2023-11-13T11:11:58.574 INFO:root:teuthology version: 0.0.1.dev203+g6899cd2 2023-11-13T11:11:58.577 DEBUG:teuthology.run:Teuthology command: teuthology --description fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/fuse objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/xfstests-dev} --verbose --archive /home/teuthworker/archive/mchangir-2023-11-13_10:27:15-fs-wip-mchangir-testing-20231110.052303-testing-default-smithi/7456244 --owner mchangir --name mchangir-2023-11-13_10:27:15-fs-wip-mchangir-testing-20231110.052303-testing-default-smithi -- /home/teuthworker/archive/mchangir-2023-11-13_10:27:15-fs-wip-mchangir-testing-20231110.052303-testing-default-smithi/7456244/orig.config.yaml 2023-11-13T11:11:58.626 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-13T11:11:58.714 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/mchangir-2023-11-13_10:27:15-fs-wip-mchangir-testing-20231110.052303-testing-default-smithi/7456244 branch: wip-mchangir-testing-20231110.052303 description: fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/fuse objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/xfstests-dev} email: mchangir@redhat.com first_in_suite: false job_id: '7456244' kernel: flavor: default kdb: true sha1: 5b73517e0e2fa132ea79290e5fc06ea5349b2288 ktype: distro last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi name: mchangir-2023-11-13_10:27:15-fs-wip-mchangir-testing-20231110.052303-testing-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: ubuntu os_version: '22.04' overrides: admin_socket: branch: wip-mchangir-testing-20231110.052303 ceph: conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 pid file: '' rados mon op timeout: 900 rados osd op timeout: 900 mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon op complaint time: 120 osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - overall HEALTH_ - \(FS_DEGRADED\) - \(MDS_FAILED\) - \(MDS_DEGRADED\) - \(FS_WITH_FAILED_MDS\) - \(MDS_DAMAGE\) - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(FS_INLINE_DATA_DEPRECATED\) - \(POOL_APP_NOT_ENABLED\) - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding sha1: 35f0debb3cc28955b7132ef4c509cd138a09d56b ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: 35f0debb3cc28955b7132ef4c509cd138a09d56b thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-mchangir-testing-20231110.052303 sha1: 35f0debb3cc28955b7132ef4c509cd138a09d56b owner: mchangir priority: 1000 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - mgr.y - mds.a - mds.c - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - client.2 - - mon.b - mon.c - mgr.x - mds.b - mds.d - osd.4 - osd.5 - osd.6 - osd.7 - client.1 - client.3 seed: 9746 sha1: 35f0debb3cc28955b7132ef4c509cd138a09d56b sleep_before_teardown: 0 subset: 768/1024 suite: fs suite_branch: wip-mchangir-testing-20231110.052303 suite_path: /home/teuthworker/src/git.ceph.com_ceph-c_35f0debb3cc28955b7132ef4c509cd138a09d56b/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph-ci.git suite_sha1: 35f0debb3cc28955b7132ef4c509cd138a09d56b syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi102.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBBcI2TSV0qNd3ch5a4V0vVrn/qrvbcXY5EvKVSqfgxKssxe7YmgPyNbPgkMrTHjeTHRtcG4DzJjr16P5Wl3BdR4= smithi154.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBA/UR6tY53tV/hRttaw/xRNVkHsaF9+RzBacTuDQ8FbEkk+ZJpl2LrtnIQHlRgvBJ9kiTJfKmB/+kxyKYllN5Zs= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - ceph: create_rbd_pool: false - ceph-fuse: null - cephfs_test_runner: fail_on_skip: false modules: - tasks.cephfs.tests_from_xfstests_dev teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return false end - local function is_kdistro() return false end - local function is_fuse() return true end - local function syntax_version() return '' end teuthology_branch: main teuthology_sha1: 6899cd26fceddb2fec83dc1a1349394b28c8998e timestamp: 2023-11-13_10:27:15 tube: smithi user: mchangir verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.3590714 2023-11-13T11:11:58.714 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph-c_35f0debb3cc28955b7132ef4c509cd138a09d56b/qa; will attempt to use it 2023-11-13T11:11:58.715 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph-c_35f0debb3cc28955b7132ef4c509cd138a09d56b/qa/tasks 2023-11-13T11:11:58.715 INFO:teuthology.run_tasks:Running task internal.check_packages... 2023-11-13T11:11:58.717 INFO:teuthology.task.internal:Checking packages... 2023-11-13T11:11:58.741 INFO:teuthology.task.internal:Checking packages for os_type 'ubuntu', flavor 'default' and ceph hash '35f0debb3cc28955b7132ef4c509cd138a09d56b' 2023-11-13T11:11:58.741 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2023-11-13T11:11:58.742 INFO:teuthology.packaging:ref: None 2023-11-13T11:11:58.742 INFO:teuthology.packaging:tag: None 2023-11-13T11:11:58.742 INFO:teuthology.packaging:branch: wip-mchangir-testing-20231110.052303 2023-11-13T11:11:58.743 INFO:teuthology.packaging:sha1: 35f0debb3cc28955b7132ef4c509cd138a09d56b 2023-11-13T11:11:58.743 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&ref=wip-mchangir-testing-20231110.052303 2023-11-13T11:11:58.889 INFO:teuthology.task.internal:Found packages for ceph version 18.0.0-7288-g35f0debb-1jammy 2023-11-13T11:11:58.890 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2023-11-13T11:11:58.901 INFO:teuthology.task.internal:no buildpackages task found 2023-11-13T11:11:58.901 INFO:teuthology.run_tasks:Running task internal.save_config... 2023-11-13T11:11:58.919 INFO:teuthology.task.internal:Saving configuration 2023-11-13T11:11:58.935 INFO:teuthology.run_tasks:Running task internal.check_lock... 2023-11-13T11:11:58.945 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-11-13T11:11:58.968 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi102.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/mchangir-2023-11-13_10:27:15-fs-wip-mchangir-testing-20231110.052303-testing-default-smithi/7456244', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-11-13 11:06:20.728869', 'locked_by': 'mchangir', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAII2kJ2SQCkDddzEPoSUZKAY/Am2Lx/qOQVWyIrQptZGt'} 2023-11-13T11:11:58.991 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi154.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/mchangir-2023-11-13_10:27:15-fs-wip-mchangir-testing-20231110.052303-testing-default-smithi/7456244', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-11-13 11:06:20.730149', 'locked_by': 'mchangir', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIOYEnl0GgFw/v5u5G1K06WbsrvsE1uDaCVPhtKjIf3qo'} 2023-11-13T11:11:58.991 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2023-11-13T11:11:58.998 INFO:teuthology.task.internal:roles: ubuntu@smithi102.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'] 2023-11-13T11:11:58.998 INFO:teuthology.task.internal:roles: ubuntu@smithi154.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3'] 2023-11-13T11:11:58.999 INFO:teuthology.run_tasks:Running task console_log... 2023-11-13T11:11:59.070 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f96ccf77b80>, signals=[15]) 2023-11-13T11:11:59.071 INFO:teuthology.run_tasks:Running task internal.connect... 2023-11-13T11:11:59.078 INFO:teuthology.task.internal:Opening connections... 2023-11-13T11:11:59.079 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi102.front.sepia.ceph.com 2023-11-13T11:11:59.080 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi102.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-13T11:11:59.156 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi154.front.sepia.ceph.com 2023-11-13T11:11:59.157 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi154.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-13T11:11:59.231 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2023-11-13T11:11:59.239 DEBUG:teuthology.orchestra.run.smithi102:> uname -m 2023-11-13T11:11:59.244 INFO:teuthology.orchestra.run.smithi102.stdout:x86_64 2023-11-13T11:11:59.245 DEBUG:teuthology.orchestra.run.smithi102:> cat /etc/os-release 2023-11-13T11:11:59.289 INFO:teuthology.orchestra.run.smithi102.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2023-11-13T11:11:59.290 INFO:teuthology.orchestra.run.smithi102.stdout:NAME="Ubuntu" 2023-11-13T11:11:59.290 INFO:teuthology.orchestra.run.smithi102.stdout:VERSION_ID="22.04" 2023-11-13T11:11:59.290 INFO:teuthology.orchestra.run.smithi102.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2023-11-13T11:11:59.290 INFO:teuthology.orchestra.run.smithi102.stdout:VERSION_CODENAME=jammy 2023-11-13T11:11:59.291 INFO:teuthology.orchestra.run.smithi102.stdout:ID=ubuntu 2023-11-13T11:11:59.291 INFO:teuthology.orchestra.run.smithi102.stdout:ID_LIKE=debian 2023-11-13T11:11:59.291 INFO:teuthology.orchestra.run.smithi102.stdout:HOME_URL="https://www.ubuntu.com/" 2023-11-13T11:11:59.291 INFO:teuthology.orchestra.run.smithi102.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-11-13T11:11:59.291 INFO:teuthology.orchestra.run.smithi102.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-11-13T11:11:59.292 INFO:teuthology.orchestra.run.smithi102.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-11-13T11:11:59.292 INFO:teuthology.orchestra.run.smithi102.stdout:UBUNTU_CODENAME=jammy 2023-11-13T11:11:59.293 INFO:teuthology.lock.ops:Updating smithi102.front.sepia.ceph.com on lock server 2023-11-13T11:11:59.314 DEBUG:teuthology.orchestra.run.smithi154:> uname -m 2023-11-13T11:11:59.319 INFO:teuthology.orchestra.run.smithi154.stdout:x86_64 2023-11-13T11:11:59.320 DEBUG:teuthology.orchestra.run.smithi154:> cat /etc/os-release 2023-11-13T11:11:59.367 INFO:teuthology.orchestra.run.smithi154.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2023-11-13T11:11:59.367 INFO:teuthology.orchestra.run.smithi154.stdout:NAME="Ubuntu" 2023-11-13T11:11:59.367 INFO:teuthology.orchestra.run.smithi154.stdout:VERSION_ID="22.04" 2023-11-13T11:11:59.367 INFO:teuthology.orchestra.run.smithi154.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2023-11-13T11:11:59.368 INFO:teuthology.orchestra.run.smithi154.stdout:VERSION_CODENAME=jammy 2023-11-13T11:11:59.368 INFO:teuthology.orchestra.run.smithi154.stdout:ID=ubuntu 2023-11-13T11:11:59.368 INFO:teuthology.orchestra.run.smithi154.stdout:ID_LIKE=debian 2023-11-13T11:11:59.368 INFO:teuthology.orchestra.run.smithi154.stdout:HOME_URL="https://www.ubuntu.com/" 2023-11-13T11:11:59.368 INFO:teuthology.orchestra.run.smithi154.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-11-13T11:11:59.369 INFO:teuthology.orchestra.run.smithi154.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-11-13T11:11:59.369 INFO:teuthology.orchestra.run.smithi154.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-11-13T11:11:59.369 INFO:teuthology.orchestra.run.smithi154.stdout:UBUNTU_CODENAME=jammy 2023-11-13T11:11:59.369 INFO:teuthology.lock.ops:Updating smithi154.front.sepia.ceph.com on lock server 2023-11-13T11:11:59.397 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2023-11-13T11:11:59.407 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2023-11-13T11:11:59.414 INFO:teuthology.task.internal:Checking for old test directory... 2023-11-13T11:11:59.414 DEBUG:teuthology.orchestra.run.smithi102:> test '!' -e /home/ubuntu/cephtest 2023-11-13T11:11:59.418 DEBUG:teuthology.orchestra.run.smithi154:> test '!' -e /home/ubuntu/cephtest 2023-11-13T11:11:59.422 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2023-11-13T11:11:59.430 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2023-11-13T11:11:59.430 DEBUG:teuthology.orchestra.run.smithi102:> test -z $(ls -A /var/lib/ceph) 2023-11-13T11:11:59.467 DEBUG:teuthology.orchestra.run.smithi154:> test -z $(ls -A /var/lib/ceph) 2023-11-13T11:11:59.526 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2023-11-13T11:11:59.584 INFO:teuthology.run_tasks:Running task kernel... 2023-11-13T11:11:59.599 INFO:teuthology.task.kernel:normalize config orig: {'flavor': 'default', 'kdb': True, 'sha1': '5b73517e0e2fa132ea79290e5fc06ea5349b2288'} 2023-11-13T11:11:59.600 INFO:teuthology.task.kernel:config {'mon.a': {'flavor': 'default', 'kdb': True, 'sha1': '5b73517e0e2fa132ea79290e5fc06ea5349b2288'}, 'mon.b': {'flavor': 'default', 'kdb': True, 'sha1': '5b73517e0e2fa132ea79290e5fc06ea5349b2288'}}, timeout 300 2023-11-13T11:11:59.601 DEBUG:teuthology.orchestra.run.smithi102:> test -f /run/.containerenv -o -f /.dockerenv 2023-11-13T11:11:59.601 DEBUG:teuthology.orchestra.run.smithi154:> test -f /run/.containerenv -o -f /.dockerenv 2023-11-13T11:11:59.606 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-13T11:11:59.607 DEBUG:teuthology.task.kernel:sha1 for mon.a is 5b73517e0e2fa132ea79290e5fc06ea5349b2288 2023-11-13T11:11:59.607 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5b73517e0e2fa132ea79290e5fc06ea5349b2288"... 2023-11-13T11:11:59.608 DEBUG:teuthology.orchestra.run.smithi102:> uname -r 2023-11-13T11:11:59.608 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-13T11:11:59.609 DEBUG:teuthology.task.kernel:sha1 for mon.b is 5b73517e0e2fa132ea79290e5fc06ea5349b2288 2023-11-13T11:11:59.609 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "5b73517e0e2fa132ea79290e5fc06ea5349b2288"... 2023-11-13T11:11:59.610 DEBUG:teuthology.orchestra.run.smithi154:> uname -r 2023-11-13T11:11:59.651 INFO:teuthology.orchestra.run.smithi154.stdout:5.15.0-56-generic 2023-11-13T11:11:59.651 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-56-generic vs 5b73517e0e2fa132ea79290e5fc06ea5349b2288 2023-11-13T11:11:59.652 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2023-11-13T11:11:59.652 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=5b73517e0e2fa132ea79290e5fc06ea5349b2288 2023-11-13T11:11:59.656 INFO:teuthology.orchestra.run.smithi102.stdout:5.15.0-56-generic 2023-11-13T11:11:59.657 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-56-generic vs 5b73517e0e2fa132ea79290e5fc06ea5349b2288 2023-11-13T11:11:59.657 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2023-11-13T11:11:59.657 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=5b73517e0e2fa132ea79290e5fc06ea5349b2288 2023-11-13T11:11:59.795 INFO:teuthology.task.kernel:Installing linux-firmware on mon.b... 2023-11-13T11:11:59.795 DEBUG:teuthology.orchestra.run.smithi154:> cd /lib/firmware/updates && test -d .git && test '!' -s .git/HEAD && sudo rm -rf .git ; sudo install -d -m0755 /lib/firmware/updates && cd /lib/firmware/updates && sudo git init 2023-11-13T11:11:59.810 INFO:teuthology.orchestra.run.smithi154.stderr:bash: line 1: cd: /lib/firmware/updates: No such file or directory 2023-11-13T11:11:59.869 INFO:teuthology.task.kernel:Installing linux-firmware on mon.a... 2023-11-13T11:11:59.870 DEBUG:teuthology.orchestra.run.smithi102:> cd /lib/firmware/updates && test -d .git && test '!' -s .git/HEAD && sudo rm -rf .git ; sudo install -d -m0755 /lib/firmware/updates && cd /lib/firmware/updates && sudo git init 2023-11-13T11:11:59.886 INFO:teuthology.orchestra.run.smithi102.stderr:bash: line 1: cd: /lib/firmware/updates: No such file or directory 2023-11-13T11:11:59.943 INFO:teuthology.orchestra.run.smithi154.stderr:hint: Using 'master' as the name for the initial branch. This default branch name 2023-11-13T11:11:59.943 INFO:teuthology.orchestra.run.smithi154.stderr:hint: is subject to change. To configure the initial branch name to use in all 2023-11-13T11:11:59.943 INFO:teuthology.orchestra.run.smithi154.stderr:hint: of your new repositories, which will suppress this warning, call: 2023-11-13T11:11:59.944 INFO:teuthology.orchestra.run.smithi154.stderr:hint: 2023-11-13T11:11:59.944 INFO:teuthology.orchestra.run.smithi154.stderr:hint: git config --global init.defaultBranch 2023-11-13T11:11:59.944 INFO:teuthology.orchestra.run.smithi154.stderr:hint: 2023-11-13T11:11:59.944 INFO:teuthology.orchestra.run.smithi154.stderr:hint: Names commonly chosen instead of 'master' are 'main', 'trunk' and 2023-11-13T11:11:59.944 INFO:teuthology.orchestra.run.smithi154.stderr:hint: 'development'. The just-created branch can be renamed via this command: 2023-11-13T11:11:59.945 INFO:teuthology.orchestra.run.smithi154.stderr:hint: 2023-11-13T11:11:59.945 INFO:teuthology.orchestra.run.smithi154.stderr:hint: git branch -m 2023-11-13T11:11:59.945 INFO:teuthology.orchestra.run.smithi154.stdout:Initialized empty Git repository in /usr/lib/firmware/updates/.git/ 2023-11-13T11:11:59.947 DEBUG:teuthology.orchestra.run.smithi154:> sudo git --git-dir=/lib/firmware/updates/.git config --get remote.origin.url >/dev/null || sudo git --git-dir=/lib/firmware/updates/.git remote add origin git://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware.git 2023-11-13T11:12:00.014 DEBUG:teuthology.orchestra.run.smithi154:> sudo git --git-dir=/lib/firmware/updates/.git remote set-url origin git://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware.git >/dev/null 2023-11-13T11:12:00.034 INFO:teuthology.orchestra.run.smithi102.stderr:hint: Using 'master' as the name for the initial branch. This default branch name 2023-11-13T11:12:00.034 INFO:teuthology.orchestra.run.smithi102.stderr:hint: is subject to change. To configure the initial branch name to use in all 2023-11-13T11:12:00.035 INFO:teuthology.orchestra.run.smithi102.stderr:hint: of your new repositories, which will suppress this warning, call: 2023-11-13T11:12:00.035 INFO:teuthology.orchestra.run.smithi102.stderr:hint: 2023-11-13T11:12:00.035 INFO:teuthology.orchestra.run.smithi102.stderr:hint: git config --global init.defaultBranch 2023-11-13T11:12:00.035 INFO:teuthology.orchestra.run.smithi102.stderr:hint: 2023-11-13T11:12:00.036 INFO:teuthology.orchestra.run.smithi102.stderr:hint: Names commonly chosen instead of 'master' are 'main', 'trunk' and 2023-11-13T11:12:00.036 INFO:teuthology.orchestra.run.smithi102.stderr:hint: 'development'. The just-created branch can be renamed via this command: 2023-11-13T11:12:00.036 INFO:teuthology.orchestra.run.smithi102.stderr:hint: 2023-11-13T11:12:00.036 INFO:teuthology.orchestra.run.smithi102.stderr:hint: git branch -m 2023-11-13T11:12:00.037 INFO:teuthology.orchestra.run.smithi102.stdout:Initialized empty Git repository in /usr/lib/firmware/updates/.git/ 2023-11-13T11:12:00.038 DEBUG:teuthology.orchestra.run.smithi102:> sudo git --git-dir=/lib/firmware/updates/.git config --get remote.origin.url >/dev/null || sudo git --git-dir=/lib/firmware/updates/.git remote add origin git://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware.git 2023-11-13T11:12:00.067 DEBUG:teuthology.orchestra.run.smithi154:> cd /lib/firmware/updates && sudo git fetch origin && sudo git reset --hard origin/main 2023-11-13T11:12:00.107 DEBUG:teuthology.orchestra.run.smithi102:> sudo git --git-dir=/lib/firmware/updates/.git remote set-url origin git://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware.git >/dev/null 2023-11-13T11:12:00.162 DEBUG:teuthology.orchestra.run.smithi102:> cd /lib/firmware/updates && sudo git fetch origin && sudo git reset --hard origin/main 2023-11-13T11:13:33.610 INFO:teuthology.orchestra.run.smithi154.stderr:From git://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware 2023-11-13T11:13:33.611 INFO:teuthology.orchestra.run.smithi154.stderr: * [new branch] main -> origin/main 2023-11-13T11:13:33.611 INFO:teuthology.orchestra.run.smithi154.stderr: * [new tag] 20231111 -> 20231111 2023-11-13T11:13:33.640 INFO:teuthology.orchestra.run.smithi154.stderr: * [new tag] 20190312 -> 20190312 2023-11-13T11:13:33.641 INFO:teuthology.orchestra.run.smithi154.stderr: * [new tag] 20190416 -> 20190416 2023-11-13T11:13:33.641 INFO:teuthology.orchestra.run.smithi154.stderr: * [new tag] 20190514 -> 20190514 2023-11-13T11:13:33.642 INFO:teuthology.orchestra.run.smithi154.stderr: * [new tag] 20190618 -> 20190618 2023-11-13T11:13:33.642 INFO:teuthology.orchestra.run.smithi154.stderr: * [new tag] 20190717 -> 20190717 2023-11-13T11:13:33.643 INFO:teuthology.orchestra.run.smithi154.stderr: * [new tag] 20190815 -> 20190815 2023-11-13T11:13:33.643 INFO:teuthology.orchestra.run.smithi154.stderr: * [new tag] 20190923 -> 20190923 2023-11-13T11:13:33.643 INFO:teuthology.orchestra.run.smithi154.stderr: * [new tag] 20191022 -> 20191022 2023-11-13T11:13:33.643 INFO:teuthology.orchestra.run.smithi154.stderr: * [new tag] 20191215 -> 20191215 2023-11-13T11:13:33.643 INFO:teuthology.orchestra.run.smithi154.stderr: * [new tag] 20200122 -> 20200122 2023-11-13T11:13:33.644 INFO:teuthology.orchestra.run.smithi154.stderr: * [new tag] 20200316 -> 20200316 2023-11-13T11:13:33.644 INFO:teuthology.orchestra.run.smithi154.stderr: * [new tag] 20200421 -> 20200421 2023-11-13T11:13:33.644 INFO:teuthology.orchestra.run.smithi154.stderr: * [new tag] 20200519 -> 20200519 2023-11-13T11:13:33.646 INFO:teuthology.orchestra.run.smithi154.stderr: * [new tag] 20200619 -> 20200619 2023-11-13T11:13:33.647 INFO:teuthology.orchestra.run.smithi154.stderr: * [new tag] 20200721 -> 20200721 2023-11-13T11:13:33.647 INFO:teuthology.orchestra.run.smithi154.stderr: * [new tag] 20200817 -> 20200817 2023-11-13T11:13:33.647 INFO:teuthology.orchestra.run.smithi154.stderr: * [new tag] 20200918 -> 20200918 2023-11-13T11:13:33.647 INFO:teuthology.orchestra.run.smithi154.stderr: * [new tag] 20201022 -> 20201022 2023-11-13T11:13:33.647 INFO:teuthology.orchestra.run.smithi154.stderr: * [new tag] 20201118 -> 20201118 2023-11-13T11:13:33.648 INFO:teuthology.orchestra.run.smithi154.stderr: * [new tag] 20201218 -> 20201218 2023-11-13T11:13:33.648 INFO:teuthology.orchestra.run.smithi154.stderr: * [new tag] 20210208 -> 20210208 2023-11-13T11:13:33.648 INFO:teuthology.orchestra.run.smithi154.stderr: * [new tag] 20210315 -> 20210315 2023-11-13T11:13:33.648 INFO:teuthology.orchestra.run.smithi154.stderr: * [new tag] 20210511 -> 20210511 2023-11-13T11:13:33.648 INFO:teuthology.orchestra.run.smithi154.stderr: * [new tag] 20210716 -> 20210716 2023-11-13T11:13:33.649 INFO:teuthology.orchestra.run.smithi154.stderr: * [new tag] 20210818 -> 20210818 2023-11-13T11:13:33.649 INFO:teuthology.orchestra.run.smithi154.stderr: * [new tag] 20210919 -> 20210919 2023-11-13T11:13:33.649 INFO:teuthology.orchestra.run.smithi154.stderr: * [new tag] 20211027 -> 20211027 2023-11-13T11:13:33.649 INFO:teuthology.orchestra.run.smithi154.stderr: * [new tag] 20211216 -> 20211216 2023-11-13T11:13:33.649 INFO:teuthology.orchestra.run.smithi154.stderr: * [new tag] 20220209 -> 20220209 2023-11-13T11:13:33.649 INFO:teuthology.orchestra.run.smithi154.stderr: * [new tag] 20220310 -> 20220310 2023-11-13T11:13:33.650 INFO:teuthology.orchestra.run.smithi154.stderr: * [new tag] 20220411 -> 20220411 2023-11-13T11:13:33.650 INFO:teuthology.orchestra.run.smithi154.stderr: * [new tag] 20220509 -> 20220509 2023-11-13T11:13:33.650 INFO:teuthology.orchestra.run.smithi154.stderr: * [new tag] 20220610 -> 20220610 2023-11-13T11:13:33.652 INFO:teuthology.orchestra.run.smithi154.stderr: * [new tag] 20220708 -> 20220708 2023-11-13T11:13:33.652 INFO:teuthology.orchestra.run.smithi154.stderr: * [new tag] 20220815 -> 20220815 2023-11-13T11:13:33.652 INFO:teuthology.orchestra.run.smithi154.stderr: * [new tag] 20220913 -> 20220913 2023-11-13T11:13:33.652 INFO:teuthology.orchestra.run.smithi154.stderr: * [new tag] 20221012 -> 20221012 2023-11-13T11:13:33.653 INFO:teuthology.orchestra.run.smithi154.stderr: * [new tag] 20221109 -> 20221109 2023-11-13T11:13:33.653 INFO:teuthology.orchestra.run.smithi154.stderr: * [new tag] 20221214 -> 20221214 2023-11-13T11:13:33.653 INFO:teuthology.orchestra.run.smithi154.stderr: * [new tag] 20230117 -> 20230117 2023-11-13T11:13:33.653 INFO:teuthology.orchestra.run.smithi154.stderr: * [new tag] 20230210 -> 20230210 2023-11-13T11:13:33.653 INFO:teuthology.orchestra.run.smithi154.stderr: * [new tag] 20230310 -> 20230310 2023-11-13T11:13:33.653 INFO:teuthology.orchestra.run.smithi154.stderr: * [new tag] 20230404 -> 20230404 2023-11-13T11:13:33.654 INFO:teuthology.orchestra.run.smithi154.stderr: * [new tag] 20230515 -> 20230515 2023-11-13T11:13:33.654 INFO:teuthology.orchestra.run.smithi154.stderr: * [new tag] 20230625 -> 20230625 2023-11-13T11:13:33.654 INFO:teuthology.orchestra.run.smithi154.stderr: * [new tag] 20230804 -> 20230804 2023-11-13T11:13:33.654 INFO:teuthology.orchestra.run.smithi154.stderr: * [new tag] 20230919 -> 20230919 2023-11-13T11:13:33.654 INFO:teuthology.orchestra.run.smithi154.stderr: * [new tag] 20231030 -> 20231030 2023-11-13T11:13:37.548 INFO:teuthology.orchestra.run.smithi154.stderr:Updating files: 51% (1644/3193) Updating files: 52% (1661/3193) Updating files: 53% (1693/3193) Updating files: 54% (1725/3193) Updating files: 55% (1757/3193) Updating files: 56% (1789/3193) Updating files: 57% (1821/3193) Updating files: 58% (1852/3193) Updating files: 59% (1884/3193) Updating files: 60% (1916/3193) Updating files: 61% (1948/3193) Updating files: 62% (1980/3193) Updating files: 63% (2012/3193) Updating files: 64% (2044/3193) Updating files: 65% (2076/3193) Updating files: 66% (2108/3193) Updating files: 66% (2118/3193) Updating files: 67% (2140/3193) Updating files: 68% (2172/3193) Updating files: 69% (2204/3193) Updating files: 70% (2236/3193) Updating files: 71% (2268/3193) Updating files: 72% (2299/3193) Updating files: 73% (2331/3193) Updating files: 74% (2363/3193) Updating files: 75% (2395/3193) Updating files: 76% (2427/3193) Updating files: 77% (2459/3193) Updating files: 78% (2491/3193) Updating files: 79% (2523/3193) Updating files: 80% (2555/3193) Updating files: 81% (2587/3193) Updating files: 81% (2602/3193) Updating files: 82% (2619/3193) Updating files: 83% (2651/3193) Updating files: 84% (2683/3193) Updating files: 85% (2715/3193) Updating files: 86% (2746/3193) Updating files: 87% (2778/3193) Updating files: 88% (2810/3193) Updating files: 89% (2842/3193) Updating files: 90% (2874/3193) Updating files: 91% (2906/3193) Updating files: 92% (2938/3193) Updating files: 93% (2970/3193) Updating files: 94% (3002/3193) Updating files: 95% (3034/3193) Updating files: 96% (3066/3193) Updating files: 97% (3098/3193) Updating files: 98% (3130/3193) Updating files: 99% (3162/3193) Updating files: 100% (3193/3193) Updating files: 100% (3193/3193), done. 2023-11-13T11:13:37.553 INFO:teuthology.orchestra.run.smithi154.stdout:HEAD is now at 74158e7a Merge branch 'amd-2023-11-10' into 'main' 2023-11-13T11:13:37.573 INFO:teuthology.task.kernel:Downloading kernel 5b73517e0e2fa132ea79290e5fc06ea5349b2288 on mon.b... 2023-11-13T11:13:37.574 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=5b73517e0e2fa132ea79290e5fc06ea5349b2288 2023-11-13T11:13:37.875 INFO:teuthology.task.kernel:fetching, builder baseurl is https://3.chacra.ceph.com/r/kernel/testing/5b73517e0e2fa132ea79290e5fc06ea5349b2288/ubuntu/jammy/flavors/default/pool/main/l/linux-6.6.0-rc5-g5b73517e0e2f/ 2023-11-13T11:13:37.875 DEBUG:teuthology.orchestra.run.smithi154:> rm -f /tmp/linux-image.deb && echo linux-image-6.6.0-rc5-g5b73517e0e2f_6.6.0-rc5-g5b73517e0e2f-1_amd64.deb | wget -nv -O /tmp/linux-image.deb --base=https://3.chacra.ceph.com/r/kernel/testing/5b73517e0e2fa132ea79290e5fc06ea5349b2288/ubuntu/jammy/flavors/default/pool/main/l/linux-6.6.0-rc5-g5b73517e0e2f/ --input-file=- 2023-11-13T11:13:37.878 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi154.front.sepia.ceph.com to complete... 2023-11-13T11:13:39.848 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-13 11:13:39 URL:https://3.chacra.ceph.com/r/kernel/testing/5b73517e0e2fa132ea79290e5fc06ea5349b2288/ubuntu/jammy/flavors/default/pool/main/l/linux-6.6.0-rc5-g5b73517e0e2f/linux-image-6.6.0-rc5-g5b73517e0e2f_6.6.0-rc5-g5b73517e0e2f-1_amd64.deb [38911386/38911386] -> "/tmp/linux-image.deb" [1] 2023-11-13T11:13:39.848 INFO:teuthology.orchestra.run.smithi154.stderr:FINISHED --2023-11-13 11:13:39-- 2023-11-13T11:13:39.848 INFO:teuthology.orchestra.run.smithi154.stderr:Total wall clock time: 1.9s 2023-11-13T11:13:39.849 INFO:teuthology.orchestra.run.smithi154.stderr:Downloaded: 1 files, 37M in 1.7s (21.6 MB/s) 2023-11-13T11:13:39.851 INFO:teuthology.task.kernel:Installing kernel 5b73517e0e2fa132ea79290e5fc06ea5349b2288 on mon.b... 2023-11-13T11:13:39.851 DEBUG:teuthology.orchestra.run.smithi154:> sudo dpkg -i /tmp/linux-image.deb 2023-11-13T11:13:40.119 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package linux-image-6.6.0-rc5-g5b73517e0e2f. 2023-11-13T11:13:42.165 INFO:teuthology.orchestra.run.smithi154.stdout:(Reading database ... 129542 files and directories currently installed.) 2023-11-13T11:13:42.169 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack /tmp/linux-image.deb ... 2023-11-13T11:13:42.274 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking linux-image-6.6.0-rc5-g5b73517e0e2f (6.6.0-rc5-g5b73517e0e2f-1) ... 2023-11-13T11:13:45.501 INFO:teuthology.orchestra.run.smithi102.stderr:From git://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware 2023-11-13T11:13:45.502 INFO:teuthology.orchestra.run.smithi102.stderr: * [new branch] main -> origin/main 2023-11-13T11:13:45.502 INFO:teuthology.orchestra.run.smithi102.stderr: * [new tag] 20231111 -> 20231111 2023-11-13T11:13:45.525 INFO:teuthology.orchestra.run.smithi102.stderr: * [new tag] 20190312 -> 20190312 2023-11-13T11:13:45.525 INFO:teuthology.orchestra.run.smithi102.stderr: * [new tag] 20190416 -> 20190416 2023-11-13T11:13:45.525 INFO:teuthology.orchestra.run.smithi102.stderr: * [new tag] 20190514 -> 20190514 2023-11-13T11:13:45.526 INFO:teuthology.orchestra.run.smithi102.stderr: * [new tag] 20190618 -> 20190618 2023-11-13T11:13:45.527 INFO:teuthology.orchestra.run.smithi102.stderr: * [new tag] 20190717 -> 20190717 2023-11-13T11:13:45.527 INFO:teuthology.orchestra.run.smithi102.stderr: * [new tag] 20190815 -> 20190815 2023-11-13T11:13:45.527 INFO:teuthology.orchestra.run.smithi102.stderr: * [new tag] 20190923 -> 20190923 2023-11-13T11:13:45.528 INFO:teuthology.orchestra.run.smithi102.stderr: * [new tag] 20191022 -> 20191022 2023-11-13T11:13:45.528 INFO:teuthology.orchestra.run.smithi102.stderr: * [new tag] 20191215 -> 20191215 2023-11-13T11:13:45.528 INFO:teuthology.orchestra.run.smithi102.stderr: * [new tag] 20200122 -> 20200122 2023-11-13T11:13:45.528 INFO:teuthology.orchestra.run.smithi102.stderr: * [new tag] 20200316 -> 20200316 2023-11-13T11:13:45.528 INFO:teuthology.orchestra.run.smithi102.stderr: * [new tag] 20200421 -> 20200421 2023-11-13T11:13:45.529 INFO:teuthology.orchestra.run.smithi102.stderr: * [new tag] 20200519 -> 20200519 2023-11-13T11:13:45.529 INFO:teuthology.orchestra.run.smithi102.stderr: * [new tag] 20200619 -> 20200619 2023-11-13T11:13:45.531 INFO:teuthology.orchestra.run.smithi102.stderr: * [new tag] 20200721 -> 20200721 2023-11-13T11:13:45.532 INFO:teuthology.orchestra.run.smithi102.stderr: * [new tag] 20200817 -> 20200817 2023-11-13T11:13:45.532 INFO:teuthology.orchestra.run.smithi102.stderr: * [new tag] 20200918 -> 20200918 2023-11-13T11:13:45.532 INFO:teuthology.orchestra.run.smithi102.stderr: * [new tag] 20201022 -> 20201022 2023-11-13T11:13:45.532 INFO:teuthology.orchestra.run.smithi102.stderr: * [new tag] 20201118 -> 20201118 2023-11-13T11:13:45.532 INFO:teuthology.orchestra.run.smithi102.stderr: * [new tag] 20201218 -> 20201218 2023-11-13T11:13:45.533 INFO:teuthology.orchestra.run.smithi102.stderr: * [new tag] 20210208 -> 20210208 2023-11-13T11:13:45.533 INFO:teuthology.orchestra.run.smithi102.stderr: * [new tag] 20210315 -> 20210315 2023-11-13T11:13:45.533 INFO:teuthology.orchestra.run.smithi102.stderr: * [new tag] 20210511 -> 20210511 2023-11-13T11:13:45.533 INFO:teuthology.orchestra.run.smithi102.stderr: * [new tag] 20210716 -> 20210716 2023-11-13T11:13:45.533 INFO:teuthology.orchestra.run.smithi102.stderr: * [new tag] 20210818 -> 20210818 2023-11-13T11:13:45.534 INFO:teuthology.orchestra.run.smithi102.stderr: * [new tag] 20210919 -> 20210919 2023-11-13T11:13:45.534 INFO:teuthology.orchestra.run.smithi102.stderr: * [new tag] 20211027 -> 20211027 2023-11-13T11:13:45.534 INFO:teuthology.orchestra.run.smithi102.stderr: * [new tag] 20211216 -> 20211216 2023-11-13T11:13:45.535 INFO:teuthology.orchestra.run.smithi102.stderr: * [new tag] 20220209 -> 20220209 2023-11-13T11:13:45.535 INFO:teuthology.orchestra.run.smithi102.stderr: * [new tag] 20220310 -> 20220310 2023-11-13T11:13:45.535 INFO:teuthology.orchestra.run.smithi102.stderr: * [new tag] 20220411 -> 20220411 2023-11-13T11:13:45.536 INFO:teuthology.orchestra.run.smithi102.stderr: * [new tag] 20220509 -> 20220509 2023-11-13T11:13:45.536 INFO:teuthology.orchestra.run.smithi102.stderr: * [new tag] 20220610 -> 20220610 2023-11-13T11:13:45.536 INFO:teuthology.orchestra.run.smithi102.stderr: * [new tag] 20220708 -> 20220708 2023-11-13T11:13:45.537 INFO:teuthology.orchestra.run.smithi102.stderr: * [new tag] 20220815 -> 20220815 2023-11-13T11:13:45.537 INFO:teuthology.orchestra.run.smithi102.stderr: * [new tag] 20220913 -> 20220913 2023-11-13T11:13:45.538 INFO:teuthology.orchestra.run.smithi102.stderr: * [new tag] 20221012 -> 20221012 2023-11-13T11:13:45.538 INFO:teuthology.orchestra.run.smithi102.stderr: * [new tag] 20221109 -> 20221109 2023-11-13T11:13:45.540 INFO:teuthology.orchestra.run.smithi102.stderr: * [new tag] 20221214 -> 20221214 2023-11-13T11:13:45.541 INFO:teuthology.orchestra.run.smithi102.stderr: * [new tag] 20230117 -> 20230117 2023-11-13T11:13:45.541 INFO:teuthology.orchestra.run.smithi102.stderr: * [new tag] 20230210 -> 20230210 2023-11-13T11:13:45.541 INFO:teuthology.orchestra.run.smithi102.stderr: * [new tag] 20230310 -> 20230310 2023-11-13T11:13:45.542 INFO:teuthology.orchestra.run.smithi102.stderr: * [new tag] 20230404 -> 20230404 2023-11-13T11:13:45.542 INFO:teuthology.orchestra.run.smithi102.stderr: * [new tag] 20230515 -> 20230515 2023-11-13T11:13:45.542 INFO:teuthology.orchestra.run.smithi102.stderr: * [new tag] 20230625 -> 20230625 2023-11-13T11:13:45.543 INFO:teuthology.orchestra.run.smithi102.stderr: * [new tag] 20230804 -> 20230804 2023-11-13T11:13:45.543 INFO:teuthology.orchestra.run.smithi102.stderr: * [new tag] 20230919 -> 20230919 2023-11-13T11:13:45.543 INFO:teuthology.orchestra.run.smithi102.stderr: * [new tag] 20231030 -> 20231030 2023-11-13T11:13:45.862 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up linux-image-6.6.0-rc5-g5b73517e0e2f (6.6.0-rc5-g5b73517e0e2f-1) ... 2023-11-13T11:13:45.968 INFO:teuthology.orchestra.run.smithi154.stderr:update-initramfs: Generating /boot/initrd.img-6.6.0-rc5-g5b73517e0e2f 2023-11-13T11:13:49.423 INFO:teuthology.orchestra.run.smithi102.stderr:Updating files: 51% (1642/3193) Updating files: 52% (1661/3193) Updating files: 53% (1693/3193) Updating files: 54% (1725/3193) Updating files: 55% (1757/3193) Updating files: 56% (1789/3193) Updating files: 57% (1821/3193) Updating files: 58% (1852/3193) Updating files: 59% (1884/3193) Updating files: 60% (1916/3193) Updating files: 61% (1948/3193) Updating files: 62% (1980/3193) Updating files: 63% (2012/3193) Updating files: 64% (2044/3193) Updating files: 65% (2076/3193) Updating files: 66% (2108/3193) Updating files: 66% (2118/3193) Updating files: 67% (2140/3193) Updating files: 68% (2172/3193) Updating files: 69% (2204/3193) Updating files: 70% (2236/3193) Updating files: 71% (2268/3193) Updating files: 72% (2299/3193) Updating files: 73% (2331/3193) Updating files: 74% (2363/3193) Updating files: 75% (2395/3193) Updating files: 76% (2427/3193) Updating files: 77% (2459/3193) Updating files: 78% (2491/3193) Updating files: 79% (2523/3193) Updating files: 80% (2555/3193) Updating files: 81% (2587/3193) Updating files: 81% (2602/3193) Updating files: 82% (2619/3193) Updating files: 83% (2651/3193) Updating files: 84% (2683/3193) Updating files: 85% (2715/3193) Updating files: 86% (2746/3193) Updating files: 87% (2778/3193) Updating files: 88% (2810/3193) Updating files: 89% (2842/3193) Updating files: 90% (2874/3193) Updating files: 91% (2906/3193) Updating files: 92% (2938/3193) Updating files: 93% (2970/3193) Updating files: 94% (3002/3193) Updating files: 95% (3034/3193) Updating files: 96% (3066/3193) Updating files: 97% (3098/3193) Updating files: 98% (3130/3193) Updating files: 99% (3162/3193) Updating files: 100% (3193/3193) Updating files: 100% (3193/3193), done. 2023-11-13T11:13:49.428 INFO:teuthology.orchestra.run.smithi102.stdout:HEAD is now at 74158e7a Merge branch 'amd-2023-11-10' into 'main' 2023-11-13T11:13:49.448 INFO:teuthology.task.kernel:Downloading kernel 5b73517e0e2fa132ea79290e5fc06ea5349b2288 on mon.a... 2023-11-13T11:13:49.449 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=5b73517e0e2fa132ea79290e5fc06ea5349b2288 2023-11-13T11:13:49.597 INFO:teuthology.task.kernel:fetching, builder baseurl is https://3.chacra.ceph.com/r/kernel/testing/5b73517e0e2fa132ea79290e5fc06ea5349b2288/ubuntu/jammy/flavors/default/pool/main/l/linux-6.6.0-rc5-g5b73517e0e2f/ 2023-11-13T11:13:49.598 DEBUG:teuthology.orchestra.run.smithi102:> rm -f /tmp/linux-image.deb && echo linux-image-6.6.0-rc5-g5b73517e0e2f_6.6.0-rc5-g5b73517e0e2f-1_amd64.deb | wget -nv -O /tmp/linux-image.deb --base=https://3.chacra.ceph.com/r/kernel/testing/5b73517e0e2fa132ea79290e5fc06ea5349b2288/ubuntu/jammy/flavors/default/pool/main/l/linux-6.6.0-rc5-g5b73517e0e2f/ --input-file=- 2023-11-13T11:13:49.601 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi102.front.sepia.ceph.com to complete... 2023-11-13T11:13:51.618 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13 11:13:51 URL:https://3.chacra.ceph.com/r/kernel/testing/5b73517e0e2fa132ea79290e5fc06ea5349b2288/ubuntu/jammy/flavors/default/pool/main/l/linux-6.6.0-rc5-g5b73517e0e2f/linux-image-6.6.0-rc5-g5b73517e0e2f_6.6.0-rc5-g5b73517e0e2f-1_amd64.deb [38911386/38911386] -> "/tmp/linux-image.deb" [1] 2023-11-13T11:13:51.619 INFO:teuthology.orchestra.run.smithi102.stderr:FINISHED --2023-11-13 11:13:51-- 2023-11-13T11:13:51.619 INFO:teuthology.orchestra.run.smithi102.stderr:Total wall clock time: 2.0s 2023-11-13T11:13:51.619 INFO:teuthology.orchestra.run.smithi102.stderr:Downloaded: 1 files, 37M in 1.6s (23.6 MB/s) 2023-11-13T11:13:51.622 INFO:teuthology.task.kernel:Installing kernel 5b73517e0e2fa132ea79290e5fc06ea5349b2288 on mon.a... 2023-11-13T11:13:51.622 DEBUG:teuthology.orchestra.run.smithi102:> sudo dpkg -i /tmp/linux-image.deb 2023-11-13T11:13:52.131 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package linux-image-6.6.0-rc5-g5b73517e0e2f. 2023-11-13T11:13:54.214 INFO:teuthology.orchestra.run.smithi102.stdout:(Reading database ... 129542 files and directories currently installed.) 2023-11-13T11:13:54.218 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack /tmp/linux-image.deb ... 2023-11-13T11:13:54.317 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking linux-image-6.6.0-rc5-g5b73517e0e2f (6.6.0-rc5-g5b73517e0e2f-1) ... 2023-11-13T11:13:57.749 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up linux-image-6.6.0-rc5-g5b73517e0e2f (6.6.0-rc5-g5b73517e0e2f-1) ... 2023-11-13T11:13:57.852 INFO:teuthology.orchestra.run.smithi102.stderr:update-initramfs: Generating /boot/initrd.img-6.6.0-rc5-g5b73517e0e2f 2023-11-13T11:14:06.430 INFO:teuthology.orchestra.run.smithi154.stderr:Sourcing file `/etc/default/grub' 2023-11-13T11:14:06.444 INFO:teuthology.orchestra.run.smithi154.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2023-11-13T11:14:06.462 INFO:teuthology.orchestra.run.smithi154.stderr:Generating grub configuration file ... 2023-11-13T11:14:06.763 INFO:teuthology.orchestra.run.smithi154.stderr:Found linux image: /boot/vmlinuz-6.6.0-rc5-g5b73517e0e2f 2023-11-13T11:14:06.782 INFO:teuthology.orchestra.run.smithi154.stderr:Found initrd image: /boot/initrd.img-6.6.0-rc5-g5b73517e0e2f 2023-11-13T11:14:07.050 INFO:teuthology.orchestra.run.smithi154.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2023-11-13T11:14:07.062 INFO:teuthology.orchestra.run.smithi154.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2023-11-13T11:14:07.121 INFO:teuthology.orchestra.run.smithi154.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2023-11-13T11:14:07.126 INFO:teuthology.orchestra.run.smithi154.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2023-11-13T11:14:07.285 INFO:teuthology.orchestra.run.smithi154.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2023-11-13T11:14:07.286 INFO:teuthology.orchestra.run.smithi154.stderr:Systems on them will not be added to the GRUB boot configuration. 2023-11-13T11:14:07.286 INFO:teuthology.orchestra.run.smithi154.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2023-11-13T11:14:07.318 INFO:teuthology.orchestra.run.smithi154.stderr:done 2023-11-13T11:14:07.494 DEBUG:teuthology.orchestra.run.smithi154:> dpkg-deb -c /tmp/linux-image.deb 2023-11-13T11:14:07.501 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./ 2023-11-13T11:14:07.501 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./boot/ 2023-11-13T11:14:07.502 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 4415097 2023-10-25 03:19 ./boot/System.map-6.6.0-rc5-g5b73517e0e2f 2023-11-13T11:14:07.511 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 169298 2023-10-25 03:19 ./boot/config-6.6.0-rc5-g5b73517e0e2f 2023-11-13T11:14:07.511 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 11352928 2023-10-25 03:19 ./boot/vmlinuz-6.6.0-rc5-g5b73517e0e2f 2023-11-13T11:14:07.528 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./etc/ 2023-11-13T11:14:07.529 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./etc/kernel/ 2023-11-13T11:14:07.529 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./etc/kernel/postinst.d/ 2023-11-13T11:14:07.529 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./etc/kernel/postrm.d/ 2023-11-13T11:14:07.529 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./etc/kernel/preinst.d/ 2023-11-13T11:14:07.529 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./etc/kernel/prerm.d/ 2023-11-13T11:14:07.530 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/ 2023-11-13T11:14:07.530 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/ 2023-11-13T11:14:07.530 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/ 2023-11-13T11:14:07.530 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/ 2023-11-13T11:14:07.531 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/arch/ 2023-11-13T11:14:07.531 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/arch/x86/ 2023-11-13T11:14:07.531 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/arch/x86/crypto/ 2023-11-13T11:14:07.531 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 490233 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/arch/x86/crypto/aesni-intel.ko 2023-11-13T11:14:07.534 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 25329 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/arch/x86/crypto/blowfish-x86_64.ko 2023-11-13T11:14:07.535 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 29529 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2023-11-13T11:14:07.535 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 30313 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2023-11-13T11:14:07.535 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 93113 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/arch/x86/crypto/camellia-x86_64.ko 2023-11-13T11:14:07.535 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 106729 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2023-11-13T11:14:07.536 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 152241 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2023-11-13T11:14:07.536 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 12553 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/arch/x86/crypto/crc32-pclmul.ko 2023-11-13T11:14:07.536 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 13777 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2023-11-13T11:14:07.537 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 83889 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2023-11-13T11:14:07.537 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 18625 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2023-11-13T11:14:07.537 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 47225 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2023-11-13T11:14:07.537 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 47209 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/arch/x86/crypto/serpent-avx2.ko 2023-11-13T11:14:07.538 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 51801 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2023-11-13T11:14:07.538 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 38937 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/arch/x86/crypto/sha1-ssse3.ko 2023-11-13T11:14:07.538 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 40529 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/arch/x86/crypto/sha256-ssse3.ko 2023-11-13T11:14:07.538 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 58585 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/arch/x86/crypto/sha512-ssse3.ko 2023-11-13T11:14:07.539 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 50497 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2023-11-13T11:14:07.539 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 32065 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2023-11-13T11:14:07.539 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 13625 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/arch/x86/crypto/twofish-x86_64.ko 2023-11-13T11:14:07.539 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/arch/x86/kernel/ 2023-11-13T11:14:07.540 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/arch/x86/kernel/cpu/ 2023-11-13T11:14:07.540 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/arch/x86/kernel/cpu/mce/ 2023-11-13T11:14:07.540 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 40113 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2023-11-13T11:14:07.540 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 13353 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/arch/x86/kernel/cpuid.ko 2023-11-13T11:14:07.540 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 17937 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/arch/x86/kernel/msr.ko 2023-11-13T11:14:07.541 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/arch/x86/kvm/ 2023-11-13T11:14:07.541 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 353761 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/arch/x86/kvm/kvm-amd.ko 2023-11-13T11:14:07.541 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 881713 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/arch/x86/kvm/kvm-intel.ko 2023-11-13T11:14:07.541 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 2276817 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/arch/x86/kvm/kvm.ko 2023-11-13T11:14:07.607 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/crypto/ 2023-11-13T11:14:07.607 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 53761 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/crypto/af_alg.ko 2023-11-13T11:14:07.607 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 23097 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/crypto/algif_hash.ko 2023-11-13T11:14:07.608 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 20049 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/crypto/algif_skcipher.ko 2023-11-13T11:14:07.608 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 17209 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/crypto/ansi_cprng.ko 2023-11-13T11:14:07.608 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 19641 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/crypto/anubis.ko 2023-11-13T11:14:07.608 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 10145 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/crypto/arc4.ko 2023-11-13T11:14:07.608 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/crypto/asymmetric_keys/ 2023-11-13T11:14:07.609 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 10185 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/crypto/asymmetric_keys/pkcs7_test_key.ko 2023-11-13T11:14:07.609 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/crypto/async_tx/ 2023-11-13T11:14:07.609 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 11249 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/crypto/async_tx/async_memcpy.ko 2023-11-13T11:14:07.609 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 19473 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/crypto/async_tx/async_pq.ko 2023-11-13T11:14:07.610 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 21561 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/crypto/async_tx/async_raid6_recov.ko 2023-11-13T11:14:07.610 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 13825 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/crypto/async_tx/async_tx.ko 2023-11-13T11:14:07.610 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 17745 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/crypto/async_tx/async_xor.ko 2023-11-13T11:14:07.610 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 17921 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/crypto/async_tx/raid6test.ko 2023-11-13T11:14:07.611 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 20489 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/crypto/authenc.ko 2023-11-13T11:14:07.611 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 22641 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/crypto/authencesn.ko 2023-11-13T11:14:07.611 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 21817 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/crypto/blake2b_generic.ko 2023-11-13T11:14:07.611 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 12729 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/crypto/blowfish_common.ko 2023-11-13T11:14:07.611 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 10537 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/crypto/blowfish_generic.ko 2023-11-13T11:14:07.612 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 38873 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/crypto/camellia_generic.ko 2023-11-13T11:14:07.612 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 27321 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/crypto/cast5_generic.ko 2023-11-13T11:14:07.612 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 17745 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/crypto/cast6_generic.ko 2023-11-13T11:14:07.612 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 10537 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/crypto/cast_common.ko 2023-11-13T11:14:07.613 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 35097 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/crypto/ccm.ko 2023-11-13T11:14:07.613 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 14769 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/crypto/cmac.ko 2023-11-13T11:14:07.613 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 9585 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/crypto/crc32_generic.ko 2023-11-13T11:14:07.613 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 47505 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/crypto/cryptd.ko 2023-11-13T11:14:07.613 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 39505 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/crypto/crypto_engine.ko 2023-11-13T11:14:07.614 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 26953 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/crypto/crypto_simd.ko 2023-11-13T11:14:07.614 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 24737 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/crypto/crypto_user.ko 2023-11-13T11:14:07.614 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 17729 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/crypto/cts.ko 2023-11-13T11:14:07.614 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 10913 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/crypto/des_generic.ko 2023-11-13T11:14:07.615 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 15681 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/crypto/dh_generic.ko 2023-11-13T11:14:07.615 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 11001 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/crypto/echainiv.ko 2023-11-13T11:14:07.615 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 25321 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/crypto/essiv.ko 2023-11-13T11:14:07.615 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 17993 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/crypto/fcrypt.ko 2023-11-13T11:14:07.615 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 26897 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/crypto/khazad.ko 2023-11-13T11:14:07.616 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 15649 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/crypto/lrw.ko 2023-11-13T11:14:07.616 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 11513 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/crypto/lz4.ko 2023-11-13T11:14:07.616 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 11529 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/crypto/lz4hc.ko 2023-11-13T11:14:07.616 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 11761 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/crypto/md4.ko 2023-11-13T11:14:07.617 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 9729 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/crypto/michael_mic.ko 2023-11-13T11:14:07.617 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 10673 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/crypto/pcbc.ko 2023-11-13T11:14:07.617 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 18745 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/crypto/pcrypt.ko 2023-11-13T11:14:07.617 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 16049 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/crypto/rmd160.ko 2023-11-13T11:14:07.618 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 29393 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/crypto/seed.ko 2023-11-13T11:14:07.618 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 27081 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/crypto/serpent_generic.ko 2023-11-13T11:14:07.618 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 149193 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/crypto/tcrypt.ko 2023-11-13T11:14:07.618 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 10881 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/crypto/tea.ko 2023-11-13T11:14:07.618 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 28777 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/crypto/twofish_common.ko 2023-11-13T11:14:07.619 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 13233 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/crypto/twofish_generic.ko 2023-11-13T11:14:07.619 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 17401 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/crypto/vmac.ko 2023-11-13T11:14:07.619 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 36185 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/crypto/wp512.ko 2023-11-13T11:14:07.619 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 14105 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/crypto/xcbc.ko 2023-11-13T11:14:07.620 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 26665 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/crypto/xor.ko 2023-11-13T11:14:07.620 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 18713 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/crypto/xts.ko 2023-11-13T11:14:07.620 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 9481 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/crypto/xxhash_generic.ko 2023-11-13T11:14:07.620 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/ 2023-11-13T11:14:07.620 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/acpi/ 2023-11-13T11:14:07.621 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 18249 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/acpi/acpi_extlog.ko 2023-11-13T11:14:07.621 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 26985 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/acpi/acpi_ipmi.ko 2023-11-13T11:14:07.621 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 28793 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/acpi/acpi_pad.ko 2023-11-13T11:14:07.621 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/acpi/apei/ 2023-11-13T11:14:07.621 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 31241 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/acpi/apei/einj.ko 2023-11-13T11:14:07.622 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 12801 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/acpi/ec_sys.ko 2023-11-13T11:14:07.622 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 14937 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/acpi/platform_profile.ko 2023-11-13T11:14:07.622 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 24401 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/acpi/sbs.ko 2023-11-13T11:14:07.622 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 19521 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/acpi/sbshc.ko 2023-11-13T11:14:07.623 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 103025 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/acpi/video.ko 2023-11-13T11:14:07.623 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/ata/ 2023-11-13T11:14:07.623 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 21601 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/ata/acard-ahci.ko 2023-11-13T11:14:07.623 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 88865 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/ata/ahci.ko 2023-11-13T11:14:07.624 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 14729 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/ata/ahci_platform.ko 2023-11-13T11:14:07.624 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 88289 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/ata/libahci.ko 2023-11-13T11:14:07.624 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 34985 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/ata/libahci_platform.ko 2023-11-13T11:14:07.624 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 17137 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/ata/pata_acpi.ko 2023-11-13T11:14:07.624 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 30497 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/ata/pata_ali.ko 2023-11-13T11:14:07.625 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 33569 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/ata/pata_amd.ko 2023-11-13T11:14:07.625 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 21265 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/ata/pata_artop.ko 2023-11-13T11:14:07.625 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 21121 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/ata/pata_atiixp.ko 2023-11-13T11:14:07.625 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 24945 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/ata/pata_atp867x.ko 2023-11-13T11:14:07.626 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 17721 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/ata/pata_cmd640.ko 2023-11-13T11:14:07.626 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 25249 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/ata/pata_cmd64x.ko 2023-11-13T11:14:07.626 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 15049 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/ata/pata_cypress.ko 2023-11-13T11:14:07.626 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 17849 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/ata/pata_efar.ko 2023-11-13T11:14:07.627 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 21945 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/ata/pata_hpt366.ko 2023-11-13T11:14:07.627 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 33977 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/ata/pata_hpt37x.ko 2023-11-13T11:14:07.627 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 23129 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/ata/pata_hpt3x2n.ko 2023-11-13T11:14:07.627 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 16921 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/ata/pata_hpt3x3.ko 2023-11-13T11:14:07.627 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 16993 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/ata/pata_it8213.ko 2023-11-13T11:14:07.628 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 35273 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/ata/pata_it821x.ko 2023-11-13T11:14:07.628 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 12889 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/ata/pata_jmicron.ko 2023-11-13T11:14:07.628 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 51481 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/ata/pata_legacy.ko 2023-11-13T11:14:07.628 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 15185 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/ata/pata_marvell.ko 2023-11-13T11:14:07.629 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 16281 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/ata/pata_mpiix.ko 2023-11-13T11:14:07.629 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 12833 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/ata/pata_netcell.ko 2023-11-13T11:14:07.629 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 16817 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/ata/pata_ninja32.ko 2023-11-13T11:14:07.629 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 15105 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/ata/pata_ns87410.ko 2023-11-13T11:14:07.629 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 17361 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/ata/pata_ns87415.ko 2023-11-13T11:14:07.630 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 16569 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/ata/pata_oldpiix.ko 2023-11-13T11:14:07.630 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 15377 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/ata/pata_opti.ko 2023-11-13T11:14:07.630 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 20681 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/ata/pata_optidma.ko 2023-11-13T11:14:07.630 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 32585 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/ata/pata_pcmcia.ko 2023-11-13T11:14:07.631 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 37793 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/ata/pata_pdc2027x.ko 2023-11-13T11:14:07.631 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 20561 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/ata/pata_pdc202xx_old.ko 2023-11-13T11:14:07.631 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 14225 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/ata/pata_piccolo.ko 2023-11-13T11:14:07.631 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 15449 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/ata/pata_radisys.ko 2023-11-13T11:14:07.631 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 19521 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/ata/pata_rdc.ko 2023-11-13T11:14:07.632 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 15329 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/ata/pata_rz1000.ko 2023-11-13T11:14:07.632 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 13937 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/ata/pata_sch.ko 2023-11-13T11:14:07.632 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 23097 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/ata/pata_serverworks.ko 2023-11-13T11:14:07.632 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 23457 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/ata/pata_sil680.ko 2023-11-13T11:14:07.633 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 19697 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/ata/pata_sl82c105.ko 2023-11-13T11:14:07.633 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 16009 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/ata/pata_triflex.ko 2023-11-13T11:14:07.633 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 30497 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/ata/pata_via.ko 2023-11-13T11:14:07.633 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 22793 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/ata/pdc_adma.ko 2023-11-13T11:14:07.633 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 29121 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/ata/sata_inic162x.ko 2023-11-13T11:14:07.634 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 83345 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/ata/sata_mv.ko 2023-11-13T11:14:07.634 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 70393 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/ata/sata_nv.ko 2023-11-13T11:14:07.634 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 37377 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/ata/sata_promise.ko 2023-11-13T11:14:07.634 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 23041 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/ata/sata_qstor.ko 2023-11-13T11:14:07.635 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 29273 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/ata/sata_sil.ko 2023-11-13T11:14:07.635 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 38337 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/ata/sata_sil24.ko 2023-11-13T11:14:07.635 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 17945 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/ata/sata_sis.ko 2023-11-13T11:14:07.635 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 20441 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/ata/sata_svw.ko 2023-11-13T11:14:07.636 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 44793 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/ata/sata_sx4.ko 2023-11-13T11:14:07.636 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 15601 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/ata/sata_uli.ko 2023-11-13T11:14:07.636 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 35065 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/ata/sata_via.ko 2023-11-13T11:14:07.636 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 20065 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/ata/sata_vsc.ko 2023-11-13T11:14:07.636 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/auxdisplay/ 2023-11-13T11:14:07.637 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 16289 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/auxdisplay/ks0108.ko 2023-11-13T11:14:07.637 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/bcma/ 2023-11-13T11:14:07.637 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 124473 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/bcma/bcma.ko 2023-11-13T11:14:07.637 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/block/ 2023-11-13T11:14:07.638 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/block/aoe/ 2023-11-13T11:14:07.638 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 113665 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/block/aoe/aoe.ko 2023-11-13T11:14:07.638 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/block/drbd/ 2023-11-13T11:14:07.638 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 965585 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/block/drbd/drbd.ko 2023-11-13T11:14:07.638 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 173225 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/block/floppy.ko 2023-11-13T11:14:07.639 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/block/mtip32xx/ 2023-11-13T11:14:07.639 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 94297 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/block/mtip32xx/mtip32xx.ko 2023-11-13T11:14:07.639 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 115793 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/block/nbd.ko 2023-11-13T11:14:07.639 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/block/null_blk/ 2023-11-13T11:14:07.640 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 110449 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/block/null_blk/null_blk.ko 2023-11-13T11:14:07.640 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 98193 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/block/pktcdvd.ko 2023-11-13T11:14:07.640 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 263769 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/block/rbd.ko 2023-11-13T11:14:07.640 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/block/xen-blkback/ 2023-11-13T11:14:07.640 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 98145 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/block/xen-blkback/xen-blkback.ko 2023-11-13T11:14:07.641 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/block/zram/ 2023-11-13T11:14:07.641 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 60217 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/block/zram/zram.ko 2023-11-13T11:14:07.641 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/char/ 2023-11-13T11:14:07.641 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 30705 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/char/applicom.ko 2023-11-13T11:14:07.642 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 12009 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/char/hangcheck-timer.ko 2023-11-13T11:14:07.642 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/char/hw_random/ 2023-11-13T11:14:07.642 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 13889 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/char/hw_random/amd-rng.ko 2023-11-13T11:14:07.642 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 18809 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/char/hw_random/intel-rng.ko 2023-11-13T11:14:07.642 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 13169 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/char/hw_random/timeriomem-rng.ko 2023-11-13T11:14:07.643 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 10673 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/char/hw_random/via-rng.ko 2023-11-13T11:14:07.643 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 15633 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/char/hw_random/virtio-rng.ko 2023-11-13T11:14:07.643 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/char/ipmi/ 2023-11-13T11:14:07.643 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 30713 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/char/ipmi/ipmi_devintf.ko 2023-11-13T11:14:07.644 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 148601 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2023-11-13T11:14:07.644 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 26569 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2023-11-13T11:14:07.644 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 139313 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/char/ipmi/ipmi_si.ko 2023-11-13T11:14:07.644 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 70921 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/char/ipmi/ipmi_ssif.ko 2023-11-13T11:14:07.644 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 53513 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2023-11-13T11:14:07.645 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 36321 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/char/lp.ko 2023-11-13T11:14:07.645 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/char/mwave/ 2023-11-13T11:14:07.645 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 84097 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/char/mwave/mwave.ko 2023-11-13T11:14:07.645 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 25873 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/char/nvram.ko 2023-11-13T11:14:07.645 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 32169 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/char/ppdev.ko 2023-11-13T11:14:07.646 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 51113 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/char/tlclk.ko 2023-11-13T11:14:07.646 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/char/tpm/ 2023-11-13T11:14:07.646 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 16401 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/char/tpm/tpm_atmel.ko 2023-11-13T11:14:07.646 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 15881 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/char/tpm/tpm_i2c_atmel.ko 2023-11-13T11:14:07.647 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 23473 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/char/tpm/tpm_i2c_infineon.ko 2023-11-13T11:14:07.647 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 32985 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/char/tpm/tpm_i2c_nuvoton.ko 2023-11-13T11:14:07.647 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 30121 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/char/tpm/tpm_infineon.ko 2023-11-13T11:14:07.647 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 22697 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/char/tpm/tpm_nsc.ko 2023-11-13T11:14:07.647 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 23561 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/char/tpm/xen-tpmfront.ko 2023-11-13T11:14:07.648 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/char/xillybus/ 2023-11-13T11:14:07.648 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 17001 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/char/xillybus/xillybus_class.ko 2023-11-13T11:14:07.648 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 50945 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/char/xillybus/xillybus_core.ko 2023-11-13T11:14:07.648 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 12393 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/char/xillybus/xillybus_pcie.ko 2023-11-13T11:14:07.649 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/clk/ 2023-11-13T11:14:07.649 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 12489 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/clk/clk-palmas.ko 2023-11-13T11:14:07.649 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 47849 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/clk/clk-si5351.ko 2023-11-13T11:14:07.649 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 11457 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/clk/clk-twl6040.ko 2023-11-13T11:14:07.650 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 19313 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/clk/clk-wm831x.ko 2023-11-13T11:14:07.650 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/cpufreq/ 2023-11-13T11:14:07.650 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 10097 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2023-11-13T11:14:07.650 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 16833 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/cpufreq/p4-clockmod.ko 2023-11-13T11:14:07.650 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 25297 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/cpufreq/speedstep-lib.ko 2023-11-13T11:14:07.651 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/crypto/ 2023-11-13T11:14:07.651 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/crypto/ccp/ 2023-11-13T11:14:07.651 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 70801 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/crypto/ccp/ccp-crypto.ko 2023-11-13T11:14:07.651 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 243025 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/crypto/ccp/ccp.ko 2023-11-13T11:14:07.652 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/crypto/intel/ 2023-11-13T11:14:07.652 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/crypto/intel/qat/ 2023-11-13T11:14:07.652 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/crypto/intel/qat/qat_common/ 2023-11-13T11:14:07.652 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 438761 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/crypto/intel/qat/qat_common/intel_qat.ko 2023-11-13T11:14:07.652 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/crypto/intel/qat/qat_dh895xcc/ 2023-11-13T11:14:07.653 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 24081 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/crypto/intel/qat/qat_dh895xcc/qat_dh895xcc.ko 2023-11-13T11:14:07.653 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 19937 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/crypto/padlock-aes.ko 2023-11-13T11:14:07.653 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 21537 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/crypto/padlock-sha.ko 2023-11-13T11:14:07.653 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/crypto/virtio/ 2023-11-13T11:14:07.654 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 68857 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/crypto/virtio/virtio_crypto.ko 2023-11-13T11:14:07.654 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/dca/ 2023-11-13T11:14:07.654 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 29785 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/dca/dca.ko 2023-11-13T11:14:07.654 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/dma/ 2023-11-13T11:14:07.655 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/dma/dw/ 2023-11-13T11:14:07.655 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 15857 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/dma/dw/dw_dmac.ko 2023-11-13T11:14:07.655 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/dma/ioat/ 2023-11-13T11:14:07.655 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 122569 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/dma/ioat/ioatdma.ko 2023-11-13T11:14:07.655 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/edac/ 2023-11-13T11:14:07.656 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 79953 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/edac/amd64_edac.ko 2023-11-13T11:14:07.656 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 35769 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/edac/e752x_edac.ko 2023-11-13T11:14:07.656 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 63617 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/edac/edac_mce_amd.ko 2023-11-13T11:14:07.656 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 18105 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/edac/i3000_edac.ko 2023-11-13T11:14:07.657 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 18065 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/edac/i3200_edac.ko 2023-11-13T11:14:07.657 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 22537 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/edac/i5100_edac.ko 2023-11-13T11:14:07.657 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 25657 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/edac/i5400_edac.ko 2023-11-13T11:14:07.657 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 24913 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/edac/i7300_edac.ko 2023-11-13T11:14:07.657 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 52041 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/edac/i7core_edac.ko 2023-11-13T11:14:07.658 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 18433 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/edac/i82975x_edac.ko 2023-11-13T11:14:07.658 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 20017 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/edac/ie31200_edac.ko 2023-11-13T11:14:07.658 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 56825 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/edac/sb_edac.ko 2023-11-13T11:14:07.658 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 17529 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/edac/x38_edac.ko 2023-11-13T11:14:07.659 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/extcon/ 2023-11-13T11:14:07.659 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 12673 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/extcon/extcon-gpio.ko 2023-11-13T11:14:07.659 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 27185 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/extcon/extcon-max14577.ko 2023-11-13T11:14:07.659 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 29569 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/extcon/extcon-max77693.ko 2023-11-13T11:14:07.660 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 24745 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/extcon/extcon-max8997.ko 2023-11-13T11:14:07.660 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 26537 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/extcon/extcon-palmas.ko 2023-11-13T11:14:07.660 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 23713 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/extcon/extcon-rt8973a.ko 2023-11-13T11:14:07.660 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 27785 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/extcon/extcon-sm5502.ko 2023-11-13T11:14:07.660 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/firmware/ 2023-11-13T11:14:07.661 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 34977 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/firmware/dmi-sysfs.ko 2023-11-13T11:14:07.661 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/firmware/efi/ 2023-11-13T11:14:07.661 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 15521 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/firmware/efi/efi-pstore.ko 2023-11-13T11:14:07.661 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 20729 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/firmware/iscsi_ibft.ko 2023-11-13T11:14:07.661 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/gpio/ 2023-11-13T11:14:07.662 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 12305 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/gpio/gpio-adp5520.ko 2023-11-13T11:14:07.662 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 20153 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/gpio/gpio-amd8111.ko 2023-11-13T11:14:07.662 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 14993 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/gpio/gpio-arizona.ko 2023-11-13T11:14:07.662 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 13841 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/gpio/gpio-da9052.ko 2023-11-13T11:14:07.663 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 11921 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/gpio/gpio-da9055.ko 2023-11-13T11:14:07.663 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 22065 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/gpio/gpio-dln2.ko 2023-11-13T11:14:07.663 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 77849 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/gpio/gpio-f7188x.ko 2023-11-13T11:14:07.663 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 28937 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/gpio/gpio-generic.ko 2023-11-13T11:14:07.664 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 19569 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/gpio/gpio-ich.ko 2023-11-13T11:14:07.664 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 11969 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/gpio/gpio-janz-ttl.ko 2023-11-13T11:14:07.664 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 14113 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/gpio/gpio-kempld.ko 2023-11-13T11:14:07.664 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 12537 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/gpio/gpio-lp3943.ko 2023-11-13T11:14:07.665 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 9505 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/gpio/gpio-max7300.ko 2023-11-13T11:14:07.665 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 11969 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/gpio/gpio-max730x.ko 2023-11-13T11:14:07.665 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 22073 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/gpio/gpio-max732x.ko 2023-11-13T11:14:07.665 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 25145 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/gpio/gpio-ml-ioh.ko 2023-11-13T11:14:07.666 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 47073 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/gpio/gpio-pca953x.ko 2023-11-13T11:14:07.666 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 26825 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/gpio/gpio-pcf857x.ko 2023-11-13T11:14:07.666 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 14377 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/gpio/gpio-rdc321x.ko 2023-11-13T11:14:07.666 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 20593 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/gpio/gpio-sch.ko 2023-11-13T11:14:07.667 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 19505 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/gpio/gpio-sch311x.ko 2023-11-13T11:14:07.667 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 12145 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/gpio/gpio-tps65912.ko 2023-11-13T11:14:07.667 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 21057 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/gpio/gpio-twl4030.ko 2023-11-13T11:14:07.667 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 11425 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/gpio/gpio-twl6040.ko 2023-11-13T11:14:07.668 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 20601 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/gpio/gpio-viperboard.ko 2023-11-13T11:14:07.668 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 15377 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/gpio/gpio-vx855.ko 2023-11-13T11:14:07.668 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 16281 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/gpio/gpio-wm831x.ko 2023-11-13T11:14:07.668 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 11617 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/gpio/gpio-wm8350.ko 2023-11-13T11:14:07.669 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 16753 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/gpio/gpio-wm8994.ko 2023-11-13T11:14:07.669 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hid/ 2023-11-13T11:14:07.669 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 11577 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hid/hid-a4tech.ko 2023-11-13T11:14:07.669 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 39169 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hid/hid-apple.ko 2023-11-13T11:14:07.670 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 14481 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hid/hid-appleir.ko 2023-11-13T11:14:07.670 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 8353 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hid/hid-aureal.ko 2023-11-13T11:14:07.670 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 15169 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hid/hid-axff.ko 2023-11-13T11:14:07.670 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 11049 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hid/hid-belkin.ko 2023-11-13T11:14:07.671 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 10313 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hid/hid-cherry.ko 2023-11-13T11:14:07.671 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 16041 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hid/hid-chicony.ko 2023-11-13T11:14:07.671 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 60649 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hid/hid-cp2112.ko 2023-11-13T11:14:07.671 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 11049 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hid/hid-cypress.ko 2023-11-13T11:14:07.672 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 16385 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hid/hid-dr.ko 2023-11-13T11:14:07.672 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 10697 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hid/hid-elecom.ko 2023-11-13T11:14:07.672 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 17665 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hid/hid-elo.ko 2023-11-13T11:14:07.672 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 13457 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hid/hid-emsff.ko 2023-11-13T11:14:07.673 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 10105 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hid/hid-ezkey.ko 2023-11-13T11:14:07.673 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 14305 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hid/hid-gaff.ko 2023-11-13T11:14:07.673 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 9225 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hid/hid-generic.ko 2023-11-13T11:14:07.673 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 17129 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hid/hid-gt683r.ko 2023-11-13T11:14:07.673 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 12681 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hid/hid-gyration.ko 2023-11-13T11:14:07.674 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 10225 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hid/hid-holtek-kbd.ko 2023-11-13T11:14:07.674 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 10457 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hid/hid-holtek-mouse.ko 2023-11-13T11:14:07.674 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 14449 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hid/hid-holtekff.ko 2023-11-13T11:14:07.674 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 19105 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hid/hid-hyperv.ko 2023-11-13T11:14:07.675 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 10489 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hid/hid-icade.ko 2023-11-13T11:14:07.675 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 9241 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hid/hid-kensington.ko 2023-11-13T11:14:07.675 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 8545 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hid/hid-keytouch.ko 2023-11-13T11:14:07.675 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 17201 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hid/hid-kye.ko 2023-11-13T11:14:07.676 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 10809 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hid/hid-lcpower.ko 2023-11-13T11:14:07.676 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 20497 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hid/hid-led.ko 2023-11-13T11:14:07.676 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 42361 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hid/hid-lenovo.ko 2023-11-13T11:14:07.676 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 30761 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hid/hid-lg-g15.ko 2023-11-13T11:14:07.677 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 58185 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hid/hid-logitech-dj.ko 2023-11-13T11:14:07.677 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 101369 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hid/hid-logitech-hidpp.ko 2023-11-13T11:14:07.677 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 80993 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hid/hid-logitech.ko 2023-11-13T11:14:07.677 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 30801 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hid/hid-magicmouse.ko 2023-11-13T11:14:07.678 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 21969 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hid/hid-microsoft.ko 2023-11-13T11:14:07.678 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 10361 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hid/hid-monterey.ko 2023-11-13T11:14:07.678 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 50161 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hid/hid-multitouch.ko 2023-11-13T11:14:07.678 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 32593 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hid/hid-ntrig.ko 2023-11-13T11:14:07.678 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 8857 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hid/hid-ortek.ko 2023-11-13T11:14:07.679 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 9121 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hid/hid-penmount.ko 2023-11-13T11:14:07.679 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 12289 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hid/hid-petalynx.ko 2023-11-13T11:14:07.679 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 72937 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hid/hid-picolcd.ko 2023-11-13T11:14:07.679 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 14225 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hid/hid-pl.ko 2023-11-13T11:14:07.680 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 15105 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hid/hid-plantronics.ko 2023-11-13T11:14:07.680 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 8417 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hid/hid-primax.ko 2023-11-13T11:14:07.680 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 35457 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hid/hid-rmi.ko 2023-11-13T11:14:07.680 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 20833 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hid/hid-roccat-arvo.ko 2023-11-13T11:14:07.680 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 14065 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hid/hid-roccat-common.ko 2023-11-13T11:14:07.681 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 31425 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hid/hid-roccat-isku.ko 2023-11-13T11:14:07.681 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 29729 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hid/hid-roccat-kone.ko 2023-11-13T11:14:07.681 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 31129 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hid/hid-roccat-koneplus.ko 2023-11-13T11:14:07.681 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 21137 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hid/hid-roccat-konepure.ko 2023-11-13T11:14:07.681 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 29489 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hid/hid-roccat-kovaplus.ko 2023-11-13T11:14:07.682 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 13305 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hid/hid-roccat-lua.ko 2023-11-13T11:14:07.682 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 29313 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hid/hid-roccat-pyra.ko 2023-11-13T11:14:07.682 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 27937 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hid/hid-roccat-ryos.ko 2023-11-13T11:14:07.682 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 19521 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hid/hid-roccat-savu.ko 2023-11-13T11:14:07.683 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 23337 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hid/hid-roccat.ko 2023-11-13T11:14:07.683 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 13681 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hid/hid-saitek.ko 2023-11-13T11:14:07.683 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 15193 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hid/hid-samsung.ko 2023-11-13T11:14:07.683 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 36817 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hid/hid-sensor-hub.ko 2023-11-13T11:14:07.683 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 13601 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hid/hid-sjoy.ko 2023-11-13T11:14:07.684 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 51249 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hid/hid-sony.ko 2023-11-13T11:14:07.684 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 8313 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hid/hid-speedlink.ko 2023-11-13T11:14:07.684 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 25297 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hid/hid-steelseries.ko 2023-11-13T11:14:07.684 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 9817 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hid/hid-sunplus.ko 2023-11-13T11:14:07.684 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 16993 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hid/hid-thrustmaster.ko 2023-11-13T11:14:07.685 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 10537 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hid/hid-tivo.ko 2023-11-13T11:14:07.685 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 15089 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hid/hid-tmff.ko 2023-11-13T11:14:07.685 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 14385 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hid/hid-topseed.ko 2023-11-13T11:14:07.685 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 16473 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hid/hid-twinhan.ko 2023-11-13T11:14:07.686 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 71073 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hid/hid-uclogic.ko 2023-11-13T11:14:07.686 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 10921 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hid/hid-waltop.ko 2023-11-13T11:14:07.686 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 143473 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hid/hid-wiimote.ko 2023-11-13T11:14:07.686 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 8153 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hid/hid-xinmo.ko 2023-11-13T11:14:07.687 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 13321 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hid/hid-zpff.ko 2023-11-13T11:14:07.687 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 16665 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hid/hid-zydacron.ko 2023-11-13T11:14:07.687 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 267825 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hid/hid.ko 2023-11-13T11:14:07.687 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 32321 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hid/uhid.ko 2023-11-13T11:14:07.687 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hid/usbhid/ 2023-11-13T11:14:07.688 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 125721 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hid/usbhid/usbhid.ko 2023-11-13T11:14:07.688 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 19137 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hid/usbhid/usbkbd.ko 2023-11-13T11:14:07.688 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 14953 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hid/usbhid/usbmouse.ko 2023-11-13T11:14:07.688 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 217873 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hid/wacom.ko 2023-11-13T11:14:07.689 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hv/ 2023-11-13T11:14:07.689 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 64201 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hv/hv_balloon.ko 2023-11-13T11:14:07.689 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 89625 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hv/hv_utils.ko 2023-11-13T11:14:07.689 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 305465 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hv/hv_vmbus.ko 2023-11-13T11:14:07.689 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/ 2023-11-13T11:14:07.690 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 66521 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/abituguru.ko 2023-11-13T11:14:07.690 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 61393 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/abituguru3.ko 2023-11-13T11:14:07.690 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 34745 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/acpi_power_meter.ko 2023-11-13T11:14:07.690 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 17505 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/ad7414.ko 2023-11-13T11:14:07.690 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 19313 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/ad7418.ko 2023-11-13T11:14:07.691 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 25257 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/adc128d818.ko 2023-11-13T11:14:07.691 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 31729 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/adm1025.ko 2023-11-13T11:14:07.691 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 97977 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/adm1026.ko 2023-11-13T11:14:07.691 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 19745 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/adm1029.ko 2023-11-13T11:14:07.692 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 45553 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/adm1031.ko 2023-11-13T11:14:07.692 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 26289 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/adm9240.ko 2023-11-13T11:14:07.692 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 14769 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/ads7828.ko 2023-11-13T11:14:07.692 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 10769 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/adt7410.ko 2023-11-13T11:14:07.692 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 22049 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/adt7411.ko 2023-11-13T11:14:07.693 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 74433 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/adt7462.ko 2023-11-13T11:14:07.693 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 39585 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/adt7470.ko 2023-11-13T11:14:07.693 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 67929 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/adt7475.ko 2023-11-13T11:14:07.693 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 19625 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/adt7x10.ko 2023-11-13T11:14:07.693 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 39073 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/amc6821.ko 2023-11-13T11:14:07.694 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 55265 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/applesmc.ko 2023-11-13T11:14:07.694 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 49913 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/asb100.ko 2023-11-13T11:14:07.694 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 58617 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/asc7621.ko 2023-11-13T11:14:07.694 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 40889 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/asus_atk0110.ko 2023-11-13T11:14:07.695 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 17225 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/atxp1.ko 2023-11-13T11:14:07.695 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 28281 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/coretemp.ko 2023-11-13T11:14:07.695 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 24657 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/da9052-hwmon.ko 2023-11-13T11:14:07.695 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 17265 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/da9055-hwmon.ko 2023-11-13T11:14:07.695 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 44465 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/dell-smm-hwmon.ko 2023-11-13T11:14:07.696 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 99601 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/dme1737.ko 2023-11-13T11:14:07.696 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 19489 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/ds1621.ko 2023-11-13T11:14:07.696 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 15321 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/ds620.ko 2023-11-13T11:14:07.696 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 29777 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/emc1403.ko 2023-11-13T11:14:07.696 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 33185 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/emc2103.ko 2023-11-13T11:14:07.697 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 30321 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/emc6w201.ko 2023-11-13T11:14:07.697 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 66985 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/f71805f.ko 2023-11-13T11:14:07.697 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 94457 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/f71882fg.ko 2023-11-13T11:14:07.697 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 41401 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/f75375s.ko 2023-11-13T11:14:07.697 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 21305 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/fam15h_power.ko 2023-11-13T11:14:07.698 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 55449 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/fschmd.ko 2023-11-13T11:14:07.698 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 14481 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/g760a.ko 2023-11-13T11:14:07.698 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 24017 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/g762.ko 2023-11-13T11:14:07.698 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 46801 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/gl518sm.ko 2023-11-13T11:14:07.698 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 45529 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/gl520sm.ko 2023-11-13T11:14:07.699 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 13273 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/hih6130.ko 2023-11-13T11:14:07.699 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 9745 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/hwmon-vid.ko 2023-11-13T11:14:07.699 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 11553 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/i5500_temp.ko 2023-11-13T11:14:07.699 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 22601 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/i5k_amb.ko 2023-11-13T11:14:07.700 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 34529 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/ibmaem.ko 2023-11-13T11:14:07.700 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 21321 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/ibmpex.ko 2023-11-13T11:14:07.700 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 24873 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/ina209.ko 2023-11-13T11:14:07.700 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 13401 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/ina2xx.ko 2023-11-13T11:14:07.700 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 130449 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/it87.ko 2023-11-13T11:14:07.701 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 18841 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/jc42.ko 2023-11-13T11:14:07.701 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 24329 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/k10temp.ko 2023-11-13T11:14:07.701 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 13553 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/k8temp.ko 2023-11-13T11:14:07.701 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 18929 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/lineage-pem.ko 2023-11-13T11:14:07.701 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 48601 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/lm63.ko 2023-11-13T11:14:07.702 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 16761 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/lm73.ko 2023-11-13T11:14:07.702 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 36777 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/lm75.ko 2023-11-13T11:14:07.702 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 19537 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/lm77.ko 2023-11-13T11:14:07.702 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 34657 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/lm78.ko 2023-11-13T11:14:07.703 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 31745 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/lm80.ko 2023-11-13T11:14:07.703 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 16889 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/lm83.ko 2023-11-13T11:14:07.703 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 72833 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/lm85.ko 2023-11-13T11:14:07.703 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 46153 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/lm87.ko 2023-11-13T11:14:07.703 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 37913 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/lm90.ko 2023-11-13T11:14:07.704 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 19745 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/lm92.ko 2023-11-13T11:14:07.704 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 108841 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/lm93.ko 2023-11-13T11:14:07.704 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 33393 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/lm95234.ko 2023-11-13T11:14:07.704 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 16265 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/lm95241.ko 2023-11-13T11:14:07.705 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 18113 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/lm95245.ko 2023-11-13T11:14:07.705 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 24017 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/ltc2945.ko 2023-11-13T11:14:07.705 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 13793 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/ltc4151.ko 2023-11-13T11:14:07.705 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 15193 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/ltc4215.ko 2023-11-13T11:14:07.705 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 14953 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/ltc4222.ko 2023-11-13T11:14:07.706 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 14825 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/ltc4245.ko 2023-11-13T11:14:07.706 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 13249 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/ltc4260.ko 2023-11-13T11:14:07.706 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 14993 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/ltc4261.ko 2023-11-13T11:14:07.706 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 33489 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/max16065.ko 2023-11-13T11:14:07.706 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 18433 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/max1619.ko 2023-11-13T11:14:07.707 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 24353 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/max1668.ko 2023-11-13T11:14:07.707 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 19969 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/max197.ko 2023-11-13T11:14:07.707 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 27129 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/max6639.ko 2023-11-13T11:14:07.707 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 23321 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/max6650.ko 2023-11-13T11:14:07.707 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 35777 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/max6697.ko 2023-11-13T11:14:07.708 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 18585 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/mc13783-adc.ko 2023-11-13T11:14:07.708 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 10585 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/mcp3021.ko 2023-11-13T11:14:07.708 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 15937 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/menf21bmc_hwmon.ko 2023-11-13T11:14:07.708 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 44129 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/nct6683.ko 2023-11-13T11:14:07.709 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 119817 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/nct6775-core.ko 2023-11-13T11:14:07.709 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 60705 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/nct6775.ko 2023-11-13T11:14:07.709 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 59737 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/nct7802.ko 2023-11-13T11:14:07.709 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 82337 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/pc87360.ko 2023-11-13T11:14:07.709 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 54433 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/pc87427.ko 2023-11-13T11:14:07.710 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 18473 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/pcf8591.ko 2023-11-13T11:14:07.710 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/pmbus/ 2023-11-13T11:14:07.710 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 21353 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/pmbus/adm1275.ko 2023-11-13T11:14:07.710 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 17065 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/pmbus/lm25066.ko 2023-11-13T11:14:07.710 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 28329 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/pmbus/ltc2978.ko 2023-11-13T11:14:07.711 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 9577 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/pmbus/max16064.ko 2023-11-13T11:14:07.711 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 17657 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/pmbus/max34440.ko 2023-11-13T11:14:07.711 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 10169 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/pmbus/max8688.ko 2023-11-13T11:14:07.711 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 15505 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/pmbus/pmbus.ko 2023-11-13T11:14:07.711 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 82577 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2023-11-13T11:14:07.712 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 8729 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/pmbus/tps40422.ko 2023-11-13T11:14:07.712 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 30729 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/pmbus/ucd9000.ko 2023-11-13T11:14:07.712 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 15073 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/pmbus/ucd9200.ko 2023-11-13T11:14:07.712 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 20681 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/pmbus/zl6100.ko 2023-11-13T11:14:07.713 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 13017 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/powr1220.ko 2023-11-13T11:14:07.713 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 18705 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/sch5627.ko 2023-11-13T11:14:07.713 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 28817 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/sch5636.ko 2023-11-13T11:14:07.713 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 27145 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/sch56xx-common.ko 2023-11-13T11:14:07.713 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 32137 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/sht15.ko 2023-11-13T11:14:07.714 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 13505 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/sht21.ko 2023-11-13T11:14:07.714 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 16833 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/shtc1.ko 2023-11-13T11:14:07.714 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 40105 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/sis5595.ko 2023-11-13T11:14:07.714 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 19577 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/smsc47b397.ko 2023-11-13T11:14:07.715 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 39193 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/smsc47m1.ko 2023-11-13T11:14:07.715 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 37385 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/smsc47m192.ko 2023-11-13T11:14:07.715 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 26553 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/thmc50.ko 2023-11-13T11:14:07.715 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 17057 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/tmp102.ko 2023-11-13T11:14:07.716 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 14097 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/tmp103.ko 2023-11-13T11:14:07.716 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 21257 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/tmp401.ko 2023-11-13T11:14:07.716 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 19537 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/tmp421.ko 2023-11-13T11:14:07.716 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 19721 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/via-cputemp.ko 2023-11-13T11:14:07.716 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 41945 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/via686a.ko 2023-11-13T11:14:07.717 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 52457 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/vt1211.ko 2023-11-13T11:14:07.717 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 51545 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/vt8231.ko 2023-11-13T11:14:07.717 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 57513 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/w83627ehf.ko 2023-11-13T11:14:07.717 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 78873 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/w83627hf.ko 2023-11-13T11:14:07.718 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 71345 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/w83781d.ko 2023-11-13T11:14:07.718 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 63289 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/w83791d.ko 2023-11-13T11:14:07.718 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 71321 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/w83792d.ko 2023-11-13T11:14:07.718 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 101473 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/w83793.ko 2023-11-13T11:14:07.718 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 119505 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/w83795.ko 2023-11-13T11:14:07.719 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 17313 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/w83l785ts.ko 2023-11-13T11:14:07.719 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 35625 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/w83l786ng.ko 2023-11-13T11:14:07.719 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 13825 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/wm831x-hwmon.ko 2023-11-13T11:14:07.719 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 10625 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/wm8350-hwmon.ko 2023-11-13T11:14:07.720 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/i2c/ 2023-11-13T11:14:07.720 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/i2c/algos/ 2023-11-13T11:14:07.720 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 20049 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2023-11-13T11:14:07.720 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 19345 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2023-11-13T11:14:07.721 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/i2c/busses/ 2023-11-13T11:14:07.721 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 27969 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/i2c/busses/i2c-ali1535.ko 2023-11-13T11:14:07.721 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 28801 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/i2c/busses/i2c-ali1563.ko 2023-11-13T11:14:07.721 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 27777 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/i2c/busses/i2c-ali15x3.ko 2023-11-13T11:14:07.721 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 17937 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2023-11-13T11:14:07.722 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 26193 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/i2c/busses/i2c-amd756.ko 2023-11-13T11:14:07.722 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 16201 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/i2c/busses/i2c-amd8111.ko 2023-11-13T11:14:07.722 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 15153 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/i2c/busses/i2c-cbus-gpio.ko 2023-11-13T11:14:07.722 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 6929 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2023-11-13T11:14:07.723 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 13961 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/i2c/busses/i2c-cros-ec-tunnel.ko 2023-11-13T11:14:07.723 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 50201 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/i2c/busses/i2c-designware-core.ko 2023-11-13T11:14:07.723 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 23905 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2023-11-13T11:14:07.723 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 20001 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2023-11-13T11:14:07.723 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 17337 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2023-11-13T11:14:07.724 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 12497 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/i2c/busses/i2c-dln2.ko 2023-11-13T11:14:07.724 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 17585 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/i2c/busses/i2c-gpio.ko 2023-11-13T11:14:07.724 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 62817 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/i2c/busses/i2c-i801.ko 2023-11-13T11:14:07.724 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 22433 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/i2c/busses/i2c-isch.ko 2023-11-13T11:14:07.725 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 47889 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/i2c/busses/i2c-ismt.ko 2023-11-13T11:14:07.725 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 17721 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/i2c/busses/i2c-kempld.ko 2023-11-13T11:14:07.725 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 17881 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2023-11-13T11:14:07.725 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 22337 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/i2c/busses/i2c-nforce2.ko 2023-11-13T11:14:07.726 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 26329 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/i2c/busses/i2c-ocores.ko 2023-11-13T11:14:07.726 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 25145 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/i2c/busses/i2c-parport.ko 2023-11-13T11:14:07.726 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 16497 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2023-11-13T11:14:07.726 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 47241 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/i2c/busses/i2c-piix4.ko 2023-11-13T11:14:07.726 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 15289 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/i2c/busses/i2c-robotfuzz-osif.ko 2023-11-13T11:14:07.727 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 18649 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/i2c/busses/i2c-scmi.ko 2023-11-13T11:14:07.727 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 11809 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/i2c/busses/i2c-simtec.ko 2023-11-13T11:14:07.727 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 22313 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/i2c/busses/i2c-sis5595.ko 2023-11-13T11:14:07.727 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 29361 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/i2c/busses/i2c-sis630.ko 2023-11-13T11:14:07.728 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 20329 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/i2c/busses/i2c-sis96x.ko 2023-11-13T11:14:07.728 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 19241 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/i2c/busses/i2c-taos-evm.ko 2023-11-13T11:14:07.728 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 19809 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2023-11-13T11:14:07.728 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 13801 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/i2c/busses/i2c-via.ko 2023-11-13T11:14:07.728 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 26081 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/i2c/busses/i2c-viapro.ko 2023-11-13T11:14:07.729 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 19041 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/i2c/busses/i2c-viperboard.ko 2023-11-13T11:14:07.729 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 47657 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/i2c/busses/i2c-xiic.ko 2023-11-13T11:14:07.729 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 22449 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/i2c/i2c-mux.ko 2023-11-13T11:14:07.729 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 18825 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/i2c/i2c-smbus.ko 2023-11-13T11:14:07.730 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 27073 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/i2c/i2c-stub.ko 2023-11-13T11:14:07.730 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/i2c/muxes/ 2023-11-13T11:14:07.730 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 14921 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/i2c/muxes/i2c-mux-gpio.ko 2023-11-13T11:14:07.730 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 13457 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/i2c/muxes/i2c-mux-pca9541.ko 2023-11-13T11:14:07.730 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 29801 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/i2c/muxes/i2c-mux-pca954x.ko 2023-11-13T11:14:07.731 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/infiniband/ 2023-11-13T11:14:07.731 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/infiniband/core/ 2023-11-13T11:14:07.731 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 273609 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/infiniband/core/ib_cm.ko 2023-11-13T11:14:07.731 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 879969 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/infiniband/core/ib_core.ko 2023-11-13T11:14:07.731 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 69337 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/infiniband/core/ib_umad.ko 2023-11-13T11:14:07.732 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 324217 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/infiniband/core/ib_uverbs.ko 2023-11-13T11:14:07.732 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 97985 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/infiniband/core/iw_cm.ko 2023-11-13T11:14:07.732 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 282273 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/infiniband/core/rdma_cm.ko 2023-11-13T11:14:07.732 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 66201 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/infiniband/core/rdma_ucm.ko 2023-11-13T11:14:07.733 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/infiniband/hw/ 2023-11-13T11:14:07.733 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/infiniband/hw/cxgb4/ 2023-11-13T11:14:07.733 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 493073 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2023-11-13T11:14:07.733 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/infiniband/hw/mlx4/ 2023-11-13T11:14:07.733 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 419737 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2023-11-13T11:14:07.734 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/infiniband/hw/mlx5/ 2023-11-13T11:14:07.734 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 739025 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2023-11-13T11:14:07.734 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/infiniband/hw/mthca/ 2023-11-13T11:14:07.734 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 296625 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2023-11-13T11:14:07.735 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/infiniband/hw/ocrdma/ 2023-11-13T11:14:07.735 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 153697 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/infiniband/hw/ocrdma/ocrdma.ko 2023-11-13T11:14:07.735 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/infiniband/hw/usnic/ 2023-11-13T11:14:07.735 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 168969 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/infiniband/hw/usnic/usnic_verbs.ko 2023-11-13T11:14:07.735 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/infiniband/ulp/ 2023-11-13T11:14:07.736 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/infiniband/ulp/ipoib/ 2023-11-13T11:14:07.736 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 263081 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2023-11-13T11:14:07.736 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/infiniband/ulp/iser/ 2023-11-13T11:14:07.736 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 100241 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2023-11-13T11:14:07.737 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/infiniband/ulp/isert/ 2023-11-13T11:14:07.737 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 111425 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2023-11-13T11:14:07.737 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/infiniband/ulp/srp/ 2023-11-13T11:14:07.737 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 128753 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2023-11-13T11:14:07.737 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/infiniband/ulp/srpt/ 2023-11-13T11:14:07.738 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 129529 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2023-11-13T11:14:07.738 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/input/ 2023-11-13T11:14:07.738 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 10745 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/input/evbug.ko 2023-11-13T11:14:07.738 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 24129 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/input/ff-memless.ko 2023-11-13T11:14:07.739 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/input/gameport/ 2023-11-13T11:14:07.739 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 11881 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/input/gameport/emu10k1-gp.ko 2023-11-13T11:14:07.739 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 12145 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/input/gameport/fm801-gp.ko 2023-11-13T11:14:07.739 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 41241 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/input/gameport/gameport.ko 2023-11-13T11:14:07.739 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 41801 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/input/joydev.ko 2023-11-13T11:14:07.740 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/input/keyboard/ 2023-11-13T11:14:07.740 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 13313 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/input/keyboard/adp5520-keys.ko 2023-11-13T11:14:07.740 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 12801 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/input/keyboard/adp5588-keys.ko 2023-11-13T11:14:07.740 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 26905 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/input/keyboard/adp5589-keys.ko 2023-11-13T11:14:07.740 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 24761 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/input/keyboard/cros_ec_keyb.ko 2023-11-13T11:14:07.741 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 36665 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/input/keyboard/gpio_keys.ko 2023-11-13T11:14:07.741 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 18625 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/input/keyboard/gpio_keys_polled.ko 2023-11-13T11:14:07.741 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 21257 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/input/keyboard/lkkbd.ko 2023-11-13T11:14:07.741 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 26473 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/input/keyboard/lm8323.ko 2023-11-13T11:14:07.741 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 14409 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/input/keyboard/lm8333.ko 2023-11-13T11:14:07.742 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 24265 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/input/keyboard/matrix_keypad.ko 2023-11-13T11:14:07.742 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 18217 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/input/keyboard/max7359_keypad.ko 2023-11-13T11:14:07.742 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 15929 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/input/keyboard/mcs_touchkey.ko 2023-11-13T11:14:07.742 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 16489 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/input/keyboard/mpr121_touchkey.ko 2023-11-13T11:14:07.743 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 11585 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/input/keyboard/newtonkbd.ko 2023-11-13T11:14:07.743 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 10673 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/input/keyboard/opencores-kbd.ko 2023-11-13T11:14:07.743 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 14161 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/input/keyboard/qt1070.ko 2023-11-13T11:14:07.743 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 17929 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/input/keyboard/qt2160.ko 2023-11-13T11:14:07.743 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 23817 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/input/keyboard/samsung-keypad.ko 2023-11-13T11:14:07.744 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 11481 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/input/keyboard/stowaway.ko 2023-11-13T11:14:07.744 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 18289 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/input/keyboard/sunkbd.ko 2023-11-13T11:14:07.744 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 17489 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/input/keyboard/tca6416-keypad.ko 2023-11-13T11:14:07.744 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 16177 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/input/keyboard/tca8418_keypad.ko 2023-11-13T11:14:07.745 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 16801 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/input/keyboard/twl4030_keypad.ko 2023-11-13T11:14:07.745 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 11753 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/input/keyboard/xtkbd.ko 2023-11-13T11:14:07.745 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 11465 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/input/matrix-keymap.ko 2023-11-13T11:14:07.745 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/input/mouse/ 2023-11-13T11:14:07.746 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 34329 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/input/mouse/appletouch.ko 2023-11-13T11:14:07.746 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 34177 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/input/mouse/bcm5974.ko 2023-11-13T11:14:07.746 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 123681 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/input/mouse/cyapatp.ko 2023-11-13T11:14:07.746 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 89449 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/input/mouse/elan_i2c.ko 2023-11-13T11:14:07.746 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 14025 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/input/mouse/gpio_mouse.ko 2023-11-13T11:14:07.747 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 335977 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/input/mouse/psmouse.ko 2023-11-13T11:14:07.747 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 14681 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/input/mouse/sermouse.ko 2023-11-13T11:14:07.747 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 23881 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/input/mouse/synaptics_i2c.ko 2023-11-13T11:14:07.747 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 22569 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/input/mouse/synaptics_usb.ko 2023-11-13T11:14:07.747 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 15665 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/input/mouse/vsxxxaa.ko 2023-11-13T11:14:07.748 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/input/rmi4/ 2023-11-13T11:14:07.748 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 109873 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/input/rmi4/rmi_core.ko 2023-11-13T11:14:07.748 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/input/serio/ 2023-11-13T11:14:07.748 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 11665 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/input/serio/altera_ps2.ko 2023-11-13T11:14:07.749 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 16289 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/input/serio/arc_ps2.ko 2023-11-13T11:14:07.749 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 16425 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/input/serio/ct82c710.ko 2023-11-13T11:14:07.749 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 16953 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/input/serio/hyperv-keyboard.ko 2023-11-13T11:14:07.749 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 15833 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/input/serio/parkbd.ko 2023-11-13T11:14:07.749 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 13225 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/input/serio/pcips2.ko 2023-11-13T11:14:07.750 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 20153 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/input/serio/ps2mult.ko 2023-11-13T11:14:07.750 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 24153 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/input/serio/serio_raw.ko 2023-11-13T11:14:07.750 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 17977 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/input/serio/serport.ko 2023-11-13T11:14:07.750 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 13337 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/input/sparse-keymap.ko 2023-11-13T11:14:07.750 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/iommu/ 2023-11-13T11:14:07.751 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/iommu/amd/ 2023-11-13T11:14:07.751 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 39289 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/iommu/amd/iommu_v2.ko 2023-11-13T11:14:07.751 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/leds/ 2023-11-13T11:14:07.751 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 13817 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/leds/leds-88pm860x.ko 2023-11-13T11:14:07.751 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 11385 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/leds/leds-adp5520.ko 2023-11-13T11:14:07.752 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 59753 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/leds/leds-bd2802.ko 2023-11-13T11:14:07.752 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 24785 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/leds/leds-blinkm.ko 2023-11-13T11:14:07.752 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 10473 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/leds/leds-da903x.ko 2023-11-13T11:14:07.752 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 12241 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/leds/leds-da9052.ko 2023-11-13T11:14:07.752 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 16561 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/leds/leds-gpio.ko 2023-11-13T11:14:07.753 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 15793 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/leds/leds-lm3530.ko 2023-11-13T11:14:07.753 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 30505 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/leds/leds-lm3533.ko 2023-11-13T11:14:07.753 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 19353 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/leds/leds-lm355x.ko 2023-11-13T11:14:07.753 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 19961 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/leds/leds-lm3642.ko 2023-11-13T11:14:07.754 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 16241 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/leds/leds-lp3944.ko 2023-11-13T11:14:07.754 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 11233 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/leds/leds-lp8788.ko 2023-11-13T11:14:07.754 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 14929 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/leds/leds-max8997.ko 2023-11-13T11:14:07.754 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 12609 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/leds/leds-mc13783.ko 2023-11-13T11:14:07.754 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 13385 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/leds/leds-menf21bmc.ko 2023-11-13T11:14:07.755 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 20721 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/leds/leds-pca9532.ko 2023-11-13T11:14:07.755 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 20481 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/leds/leds-pca955x.ko 2023-11-13T11:14:07.755 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 17857 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/leds/leds-pca963x.ko 2023-11-13T11:14:07.755 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 34433 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/leds/leds-ss4200.ko 2023-11-13T11:14:07.756 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 24865 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/leds/leds-tca6507.ko 2023-11-13T11:14:07.756 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 15665 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/leds/leds-wm831x-status.ko 2023-11-13T11:14:07.756 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 11841 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/leds/leds-wm8350.ko 2023-11-13T11:14:07.756 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/leds/trigger/ 2023-11-13T11:14:07.757 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 10049 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/leds/trigger/ledtrig-audio.ko 2023-11-13T11:14:07.757 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 10873 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2023-11-13T11:14:07.757 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 9089 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/leds/trigger/ledtrig-camera.ko 2023-11-13T11:14:07.757 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 7617 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2023-11-13T11:14:07.757 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 14249 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2023-11-13T11:14:07.758 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 14073 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2023-11-13T11:14:07.758 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 11889 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/leds/trigger/ledtrig-timer.ko 2023-11-13T11:14:07.758 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 14073 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/leds/trigger/ledtrig-transient.ko 2023-11-13T11:14:07.758 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/md/ 2023-11-13T11:14:07.759 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/md/bcache/ 2023-11-13T11:14:07.759 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 654969 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/md/bcache/bcache.ko 2023-11-13T11:14:07.759 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 40577 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/md/dm-bio-prison.ko 2023-11-13T11:14:07.759 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 89601 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/md/dm-bufio.ko 2023-11-13T11:14:07.759 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 47529 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/md/dm-cache-smq.ko 2023-11-13T11:14:07.760 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 156009 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/md/dm-cache.ko 2023-11-13T11:14:07.760 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 106897 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/md/dm-crypt.ko 2023-11-13T11:14:07.760 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 21545 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/md/dm-delay.ko 2023-11-13T11:14:07.760 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 53857 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/md/dm-era.ko 2023-11-13T11:14:07.761 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 28465 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/md/dm-flakey.ko 2023-11-13T11:14:07.761 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 41593 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/md/dm-log-userspace.ko 2023-11-13T11:14:07.761 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 32737 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/md/dm-log.ko 2023-11-13T11:14:07.761 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 49545 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/md/dm-mirror.ko 2023-11-13T11:14:07.761 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 78033 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/md/dm-multipath.ko 2023-11-13T11:14:07.762 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 16473 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/md/dm-queue-length.ko 2023-11-13T11:14:07.762 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 70825 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/md/dm-raid.ko 2023-11-13T11:14:07.762 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 36297 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/md/dm-region-hash.ko 2023-11-13T11:14:07.762 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 15873 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/md/dm-round-robin.ko 2023-11-13T11:14:07.762 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 16801 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/md/dm-service-time.ko 2023-11-13T11:14:07.763 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 109593 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/md/dm-snapshot.ko 2023-11-13T11:14:07.763 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 19361 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/md/dm-switch.ko 2023-11-13T11:14:07.763 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 181865 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/md/dm-thin-pool.ko 2023-11-13T11:14:07.763 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 51737 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/md/dm-verity.ko 2023-11-13T11:14:07.764 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 8561 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/md/dm-zero.ko 2023-11-13T11:14:07.764 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 15345 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/md/faulty.ko 2023-11-13T11:14:07.764 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 19625 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/md/linear.ko 2023-11-13T11:14:07.764 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 32417 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/md/multipath.ko 2023-11-13T11:14:07.764 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/md/persistent-data/ 2023-11-13T11:14:07.765 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 199937 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2023-11-13T11:14:07.765 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 37337 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/md/raid0.ko 2023-11-13T11:14:07.765 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 113073 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/md/raid1.ko 2023-11-13T11:14:07.765 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 158681 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/md/raid10.ko 2023-11-13T11:14:07.765 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 395721 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/md/raid456.ko 2023-11-13T11:14:07.766 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/message/ 2023-11-13T11:14:07.766 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/message/fusion/ 2023-11-13T11:14:07.766 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 178137 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/message/fusion/mptbase.ko 2023-11-13T11:14:07.766 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 63385 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/message/fusion/mptctl.ko 2023-11-13T11:14:07.767 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 44665 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/message/fusion/mptfc.ko 2023-11-13T11:14:07.767 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 37225 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/message/fusion/mptlan.ko 2023-11-13T11:14:07.767 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 123321 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/message/fusion/mptsas.ko 2023-11-13T11:14:07.767 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 79041 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/message/fusion/mptscsih.ko 2023-11-13T11:14:07.767 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 53081 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/message/fusion/mptspi.ko 2023-11-13T11:14:07.768 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/mfd/ 2023-11-13T11:14:07.768 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 17305 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/mfd/88pm800.ko 2023-11-13T11:14:07.768 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 12761 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/mfd/88pm805.ko 2023-11-13T11:14:07.768 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 11193 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/mfd/88pm80x.ko 2023-11-13T11:14:07.768 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 11865 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/mfd/arizona-i2c.ko 2023-11-13T11:14:07.769 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 123721 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/mfd/arizona.ko 2023-11-13T11:14:07.769 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 11961 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/mfd/bcm590xx.ko 2023-11-13T11:14:07.769 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 17465 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/mfd/cros_ec_dev.ko 2023-11-13T11:14:07.769 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 34961 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/mfd/dln2.ko 2023-11-13T11:14:07.769 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 16689 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/mfd/janz-cmodio.ko 2023-11-13T11:14:07.770 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 53585 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/mfd/kempld-core.ko 2023-11-13T11:14:07.770 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 27529 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/mfd/lm3533-core.ko 2023-11-13T11:14:07.770 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 14993 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/mfd/lm3533-ctrlbank.ko 2023-11-13T11:14:07.770 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 13009 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/mfd/lp3943.ko 2023-11-13T11:14:07.771 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 54569 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/mfd/lpc_ich.ko 2023-11-13T11:14:07.771 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 12113 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/mfd/lpc_sch.ko 2023-11-13T11:14:07.771 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 17409 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/mfd/max8907.ko 2023-11-13T11:14:07.771 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 29857 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/mfd/mc13xxx-core.ko 2023-11-13T11:14:07.771 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 11801 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/mfd/mc13xxx-i2c.ko 2023-11-13T11:14:07.772 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 11593 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/mfd/menf21bmc.ko 2023-11-13T11:14:07.772 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 17329 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/mfd/pcf50633-adc.ko 2023-11-13T11:14:07.772 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 9153 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/mfd/pcf50633-gpio.ko 2023-11-13T11:14:07.772 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 34873 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/mfd/pcf50633.ko 2023-11-13T11:14:07.773 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 10105 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/mfd/rdc321x-southbridge.ko 2023-11-13T11:14:07.773 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 20289 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/mfd/retu-mfd.ko 2023-11-13T11:14:07.773 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 80425 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/mfd/si476x-core.ko 2023-11-13T11:14:07.773 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 48457 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/mfd/sm501.ko 2023-11-13T11:14:07.773 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 19825 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/mfd/ti_am335x_tscadc.ko 2023-11-13T11:14:07.774 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 51137 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/mfd/tps65010.ko 2023-11-13T11:14:07.774 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 10417 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/mfd/tps6507x.ko 2023-11-13T11:14:07.774 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 13329 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/mfd/viperboard.ko 2023-11-13T11:14:07.774 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 10537 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/mfd/vx855.ko 2023-11-13T11:14:07.775 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 17953 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/mfd/wl1273-core.ko 2023-11-13T11:14:07.775 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 44345 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/mfd/wm8994.ko 2023-11-13T11:14:07.775 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/misc/ 2023-11-13T11:14:07.775 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 13833 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/misc/ad525x_dpot-i2c.ko 2023-11-13T11:14:07.775 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 48489 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/misc/ad525x_dpot.ko 2023-11-13T11:14:07.776 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/misc/altera-stapl/ 2023-11-13T11:14:07.776 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 46585 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2023-11-13T11:14:07.776 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 18393 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/misc/apds9802als.ko 2023-11-13T11:14:07.776 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 36729 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/misc/apds990x.ko 2023-11-13T11:14:07.776 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 45593 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/misc/bh1770glc.ko 2023-11-13T11:14:07.777 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/misc/c2port/ 2023-11-13T11:14:07.777 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 11145 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/misc/c2port/c2port-duramar2150.ko 2023-11-13T11:14:07.777 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 35281 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/misc/c2port/core.ko 2023-11-13T11:14:07.777 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/misc/cb710/ 2023-11-13T11:14:07.778 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 25161 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/misc/cb710/cb710.ko 2023-11-13T11:14:07.778 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 17801 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/misc/ds1682.ko 2023-11-13T11:14:07.778 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 8897 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/misc/dummy-irq.ko 2023-11-13T11:14:07.778 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/misc/echo/ 2023-11-13T11:14:07.779 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 13657 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/misc/echo/echo.ko 2023-11-13T11:14:07.779 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/misc/eeprom/ 2023-11-13T11:14:07.779 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 37849 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/misc/eeprom/at24.ko 2023-11-13T11:14:07.779 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 14321 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/misc/eeprom/eeprom.ko 2023-11-13T11:14:07.779 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 14769 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2023-11-13T11:14:07.780 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 13537 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/misc/eeprom/max6875.ko 2023-11-13T11:14:07.780 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 33009 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/misc/enclosure.ko 2023-11-13T11:14:07.780 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/misc/genwqe/ 2023-11-13T11:14:07.780 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 152201 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/misc/genwqe/genwqe_card.ko 2023-11-13T11:14:07.780 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 14129 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/misc/hmc6352.ko 2023-11-13T11:14:07.781 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 31321 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/misc/hpilo.ko 2023-11-13T11:14:07.781 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/misc/ibmasm/ 2023-11-13T11:14:07.781 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 72129 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/misc/ibmasm/ibmasm.ko 2023-11-13T11:14:07.781 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 19785 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/misc/ics932s401.ko 2023-11-13T11:14:07.782 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 21681 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/misc/isl29003.ko 2023-11-13T11:14:07.782 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 15753 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/misc/isl29020.ko 2023-11-13T11:14:07.782 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/misc/lis3lv02d/ 2023-11-13T11:14:07.782 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 42513 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2023-11-13T11:14:07.782 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 13857 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2023-11-13T11:14:07.783 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/misc/mei/ 2023-11-13T11:14:07.783 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 125209 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/misc/mei/mei-me.ko 2023-11-13T11:14:07.783 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 56521 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/misc/mei/mei-txe.ko 2023-11-13T11:14:07.783 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 310113 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/misc/mei/mei.ko 2023-11-13T11:14:07.784 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 31329 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/misc/phantom.ko 2023-11-13T11:14:07.784 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/misc/ti-st/ 2023-11-13T11:14:07.784 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 74265 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/misc/ti-st/st_drv.ko 2023-11-13T11:14:07.784 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 24305 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/misc/tifm_7xx1.ko 2023-11-13T11:14:07.784 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 28849 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/misc/tifm_core.ko 2023-11-13T11:14:07.785 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 18729 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/misc/tsl2550.ko 2023-11-13T11:14:07.785 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 48697 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/misc/vmw_balloon.ko 2023-11-13T11:14:07.785 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/misc/vmw_vmci/ 2023-11-13T11:14:07.785 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 183609 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2023-11-13T11:14:07.785 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ 2023-11-13T11:14:07.786 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/bonding/ 2023-11-13T11:14:07.786 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 490129 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/bonding/bonding.ko 2023-11-13T11:14:07.786 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/dsa/ 2023-11-13T11:14:07.786 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/dsa/b53/ 2023-11-13T11:14:07.787 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 106033 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/dsa/b53/b53_common.ko 2023-11-13T11:14:07.787 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 40297 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/dsa/bcm-sf2.ko 2023-11-13T11:14:07.787 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 16041 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/dsa/mv88e6060.ko 2023-11-13T11:14:07.787 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/dsa/mv88e6xxx/ 2023-11-13T11:14:07.787 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 453737 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2023-11-13T11:14:07.788 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 16929 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/dummy.ko 2023-11-13T11:14:07.788 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 17961 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/eql.ko 2023-11-13T11:14:07.788 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/ 2023-11-13T11:14:07.788 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/3com/ 2023-11-13T11:14:07.788 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 45785 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2023-11-13T11:14:07.789 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 42105 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2023-11-13T11:14:07.789 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 130553 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/3com/3c59x.ko 2023-11-13T11:14:07.789 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 68849 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/3com/typhoon.ko 2023-11-13T11:14:07.789 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/8390/ 2023-11-13T11:14:07.789 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 37649 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/8390/8390.ko 2023-11-13T11:14:07.790 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 59689 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2023-11-13T11:14:07.790 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 27201 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2023-11-13T11:14:07.790 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 99113 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2023-11-13T11:14:07.790 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/adaptec/ 2023-11-13T11:14:07.790 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 54521 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/adaptec/starfire.ko 2023-11-13T11:14:07.791 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/agere/ 2023-11-13T11:14:07.791 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 69201 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/agere/et131x.ko 2023-11-13T11:14:07.791 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/alteon/ 2023-11-13T11:14:07.791 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 59585 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/alteon/acenic.ko 2023-11-13T11:14:07.791 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/altera/ 2023-11-13T11:14:07.792 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 41409 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/altera/altera_tse.ko 2023-11-13T11:14:07.792 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/amd/ 2023-11-13T11:14:07.792 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 54609 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/amd/amd8111e.ko 2023-11-13T11:14:07.792 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 49289 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2023-11-13T11:14:07.793 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 87297 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/amd/pcnet32.ko 2023-11-13T11:14:07.793 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/atheros/ 2023-11-13T11:14:07.793 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/atheros/alx/ 2023-11-13T11:14:07.793 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 97337 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2023-11-13T11:14:07.793 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/atheros/atl1c/ 2023-11-13T11:14:07.794 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 104673 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2023-11-13T11:14:07.794 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/atheros/atl1e/ 2023-11-13T11:14:07.794 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 90257 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2023-11-13T11:14:07.794 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/atheros/atlx/ 2023-11-13T11:14:07.795 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 81569 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2023-11-13T11:14:07.795 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 69729 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2023-11-13T11:14:07.795 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/broadcom/ 2023-11-13T11:14:07.795 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 78401 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/broadcom/b44.ko 2023-11-13T11:14:07.795 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 176761 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2023-11-13T11:14:07.796 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/broadcom/bnx2x/ 2023-11-13T11:14:07.796 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 1421497 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2023-11-13T11:14:07.796 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 128569 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/broadcom/cnic.ko 2023-11-13T11:14:07.796 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/broadcom/genet/ 2023-11-13T11:14:07.796 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 132089 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2023-11-13T11:14:07.797 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 312081 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/broadcom/tg3.ko 2023-11-13T11:14:07.797 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/brocade/ 2023-11-13T11:14:07.797 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/brocade/bna/ 2023-11-13T11:14:07.797 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 323513 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2023-11-13T11:14:07.798 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/chelsio/ 2023-11-13T11:14:07.798 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/chelsio/cxgb/ 2023-11-13T11:14:07.798 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 193497 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2023-11-13T11:14:07.798 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/chelsio/cxgb3/ 2023-11-13T11:14:07.798 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 347417 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2023-11-13T11:14:07.799 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/chelsio/cxgb4/ 2023-11-13T11:14:07.799 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 1044433 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2023-11-13T11:14:07.799 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/chelsio/cxgb4vf/ 2023-11-13T11:14:07.799 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 166193 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2023-11-13T11:14:07.799 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/chelsio/libcxgb/ 2023-11-13T11:14:07.800 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 34881 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2023-11-13T11:14:07.800 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/cisco/ 2023-11-13T11:14:07.800 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/cisco/enic/ 2023-11-13T11:14:07.800 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 204345 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2023-11-13T11:14:07.800 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/dec/ 2023-11-13T11:14:07.801 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/dec/tulip/ 2023-11-13T11:14:07.801 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 69449 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2023-11-13T11:14:07.801 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 61489 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2023-11-13T11:14:07.801 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 141225 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2023-11-13T11:14:07.802 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 51497 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2023-11-13T11:14:07.802 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 62817 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2023-11-13T11:14:07.802 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 31369 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2023-11-13T11:14:07.802 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/dlink/ 2023-11-13T11:14:07.802 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 60873 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/dlink/dl2k.ko 2023-11-13T11:14:07.803 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 62833 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/dlink/sundance.ko 2023-11-13T11:14:07.803 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 45721 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/dnet.ko 2023-11-13T11:14:07.803 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 25185 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/ec_bhf.ko 2023-11-13T11:14:07.803 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/emulex/ 2023-11-13T11:14:07.804 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/emulex/benet/ 2023-11-13T11:14:07.804 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 281137 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2023-11-13T11:14:07.804 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 49457 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/ethoc.ko 2023-11-13T11:14:07.804 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 51737 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/fealnx.ko 2023-11-13T11:14:07.804 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/fujitsu/ 2023-11-13T11:14:07.805 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 45345 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/fujitsu/fmvj18x_cs.ko 2023-11-13T11:14:07.805 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/intel/ 2023-11-13T11:14:07.805 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 90465 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/intel/e100.ko 2023-11-13T11:14:07.805 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/intel/e1000/ 2023-11-13T11:14:07.805 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 295577 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2023-11-13T11:14:07.928 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/intel/e1000e/ 2023-11-13T11:14:07.928 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 584497 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2023-11-13T11:14:07.929 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/intel/fm10k/ 2023-11-13T11:14:07.929 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 246209 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2023-11-13T11:14:07.929 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/intel/i40e/ 2023-11-13T11:14:07.929 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 925697 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2023-11-13T11:14:07.929 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/intel/iavf/ 2023-11-13T11:14:07.930 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 302849 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2023-11-13T11:14:07.930 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/intel/igb/ 2023-11-13T11:14:07.930 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 514681 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/intel/igb/igb.ko 2023-11-13T11:14:07.930 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/intel/igbvf/ 2023-11-13T11:14:07.931 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 93593 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2023-11-13T11:14:07.931 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/intel/ixgbe/ 2023-11-13T11:14:07.931 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 734305 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2023-11-13T11:14:07.931 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/intel/ixgbevf/ 2023-11-13T11:14:07.931 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 151769 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2023-11-13T11:14:07.932 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 86921 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/jme.ko 2023-11-13T11:14:07.932 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/marvell/ 2023-11-13T11:14:07.932 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 20977 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2023-11-13T11:14:07.932 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 102289 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/marvell/skge.ko 2023-11-13T11:14:07.932 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 122649 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/marvell/sky2.ko 2023-11-13T11:14:07.933 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/mellanox/ 2023-11-13T11:14:07.933 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/mellanox/mlx4/ 2023-11-13T11:14:07.933 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 727601 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2023-11-13T11:14:07.933 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 278937 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2023-11-13T11:14:07.934 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/mellanox/mlx5/ 2023-11-13T11:14:07.934 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/mellanox/mlx5/core/ 2023-11-13T11:14:07.934 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 1113993 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2023-11-13T11:14:07.934 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/micrel/ 2023-11-13T11:14:07.934 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 53105 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/micrel/ks8842.ko 2023-11-13T11:14:07.935 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 40993 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/micrel/ks8851_common.ko 2023-11-13T11:14:07.935 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 19489 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/micrel/ks8851_par.ko 2023-11-13T11:14:07.935 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 95665 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2023-11-13T11:14:07.935 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/myricom/ 2023-11-13T11:14:07.935 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/myricom/myri10ge/ 2023-11-13T11:14:07.936 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 108649 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2023-11-13T11:14:07.936 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/natsemi/ 2023-11-13T11:14:07.936 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 73441 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2023-11-13T11:14:07.936 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 47777 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2023-11-13T11:14:07.937 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/neterion/ 2023-11-13T11:14:07.937 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 150905 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/neterion/s2io.ko 2023-11-13T11:14:07.937 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/nvidia/ 2023-11-13T11:14:07.937 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 136721 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2023-11-13T11:14:07.937 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/packetengines/ 2023-11-13T11:14:07.938 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 50481 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2023-11-13T11:14:07.938 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 43145 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2023-11-13T11:14:07.938 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/qlogic/ 2023-11-13T11:14:07.938 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/qlogic/netxen/ 2023-11-13T11:14:07.939 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 227897 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2023-11-13T11:14:07.939 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 87081 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2023-11-13T11:14:07.939 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/qlogic/qlcnic/ 2023-11-13T11:14:07.939 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 672049 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2023-11-13T11:14:07.939 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/rdc/ 2023-11-13T11:14:07.940 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 43017 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/rdc/r6040.ko 2023-11-13T11:14:07.940 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/realtek/ 2023-11-13T11:14:07.940 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 67385 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/realtek/8139cp.ko 2023-11-13T11:14:07.940 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 83985 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/realtek/8139too.ko 2023-11-13T11:14:07.940 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 29321 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/realtek/atp.ko 2023-11-13T11:14:07.941 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 189801 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/realtek/r8169.ko 2023-11-13T11:14:07.941 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/samsung/ 2023-11-13T11:14:07.941 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/samsung/sxgbe/ 2023-11-13T11:14:07.941 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 104241 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/samsung/sxgbe/samsung-sxgbe.ko 2023-11-13T11:14:07.941 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/sfc/ 2023-11-13T11:14:07.942 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 1053921 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/sfc/sfc.ko 2023-11-13T11:14:07.942 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/silan/ 2023-11-13T11:14:07.942 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 47097 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/silan/sc92031.ko 2023-11-13T11:14:07.942 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/sis/ 2023-11-13T11:14:07.943 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 54817 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/sis/sis190.ko 2023-11-13T11:14:07.943 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 63337 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/sis/sis900.ko 2023-11-13T11:14:07.943 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/smsc/ 2023-11-13T11:14:07.943 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 61601 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/smsc/epic100.ko 2023-11-13T11:14:07.943 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 67193 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2023-11-13T11:14:07.944 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 73409 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2023-11-13T11:14:07.944 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 68177 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2023-11-13T11:14:07.944 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/stmicro/ 2023-11-13T11:14:07.944 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/stmicro/stmmac/ 2023-11-13T11:14:07.944 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 13441 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-generic.ko 2023-11-13T11:14:07.945 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 39905 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2023-11-13T11:14:07.945 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 20657 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac-platform.ko 2023-11-13T11:14:07.945 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 486961 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2023-11-13T11:14:07.945 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/sun/ 2023-11-13T11:14:07.945 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 103337 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/sun/cassini.ko 2023-11-13T11:14:07.946 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 166161 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/sun/niu.ko 2023-11-13T11:14:07.946 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 66329 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/sun/sungem.ko 2023-11-13T11:14:07.946 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 78801 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/sun/sunhme.ko 2023-11-13T11:14:07.946 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/tehuti/ 2023-11-13T11:14:07.947 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 50057 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2023-11-13T11:14:07.947 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/ti/ 2023-11-13T11:14:07.947 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 86529 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/ti/tlan.ko 2023-11-13T11:14:07.947 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/via/ 2023-11-13T11:14:07.947 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 80273 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/via/via-rhine.ko 2023-11-13T11:14:07.948 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 83633 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/via/via-velocity.ko 2023-11-13T11:14:07.948 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/wiznet/ 2023-11-13T11:14:07.948 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 46241 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/wiznet/w5100.ko 2023-11-13T11:14:07.948 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 30849 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/wiznet/w5300.ko 2023-11-13T11:14:07.949 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/xircom/ 2023-11-13T11:14:07.949 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 60057 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2023-11-13T11:14:07.949 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/fddi/ 2023-11-13T11:14:07.949 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 41065 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/fddi/defxx.ko 2023-11-13T11:14:07.949 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/fddi/skfp/ 2023-11-13T11:14:07.950 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 216985 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/fddi/skfp/skfp.ko 2023-11-13T11:14:07.950 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 77345 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/geneve.ko 2023-11-13T11:14:07.950 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/hyperv/ 2023-11-13T11:14:07.950 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 235521 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/hyperv/hv_netvsc.ko 2023-11-13T11:14:07.950 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ieee802154/ 2023-11-13T11:14:07.951 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 18273 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ieee802154/fakelb.ko 2023-11-13T11:14:07.951 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 25065 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ifb.ko 2023-11-13T11:14:07.951 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ipvlan/ 2023-11-13T11:14:07.951 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 83769 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ipvlan/ipvlan.ko 2023-11-13T11:14:07.951 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 62209 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/macvlan.ko 2023-11-13T11:14:07.952 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 15865 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/macvtap.ko 2023-11-13T11:14:07.952 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/mdio/ 2023-11-13T11:14:07.952 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 20569 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2023-11-13T11:14:07.952 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 14185 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/mdio/mdio-bitbang.ko 2023-11-13T11:14:07.953 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 13745 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/mdio/mdio-gpio.ko 2023-11-13T11:14:07.953 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 8825 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/mdio/mdio-regmap.ko 2023-11-13T11:14:07.953 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 16025 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/mdio.ko 2023-11-13T11:14:07.953 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 20513 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/mii.ko 2023-11-13T11:14:07.953 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 43953 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/netconsole.ko 2023-11-13T11:14:07.954 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 13145 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/nlmon.ko 2023-11-13T11:14:07.954 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/pcs/ 2023-11-13T11:14:07.954 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 17985 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/pcs/pcs-lynx.ko 2023-11-13T11:14:07.954 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 38977 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/pcs/pcs_xpcs.ko 2023-11-13T11:14:07.954 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/phy/ 2023-11-13T11:14:07.955 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 9737 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/phy/amd.ko 2023-11-13T11:14:07.955 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 50097 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/phy/bcm-phy-lib.ko 2023-11-13T11:14:07.955 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 44505 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/phy/bcm7xxx.ko 2023-11-13T11:14:07.955 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 11521 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/phy/bcm87xx.ko 2023-11-13T11:14:07.956 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 42241 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/phy/broadcom.ko 2023-11-13T11:14:07.956 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 10625 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/phy/cicada.ko 2023-11-13T11:14:07.956 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 13025 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/phy/davicom.ko 2023-11-13T11:14:07.956 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 9449 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/phy/et1011c.ko 2023-11-13T11:14:07.956 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 24969 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/phy/icplus.ko 2023-11-13T11:14:07.957 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 15849 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/phy/lxt.ko 2023-11-13T11:14:07.957 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 82049 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/phy/marvell.ko 2023-11-13T11:14:07.957 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 76177 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/phy/micrel.ko 2023-11-13T11:14:07.957 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 12033 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/phy/national.ko 2023-11-13T11:14:07.957 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 97857 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/phy/phylink.ko 2023-11-13T11:14:07.958 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 10065 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/phy/qsemi.ko 2023-11-13T11:14:07.958 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 50065 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/phy/realtek.ko 2023-11-13T11:14:07.958 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 29985 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/phy/smsc.ko 2023-11-13T11:14:07.958 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 10857 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/phy/ste10Xp.ko 2023-11-13T11:14:07.958 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 24289 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/phy/vitesse.ko 2023-11-13T11:14:07.959 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/plip/ 2023-11-13T11:14:07.959 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 43569 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/plip/plip.ko 2023-11-13T11:14:07.959 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ppp/ 2023-11-13T11:14:07.959 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 15857 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ppp/bsd_comp.ko 2023-11-13T11:14:07.960 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 29713 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ppp/ppp_async.ko 2023-11-13T11:14:07.960 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 17665 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ppp/ppp_deflate.ko 2023-11-13T11:14:07.960 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 18625 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ppp/ppp_mppe.ko 2023-11-13T11:14:07.960 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 28729 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ppp/ppp_synctty.ko 2023-11-13T11:14:07.960 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 42545 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ppp/pppoe.ko 2023-11-13T11:14:07.961 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 13441 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ppp/pppox.ko 2023-11-13T11:14:07.961 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 32689 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ppp/pptp.ko 2023-11-13T11:14:07.961 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 28289 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/sb1000.ko 2023-11-13T11:14:07.961 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/slip/ 2023-11-13T11:14:07.961 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 42465 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/slip/slip.ko 2023-11-13T11:14:07.962 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 26929 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/sungem_phy.ko 2023-11-13T11:14:07.962 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 64385 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/tap.ko 2023-11-13T11:14:07.962 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/team/ 2023-11-13T11:14:07.962 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 106169 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/team/team.ko 2023-11-13T11:14:07.962 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 13497 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/team/team_mode_activebackup.ko 2023-11-13T11:14:07.963 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 10209 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/team/team_mode_broadcast.ko 2023-11-13T11:14:07.963 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 28881 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/team/team_mode_loadbalance.ko 2023-11-13T11:14:07.963 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 9641 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/team/team_mode_random.ko 2023-11-13T11:14:07.963 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 9321 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/team/team_mode_roundrobin.ko 2023-11-13T11:14:07.964 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 87017 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/veth.ko 2023-11-13T11:14:07.964 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/vmxnet3/ 2023-11-13T11:14:07.964 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 144297 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/vmxnet3/vmxnet3.ko 2023-11-13T11:14:07.964 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/vxlan/ 2023-11-13T11:14:07.964 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 297329 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/vxlan/vxlan.ko 2023-11-13T11:14:07.965 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/xen-netback/ 2023-11-13T11:14:07.965 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 144649 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/xen-netback/xen-netback.ko 2023-11-13T11:14:07.965 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/ntb/ 2023-11-13T11:14:07.965 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 20969 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/ntb/ntb.ko 2023-11-13T11:14:07.965 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/nvme/ 2023-11-13T11:14:07.966 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/nvme/host/ 2023-11-13T11:14:07.966 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 264937 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/nvme/host/nvme-core.ko 2023-11-13T11:14:07.966 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 102209 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/nvme/host/nvme.ko 2023-11-13T11:14:07.966 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/parport/ 2023-11-13T11:14:07.967 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 133841 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/parport/parport.ko 2023-11-13T11:14:07.967 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 14561 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/parport/parport_cs.ko 2023-11-13T11:14:07.967 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 84465 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/parport/parport_pc.ko 2023-11-13T11:14:07.967 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 26121 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/parport/parport_serial.ko 2023-11-13T11:14:07.968 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/pci/ 2023-11-13T11:14:07.968 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/pci/hotplug/ 2023-11-13T11:14:07.968 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 25009 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2023-11-13T11:14:07.968 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 17849 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/pci/hotplug/cpcihp_generic.ko 2023-11-13T11:14:07.968 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 20137 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/pci/hotplug/cpcihp_zt5550.ko 2023-11-13T11:14:07.969 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 11857 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/pci/pci-stub.ko 2023-11-13T11:14:07.969 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 46529 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/pci/xen-pcifront.ko 2023-11-13T11:14:07.969 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/pcmcia/ 2023-11-13T11:14:07.969 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 26793 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/pcmcia/i82092.ko 2023-11-13T11:14:07.969 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 145809 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/pcmcia/pcmcia.ko 2023-11-13T11:14:07.970 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 62137 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/pcmcia/pcmcia_core.ko 2023-11-13T11:14:07.970 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 34345 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/pcmcia/pcmcia_rsrc.ko 2023-11-13T11:14:07.970 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 34265 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/pcmcia/pd6729.ko 2023-11-13T11:14:07.970 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 112889 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/pcmcia/yenta_socket.ko 2023-11-13T11:14:07.971 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/phy/ 2023-11-13T11:14:07.971 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/phy/broadcom/ 2023-11-13T11:14:07.971 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 10841 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/phy/broadcom/phy-bcm-kona-usb2.ko 2023-11-13T11:14:07.971 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/phy/samsung/ 2023-11-13T11:14:07.971 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 8441 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/phy/samsung/phy-exynos-usb2.ko 2023-11-13T11:14:07.972 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/pinctrl/ 2023-11-13T11:14:07.972 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/pinctrl/intel/ 2023-11-13T11:14:07.972 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 70153 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2023-11-13T11:14:07.972 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/platform/ 2023-11-13T11:14:07.973 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/platform/chrome/ 2023-11-13T11:14:07.973 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 50889 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/platform/chrome/cros-ec-sensorhub.ko 2023-11-13T11:14:07.973 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 20849 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/platform/chrome/cros_ec.ko 2023-11-13T11:14:07.973 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 21449 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/platform/chrome/cros_ec_chardev.ko 2023-11-13T11:14:07.973 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 25417 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/platform/chrome/cros_ec_debugfs.ko 2023-11-13T11:14:07.974 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 26201 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/platform/chrome/cros_ec_lightbar.ko 2023-11-13T11:14:07.974 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 18201 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/platform/chrome/cros_ec_sysfs.ko 2023-11-13T11:14:07.974 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 17425 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/platform/chrome/cros_usbpd_notify.ko 2023-11-13T11:14:07.974 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/platform/x86/ 2023-11-13T11:14:07.974 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 67097 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/platform/x86/acer-wmi.ko 2023-11-13T11:14:07.975 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 39145 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/platform/x86/acerhdf.ko 2023-11-13T11:14:07.975 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 36913 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/platform/x86/apple-gmux.ko 2023-11-13T11:14:07.975 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 59665 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/platform/x86/asus-laptop.ko 2023-11-13T11:14:07.975 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 31097 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/platform/x86/asus-nb-wmi.ko 2023-11-13T11:14:07.976 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 127569 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/platform/x86/asus-wmi.ko 2023-11-13T11:14:07.976 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 36913 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/platform/x86/classmate-laptop.ko 2023-11-13T11:14:07.976 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 49121 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/platform/x86/eeepc-laptop.ko 2023-11-13T11:14:07.976 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 13961 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/platform/x86/eeepc-wmi.ko 2023-11-13T11:14:07.976 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 40265 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/platform/x86/fujitsu-laptop.ko 2023-11-13T11:14:07.977 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 22521 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/platform/x86/fujitsu-tablet.ko 2023-11-13T11:14:07.977 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 36657 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/platform/x86/hdaps.ko 2023-11-13T11:14:07.977 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 19449 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/platform/x86/ibm_rtl.ko 2023-11-13T11:14:07.977 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/platform/x86/intel/ 2023-11-13T11:14:07.977 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 12073 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/platform/x86/intel/intel-rst.ko 2023-11-13T11:14:07.978 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 8985 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/platform/x86/intel/intel-smartconnect.ko 2023-11-13T11:14:07.978 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 43497 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/platform/x86/intel_ips.ko 2023-11-13T11:14:07.978 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 20273 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/platform/x86/msi-wmi.ko 2023-11-13T11:14:07.978 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 10377 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/platform/x86/mxm-wmi.ko 2023-11-13T11:14:07.979 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 34801 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/platform/x86/panasonic-laptop.ko 2023-11-13T11:14:07.979 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 42329 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/platform/x86/samsung-laptop.ko 2023-11-13T11:14:07.979 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 14169 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/platform/x86/samsung-q10.ko 2023-11-13T11:14:07.979 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 17321 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/platform/x86/topstar-laptop.ko 2023-11-13T11:14:07.979 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 13721 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2023-11-13T11:14:07.980 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 17081 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/platform/x86/toshiba_haps.ko 2023-11-13T11:14:07.980 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 10129 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/platform/x86/wmi-bmof.ko 2023-11-13T11:14:07.980 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 57569 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/platform/x86/wmi.ko 2023-11-13T11:14:07.980 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/power/ 2023-11-13T11:14:07.980 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/power/supply/ 2023-11-13T11:14:07.981 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 30345 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/power/supply/88pm860x_battery.ko 2023-11-13T11:14:07.981 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 33985 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/power/supply/88pm860x_charger.ko 2023-11-13T11:14:07.981 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 55057 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/power/supply/bq2415x_charger.ko 2023-11-13T11:14:07.981 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 54081 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/power/supply/bq24190_charger.ko 2023-11-13T11:14:07.981 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 21553 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/power/supply/bq24735-charger.ko 2023-11-13T11:14:07.982 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 17337 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/power/supply/cros_peripheral_charger.ko 2023-11-13T11:14:07.982 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 19609 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/power/supply/da9030_battery.ko 2023-11-13T11:14:07.982 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 19841 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/power/supply/da9052-battery.ko 2023-11-13T11:14:07.983 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 29281 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/power/supply/ds2760_battery.ko 2023-11-13T11:14:07.983 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 23217 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/power/supply/ds2780_battery.ko 2023-11-13T11:14:07.983 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 23353 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/power/supply/ds2781_battery.ko 2023-11-13T11:14:07.983 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 23649 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/power/supply/ds2782_battery.ko 2023-11-13T11:14:07.983 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 20353 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/power/supply/gpio-charger.ko 2023-11-13T11:14:07.984 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 18041 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/power/supply/isp1704_charger.ko 2023-11-13T11:14:07.984 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 20273 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/power/supply/lp8727_charger.ko 2023-11-13T11:14:07.984 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 12577 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/power/supply/max14577_charger.ko 2023-11-13T11:14:07.984 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 25897 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/power/supply/max17040_battery.ko 2023-11-13T11:14:07.985 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 30289 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/power/supply/max17042_battery.ko 2023-11-13T11:14:07.985 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 18585 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/power/supply/max8903_charger.ko 2023-11-13T11:14:07.985 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 23729 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/power/supply/max8925_power.ko 2023-11-13T11:14:07.985 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 21657 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/power/supply/pcf50633-charger.ko 2023-11-13T11:14:07.985 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 38009 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/power/supply/sbs-battery.ko 2023-11-13T11:14:07.986 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 28385 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/power/supply/test_power.ko 2023-11-13T11:14:07.986 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 18865 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/power/supply/tps65090-charger.ko 2023-11-13T11:14:07.986 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 11969 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/power/supply/wm831x_backup.ko 2023-11-13T11:14:07.986 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 24521 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/power/supply/wm831x_power.ko 2023-11-13T11:14:07.987 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 22417 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/power/supply/wm8350_power.ko 2023-11-13T11:14:07.987 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/powercap/ 2023-11-13T11:14:07.987 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 57729 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/powercap/intel_rapl_common.ko 2023-11-13T11:14:07.987 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 17345 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/powercap/intel_rapl_msr.ko 2023-11-13T11:14:07.987 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/pps/ 2023-11-13T11:14:07.988 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/pps/clients/ 2023-11-13T11:14:07.988 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 15521 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/pps/clients/pps-gpio.ko 2023-11-13T11:14:07.988 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 13249 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/pps/clients/pps-ldisc.ko 2023-11-13T11:14:07.988 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 15913 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/pps/clients/pps_parport.ko 2023-11-13T11:14:07.989 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 41873 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/pps/pps_core.ko 2023-11-13T11:14:07.989 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/ptp/ 2023-11-13T11:14:07.989 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 66385 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/ptp/ptp.ko 2023-11-13T11:14:07.989 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 16449 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/ptp/ptp_kvm.ko 2023-11-13T11:14:07.989 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/rtc/ 2023-11-13T11:14:07.990 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 23497 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/rtc/rtc-88pm80x.ko 2023-11-13T11:14:07.990 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 24521 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/rtc/rtc-88pm860x.ko 2023-11-13T11:14:07.990 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 15393 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/rtc/rtc-bq32k.ko 2023-11-13T11:14:07.990 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 20105 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/rtc/rtc-da9052.ko 2023-11-13T11:14:07.990 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 18505 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/rtc/rtc-da9055.ko 2023-11-13T11:14:07.991 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 20425 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/rtc/rtc-da9063.ko 2023-11-13T11:14:07.991 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 16457 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/rtc/rtc-ds1286.ko 2023-11-13T11:14:07.991 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 68577 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/rtc/rtc-ds1307.ko 2023-11-13T11:14:07.991 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 20817 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/rtc/rtc-ds1374.ko 2023-11-13T11:14:07.991 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 18217 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/rtc/rtc-ds1511.ko 2023-11-13T11:14:07.992 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 16737 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/rtc/rtc-ds1553.ko 2023-11-13T11:14:07.992 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 13953 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/rtc/rtc-ds1672.ko 2023-11-13T11:14:07.992 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 13369 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/rtc/rtc-ds1742.ko 2023-11-13T11:14:07.992 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 14697 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/rtc/rtc-ds2404.ko 2023-11-13T11:14:07.993 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 23705 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/rtc/rtc-ds3232.ko 2023-11-13T11:14:07.993 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 11081 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/rtc/rtc-em3027.ko 2023-11-13T11:14:07.993 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 24329 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/rtc/rtc-fm3130.ko 2023-11-13T11:14:07.993 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 20729 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/rtc/rtc-isl12022.ko 2023-11-13T11:14:07.993 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 35969 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/rtc/rtc-isl1208.ko 2023-11-13T11:14:07.994 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 14673 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/rtc/rtc-lp8788.ko 2023-11-13T11:14:07.994 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 38097 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/rtc/rtc-m41t80.ko 2023-11-13T11:14:07.994 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 12089 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/rtc/rtc-m48t35.ko 2023-11-13T11:14:07.994 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 25945 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/rtc/rtc-m48t59.ko 2023-11-13T11:14:07.995 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 14841 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/rtc/rtc-m48t86.ko 2023-11-13T11:14:07.995 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 11633 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/rtc/rtc-max6900.ko 2023-11-13T11:14:07.995 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 14737 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/rtc/rtc-max8907.ko 2023-11-13T11:14:07.995 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 15409 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/rtc/rtc-max8925.ko 2023-11-13T11:14:07.996 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 25809 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/rtc/rtc-max8997.ko 2023-11-13T11:14:07.996 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 16681 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/rtc/rtc-max8998.ko 2023-11-13T11:14:07.996 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 18513 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/rtc/rtc-mc13xxx.ko 2023-11-13T11:14:07.996 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 11409 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/rtc/rtc-msm6242.ko 2023-11-13T11:14:07.996 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 19625 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/rtc/rtc-palmas.ko 2023-11-13T11:14:07.997 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 46633 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/rtc/rtc-pcf2127.ko 2023-11-13T11:14:07.997 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 17977 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/rtc/rtc-pcf50633.ko 2023-11-13T11:14:07.997 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 26993 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/rtc/rtc-pcf85063.ko 2023-11-13T11:14:07.997 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 21825 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/rtc/rtc-pcf8523.ko 2023-11-13T11:14:07.997 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 29881 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/rtc/rtc-pcf8563.ko 2023-11-13T11:14:07.998 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 12441 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/rtc/rtc-pcf8583.ko 2023-11-13T11:14:07.998 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 18033 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/rtc/rtc-rc5t583.ko 2023-11-13T11:14:07.998 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 13049 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/rtc/rtc-rp5c01.ko 2023-11-13T11:14:07.998 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 33753 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/rtc/rtc-rs5c372.ko 2023-11-13T11:14:07.998 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 27833 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/rtc/rtc-rv3029c2.ko 2023-11-13T11:14:07.999 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 25257 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/rtc/rtc-rx8025.ko 2023-11-13T11:14:07.999 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 20113 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/rtc/rtc-rx8581.ko 2023-11-13T11:14:07.999 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 21617 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/rtc/rtc-s35390a.ko 2023-11-13T11:14:07.999 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 16825 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/rtc/rtc-stk17ta8.ko 2023-11-13T11:14:08.000 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 17889 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/rtc/rtc-tps6586x.ko 2023-11-13T11:14:08.000 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 21337 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/rtc/rtc-tps65910.ko 2023-11-13T11:14:08.000 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 20545 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/rtc/rtc-wm831x.ko 2023-11-13T11:14:08.000 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 21089 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/rtc/rtc-wm8350.ko 2023-11-13T11:14:08.000 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 27873 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/rtc/rtc-x1205.ko 2023-11-13T11:14:08.001 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/ 2023-11-13T11:14:08.001 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 77617 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/3w-9xxx.ko 2023-11-13T11:14:08.001 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 57665 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/3w-sas.ko 2023-11-13T11:14:08.001 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 55169 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/3w-xxxx.ko 2023-11-13T11:14:08.001 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 135185 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/BusLogic.ko 2023-11-13T11:14:08.002 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 26657 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/a100u2w.ko 2023-11-13T11:14:08.002 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/aacraid/ 2023-11-13T11:14:08.002 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 272305 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/aacraid/aacraid.ko 2023-11-13T11:14:08.002 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 100617 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/advansys.ko 2023-11-13T11:14:08.003 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/aic7xxx/ 2023-11-13T11:14:08.003 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 356265 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2023-11-13T11:14:08.003 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 295801 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2023-11-13T11:14:08.003 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/aic94xx/ 2023-11-13T11:14:08.003 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 189185 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/aic94xx/aic94xx.ko 2023-11-13T11:14:08.003 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 24073 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/am53c974.ko 2023-11-13T11:14:08.004 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/arcmsr/ 2023-11-13T11:14:08.004 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 106881 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/arcmsr/arcmsr.ko 2023-11-13T11:14:08.004 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 38185 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/atp870u.ko 2023-11-13T11:14:08.004 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/be2iscsi/ 2023-11-13T11:14:08.004 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 246985 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2023-11-13T11:14:08.005 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/bfa/ 2023-11-13T11:14:08.005 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 1171945 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/bfa/bfa.ko 2023-11-13T11:14:08.005 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/bnx2fc/ 2023-11-13T11:14:08.005 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 237273 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2023-11-13T11:14:08.006 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/bnx2i/ 2023-11-13T11:14:08.006 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 115369 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/bnx2i/bnx2i.ko 2023-11-13T11:14:08.006 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 40585 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/ch.ko 2023-11-13T11:14:08.006 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/csiostor/ 2023-11-13T11:14:08.006 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 308921 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/csiostor/csiostor.ko 2023-11-13T11:14:08.007 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/cxgbi/ 2023-11-13T11:14:08.007 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/cxgbi/cxgb3i/ 2023-11-13T11:14:08.007 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 76145 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2023-11-13T11:14:08.007 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/cxgbi/cxgb4i/ 2023-11-13T11:14:08.007 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 101449 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2023-11-13T11:14:08.008 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 146689 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2023-11-13T11:14:08.008 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 75553 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/dc395x.ko 2023-11-13T11:14:08.008 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 38137 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/dmx3191d.ko 2023-11-13T11:14:08.008 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/esas2r/ 2023-11-13T11:14:08.009 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 212425 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/esas2r/esas2r.ko 2023-11-13T11:14:08.009 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 60505 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/esp_scsi.ko 2023-11-13T11:14:08.009 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/fcoe/ 2023-11-13T11:14:08.009 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 78209 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/fcoe/fcoe.ko 2023-11-13T11:14:08.009 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 158505 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/fcoe/libfcoe.ko 2023-11-13T11:14:08.010 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 18945 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/fdomain.ko 2023-11-13T11:14:08.010 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/fnic/ 2023-11-13T11:14:08.010 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 263489 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/fnic/fnic.ko 2023-11-13T11:14:08.010 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 201817 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/hpsa.ko 2023-11-13T11:14:08.011 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 51209 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/hptiop.ko 2023-11-13T11:14:08.011 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 49041 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/hv_storvsc.ko 2023-11-13T11:14:08.011 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 35337 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/imm.ko 2023-11-13T11:14:08.011 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 44057 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/initio.ko 2023-11-13T11:14:08.011 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 266537 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/ipr.ko 2023-11-13T11:14:08.012 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 101881 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/ips.ko 2023-11-13T11:14:08.012 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/isci/ 2023-11-13T11:14:08.012 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 317153 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/isci/isci.ko 2023-11-13T11:14:08.012 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 26385 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2023-11-13T11:14:08.013 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 52961 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/iscsi_tcp.ko 2023-11-13T11:14:08.013 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/libfc/ 2023-11-13T11:14:08.013 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 314865 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/libfc/libfc.ko 2023-11-13T11:14:08.013 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 145585 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/libiscsi.ko 2023-11-13T11:14:08.013 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 53521 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/libiscsi_tcp.ko 2023-11-13T11:14:08.014 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/libsas/ 2023-11-13T11:14:08.014 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 216665 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/libsas/libsas.ko 2023-11-13T11:14:08.014 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/lpfc/ 2023-11-13T11:14:08.014 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 2197249 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/lpfc/lpfc.ko 2023-11-13T11:14:08.015 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/megaraid/ 2023-11-13T11:14:08.015 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 73569 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2023-11-13T11:14:08.015 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 33529 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2023-11-13T11:14:08.015 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 310617 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2023-11-13T11:14:08.015 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 84721 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/megaraid.ko 2023-11-13T11:14:08.016 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/mpt3sas/ 2023-11-13T11:14:08.016 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 659777 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2023-11-13T11:14:08.016 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/mvsas/ 2023-11-13T11:14:08.016 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 119561 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/mvsas/mvsas.ko 2023-11-13T11:14:08.017 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 78129 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/mvumi.ko 2023-11-13T11:14:08.017 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/pcmcia/ 2023-11-13T11:14:08.017 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 81625 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/pcmcia/aha152x_cs.ko 2023-11-13T11:14:08.017 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 11713 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/pcmcia/fdomain_cs.ko 2023-11-13T11:14:08.017 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 20865 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/pcmcia/qlogic_cs.ko 2023-11-13T11:14:08.018 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 23857 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/pcmcia/sym53c500_cs.ko 2023-11-13T11:14:08.018 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/pm8001/ 2023-11-13T11:14:08.018 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 364105 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/pm8001/pm80xx.ko 2023-11-13T11:14:08.018 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 123617 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/pmcraid.ko 2023-11-13T11:14:08.019 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 34513 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/ppa.ko 2023-11-13T11:14:08.019 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 55361 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/qla1280.ko 2023-11-13T11:14:08.019 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/qla2xxx/ 2023-11-13T11:14:08.019 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 1876625 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2023-11-13T11:14:08.019 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 85289 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2023-11-13T11:14:08.020 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/qla4xxx/ 2023-11-13T11:14:08.020 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 559033 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2023-11-13T11:14:08.020 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 19025 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/qlogicfas408.ko 2023-11-13T11:14:08.020 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 15993 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/raid_class.ko 2023-11-13T11:14:08.021 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 238825 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/scsi_debug.ko 2023-11-13T11:14:08.021 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 173937 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/scsi_transport_fc.ko 2023-11-13T11:14:08.021 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 279313 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/scsi_transport_iscsi.ko 2023-11-13T11:14:08.021 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 97729 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/scsi_transport_sas.ko 2023-11-13T11:14:08.022 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 73881 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/scsi_transport_spi.ko 2023-11-13T11:14:08.022 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 44993 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/scsi_transport_srp.ko 2023-11-13T11:14:08.022 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 26249 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/ses.ko 2023-11-13T11:14:08.022 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 115889 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/st.ko 2023-11-13T11:14:08.022 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 46825 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/stex.ko 2023-11-13T11:14:08.023 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/sym53c8xx_2/ 2023-11-13T11:14:08.023 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 162121 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2023-11-13T11:14:08.023 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 42297 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/virtio_scsi.ko 2023-11-13T11:14:08.023 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 50321 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/vmw_pvscsi.ko 2023-11-13T11:14:08.023 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 40025 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/wd719x.ko 2023-11-13T11:14:08.024 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 50025 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/xen-scsifront.ko 2023-11-13T11:14:08.024 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/ssb/ 2023-11-13T11:14:08.024 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 129441 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/ssb/ssb.ko 2023-11-13T11:14:08.024 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/target/ 2023-11-13T11:14:08.024 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/target/iscsi/ 2023-11-13T11:14:08.025 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 736601 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2023-11-13T11:14:08.025 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/target/loopback/ 2023-11-13T11:14:08.025 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 49985 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/target/loopback/tcm_loop.ko 2023-11-13T11:14:08.025 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 39713 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/target/target_core_file.ko 2023-11-13T11:14:08.026 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 43025 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/target/target_core_iblock.ko 2023-11-13T11:14:08.026 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 930321 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/target/target_core_mod.ko 2023-11-13T11:14:08.026 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 44305 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/target/target_core_pscsi.ko 2023-11-13T11:14:08.026 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 122521 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/target/target_core_user.ko 2023-11-13T11:14:08.026 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/target/tcm_fc/ 2023-11-13T11:14:08.027 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 75593 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/target/tcm_fc/tcm_fc.ko 2023-11-13T11:14:08.027 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/thermal/ 2023-11-13T11:14:08.027 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/thermal/intel/ 2023-11-13T11:14:08.027 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/thermal/intel/int340x_thermal/ 2023-11-13T11:14:08.027 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 23481 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2023-11-13T11:14:08.028 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 29321 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2023-11-13T11:14:08.028 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 9953 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2023-11-13T11:14:08.029 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 10257 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2023-11-13T11:14:08.029 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 15081 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2023-11-13T11:14:08.030 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 16497 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2023-11-13T11:14:08.030 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 26809 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2023-11-13T11:14:08.030 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 20281 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2023-11-13T11:14:08.030 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 14865 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2023-11-13T11:14:08.030 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 14393 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2023-11-13T11:14:08.031 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 13001 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2023-11-13T11:14:08.031 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 37065 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2023-11-13T11:14:08.031 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 30729 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/thermal/intel/intel_powerclamp.ko 2023-11-13T11:14:08.031 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 18937 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2023-11-13T11:14:08.032 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 11521 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2023-11-13T11:14:08.032 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 26489 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2023-11-13T11:14:08.032 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/tty/ 2023-11-13T11:14:08.032 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/tty/ipwireless/ 2023-11-13T11:14:08.032 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 78425 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/tty/ipwireless/ipwireless.ko 2023-11-13T11:14:08.033 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 57865 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/tty/moxa.ko 2023-11-13T11:14:08.033 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 50953 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/tty/mxser.ko 2023-11-13T11:14:08.033 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 108601 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/tty/n_gsm.ko 2023-11-13T11:14:08.033 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 31961 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/tty/n_hdlc.ko 2023-11-13T11:14:08.033 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 67929 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/tty/nozomi.ko 2023-11-13T11:14:08.034 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/tty/serial/ 2023-11-13T11:14:08.034 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/tty/serial/8250/ 2023-11-13T11:14:08.034 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 35753 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/tty/serial/8250/8250_dw.ko 2023-11-13T11:14:08.034 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 59497 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/tty/serial/8250/serial_cs.ko 2023-11-13T11:14:08.034 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 18097 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/tty/serial/altera_jtaguart.ko 2023-11-13T11:14:08.035 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 22577 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/tty/serial/altera_uart.ko 2023-11-13T11:14:08.035 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 9489 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/tty/serial/arc_uart.ko 2023-11-13T11:14:08.035 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 72425 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/tty/serial/fsl_lpuart.ko 2023-11-13T11:14:08.035 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/tty/serial/jsm/ 2023-11-13T11:14:08.035 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 103073 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/tty/serial/jsm/jsm.ko 2023-11-13T11:14:08.036 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 28785 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/tty/serial/rp2.ko 2023-11-13T11:14:08.036 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 52817 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/tty/serial/sc16is7xx.ko 2023-11-13T11:14:08.036 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/ufs/ 2023-11-13T11:14:08.036 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/ufs/core/ 2023-11-13T11:14:08.036 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 531265 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/ufs/core/ufshcd-core.ko 2023-11-13T11:14:08.037 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/ufs/host/ 2023-11-13T11:14:08.037 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 28481 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/ufs/host/ufshcd-pci.ko 2023-11-13T11:14:08.037 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 14601 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/ufs/host/ufshcd-pltfrm.ko 2023-11-13T11:14:08.037 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/uio/ 2023-11-13T11:14:08.038 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 44513 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/uio/uio.ko 2023-11-13T11:14:08.038 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 12241 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/uio/uio_aec.ko 2023-11-13T11:14:08.038 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 11281 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/uio/uio_cif.ko 2023-11-13T11:14:08.038 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 18329 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/uio/uio_dmem_genirq.ko 2023-11-13T11:14:08.039 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 13001 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/uio/uio_mf624.ko 2023-11-13T11:14:08.039 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 12177 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/uio/uio_netx.ko 2023-11-13T11:14:08.039 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 10601 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/uio/uio_pci_generic.ko 2023-11-13T11:14:08.039 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 16057 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/uio/uio_pdrv_genirq.ko 2023-11-13T11:14:08.040 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 13633 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/uio/uio_sercos3.ko 2023-11-13T11:14:08.040 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/ 2023-11-13T11:14:08.040 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/c67x00/ 2023-11-13T11:14:08.040 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 73297 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/c67x00/c67x00.ko 2023-11-13T11:14:08.041 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/chipidea/ 2023-11-13T11:14:08.041 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 144377 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/chipidea/ci_hdrc.ko 2023-11-13T11:14:08.041 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 18505 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/chipidea/ci_hdrc_msm.ko 2023-11-13T11:14:08.041 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 12713 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/chipidea/ci_hdrc_pci.ko 2023-11-13T11:14:08.041 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 13057 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/chipidea/ci_hdrc_usb2.ko 2023-11-13T11:14:08.042 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/class/ 2023-11-13T11:14:08.042 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 87089 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/class/cdc-acm.ko 2023-11-13T11:14:08.042 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 51409 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/class/cdc-wdm.ko 2023-11-13T11:14:08.042 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 47369 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/class/usblp.ko 2023-11-13T11:14:08.043 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 89857 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/class/usbtmc.ko 2023-11-13T11:14:08.043 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/common/ 2023-11-13T11:14:08.043 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 22953 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/common/ulpi.ko 2023-11-13T11:14:08.043 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/dwc2/ 2023-11-13T11:14:08.043 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 11529 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/dwc2/dwc2_pci.ko 2023-11-13T11:14:08.044 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/dwc3/ 2023-11-13T11:14:08.044 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 12089 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/dwc3/dwc3-haps.ko 2023-11-13T11:14:08.044 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 30041 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/dwc3/dwc3-pci.ko 2023-11-13T11:14:08.044 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 444553 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/dwc3/dwc3.ko 2023-11-13T11:14:08.045 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/gadget/ 2023-11-13T11:14:08.045 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/gadget/function/ 2023-11-13T11:14:08.045 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 60177 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/gadget/function/u_ether.ko 2023-11-13T11:14:08.045 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 51881 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/gadget/function/u_serial.ko 2023-11-13T11:14:08.046 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 28841 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/gadget/function/usb_f_acm.ko 2023-11-13T11:14:08.046 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 42449 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/gadget/function/usb_f_ecm.ko 2023-11-13T11:14:08.046 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 27953 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/gadget/function/usb_f_ecm_subset.ko 2023-11-13T11:14:08.046 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 36513 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/gadget/function/usb_f_eem.ko 2023-11-13T11:14:08.047 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 92489 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/gadget/function/usb_f_fs.ko 2023-11-13T11:14:08.047 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 51049 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/gadget/function/usb_f_hid.ko 2023-11-13T11:14:08.047 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 122081 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/gadget/function/usb_f_mass_storage.ko 2023-11-13T11:14:08.047 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 57617 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/gadget/function/usb_f_ncm.ko 2023-11-13T11:14:08.047 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 22185 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/gadget/function/usb_f_obex.ko 2023-11-13T11:14:08.048 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 31265 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/gadget/function/usb_f_phonet.ko 2023-11-13T11:14:08.048 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 57729 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/gadget/function/usb_f_printer.ko 2023-11-13T11:14:08.048 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 85609 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/gadget/function/usb_f_rndis.ko 2023-11-13T11:14:08.048 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 19273 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/gadget/function/usb_f_serial.ko 2023-11-13T11:14:08.049 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 58113 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/gadget/function/usb_f_ss_lb.ko 2023-11-13T11:14:08.049 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 67337 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/gadget/function/usb_f_tcm.ko 2023-11-13T11:14:08.049 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/gadget/legacy/ 2023-11-13T11:14:08.049 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 21265 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/gadget/legacy/g_acm_ms.ko 2023-11-13T11:14:08.049 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 18057 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/gadget/legacy/g_cdc.ko 2023-11-13T11:14:08.050 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 18465 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/gadget/legacy/g_dbgp.ko 2023-11-13T11:14:08.050 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 21657 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/gadget/legacy/g_ether.ko 2023-11-13T11:14:08.050 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 28401 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/gadget/legacy/g_ffs.ko 2023-11-13T11:14:08.050 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 19009 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/gadget/legacy/g_hid.ko 2023-11-13T11:14:08.051 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 20409 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/gadget/legacy/g_mass_storage.ko 2023-11-13T11:14:08.051 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 16977 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/gadget/legacy/g_ncm.ko 2023-11-13T11:14:08.051 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 32073 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/gadget/legacy/g_nokia.ko 2023-11-13T11:14:08.051 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 16793 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/gadget/legacy/g_printer.ko 2023-11-13T11:14:08.052 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 19393 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/gadget/legacy/g_serial.ko 2023-11-13T11:14:08.052 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 27201 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/gadget/legacy/g_zero.ko 2023-11-13T11:14:08.052 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 62185 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/gadget/legacy/gadgetfs.ko 2023-11-13T11:14:08.052 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 15201 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/gadget/legacy/tcm_usb_gadget.ko 2023-11-13T11:14:08.053 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 161225 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/gadget/libcomposite.ko 2023-11-13T11:14:08.053 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/gadget/udc/ 2023-11-13T11:14:08.053 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 17705 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/gadget/udc/amd5536udc_pci.ko 2023-11-13T11:14:08.053 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/gadget/udc/bdc/ 2023-11-13T11:14:08.054 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 157681 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/gadget/udc/bdc/bdc.ko 2023-11-13T11:14:08.054 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 36089 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/gadget/udc/goku_udc.ko 2023-11-13T11:14:08.054 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 52721 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/gadget/udc/gr_udc.ko 2023-11-13T11:14:08.054 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 69705 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/gadget/udc/mv_u3d_core.ko 2023-11-13T11:14:08.055 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 56033 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/gadget/udc/mv_udc.ko 2023-11-13T11:14:08.055 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 76057 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/gadget/udc/net2272.ko 2023-11-13T11:14:08.055 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 75073 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/gadget/udc/net2280.ko 2023-11-13T11:14:08.055 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 73169 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/gadget/udc/pch_udc.ko 2023-11-13T11:14:08.056 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 65809 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/gadget/udc/pxa27x_udc.ko 2023-11-13T11:14:08.056 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 66097 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/gadget/udc/r8a66597-udc.ko 2023-11-13T11:14:08.056 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 81505 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/gadget/udc/snps_udc_core.ko 2023-11-13T11:14:08.056 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 156073 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/gadget/udc/udc-core.ko 2023-11-13T11:14:08.056 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/host/ 2023-11-13T11:14:08.057 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 11585 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/host/bcma-hcd.ko 2023-11-13T11:14:08.057 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 80113 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/host/isp116x-hcd.ko 2023-11-13T11:14:08.057 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 87353 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/host/oxu210hp-hcd.ko 2023-11-13T11:14:08.057 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 78873 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/host/r8a66597-hcd.ko 2023-11-13T11:14:08.058 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 51329 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/host/sl811-hcd.ko 2023-11-13T11:14:08.058 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 15593 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/host/sl811_cs.ko 2023-11-13T11:14:08.058 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 13305 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/host/ssb-hcd.ko 2023-11-13T11:14:08.058 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 25945 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/host/xhci-plat-hcd.ko 2023-11-13T11:14:08.058 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/image/ 2023-11-13T11:14:08.059 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 34585 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/image/mdc800.ko 2023-11-13T11:14:08.059 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 21081 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/image/microtek.ko 2023-11-13T11:14:08.059 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/misc/ 2023-11-13T11:14:08.059 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 41721 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/misc/adutux.ko 2023-11-13T11:14:08.060 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 20713 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/misc/appledisplay.ko 2023-11-13T11:14:08.060 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 17721 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/misc/cypress_cy7c63.ko 2023-11-13T11:14:08.060 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 23049 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/misc/cytherm.ko 2023-11-13T11:14:08.060 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 13729 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/misc/ehset.ko 2023-11-13T11:14:08.060 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 15057 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/misc/emi26.ko 2023-11-13T11:14:08.061 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 15985 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/misc/emi62.ko 2023-11-13T11:14:08.061 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 11433 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/misc/ezusb.ko 2023-11-13T11:14:08.061 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 19297 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/misc/idmouse.ko 2023-11-13T11:14:08.061 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 36617 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/misc/iowarrior.ko 2023-11-13T11:14:08.062 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 11593 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/misc/isight_firmware.ko 2023-11-13T11:14:08.062 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 36529 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/misc/ldusb.ko 2023-11-13T11:14:08.062 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 36265 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/misc/legousbtower.ko 2023-11-13T11:14:08.062 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 27793 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/misc/lvstest.ko 2023-11-13T11:14:08.062 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/misc/sisusbvga/ 2023-11-13T11:14:08.063 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 64841 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2023-11-13T11:14:08.063 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 13001 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/misc/trancevibrator.ko 2023-11-13T11:14:08.063 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 20473 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/misc/usb3503.ko 2023-11-13T11:14:08.063 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 25145 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/misc/usblcd.ko 2023-11-13T11:14:08.064 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 22753 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/misc/usbsevseg.ko 2023-11-13T11:14:08.064 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 70873 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/misc/usbtest.ko 2023-11-13T11:14:08.064 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 41969 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/misc/uss720.ko 2023-11-13T11:14:08.064 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 27617 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/misc/yurex.ko 2023-11-13T11:14:08.064 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/mon/ 2023-11-13T11:14:08.065 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 72953 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/mon/usbmon.ko 2023-11-13T11:14:08.065 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/musb/ 2023-11-13T11:14:08.065 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 301545 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/musb/musb_hdrc.ko 2023-11-13T11:14:08.065 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/phy/ 2023-11-13T11:14:08.066 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 21105 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/phy/phy-generic.ko 2023-11-13T11:14:08.066 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 20177 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/phy/phy-gpio-vbus-usb.ko 2023-11-13T11:14:08.066 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 12257 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/phy/phy-isp1301.ko 2023-11-13T11:14:08.066 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 21745 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/phy/phy-tahvo.ko 2023-11-13T11:14:08.066 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/serial/ 2023-11-13T11:14:08.067 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 13209 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/serial/aircable.ko 2023-11-13T11:14:08.067 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 33329 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/serial/ark3116.ko 2023-11-13T11:14:08.067 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 26633 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/serial/belkin_sa.ko 2023-11-13T11:14:08.067 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 38105 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/serial/ch341.ko 2023-11-13T11:14:08.068 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 70257 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/serial/cp210x.ko 2023-11-13T11:14:08.068 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 31057 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/serial/cyberjack.ko 2023-11-13T11:14:08.068 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 58217 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/serial/cypress_m8.ko 2023-11-13T11:14:08.068 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 49817 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/serial/digi_acceleport.ko 2023-11-13T11:14:08.068 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 9617 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/serial/empeg.ko 2023-11-13T11:14:08.069 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 44337 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/serial/f81232.ko 2023-11-13T11:14:08.069 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 175137 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/serial/ftdi_sio.ko 2023-11-13T11:14:08.069 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 53113 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/serial/garmin_gps.ko 2023-11-13T11:14:08.069 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 137081 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/serial/io_edgeport.ko 2023-11-13T11:14:08.070 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 124833 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/serial/io_ti.ko 2023-11-13T11:14:08.070 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 67769 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/serial/ipaq.ko 2023-11-13T11:14:08.070 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 19161 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/serial/ipw.ko 2023-11-13T11:14:08.070 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 26897 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/serial/ir-usb.ko 2023-11-13T11:14:08.070 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 58233 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/serial/iuu_phoenix.ko 2023-11-13T11:14:08.071 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 107521 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/serial/keyspan.ko 2023-11-13T11:14:08.071 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 35617 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/serial/keyspan_pda.ko 2023-11-13T11:14:08.071 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 25665 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/serial/kl5kusb105.ko 2023-11-13T11:14:08.071 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 33689 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/serial/kobil_sct.ko 2023-11-13T11:14:08.072 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 32953 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/serial/mct_u232.ko 2023-11-13T11:14:08.072 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 22033 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/serial/metro-usb.ko 2023-11-13T11:14:08.072 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 66449 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/serial/mos7720.ko 2023-11-13T11:14:08.072 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 78217 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/serial/mos7840.ko 2023-11-13T11:14:08.072 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 56337 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/serial/mxuport.ko 2023-11-13T11:14:08.073 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 14089 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/serial/navman.ko 2023-11-13T11:14:08.073 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 12009 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/serial/omninet.ko 2023-11-13T11:14:08.073 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 24633 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/serial/opticon.ko 2023-11-13T11:14:08.073 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 190633 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/serial/option.ko 2023-11-13T11:14:08.073 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 39073 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/serial/oti6858.ko 2023-11-13T11:14:08.074 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 54353 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/serial/pl2303.ko 2023-11-13T11:14:08.074 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 9801 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/serial/qcaux.ko 2023-11-13T11:14:08.074 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 37825 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/serial/qcserial.ko 2023-11-13T11:14:08.074 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 34321 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/serial/quatech2.ko 2023-11-13T11:14:08.075 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 15393 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/serial/safe_serial.ko 2023-11-13T11:14:08.075 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 51625 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/serial/sierra.ko 2023-11-13T11:14:08.075 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 21673 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/serial/spcp8x5.ko 2023-11-13T11:14:08.075 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 29993 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/serial/ssu100.ko 2023-11-13T11:14:08.075 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 17265 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/serial/symbolserial.ko 2023-11-13T11:14:08.076 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 61489 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2023-11-13T11:14:08.076 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 23729 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/serial/usb-serial-simple.ko 2023-11-13T11:14:08.076 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 10241 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/serial/usb_debug.ko 2023-11-13T11:14:08.076 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 33201 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/serial/usb_wwan.ko 2023-11-13T11:14:08.077 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 125609 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/serial/usbserial.ko 2023-11-13T11:14:08.077 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 28753 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/serial/visor.ko 2023-11-13T11:14:08.077 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 37409 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/serial/whiteheat.ko 2023-11-13T11:14:08.077 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 10537 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/serial/wishbone-serial.ko 2023-11-13T11:14:08.078 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 9289 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/serial/xsens_mt.ko 2023-11-13T11:14:08.078 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/storage/ 2023-11-13T11:14:08.078 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 52913 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/storage/uas.ko 2023-11-13T11:14:08.078 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 26017 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/storage/ums-alauda.ko 2023-11-13T11:14:08.078 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 13049 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/storage/ums-cypress.ko 2023-11-13T11:14:08.079 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 22049 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/storage/ums-datafab.ko 2023-11-13T11:14:08.079 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 33497 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/storage/ums-eneub6250.ko 2023-11-13T11:14:08.079 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 13745 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/storage/ums-freecom.ko 2023-11-13T11:14:08.079 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 19769 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/storage/ums-isd200.ko 2023-11-13T11:14:08.080 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 19361 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/storage/ums-jumpshot.ko 2023-11-13T11:14:08.080 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 13713 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/storage/ums-karma.ko 2023-11-13T11:14:08.080 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 17841 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/storage/ums-onetouch.ko 2023-11-13T11:14:08.080 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 28441 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/storage/ums-realtek.ko 2023-11-13T11:14:08.080 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 28905 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/storage/ums-sddr09.ko 2023-11-13T11:14:08.081 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 19521 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/storage/ums-sddr55.ko 2023-11-13T11:14:08.081 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 35337 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/storage/ums-usbat.ko 2023-11-13T11:14:08.081 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 179969 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/storage/usb-storage.ko 2023-11-13T11:14:08.081 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/usbip/ 2023-11-13T11:14:08.081 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 67481 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/usbip/usbip-core.ko 2023-11-13T11:14:08.082 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 72177 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/usbip/usbip-host.ko 2023-11-13T11:14:08.082 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 107001 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/usbip/vhci-hcd.ko 2023-11-13T11:14:08.082 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/vfio/ 2023-11-13T11:14:08.082 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/vfio/pci/ 2023-11-13T11:14:08.083 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 154297 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/vfio/pci/vfio-pci-core.ko 2023-11-13T11:14:08.083 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 29537 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/vfio/pci/vfio-pci.ko 2023-11-13T11:14:08.083 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 108737 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/vfio/vfio.ko 2023-11-13T11:14:08.083 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 77609 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/vfio/vfio_iommu_type1.ko 2023-11-13T11:14:08.084 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/vhost/ 2023-11-13T11:14:08.084 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 113873 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/vhost/vhost.ko 2023-11-13T11:14:08.084 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 17009 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/vhost/vhost_iotlb.ko 2023-11-13T11:14:08.084 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 58089 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/vhost/vhost_net.ko 2023-11-13T11:14:08.084 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 89249 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/vhost/vhost_scsi.ko 2023-11-13T11:14:08.085 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/video/ 2023-11-13T11:14:08.085 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/video/backlight/ 2023-11-13T11:14:08.085 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 15417 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/video/backlight/88pm860x_bl.ko 2023-11-13T11:14:08.085 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 12393 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/video/backlight/aat2870_bl.ko 2023-11-13T11:14:08.086 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 23305 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/video/backlight/adp5520_bl.ko 2023-11-13T11:14:08.086 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 32609 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/video/backlight/adp8860_bl.ko 2023-11-13T11:14:08.086 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 39993 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/video/backlight/adp8870_bl.ko 2023-11-13T11:14:08.086 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 16921 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/video/backlight/apple_bl.ko 2023-11-13T11:14:08.086 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 16777 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/video/backlight/as3711_bl.ko 2023-11-13T11:14:08.087 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 12097 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/video/backlight/bd6107.ko 2023-11-13T11:14:08.087 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 11409 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/video/backlight/da903x_bl.ko 2023-11-13T11:14:08.087 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 11273 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/video/backlight/da9052_bl.ko 2023-11-13T11:14:08.087 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 11753 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/video/backlight/gpio_backlight.ko 2023-11-13T11:14:08.088 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 14769 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/video/backlight/kb3886_bl.ko 2023-11-13T11:14:08.088 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 22017 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/video/backlight/lcd.ko 2023-11-13T11:14:08.088 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 23657 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/video/backlight/lm3533_bl.ko 2023-11-13T11:14:08.088 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 19337 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/video/backlight/lm3639_bl.ko 2023-11-13T11:14:08.088 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 11425 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/video/backlight/lv5207lp.ko 2023-11-13T11:14:08.089 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 14345 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/video/backlight/max8925_bl.ko 2023-11-13T11:14:08.089 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 11313 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/video/backlight/pandora_bl.ko 2023-11-13T11:14:08.089 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 10865 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/video/backlight/pcf50633-backlight.ko 2023-11-13T11:14:08.089 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 10897 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/video/backlight/platform_lcd.ko 2023-11-13T11:14:08.089 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 12721 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/video/backlight/wm831x_bl.ko 2023-11-13T11:14:08.090 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/w1/ 2023-11-13T11:14:08.090 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/w1/masters/ 2023-11-13T11:14:08.090 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 18785 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/w1/masters/ds2482.ko 2023-11-13T11:14:08.090 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 38985 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/w1/masters/ds2490.ko 2023-11-13T11:14:08.091 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 11265 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/w1/masters/matrox_w1.ko 2023-11-13T11:14:08.091 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 12417 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/w1/masters/w1-gpio.ko 2023-11-13T11:14:08.091 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/w1/slaves/ 2023-11-13T11:14:08.091 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 12041 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/w1/slaves/w1_ds2406.ko 2023-11-13T11:14:08.092 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 22809 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/w1/slaves/w1_ds2408.ko 2023-11-13T11:14:08.092 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 15113 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/w1/slaves/w1_ds2413.ko 2023-11-13T11:14:08.092 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 10825 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/w1/slaves/w1_ds2423.ko 2023-11-13T11:14:08.092 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 14153 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/w1/slaves/w1_ds2431.ko 2023-11-13T11:14:08.092 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 11929 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/w1/slaves/w1_ds2433.ko 2023-11-13T11:14:08.093 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 14113 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/w1/slaves/w1_ds2780.ko 2023-11-13T11:14:08.093 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 14049 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/w1/slaves/w1_ds2781.ko 2023-11-13T11:14:08.093 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 17921 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/w1/slaves/w1_ds28e04.ko 2023-11-13T11:14:08.093 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 7385 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/w1/slaves/w1_smem.ko 2023-11-13T11:14:08.094 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 56425 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/w1/slaves/w1_therm.ko 2023-11-13T11:14:08.094 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 102673 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/w1/wire.ko 2023-11-13T11:14:08.094 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/watchdog/ 2023-11-13T11:14:08.094 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 18793 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/watchdog/acquirewdt.ko 2023-11-13T11:14:08.095 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 19977 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/watchdog/advantechwdt.ko 2023-11-13T11:14:08.095 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 18561 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/watchdog/alim1535_wdt.ko 2023-11-13T11:14:08.095 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 22969 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/watchdog/alim7101_wdt.ko 2023-11-13T11:14:08.095 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 19113 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/watchdog/cpu5wdt.ko 2023-11-13T11:14:08.095 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 13617 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/watchdog/da9052_wdt.ko 2023-11-13T11:14:08.096 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 12777 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/watchdog/da9055_wdt.ko 2023-11-13T11:14:08.096 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 17409 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/watchdog/da9063_wdt.ko 2023-11-13T11:14:08.096 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 20169 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/watchdog/dw_wdt.ko 2023-11-13T11:14:08.096 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 20265 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/watchdog/eurotechwdt.ko 2023-11-13T11:14:08.097 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 23865 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/watchdog/f71808e_wdt.ko 2023-11-13T11:14:08.097 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 27401 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/watchdog/hpwdt.ko 2023-11-13T11:14:08.097 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 15577 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/watchdog/i6300esb.ko 2023-11-13T11:14:08.097 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 10833 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/watchdog/iTCO_vendor_support.ko 2023-11-13T11:14:08.097 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 21913 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/watchdog/iTCO_wdt.ko 2023-11-13T11:14:08.098 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 19241 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/watchdog/ib700wdt.ko 2023-11-13T11:14:08.098 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 18689 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/watchdog/ibmasr.ko 2023-11-13T11:14:08.098 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 19713 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/watchdog/ie6xx_wdt.ko 2023-11-13T11:14:08.098 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 21225 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/watchdog/it8712f_wdt.ko 2023-11-13T11:14:08.099 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 13841 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/watchdog/it87_wdt.ko 2023-11-13T11:14:08.099 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 21489 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/watchdog/kempld_wdt.ko 2023-11-13T11:14:08.099 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 18617 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/watchdog/machzwd.ko 2023-11-13T11:14:08.099 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 14721 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/watchdog/mena21_wdt.ko 2023-11-13T11:14:08.099 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 13217 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/watchdog/menf21bmc_wdt.ko 2023-11-13T11:14:08.100 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 24673 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/watchdog/nv_tco.ko 2023-11-13T11:14:08.100 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 17737 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/watchdog/of_xilinx_wdt.ko 2023-11-13T11:14:08.100 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 22265 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/watchdog/pc87413_wdt.ko 2023-11-13T11:14:08.100 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 38657 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/watchdog/pcwd_pci.ko 2023-11-13T11:14:08.100 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 31825 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/watchdog/pcwd_usb.ko 2023-11-13T11:14:08.101 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 13129 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/watchdog/retu_wdt.ko 2023-11-13T11:14:08.101 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 20449 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/watchdog/sbc60xxwdt.ko 2023-11-13T11:14:08.101 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 14129 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/watchdog/sbc_epx_c3.ko 2023-11-13T11:14:08.101 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 17321 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2023-11-13T11:14:08.102 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 23809 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/watchdog/sc1200wdt.ko 2023-11-13T11:14:08.102 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 23321 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/watchdog/sch311x_wdt.ko 2023-11-13T11:14:08.102 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 21577 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/watchdog/smsc37b787_wdt.ko 2023-11-13T11:14:08.102 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 17273 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/watchdog/softdog.ko 2023-11-13T11:14:08.103 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 22273 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/watchdog/sp5100_tco.ko 2023-11-13T11:14:08.103 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 12817 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/watchdog/twl4030_wdt.ko 2023-11-13T11:14:08.103 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 17649 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/watchdog/via_wdt.ko 2023-11-13T11:14:08.103 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 19161 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/watchdog/w83627hf_wdt.ko 2023-11-13T11:14:08.103 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 20681 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/watchdog/w83877f_wdt.ko 2023-11-13T11:14:08.104 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 25409 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/watchdog/w83977f_wdt.ko 2023-11-13T11:14:08.104 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 18497 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/watchdog/wafer5823wdt.ko 2023-11-13T11:14:08.104 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 28089 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/watchdog/wdt_pci.ko 2023-11-13T11:14:08.104 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 16257 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/watchdog/wm831x_wdt.ko 2023-11-13T11:14:08.105 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 13785 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/watchdog/wm8350_wdt.ko 2023-11-13T11:14:08.105 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 15697 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/watchdog/xen_wdt.ko 2023-11-13T11:14:08.105 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/xen/ 2023-11-13T11:14:08.105 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 24729 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/xen/xen-evtchn.ko 2023-11-13T11:14:08.105 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 26769 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/xen/xen-gntalloc.ko 2023-11-13T11:14:08.106 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 47865 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/xen/xen-gntdev.ko 2023-11-13T11:14:08.106 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/xen/xen-pciback/ 2023-11-13T11:14:08.106 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 176441 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2023-11-13T11:14:08.106 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 40121 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/xen/xen-privcmd.ko 2023-11-13T11:14:08.107 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 71249 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/xen/xen-scsiback.ko 2023-11-13T11:14:08.107 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/xen/xenfs/ 2023-11-13T11:14:08.107 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 19425 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/xen/xenfs/xenfs.ko 2023-11-13T11:14:08.107 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/ 2023-11-13T11:14:08.107 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/9p/ 2023-11-13T11:14:08.108 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 166425 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/9p/9p.ko 2023-11-13T11:14:08.108 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/adfs/ 2023-11-13T11:14:08.108 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 61073 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/adfs/adfs.ko 2023-11-13T11:14:08.108 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/affs/ 2023-11-13T11:14:08.108 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 163593 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/affs/affs.ko 2023-11-13T11:14:08.109 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/afs/ 2023-11-13T11:14:08.109 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 932817 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/afs/kafs.ko 2023-11-13T11:14:08.109 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/autofs/ 2023-11-13T11:14:08.109 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 101057 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/autofs/autofs4.ko 2023-11-13T11:14:08.109 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/befs/ 2023-11-13T11:14:08.110 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 64545 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/befs/befs.ko 2023-11-13T11:14:08.110 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/bfs/ 2023-11-13T11:14:08.110 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 41257 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/bfs/bfs.ko 2023-11-13T11:14:08.110 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 34585 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/binfmt_misc.ko 2023-11-13T11:14:08.111 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/btrfs/ 2023-11-13T11:14:08.111 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 3402585 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/btrfs/btrfs.ko 2023-11-13T11:14:08.111 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/cachefiles/ 2023-11-13T11:14:08.111 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 306073 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/cachefiles/cachefiles.ko 2023-11-13T11:14:08.111 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/ceph/ 2023-11-13T11:14:08.112 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 1323873 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/ceph/ceph.ko 2023-11-13T11:14:08.112 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/coda/ 2023-11-13T11:14:08.112 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 100801 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/coda/coda.ko 2023-11-13T11:14:08.112 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/configfs/ 2023-11-13T11:14:08.112 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 108393 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/configfs/configfs.ko 2023-11-13T11:14:08.113 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/cramfs/ 2023-11-13T11:14:08.113 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 29625 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/cramfs/cramfs.ko 2023-11-13T11:14:08.113 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/dlm/ 2023-11-13T11:14:08.113 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 642577 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/dlm/dlm.ko 2023-11-13T11:14:08.114 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/efs/ 2023-11-13T11:14:08.114 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 36649 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/efs/efs.ko 2023-11-13T11:14:08.114 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/f2fs/ 2023-11-13T11:14:08.114 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 1505025 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/f2fs/f2fs.ko 2023-11-13T11:14:08.114 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/fat/ 2023-11-13T11:14:08.115 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 27929 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/fat/msdos.ko 2023-11-13T11:14:08.115 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/freevxfs/ 2023-11-13T11:14:08.115 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 42545 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/freevxfs/freevxfs.ko 2023-11-13T11:14:08.115 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/fscache/ 2023-11-13T11:14:08.115 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 226481 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/fscache/fscache.ko 2023-11-13T11:14:08.116 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/fuse/ 2023-11-13T11:14:08.116 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 24489 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/fuse/cuse.ko 2023-11-13T11:14:08.116 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/gfs2/ 2023-11-13T11:14:08.116 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 1231529 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/gfs2/gfs2.ko 2023-11-13T11:14:08.116 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/hfs/ 2023-11-13T11:14:08.117 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 141209 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/hfs/hfs.ko 2023-11-13T11:14:08.117 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/hfsplus/ 2023-11-13T11:14:08.117 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 222817 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/hfsplus/hfsplus.ko 2023-11-13T11:14:08.117 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/hpfs/ 2023-11-13T11:14:08.117 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 192329 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/hpfs/hpfs.ko 2023-11-13T11:14:08.118 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/isofs/ 2023-11-13T11:14:08.118 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 74065 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/isofs/isofs.ko 2023-11-13T11:14:08.118 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/jfs/ 2023-11-13T11:14:08.118 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 419497 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/jfs/jfs.ko 2023-11-13T11:14:08.118 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/lockd/ 2023-11-13T11:14:08.119 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 280313 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/lockd/lockd.ko 2023-11-13T11:14:08.119 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/minix/ 2023-11-13T11:14:08.119 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 89193 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/minix/minix.ko 2023-11-13T11:14:08.119 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/netfs/ 2023-11-13T11:14:08.120 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 124649 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/netfs/netfs.ko 2023-11-13T11:14:08.120 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/nfs/ 2023-11-13T11:14:08.120 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/nfs/blocklayout/ 2023-11-13T11:14:08.120 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 81449 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2023-11-13T11:14:08.120 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/nfs/filelayout/ 2023-11-13T11:14:08.121 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 59449 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2023-11-13T11:14:08.121 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/nfs/flexfilelayout/ 2023-11-13T11:14:08.121 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 117513 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2023-11-13T11:14:08.122 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 1055649 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/nfs/nfs.ko 2023-11-13T11:14:08.122 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 66441 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/nfs/nfsv2.ko 2023-11-13T11:14:08.122 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 120177 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/nfs/nfsv3.ko 2023-11-13T11:14:08.122 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 2041689 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/nfs/nfsv4.ko 2023-11-13T11:14:08.122 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/nfs_common/ 2023-11-13T11:14:08.123 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 16929 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/nfs_common/grace.ko 2023-11-13T11:14:08.123 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 16145 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/nfs_common/nfs_acl.ko 2023-11-13T11:14:08.123 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/nfsd/ 2023-11-13T11:14:08.123 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 1516809 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/nfsd/nfsd.ko 2023-11-13T11:14:08.124 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/nilfs2/ 2023-11-13T11:14:08.124 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 592833 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/nilfs2/nilfs2.ko 2023-11-13T11:14:08.124 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/nls/ 2023-11-13T11:14:08.124 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 13793 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/nls/mac-celtic.ko 2023-11-13T11:14:08.124 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 13169 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/nls/mac-centeuro.ko 2023-11-13T11:14:08.125 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 13793 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/nls/mac-croatian.ko 2023-11-13T11:14:08.125 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 12865 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/nls/mac-cyrillic.ko 2023-11-13T11:14:08.125 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 13481 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/nls/mac-gaelic.ko 2023-11-13T11:14:08.125 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 12857 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/nls/mac-greek.ko 2023-11-13T11:14:08.125 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 13793 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/nls/mac-iceland.ko 2023-11-13T11:14:08.126 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 13169 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/nls/mac-inuit.ko 2023-11-13T11:14:08.126 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 14097 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/nls/mac-roman.ko 2023-11-13T11:14:08.126 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 13793 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/nls/mac-romanian.ko 2023-11-13T11:14:08.126 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 13793 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/nls/mac-turkish.ko 2023-11-13T11:14:08.126 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 11297 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/nls/nls_ascii.ko 2023-11-13T11:14:08.127 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 12537 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/nls/nls_cp1250.ko 2023-11-13T11:14:08.127 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 12233 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/nls/nls_cp1251.ko 2023-11-13T11:14:08.127 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 12921 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/nls/nls_cp1255.ko 2023-11-13T11:14:08.127 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 12537 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/nls/nls_cp737.ko 2023-11-13T11:14:08.127 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 12537 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/nls/nls_cp775.ko 2023-11-13T11:14:08.128 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 12225 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/nls/nls_cp850.ko 2023-11-13T11:14:08.128 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 12225 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/nls/nls_cp852.ko 2023-11-13T11:14:08.128 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 12225 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/nls/nls_cp855.ko 2023-11-13T11:14:08.128 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 11913 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/nls/nls_cp857.ko 2023-11-13T11:14:08.128 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 12849 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/nls/nls_cp860.ko 2023-11-13T11:14:08.129 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 13161 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/nls/nls_cp861.ko 2023-11-13T11:14:08.129 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 13473 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/nls/nls_cp862.ko 2023-11-13T11:14:08.129 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 13161 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/nls/nls_cp863.ko 2023-11-13T11:14:08.129 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 12849 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/nls/nls_cp864.ko 2023-11-13T11:14:08.130 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 13161 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/nls/nls_cp865.ko 2023-11-13T11:14:08.130 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 12537 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/nls/nls_cp866.ko 2023-11-13T11:14:08.130 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 12225 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/nls/nls_cp869.ko 2023-11-13T11:14:08.130 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 11985 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/nls/nls_cp874.ko 2023-11-13T11:14:08.130 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 94137 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/nls/nls_cp932.ko 2023-11-13T11:14:08.131 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 142673 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/nls/nls_cp936.ko 2023-11-13T11:14:08.131 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 165745 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/nls/nls_cp949.ko 2023-11-13T11:14:08.131 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 118121 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/nls/nls_cp950.ko 2023-11-13T11:14:08.131 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 12457 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/nls/nls_euc-jp.ko 2023-11-13T11:14:08.131 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 11305 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/nls/nls_iso8859-1.ko 2023-11-13T11:14:08.132 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 11929 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/nls/nls_iso8859-13.ko 2023-11-13T11:14:08.132 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 11929 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/nls/nls_iso8859-14.ko 2023-11-13T11:14:08.132 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 11929 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/nls/nls_iso8859-15.ko 2023-11-13T11:14:08.132 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 11921 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/nls/nls_iso8859-2.ko 2023-11-13T11:14:08.133 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 11921 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/nls/nls_iso8859-3.ko 2023-11-13T11:14:08.133 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 11921 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/nls/nls_iso8859-4.ko 2023-11-13T11:14:08.133 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 11921 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/nls/nls_iso8859-5.ko 2023-11-13T11:14:08.133 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 11617 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/nls/nls_iso8859-6.ko 2023-11-13T11:14:08.133 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 12233 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/nls/nls_iso8859-7.ko 2023-11-13T11:14:08.134 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 11617 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/nls/nls_iso8859-9.ko 2023-11-13T11:14:08.134 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 12537 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/nls/nls_koi8-r.ko 2023-11-13T11:14:08.134 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 8017 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/nls/nls_koi8-ru.ko 2023-11-13T11:14:08.134 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 12537 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/nls/nls_koi8-u.ko 2023-11-13T11:14:08.135 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 7569 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/nls/nls_ucs2_utils.ko 2023-11-13T11:14:08.135 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 8337 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/nls/nls_utf8.ko 2023-11-13T11:14:08.135 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/ntfs/ 2023-11-13T11:14:08.135 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 219417 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/ntfs/ntfs.ko 2023-11-13T11:14:08.136 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/ocfs2/ 2023-11-13T11:14:08.136 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/ocfs2/cluster/ 2023-11-13T11:14:08.136 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 244409 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2023-11-13T11:14:08.136 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/ocfs2/dlm/ 2023-11-13T11:14:08.136 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 440737 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2023-11-13T11:14:08.137 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/ocfs2/dlmfs/ 2023-11-13T11:14:08.137 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 54049 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2023-11-13T11:14:08.137 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 2592433 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/ocfs2/ocfs2.ko 2023-11-13T11:14:08.137 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 17905 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2023-11-13T11:14:08.138 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 31729 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/ocfs2/ocfs2_stack_user.ko 2023-11-13T11:14:08.138 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 35897 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/ocfs2/ocfs2_stackglue.ko 2023-11-13T11:14:08.138 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/omfs/ 2023-11-13T11:14:08.138 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 53433 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/omfs/omfs.ko 2023-11-13T11:14:08.138 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/overlayfs/ 2023-11-13T11:14:08.139 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 352153 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/overlayfs/overlay.ko 2023-11-13T11:14:08.139 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/pstore/ 2023-11-13T11:14:08.139 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 54809 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/pstore/ramoops.ko 2023-11-13T11:14:08.139 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/qnx4/ 2023-11-13T11:14:08.140 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 26865 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/qnx4/qnx4.ko 2023-11-13T11:14:08.140 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/qnx6/ 2023-11-13T11:14:08.140 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 46689 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/qnx6/qnx6.ko 2023-11-13T11:14:08.140 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/quota/ 2023-11-13T11:14:08.140 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 30881 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/quota/quota_tree.ko 2023-11-13T11:14:08.141 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 14361 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/quota/quota_v1.ko 2023-11-13T11:14:08.141 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 22017 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/quota/quota_v2.ko 2023-11-13T11:14:08.141 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/reiserfs/ 2023-11-13T11:14:08.141 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 532673 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/reiserfs/reiserfs.ko 2023-11-13T11:14:08.142 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/romfs/ 2023-11-13T11:14:08.142 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 28641 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/romfs/romfs.ko 2023-11-13T11:14:08.142 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/smb/ 2023-11-13T11:14:08.142 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/smb/client/ 2023-11-13T11:14:08.143 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 2668121 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/smb/client/cifs.ko 2023-11-13T11:14:08.143 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/smb/common/ 2023-11-13T11:14:08.143 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 7161 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/smb/common/cifs_arc4.ko 2023-11-13T11:14:08.143 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 11257 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/smb/common/cifs_md4.ko 2023-11-13T11:14:08.143 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/squashfs/ 2023-11-13T11:14:08.144 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 134641 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/squashfs/squashfs.ko 2023-11-13T11:14:08.144 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/sysv/ 2023-11-13T11:14:08.144 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 90721 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/sysv/sysv.ko 2023-11-13T11:14:08.144 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/udf/ 2023-11-13T11:14:08.145 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 247737 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/udf/udf.ko 2023-11-13T11:14:08.145 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/ufs/ 2023-11-13T11:14:08.145 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 162497 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/ufs/ufs.ko 2023-11-13T11:14:08.145 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/xfs/ 2023-11-13T11:14:08.145 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 4010729 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/xfs/xfs.ko 2023-11-13T11:14:08.146 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/kernel/ 2023-11-13T11:14:08.146 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/kernel/locking/ 2023-11-13T11:14:08.146 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 75489 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/kernel/locking/locktorture.ko 2023-11-13T11:14:08.146 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/kernel/time/ 2023-11-13T11:14:08.146 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 13737 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/kernel/time/test_udelay.ko 2023-11-13T11:14:08.147 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 60553 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/kernel/torture.ko 2023-11-13T11:14:08.147 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/lib/ 2023-11-13T11:14:08.147 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 6833 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/lib/crc-itu-t.ko 2023-11-13T11:14:08.147 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 6529 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/lib/crc7.ko 2023-11-13T11:14:08.147 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 7025 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/lib/crc8.ko 2023-11-13T11:14:08.148 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/lib/crypto/ 2023-11-13T11:14:08.148 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 7097 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/lib/crypto/libarc4.ko 2023-11-13T11:14:08.148 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 37081 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/lib/crypto/libdes.ko 2023-11-13T11:14:08.148 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 13313 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/lib/interval_tree_test.ko 2023-11-13T11:14:08.148 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 8425 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/lib/libcrc32c.ko 2023-11-13T11:14:08.149 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 24953 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/lib/lru_cache.ko 2023-11-13T11:14:08.149 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/lib/lz4/ 2023-11-13T11:14:08.149 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 33801 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/lib/lz4/lz4_compress.ko 2023-11-13T11:14:08.149 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 22633 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/lib/lz4/lz4hc_compress.ko 2023-11-13T11:14:08.150 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/lib/math/ 2023-11-13T11:14:08.150 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 6617 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/lib/math/cordic.ko 2023-11-13T11:14:08.150 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 8233 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/lib/memory-notifier-error-inject.ko 2023-11-13T11:14:08.150 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 10929 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/lib/notifier-error-inject.ko 2023-11-13T11:14:08.151 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 14089 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/lib/percpu_test.ko 2023-11-13T11:14:08.151 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 8305 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/lib/pm-notifier-error-inject.ko 2023-11-13T11:14:08.151 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/lib/raid6/ 2023-11-13T11:14:08.151 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 143433 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/lib/raid6/raid6_pq.ko 2023-11-13T11:14:08.151 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 21105 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/lib/rbtree_test.ko 2023-11-13T11:14:08.152 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/lib/reed_solomon/ 2023-11-13T11:14:08.152 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 18753 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/lib/reed_solomon/reed_solomon.ko 2023-11-13T11:14:08.152 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 38841 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/lib/test-kstrtox.ko 2023-11-13T11:14:08.152 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 26321 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/lib/test-string_helpers.ko 2023-11-13T11:14:08.152 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 4760425 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/lib/test_bpf.ko 2023-11-13T11:14:08.153 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 49089 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/lib/test_firmware.ko 2023-11-13T11:14:08.153 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 6369 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/lib/test_module.ko 2023-11-13T11:14:08.153 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 20801 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/lib/test_user_copy.ko 2023-11-13T11:14:08.153 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 9585 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/lib/ts_bm.ko 2023-11-13T11:14:08.154 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 11121 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/lib/ts_fsm.ko 2023-11-13T11:14:08.154 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 9689 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/lib/ts_kmp.ko 2023-11-13T11:14:08.154 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/lib/xz/ 2023-11-13T11:14:08.154 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 13545 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/lib/xz/xz_dec_test.ko 2023-11-13T11:14:08.154 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/mm/ 2023-11-13T11:14:08.155 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 15425 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/mm/hwpoison-inject.ko 2023-11-13T11:14:08.155 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ 2023-11-13T11:14:08.155 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/6lowpan/ 2023-11-13T11:14:08.155 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 55737 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/6lowpan/6lowpan.ko 2023-11-13T11:14:08.155 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 7049 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/6lowpan/nhc_dest.ko 2023-11-13T11:14:08.156 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 7065 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/6lowpan/nhc_fragment.ko 2023-11-13T11:14:08.156 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 7049 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/6lowpan/nhc_hop.ko 2023-11-13T11:14:08.156 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 6985 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/6lowpan/nhc_ipv6.ko 2023-11-13T11:14:08.156 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 7065 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/6lowpan/nhc_mobility.ko 2023-11-13T11:14:08.157 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 7065 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/6lowpan/nhc_routing.ko 2023-11-13T11:14:08.157 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 15329 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/6lowpan/nhc_udp.ko 2023-11-13T11:14:08.157 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/802/ 2023-11-13T11:14:08.157 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 30385 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/802/garp.ko 2023-11-13T11:14:08.157 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 34809 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/802/mrp.ko 2023-11-13T11:14:08.158 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 8545 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/802/p8022.ko 2023-11-13T11:14:08.158 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 16345 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/802/psnap.ko 2023-11-13T11:14:08.158 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 11537 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/802/stp.ko 2023-11-13T11:14:08.158 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/8021q/ 2023-11-13T11:14:08.159 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 81737 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/8021q/8021q.ko 2023-11-13T11:14:08.159 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/9p/ 2023-11-13T11:14:08.159 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 198337 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/9p/9pnet.ko 2023-11-13T11:14:08.159 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 35977 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/9p/9pnet_fd.ko 2023-11-13T11:14:08.159 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 26345 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/9p/9pnet_rdma.ko 2023-11-13T11:14:08.160 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 32337 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/9p/9pnet_virtio.ko 2023-11-13T11:14:08.160 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/batman-adv/ 2023-11-13T11:14:08.160 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 649297 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/batman-adv/batman-adv.ko 2023-11-13T11:14:08.160 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/bridge/ 2023-11-13T11:14:08.160 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 63809 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/bridge/br_netfilter.ko 2023-11-13T11:14:08.161 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 777689 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/bridge/bridge.ko 2023-11-13T11:14:08.161 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/bridge/netfilter/ 2023-11-13T11:14:08.161 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 7657 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/bridge/netfilter/ebt_802_3.ko 2023-11-13T11:14:08.161 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 12385 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/bridge/netfilter/ebt_among.ko 2023-11-13T11:14:08.162 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 9169 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/bridge/netfilter/ebt_arp.ko 2023-11-13T11:14:08.162 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 9073 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/bridge/netfilter/ebt_arpreply.ko 2023-11-13T11:14:08.162 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 9625 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/bridge/netfilter/ebt_dnat.ko 2023-11-13T11:14:08.162 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 8737 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/bridge/netfilter/ebt_ip.ko 2023-11-13T11:14:08.163 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 9145 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/bridge/netfilter/ebt_ip6.ko 2023-11-13T11:14:08.163 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 9825 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/bridge/netfilter/ebt_limit.ko 2023-11-13T11:14:08.163 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 13217 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/bridge/netfilter/ebt_log.ko 2023-11-13T11:14:08.163 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 7585 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/bridge/netfilter/ebt_mark.ko 2023-11-13T11:14:08.163 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 7593 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/bridge/netfilter/ebt_mark_m.ko 2023-11-13T11:14:08.164 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 8385 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/bridge/netfilter/ebt_nflog.ko 2023-11-13T11:14:08.164 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 7537 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/bridge/netfilter/ebt_pkttype.ko 2023-11-13T11:14:08.164 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 9593 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/bridge/netfilter/ebt_redirect.ko 2023-11-13T11:14:08.164 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 8649 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/bridge/netfilter/ebt_snat.ko 2023-11-13T11:14:08.165 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 8889 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/bridge/netfilter/ebt_stp.ko 2023-11-13T11:14:08.165 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 12401 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/bridge/netfilter/ebt_vlan.ko 2023-11-13T11:14:08.165 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 11529 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/bridge/netfilter/ebtable_broute.ko 2023-11-13T11:14:08.165 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 9817 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/bridge/netfilter/ebtable_filter.ko 2023-11-13T11:14:08.165 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 9793 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/bridge/netfilter/ebtable_nat.ko 2023-11-13T11:14:08.166 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 55929 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/bridge/netfilter/ebtables.ko 2023-11-13T11:14:08.166 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 14041 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2023-11-13T11:14:08.166 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 13945 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2023-11-13T11:14:08.166 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ceph/ 2023-11-13T11:14:08.167 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 1047497 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ceph/libceph.ko 2023-11-13T11:14:08.167 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/core/ 2023-11-13T11:14:08.167 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 125697 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/core/pktgen.ko 2023-11-13T11:14:08.167 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/dccp/ 2023-11-13T11:14:08.168 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 194209 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/dccp/dccp.ko 2023-11-13T11:14:08.168 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 8665 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/dccp/dccp_diag.ko 2023-11-13T11:14:08.168 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 57881 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/dccp/dccp_ipv4.ko 2023-11-13T11:14:08.168 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 60337 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/dccp/dccp_ipv6.ko 2023-11-13T11:14:08.168 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/dsa/ 2023-11-13T11:14:08.169 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 390473 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/dsa/dsa_core.ko 2023-11-13T11:14:08.169 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 13337 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/dsa/tag_brcm.ko 2023-11-13T11:14:08.169 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 12577 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/dsa/tag_dsa.ko 2023-11-13T11:14:08.169 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 7721 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/dsa/tag_none.ko 2023-11-13T11:14:08.169 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 8953 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/dsa/tag_trailer.ko 2023-11-13T11:14:08.170 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/hsr/ 2023-11-13T11:14:08.170 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 99729 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/hsr/hsr.ko 2023-11-13T11:14:08.170 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ieee802154/ 2023-11-13T11:14:08.170 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ieee802154/6lowpan/ 2023-11-13T11:14:08.171 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 45233 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2023-11-13T11:14:08.171 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 254625 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ieee802154/ieee802154.ko 2023-11-13T11:14:08.171 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 47289 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ieee802154/ieee802154_socket.ko 2023-11-13T11:14:08.171 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ipv4/ 2023-11-13T11:14:08.171 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 24729 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ipv4/ah4.ko 2023-11-13T11:14:08.172 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 38905 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ipv4/esp4.ko 2023-11-13T11:14:08.172 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 48401 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ipv4/fou.ko 2023-11-13T11:14:08.172 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 18121 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ipv4/gre.ko 2023-11-13T11:14:08.172 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 48657 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ipv4/inet_diag.ko 2023-11-13T11:14:08.172 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 60633 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ipv4/ip_gre.ko 2023-11-13T11:14:08.173 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 61225 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ipv4/ip_tunnel.ko 2023-11-13T11:14:08.173 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 34505 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ipv4/ip_vti.ko 2023-11-13T11:14:08.173 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 14001 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ipv4/ipcomp.ko 2023-11-13T11:14:08.173 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 28841 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ipv4/ipip.ko 2023-11-13T11:14:08.173 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ipv4/netfilter/ 2023-11-13T11:14:08.174 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 37641 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ipv4/netfilter/arp_tables.ko 2023-11-13T11:14:08.174 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 8873 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ipv4/netfilter/arpt_mangle.ko 2023-11-13T11:14:08.174 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 10409 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ipv4/netfilter/arptable_filter.ko 2023-11-13T11:14:08.174 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 41673 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ipv4/netfilter/ip_tables.ko 2023-11-13T11:14:08.175 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 10057 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ipv4/netfilter/ipt_ECN.ko 2023-11-13T11:14:08.175 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 9681 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ipv4/netfilter/ipt_REJECT.ko 2023-11-13T11:14:08.175 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 14121 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2023-11-13T11:14:08.175 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 11177 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ipv4/netfilter/ipt_ah.ko 2023-11-13T11:14:08.175 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 14881 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2023-11-13T11:14:08.176 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 11305 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ipv4/netfilter/iptable_filter.ko 2023-11-13T11:14:08.176 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 11649 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ipv4/netfilter/iptable_mangle.ko 2023-11-13T11:14:08.176 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 14905 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ipv4/netfilter/iptable_nat.ko 2023-11-13T11:14:08.176 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 11545 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ipv4/netfilter/iptable_raw.ko 2023-11-13T11:14:08.176 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 10409 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ipv4/netfilter/iptable_security.ko 2023-11-13T11:14:08.177 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 12489 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2023-11-13T11:14:08.177 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 8817 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2023-11-13T11:14:08.177 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 27625 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2023-11-13T11:14:08.177 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 18225 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2023-11-13T11:14:08.178 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 13337 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2023-11-13T11:14:08.178 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 20561 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ipv4/netfilter/nf_reject_ipv4.ko 2023-11-13T11:14:08.178 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 9329 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2023-11-13T11:14:08.178 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 15177 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2023-11-13T11:14:08.178 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 9961 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2023-11-13T11:14:08.179 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 17113 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2023-11-13T11:14:08.179 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 9009 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2023-11-13T11:14:08.179 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 13073 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ipv4/tcp_bic.ko 2023-11-13T11:14:08.179 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 13737 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ipv4/tcp_dctcp.ko 2023-11-13T11:14:08.180 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 15369 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ipv4/tcp_diag.ko 2023-11-13T11:14:08.180 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 9537 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ipv4/tcp_highspeed.ko 2023-11-13T11:14:08.180 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 12401 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ipv4/tcp_htcp.ko 2023-11-13T11:14:08.180 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 10449 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ipv4/tcp_hybla.ko 2023-11-13T11:14:08.180 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 11473 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ipv4/tcp_illinois.ko 2023-11-13T11:14:08.181 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 10433 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ipv4/tcp_lp.ko 2023-11-13T11:14:08.181 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 8329 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ipv4/tcp_scalable.ko 2023-11-13T11:14:08.181 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 14425 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ipv4/tcp_vegas.ko 2023-11-13T11:14:08.181 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 10089 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ipv4/tcp_veno.ko 2023-11-13T11:14:08.181 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 10953 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ipv4/tcp_westwood.ko 2023-11-13T11:14:08.182 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 10185 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ipv4/tcp_yeah.ko 2023-11-13T11:14:08.182 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 22601 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ipv4/tunnel4.ko 2023-11-13T11:14:08.182 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 17097 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ipv4/udp_diag.ko 2023-11-13T11:14:08.182 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 41665 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ipv4/udp_tunnel.ko 2023-11-13T11:14:08.183 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 11425 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ipv4/xfrm4_tunnel.ko 2023-11-13T11:14:08.183 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ipv6/ 2023-11-13T11:14:08.183 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 26441 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ipv6/ah6.ko 2023-11-13T11:14:08.183 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 39537 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ipv6/esp6.ko 2023-11-13T11:14:08.183 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 14425 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ipv6/fou6.ko 2023-11-13T11:14:08.184 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 80897 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ipv6/ip6_gre.ko 2023-11-13T11:14:08.184 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 93577 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ipv6/ip6_tunnel.ko 2023-11-13T11:14:08.184 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 10825 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ipv6/ip6_udp_tunnel.ko 2023-11-13T11:14:08.184 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 53273 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ipv6/ip6_vti.ko 2023-11-13T11:14:08.185 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 13785 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ipv6/ipcomp6.ko 2023-11-13T11:14:08.185 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 19017 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ipv6/mip6.ko 2023-11-13T11:14:08.185 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ipv6/netfilter/ 2023-11-13T11:14:08.185 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 42169 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ipv6/netfilter/ip6_tables.ko 2023-11-13T11:14:08.185 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 11753 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ipv6/netfilter/ip6t_NPT.ko 2023-11-13T11:14:08.186 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 9753 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2023-11-13T11:14:08.186 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 14201 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2023-11-13T11:14:08.186 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 14337 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ipv6/netfilter/ip6t_ah.ko 2023-11-13T11:14:08.186 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 7801 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2023-11-13T11:14:08.187 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 16209 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ipv6/netfilter/ip6t_frag.ko 2023-11-13T11:14:08.187 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 16033 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2023-11-13T11:14:08.187 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 8913 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2023-11-13T11:14:08.187 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 9897 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ipv6/netfilter/ip6t_mh.ko 2023-11-13T11:14:08.187 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 10937 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2023-11-13T11:14:08.188 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 10897 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ipv6/netfilter/ip6t_rt.ko 2023-11-13T11:14:08.188 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 11321 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ipv6/netfilter/ip6table_filter.ko 2023-11-13T11:14:08.188 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 11121 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2023-11-13T11:14:08.188 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 15009 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ipv6/netfilter/ip6table_nat.ko 2023-11-13T11:14:08.188 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 11617 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ipv6/netfilter/ip6table_raw.ko 2023-11-13T11:14:08.189 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 10433 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ipv6/netfilter/ip6table_security.ko 2023-11-13T11:14:08.189 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 39113 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2023-11-13T11:14:08.189 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 8449 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2023-11-13T11:14:08.189 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 25945 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2023-11-13T11:14:08.189 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 9801 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2023-11-13T11:14:08.190 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 15393 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2023-11-13T11:14:08.190 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 9633 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2023-11-13T11:14:08.190 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 16025 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2023-11-13T11:14:08.190 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 9009 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2023-11-13T11:14:08.191 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 74073 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ipv6/sit.ko 2023-11-13T11:14:08.191 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 24193 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ipv6/tunnel6.ko 2023-11-13T11:14:08.191 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 23297 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ipv6/xfrm6_tunnel.ko 2023-11-13T11:14:08.191 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/key/ 2023-11-13T11:14:08.191 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 82833 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/key/af_key.ko 2023-11-13T11:14:08.192 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/l2tp/ 2023-11-13T11:14:08.192 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 125281 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/l2tp/l2tp_core.ko 2023-11-13T11:14:08.192 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 20177 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/l2tp/l2tp_debugfs.ko 2023-11-13T11:14:08.192 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 25953 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/l2tp/l2tp_eth.ko 2023-11-13T11:14:08.193 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 35569 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/l2tp/l2tp_ip.ko 2023-11-13T11:14:08.193 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 36713 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/l2tp/l2tp_ip6.ko 2023-11-13T11:14:08.193 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 33001 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/l2tp/l2tp_netlink.ko 2023-11-13T11:14:08.193 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 53241 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/l2tp/l2tp_ppp.ko 2023-11-13T11:14:08.193 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/lapb/ 2023-11-13T11:14:08.194 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 47977 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/lapb/lapb.ko 2023-11-13T11:14:08.194 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/llc/ 2023-11-13T11:14:08.194 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 23193 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/llc/llc.ko 2023-11-13T11:14:08.194 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 267777 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/llc/llc2.ko 2023-11-13T11:14:08.194 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/mac802154/ 2023-11-13T11:14:08.195 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 290417 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/mac802154/mac802154.ko 2023-11-13T11:14:08.195 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/mpls/ 2023-11-13T11:14:08.195 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 9393 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/mpls/mpls_gso.ko 2023-11-13T11:14:08.195 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/ 2023-11-13T11:14:08.195 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/ipset/ 2023-11-13T11:14:08.196 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 119585 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/ipset/ip_set.ko 2023-11-13T11:14:08.196 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 28353 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2023-11-13T11:14:08.196 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 26913 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2023-11-13T11:14:08.196 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 26369 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2023-11-13T11:14:08.197 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 100297 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2023-11-13T11:14:08.197 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 101441 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2023-11-13T11:14:08.197 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 102817 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2023-11-13T11:14:08.197 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 103481 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2023-11-13T11:14:08.197 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 112849 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2023-11-13T11:14:08.198 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 60329 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2023-11-13T11:14:08.198 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 109593 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2023-11-13T11:14:08.198 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 113129 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2023-11-13T11:14:08.198 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 112585 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2023-11-13T11:14:08.198 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 111585 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2023-11-13T11:14:08.199 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 114465 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2023-11-13T11:14:08.199 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 30025 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/ipset/ip_set_list_set.ko 2023-11-13T11:14:08.199 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/ipvs/ 2023-11-13T11:14:08.199 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 411729 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/ipvs/ip_vs.ko 2023-11-13T11:14:08.199 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 11961 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2023-11-13T11:14:08.200 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 7625 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2023-11-13T11:14:08.200 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 17729 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2023-11-13T11:14:08.200 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 17905 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2023-11-13T11:14:08.200 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 20737 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2023-11-13T11:14:08.201 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 7689 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2023-11-13T11:14:08.201 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 7689 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2023-11-13T11:14:08.201 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 10681 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2023-11-13T11:14:08.201 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 9233 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2023-11-13T11:14:08.201 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 7697 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2023-11-13T11:14:08.202 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 13521 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2023-11-13T11:14:08.202 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 7697 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2023-11-13T11:14:08.202 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 10993 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2023-11-13T11:14:08.202 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 49257 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/nf_conncount.ko 2023-11-13T11:14:08.203 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 408257 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/nf_conntrack.ko 2023-11-13T11:14:08.203 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 15985 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/nf_conntrack_amanda.ko 2023-11-13T11:14:08.203 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 10177 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/nf_conntrack_broadcast.ko 2023-11-13T11:14:08.203 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 33761 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/nf_conntrack_ftp.ko 2023-11-13T11:14:08.203 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 118145 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/nf_conntrack_h323.ko 2023-11-13T11:14:08.204 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 22185 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/nf_conntrack_irc.ko 2023-11-13T11:14:08.204 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 8817 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2023-11-13T11:14:08.204 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 107297 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/nf_conntrack_netlink.ko 2023-11-13T11:14:08.204 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 33633 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/nf_conntrack_pptp.ko 2023-11-13T11:14:08.204 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 17401 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/nf_conntrack_sane.ko 2023-11-13T11:14:08.205 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 66641 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/nf_conntrack_sip.ko 2023-11-13T11:14:08.205 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 11233 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/nf_conntrack_snmp.ko 2023-11-13T11:14:08.205 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 19185 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/nf_conntrack_tftp.ko 2023-11-13T11:14:08.205 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 10113 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/nf_dup_netdev.ko 2023-11-13T11:14:08.206 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 89473 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/nf_flow_table.ko 2023-11-13T11:14:08.206 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 9593 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/nf_flow_table_inet.ko 2023-11-13T11:14:08.206 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 37129 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/nf_log_syslog.ko 2023-11-13T11:14:08.206 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 95417 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/nf_nat.ko 2023-11-13T11:14:08.206 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 10129 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/nf_nat_amanda.ko 2023-11-13T11:14:08.207 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 12625 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/nf_nat_ftp.ko 2023-11-13T11:14:08.207 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 11857 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/nf_nat_irc.ko 2023-11-13T11:14:08.207 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 28929 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/nf_nat_sip.ko 2023-11-13T11:14:08.207 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 8809 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/nf_nat_tftp.ko 2023-11-13T11:14:08.208 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 44065 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/nf_synproxy_core.ko 2023-11-13T11:14:08.208 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 615313 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/nf_tables.ko 2023-11-13T11:14:08.208 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 42561 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/nfnetlink.ko 2023-11-13T11:14:08.208 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 30233 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/nfnetlink_acct.ko 2023-11-13T11:14:08.208 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 30569 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/nfnetlink_cttimeout.ko 2023-11-13T11:14:08.209 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 39785 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/nfnetlink_log.ko 2023-11-13T11:14:08.209 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 22921 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/nfnetlink_osf.ko 2023-11-13T11:14:08.209 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 49377 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/nfnetlink_queue.ko 2023-11-13T11:14:08.209 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 10457 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/nft_chain_nat.ko 2023-11-13T11:14:08.209 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 33209 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/nft_compat.ko 2023-11-13T11:14:08.210 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 40721 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/nft_ct.ko 2023-11-13T11:14:08.210 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 9601 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/nft_dup_netdev.ko 2023-11-13T11:14:08.210 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 11401 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/nft_fib.ko 2023-11-13T11:14:08.210 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 13745 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/nft_fwd_netdev.ko 2023-11-13T11:14:08.211 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 14185 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/nft_hash.ko 2023-11-13T11:14:08.211 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 20065 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/nft_limit.ko 2023-11-13T11:14:08.211 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 15401 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/nft_log.ko 2023-11-13T11:14:08.211 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 14801 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/nft_masq.ko 2023-11-13T11:14:08.211 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 14329 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/nft_nat.ko 2023-11-13T11:14:08.212 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 13673 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/nft_numgen.ko 2023-11-13T11:14:08.212 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 11841 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/nft_osf.ko 2023-11-13T11:14:08.212 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 14073 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/nft_queue.ko 2023-11-13T11:14:08.212 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 14193 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/nft_redir.ko 2023-11-13T11:14:08.212 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 10497 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/nft_reject.ko 2023-11-13T11:14:08.213 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 10081 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/nft_reject_inet.ko 2023-11-13T11:14:08.213 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 12737 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/nft_socket.ko 2023-11-13T11:14:08.213 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 20369 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/nft_synproxy.ko 2023-11-13T11:14:08.213 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 14849 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/nft_tproxy.ko 2023-11-13T11:14:08.214 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 89313 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/x_tables.ko 2023-11-13T11:14:08.214 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 12097 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/xt_AUDIT.ko 2023-11-13T11:14:08.214 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 9633 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/xt_CHECKSUM.ko 2023-11-13T11:14:08.214 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 7729 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/xt_CLASSIFY.ko 2023-11-13T11:14:08.214 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 11521 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/xt_CONNSECMARK.ko 2023-11-13T11:14:08.215 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 18169 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/xt_CT.ko 2023-11-13T11:14:08.215 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 10497 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/xt_DSCP.ko 2023-11-13T11:14:08.215 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 9465 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/xt_HL.ko 2023-11-13T11:14:08.215 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 13433 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/xt_HMARK.ko 2023-11-13T11:14:08.215 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 38873 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/xt_IDLETIMER.ko 2023-11-13T11:14:08.216 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 13889 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/xt_LED.ko 2023-11-13T11:14:08.216 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 11489 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/xt_LOG.ko 2023-11-13T11:14:08.216 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 11753 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/xt_MASQUERADE.ko 2023-11-13T11:14:08.216 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 11657 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/xt_NETMAP.ko 2023-11-13T11:14:08.216 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 9473 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/xt_NFLOG.ko 2023-11-13T11:14:08.217 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 13289 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/xt_NFQUEUE.ko 2023-11-13T11:14:08.217 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 19665 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/xt_RATEEST.ko 2023-11-13T11:14:08.217 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 11073 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/xt_REDIRECT.ko 2023-11-13T11:14:08.217 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 14337 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/xt_SECMARK.ko 2023-11-13T11:14:08.217 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 16057 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/xt_TCPMSS.ko 2023-11-13T11:14:08.218 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 10433 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2023-11-13T11:14:08.218 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 17361 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/xt_TEE.ko 2023-11-13T11:14:08.218 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 16785 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/xt_TPROXY.ko 2023-11-13T11:14:08.218 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 8321 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/xt_TRACE.ko 2023-11-13T11:14:08.219 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 13897 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/xt_addrtype.ko 2023-11-13T11:14:08.221 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 13897 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/xt_bpf.ko 2023-11-13T11:14:08.221 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 15529 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/xt_cgroup.ko 2023-11-13T11:14:08.221 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 11209 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/xt_cluster.ko 2023-11-13T11:14:08.221 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 7505 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/xt_comment.ko 2023-11-13T11:14:08.222 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 10465 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/xt_connbytes.ko 2023-11-13T11:14:08.222 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 11081 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/xt_connlabel.ko 2023-11-13T11:14:08.222 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 9401 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/xt_connlimit.ko 2023-11-13T11:14:08.222 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 13129 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/xt_connmark.ko 2023-11-13T11:14:08.223 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 12401 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/xt_conntrack.ko 2023-11-13T11:14:08.223 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 7817 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/xt_cpu.ko 2023-11-13T11:14:08.223 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 10969 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/xt_dccp.ko 2023-11-13T11:14:08.223 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 7865 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/xt_devgroup.ko 2023-11-13T11:14:08.223 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 8801 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/xt_dscp.ko 2023-11-13T11:14:08.224 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 10657 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/xt_ecn.ko 2023-11-13T11:14:08.224 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 11473 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/xt_esp.ko 2023-11-13T11:14:08.224 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 43289 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/xt_hashlimit.ko 2023-11-13T11:14:08.224 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 11313 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/xt_helper.ko 2023-11-13T11:14:08.224 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 7865 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/xt_hl.ko 2023-11-13T11:14:08.225 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 11921 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/xt_ipcomp.ko 2023-11-13T11:14:08.225 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 11473 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/xt_iprange.ko 2023-11-13T11:14:08.225 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 11785 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/xt_ipvs.ko 2023-11-13T11:14:08.225 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 16041 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/xt_l2tp.ko 2023-11-13T11:14:08.225 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 8001 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/xt_length.ko 2023-11-13T11:14:08.226 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 10273 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/xt_limit.ko 2023-11-13T11:14:08.226 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 7545 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/xt_mac.ko 2023-11-13T11:14:08.226 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 8641 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/xt_mark.ko 2023-11-13T11:14:08.226 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 11825 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/xt_multiport.ko 2023-11-13T11:14:08.226 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 13817 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/xt_nat.ko 2023-11-13T11:14:08.227 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 10105 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/xt_nfacct.ko 2023-11-13T11:14:08.227 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 8297 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/xt_osf.ko 2023-11-13T11:14:08.227 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 9553 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/xt_owner.ko 2023-11-13T11:14:08.227 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 9729 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/xt_physdev.ko 2023-11-13T11:14:08.228 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 7633 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/xt_pkttype.ko 2023-11-13T11:14:08.228 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 11985 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/xt_policy.ko 2023-11-13T11:14:08.228 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 9473 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/xt_quota.ko 2023-11-13T11:14:08.228 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 10409 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/xt_rateest.ko 2023-11-13T11:14:08.228 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 8257 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/xt_realm.ko 2023-11-13T11:14:08.229 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 36497 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/xt_recent.ko 2023-11-13T11:14:08.229 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 13393 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/xt_sctp.ko 2023-11-13T11:14:08.229 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 30089 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/xt_set.ko 2023-11-13T11:14:08.229 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 16089 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/xt_socket.ko 2023-11-13T11:14:08.229 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 9505 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/xt_state.ko 2023-11-13T11:14:08.230 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 9473 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/xt_statistic.ko 2023-11-13T11:14:08.230 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 8809 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/xt_string.ko 2023-11-13T11:14:08.230 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 8553 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/xt_tcpmss.ko 2023-11-13T11:14:08.230 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 15777 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/xt_tcpudp.ko 2023-11-13T11:14:08.230 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 11129 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/xt_time.ko 2023-11-13T11:14:08.231 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 9401 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/xt_u32.ko 2023-11-13T11:14:08.231 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netlink/ 2023-11-13T11:14:08.231 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 13969 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netlink/netlink_diag.ko 2023-11-13T11:14:08.231 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/nsh/ 2023-11-13T11:14:08.231 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 12425 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/nsh/nsh.ko 2023-11-13T11:14:08.232 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/openvswitch/ 2023-11-13T11:14:08.232 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 380033 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/openvswitch/openvswitch.ko 2023-11-13T11:14:08.232 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 10321 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/openvswitch/vport-geneve.ko 2023-11-13T11:14:08.232 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 9449 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/openvswitch/vport-gre.ko 2023-11-13T11:14:08.233 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 11793 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/openvswitch/vport-vxlan.ko 2023-11-13T11:14:08.233 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/packet/ 2023-11-13T11:14:08.233 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 13057 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/packet/af_packet_diag.ko 2023-11-13T11:14:08.233 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/phonet/ 2023-11-13T11:14:08.233 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 110201 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/phonet/phonet.ko 2023-11-13T11:14:08.234 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 54697 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/phonet/pn_pep.ko 2023-11-13T11:14:08.234 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/rds/ 2023-11-13T11:14:08.234 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 251481 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/rds/rds.ko 2023-11-13T11:14:08.234 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 164937 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/rds/rds_rdma.ko 2023-11-13T11:14:08.235 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 67377 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/rds/rds_tcp.ko 2023-11-13T11:14:08.235 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/rxrpc/ 2023-11-13T11:14:08.235 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 819657 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/rxrpc/rxrpc.ko 2023-11-13T11:14:08.235 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/sched/ 2023-11-13T11:14:08.235 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 32241 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/sched/act_csum.ko 2023-11-13T11:14:08.236 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 23577 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/sched/act_gact.ko 2023-11-13T11:14:08.236 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 26873 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/sched/act_ipt.ko 2023-11-13T11:14:08.236 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 34097 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/sched/act_mirred.ko 2023-11-13T11:14:08.236 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 23401 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/sched/act_nat.ko 2023-11-13T11:14:08.236 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 43449 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/sched/act_pedit.ko 2023-11-13T11:14:08.237 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 31961 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/sched/act_police.ko 2023-11-13T11:14:08.237 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 20289 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/sched/act_simple.ko 2023-11-13T11:14:08.237 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 35297 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/sched/act_skbedit.ko 2023-11-13T11:14:08.237 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 36665 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/sched/act_vlan.ko 2023-11-13T11:14:08.238 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 26169 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/sched/cls_basic.ko 2023-11-13T11:14:08.238 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 33961 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/sched/cls_bpf.ko 2023-11-13T11:14:08.238 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 19233 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/sched/cls_cgroup.ko 2023-11-13T11:14:08.238 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 31401 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/sched/cls_flow.ko 2023-11-13T11:14:08.238 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 31769 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/sched/cls_fw.ko 2023-11-13T11:14:08.239 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 38489 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/sched/cls_route.ko 2023-11-13T11:14:08.239 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 61409 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/sched/cls_u32.ko 2023-11-13T11:14:08.239 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 7441 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/sched/em_cmp.ko 2023-11-13T11:14:08.239 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 13409 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/sched/em_ipset.ko 2023-11-13T11:14:08.239 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 33289 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/sched/em_meta.ko 2023-11-13T11:14:08.240 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 7897 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/sched/em_nbyte.ko 2023-11-13T11:14:08.240 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 10625 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/sched/em_text.ko 2023-11-13T11:14:08.240 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 7249 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/sched/em_u32.ko 2023-11-13T11:14:08.240 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 21649 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/sched/sch_choke.ko 2023-11-13T11:14:08.240 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 20849 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/sched/sch_codel.ko 2023-11-13T11:14:08.241 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 34633 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/sched/sch_drr.ko 2023-11-13T11:14:08.241 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 33609 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/sched/sch_fq.ko 2023-11-13T11:14:08.241 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 31617 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/sched/sch_fq_codel.ko 2023-11-13T11:14:08.241 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 35433 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/sched/sch_gred.ko 2023-11-13T11:14:08.241 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 49601 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/sched/sch_hfsc.ko 2023-11-13T11:14:08.242 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 22089 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/sched/sch_hhf.ko 2023-11-13T11:14:08.242 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 66393 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/sched/sch_htb.ko 2023-11-13T11:14:08.242 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 26073 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/sched/sch_ingress.ko 2023-11-13T11:14:08.242 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 30273 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/sched/sch_mqprio.ko 2023-11-13T11:14:08.243 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 10793 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/sched/sch_mqprio_lib.ko 2023-11-13T11:14:08.243 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 26065 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/sched/sch_multiq.ko 2023-11-13T11:14:08.243 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 36137 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/sched/sch_netem.ko 2023-11-13T11:14:08.243 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 27497 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/sched/sch_pie.ko 2023-11-13T11:14:08.243 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 10625 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/sched/sch_plug.ko 2023-11-13T11:14:08.244 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 24729 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/sched/sch_prio.ko 2023-11-13T11:14:08.244 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 48793 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/sched/sch_qfq.ko 2023-11-13T11:14:08.244 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 32905 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/sched/sch_red.ko 2023-11-13T11:14:08.244 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 26881 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/sched/sch_sfb.ko 2023-11-13T11:14:08.245 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 31353 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/sched/sch_sfq.ko 2023-11-13T11:14:08.245 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 28897 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/sched/sch_tbf.ko 2023-11-13T11:14:08.245 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 28105 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/sched/sch_teql.ko 2023-11-13T11:14:08.245 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/sctp/ 2023-11-13T11:14:08.245 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 929745 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/sctp/sctp.ko 2023-11-13T11:14:08.246 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 19033 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/sctp/sctp_diag.ko 2023-11-13T11:14:08.246 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/sunrpc/ 2023-11-13T11:14:08.246 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/sunrpc/auth_gss/ 2023-11-13T11:14:08.246 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 336529 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2023-11-13T11:14:08.246 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 54737 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2023-11-13T11:14:08.247 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 1520161 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/sunrpc/sunrpc.ko 2023-11-13T11:14:08.247 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/sunrpc/xprtrdma/ 2023-11-13T11:14:08.247 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 707721 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2023-11-13T11:14:08.247 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/tipc/ 2023-11-13T11:14:08.247 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 10025 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/tipc/diag.ko 2023-11-13T11:14:08.248 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 862641 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/tipc/tipc.ko 2023-11-13T11:14:08.248 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/unix/ 2023-11-13T11:14:08.248 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 15729 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/unix/unix_diag.ko 2023-11-13T11:14:08.248 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/vmw_vsock/ 2023-11-13T11:14:08.248 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 85337 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2023-11-13T11:14:08.249 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 68049 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2023-11-13T11:14:08.249 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 96193 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/vmw_vsock/vsock.ko 2023-11-13T11:14:08.249 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 10705 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/vmw_vsock/vsock_diag.ko 2023-11-13T11:14:08.249 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 17521 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/vmw_vsock/vsock_loopback.ko 2023-11-13T11:14:08.249 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/x25/ 2023-11-13T11:14:08.250 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 125177 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/x25/x25.ko 2023-11-13T11:14:08.250 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/xfrm/ 2023-11-13T11:14:08.250 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 22657 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/xfrm/xfrm_algo.ko 2023-11-13T11:14:08.250 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 20649 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/xfrm/xfrm_ipcomp.ko 2023-11-13T11:14:08.251 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 102257 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/xfrm/xfrm_user.ko 2023-11-13T11:14:08.251 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/virt/ 2023-11-13T11:14:08.251 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/virt/lib/ 2023-11-13T11:14:08.251 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 15537 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/virt/lib/irqbypass.ko 2023-11-13T11:14:08.251 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 639863 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/modules.alias 2023-11-13T11:14:08.251 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 623919 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/modules.alias.bin 2023-11-13T11:14:08.252 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 7663 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/modules.builtin 2023-11-13T11:14:08.252 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 23428 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/modules.builtin.alias.bin 2023-11-13T11:14:08.252 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 9821 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/modules.builtin.bin 2023-11-13T11:14:08.252 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 70004 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/modules.builtin.modinfo 2023-11-13T11:14:08.252 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 146313 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/modules.dep 2023-11-13T11:14:08.253 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 232548 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/modules.dep.bin 2023-11-13T11:14:08.253 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 210 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/modules.devname 2023-11-13T11:14:08.253 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 72606 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/modules.order 2023-11-13T11:14:08.253 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 879 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/modules.softdep 2023-11-13T11:14:08.254 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 254438 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/modules.symbols 2023-11-13T11:14:08.254 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 309363 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/modules.symbols.bin 2023-11-13T11:14:08.254 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./usr/ 2023-11-13T11:14:08.254 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./usr/share/ 2023-11-13T11:14:08.254 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./usr/share/doc/ 2023-11-13T11:14:08.255 INFO:teuthology.orchestra.run.smithi154.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./usr/share/doc/linux-image-6.6.0-rc5-g5b73517e0e2f/ 2023-11-13T11:14:08.255 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 174 2023-10-25 03:19 ./usr/share/doc/linux-image-6.6.0-rc5-g5b73517e0e2f/changelog.Debian.gz 2023-11-13T11:14:08.255 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r-- root/root 691 2023-10-25 03:19 ./usr/share/doc/linux-image-6.6.0-rc5-g5b73517e0e2f/copyright 2023-11-13T11:14:08.256 DEBUG:teuthology.task.kernel:get_image_version: 6.6.0-rc5-g5b73517e0e2f 2023-11-13T11:14:08.256 INFO:teuthology.task.kernel:searching for kernel 6.6.0-rc5-g5b73517e0e2f 2023-11-13T11:14:08.257 DEBUG:teuthology.orchestra.run.smithi154:> egrep '(submenu|menuentry.*6.6.0-rc5-g5b73517e0e2f).*{' /boot/grub/grub.cfg 2023-11-13T11:14:08.264 INFO:teuthology.orchestra.run.smithi154.stdout:submenu 'Advanced options for Ubuntu' $menuentry_id_option 'gnulinux-advanced-7e9e2103-8bb7-4452-b35a-3b1230743254' { 2023-11-13T11:14:08.264 INFO:teuthology.orchestra.run.smithi154.stdout: menuentry 'Ubuntu, with Linux 6.6.0-rc5-g5b73517e0e2f' --class ubuntu --class gnu-linux --class gnu --class os $menuentry_id_option 'gnulinux-6.6.0-rc5-g5b73517e0e2f-advanced-7e9e2103-8bb7-4452-b35a-3b1230743254' { 2023-11-13T11:14:08.264 INFO:teuthology.orchestra.run.smithi154.stdout: menuentry 'Ubuntu, with Linux 6.6.0-rc5-g5b73517e0e2f (recovery mode)' --class ubuntu --class gnu-linux --class gnu --class os $menuentry_id_option 'gnulinux-6.6.0-rc5-g5b73517e0e2f-recovery-7e9e2103-8bb7-4452-b35a-3b1230743254' { 2023-11-13T11:14:08.265 INFO:teuthology.task.kernel:submenu_title:Advanced options for Ubuntu> 2023-11-13T11:14:08.265 INFO:teuthology.task.kernel:default_title:Ubuntu, with Linux 6.6.0-rc5-g5b73517e0e2f 2023-11-13T11:14:08.265 DEBUG:teuthology.orchestra.run.smithi154:> /bin/echo -e 'cat </dev/null && sudo chmod a+x -- '/etc/grub.d/01_ceph_kernel.tmp~' && sudo mv -- '/etc/grub.d/01_ceph_kernel.tmp~' /etc/grub.d/01_ceph_kernel && sudo update-grub && rm /tmp/linux-image.deb && ( sleep 1 && sudo shutdown -r now & ) 2023-11-13T11:14:08.310 DEBUG:teuthology.task.kernel:Waiting for install on ubuntu@smithi154.front.sepia.ceph.com to complete... 2023-11-13T11:14:08.651 INFO:teuthology.orchestra.run.smithi154.stderr:Sourcing file `/etc/default/grub' 2023-11-13T11:14:08.652 INFO:teuthology.orchestra.run.smithi154.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2023-11-13T11:14:08.678 INFO:teuthology.orchestra.run.smithi154.stderr:Generating grub configuration file ... 2023-11-13T11:14:08.898 INFO:teuthology.orchestra.run.smithi154.stderr:Found linux image: /boot/vmlinuz-6.6.0-rc5-g5b73517e0e2f 2023-11-13T11:14:08.905 INFO:teuthology.orchestra.run.smithi154.stderr:Found initrd image: /boot/initrd.img-6.6.0-rc5-g5b73517e0e2f 2023-11-13T11:14:09.131 INFO:teuthology.orchestra.run.smithi154.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2023-11-13T11:14:09.136 INFO:teuthology.orchestra.run.smithi154.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2023-11-13T11:14:09.173 INFO:teuthology.orchestra.run.smithi154.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2023-11-13T11:14:09.178 INFO:teuthology.orchestra.run.smithi154.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2023-11-13T11:14:09.310 INFO:teuthology.orchestra.run.smithi154.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2023-11-13T11:14:09.310 INFO:teuthology.orchestra.run.smithi154.stderr:Systems on them will not be added to the GRUB boot configuration. 2023-11-13T11:14:09.311 INFO:teuthology.orchestra.run.smithi154.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2023-11-13T11:14:09.319 INFO:teuthology.orchestra.run.smithi154.stderr:done 2023-11-13T11:14:18.082 INFO:teuthology.orchestra.run.smithi102.stderr:Sourcing file `/etc/default/grub' 2023-11-13T11:14:18.090 INFO:teuthology.orchestra.run.smithi102.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2023-11-13T11:14:18.102 INFO:teuthology.orchestra.run.smithi102.stderr:Generating grub configuration file ... 2023-11-13T11:14:18.413 INFO:teuthology.orchestra.run.smithi102.stderr:Found linux image: /boot/vmlinuz-6.6.0-rc5-g5b73517e0e2f 2023-11-13T11:14:18.435 INFO:teuthology.orchestra.run.smithi102.stderr:Found initrd image: /boot/initrd.img-6.6.0-rc5-g5b73517e0e2f 2023-11-13T11:14:18.719 INFO:teuthology.orchestra.run.smithi102.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2023-11-13T11:14:18.725 INFO:teuthology.orchestra.run.smithi102.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2023-11-13T11:14:18.781 INFO:teuthology.orchestra.run.smithi102.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2023-11-13T11:14:18.786 INFO:teuthology.orchestra.run.smithi102.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2023-11-13T11:14:18.930 INFO:teuthology.orchestra.run.smithi102.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2023-11-13T11:14:18.931 INFO:teuthology.orchestra.run.smithi102.stderr:Systems on them will not be added to the GRUB boot configuration. 2023-11-13T11:14:18.931 INFO:teuthology.orchestra.run.smithi102.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2023-11-13T11:14:18.975 INFO:teuthology.orchestra.run.smithi102.stderr:done 2023-11-13T11:14:19.175 DEBUG:teuthology.orchestra.run.smithi102:> dpkg-deb -c /tmp/linux-image.deb 2023-11-13T11:14:19.183 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./ 2023-11-13T11:14:19.183 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./boot/ 2023-11-13T11:14:19.183 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 4415097 2023-10-25 03:19 ./boot/System.map-6.6.0-rc5-g5b73517e0e2f 2023-11-13T11:14:19.195 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 169298 2023-10-25 03:19 ./boot/config-6.6.0-rc5-g5b73517e0e2f 2023-11-13T11:14:19.195 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 11352928 2023-10-25 03:19 ./boot/vmlinuz-6.6.0-rc5-g5b73517e0e2f 2023-11-13T11:14:19.214 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./etc/ 2023-11-13T11:14:19.215 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./etc/kernel/ 2023-11-13T11:14:19.215 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./etc/kernel/postinst.d/ 2023-11-13T11:14:19.215 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./etc/kernel/postrm.d/ 2023-11-13T11:14:19.215 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./etc/kernel/preinst.d/ 2023-11-13T11:14:19.216 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./etc/kernel/prerm.d/ 2023-11-13T11:14:19.216 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/ 2023-11-13T11:14:19.216 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/ 2023-11-13T11:14:19.217 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/ 2023-11-13T11:14:19.217 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/ 2023-11-13T11:14:19.217 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/arch/ 2023-11-13T11:14:19.217 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/arch/x86/ 2023-11-13T11:14:19.217 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/arch/x86/crypto/ 2023-11-13T11:14:19.218 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 490233 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/arch/x86/crypto/aesni-intel.ko 2023-11-13T11:14:19.220 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 25329 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/arch/x86/crypto/blowfish-x86_64.ko 2023-11-13T11:14:19.220 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 29529 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2023-11-13T11:14:19.221 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 30313 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2023-11-13T11:14:19.221 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 93113 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/arch/x86/crypto/camellia-x86_64.ko 2023-11-13T11:14:19.221 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 106729 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2023-11-13T11:14:19.222 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 152241 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2023-11-13T11:14:19.222 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 12553 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/arch/x86/crypto/crc32-pclmul.ko 2023-11-13T11:14:19.222 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 13777 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2023-11-13T11:14:19.222 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 83889 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2023-11-13T11:14:19.223 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 18625 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2023-11-13T11:14:19.223 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 47225 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2023-11-13T11:14:19.223 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 47209 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/arch/x86/crypto/serpent-avx2.ko 2023-11-13T11:14:19.224 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 51801 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2023-11-13T11:14:19.224 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 38937 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/arch/x86/crypto/sha1-ssse3.ko 2023-11-13T11:14:19.224 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 40529 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/arch/x86/crypto/sha256-ssse3.ko 2023-11-13T11:14:19.225 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 58585 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/arch/x86/crypto/sha512-ssse3.ko 2023-11-13T11:14:19.225 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 50497 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2023-11-13T11:14:19.225 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 32065 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2023-11-13T11:14:19.226 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 13625 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/arch/x86/crypto/twofish-x86_64.ko 2023-11-13T11:14:19.226 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/arch/x86/kernel/ 2023-11-13T11:14:19.227 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/arch/x86/kernel/cpu/ 2023-11-13T11:14:19.227 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/arch/x86/kernel/cpu/mce/ 2023-11-13T11:14:19.227 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 40113 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2023-11-13T11:14:19.227 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 13353 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/arch/x86/kernel/cpuid.ko 2023-11-13T11:14:19.227 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 17937 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/arch/x86/kernel/msr.ko 2023-11-13T11:14:19.228 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/arch/x86/kvm/ 2023-11-13T11:14:19.228 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 353761 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/arch/x86/kvm/kvm-amd.ko 2023-11-13T11:14:19.228 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 881713 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/arch/x86/kvm/kvm-intel.ko 2023-11-13T11:14:19.228 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 2276817 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/arch/x86/kvm/kvm.ko 2023-11-13T11:14:19.305 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/crypto/ 2023-11-13T11:14:19.305 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 53761 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/crypto/af_alg.ko 2023-11-13T11:14:19.305 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 23097 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/crypto/algif_hash.ko 2023-11-13T11:14:19.305 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 20049 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/crypto/algif_skcipher.ko 2023-11-13T11:14:19.306 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 17209 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/crypto/ansi_cprng.ko 2023-11-13T11:14:19.306 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 19641 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/crypto/anubis.ko 2023-11-13T11:14:19.306 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 10145 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/crypto/arc4.ko 2023-11-13T11:14:19.306 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/crypto/asymmetric_keys/ 2023-11-13T11:14:19.307 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 10185 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/crypto/asymmetric_keys/pkcs7_test_key.ko 2023-11-13T11:14:19.307 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/crypto/async_tx/ 2023-11-13T11:14:19.307 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 11249 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/crypto/async_tx/async_memcpy.ko 2023-11-13T11:14:19.307 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 19473 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/crypto/async_tx/async_pq.ko 2023-11-13T11:14:19.307 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 21561 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/crypto/async_tx/async_raid6_recov.ko 2023-11-13T11:14:19.307 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 13825 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/crypto/async_tx/async_tx.ko 2023-11-13T11:14:19.308 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 17745 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/crypto/async_tx/async_xor.ko 2023-11-13T11:14:19.308 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 17921 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/crypto/async_tx/raid6test.ko 2023-11-13T11:14:19.308 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 20489 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/crypto/authenc.ko 2023-11-13T11:14:19.308 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 22641 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/crypto/authencesn.ko 2023-11-13T11:14:19.308 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 21817 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/crypto/blake2b_generic.ko 2023-11-13T11:14:19.309 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 12729 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/crypto/blowfish_common.ko 2023-11-13T11:14:19.309 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 10537 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/crypto/blowfish_generic.ko 2023-11-13T11:14:19.309 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 38873 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/crypto/camellia_generic.ko 2023-11-13T11:14:19.309 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 27321 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/crypto/cast5_generic.ko 2023-11-13T11:14:19.309 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 17745 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/crypto/cast6_generic.ko 2023-11-13T11:14:19.310 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 10537 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/crypto/cast_common.ko 2023-11-13T11:14:19.310 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 35097 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/crypto/ccm.ko 2023-11-13T11:14:19.310 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 14769 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/crypto/cmac.ko 2023-11-13T11:14:19.310 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 9585 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/crypto/crc32_generic.ko 2023-11-13T11:14:19.310 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 47505 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/crypto/cryptd.ko 2023-11-13T11:14:19.311 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 39505 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/crypto/crypto_engine.ko 2023-11-13T11:14:19.311 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 26953 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/crypto/crypto_simd.ko 2023-11-13T11:14:19.311 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 24737 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/crypto/crypto_user.ko 2023-11-13T11:14:19.311 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 17729 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/crypto/cts.ko 2023-11-13T11:14:19.312 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 10913 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/crypto/des_generic.ko 2023-11-13T11:14:19.312 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 15681 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/crypto/dh_generic.ko 2023-11-13T11:14:19.312 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 11001 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/crypto/echainiv.ko 2023-11-13T11:14:19.312 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 25321 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/crypto/essiv.ko 2023-11-13T11:14:19.312 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 17993 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/crypto/fcrypt.ko 2023-11-13T11:14:19.313 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 26897 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/crypto/khazad.ko 2023-11-13T11:14:19.313 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 15649 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/crypto/lrw.ko 2023-11-13T11:14:19.313 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 11513 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/crypto/lz4.ko 2023-11-13T11:14:19.313 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 11529 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/crypto/lz4hc.ko 2023-11-13T11:14:19.314 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 11761 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/crypto/md4.ko 2023-11-13T11:14:19.314 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 9729 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/crypto/michael_mic.ko 2023-11-13T11:14:19.314 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 10673 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/crypto/pcbc.ko 2023-11-13T11:14:19.314 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 18745 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/crypto/pcrypt.ko 2023-11-13T11:14:19.315 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 16049 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/crypto/rmd160.ko 2023-11-13T11:14:19.315 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 29393 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/crypto/seed.ko 2023-11-13T11:14:19.315 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 27081 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/crypto/serpent_generic.ko 2023-11-13T11:14:19.315 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 149193 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/crypto/tcrypt.ko 2023-11-13T11:14:19.315 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 10881 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/crypto/tea.ko 2023-11-13T11:14:19.316 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 28777 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/crypto/twofish_common.ko 2023-11-13T11:14:19.316 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 13233 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/crypto/twofish_generic.ko 2023-11-13T11:14:19.316 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 17401 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/crypto/vmac.ko 2023-11-13T11:14:19.316 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 36185 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/crypto/wp512.ko 2023-11-13T11:14:19.317 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 14105 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/crypto/xcbc.ko 2023-11-13T11:14:19.317 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 26665 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/crypto/xor.ko 2023-11-13T11:14:19.317 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 18713 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/crypto/xts.ko 2023-11-13T11:14:19.317 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 9481 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/crypto/xxhash_generic.ko 2023-11-13T11:14:19.317 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/ 2023-11-13T11:14:19.318 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/acpi/ 2023-11-13T11:14:19.318 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 18249 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/acpi/acpi_extlog.ko 2023-11-13T11:14:19.318 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 26985 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/acpi/acpi_ipmi.ko 2023-11-13T11:14:19.318 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 28793 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/acpi/acpi_pad.ko 2023-11-13T11:14:19.319 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/acpi/apei/ 2023-11-13T11:14:19.319 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 31241 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/acpi/apei/einj.ko 2023-11-13T11:14:19.319 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 12801 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/acpi/ec_sys.ko 2023-11-13T11:14:19.320 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 14937 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/acpi/platform_profile.ko 2023-11-13T11:14:19.320 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 24401 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/acpi/sbs.ko 2023-11-13T11:14:19.320 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 19521 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/acpi/sbshc.ko 2023-11-13T11:14:19.320 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 103025 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/acpi/video.ko 2023-11-13T11:14:19.321 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/ata/ 2023-11-13T11:14:19.321 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 21601 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/ata/acard-ahci.ko 2023-11-13T11:14:19.321 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 88865 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/ata/ahci.ko 2023-11-13T11:14:19.321 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 14729 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/ata/ahci_platform.ko 2023-11-13T11:14:19.321 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 88289 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/ata/libahci.ko 2023-11-13T11:14:19.322 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 34985 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/ata/libahci_platform.ko 2023-11-13T11:14:19.322 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 17137 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/ata/pata_acpi.ko 2023-11-13T11:14:19.322 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 30497 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/ata/pata_ali.ko 2023-11-13T11:14:19.322 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 33569 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/ata/pata_amd.ko 2023-11-13T11:14:19.323 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 21265 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/ata/pata_artop.ko 2023-11-13T11:14:19.323 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 21121 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/ata/pata_atiixp.ko 2023-11-13T11:14:19.323 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 24945 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/ata/pata_atp867x.ko 2023-11-13T11:14:19.323 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 17721 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/ata/pata_cmd640.ko 2023-11-13T11:14:19.323 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 25249 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/ata/pata_cmd64x.ko 2023-11-13T11:14:19.324 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 15049 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/ata/pata_cypress.ko 2023-11-13T11:14:19.324 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 17849 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/ata/pata_efar.ko 2023-11-13T11:14:19.324 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 21945 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/ata/pata_hpt366.ko 2023-11-13T11:14:19.325 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 33977 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/ata/pata_hpt37x.ko 2023-11-13T11:14:19.325 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 23129 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/ata/pata_hpt3x2n.ko 2023-11-13T11:14:19.325 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 16921 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/ata/pata_hpt3x3.ko 2023-11-13T11:14:19.326 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 16993 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/ata/pata_it8213.ko 2023-11-13T11:14:19.326 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 35273 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/ata/pata_it821x.ko 2023-11-13T11:14:19.326 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 12889 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/ata/pata_jmicron.ko 2023-11-13T11:14:19.327 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 51481 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/ata/pata_legacy.ko 2023-11-13T11:14:19.327 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 15185 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/ata/pata_marvell.ko 2023-11-13T11:14:19.327 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 16281 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/ata/pata_mpiix.ko 2023-11-13T11:14:19.328 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 12833 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/ata/pata_netcell.ko 2023-11-13T11:14:19.328 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 16817 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/ata/pata_ninja32.ko 2023-11-13T11:14:19.328 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 15105 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/ata/pata_ns87410.ko 2023-11-13T11:14:19.328 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 17361 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/ata/pata_ns87415.ko 2023-11-13T11:14:19.328 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 16569 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/ata/pata_oldpiix.ko 2023-11-13T11:14:19.329 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 15377 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/ata/pata_opti.ko 2023-11-13T11:14:19.329 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 20681 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/ata/pata_optidma.ko 2023-11-13T11:14:19.329 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 32585 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/ata/pata_pcmcia.ko 2023-11-13T11:14:19.329 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 37793 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/ata/pata_pdc2027x.ko 2023-11-13T11:14:19.330 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 20561 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/ata/pata_pdc202xx_old.ko 2023-11-13T11:14:19.330 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 14225 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/ata/pata_piccolo.ko 2023-11-13T11:14:19.330 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 15449 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/ata/pata_radisys.ko 2023-11-13T11:14:19.330 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 19521 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/ata/pata_rdc.ko 2023-11-13T11:14:19.330 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 15329 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/ata/pata_rz1000.ko 2023-11-13T11:14:19.331 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 13937 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/ata/pata_sch.ko 2023-11-13T11:14:19.331 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 23097 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/ata/pata_serverworks.ko 2023-11-13T11:14:19.331 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 23457 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/ata/pata_sil680.ko 2023-11-13T11:14:19.331 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 19697 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/ata/pata_sl82c105.ko 2023-11-13T11:14:19.331 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 16009 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/ata/pata_triflex.ko 2023-11-13T11:14:19.332 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 30497 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/ata/pata_via.ko 2023-11-13T11:14:19.332 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 22793 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/ata/pdc_adma.ko 2023-11-13T11:14:19.332 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 29121 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/ata/sata_inic162x.ko 2023-11-13T11:14:19.332 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 83345 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/ata/sata_mv.ko 2023-11-13T11:14:19.332 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 70393 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/ata/sata_nv.ko 2023-11-13T11:14:19.333 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 37377 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/ata/sata_promise.ko 2023-11-13T11:14:19.333 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 23041 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/ata/sata_qstor.ko 2023-11-13T11:14:19.333 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 29273 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/ata/sata_sil.ko 2023-11-13T11:14:19.333 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 38337 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/ata/sata_sil24.ko 2023-11-13T11:14:19.333 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 17945 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/ata/sata_sis.ko 2023-11-13T11:14:19.334 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 20441 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/ata/sata_svw.ko 2023-11-13T11:14:19.334 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 44793 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/ata/sata_sx4.ko 2023-11-13T11:14:19.334 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 15601 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/ata/sata_uli.ko 2023-11-13T11:14:19.334 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 35065 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/ata/sata_via.ko 2023-11-13T11:14:19.335 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 20065 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/ata/sata_vsc.ko 2023-11-13T11:14:19.335 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/auxdisplay/ 2023-11-13T11:14:19.335 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 16289 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/auxdisplay/ks0108.ko 2023-11-13T11:14:19.336 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/bcma/ 2023-11-13T11:14:19.336 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 124473 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/bcma/bcma.ko 2023-11-13T11:14:19.336 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/block/ 2023-11-13T11:14:19.336 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/block/aoe/ 2023-11-13T11:14:19.337 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 113665 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/block/aoe/aoe.ko 2023-11-13T11:14:19.337 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/block/drbd/ 2023-11-13T11:14:19.337 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 965585 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/block/drbd/drbd.ko 2023-11-13T11:14:19.337 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 173225 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/block/floppy.ko 2023-11-13T11:14:19.337 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/block/mtip32xx/ 2023-11-13T11:14:19.338 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 94297 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/block/mtip32xx/mtip32xx.ko 2023-11-13T11:14:19.338 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 115793 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/block/nbd.ko 2023-11-13T11:14:19.338 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/block/null_blk/ 2023-11-13T11:14:19.338 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 110449 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/block/null_blk/null_blk.ko 2023-11-13T11:14:19.338 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 98193 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/block/pktcdvd.ko 2023-11-13T11:14:19.339 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 263769 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/block/rbd.ko 2023-11-13T11:14:19.339 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/block/xen-blkback/ 2023-11-13T11:14:19.339 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 98145 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/block/xen-blkback/xen-blkback.ko 2023-11-13T11:14:19.339 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/block/zram/ 2023-11-13T11:14:19.339 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 60217 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/block/zram/zram.ko 2023-11-13T11:14:19.340 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/char/ 2023-11-13T11:14:19.340 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 30705 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/char/applicom.ko 2023-11-13T11:14:19.340 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 12009 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/char/hangcheck-timer.ko 2023-11-13T11:14:19.341 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/char/hw_random/ 2023-11-13T11:14:19.341 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 13889 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/char/hw_random/amd-rng.ko 2023-11-13T11:14:19.341 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 18809 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/char/hw_random/intel-rng.ko 2023-11-13T11:14:19.342 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 13169 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/char/hw_random/timeriomem-rng.ko 2023-11-13T11:14:19.342 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 10673 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/char/hw_random/via-rng.ko 2023-11-13T11:14:19.342 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 15633 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/char/hw_random/virtio-rng.ko 2023-11-13T11:14:19.343 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/char/ipmi/ 2023-11-13T11:14:19.343 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 30713 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/char/ipmi/ipmi_devintf.ko 2023-11-13T11:14:19.344 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 148601 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2023-11-13T11:14:19.344 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 26569 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2023-11-13T11:14:19.344 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 139313 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/char/ipmi/ipmi_si.ko 2023-11-13T11:14:19.345 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 70921 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/char/ipmi/ipmi_ssif.ko 2023-11-13T11:14:19.345 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 53513 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2023-11-13T11:14:19.345 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 36321 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/char/lp.ko 2023-11-13T11:14:19.346 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/char/mwave/ 2023-11-13T11:14:19.346 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 84097 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/char/mwave/mwave.ko 2023-11-13T11:14:19.346 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 25873 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/char/nvram.ko 2023-11-13T11:14:19.347 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 32169 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/char/ppdev.ko 2023-11-13T11:14:19.347 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 51113 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/char/tlclk.ko 2023-11-13T11:14:19.347 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/char/tpm/ 2023-11-13T11:14:19.348 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 16401 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/char/tpm/tpm_atmel.ko 2023-11-13T11:14:19.348 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 15881 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/char/tpm/tpm_i2c_atmel.ko 2023-11-13T11:14:19.348 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 23473 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/char/tpm/tpm_i2c_infineon.ko 2023-11-13T11:14:19.349 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 32985 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/char/tpm/tpm_i2c_nuvoton.ko 2023-11-13T11:14:19.349 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 30121 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/char/tpm/tpm_infineon.ko 2023-11-13T11:14:19.350 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 22697 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/char/tpm/tpm_nsc.ko 2023-11-13T11:14:19.350 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 23561 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/char/tpm/xen-tpmfront.ko 2023-11-13T11:14:19.350 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/char/xillybus/ 2023-11-13T11:14:19.351 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 17001 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/char/xillybus/xillybus_class.ko 2023-11-13T11:14:19.351 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 50945 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/char/xillybus/xillybus_core.ko 2023-11-13T11:14:19.351 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 12393 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/char/xillybus/xillybus_pcie.ko 2023-11-13T11:14:19.352 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/clk/ 2023-11-13T11:14:19.352 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 12489 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/clk/clk-palmas.ko 2023-11-13T11:14:19.352 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 47849 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/clk/clk-si5351.ko 2023-11-13T11:14:19.353 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 11457 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/clk/clk-twl6040.ko 2023-11-13T11:14:19.353 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 19313 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/clk/clk-wm831x.ko 2023-11-13T11:14:19.353 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/cpufreq/ 2023-11-13T11:14:19.353 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 10097 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2023-11-13T11:14:19.354 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 16833 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/cpufreq/p4-clockmod.ko 2023-11-13T11:14:19.354 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 25297 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/cpufreq/speedstep-lib.ko 2023-11-13T11:14:19.354 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/crypto/ 2023-11-13T11:14:19.354 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/crypto/ccp/ 2023-11-13T11:14:19.354 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 70801 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/crypto/ccp/ccp-crypto.ko 2023-11-13T11:14:19.355 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 243025 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/crypto/ccp/ccp.ko 2023-11-13T11:14:19.355 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/crypto/intel/ 2023-11-13T11:14:19.355 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/crypto/intel/qat/ 2023-11-13T11:14:19.355 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/crypto/intel/qat/qat_common/ 2023-11-13T11:14:19.355 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 438761 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/crypto/intel/qat/qat_common/intel_qat.ko 2023-11-13T11:14:19.356 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/crypto/intel/qat/qat_dh895xcc/ 2023-11-13T11:14:19.356 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 24081 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/crypto/intel/qat/qat_dh895xcc/qat_dh895xcc.ko 2023-11-13T11:14:19.356 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 19937 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/crypto/padlock-aes.ko 2023-11-13T11:14:19.356 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 21537 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/crypto/padlock-sha.ko 2023-11-13T11:14:19.356 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/crypto/virtio/ 2023-11-13T11:14:19.357 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 68857 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/crypto/virtio/virtio_crypto.ko 2023-11-13T11:14:19.357 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/dca/ 2023-11-13T11:14:19.357 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 29785 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/dca/dca.ko 2023-11-13T11:14:19.357 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/dma/ 2023-11-13T11:14:19.357 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/dma/dw/ 2023-11-13T11:14:19.357 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 15857 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/dma/dw/dw_dmac.ko 2023-11-13T11:14:19.358 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/dma/ioat/ 2023-11-13T11:14:19.358 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 122569 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/dma/ioat/ioatdma.ko 2023-11-13T11:14:19.358 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/edac/ 2023-11-13T11:14:19.358 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 79953 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/edac/amd64_edac.ko 2023-11-13T11:14:19.358 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 35769 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/edac/e752x_edac.ko 2023-11-13T11:14:19.359 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 63617 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/edac/edac_mce_amd.ko 2023-11-13T11:14:19.359 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 18105 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/edac/i3000_edac.ko 2023-11-13T11:14:19.359 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 18065 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/edac/i3200_edac.ko 2023-11-13T11:14:19.359 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 22537 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/edac/i5100_edac.ko 2023-11-13T11:14:19.359 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 25657 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/edac/i5400_edac.ko 2023-11-13T11:14:19.360 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 24913 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/edac/i7300_edac.ko 2023-11-13T11:14:19.360 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 52041 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/edac/i7core_edac.ko 2023-11-13T11:14:19.360 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 18433 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/edac/i82975x_edac.ko 2023-11-13T11:14:19.360 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 20017 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/edac/ie31200_edac.ko 2023-11-13T11:14:19.360 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 56825 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/edac/sb_edac.ko 2023-11-13T11:14:19.360 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 17529 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/edac/x38_edac.ko 2023-11-13T11:14:19.361 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/extcon/ 2023-11-13T11:14:19.361 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 12673 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/extcon/extcon-gpio.ko 2023-11-13T11:14:19.361 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 27185 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/extcon/extcon-max14577.ko 2023-11-13T11:14:19.361 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 29569 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/extcon/extcon-max77693.ko 2023-11-13T11:14:19.361 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 24745 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/extcon/extcon-max8997.ko 2023-11-13T11:14:19.362 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 26537 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/extcon/extcon-palmas.ko 2023-11-13T11:14:19.362 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 23713 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/extcon/extcon-rt8973a.ko 2023-11-13T11:14:19.362 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 27785 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/extcon/extcon-sm5502.ko 2023-11-13T11:14:19.362 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/firmware/ 2023-11-13T11:14:19.362 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 34977 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/firmware/dmi-sysfs.ko 2023-11-13T11:14:19.363 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/firmware/efi/ 2023-11-13T11:14:19.363 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 15521 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/firmware/efi/efi-pstore.ko 2023-11-13T11:14:19.363 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 20729 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/firmware/iscsi_ibft.ko 2023-11-13T11:14:19.363 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/gpio/ 2023-11-13T11:14:19.363 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 12305 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/gpio/gpio-adp5520.ko 2023-11-13T11:14:19.363 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 20153 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/gpio/gpio-amd8111.ko 2023-11-13T11:14:19.364 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 14993 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/gpio/gpio-arizona.ko 2023-11-13T11:14:19.364 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 13841 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/gpio/gpio-da9052.ko 2023-11-13T11:14:19.364 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 11921 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/gpio/gpio-da9055.ko 2023-11-13T11:14:19.364 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 22065 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/gpio/gpio-dln2.ko 2023-11-13T11:14:19.364 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 77849 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/gpio/gpio-f7188x.ko 2023-11-13T11:14:19.365 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 28937 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/gpio/gpio-generic.ko 2023-11-13T11:14:19.365 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 19569 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/gpio/gpio-ich.ko 2023-11-13T11:14:19.365 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 11969 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/gpio/gpio-janz-ttl.ko 2023-11-13T11:14:19.365 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 14113 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/gpio/gpio-kempld.ko 2023-11-13T11:14:19.365 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 12537 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/gpio/gpio-lp3943.ko 2023-11-13T11:14:19.366 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 9505 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/gpio/gpio-max7300.ko 2023-11-13T11:14:19.366 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 11969 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/gpio/gpio-max730x.ko 2023-11-13T11:14:19.366 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 22073 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/gpio/gpio-max732x.ko 2023-11-13T11:14:19.366 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 25145 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/gpio/gpio-ml-ioh.ko 2023-11-13T11:14:19.366 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 47073 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/gpio/gpio-pca953x.ko 2023-11-13T11:14:19.366 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 26825 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/gpio/gpio-pcf857x.ko 2023-11-13T11:14:19.367 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 14377 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/gpio/gpio-rdc321x.ko 2023-11-13T11:14:19.367 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 20593 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/gpio/gpio-sch.ko 2023-11-13T11:14:19.367 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 19505 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/gpio/gpio-sch311x.ko 2023-11-13T11:14:19.367 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 12145 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/gpio/gpio-tps65912.ko 2023-11-13T11:14:19.367 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 21057 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/gpio/gpio-twl4030.ko 2023-11-13T11:14:19.368 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 11425 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/gpio/gpio-twl6040.ko 2023-11-13T11:14:19.368 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 20601 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/gpio/gpio-viperboard.ko 2023-11-13T11:14:19.368 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 15377 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/gpio/gpio-vx855.ko 2023-11-13T11:14:19.368 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 16281 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/gpio/gpio-wm831x.ko 2023-11-13T11:14:19.368 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 11617 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/gpio/gpio-wm8350.ko 2023-11-13T11:14:19.368 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 16753 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/gpio/gpio-wm8994.ko 2023-11-13T11:14:19.369 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hid/ 2023-11-13T11:14:19.369 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 11577 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hid/hid-a4tech.ko 2023-11-13T11:14:19.369 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 39169 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hid/hid-apple.ko 2023-11-13T11:14:19.369 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 14481 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hid/hid-appleir.ko 2023-11-13T11:14:19.369 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 8353 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hid/hid-aureal.ko 2023-11-13T11:14:19.370 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 15169 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hid/hid-axff.ko 2023-11-13T11:14:19.370 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 11049 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hid/hid-belkin.ko 2023-11-13T11:14:19.370 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 10313 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hid/hid-cherry.ko 2023-11-13T11:14:19.370 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 16041 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hid/hid-chicony.ko 2023-11-13T11:14:19.370 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 60649 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hid/hid-cp2112.ko 2023-11-13T11:14:19.371 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 11049 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hid/hid-cypress.ko 2023-11-13T11:14:19.371 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 16385 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hid/hid-dr.ko 2023-11-13T11:14:19.371 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 10697 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hid/hid-elecom.ko 2023-11-13T11:14:19.371 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 17665 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hid/hid-elo.ko 2023-11-13T11:14:19.371 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 13457 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hid/hid-emsff.ko 2023-11-13T11:14:19.371 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 10105 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hid/hid-ezkey.ko 2023-11-13T11:14:19.372 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 14305 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hid/hid-gaff.ko 2023-11-13T11:14:19.372 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 9225 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hid/hid-generic.ko 2023-11-13T11:14:19.372 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 17129 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hid/hid-gt683r.ko 2023-11-13T11:14:19.372 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 12681 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hid/hid-gyration.ko 2023-11-13T11:14:19.372 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 10225 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hid/hid-holtek-kbd.ko 2023-11-13T11:14:19.373 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 10457 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hid/hid-holtek-mouse.ko 2023-11-13T11:14:19.373 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 14449 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hid/hid-holtekff.ko 2023-11-13T11:14:19.373 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 19105 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hid/hid-hyperv.ko 2023-11-13T11:14:19.373 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 10489 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hid/hid-icade.ko 2023-11-13T11:14:19.373 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 9241 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hid/hid-kensington.ko 2023-11-13T11:14:19.373 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 8545 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hid/hid-keytouch.ko 2023-11-13T11:14:19.374 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 17201 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hid/hid-kye.ko 2023-11-13T11:14:19.374 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 10809 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hid/hid-lcpower.ko 2023-11-13T11:14:19.374 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 20497 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hid/hid-led.ko 2023-11-13T11:14:19.374 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 42361 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hid/hid-lenovo.ko 2023-11-13T11:14:19.374 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 30761 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hid/hid-lg-g15.ko 2023-11-13T11:14:19.375 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 58185 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hid/hid-logitech-dj.ko 2023-11-13T11:14:19.375 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 101369 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hid/hid-logitech-hidpp.ko 2023-11-13T11:14:19.375 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 80993 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hid/hid-logitech.ko 2023-11-13T11:14:19.375 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 30801 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hid/hid-magicmouse.ko 2023-11-13T11:14:19.375 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 21969 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hid/hid-microsoft.ko 2023-11-13T11:14:19.376 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 10361 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hid/hid-monterey.ko 2023-11-13T11:14:19.376 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 50161 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hid/hid-multitouch.ko 2023-11-13T11:14:19.376 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 32593 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hid/hid-ntrig.ko 2023-11-13T11:14:19.376 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 8857 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hid/hid-ortek.ko 2023-11-13T11:14:19.376 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 9121 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hid/hid-penmount.ko 2023-11-13T11:14:19.376 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 12289 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hid/hid-petalynx.ko 2023-11-13T11:14:19.377 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 72937 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hid/hid-picolcd.ko 2023-11-13T11:14:19.377 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 14225 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hid/hid-pl.ko 2023-11-13T11:14:19.377 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 15105 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hid/hid-plantronics.ko 2023-11-13T11:14:19.377 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 8417 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hid/hid-primax.ko 2023-11-13T11:14:19.377 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 35457 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hid/hid-rmi.ko 2023-11-13T11:14:19.378 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 20833 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hid/hid-roccat-arvo.ko 2023-11-13T11:14:19.378 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 14065 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hid/hid-roccat-common.ko 2023-11-13T11:14:19.378 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 31425 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hid/hid-roccat-isku.ko 2023-11-13T11:14:19.378 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 29729 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hid/hid-roccat-kone.ko 2023-11-13T11:14:19.378 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 31129 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hid/hid-roccat-koneplus.ko 2023-11-13T11:14:19.379 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 21137 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hid/hid-roccat-konepure.ko 2023-11-13T11:14:19.379 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 29489 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hid/hid-roccat-kovaplus.ko 2023-11-13T11:14:19.379 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 13305 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hid/hid-roccat-lua.ko 2023-11-13T11:14:19.379 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 29313 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hid/hid-roccat-pyra.ko 2023-11-13T11:14:19.379 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 27937 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hid/hid-roccat-ryos.ko 2023-11-13T11:14:19.379 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 19521 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hid/hid-roccat-savu.ko 2023-11-13T11:14:19.380 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 23337 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hid/hid-roccat.ko 2023-11-13T11:14:19.380 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 13681 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hid/hid-saitek.ko 2023-11-13T11:14:19.380 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 15193 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hid/hid-samsung.ko 2023-11-13T11:14:19.380 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 36817 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hid/hid-sensor-hub.ko 2023-11-13T11:14:19.380 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 13601 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hid/hid-sjoy.ko 2023-11-13T11:14:19.381 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 51249 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hid/hid-sony.ko 2023-11-13T11:14:19.381 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 8313 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hid/hid-speedlink.ko 2023-11-13T11:14:19.381 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 25297 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hid/hid-steelseries.ko 2023-11-13T11:14:19.381 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 9817 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hid/hid-sunplus.ko 2023-11-13T11:14:19.381 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 16993 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hid/hid-thrustmaster.ko 2023-11-13T11:14:19.381 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 10537 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hid/hid-tivo.ko 2023-11-13T11:14:19.382 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 15089 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hid/hid-tmff.ko 2023-11-13T11:14:19.382 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 14385 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hid/hid-topseed.ko 2023-11-13T11:14:19.382 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 16473 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hid/hid-twinhan.ko 2023-11-13T11:14:19.382 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 71073 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hid/hid-uclogic.ko 2023-11-13T11:14:19.382 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 10921 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hid/hid-waltop.ko 2023-11-13T11:14:19.383 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 143473 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hid/hid-wiimote.ko 2023-11-13T11:14:19.383 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 8153 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hid/hid-xinmo.ko 2023-11-13T11:14:19.383 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 13321 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hid/hid-zpff.ko 2023-11-13T11:14:19.383 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 16665 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hid/hid-zydacron.ko 2023-11-13T11:14:19.383 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 267825 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hid/hid.ko 2023-11-13T11:14:19.384 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 32321 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hid/uhid.ko 2023-11-13T11:14:19.384 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hid/usbhid/ 2023-11-13T11:14:19.384 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 125721 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hid/usbhid/usbhid.ko 2023-11-13T11:14:19.384 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 19137 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hid/usbhid/usbkbd.ko 2023-11-13T11:14:19.384 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 14953 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hid/usbhid/usbmouse.ko 2023-11-13T11:14:19.384 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 217873 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hid/wacom.ko 2023-11-13T11:14:19.385 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hv/ 2023-11-13T11:14:19.385 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 64201 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hv/hv_balloon.ko 2023-11-13T11:14:19.385 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 89625 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hv/hv_utils.ko 2023-11-13T11:14:19.385 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 305465 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hv/hv_vmbus.ko 2023-11-13T11:14:19.385 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/ 2023-11-13T11:14:19.386 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 66521 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/abituguru.ko 2023-11-13T11:14:19.386 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 61393 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/abituguru3.ko 2023-11-13T11:14:19.386 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 34745 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/acpi_power_meter.ko 2023-11-13T11:14:19.386 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 17505 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/ad7414.ko 2023-11-13T11:14:19.386 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 19313 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/ad7418.ko 2023-11-13T11:14:19.386 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 25257 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/adc128d818.ko 2023-11-13T11:14:19.387 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 31729 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/adm1025.ko 2023-11-13T11:14:19.387 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 97977 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/adm1026.ko 2023-11-13T11:14:19.387 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 19745 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/adm1029.ko 2023-11-13T11:14:19.387 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 45553 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/adm1031.ko 2023-11-13T11:14:19.387 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 26289 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/adm9240.ko 2023-11-13T11:14:19.388 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 14769 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/ads7828.ko 2023-11-13T11:14:19.388 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 10769 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/adt7410.ko 2023-11-13T11:14:19.388 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 22049 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/adt7411.ko 2023-11-13T11:14:19.388 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 74433 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/adt7462.ko 2023-11-13T11:14:19.388 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 39585 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/adt7470.ko 2023-11-13T11:14:19.388 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 67929 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/adt7475.ko 2023-11-13T11:14:19.389 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 19625 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/adt7x10.ko 2023-11-13T11:14:19.389 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 39073 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/amc6821.ko 2023-11-13T11:14:19.389 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 55265 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/applesmc.ko 2023-11-13T11:14:19.389 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 49913 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/asb100.ko 2023-11-13T11:14:19.389 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 58617 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/asc7621.ko 2023-11-13T11:14:19.390 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 40889 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/asus_atk0110.ko 2023-11-13T11:14:19.390 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 17225 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/atxp1.ko 2023-11-13T11:14:19.390 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 28281 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/coretemp.ko 2023-11-13T11:14:19.390 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 24657 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/da9052-hwmon.ko 2023-11-13T11:14:19.390 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 17265 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/da9055-hwmon.ko 2023-11-13T11:14:19.391 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 44465 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/dell-smm-hwmon.ko 2023-11-13T11:14:19.391 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 99601 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/dme1737.ko 2023-11-13T11:14:19.391 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 19489 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/ds1621.ko 2023-11-13T11:14:19.391 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 15321 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/ds620.ko 2023-11-13T11:14:19.391 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 29777 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/emc1403.ko 2023-11-13T11:14:19.391 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 33185 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/emc2103.ko 2023-11-13T11:14:19.392 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 30321 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/emc6w201.ko 2023-11-13T11:14:19.392 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 66985 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/f71805f.ko 2023-11-13T11:14:19.392 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 94457 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/f71882fg.ko 2023-11-13T11:14:19.392 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 41401 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/f75375s.ko 2023-11-13T11:14:19.392 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 21305 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/fam15h_power.ko 2023-11-13T11:14:19.393 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 55449 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/fschmd.ko 2023-11-13T11:14:19.393 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 14481 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/g760a.ko 2023-11-13T11:14:19.393 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 24017 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/g762.ko 2023-11-13T11:14:19.393 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 46801 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/gl518sm.ko 2023-11-13T11:14:19.393 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 45529 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/gl520sm.ko 2023-11-13T11:14:19.393 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 13273 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/hih6130.ko 2023-11-13T11:14:19.394 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 9745 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/hwmon-vid.ko 2023-11-13T11:14:19.394 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 11553 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/i5500_temp.ko 2023-11-13T11:14:19.394 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 22601 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/i5k_amb.ko 2023-11-13T11:14:19.394 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 34529 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/ibmaem.ko 2023-11-13T11:14:19.394 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 21321 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/ibmpex.ko 2023-11-13T11:14:19.395 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 24873 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/ina209.ko 2023-11-13T11:14:19.395 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 13401 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/ina2xx.ko 2023-11-13T11:14:19.395 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 130449 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/it87.ko 2023-11-13T11:14:19.395 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 18841 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/jc42.ko 2023-11-13T11:14:19.395 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 24329 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/k10temp.ko 2023-11-13T11:14:19.396 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 13553 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/k8temp.ko 2023-11-13T11:14:19.396 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 18929 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/lineage-pem.ko 2023-11-13T11:14:19.396 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 48601 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/lm63.ko 2023-11-13T11:14:19.396 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 16761 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/lm73.ko 2023-11-13T11:14:19.396 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 36777 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/lm75.ko 2023-11-13T11:14:19.396 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 19537 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/lm77.ko 2023-11-13T11:14:19.397 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 34657 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/lm78.ko 2023-11-13T11:14:19.397 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 31745 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/lm80.ko 2023-11-13T11:14:19.397 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 16889 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/lm83.ko 2023-11-13T11:14:19.397 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 72833 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/lm85.ko 2023-11-13T11:14:19.397 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 46153 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/lm87.ko 2023-11-13T11:14:19.398 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 37913 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/lm90.ko 2023-11-13T11:14:19.398 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 19745 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/lm92.ko 2023-11-13T11:14:19.398 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 108841 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/lm93.ko 2023-11-13T11:14:19.398 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 33393 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/lm95234.ko 2023-11-13T11:14:19.398 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 16265 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/lm95241.ko 2023-11-13T11:14:19.399 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 18113 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/lm95245.ko 2023-11-13T11:14:19.399 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 24017 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/ltc2945.ko 2023-11-13T11:14:19.399 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 13793 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/ltc4151.ko 2023-11-13T11:14:19.399 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 15193 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/ltc4215.ko 2023-11-13T11:14:19.399 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 14953 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/ltc4222.ko 2023-11-13T11:14:19.399 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 14825 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/ltc4245.ko 2023-11-13T11:14:19.400 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 13249 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/ltc4260.ko 2023-11-13T11:14:19.400 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 14993 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/ltc4261.ko 2023-11-13T11:14:19.400 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 33489 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/max16065.ko 2023-11-13T11:14:19.400 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 18433 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/max1619.ko 2023-11-13T11:14:19.400 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 24353 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/max1668.ko 2023-11-13T11:14:19.401 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 19969 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/max197.ko 2023-11-13T11:14:19.401 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 27129 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/max6639.ko 2023-11-13T11:14:19.401 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 23321 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/max6650.ko 2023-11-13T11:14:19.401 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 35777 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/max6697.ko 2023-11-13T11:14:19.401 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 18585 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/mc13783-adc.ko 2023-11-13T11:14:19.401 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 10585 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/mcp3021.ko 2023-11-13T11:14:19.402 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 15937 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/menf21bmc_hwmon.ko 2023-11-13T11:14:19.402 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 44129 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/nct6683.ko 2023-11-13T11:14:19.402 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 119817 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/nct6775-core.ko 2023-11-13T11:14:19.402 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 60705 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/nct6775.ko 2023-11-13T11:14:19.402 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 59737 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/nct7802.ko 2023-11-13T11:14:19.403 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 82337 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/pc87360.ko 2023-11-13T11:14:19.403 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 54433 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/pc87427.ko 2023-11-13T11:14:19.403 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 18473 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/pcf8591.ko 2023-11-13T11:14:19.403 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/pmbus/ 2023-11-13T11:14:19.403 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 21353 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/pmbus/adm1275.ko 2023-11-13T11:14:19.404 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 17065 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/pmbus/lm25066.ko 2023-11-13T11:14:19.404 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 28329 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/pmbus/ltc2978.ko 2023-11-13T11:14:19.404 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 9577 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/pmbus/max16064.ko 2023-11-13T11:14:19.404 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 17657 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/pmbus/max34440.ko 2023-11-13T11:14:19.404 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 10169 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/pmbus/max8688.ko 2023-11-13T11:14:19.404 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 15505 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/pmbus/pmbus.ko 2023-11-13T11:14:19.405 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 82577 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2023-11-13T11:14:19.405 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 8729 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/pmbus/tps40422.ko 2023-11-13T11:14:19.405 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 30729 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/pmbus/ucd9000.ko 2023-11-13T11:14:19.405 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 15073 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/pmbus/ucd9200.ko 2023-11-13T11:14:19.405 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 20681 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/pmbus/zl6100.ko 2023-11-13T11:14:19.406 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 13017 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/powr1220.ko 2023-11-13T11:14:19.406 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 18705 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/sch5627.ko 2023-11-13T11:14:19.406 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 28817 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/sch5636.ko 2023-11-13T11:14:19.406 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 27145 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/sch56xx-common.ko 2023-11-13T11:14:19.406 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 32137 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/sht15.ko 2023-11-13T11:14:19.406 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 13505 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/sht21.ko 2023-11-13T11:14:19.407 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 16833 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/shtc1.ko 2023-11-13T11:14:19.407 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 40105 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/sis5595.ko 2023-11-13T11:14:19.407 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 19577 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/smsc47b397.ko 2023-11-13T11:14:19.407 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 39193 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/smsc47m1.ko 2023-11-13T11:14:19.407 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 37385 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/smsc47m192.ko 2023-11-13T11:14:19.408 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 26553 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/thmc50.ko 2023-11-13T11:14:19.408 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 17057 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/tmp102.ko 2023-11-13T11:14:19.408 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 14097 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/tmp103.ko 2023-11-13T11:14:19.408 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 21257 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/tmp401.ko 2023-11-13T11:14:19.408 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 19537 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/tmp421.ko 2023-11-13T11:14:19.409 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 19721 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/via-cputemp.ko 2023-11-13T11:14:19.409 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 41945 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/via686a.ko 2023-11-13T11:14:19.409 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 52457 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/vt1211.ko 2023-11-13T11:14:19.409 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 51545 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/vt8231.ko 2023-11-13T11:14:19.409 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 57513 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/w83627ehf.ko 2023-11-13T11:14:19.409 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 78873 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/w83627hf.ko 2023-11-13T11:14:19.410 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 71345 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/w83781d.ko 2023-11-13T11:14:19.410 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 63289 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/w83791d.ko 2023-11-13T11:14:19.410 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 71321 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/w83792d.ko 2023-11-13T11:14:19.410 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 101473 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/w83793.ko 2023-11-13T11:14:19.410 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 119505 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/w83795.ko 2023-11-13T11:14:19.411 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 17313 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/w83l785ts.ko 2023-11-13T11:14:19.411 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 35625 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/w83l786ng.ko 2023-11-13T11:14:19.411 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 13825 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/wm831x-hwmon.ko 2023-11-13T11:14:19.411 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 10625 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/wm8350-hwmon.ko 2023-11-13T11:14:19.411 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/i2c/ 2023-11-13T11:14:19.411 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/i2c/algos/ 2023-11-13T11:14:19.412 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 20049 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2023-11-13T11:14:19.412 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 19345 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2023-11-13T11:14:19.412 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/i2c/busses/ 2023-11-13T11:14:19.412 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 27969 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/i2c/busses/i2c-ali1535.ko 2023-11-13T11:14:19.412 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 28801 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/i2c/busses/i2c-ali1563.ko 2023-11-13T11:14:19.413 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 27777 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/i2c/busses/i2c-ali15x3.ko 2023-11-13T11:14:19.413 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 17937 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2023-11-13T11:14:19.413 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 26193 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/i2c/busses/i2c-amd756.ko 2023-11-13T11:14:19.413 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 16201 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/i2c/busses/i2c-amd8111.ko 2023-11-13T11:14:19.413 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 15153 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/i2c/busses/i2c-cbus-gpio.ko 2023-11-13T11:14:19.413 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 6929 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2023-11-13T11:14:19.414 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 13961 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/i2c/busses/i2c-cros-ec-tunnel.ko 2023-11-13T11:14:19.414 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 50201 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/i2c/busses/i2c-designware-core.ko 2023-11-13T11:14:19.414 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 23905 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2023-11-13T11:14:19.414 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 20001 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2023-11-13T11:14:19.414 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 17337 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2023-11-13T11:14:19.415 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 12497 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/i2c/busses/i2c-dln2.ko 2023-11-13T11:14:19.415 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 17585 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/i2c/busses/i2c-gpio.ko 2023-11-13T11:14:19.415 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 62817 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/i2c/busses/i2c-i801.ko 2023-11-13T11:14:19.415 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 22433 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/i2c/busses/i2c-isch.ko 2023-11-13T11:14:19.415 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 47889 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/i2c/busses/i2c-ismt.ko 2023-11-13T11:14:19.416 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 17721 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/i2c/busses/i2c-kempld.ko 2023-11-13T11:14:19.416 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 17881 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2023-11-13T11:14:19.416 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 22337 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/i2c/busses/i2c-nforce2.ko 2023-11-13T11:14:19.416 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 26329 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/i2c/busses/i2c-ocores.ko 2023-11-13T11:14:19.416 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 25145 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/i2c/busses/i2c-parport.ko 2023-11-13T11:14:19.416 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 16497 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2023-11-13T11:14:19.417 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 47241 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/i2c/busses/i2c-piix4.ko 2023-11-13T11:14:19.417 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 15289 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/i2c/busses/i2c-robotfuzz-osif.ko 2023-11-13T11:14:19.417 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 18649 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/i2c/busses/i2c-scmi.ko 2023-11-13T11:14:19.417 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 11809 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/i2c/busses/i2c-simtec.ko 2023-11-13T11:14:19.417 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 22313 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/i2c/busses/i2c-sis5595.ko 2023-11-13T11:14:19.418 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 29361 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/i2c/busses/i2c-sis630.ko 2023-11-13T11:14:19.418 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 20329 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/i2c/busses/i2c-sis96x.ko 2023-11-13T11:14:19.418 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 19241 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/i2c/busses/i2c-taos-evm.ko 2023-11-13T11:14:19.418 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 19809 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2023-11-13T11:14:19.418 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 13801 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/i2c/busses/i2c-via.ko 2023-11-13T11:14:19.419 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 26081 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/i2c/busses/i2c-viapro.ko 2023-11-13T11:14:19.419 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 19041 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/i2c/busses/i2c-viperboard.ko 2023-11-13T11:14:19.419 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 47657 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/i2c/busses/i2c-xiic.ko 2023-11-13T11:14:19.419 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 22449 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/i2c/i2c-mux.ko 2023-11-13T11:14:19.419 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 18825 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/i2c/i2c-smbus.ko 2023-11-13T11:14:19.419 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 27073 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/i2c/i2c-stub.ko 2023-11-13T11:14:19.420 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/i2c/muxes/ 2023-11-13T11:14:19.420 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 14921 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/i2c/muxes/i2c-mux-gpio.ko 2023-11-13T11:14:19.420 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 13457 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/i2c/muxes/i2c-mux-pca9541.ko 2023-11-13T11:14:19.420 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 29801 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/i2c/muxes/i2c-mux-pca954x.ko 2023-11-13T11:14:19.420 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/infiniband/ 2023-11-13T11:14:19.421 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/infiniband/core/ 2023-11-13T11:14:19.421 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 273609 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/infiniband/core/ib_cm.ko 2023-11-13T11:14:19.421 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 879969 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/infiniband/core/ib_core.ko 2023-11-13T11:14:19.421 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 69337 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/infiniband/core/ib_umad.ko 2023-11-13T11:14:19.421 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 324217 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/infiniband/core/ib_uverbs.ko 2023-11-13T11:14:19.422 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 97985 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/infiniband/core/iw_cm.ko 2023-11-13T11:14:19.422 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 282273 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/infiniband/core/rdma_cm.ko 2023-11-13T11:14:19.422 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 66201 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/infiniband/core/rdma_ucm.ko 2023-11-13T11:14:19.422 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/infiniband/hw/ 2023-11-13T11:14:19.422 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/infiniband/hw/cxgb4/ 2023-11-13T11:14:19.423 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 493073 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2023-11-13T11:14:19.423 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/infiniband/hw/mlx4/ 2023-11-13T11:14:19.423 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 419737 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2023-11-13T11:14:19.423 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/infiniband/hw/mlx5/ 2023-11-13T11:14:19.423 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 739025 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2023-11-13T11:14:19.423 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/infiniband/hw/mthca/ 2023-11-13T11:14:19.424 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 296625 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2023-11-13T11:14:19.424 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/infiniband/hw/ocrdma/ 2023-11-13T11:14:19.424 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 153697 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/infiniband/hw/ocrdma/ocrdma.ko 2023-11-13T11:14:19.424 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/infiniband/hw/usnic/ 2023-11-13T11:14:19.424 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 168969 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/infiniband/hw/usnic/usnic_verbs.ko 2023-11-13T11:14:19.425 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/infiniband/ulp/ 2023-11-13T11:14:19.425 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/infiniband/ulp/ipoib/ 2023-11-13T11:14:19.425 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 263081 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2023-11-13T11:14:19.425 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/infiniband/ulp/iser/ 2023-11-13T11:14:19.425 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 100241 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2023-11-13T11:14:19.425 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/infiniband/ulp/isert/ 2023-11-13T11:14:19.426 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 111425 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2023-11-13T11:14:19.426 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/infiniband/ulp/srp/ 2023-11-13T11:14:19.426 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 128753 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2023-11-13T11:14:19.426 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/infiniband/ulp/srpt/ 2023-11-13T11:14:19.426 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 129529 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2023-11-13T11:14:19.427 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/input/ 2023-11-13T11:14:19.427 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 10745 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/input/evbug.ko 2023-11-13T11:14:19.427 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 24129 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/input/ff-memless.ko 2023-11-13T11:14:19.427 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/input/gameport/ 2023-11-13T11:14:19.427 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 11881 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/input/gameport/emu10k1-gp.ko 2023-11-13T11:14:19.428 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 12145 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/input/gameport/fm801-gp.ko 2023-11-13T11:14:19.428 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 41241 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/input/gameport/gameport.ko 2023-11-13T11:14:19.428 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 41801 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/input/joydev.ko 2023-11-13T11:14:19.428 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/input/keyboard/ 2023-11-13T11:14:19.428 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 13313 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/input/keyboard/adp5520-keys.ko 2023-11-13T11:14:19.428 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 12801 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/input/keyboard/adp5588-keys.ko 2023-11-13T11:14:19.429 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 26905 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/input/keyboard/adp5589-keys.ko 2023-11-13T11:14:19.429 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 24761 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/input/keyboard/cros_ec_keyb.ko 2023-11-13T11:14:19.429 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 36665 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/input/keyboard/gpio_keys.ko 2023-11-13T11:14:19.429 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 18625 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/input/keyboard/gpio_keys_polled.ko 2023-11-13T11:14:19.429 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 21257 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/input/keyboard/lkkbd.ko 2023-11-13T11:14:19.430 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 26473 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/input/keyboard/lm8323.ko 2023-11-13T11:14:19.430 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 14409 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/input/keyboard/lm8333.ko 2023-11-13T11:14:19.430 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 24265 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/input/keyboard/matrix_keypad.ko 2023-11-13T11:14:19.430 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 18217 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/input/keyboard/max7359_keypad.ko 2023-11-13T11:14:19.430 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 15929 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/input/keyboard/mcs_touchkey.ko 2023-11-13T11:14:19.431 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 16489 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/input/keyboard/mpr121_touchkey.ko 2023-11-13T11:14:19.431 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 11585 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/input/keyboard/newtonkbd.ko 2023-11-13T11:14:19.431 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 10673 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/input/keyboard/opencores-kbd.ko 2023-11-13T11:14:19.431 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 14161 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/input/keyboard/qt1070.ko 2023-11-13T11:14:19.431 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 17929 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/input/keyboard/qt2160.ko 2023-11-13T11:14:19.431 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 23817 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/input/keyboard/samsung-keypad.ko 2023-11-13T11:14:19.432 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 11481 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/input/keyboard/stowaway.ko 2023-11-13T11:14:19.432 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 18289 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/input/keyboard/sunkbd.ko 2023-11-13T11:14:19.432 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 17489 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/input/keyboard/tca6416-keypad.ko 2023-11-13T11:14:19.432 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 16177 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/input/keyboard/tca8418_keypad.ko 2023-11-13T11:14:19.432 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 16801 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/input/keyboard/twl4030_keypad.ko 2023-11-13T11:14:19.433 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 11753 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/input/keyboard/xtkbd.ko 2023-11-13T11:14:19.433 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 11465 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/input/matrix-keymap.ko 2023-11-13T11:14:19.433 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/input/mouse/ 2023-11-13T11:14:19.433 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 34329 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/input/mouse/appletouch.ko 2023-11-13T11:14:19.433 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 34177 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/input/mouse/bcm5974.ko 2023-11-13T11:14:19.433 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 123681 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/input/mouse/cyapatp.ko 2023-11-13T11:14:19.434 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 89449 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/input/mouse/elan_i2c.ko 2023-11-13T11:14:19.434 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 14025 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/input/mouse/gpio_mouse.ko 2023-11-13T11:14:19.434 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 335977 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/input/mouse/psmouse.ko 2023-11-13T11:14:19.434 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 14681 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/input/mouse/sermouse.ko 2023-11-13T11:14:19.434 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 23881 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/input/mouse/synaptics_i2c.ko 2023-11-13T11:14:19.435 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 22569 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/input/mouse/synaptics_usb.ko 2023-11-13T11:14:19.435 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 15665 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/input/mouse/vsxxxaa.ko 2023-11-13T11:14:19.435 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/input/rmi4/ 2023-11-13T11:14:19.435 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 109873 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/input/rmi4/rmi_core.ko 2023-11-13T11:14:19.435 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/input/serio/ 2023-11-13T11:14:19.436 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 11665 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/input/serio/altera_ps2.ko 2023-11-13T11:14:19.436 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 16289 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/input/serio/arc_ps2.ko 2023-11-13T11:14:19.436 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 16425 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/input/serio/ct82c710.ko 2023-11-13T11:14:19.436 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 16953 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/input/serio/hyperv-keyboard.ko 2023-11-13T11:14:19.436 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 15833 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/input/serio/parkbd.ko 2023-11-13T11:14:19.436 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 13225 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/input/serio/pcips2.ko 2023-11-13T11:14:19.437 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 20153 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/input/serio/ps2mult.ko 2023-11-13T11:14:19.437 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 24153 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/input/serio/serio_raw.ko 2023-11-13T11:14:19.437 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 17977 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/input/serio/serport.ko 2023-11-13T11:14:19.437 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 13337 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/input/sparse-keymap.ko 2023-11-13T11:14:19.437 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/iommu/ 2023-11-13T11:14:19.438 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/iommu/amd/ 2023-11-13T11:14:19.438 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 39289 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/iommu/amd/iommu_v2.ko 2023-11-13T11:14:19.438 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/leds/ 2023-11-13T11:14:19.438 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 13817 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/leds/leds-88pm860x.ko 2023-11-13T11:14:19.438 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 11385 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/leds/leds-adp5520.ko 2023-11-13T11:14:19.439 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 59753 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/leds/leds-bd2802.ko 2023-11-13T11:14:19.439 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 24785 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/leds/leds-blinkm.ko 2023-11-13T11:14:19.439 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 10473 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/leds/leds-da903x.ko 2023-11-13T11:14:19.439 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 12241 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/leds/leds-da9052.ko 2023-11-13T11:14:19.439 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 16561 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/leds/leds-gpio.ko 2023-11-13T11:14:19.439 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 15793 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/leds/leds-lm3530.ko 2023-11-13T11:14:19.440 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 30505 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/leds/leds-lm3533.ko 2023-11-13T11:14:19.440 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 19353 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/leds/leds-lm355x.ko 2023-11-13T11:14:19.440 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 19961 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/leds/leds-lm3642.ko 2023-11-13T11:14:19.440 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 16241 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/leds/leds-lp3944.ko 2023-11-13T11:14:19.441 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 11233 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/leds/leds-lp8788.ko 2023-11-13T11:14:19.441 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 14929 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/leds/leds-max8997.ko 2023-11-13T11:14:19.441 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 12609 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/leds/leds-mc13783.ko 2023-11-13T11:14:19.441 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 13385 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/leds/leds-menf21bmc.ko 2023-11-13T11:14:19.442 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 20721 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/leds/leds-pca9532.ko 2023-11-13T11:14:19.442 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 20481 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/leds/leds-pca955x.ko 2023-11-13T11:14:19.442 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 17857 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/leds/leds-pca963x.ko 2023-11-13T11:14:19.442 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 34433 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/leds/leds-ss4200.ko 2023-11-13T11:14:19.442 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 24865 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/leds/leds-tca6507.ko 2023-11-13T11:14:19.443 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 15665 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/leds/leds-wm831x-status.ko 2023-11-13T11:14:19.443 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 11841 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/leds/leds-wm8350.ko 2023-11-13T11:14:19.443 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/leds/trigger/ 2023-11-13T11:14:19.443 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 10049 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/leds/trigger/ledtrig-audio.ko 2023-11-13T11:14:19.444 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 10873 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2023-11-13T11:14:19.444 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 9089 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/leds/trigger/ledtrig-camera.ko 2023-11-13T11:14:19.444 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 7617 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2023-11-13T11:14:19.444 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 14249 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2023-11-13T11:14:19.445 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 14073 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2023-11-13T11:14:19.445 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 11889 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/leds/trigger/ledtrig-timer.ko 2023-11-13T11:14:19.445 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 14073 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/leds/trigger/ledtrig-transient.ko 2023-11-13T11:14:19.445 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/md/ 2023-11-13T11:14:19.446 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/md/bcache/ 2023-11-13T11:14:19.446 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 654969 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/md/bcache/bcache.ko 2023-11-13T11:14:19.446 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 40577 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/md/dm-bio-prison.ko 2023-11-13T11:14:19.446 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 89601 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/md/dm-bufio.ko 2023-11-13T11:14:19.447 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 47529 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/md/dm-cache-smq.ko 2023-11-13T11:14:19.447 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 156009 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/md/dm-cache.ko 2023-11-13T11:14:19.447 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 106897 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/md/dm-crypt.ko 2023-11-13T11:14:19.447 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 21545 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/md/dm-delay.ko 2023-11-13T11:14:19.448 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 53857 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/md/dm-era.ko 2023-11-13T11:14:19.448 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 28465 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/md/dm-flakey.ko 2023-11-13T11:14:19.448 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 41593 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/md/dm-log-userspace.ko 2023-11-13T11:14:19.448 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 32737 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/md/dm-log.ko 2023-11-13T11:14:19.449 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 49545 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/md/dm-mirror.ko 2023-11-13T11:14:19.449 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 78033 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/md/dm-multipath.ko 2023-11-13T11:14:19.449 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 16473 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/md/dm-queue-length.ko 2023-11-13T11:14:19.449 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 70825 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/md/dm-raid.ko 2023-11-13T11:14:19.450 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 36297 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/md/dm-region-hash.ko 2023-11-13T11:14:19.450 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 15873 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/md/dm-round-robin.ko 2023-11-13T11:14:19.450 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 16801 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/md/dm-service-time.ko 2023-11-13T11:14:19.450 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 109593 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/md/dm-snapshot.ko 2023-11-13T11:14:19.450 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 19361 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/md/dm-switch.ko 2023-11-13T11:14:19.451 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 181865 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/md/dm-thin-pool.ko 2023-11-13T11:14:19.451 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 51737 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/md/dm-verity.ko 2023-11-13T11:14:19.451 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 8561 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/md/dm-zero.ko 2023-11-13T11:14:19.451 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 15345 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/md/faulty.ko 2023-11-13T11:14:19.452 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 19625 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/md/linear.ko 2023-11-13T11:14:19.452 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 32417 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/md/multipath.ko 2023-11-13T11:14:19.452 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/md/persistent-data/ 2023-11-13T11:14:19.452 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 199937 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2023-11-13T11:14:19.453 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 37337 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/md/raid0.ko 2023-11-13T11:14:19.453 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 113073 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/md/raid1.ko 2023-11-13T11:14:19.453 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 158681 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/md/raid10.ko 2023-11-13T11:14:19.453 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 395721 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/md/raid456.ko 2023-11-13T11:14:19.454 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/message/ 2023-11-13T11:14:19.454 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/message/fusion/ 2023-11-13T11:14:19.454 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 178137 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/message/fusion/mptbase.ko 2023-11-13T11:14:19.454 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 63385 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/message/fusion/mptctl.ko 2023-11-13T11:14:19.455 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 44665 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/message/fusion/mptfc.ko 2023-11-13T11:14:19.455 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 37225 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/message/fusion/mptlan.ko 2023-11-13T11:14:19.455 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 123321 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/message/fusion/mptsas.ko 2023-11-13T11:14:19.455 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 79041 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/message/fusion/mptscsih.ko 2023-11-13T11:14:19.456 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 53081 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/message/fusion/mptspi.ko 2023-11-13T11:14:19.456 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/mfd/ 2023-11-13T11:14:19.456 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 17305 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/mfd/88pm800.ko 2023-11-13T11:14:19.456 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 12761 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/mfd/88pm805.ko 2023-11-13T11:14:19.457 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 11193 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/mfd/88pm80x.ko 2023-11-13T11:14:19.457 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 11865 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/mfd/arizona-i2c.ko 2023-11-13T11:14:19.457 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 123721 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/mfd/arizona.ko 2023-11-13T11:14:19.457 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 11961 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/mfd/bcm590xx.ko 2023-11-13T11:14:19.457 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 17465 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/mfd/cros_ec_dev.ko 2023-11-13T11:14:19.458 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 34961 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/mfd/dln2.ko 2023-11-13T11:14:19.458 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 16689 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/mfd/janz-cmodio.ko 2023-11-13T11:14:19.458 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 53585 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/mfd/kempld-core.ko 2023-11-13T11:14:19.458 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 27529 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/mfd/lm3533-core.ko 2023-11-13T11:14:19.459 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 14993 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/mfd/lm3533-ctrlbank.ko 2023-11-13T11:14:19.459 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 13009 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/mfd/lp3943.ko 2023-11-13T11:14:19.459 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 54569 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/mfd/lpc_ich.ko 2023-11-13T11:14:19.459 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 12113 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/mfd/lpc_sch.ko 2023-11-13T11:14:19.460 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 17409 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/mfd/max8907.ko 2023-11-13T11:14:19.460 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 29857 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/mfd/mc13xxx-core.ko 2023-11-13T11:14:19.460 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 11801 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/mfd/mc13xxx-i2c.ko 2023-11-13T11:14:19.460 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 11593 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/mfd/menf21bmc.ko 2023-11-13T11:14:19.460 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 17329 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/mfd/pcf50633-adc.ko 2023-11-13T11:14:19.461 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 9153 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/mfd/pcf50633-gpio.ko 2023-11-13T11:14:19.461 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 34873 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/mfd/pcf50633.ko 2023-11-13T11:14:19.461 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 10105 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/mfd/rdc321x-southbridge.ko 2023-11-13T11:14:19.461 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 20289 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/mfd/retu-mfd.ko 2023-11-13T11:14:19.462 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 80425 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/mfd/si476x-core.ko 2023-11-13T11:14:19.462 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 48457 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/mfd/sm501.ko 2023-11-13T11:14:19.462 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 19825 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/mfd/ti_am335x_tscadc.ko 2023-11-13T11:14:19.462 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 51137 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/mfd/tps65010.ko 2023-11-13T11:14:19.463 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 10417 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/mfd/tps6507x.ko 2023-11-13T11:14:19.463 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 13329 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/mfd/viperboard.ko 2023-11-13T11:14:19.463 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 10537 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/mfd/vx855.ko 2023-11-13T11:14:19.463 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 17953 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/mfd/wl1273-core.ko 2023-11-13T11:14:19.465 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 44345 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/mfd/wm8994.ko 2023-11-13T11:14:19.466 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/misc/ 2023-11-13T11:14:19.466 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 13833 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/misc/ad525x_dpot-i2c.ko 2023-11-13T11:14:19.466 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 48489 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/misc/ad525x_dpot.ko 2023-11-13T11:14:19.466 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/misc/altera-stapl/ 2023-11-13T11:14:19.467 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 46585 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2023-11-13T11:14:19.467 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 18393 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/misc/apds9802als.ko 2023-11-13T11:14:19.467 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 36729 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/misc/apds990x.ko 2023-11-13T11:14:19.467 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 45593 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/misc/bh1770glc.ko 2023-11-13T11:14:19.468 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/misc/c2port/ 2023-11-13T11:14:19.468 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 11145 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/misc/c2port/c2port-duramar2150.ko 2023-11-13T11:14:19.468 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 35281 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/misc/c2port/core.ko 2023-11-13T11:14:19.468 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/misc/cb710/ 2023-11-13T11:14:19.469 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 25161 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/misc/cb710/cb710.ko 2023-11-13T11:14:19.469 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 17801 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/misc/ds1682.ko 2023-11-13T11:14:19.469 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 8897 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/misc/dummy-irq.ko 2023-11-13T11:14:19.469 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/misc/echo/ 2023-11-13T11:14:19.470 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 13657 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/misc/echo/echo.ko 2023-11-13T11:14:19.470 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/misc/eeprom/ 2023-11-13T11:14:19.470 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 37849 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/misc/eeprom/at24.ko 2023-11-13T11:14:19.470 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 14321 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/misc/eeprom/eeprom.ko 2023-11-13T11:14:19.471 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 14769 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2023-11-13T11:14:19.471 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 13537 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/misc/eeprom/max6875.ko 2023-11-13T11:14:19.471 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 33009 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/misc/enclosure.ko 2023-11-13T11:14:19.471 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/misc/genwqe/ 2023-11-13T11:14:19.471 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 152201 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/misc/genwqe/genwqe_card.ko 2023-11-13T11:14:19.472 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 14129 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/misc/hmc6352.ko 2023-11-13T11:14:19.472 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 31321 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/misc/hpilo.ko 2023-11-13T11:14:19.472 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/misc/ibmasm/ 2023-11-13T11:14:19.472 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 72129 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/misc/ibmasm/ibmasm.ko 2023-11-13T11:14:19.473 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 19785 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/misc/ics932s401.ko 2023-11-13T11:14:19.473 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 21681 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/misc/isl29003.ko 2023-11-13T11:14:19.473 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 15753 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/misc/isl29020.ko 2023-11-13T11:14:19.473 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/misc/lis3lv02d/ 2023-11-13T11:14:19.473 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 42513 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2023-11-13T11:14:19.474 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 13857 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2023-11-13T11:14:19.474 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/misc/mei/ 2023-11-13T11:14:19.474 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 125209 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/misc/mei/mei-me.ko 2023-11-13T11:14:19.474 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 56521 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/misc/mei/mei-txe.ko 2023-11-13T11:14:19.475 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 310113 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/misc/mei/mei.ko 2023-11-13T11:14:19.475 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 31329 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/misc/phantom.ko 2023-11-13T11:14:19.475 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/misc/ti-st/ 2023-11-13T11:14:19.475 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 74265 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/misc/ti-st/st_drv.ko 2023-11-13T11:14:19.476 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 24305 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/misc/tifm_7xx1.ko 2023-11-13T11:14:19.476 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 28849 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/misc/tifm_core.ko 2023-11-13T11:14:19.476 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 18729 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/misc/tsl2550.ko 2023-11-13T11:14:19.476 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 48697 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/misc/vmw_balloon.ko 2023-11-13T11:14:19.477 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/misc/vmw_vmci/ 2023-11-13T11:14:19.477 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 183609 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2023-11-13T11:14:19.477 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ 2023-11-13T11:14:19.477 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/bonding/ 2023-11-13T11:14:19.478 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 490129 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/bonding/bonding.ko 2023-11-13T11:14:19.478 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/dsa/ 2023-11-13T11:14:19.478 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/dsa/b53/ 2023-11-13T11:14:19.478 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 106033 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/dsa/b53/b53_common.ko 2023-11-13T11:14:19.479 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 40297 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/dsa/bcm-sf2.ko 2023-11-13T11:14:19.479 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 16041 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/dsa/mv88e6060.ko 2023-11-13T11:14:19.479 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/dsa/mv88e6xxx/ 2023-11-13T11:14:19.479 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 453737 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2023-11-13T11:14:19.480 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 16929 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/dummy.ko 2023-11-13T11:14:19.480 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 17961 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/eql.ko 2023-11-13T11:14:19.480 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/ 2023-11-13T11:14:19.480 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/3com/ 2023-11-13T11:14:19.480 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 45785 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2023-11-13T11:14:19.481 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 42105 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2023-11-13T11:14:19.481 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 130553 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/3com/3c59x.ko 2023-11-13T11:14:19.481 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 68849 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/3com/typhoon.ko 2023-11-13T11:14:19.481 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/8390/ 2023-11-13T11:14:19.481 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 37649 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/8390/8390.ko 2023-11-13T11:14:19.482 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 59689 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2023-11-13T11:14:19.482 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 27201 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2023-11-13T11:14:19.482 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 99113 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2023-11-13T11:14:19.482 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/adaptec/ 2023-11-13T11:14:19.483 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 54521 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/adaptec/starfire.ko 2023-11-13T11:14:19.483 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/agere/ 2023-11-13T11:14:19.483 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 69201 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/agere/et131x.ko 2023-11-13T11:14:19.483 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/alteon/ 2023-11-13T11:14:19.484 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 59585 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/alteon/acenic.ko 2023-11-13T11:14:19.484 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/altera/ 2023-11-13T11:14:19.484 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 41409 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/altera/altera_tse.ko 2023-11-13T11:14:19.484 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/amd/ 2023-11-13T11:14:19.484 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 54609 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/amd/amd8111e.ko 2023-11-13T11:14:19.485 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 49289 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2023-11-13T11:14:19.485 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 87297 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/amd/pcnet32.ko 2023-11-13T11:14:19.485 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/atheros/ 2023-11-13T11:14:19.485 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/atheros/alx/ 2023-11-13T11:14:19.486 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 97337 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2023-11-13T11:14:19.486 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/atheros/atl1c/ 2023-11-13T11:14:19.486 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 104673 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2023-11-13T11:14:19.486 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/atheros/atl1e/ 2023-11-13T11:14:19.486 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 90257 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2023-11-13T11:14:19.487 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/atheros/atlx/ 2023-11-13T11:14:19.487 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 81569 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2023-11-13T11:14:19.487 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 69729 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2023-11-13T11:14:19.487 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/broadcom/ 2023-11-13T11:14:19.488 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 78401 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/broadcom/b44.ko 2023-11-13T11:14:19.488 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 176761 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2023-11-13T11:14:19.488 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/broadcom/bnx2x/ 2023-11-13T11:14:19.488 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 1421497 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2023-11-13T11:14:19.489 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 128569 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/broadcom/cnic.ko 2023-11-13T11:14:19.489 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/broadcom/genet/ 2023-11-13T11:14:19.489 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 132089 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2023-11-13T11:14:19.489 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 312081 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/broadcom/tg3.ko 2023-11-13T11:14:19.489 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/brocade/ 2023-11-13T11:14:19.490 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/brocade/bna/ 2023-11-13T11:14:19.490 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 323513 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2023-11-13T11:14:19.490 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/chelsio/ 2023-11-13T11:14:19.490 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/chelsio/cxgb/ 2023-11-13T11:14:19.491 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 193497 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2023-11-13T11:14:19.491 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/chelsio/cxgb3/ 2023-11-13T11:14:19.491 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 347417 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2023-11-13T11:14:19.491 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/chelsio/cxgb4/ 2023-11-13T11:14:19.491 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 1044433 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2023-11-13T11:14:19.492 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/chelsio/cxgb4vf/ 2023-11-13T11:14:19.492 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 166193 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2023-11-13T11:14:19.492 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/chelsio/libcxgb/ 2023-11-13T11:14:19.492 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 34881 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2023-11-13T11:14:19.493 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/cisco/ 2023-11-13T11:14:19.493 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/cisco/enic/ 2023-11-13T11:14:19.493 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 204345 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2023-11-13T11:14:19.493 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/dec/ 2023-11-13T11:14:19.494 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/dec/tulip/ 2023-11-13T11:14:19.494 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 69449 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2023-11-13T11:14:19.494 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 61489 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2023-11-13T11:14:19.494 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 141225 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2023-11-13T11:14:19.494 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 51497 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2023-11-13T11:14:19.495 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 62817 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2023-11-13T11:14:19.495 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 31369 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2023-11-13T11:14:19.495 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/dlink/ 2023-11-13T11:14:19.495 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 60873 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/dlink/dl2k.ko 2023-11-13T11:14:19.496 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 62833 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/dlink/sundance.ko 2023-11-13T11:14:19.496 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 45721 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/dnet.ko 2023-11-13T11:14:19.496 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 25185 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/ec_bhf.ko 2023-11-13T11:14:19.496 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/emulex/ 2023-11-13T11:14:19.496 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/emulex/benet/ 2023-11-13T11:14:19.497 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 281137 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2023-11-13T11:14:19.622 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 49457 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/ethoc.ko 2023-11-13T11:14:19.623 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 51737 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/fealnx.ko 2023-11-13T11:14:19.623 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/fujitsu/ 2023-11-13T11:14:19.623 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 45345 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/fujitsu/fmvj18x_cs.ko 2023-11-13T11:14:19.623 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/intel/ 2023-11-13T11:14:19.624 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 90465 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/intel/e100.ko 2023-11-13T11:14:19.624 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/intel/e1000/ 2023-11-13T11:14:19.624 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 295577 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2023-11-13T11:14:19.624 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/intel/e1000e/ 2023-11-13T11:14:19.624 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 584497 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2023-11-13T11:14:19.625 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/intel/fm10k/ 2023-11-13T11:14:19.625 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 246209 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2023-11-13T11:14:19.625 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/intel/i40e/ 2023-11-13T11:14:19.625 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 925697 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2023-11-13T11:14:19.625 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/intel/iavf/ 2023-11-13T11:14:19.626 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 302849 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2023-11-13T11:14:19.626 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/intel/igb/ 2023-11-13T11:14:19.626 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 514681 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/intel/igb/igb.ko 2023-11-13T11:14:19.626 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/intel/igbvf/ 2023-11-13T11:14:19.627 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 93593 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2023-11-13T11:14:19.627 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/intel/ixgbe/ 2023-11-13T11:14:19.627 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 734305 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2023-11-13T11:14:19.627 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/intel/ixgbevf/ 2023-11-13T11:14:19.627 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 151769 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2023-11-13T11:14:19.628 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 86921 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/jme.ko 2023-11-13T11:14:19.628 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/marvell/ 2023-11-13T11:14:19.628 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 20977 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2023-11-13T11:14:19.628 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 102289 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/marvell/skge.ko 2023-11-13T11:14:19.629 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 122649 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/marvell/sky2.ko 2023-11-13T11:14:19.629 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/mellanox/ 2023-11-13T11:14:19.629 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/mellanox/mlx4/ 2023-11-13T11:14:19.629 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 727601 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2023-11-13T11:14:19.629 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 278937 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2023-11-13T11:14:19.630 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/mellanox/mlx5/ 2023-11-13T11:14:19.630 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/mellanox/mlx5/core/ 2023-11-13T11:14:19.630 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 1113993 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2023-11-13T11:14:19.630 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/micrel/ 2023-11-13T11:14:19.631 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 53105 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/micrel/ks8842.ko 2023-11-13T11:14:19.631 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 40993 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/micrel/ks8851_common.ko 2023-11-13T11:14:19.631 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 19489 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/micrel/ks8851_par.ko 2023-11-13T11:14:19.631 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 95665 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2023-11-13T11:14:19.631 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/myricom/ 2023-11-13T11:14:19.632 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/myricom/myri10ge/ 2023-11-13T11:14:19.632 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 108649 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2023-11-13T11:14:19.632 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/natsemi/ 2023-11-13T11:14:19.632 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 73441 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2023-11-13T11:14:19.632 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 47777 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2023-11-13T11:14:19.633 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/neterion/ 2023-11-13T11:14:19.633 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 150905 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/neterion/s2io.ko 2023-11-13T11:14:19.633 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/nvidia/ 2023-11-13T11:14:19.633 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 136721 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2023-11-13T11:14:19.634 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/packetengines/ 2023-11-13T11:14:19.634 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 50481 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2023-11-13T11:14:19.634 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 43145 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2023-11-13T11:14:19.634 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/qlogic/ 2023-11-13T11:14:19.634 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/qlogic/netxen/ 2023-11-13T11:14:19.635 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 227897 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2023-11-13T11:14:19.635 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 87081 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2023-11-13T11:14:19.635 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/qlogic/qlcnic/ 2023-11-13T11:14:19.635 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 672049 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2023-11-13T11:14:19.635 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/rdc/ 2023-11-13T11:14:19.636 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 43017 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/rdc/r6040.ko 2023-11-13T11:14:19.636 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/realtek/ 2023-11-13T11:14:19.636 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 67385 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/realtek/8139cp.ko 2023-11-13T11:14:19.636 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 83985 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/realtek/8139too.ko 2023-11-13T11:14:19.637 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 29321 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/realtek/atp.ko 2023-11-13T11:14:19.637 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 189801 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/realtek/r8169.ko 2023-11-13T11:14:19.637 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/samsung/ 2023-11-13T11:14:19.637 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/samsung/sxgbe/ 2023-11-13T11:14:19.638 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 104241 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/samsung/sxgbe/samsung-sxgbe.ko 2023-11-13T11:14:19.638 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/sfc/ 2023-11-13T11:14:19.638 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 1053921 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/sfc/sfc.ko 2023-11-13T11:14:19.638 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/silan/ 2023-11-13T11:14:19.638 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 47097 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/silan/sc92031.ko 2023-11-13T11:14:19.639 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/sis/ 2023-11-13T11:14:19.639 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 54817 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/sis/sis190.ko 2023-11-13T11:14:19.639 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 63337 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/sis/sis900.ko 2023-11-13T11:14:19.639 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/smsc/ 2023-11-13T11:14:19.640 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 61601 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/smsc/epic100.ko 2023-11-13T11:14:19.640 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 67193 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2023-11-13T11:14:19.640 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 73409 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2023-11-13T11:14:19.640 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 68177 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2023-11-13T11:14:19.640 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/stmicro/ 2023-11-13T11:14:19.641 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/stmicro/stmmac/ 2023-11-13T11:14:19.641 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 13441 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-generic.ko 2023-11-13T11:14:19.641 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 39905 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2023-11-13T11:14:19.641 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 20657 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac-platform.ko 2023-11-13T11:14:19.642 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 486961 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2023-11-13T11:14:19.642 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/sun/ 2023-11-13T11:14:19.642 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 103337 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/sun/cassini.ko 2023-11-13T11:14:19.642 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 166161 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/sun/niu.ko 2023-11-13T11:14:19.642 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 66329 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/sun/sungem.ko 2023-11-13T11:14:19.643 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 78801 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/sun/sunhme.ko 2023-11-13T11:14:19.643 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/tehuti/ 2023-11-13T11:14:19.643 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 50057 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2023-11-13T11:14:19.643 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/ti/ 2023-11-13T11:14:19.644 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 86529 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/ti/tlan.ko 2023-11-13T11:14:19.644 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/via/ 2023-11-13T11:14:19.644 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 80273 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/via/via-rhine.ko 2023-11-13T11:14:19.644 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 83633 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/via/via-velocity.ko 2023-11-13T11:14:19.644 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/wiznet/ 2023-11-13T11:14:19.645 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 46241 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/wiznet/w5100.ko 2023-11-13T11:14:19.645 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 30849 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/wiznet/w5300.ko 2023-11-13T11:14:19.645 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/xircom/ 2023-11-13T11:14:19.645 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 60057 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2023-11-13T11:14:19.645 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/fddi/ 2023-11-13T11:14:19.646 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 41065 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/fddi/defxx.ko 2023-11-13T11:14:19.646 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/fddi/skfp/ 2023-11-13T11:14:19.646 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 216985 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/fddi/skfp/skfp.ko 2023-11-13T11:14:19.646 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 77345 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/geneve.ko 2023-11-13T11:14:19.647 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/hyperv/ 2023-11-13T11:14:19.647 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 235521 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/hyperv/hv_netvsc.ko 2023-11-13T11:14:19.647 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ieee802154/ 2023-11-13T11:14:19.647 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 18273 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ieee802154/fakelb.ko 2023-11-13T11:14:19.647 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 25065 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ifb.ko 2023-11-13T11:14:19.648 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ipvlan/ 2023-11-13T11:14:19.648 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 83769 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ipvlan/ipvlan.ko 2023-11-13T11:14:19.648 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 62209 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/macvlan.ko 2023-11-13T11:14:19.648 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 15865 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/macvtap.ko 2023-11-13T11:14:19.649 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/mdio/ 2023-11-13T11:14:19.649 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 20569 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2023-11-13T11:14:19.649 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 14185 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/mdio/mdio-bitbang.ko 2023-11-13T11:14:19.649 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 13745 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/mdio/mdio-gpio.ko 2023-11-13T11:14:19.649 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 8825 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/mdio/mdio-regmap.ko 2023-11-13T11:14:19.650 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 16025 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/mdio.ko 2023-11-13T11:14:19.650 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 20513 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/mii.ko 2023-11-13T11:14:19.650 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 43953 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/netconsole.ko 2023-11-13T11:14:19.650 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 13145 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/nlmon.ko 2023-11-13T11:14:19.651 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/pcs/ 2023-11-13T11:14:19.651 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 17985 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/pcs/pcs-lynx.ko 2023-11-13T11:14:19.651 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 38977 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/pcs/pcs_xpcs.ko 2023-11-13T11:14:19.651 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/phy/ 2023-11-13T11:14:19.651 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 9737 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/phy/amd.ko 2023-11-13T11:14:19.652 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 50097 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/phy/bcm-phy-lib.ko 2023-11-13T11:14:19.652 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 44505 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/phy/bcm7xxx.ko 2023-11-13T11:14:19.652 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 11521 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/phy/bcm87xx.ko 2023-11-13T11:14:19.652 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 42241 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/phy/broadcom.ko 2023-11-13T11:14:19.652 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 10625 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/phy/cicada.ko 2023-11-13T11:14:19.653 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 13025 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/phy/davicom.ko 2023-11-13T11:14:19.653 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 9449 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/phy/et1011c.ko 2023-11-13T11:14:19.653 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 24969 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/phy/icplus.ko 2023-11-13T11:14:19.653 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 15849 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/phy/lxt.ko 2023-11-13T11:14:19.654 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 82049 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/phy/marvell.ko 2023-11-13T11:14:19.654 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 76177 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/phy/micrel.ko 2023-11-13T11:14:19.654 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 12033 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/phy/national.ko 2023-11-13T11:14:19.654 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 97857 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/phy/phylink.ko 2023-11-13T11:14:19.654 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 10065 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/phy/qsemi.ko 2023-11-13T11:14:19.655 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 50065 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/phy/realtek.ko 2023-11-13T11:14:19.655 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 29985 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/phy/smsc.ko 2023-11-13T11:14:19.655 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 10857 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/phy/ste10Xp.ko 2023-11-13T11:14:19.655 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 24289 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/phy/vitesse.ko 2023-11-13T11:14:19.655 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/plip/ 2023-11-13T11:14:19.656 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 43569 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/plip/plip.ko 2023-11-13T11:14:19.656 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ppp/ 2023-11-13T11:14:19.656 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 15857 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ppp/bsd_comp.ko 2023-11-13T11:14:19.656 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 29713 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ppp/ppp_async.ko 2023-11-13T11:14:19.657 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 17665 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ppp/ppp_deflate.ko 2023-11-13T11:14:19.657 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 18625 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ppp/ppp_mppe.ko 2023-11-13T11:14:19.657 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 28729 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ppp/ppp_synctty.ko 2023-11-13T11:14:19.657 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 42545 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ppp/pppoe.ko 2023-11-13T11:14:19.657 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 13441 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ppp/pppox.ko 2023-11-13T11:14:19.658 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 32689 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ppp/pptp.ko 2023-11-13T11:14:19.658 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 28289 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/sb1000.ko 2023-11-13T11:14:19.658 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/slip/ 2023-11-13T11:14:19.658 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 42465 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/slip/slip.ko 2023-11-13T11:14:19.658 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 26929 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/sungem_phy.ko 2023-11-13T11:14:19.659 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 64385 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/tap.ko 2023-11-13T11:14:19.659 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/team/ 2023-11-13T11:14:19.659 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 106169 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/team/team.ko 2023-11-13T11:14:19.659 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 13497 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/team/team_mode_activebackup.ko 2023-11-13T11:14:19.660 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 10209 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/team/team_mode_broadcast.ko 2023-11-13T11:14:19.660 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 28881 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/team/team_mode_loadbalance.ko 2023-11-13T11:14:19.660 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 9641 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/team/team_mode_random.ko 2023-11-13T11:14:19.660 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 9321 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/team/team_mode_roundrobin.ko 2023-11-13T11:14:19.660 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 87017 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/veth.ko 2023-11-13T11:14:19.661 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/vmxnet3/ 2023-11-13T11:14:19.661 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 144297 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/vmxnet3/vmxnet3.ko 2023-11-13T11:14:19.661 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/vxlan/ 2023-11-13T11:14:19.661 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 297329 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/vxlan/vxlan.ko 2023-11-13T11:14:19.662 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/xen-netback/ 2023-11-13T11:14:19.662 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 144649 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/xen-netback/xen-netback.ko 2023-11-13T11:14:19.662 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/ntb/ 2023-11-13T11:14:19.662 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 20969 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/ntb/ntb.ko 2023-11-13T11:14:19.663 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/nvme/ 2023-11-13T11:14:19.663 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/nvme/host/ 2023-11-13T11:14:19.663 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 264937 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/nvme/host/nvme-core.ko 2023-11-13T11:14:19.663 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 102209 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/nvme/host/nvme.ko 2023-11-13T11:14:19.663 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/parport/ 2023-11-13T11:14:19.664 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 133841 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/parport/parport.ko 2023-11-13T11:14:19.664 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 14561 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/parport/parport_cs.ko 2023-11-13T11:14:19.664 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 84465 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/parport/parport_pc.ko 2023-11-13T11:14:19.664 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 26121 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/parport/parport_serial.ko 2023-11-13T11:14:19.665 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/pci/ 2023-11-13T11:14:19.665 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/pci/hotplug/ 2023-11-13T11:14:19.665 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 25009 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2023-11-13T11:14:19.665 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 17849 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/pci/hotplug/cpcihp_generic.ko 2023-11-13T11:14:19.665 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 20137 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/pci/hotplug/cpcihp_zt5550.ko 2023-11-13T11:14:19.666 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 11857 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/pci/pci-stub.ko 2023-11-13T11:14:19.666 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 46529 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/pci/xen-pcifront.ko 2023-11-13T11:14:19.666 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/pcmcia/ 2023-11-13T11:14:19.666 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 26793 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/pcmcia/i82092.ko 2023-11-13T11:14:19.667 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 145809 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/pcmcia/pcmcia.ko 2023-11-13T11:14:19.667 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 62137 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/pcmcia/pcmcia_core.ko 2023-11-13T11:14:19.667 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 34345 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/pcmcia/pcmcia_rsrc.ko 2023-11-13T11:14:19.667 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 34265 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/pcmcia/pd6729.ko 2023-11-13T11:14:19.667 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 112889 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/pcmcia/yenta_socket.ko 2023-11-13T11:14:19.668 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/phy/ 2023-11-13T11:14:19.668 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/phy/broadcom/ 2023-11-13T11:14:19.668 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 10841 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/phy/broadcom/phy-bcm-kona-usb2.ko 2023-11-13T11:14:19.668 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/phy/samsung/ 2023-11-13T11:14:19.668 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 8441 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/phy/samsung/phy-exynos-usb2.ko 2023-11-13T11:14:19.669 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/pinctrl/ 2023-11-13T11:14:19.669 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/pinctrl/intel/ 2023-11-13T11:14:19.669 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 70153 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2023-11-13T11:14:19.669 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/platform/ 2023-11-13T11:14:19.669 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/platform/chrome/ 2023-11-13T11:14:19.670 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 50889 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/platform/chrome/cros-ec-sensorhub.ko 2023-11-13T11:14:19.670 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 20849 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/platform/chrome/cros_ec.ko 2023-11-13T11:14:19.670 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 21449 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/platform/chrome/cros_ec_chardev.ko 2023-11-13T11:14:19.670 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 25417 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/platform/chrome/cros_ec_debugfs.ko 2023-11-13T11:14:19.670 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 26201 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/platform/chrome/cros_ec_lightbar.ko 2023-11-13T11:14:19.671 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 18201 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/platform/chrome/cros_ec_sysfs.ko 2023-11-13T11:14:19.671 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 17425 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/platform/chrome/cros_usbpd_notify.ko 2023-11-13T11:14:19.671 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/platform/x86/ 2023-11-13T11:14:19.671 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 67097 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/platform/x86/acer-wmi.ko 2023-11-13T11:14:19.671 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 39145 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/platform/x86/acerhdf.ko 2023-11-13T11:14:19.672 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 36913 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/platform/x86/apple-gmux.ko 2023-11-13T11:14:19.672 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 59665 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/platform/x86/asus-laptop.ko 2023-11-13T11:14:19.672 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 31097 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/platform/x86/asus-nb-wmi.ko 2023-11-13T11:14:19.672 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 127569 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/platform/x86/asus-wmi.ko 2023-11-13T11:14:19.672 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 36913 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/platform/x86/classmate-laptop.ko 2023-11-13T11:14:19.673 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 49121 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/platform/x86/eeepc-laptop.ko 2023-11-13T11:14:19.673 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 13961 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/platform/x86/eeepc-wmi.ko 2023-11-13T11:14:19.673 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 40265 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/platform/x86/fujitsu-laptop.ko 2023-11-13T11:14:19.673 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 22521 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/platform/x86/fujitsu-tablet.ko 2023-11-13T11:14:19.674 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 36657 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/platform/x86/hdaps.ko 2023-11-13T11:14:19.674 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 19449 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/platform/x86/ibm_rtl.ko 2023-11-13T11:14:19.674 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/platform/x86/intel/ 2023-11-13T11:14:19.674 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 12073 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/platform/x86/intel/intel-rst.ko 2023-11-13T11:14:19.674 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 8985 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/platform/x86/intel/intel-smartconnect.ko 2023-11-13T11:14:19.675 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 43497 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/platform/x86/intel_ips.ko 2023-11-13T11:14:19.675 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 20273 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/platform/x86/msi-wmi.ko 2023-11-13T11:14:19.675 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 10377 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/platform/x86/mxm-wmi.ko 2023-11-13T11:14:19.675 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 34801 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/platform/x86/panasonic-laptop.ko 2023-11-13T11:14:19.676 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 42329 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/platform/x86/samsung-laptop.ko 2023-11-13T11:14:19.676 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 14169 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/platform/x86/samsung-q10.ko 2023-11-13T11:14:19.676 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 17321 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/platform/x86/topstar-laptop.ko 2023-11-13T11:14:19.676 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 13721 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2023-11-13T11:14:19.676 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 17081 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/platform/x86/toshiba_haps.ko 2023-11-13T11:14:19.677 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 10129 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/platform/x86/wmi-bmof.ko 2023-11-13T11:14:19.677 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 57569 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/platform/x86/wmi.ko 2023-11-13T11:14:19.677 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/power/ 2023-11-13T11:14:19.677 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/power/supply/ 2023-11-13T11:14:19.677 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 30345 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/power/supply/88pm860x_battery.ko 2023-11-13T11:14:19.678 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 33985 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/power/supply/88pm860x_charger.ko 2023-11-13T11:14:19.678 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 55057 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/power/supply/bq2415x_charger.ko 2023-11-13T11:14:19.678 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 54081 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/power/supply/bq24190_charger.ko 2023-11-13T11:14:19.678 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 21553 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/power/supply/bq24735-charger.ko 2023-11-13T11:14:19.678 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 17337 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/power/supply/cros_peripheral_charger.ko 2023-11-13T11:14:19.679 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 19609 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/power/supply/da9030_battery.ko 2023-11-13T11:14:19.679 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 19841 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/power/supply/da9052-battery.ko 2023-11-13T11:14:19.679 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 29281 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/power/supply/ds2760_battery.ko 2023-11-13T11:14:19.679 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 23217 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/power/supply/ds2780_battery.ko 2023-11-13T11:14:19.680 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 23353 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/power/supply/ds2781_battery.ko 2023-11-13T11:14:19.680 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 23649 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/power/supply/ds2782_battery.ko 2023-11-13T11:14:19.680 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 20353 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/power/supply/gpio-charger.ko 2023-11-13T11:14:19.680 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 18041 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/power/supply/isp1704_charger.ko 2023-11-13T11:14:19.680 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 20273 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/power/supply/lp8727_charger.ko 2023-11-13T11:14:19.681 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 12577 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/power/supply/max14577_charger.ko 2023-11-13T11:14:19.681 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 25897 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/power/supply/max17040_battery.ko 2023-11-13T11:14:19.681 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 30289 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/power/supply/max17042_battery.ko 2023-11-13T11:14:19.681 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 18585 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/power/supply/max8903_charger.ko 2023-11-13T11:14:19.682 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 23729 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/power/supply/max8925_power.ko 2023-11-13T11:14:19.682 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 21657 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/power/supply/pcf50633-charger.ko 2023-11-13T11:14:19.682 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 38009 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/power/supply/sbs-battery.ko 2023-11-13T11:14:19.682 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 28385 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/power/supply/test_power.ko 2023-11-13T11:14:19.682 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 18865 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/power/supply/tps65090-charger.ko 2023-11-13T11:14:19.683 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 11969 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/power/supply/wm831x_backup.ko 2023-11-13T11:14:19.683 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 24521 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/power/supply/wm831x_power.ko 2023-11-13T11:14:19.683 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 22417 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/power/supply/wm8350_power.ko 2023-11-13T11:14:19.683 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/powercap/ 2023-11-13T11:14:19.684 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 57729 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/powercap/intel_rapl_common.ko 2023-11-13T11:14:19.684 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 17345 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/powercap/intel_rapl_msr.ko 2023-11-13T11:14:19.684 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/pps/ 2023-11-13T11:14:19.684 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/pps/clients/ 2023-11-13T11:14:19.684 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 15521 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/pps/clients/pps-gpio.ko 2023-11-13T11:14:19.685 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 13249 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/pps/clients/pps-ldisc.ko 2023-11-13T11:14:19.685 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 15913 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/pps/clients/pps_parport.ko 2023-11-13T11:14:19.685 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 41873 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/pps/pps_core.ko 2023-11-13T11:14:19.685 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/ptp/ 2023-11-13T11:14:19.685 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 66385 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/ptp/ptp.ko 2023-11-13T11:14:19.686 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 16449 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/ptp/ptp_kvm.ko 2023-11-13T11:14:19.686 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/rtc/ 2023-11-13T11:14:19.686 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 23497 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/rtc/rtc-88pm80x.ko 2023-11-13T11:14:19.686 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 24521 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/rtc/rtc-88pm860x.ko 2023-11-13T11:14:19.687 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 15393 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/rtc/rtc-bq32k.ko 2023-11-13T11:14:19.687 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 20105 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/rtc/rtc-da9052.ko 2023-11-13T11:14:19.687 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 18505 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/rtc/rtc-da9055.ko 2023-11-13T11:14:19.687 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 20425 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/rtc/rtc-da9063.ko 2023-11-13T11:14:19.687 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 16457 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/rtc/rtc-ds1286.ko 2023-11-13T11:14:19.688 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 68577 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/rtc/rtc-ds1307.ko 2023-11-13T11:14:19.688 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 20817 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/rtc/rtc-ds1374.ko 2023-11-13T11:14:19.688 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 18217 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/rtc/rtc-ds1511.ko 2023-11-13T11:14:19.688 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 16737 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/rtc/rtc-ds1553.ko 2023-11-13T11:14:19.689 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 13953 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/rtc/rtc-ds1672.ko 2023-11-13T11:14:19.689 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 13369 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/rtc/rtc-ds1742.ko 2023-11-13T11:14:19.689 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 14697 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/rtc/rtc-ds2404.ko 2023-11-13T11:14:19.689 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 23705 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/rtc/rtc-ds3232.ko 2023-11-13T11:14:19.689 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 11081 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/rtc/rtc-em3027.ko 2023-11-13T11:14:19.690 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 24329 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/rtc/rtc-fm3130.ko 2023-11-13T11:14:19.690 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 20729 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/rtc/rtc-isl12022.ko 2023-11-13T11:14:19.690 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 35969 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/rtc/rtc-isl1208.ko 2023-11-13T11:14:19.690 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 14673 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/rtc/rtc-lp8788.ko 2023-11-13T11:14:19.690 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 38097 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/rtc/rtc-m41t80.ko 2023-11-13T11:14:19.691 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 12089 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/rtc/rtc-m48t35.ko 2023-11-13T11:14:19.691 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 25945 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/rtc/rtc-m48t59.ko 2023-11-13T11:14:19.691 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 14841 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/rtc/rtc-m48t86.ko 2023-11-13T11:14:19.691 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 11633 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/rtc/rtc-max6900.ko 2023-11-13T11:14:19.692 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 14737 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/rtc/rtc-max8907.ko 2023-11-13T11:14:19.692 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 15409 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/rtc/rtc-max8925.ko 2023-11-13T11:14:19.692 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 25809 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/rtc/rtc-max8997.ko 2023-11-13T11:14:19.692 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 16681 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/rtc/rtc-max8998.ko 2023-11-13T11:14:19.692 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 18513 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/rtc/rtc-mc13xxx.ko 2023-11-13T11:14:19.693 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 11409 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/rtc/rtc-msm6242.ko 2023-11-13T11:14:19.693 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 19625 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/rtc/rtc-palmas.ko 2023-11-13T11:14:19.693 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 46633 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/rtc/rtc-pcf2127.ko 2023-11-13T11:14:19.693 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 17977 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/rtc/rtc-pcf50633.ko 2023-11-13T11:14:19.693 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 26993 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/rtc/rtc-pcf85063.ko 2023-11-13T11:14:19.694 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 21825 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/rtc/rtc-pcf8523.ko 2023-11-13T11:14:19.694 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 29881 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/rtc/rtc-pcf8563.ko 2023-11-13T11:14:19.694 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 12441 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/rtc/rtc-pcf8583.ko 2023-11-13T11:14:19.694 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 18033 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/rtc/rtc-rc5t583.ko 2023-11-13T11:14:19.695 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 13049 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/rtc/rtc-rp5c01.ko 2023-11-13T11:14:19.695 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 33753 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/rtc/rtc-rs5c372.ko 2023-11-13T11:14:19.695 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 27833 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/rtc/rtc-rv3029c2.ko 2023-11-13T11:14:19.695 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 25257 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/rtc/rtc-rx8025.ko 2023-11-13T11:14:19.695 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 20113 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/rtc/rtc-rx8581.ko 2023-11-13T11:14:19.696 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 21617 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/rtc/rtc-s35390a.ko 2023-11-13T11:14:19.696 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 16825 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/rtc/rtc-stk17ta8.ko 2023-11-13T11:14:19.696 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 17889 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/rtc/rtc-tps6586x.ko 2023-11-13T11:14:19.696 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 21337 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/rtc/rtc-tps65910.ko 2023-11-13T11:14:19.697 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 20545 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/rtc/rtc-wm831x.ko 2023-11-13T11:14:19.697 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 21089 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/rtc/rtc-wm8350.ko 2023-11-13T11:14:19.697 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 27873 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/rtc/rtc-x1205.ko 2023-11-13T11:14:19.697 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/ 2023-11-13T11:14:19.697 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 77617 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/3w-9xxx.ko 2023-11-13T11:14:19.698 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 57665 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/3w-sas.ko 2023-11-13T11:14:19.698 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 55169 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/3w-xxxx.ko 2023-11-13T11:14:19.698 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 135185 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/BusLogic.ko 2023-11-13T11:14:19.698 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 26657 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/a100u2w.ko 2023-11-13T11:14:19.699 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/aacraid/ 2023-11-13T11:14:19.699 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 272305 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/aacraid/aacraid.ko 2023-11-13T11:14:19.699 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 100617 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/advansys.ko 2023-11-13T11:14:19.699 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/aic7xxx/ 2023-11-13T11:14:19.700 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 356265 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2023-11-13T11:14:19.700 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 295801 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2023-11-13T11:14:19.700 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/aic94xx/ 2023-11-13T11:14:19.700 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 189185 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/aic94xx/aic94xx.ko 2023-11-13T11:14:19.700 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 24073 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/am53c974.ko 2023-11-13T11:14:19.700 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/arcmsr/ 2023-11-13T11:14:19.701 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 106881 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/arcmsr/arcmsr.ko 2023-11-13T11:14:19.701 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 38185 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/atp870u.ko 2023-11-13T11:14:19.701 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/be2iscsi/ 2023-11-13T11:14:19.701 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 246985 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2023-11-13T11:14:19.702 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/bfa/ 2023-11-13T11:14:19.702 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 1171945 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/bfa/bfa.ko 2023-11-13T11:14:19.702 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/bnx2fc/ 2023-11-13T11:14:19.702 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 237273 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2023-11-13T11:14:19.702 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/bnx2i/ 2023-11-13T11:14:19.703 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 115369 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/bnx2i/bnx2i.ko 2023-11-13T11:14:19.703 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 40585 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/ch.ko 2023-11-13T11:14:19.703 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/csiostor/ 2023-11-13T11:14:19.703 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 308921 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/csiostor/csiostor.ko 2023-11-13T11:14:19.703 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/cxgbi/ 2023-11-13T11:14:19.704 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/cxgbi/cxgb3i/ 2023-11-13T11:14:19.704 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 76145 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2023-11-13T11:14:19.704 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/cxgbi/cxgb4i/ 2023-11-13T11:14:19.704 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 101449 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2023-11-13T11:14:19.705 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 146689 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2023-11-13T11:14:19.705 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 75553 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/dc395x.ko 2023-11-13T11:14:19.705 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 38137 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/dmx3191d.ko 2023-11-13T11:14:19.705 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/esas2r/ 2023-11-13T11:14:19.706 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 212425 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/esas2r/esas2r.ko 2023-11-13T11:14:19.706 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 60505 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/esp_scsi.ko 2023-11-13T11:14:19.706 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/fcoe/ 2023-11-13T11:14:19.706 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 78209 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/fcoe/fcoe.ko 2023-11-13T11:14:19.706 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 158505 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/fcoe/libfcoe.ko 2023-11-13T11:14:19.707 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 18945 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/fdomain.ko 2023-11-13T11:14:19.707 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/fnic/ 2023-11-13T11:14:19.707 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 263489 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/fnic/fnic.ko 2023-11-13T11:14:19.707 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 201817 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/hpsa.ko 2023-11-13T11:14:19.708 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 51209 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/hptiop.ko 2023-11-13T11:14:19.708 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 49041 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/hv_storvsc.ko 2023-11-13T11:14:19.708 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 35337 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/imm.ko 2023-11-13T11:14:19.708 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 44057 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/initio.ko 2023-11-13T11:14:19.708 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 266537 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/ipr.ko 2023-11-13T11:14:19.709 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 101881 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/ips.ko 2023-11-13T11:14:19.709 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/isci/ 2023-11-13T11:14:19.709 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 317153 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/isci/isci.ko 2023-11-13T11:14:19.709 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 26385 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2023-11-13T11:14:19.710 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 52961 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/iscsi_tcp.ko 2023-11-13T11:14:19.710 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/libfc/ 2023-11-13T11:14:19.710 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 314865 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/libfc/libfc.ko 2023-11-13T11:14:19.710 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 145585 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/libiscsi.ko 2023-11-13T11:14:19.710 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 53521 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/libiscsi_tcp.ko 2023-11-13T11:14:19.711 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/libsas/ 2023-11-13T11:14:19.711 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 216665 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/libsas/libsas.ko 2023-11-13T11:14:19.711 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/lpfc/ 2023-11-13T11:14:19.711 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 2197249 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/lpfc/lpfc.ko 2023-11-13T11:14:19.711 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/megaraid/ 2023-11-13T11:14:19.712 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 73569 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2023-11-13T11:14:19.712 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 33529 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2023-11-13T11:14:19.712 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 310617 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2023-11-13T11:14:19.712 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 84721 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/megaraid.ko 2023-11-13T11:14:19.713 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/mpt3sas/ 2023-11-13T11:14:19.713 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 659777 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2023-11-13T11:14:19.713 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/mvsas/ 2023-11-13T11:14:19.713 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 119561 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/mvsas/mvsas.ko 2023-11-13T11:14:19.713 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 78129 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/mvumi.ko 2023-11-13T11:14:19.714 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/pcmcia/ 2023-11-13T11:14:19.714 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 81625 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/pcmcia/aha152x_cs.ko 2023-11-13T11:14:19.714 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 11713 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/pcmcia/fdomain_cs.ko 2023-11-13T11:14:19.714 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 20865 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/pcmcia/qlogic_cs.ko 2023-11-13T11:14:19.715 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 23857 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/pcmcia/sym53c500_cs.ko 2023-11-13T11:14:19.715 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/pm8001/ 2023-11-13T11:14:19.715 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 364105 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/pm8001/pm80xx.ko 2023-11-13T11:14:19.715 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 123617 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/pmcraid.ko 2023-11-13T11:14:19.716 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 34513 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/ppa.ko 2023-11-13T11:14:19.716 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 55361 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/qla1280.ko 2023-11-13T11:14:19.716 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/qla2xxx/ 2023-11-13T11:14:19.716 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 1876625 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2023-11-13T11:14:19.716 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 85289 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2023-11-13T11:14:19.717 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/qla4xxx/ 2023-11-13T11:14:19.717 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 559033 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2023-11-13T11:14:19.717 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 19025 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/qlogicfas408.ko 2023-11-13T11:14:19.717 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 15993 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/raid_class.ko 2023-11-13T11:14:19.717 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 238825 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/scsi_debug.ko 2023-11-13T11:14:19.718 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 173937 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/scsi_transport_fc.ko 2023-11-13T11:14:19.718 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 279313 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/scsi_transport_iscsi.ko 2023-11-13T11:14:19.718 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 97729 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/scsi_transport_sas.ko 2023-11-13T11:14:19.718 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 73881 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/scsi_transport_spi.ko 2023-11-13T11:14:19.719 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 44993 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/scsi_transport_srp.ko 2023-11-13T11:14:19.719 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 26249 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/ses.ko 2023-11-13T11:14:19.719 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 115889 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/st.ko 2023-11-13T11:14:19.719 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 46825 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/stex.ko 2023-11-13T11:14:19.719 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/sym53c8xx_2/ 2023-11-13T11:14:19.720 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 162121 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2023-11-13T11:14:19.720 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 42297 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/virtio_scsi.ko 2023-11-13T11:14:19.720 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 50321 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/vmw_pvscsi.ko 2023-11-13T11:14:19.720 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 40025 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/wd719x.ko 2023-11-13T11:14:19.720 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 50025 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/xen-scsifront.ko 2023-11-13T11:14:19.721 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/ssb/ 2023-11-13T11:14:19.721 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 129441 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/ssb/ssb.ko 2023-11-13T11:14:19.721 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/target/ 2023-11-13T11:14:19.721 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/target/iscsi/ 2023-11-13T11:14:19.721 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 736601 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2023-11-13T11:14:19.722 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/target/loopback/ 2023-11-13T11:14:19.722 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 49985 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/target/loopback/tcm_loop.ko 2023-11-13T11:14:19.722 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 39713 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/target/target_core_file.ko 2023-11-13T11:14:19.722 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 43025 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/target/target_core_iblock.ko 2023-11-13T11:14:19.722 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 930321 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/target/target_core_mod.ko 2023-11-13T11:14:19.723 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 44305 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/target/target_core_pscsi.ko 2023-11-13T11:14:19.723 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 122521 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/target/target_core_user.ko 2023-11-13T11:14:19.723 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/target/tcm_fc/ 2023-11-13T11:14:19.723 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 75593 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/target/tcm_fc/tcm_fc.ko 2023-11-13T11:14:19.724 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/thermal/ 2023-11-13T11:14:19.724 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/thermal/intel/ 2023-11-13T11:14:19.724 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/thermal/intel/int340x_thermal/ 2023-11-13T11:14:19.724 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 23481 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2023-11-13T11:14:19.724 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 29321 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2023-11-13T11:14:19.724 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 9953 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2023-11-13T11:14:19.725 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 10257 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2023-11-13T11:14:19.725 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 15081 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2023-11-13T11:14:19.725 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 16497 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2023-11-13T11:14:19.725 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 26809 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2023-11-13T11:14:19.725 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 20281 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2023-11-13T11:14:19.726 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 14865 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2023-11-13T11:14:19.726 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 14393 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2023-11-13T11:14:19.726 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 13001 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2023-11-13T11:14:19.726 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 37065 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2023-11-13T11:14:19.727 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 30729 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/thermal/intel/intel_powerclamp.ko 2023-11-13T11:14:19.727 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 18937 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2023-11-13T11:14:19.727 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 11521 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2023-11-13T11:14:19.727 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 26489 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2023-11-13T11:14:19.728 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/tty/ 2023-11-13T11:14:19.728 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/tty/ipwireless/ 2023-11-13T11:14:19.728 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 78425 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/tty/ipwireless/ipwireless.ko 2023-11-13T11:14:19.728 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 57865 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/tty/moxa.ko 2023-11-13T11:14:19.729 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 50953 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/tty/mxser.ko 2023-11-13T11:14:19.729 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 108601 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/tty/n_gsm.ko 2023-11-13T11:14:19.729 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 31961 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/tty/n_hdlc.ko 2023-11-13T11:14:19.729 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 67929 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/tty/nozomi.ko 2023-11-13T11:14:19.729 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/tty/serial/ 2023-11-13T11:14:19.730 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/tty/serial/8250/ 2023-11-13T11:14:19.730 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 35753 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/tty/serial/8250/8250_dw.ko 2023-11-13T11:14:19.730 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 59497 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/tty/serial/8250/serial_cs.ko 2023-11-13T11:14:19.731 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 18097 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/tty/serial/altera_jtaguart.ko 2023-11-13T11:14:19.731 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 22577 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/tty/serial/altera_uart.ko 2023-11-13T11:14:19.731 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 9489 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/tty/serial/arc_uart.ko 2023-11-13T11:14:19.731 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 72425 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/tty/serial/fsl_lpuart.ko 2023-11-13T11:14:19.731 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/tty/serial/jsm/ 2023-11-13T11:14:19.732 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 103073 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/tty/serial/jsm/jsm.ko 2023-11-13T11:14:19.732 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 28785 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/tty/serial/rp2.ko 2023-11-13T11:14:19.732 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 52817 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/tty/serial/sc16is7xx.ko 2023-11-13T11:14:19.732 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/ufs/ 2023-11-13T11:14:19.733 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/ufs/core/ 2023-11-13T11:14:19.733 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 531265 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/ufs/core/ufshcd-core.ko 2023-11-13T11:14:19.733 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/ufs/host/ 2023-11-13T11:14:19.733 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 28481 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/ufs/host/ufshcd-pci.ko 2023-11-13T11:14:19.734 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 14601 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/ufs/host/ufshcd-pltfrm.ko 2023-11-13T11:14:19.734 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/uio/ 2023-11-13T11:14:19.734 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 44513 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/uio/uio.ko 2023-11-13T11:14:19.734 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 12241 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/uio/uio_aec.ko 2023-11-13T11:14:19.735 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 11281 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/uio/uio_cif.ko 2023-11-13T11:14:19.735 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 18329 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/uio/uio_dmem_genirq.ko 2023-11-13T11:14:19.735 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 13001 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/uio/uio_mf624.ko 2023-11-13T11:14:19.735 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 12177 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/uio/uio_netx.ko 2023-11-13T11:14:19.736 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 10601 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/uio/uio_pci_generic.ko 2023-11-13T11:14:19.736 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 16057 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/uio/uio_pdrv_genirq.ko 2023-11-13T11:14:19.736 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 13633 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/uio/uio_sercos3.ko 2023-11-13T11:14:19.736 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/ 2023-11-13T11:14:19.737 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/c67x00/ 2023-11-13T11:14:19.737 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 73297 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/c67x00/c67x00.ko 2023-11-13T11:14:19.737 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/chipidea/ 2023-11-13T11:14:19.737 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 144377 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/chipidea/ci_hdrc.ko 2023-11-13T11:14:19.737 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 18505 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/chipidea/ci_hdrc_msm.ko 2023-11-13T11:14:19.738 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 12713 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/chipidea/ci_hdrc_pci.ko 2023-11-13T11:14:19.738 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 13057 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/chipidea/ci_hdrc_usb2.ko 2023-11-13T11:14:19.738 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/class/ 2023-11-13T11:14:19.738 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 87089 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/class/cdc-acm.ko 2023-11-13T11:14:19.739 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 51409 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/class/cdc-wdm.ko 2023-11-13T11:14:19.739 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 47369 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/class/usblp.ko 2023-11-13T11:14:19.739 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 89857 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/class/usbtmc.ko 2023-11-13T11:14:19.739 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/common/ 2023-11-13T11:14:19.740 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 22953 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/common/ulpi.ko 2023-11-13T11:14:19.740 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/dwc2/ 2023-11-13T11:14:19.740 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 11529 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/dwc2/dwc2_pci.ko 2023-11-13T11:14:19.740 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/dwc3/ 2023-11-13T11:14:19.740 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 12089 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/dwc3/dwc3-haps.ko 2023-11-13T11:14:19.741 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 30041 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/dwc3/dwc3-pci.ko 2023-11-13T11:14:19.741 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 444553 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/dwc3/dwc3.ko 2023-11-13T11:14:19.741 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/gadget/ 2023-11-13T11:14:19.741 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/gadget/function/ 2023-11-13T11:14:19.741 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 60177 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/gadget/function/u_ether.ko 2023-11-13T11:14:19.742 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 51881 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/gadget/function/u_serial.ko 2023-11-13T11:14:19.742 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 28841 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/gadget/function/usb_f_acm.ko 2023-11-13T11:14:19.742 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 42449 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/gadget/function/usb_f_ecm.ko 2023-11-13T11:14:19.742 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 27953 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/gadget/function/usb_f_ecm_subset.ko 2023-11-13T11:14:19.743 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 36513 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/gadget/function/usb_f_eem.ko 2023-11-13T11:14:19.743 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 92489 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/gadget/function/usb_f_fs.ko 2023-11-13T11:14:19.743 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 51049 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/gadget/function/usb_f_hid.ko 2023-11-13T11:14:19.743 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 122081 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/gadget/function/usb_f_mass_storage.ko 2023-11-13T11:14:19.743 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 57617 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/gadget/function/usb_f_ncm.ko 2023-11-13T11:14:19.744 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 22185 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/gadget/function/usb_f_obex.ko 2023-11-13T11:14:19.744 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 31265 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/gadget/function/usb_f_phonet.ko 2023-11-13T11:14:19.744 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 57729 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/gadget/function/usb_f_printer.ko 2023-11-13T11:14:19.744 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 85609 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/gadget/function/usb_f_rndis.ko 2023-11-13T11:14:19.745 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 19273 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/gadget/function/usb_f_serial.ko 2023-11-13T11:14:19.745 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 58113 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/gadget/function/usb_f_ss_lb.ko 2023-11-13T11:14:19.745 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 67337 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/gadget/function/usb_f_tcm.ko 2023-11-13T11:14:19.745 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/gadget/legacy/ 2023-11-13T11:14:19.746 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 21265 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/gadget/legacy/g_acm_ms.ko 2023-11-13T11:14:19.746 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 18057 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/gadget/legacy/g_cdc.ko 2023-11-13T11:14:19.746 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 18465 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/gadget/legacy/g_dbgp.ko 2023-11-13T11:14:19.746 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 21657 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/gadget/legacy/g_ether.ko 2023-11-13T11:14:19.746 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 28401 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/gadget/legacy/g_ffs.ko 2023-11-13T11:14:19.747 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 19009 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/gadget/legacy/g_hid.ko 2023-11-13T11:14:19.747 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 20409 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/gadget/legacy/g_mass_storage.ko 2023-11-13T11:14:19.747 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 16977 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/gadget/legacy/g_ncm.ko 2023-11-13T11:14:19.747 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 32073 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/gadget/legacy/g_nokia.ko 2023-11-13T11:14:19.748 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 16793 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/gadget/legacy/g_printer.ko 2023-11-13T11:14:19.748 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 19393 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/gadget/legacy/g_serial.ko 2023-11-13T11:14:19.748 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 27201 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/gadget/legacy/g_zero.ko 2023-11-13T11:14:19.748 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 62185 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/gadget/legacy/gadgetfs.ko 2023-11-13T11:14:19.749 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 15201 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/gadget/legacy/tcm_usb_gadget.ko 2023-11-13T11:14:19.749 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 161225 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/gadget/libcomposite.ko 2023-11-13T11:14:19.749 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/gadget/udc/ 2023-11-13T11:14:19.749 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 17705 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/gadget/udc/amd5536udc_pci.ko 2023-11-13T11:14:19.749 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/gadget/udc/bdc/ 2023-11-13T11:14:19.750 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 157681 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/gadget/udc/bdc/bdc.ko 2023-11-13T11:14:19.750 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 36089 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/gadget/udc/goku_udc.ko 2023-11-13T11:14:19.750 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 52721 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/gadget/udc/gr_udc.ko 2023-11-13T11:14:19.750 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 69705 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/gadget/udc/mv_u3d_core.ko 2023-11-13T11:14:19.751 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 56033 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/gadget/udc/mv_udc.ko 2023-11-13T11:14:19.751 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 76057 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/gadget/udc/net2272.ko 2023-11-13T11:14:19.751 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 75073 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/gadget/udc/net2280.ko 2023-11-13T11:14:19.751 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 73169 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/gadget/udc/pch_udc.ko 2023-11-13T11:14:19.751 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 65809 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/gadget/udc/pxa27x_udc.ko 2023-11-13T11:14:19.752 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 66097 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/gadget/udc/r8a66597-udc.ko 2023-11-13T11:14:19.752 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 81505 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/gadget/udc/snps_udc_core.ko 2023-11-13T11:14:19.752 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 156073 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/gadget/udc/udc-core.ko 2023-11-13T11:14:19.752 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/host/ 2023-11-13T11:14:19.752 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 11585 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/host/bcma-hcd.ko 2023-11-13T11:14:19.753 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 80113 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/host/isp116x-hcd.ko 2023-11-13T11:14:19.753 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 87353 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/host/oxu210hp-hcd.ko 2023-11-13T11:14:19.753 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 78873 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/host/r8a66597-hcd.ko 2023-11-13T11:14:19.753 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 51329 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/host/sl811-hcd.ko 2023-11-13T11:14:19.754 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 15593 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/host/sl811_cs.ko 2023-11-13T11:14:19.754 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 13305 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/host/ssb-hcd.ko 2023-11-13T11:14:19.754 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 25945 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/host/xhci-plat-hcd.ko 2023-11-13T11:14:19.754 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/image/ 2023-11-13T11:14:19.755 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 34585 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/image/mdc800.ko 2023-11-13T11:14:19.755 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 21081 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/image/microtek.ko 2023-11-13T11:14:19.755 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/misc/ 2023-11-13T11:14:19.755 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 41721 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/misc/adutux.ko 2023-11-13T11:14:19.755 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 20713 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/misc/appledisplay.ko 2023-11-13T11:14:19.756 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 17721 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/misc/cypress_cy7c63.ko 2023-11-13T11:14:19.756 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 23049 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/misc/cytherm.ko 2023-11-13T11:14:19.756 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 13729 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/misc/ehset.ko 2023-11-13T11:14:19.756 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 15057 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/misc/emi26.ko 2023-11-13T11:14:19.756 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 15985 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/misc/emi62.ko 2023-11-13T11:14:19.757 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 11433 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/misc/ezusb.ko 2023-11-13T11:14:19.757 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 19297 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/misc/idmouse.ko 2023-11-13T11:14:19.757 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 36617 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/misc/iowarrior.ko 2023-11-13T11:14:19.757 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 11593 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/misc/isight_firmware.ko 2023-11-13T11:14:19.758 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 36529 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/misc/ldusb.ko 2023-11-13T11:14:19.758 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 36265 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/misc/legousbtower.ko 2023-11-13T11:14:19.758 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 27793 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/misc/lvstest.ko 2023-11-13T11:14:19.758 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/misc/sisusbvga/ 2023-11-13T11:14:19.759 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 64841 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2023-11-13T11:14:19.759 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 13001 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/misc/trancevibrator.ko 2023-11-13T11:14:19.759 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 20473 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/misc/usb3503.ko 2023-11-13T11:14:19.759 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 25145 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/misc/usblcd.ko 2023-11-13T11:14:19.759 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 22753 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/misc/usbsevseg.ko 2023-11-13T11:14:19.760 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 70873 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/misc/usbtest.ko 2023-11-13T11:14:19.760 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 41969 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/misc/uss720.ko 2023-11-13T11:14:19.760 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 27617 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/misc/yurex.ko 2023-11-13T11:14:19.760 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/mon/ 2023-11-13T11:14:19.761 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 72953 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/mon/usbmon.ko 2023-11-13T11:14:19.761 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/musb/ 2023-11-13T11:14:19.761 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 301545 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/musb/musb_hdrc.ko 2023-11-13T11:14:19.761 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/phy/ 2023-11-13T11:14:19.761 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 21105 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/phy/phy-generic.ko 2023-11-13T11:14:19.762 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 20177 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/phy/phy-gpio-vbus-usb.ko 2023-11-13T11:14:19.762 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 12257 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/phy/phy-isp1301.ko 2023-11-13T11:14:19.762 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 21745 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/phy/phy-tahvo.ko 2023-11-13T11:14:19.762 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/serial/ 2023-11-13T11:14:19.762 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 13209 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/serial/aircable.ko 2023-11-13T11:14:19.763 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 33329 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/serial/ark3116.ko 2023-11-13T11:14:19.763 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 26633 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/serial/belkin_sa.ko 2023-11-13T11:14:19.763 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 38105 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/serial/ch341.ko 2023-11-13T11:14:19.763 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 70257 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/serial/cp210x.ko 2023-11-13T11:14:19.763 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 31057 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/serial/cyberjack.ko 2023-11-13T11:14:19.764 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 58217 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/serial/cypress_m8.ko 2023-11-13T11:14:19.764 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 49817 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/serial/digi_acceleport.ko 2023-11-13T11:14:19.764 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 9617 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/serial/empeg.ko 2023-11-13T11:14:19.764 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 44337 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/serial/f81232.ko 2023-11-13T11:14:19.765 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 175137 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/serial/ftdi_sio.ko 2023-11-13T11:14:19.765 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 53113 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/serial/garmin_gps.ko 2023-11-13T11:14:19.765 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 137081 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/serial/io_edgeport.ko 2023-11-13T11:14:19.765 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 124833 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/serial/io_ti.ko 2023-11-13T11:14:19.765 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 67769 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/serial/ipaq.ko 2023-11-13T11:14:19.766 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 19161 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/serial/ipw.ko 2023-11-13T11:14:19.766 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 26897 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/serial/ir-usb.ko 2023-11-13T11:14:19.766 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 58233 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/serial/iuu_phoenix.ko 2023-11-13T11:14:19.766 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 107521 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/serial/keyspan.ko 2023-11-13T11:14:19.767 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 35617 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/serial/keyspan_pda.ko 2023-11-13T11:14:19.767 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 25665 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/serial/kl5kusb105.ko 2023-11-13T11:14:19.767 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 33689 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/serial/kobil_sct.ko 2023-11-13T11:14:19.767 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 32953 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/serial/mct_u232.ko 2023-11-13T11:14:19.768 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 22033 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/serial/metro-usb.ko 2023-11-13T11:14:19.768 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 66449 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/serial/mos7720.ko 2023-11-13T11:14:19.768 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 78217 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/serial/mos7840.ko 2023-11-13T11:14:19.768 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 56337 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/serial/mxuport.ko 2023-11-13T11:14:19.768 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 14089 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/serial/navman.ko 2023-11-13T11:14:19.769 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 12009 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/serial/omninet.ko 2023-11-13T11:14:19.769 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 24633 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/serial/opticon.ko 2023-11-13T11:14:19.769 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 190633 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/serial/option.ko 2023-11-13T11:14:19.769 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 39073 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/serial/oti6858.ko 2023-11-13T11:14:19.770 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 54353 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/serial/pl2303.ko 2023-11-13T11:14:19.770 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 9801 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/serial/qcaux.ko 2023-11-13T11:14:19.770 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 37825 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/serial/qcserial.ko 2023-11-13T11:14:19.770 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 34321 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/serial/quatech2.ko 2023-11-13T11:14:19.771 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 15393 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/serial/safe_serial.ko 2023-11-13T11:14:19.771 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 51625 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/serial/sierra.ko 2023-11-13T11:14:19.771 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 21673 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/serial/spcp8x5.ko 2023-11-13T11:14:19.771 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 29993 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/serial/ssu100.ko 2023-11-13T11:14:19.771 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 17265 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/serial/symbolserial.ko 2023-11-13T11:14:19.772 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 61489 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2023-11-13T11:14:19.772 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 23729 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/serial/usb-serial-simple.ko 2023-11-13T11:14:19.772 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 10241 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/serial/usb_debug.ko 2023-11-13T11:14:19.772 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 33201 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/serial/usb_wwan.ko 2023-11-13T11:14:19.773 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 125609 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/serial/usbserial.ko 2023-11-13T11:14:19.773 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 28753 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/serial/visor.ko 2023-11-13T11:14:19.773 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 37409 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/serial/whiteheat.ko 2023-11-13T11:14:19.773 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 10537 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/serial/wishbone-serial.ko 2023-11-13T11:14:19.774 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 9289 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/serial/xsens_mt.ko 2023-11-13T11:14:19.774 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/storage/ 2023-11-13T11:14:19.774 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 52913 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/storage/uas.ko 2023-11-13T11:14:19.774 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 26017 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/storage/ums-alauda.ko 2023-11-13T11:14:19.775 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 13049 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/storage/ums-cypress.ko 2023-11-13T11:14:19.775 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 22049 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/storage/ums-datafab.ko 2023-11-13T11:14:19.775 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 33497 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/storage/ums-eneub6250.ko 2023-11-13T11:14:19.775 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 13745 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/storage/ums-freecom.ko 2023-11-13T11:14:19.775 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 19769 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/storage/ums-isd200.ko 2023-11-13T11:14:19.776 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 19361 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/storage/ums-jumpshot.ko 2023-11-13T11:14:19.776 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 13713 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/storage/ums-karma.ko 2023-11-13T11:14:19.776 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 17841 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/storage/ums-onetouch.ko 2023-11-13T11:14:19.776 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 28441 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/storage/ums-realtek.ko 2023-11-13T11:14:19.777 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 28905 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/storage/ums-sddr09.ko 2023-11-13T11:14:19.777 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 19521 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/storage/ums-sddr55.ko 2023-11-13T11:14:19.777 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 35337 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/storage/ums-usbat.ko 2023-11-13T11:14:19.777 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 179969 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/storage/usb-storage.ko 2023-11-13T11:14:19.777 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/usbip/ 2023-11-13T11:14:19.778 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 67481 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/usbip/usbip-core.ko 2023-11-13T11:14:19.778 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 72177 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/usbip/usbip-host.ko 2023-11-13T11:14:19.778 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 107001 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/usbip/vhci-hcd.ko 2023-11-13T11:14:19.778 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/vfio/ 2023-11-13T11:14:19.779 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/vfio/pci/ 2023-11-13T11:14:19.779 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 154297 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/vfio/pci/vfio-pci-core.ko 2023-11-13T11:14:19.779 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 29537 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/vfio/pci/vfio-pci.ko 2023-11-13T11:14:19.779 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 108737 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/vfio/vfio.ko 2023-11-13T11:14:19.780 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 77609 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/vfio/vfio_iommu_type1.ko 2023-11-13T11:14:19.780 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/vhost/ 2023-11-13T11:14:19.780 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 113873 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/vhost/vhost.ko 2023-11-13T11:14:19.780 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 17009 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/vhost/vhost_iotlb.ko 2023-11-13T11:14:19.780 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 58089 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/vhost/vhost_net.ko 2023-11-13T11:14:19.781 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 89249 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/vhost/vhost_scsi.ko 2023-11-13T11:14:19.781 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/video/ 2023-11-13T11:14:19.781 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/video/backlight/ 2023-11-13T11:14:19.781 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 15417 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/video/backlight/88pm860x_bl.ko 2023-11-13T11:14:19.781 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 12393 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/video/backlight/aat2870_bl.ko 2023-11-13T11:14:19.782 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 23305 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/video/backlight/adp5520_bl.ko 2023-11-13T11:14:19.782 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 32609 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/video/backlight/adp8860_bl.ko 2023-11-13T11:14:19.782 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 39993 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/video/backlight/adp8870_bl.ko 2023-11-13T11:14:19.782 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 16921 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/video/backlight/apple_bl.ko 2023-11-13T11:14:19.783 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 16777 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/video/backlight/as3711_bl.ko 2023-11-13T11:14:19.783 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 12097 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/video/backlight/bd6107.ko 2023-11-13T11:14:19.783 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 11409 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/video/backlight/da903x_bl.ko 2023-11-13T11:14:19.783 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 11273 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/video/backlight/da9052_bl.ko 2023-11-13T11:14:19.783 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 11753 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/video/backlight/gpio_backlight.ko 2023-11-13T11:14:19.784 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 14769 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/video/backlight/kb3886_bl.ko 2023-11-13T11:14:19.784 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 22017 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/video/backlight/lcd.ko 2023-11-13T11:14:19.784 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 23657 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/video/backlight/lm3533_bl.ko 2023-11-13T11:14:19.784 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 19337 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/video/backlight/lm3639_bl.ko 2023-11-13T11:14:19.784 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 11425 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/video/backlight/lv5207lp.ko 2023-11-13T11:14:19.785 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 14345 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/video/backlight/max8925_bl.ko 2023-11-13T11:14:19.785 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 11313 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/video/backlight/pandora_bl.ko 2023-11-13T11:14:19.785 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 10865 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/video/backlight/pcf50633-backlight.ko 2023-11-13T11:14:19.785 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 10897 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/video/backlight/platform_lcd.ko 2023-11-13T11:14:19.785 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 12721 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/video/backlight/wm831x_bl.ko 2023-11-13T11:14:19.786 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/w1/ 2023-11-13T11:14:19.786 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/w1/masters/ 2023-11-13T11:14:19.786 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 18785 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/w1/masters/ds2482.ko 2023-11-13T11:14:19.786 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 38985 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/w1/masters/ds2490.ko 2023-11-13T11:14:19.787 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 11265 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/w1/masters/matrox_w1.ko 2023-11-13T11:14:19.787 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 12417 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/w1/masters/w1-gpio.ko 2023-11-13T11:14:19.787 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/w1/slaves/ 2023-11-13T11:14:19.787 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 12041 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/w1/slaves/w1_ds2406.ko 2023-11-13T11:14:19.787 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 22809 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/w1/slaves/w1_ds2408.ko 2023-11-13T11:14:19.788 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 15113 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/w1/slaves/w1_ds2413.ko 2023-11-13T11:14:19.788 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 10825 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/w1/slaves/w1_ds2423.ko 2023-11-13T11:14:19.788 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 14153 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/w1/slaves/w1_ds2431.ko 2023-11-13T11:14:19.788 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 11929 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/w1/slaves/w1_ds2433.ko 2023-11-13T11:14:19.788 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 14113 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/w1/slaves/w1_ds2780.ko 2023-11-13T11:14:19.789 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 14049 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/w1/slaves/w1_ds2781.ko 2023-11-13T11:14:19.789 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 17921 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/w1/slaves/w1_ds28e04.ko 2023-11-13T11:14:19.789 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 7385 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/w1/slaves/w1_smem.ko 2023-11-13T11:14:19.789 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 56425 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/w1/slaves/w1_therm.ko 2023-11-13T11:14:19.790 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 102673 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/w1/wire.ko 2023-11-13T11:14:19.790 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/watchdog/ 2023-11-13T11:14:19.790 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 18793 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/watchdog/acquirewdt.ko 2023-11-13T11:14:19.790 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 19977 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/watchdog/advantechwdt.ko 2023-11-13T11:14:19.790 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 18561 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/watchdog/alim1535_wdt.ko 2023-11-13T11:14:19.791 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 22969 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/watchdog/alim7101_wdt.ko 2023-11-13T11:14:19.791 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 19113 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/watchdog/cpu5wdt.ko 2023-11-13T11:14:19.791 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 13617 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/watchdog/da9052_wdt.ko 2023-11-13T11:14:19.791 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 12777 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/watchdog/da9055_wdt.ko 2023-11-13T11:14:19.791 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 17409 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/watchdog/da9063_wdt.ko 2023-11-13T11:14:19.792 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 20169 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/watchdog/dw_wdt.ko 2023-11-13T11:14:19.792 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 20265 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/watchdog/eurotechwdt.ko 2023-11-13T11:14:19.792 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 23865 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/watchdog/f71808e_wdt.ko 2023-11-13T11:14:19.792 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 27401 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/watchdog/hpwdt.ko 2023-11-13T11:14:19.793 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 15577 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/watchdog/i6300esb.ko 2023-11-13T11:14:19.793 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 10833 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/watchdog/iTCO_vendor_support.ko 2023-11-13T11:14:19.793 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 21913 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/watchdog/iTCO_wdt.ko 2023-11-13T11:14:19.793 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 19241 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/watchdog/ib700wdt.ko 2023-11-13T11:14:19.793 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 18689 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/watchdog/ibmasr.ko 2023-11-13T11:14:19.794 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 19713 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/watchdog/ie6xx_wdt.ko 2023-11-13T11:14:19.794 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 21225 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/watchdog/it8712f_wdt.ko 2023-11-13T11:14:19.794 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 13841 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/watchdog/it87_wdt.ko 2023-11-13T11:14:19.794 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 21489 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/watchdog/kempld_wdt.ko 2023-11-13T11:14:19.794 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 18617 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/watchdog/machzwd.ko 2023-11-13T11:14:19.795 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 14721 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/watchdog/mena21_wdt.ko 2023-11-13T11:14:19.795 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 13217 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/watchdog/menf21bmc_wdt.ko 2023-11-13T11:14:19.795 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 24673 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/watchdog/nv_tco.ko 2023-11-13T11:14:19.795 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 17737 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/watchdog/of_xilinx_wdt.ko 2023-11-13T11:14:19.796 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 22265 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/watchdog/pc87413_wdt.ko 2023-11-13T11:14:19.796 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 38657 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/watchdog/pcwd_pci.ko 2023-11-13T11:14:19.796 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 31825 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/watchdog/pcwd_usb.ko 2023-11-13T11:14:19.796 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 13129 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/watchdog/retu_wdt.ko 2023-11-13T11:14:19.796 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 20449 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/watchdog/sbc60xxwdt.ko 2023-11-13T11:14:19.797 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 14129 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/watchdog/sbc_epx_c3.ko 2023-11-13T11:14:19.797 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 17321 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2023-11-13T11:14:19.797 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 23809 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/watchdog/sc1200wdt.ko 2023-11-13T11:14:19.797 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 23321 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/watchdog/sch311x_wdt.ko 2023-11-13T11:14:19.798 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 21577 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/watchdog/smsc37b787_wdt.ko 2023-11-13T11:14:19.798 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 17273 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/watchdog/softdog.ko 2023-11-13T11:14:19.798 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 22273 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/watchdog/sp5100_tco.ko 2023-11-13T11:14:19.798 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 12817 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/watchdog/twl4030_wdt.ko 2023-11-13T11:14:19.799 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 17649 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/watchdog/via_wdt.ko 2023-11-13T11:14:19.799 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 19161 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/watchdog/w83627hf_wdt.ko 2023-11-13T11:14:19.799 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 20681 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/watchdog/w83877f_wdt.ko 2023-11-13T11:14:19.799 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 25409 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/watchdog/w83977f_wdt.ko 2023-11-13T11:14:19.799 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 18497 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/watchdog/wafer5823wdt.ko 2023-11-13T11:14:19.800 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 28089 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/watchdog/wdt_pci.ko 2023-11-13T11:14:19.800 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 16257 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/watchdog/wm831x_wdt.ko 2023-11-13T11:14:19.800 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 13785 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/watchdog/wm8350_wdt.ko 2023-11-13T11:14:19.800 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 15697 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/watchdog/xen_wdt.ko 2023-11-13T11:14:19.800 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/xen/ 2023-11-13T11:14:19.801 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 24729 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/xen/xen-evtchn.ko 2023-11-13T11:14:19.801 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 26769 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/xen/xen-gntalloc.ko 2023-11-13T11:14:19.801 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 47865 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/xen/xen-gntdev.ko 2023-11-13T11:14:19.801 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/xen/xen-pciback/ 2023-11-13T11:14:19.802 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 176441 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2023-11-13T11:14:19.802 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 40121 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/xen/xen-privcmd.ko 2023-11-13T11:14:19.802 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 71249 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/xen/xen-scsiback.ko 2023-11-13T11:14:19.802 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/xen/xenfs/ 2023-11-13T11:14:19.802 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 19425 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/xen/xenfs/xenfs.ko 2023-11-13T11:14:19.803 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/ 2023-11-13T11:14:19.803 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/9p/ 2023-11-13T11:14:19.803 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 166425 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/9p/9p.ko 2023-11-13T11:14:19.803 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/adfs/ 2023-11-13T11:14:19.803 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 61073 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/adfs/adfs.ko 2023-11-13T11:14:19.804 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/affs/ 2023-11-13T11:14:19.804 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 163593 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/affs/affs.ko 2023-11-13T11:14:19.804 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/afs/ 2023-11-13T11:14:19.804 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 932817 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/afs/kafs.ko 2023-11-13T11:14:19.804 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/autofs/ 2023-11-13T11:14:19.805 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 101057 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/autofs/autofs4.ko 2023-11-13T11:14:19.805 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/befs/ 2023-11-13T11:14:19.805 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 64545 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/befs/befs.ko 2023-11-13T11:14:19.805 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/bfs/ 2023-11-13T11:14:19.806 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 41257 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/bfs/bfs.ko 2023-11-13T11:14:19.806 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 34585 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/binfmt_misc.ko 2023-11-13T11:14:19.806 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/btrfs/ 2023-11-13T11:14:19.806 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 3402585 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/btrfs/btrfs.ko 2023-11-13T11:14:19.807 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/cachefiles/ 2023-11-13T11:14:19.807 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 306073 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/cachefiles/cachefiles.ko 2023-11-13T11:14:19.807 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/ceph/ 2023-11-13T11:14:19.807 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 1323873 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/ceph/ceph.ko 2023-11-13T11:14:19.807 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/coda/ 2023-11-13T11:14:19.808 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 100801 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/coda/coda.ko 2023-11-13T11:14:19.808 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/configfs/ 2023-11-13T11:14:19.808 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 108393 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/configfs/configfs.ko 2023-11-13T11:14:19.808 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/cramfs/ 2023-11-13T11:14:19.808 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 29625 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/cramfs/cramfs.ko 2023-11-13T11:14:19.809 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/dlm/ 2023-11-13T11:14:19.809 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 642577 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/dlm/dlm.ko 2023-11-13T11:14:19.809 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/efs/ 2023-11-13T11:14:19.809 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 36649 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/efs/efs.ko 2023-11-13T11:14:19.809 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/f2fs/ 2023-11-13T11:14:19.809 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 1505025 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/f2fs/f2fs.ko 2023-11-13T11:14:19.810 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/fat/ 2023-11-13T11:14:19.810 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 27929 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/fat/msdos.ko 2023-11-13T11:14:19.810 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/freevxfs/ 2023-11-13T11:14:19.810 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 42545 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/freevxfs/freevxfs.ko 2023-11-13T11:14:19.811 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/fscache/ 2023-11-13T11:14:19.811 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 226481 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/fscache/fscache.ko 2023-11-13T11:14:19.811 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/fuse/ 2023-11-13T11:14:19.811 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 24489 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/fuse/cuse.ko 2023-11-13T11:14:19.812 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/gfs2/ 2023-11-13T11:14:19.812 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 1231529 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/gfs2/gfs2.ko 2023-11-13T11:14:19.812 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/hfs/ 2023-11-13T11:14:19.812 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 141209 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/hfs/hfs.ko 2023-11-13T11:14:19.812 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/hfsplus/ 2023-11-13T11:14:19.813 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 222817 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/hfsplus/hfsplus.ko 2023-11-13T11:14:19.813 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/hpfs/ 2023-11-13T11:14:19.813 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 192329 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/hpfs/hpfs.ko 2023-11-13T11:14:19.813 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/isofs/ 2023-11-13T11:14:19.813 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 74065 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/isofs/isofs.ko 2023-11-13T11:14:19.814 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/jfs/ 2023-11-13T11:14:19.814 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 419497 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/jfs/jfs.ko 2023-11-13T11:14:19.814 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/lockd/ 2023-11-13T11:14:19.814 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 280313 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/lockd/lockd.ko 2023-11-13T11:14:19.815 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/minix/ 2023-11-13T11:14:19.815 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 89193 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/minix/minix.ko 2023-11-13T11:14:19.815 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/netfs/ 2023-11-13T11:14:19.815 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 124649 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/netfs/netfs.ko 2023-11-13T11:14:19.815 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/nfs/ 2023-11-13T11:14:19.816 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/nfs/blocklayout/ 2023-11-13T11:14:19.816 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 81449 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2023-11-13T11:14:19.816 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/nfs/filelayout/ 2023-11-13T11:14:19.816 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 59449 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2023-11-13T11:14:19.816 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/nfs/flexfilelayout/ 2023-11-13T11:14:19.817 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 117513 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2023-11-13T11:14:19.817 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 1055649 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/nfs/nfs.ko 2023-11-13T11:14:19.817 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 66441 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/nfs/nfsv2.ko 2023-11-13T11:14:19.817 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 120177 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/nfs/nfsv3.ko 2023-11-13T11:14:19.817 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 2041689 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/nfs/nfsv4.ko 2023-11-13T11:14:19.818 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/nfs_common/ 2023-11-13T11:14:19.818 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 16929 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/nfs_common/grace.ko 2023-11-13T11:14:19.818 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 16145 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/nfs_common/nfs_acl.ko 2023-11-13T11:14:19.818 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/nfsd/ 2023-11-13T11:14:19.819 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 1516809 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/nfsd/nfsd.ko 2023-11-13T11:14:19.819 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/nilfs2/ 2023-11-13T11:14:19.819 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 592833 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/nilfs2/nilfs2.ko 2023-11-13T11:14:19.819 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/nls/ 2023-11-13T11:14:19.820 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 13793 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/nls/mac-celtic.ko 2023-11-13T11:14:19.820 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 13169 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/nls/mac-centeuro.ko 2023-11-13T11:14:19.820 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 13793 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/nls/mac-croatian.ko 2023-11-13T11:14:19.820 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 12865 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/nls/mac-cyrillic.ko 2023-11-13T11:14:19.820 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 13481 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/nls/mac-gaelic.ko 2023-11-13T11:14:19.821 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 12857 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/nls/mac-greek.ko 2023-11-13T11:14:19.821 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 13793 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/nls/mac-iceland.ko 2023-11-13T11:14:19.821 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 13169 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/nls/mac-inuit.ko 2023-11-13T11:14:19.821 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 14097 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/nls/mac-roman.ko 2023-11-13T11:14:19.822 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 13793 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/nls/mac-romanian.ko 2023-11-13T11:14:19.822 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 13793 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/nls/mac-turkish.ko 2023-11-13T11:14:19.822 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 11297 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/nls/nls_ascii.ko 2023-11-13T11:14:19.822 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 12537 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/nls/nls_cp1250.ko 2023-11-13T11:14:19.822 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 12233 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/nls/nls_cp1251.ko 2023-11-13T11:14:19.823 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 12921 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/nls/nls_cp1255.ko 2023-11-13T11:14:19.823 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 12537 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/nls/nls_cp737.ko 2023-11-13T11:14:19.823 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 12537 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/nls/nls_cp775.ko 2023-11-13T11:14:19.823 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 12225 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/nls/nls_cp850.ko 2023-11-13T11:14:19.824 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 12225 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/nls/nls_cp852.ko 2023-11-13T11:14:19.824 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 12225 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/nls/nls_cp855.ko 2023-11-13T11:14:19.824 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 11913 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/nls/nls_cp857.ko 2023-11-13T11:14:19.824 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 12849 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/nls/nls_cp860.ko 2023-11-13T11:14:19.824 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 13161 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/nls/nls_cp861.ko 2023-11-13T11:14:19.825 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 13473 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/nls/nls_cp862.ko 2023-11-13T11:14:19.825 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 13161 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/nls/nls_cp863.ko 2023-11-13T11:14:19.825 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 12849 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/nls/nls_cp864.ko 2023-11-13T11:14:19.825 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 13161 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/nls/nls_cp865.ko 2023-11-13T11:14:19.825 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 12537 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/nls/nls_cp866.ko 2023-11-13T11:14:19.826 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 12225 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/nls/nls_cp869.ko 2023-11-13T11:14:19.826 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 11985 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/nls/nls_cp874.ko 2023-11-13T11:14:19.826 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 94137 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/nls/nls_cp932.ko 2023-11-13T11:14:19.826 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 142673 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/nls/nls_cp936.ko 2023-11-13T11:14:19.827 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 165745 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/nls/nls_cp949.ko 2023-11-13T11:14:19.827 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 118121 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/nls/nls_cp950.ko 2023-11-13T11:14:19.827 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 12457 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/nls/nls_euc-jp.ko 2023-11-13T11:14:19.827 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 11305 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/nls/nls_iso8859-1.ko 2023-11-13T11:14:19.827 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 11929 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/nls/nls_iso8859-13.ko 2023-11-13T11:14:19.828 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 11929 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/nls/nls_iso8859-14.ko 2023-11-13T11:14:19.828 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 11929 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/nls/nls_iso8859-15.ko 2023-11-13T11:14:19.828 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 11921 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/nls/nls_iso8859-2.ko 2023-11-13T11:14:19.828 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 11921 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/nls/nls_iso8859-3.ko 2023-11-13T11:14:19.828 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 11921 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/nls/nls_iso8859-4.ko 2023-11-13T11:14:19.829 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 11921 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/nls/nls_iso8859-5.ko 2023-11-13T11:14:19.829 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 11617 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/nls/nls_iso8859-6.ko 2023-11-13T11:14:19.829 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 12233 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/nls/nls_iso8859-7.ko 2023-11-13T11:14:19.829 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 11617 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/nls/nls_iso8859-9.ko 2023-11-13T11:14:19.830 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 12537 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/nls/nls_koi8-r.ko 2023-11-13T11:14:19.830 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 8017 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/nls/nls_koi8-ru.ko 2023-11-13T11:14:19.830 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 12537 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/nls/nls_koi8-u.ko 2023-11-13T11:14:19.830 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 7569 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/nls/nls_ucs2_utils.ko 2023-11-13T11:14:19.830 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 8337 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/nls/nls_utf8.ko 2023-11-13T11:14:19.831 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/ntfs/ 2023-11-13T11:14:19.831 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 219417 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/ntfs/ntfs.ko 2023-11-13T11:14:19.831 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/ocfs2/ 2023-11-13T11:14:19.831 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/ocfs2/cluster/ 2023-11-13T11:14:19.832 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 244409 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2023-11-13T11:14:19.832 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/ocfs2/dlm/ 2023-11-13T11:14:19.832 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 440737 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2023-11-13T11:14:19.832 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/ocfs2/dlmfs/ 2023-11-13T11:14:19.832 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 54049 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2023-11-13T11:14:19.833 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 2592433 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/ocfs2/ocfs2.ko 2023-11-13T11:14:19.833 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 17905 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2023-11-13T11:14:19.833 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 31729 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/ocfs2/ocfs2_stack_user.ko 2023-11-13T11:14:19.833 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 35897 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/ocfs2/ocfs2_stackglue.ko 2023-11-13T11:14:19.833 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/omfs/ 2023-11-13T11:14:19.834 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 53433 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/omfs/omfs.ko 2023-11-13T11:14:19.834 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/overlayfs/ 2023-11-13T11:14:19.834 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 352153 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/overlayfs/overlay.ko 2023-11-13T11:14:19.834 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/pstore/ 2023-11-13T11:14:19.834 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 54809 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/pstore/ramoops.ko 2023-11-13T11:14:19.835 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/qnx4/ 2023-11-13T11:14:19.835 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 26865 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/qnx4/qnx4.ko 2023-11-13T11:14:19.835 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/qnx6/ 2023-11-13T11:14:19.835 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 46689 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/qnx6/qnx6.ko 2023-11-13T11:14:19.835 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/quota/ 2023-11-13T11:14:19.836 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 30881 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/quota/quota_tree.ko 2023-11-13T11:14:19.836 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 14361 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/quota/quota_v1.ko 2023-11-13T11:14:19.836 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 22017 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/quota/quota_v2.ko 2023-11-13T11:14:19.836 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/reiserfs/ 2023-11-13T11:14:19.837 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 532673 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/reiserfs/reiserfs.ko 2023-11-13T11:14:19.837 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/romfs/ 2023-11-13T11:14:19.837 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 28641 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/romfs/romfs.ko 2023-11-13T11:14:19.837 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/smb/ 2023-11-13T11:14:19.838 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/smb/client/ 2023-11-13T11:14:19.838 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 2668121 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/smb/client/cifs.ko 2023-11-13T11:14:19.838 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/smb/common/ 2023-11-13T11:14:19.838 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 7161 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/smb/common/cifs_arc4.ko 2023-11-13T11:14:19.839 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 11257 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/smb/common/cifs_md4.ko 2023-11-13T11:14:19.839 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/squashfs/ 2023-11-13T11:14:19.839 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 134641 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/squashfs/squashfs.ko 2023-11-13T11:14:19.839 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/sysv/ 2023-11-13T11:14:19.839 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 90721 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/sysv/sysv.ko 2023-11-13T11:14:19.840 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/udf/ 2023-11-13T11:14:19.840 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 247737 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/udf/udf.ko 2023-11-13T11:14:19.840 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/ufs/ 2023-11-13T11:14:19.840 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 162497 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/ufs/ufs.ko 2023-11-13T11:14:19.840 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/xfs/ 2023-11-13T11:14:19.841 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 4010729 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/xfs/xfs.ko 2023-11-13T11:14:19.841 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/kernel/ 2023-11-13T11:14:19.841 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/kernel/locking/ 2023-11-13T11:14:19.841 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 75489 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/kernel/locking/locktorture.ko 2023-11-13T11:14:19.841 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/kernel/time/ 2023-11-13T11:14:19.842 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 13737 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/kernel/time/test_udelay.ko 2023-11-13T11:14:19.842 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 60553 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/kernel/torture.ko 2023-11-13T11:14:19.842 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/lib/ 2023-11-13T11:14:19.842 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 6833 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/lib/crc-itu-t.ko 2023-11-13T11:14:19.843 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 6529 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/lib/crc7.ko 2023-11-13T11:14:19.843 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 7025 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/lib/crc8.ko 2023-11-13T11:14:19.843 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/lib/crypto/ 2023-11-13T11:14:19.843 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 7097 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/lib/crypto/libarc4.ko 2023-11-13T11:14:19.844 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 37081 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/lib/crypto/libdes.ko 2023-11-13T11:14:19.844 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 13313 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/lib/interval_tree_test.ko 2023-11-13T11:14:19.844 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 8425 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/lib/libcrc32c.ko 2023-11-13T11:14:19.844 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 24953 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/lib/lru_cache.ko 2023-11-13T11:14:19.845 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/lib/lz4/ 2023-11-13T11:14:19.845 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 33801 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/lib/lz4/lz4_compress.ko 2023-11-13T11:14:19.845 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 22633 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/lib/lz4/lz4hc_compress.ko 2023-11-13T11:14:19.845 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/lib/math/ 2023-11-13T11:14:19.846 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 6617 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/lib/math/cordic.ko 2023-11-13T11:14:19.846 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 8233 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/lib/memory-notifier-error-inject.ko 2023-11-13T11:14:19.846 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 10929 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/lib/notifier-error-inject.ko 2023-11-13T11:14:19.846 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 14089 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/lib/percpu_test.ko 2023-11-13T11:14:19.847 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 8305 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/lib/pm-notifier-error-inject.ko 2023-11-13T11:14:19.847 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/lib/raid6/ 2023-11-13T11:14:19.847 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 143433 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/lib/raid6/raid6_pq.ko 2023-11-13T11:14:19.847 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 21105 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/lib/rbtree_test.ko 2023-11-13T11:14:19.847 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/lib/reed_solomon/ 2023-11-13T11:14:19.848 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 18753 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/lib/reed_solomon/reed_solomon.ko 2023-11-13T11:14:19.848 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 38841 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/lib/test-kstrtox.ko 2023-11-13T11:14:19.848 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 26321 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/lib/test-string_helpers.ko 2023-11-13T11:14:19.848 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 4760425 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/lib/test_bpf.ko 2023-11-13T11:14:19.848 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 49089 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/lib/test_firmware.ko 2023-11-13T11:14:19.849 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 6369 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/lib/test_module.ko 2023-11-13T11:14:19.849 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 20801 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/lib/test_user_copy.ko 2023-11-13T11:14:19.849 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 9585 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/lib/ts_bm.ko 2023-11-13T11:14:19.849 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 11121 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/lib/ts_fsm.ko 2023-11-13T11:14:19.849 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 9689 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/lib/ts_kmp.ko 2023-11-13T11:14:19.850 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/lib/xz/ 2023-11-13T11:14:19.850 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 13545 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/lib/xz/xz_dec_test.ko 2023-11-13T11:14:19.850 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/mm/ 2023-11-13T11:14:19.850 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 15425 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/mm/hwpoison-inject.ko 2023-11-13T11:14:19.851 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ 2023-11-13T11:14:19.851 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/6lowpan/ 2023-11-13T11:14:19.851 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 55737 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/6lowpan/6lowpan.ko 2023-11-13T11:14:19.851 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 7049 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/6lowpan/nhc_dest.ko 2023-11-13T11:14:19.851 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 7065 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/6lowpan/nhc_fragment.ko 2023-11-13T11:14:19.852 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 7049 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/6lowpan/nhc_hop.ko 2023-11-13T11:14:19.852 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 6985 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/6lowpan/nhc_ipv6.ko 2023-11-13T11:14:19.852 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 7065 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/6lowpan/nhc_mobility.ko 2023-11-13T11:14:19.852 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 7065 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/6lowpan/nhc_routing.ko 2023-11-13T11:14:19.852 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 15329 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/6lowpan/nhc_udp.ko 2023-11-13T11:14:19.853 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/802/ 2023-11-13T11:14:19.853 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 30385 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/802/garp.ko 2023-11-13T11:14:19.853 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 34809 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/802/mrp.ko 2023-11-13T11:14:19.853 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 8545 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/802/p8022.ko 2023-11-13T11:14:19.854 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 16345 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/802/psnap.ko 2023-11-13T11:14:19.854 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 11537 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/802/stp.ko 2023-11-13T11:14:19.854 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/8021q/ 2023-11-13T11:14:19.854 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 81737 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/8021q/8021q.ko 2023-11-13T11:14:19.854 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/9p/ 2023-11-13T11:14:19.855 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 198337 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/9p/9pnet.ko 2023-11-13T11:14:19.855 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 35977 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/9p/9pnet_fd.ko 2023-11-13T11:14:19.855 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 26345 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/9p/9pnet_rdma.ko 2023-11-13T11:14:19.855 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 32337 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/9p/9pnet_virtio.ko 2023-11-13T11:14:19.855 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/batman-adv/ 2023-11-13T11:14:19.856 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 649297 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/batman-adv/batman-adv.ko 2023-11-13T11:14:19.856 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/bridge/ 2023-11-13T11:14:19.856 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 63809 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/bridge/br_netfilter.ko 2023-11-13T11:14:19.856 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 777689 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/bridge/bridge.ko 2023-11-13T11:14:19.856 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/bridge/netfilter/ 2023-11-13T11:14:19.857 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 7657 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/bridge/netfilter/ebt_802_3.ko 2023-11-13T11:14:19.857 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 12385 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/bridge/netfilter/ebt_among.ko 2023-11-13T11:14:19.857 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 9169 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/bridge/netfilter/ebt_arp.ko 2023-11-13T11:14:19.857 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 9073 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/bridge/netfilter/ebt_arpreply.ko 2023-11-13T11:14:19.858 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 9625 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/bridge/netfilter/ebt_dnat.ko 2023-11-13T11:14:19.858 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 8737 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/bridge/netfilter/ebt_ip.ko 2023-11-13T11:14:19.858 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 9145 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/bridge/netfilter/ebt_ip6.ko 2023-11-13T11:14:19.858 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 9825 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/bridge/netfilter/ebt_limit.ko 2023-11-13T11:14:19.859 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 13217 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/bridge/netfilter/ebt_log.ko 2023-11-13T11:14:19.859 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 7585 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/bridge/netfilter/ebt_mark.ko 2023-11-13T11:14:19.859 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 7593 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/bridge/netfilter/ebt_mark_m.ko 2023-11-13T11:14:19.859 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 8385 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/bridge/netfilter/ebt_nflog.ko 2023-11-13T11:14:19.859 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 7537 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/bridge/netfilter/ebt_pkttype.ko 2023-11-13T11:14:19.860 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 9593 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/bridge/netfilter/ebt_redirect.ko 2023-11-13T11:14:19.860 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 8649 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/bridge/netfilter/ebt_snat.ko 2023-11-13T11:14:19.860 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 8889 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/bridge/netfilter/ebt_stp.ko 2023-11-13T11:14:19.860 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 12401 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/bridge/netfilter/ebt_vlan.ko 2023-11-13T11:14:19.861 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 11529 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/bridge/netfilter/ebtable_broute.ko 2023-11-13T11:14:19.861 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 9817 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/bridge/netfilter/ebtable_filter.ko 2023-11-13T11:14:19.861 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 9793 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/bridge/netfilter/ebtable_nat.ko 2023-11-13T11:14:19.861 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 55929 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/bridge/netfilter/ebtables.ko 2023-11-13T11:14:19.862 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 14041 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2023-11-13T11:14:19.862 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 13945 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2023-11-13T11:14:19.862 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ceph/ 2023-11-13T11:14:19.862 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 1047497 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ceph/libceph.ko 2023-11-13T11:14:19.863 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/core/ 2023-11-13T11:14:19.863 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 125697 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/core/pktgen.ko 2023-11-13T11:14:19.863 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/dccp/ 2023-11-13T11:14:19.863 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 194209 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/dccp/dccp.ko 2023-11-13T11:14:19.864 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 8665 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/dccp/dccp_diag.ko 2023-11-13T11:14:19.864 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 57881 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/dccp/dccp_ipv4.ko 2023-11-13T11:14:19.864 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 60337 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/dccp/dccp_ipv6.ko 2023-11-13T11:14:19.864 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/dsa/ 2023-11-13T11:14:19.865 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 390473 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/dsa/dsa_core.ko 2023-11-13T11:14:19.865 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 13337 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/dsa/tag_brcm.ko 2023-11-13T11:14:19.865 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 12577 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/dsa/tag_dsa.ko 2023-11-13T11:14:19.865 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 7721 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/dsa/tag_none.ko 2023-11-13T11:14:19.865 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 8953 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/dsa/tag_trailer.ko 2023-11-13T11:14:19.866 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/hsr/ 2023-11-13T11:14:19.866 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 99729 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/hsr/hsr.ko 2023-11-13T11:14:19.866 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ieee802154/ 2023-11-13T11:14:19.866 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ieee802154/6lowpan/ 2023-11-13T11:14:19.867 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 45233 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2023-11-13T11:14:19.867 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 254625 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ieee802154/ieee802154.ko 2023-11-13T11:14:19.867 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 47289 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ieee802154/ieee802154_socket.ko 2023-11-13T11:14:19.868 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ipv4/ 2023-11-13T11:14:19.868 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 24729 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ipv4/ah4.ko 2023-11-13T11:14:19.868 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 38905 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ipv4/esp4.ko 2023-11-13T11:14:19.868 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 48401 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ipv4/fou.ko 2023-11-13T11:14:19.868 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 18121 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ipv4/gre.ko 2023-11-13T11:14:19.869 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 48657 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ipv4/inet_diag.ko 2023-11-13T11:14:19.869 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 60633 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ipv4/ip_gre.ko 2023-11-13T11:14:19.869 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 61225 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ipv4/ip_tunnel.ko 2023-11-13T11:14:19.869 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 34505 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ipv4/ip_vti.ko 2023-11-13T11:14:19.870 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 14001 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ipv4/ipcomp.ko 2023-11-13T11:14:19.870 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 28841 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ipv4/ipip.ko 2023-11-13T11:14:19.870 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ipv4/netfilter/ 2023-11-13T11:14:19.870 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 37641 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ipv4/netfilter/arp_tables.ko 2023-11-13T11:14:19.871 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 8873 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ipv4/netfilter/arpt_mangle.ko 2023-11-13T11:14:19.871 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 10409 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ipv4/netfilter/arptable_filter.ko 2023-11-13T11:14:19.871 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 41673 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ipv4/netfilter/ip_tables.ko 2023-11-13T11:14:19.871 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 10057 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ipv4/netfilter/ipt_ECN.ko 2023-11-13T11:14:19.873 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 9681 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ipv4/netfilter/ipt_REJECT.ko 2023-11-13T11:14:19.873 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 14121 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2023-11-13T11:14:19.873 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 11177 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ipv4/netfilter/ipt_ah.ko 2023-11-13T11:14:19.874 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 14881 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2023-11-13T11:14:19.874 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 11305 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ipv4/netfilter/iptable_filter.ko 2023-11-13T11:14:19.874 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 11649 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ipv4/netfilter/iptable_mangle.ko 2023-11-13T11:14:19.874 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 14905 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ipv4/netfilter/iptable_nat.ko 2023-11-13T11:14:19.875 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 11545 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ipv4/netfilter/iptable_raw.ko 2023-11-13T11:14:19.875 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 10409 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ipv4/netfilter/iptable_security.ko 2023-11-13T11:14:19.875 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 12489 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2023-11-13T11:14:19.875 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 8817 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2023-11-13T11:14:19.876 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 27625 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2023-11-13T11:14:19.876 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 18225 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2023-11-13T11:14:19.876 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 13337 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2023-11-13T11:14:19.876 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 20561 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ipv4/netfilter/nf_reject_ipv4.ko 2023-11-13T11:14:19.877 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 9329 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2023-11-13T11:14:19.877 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 15177 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2023-11-13T11:14:19.877 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 9961 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2023-11-13T11:14:19.877 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 17113 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2023-11-13T11:14:19.877 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 9009 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2023-11-13T11:14:19.878 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 13073 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ipv4/tcp_bic.ko 2023-11-13T11:14:19.878 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 13737 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ipv4/tcp_dctcp.ko 2023-11-13T11:14:19.878 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 15369 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ipv4/tcp_diag.ko 2023-11-13T11:14:19.878 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 9537 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ipv4/tcp_highspeed.ko 2023-11-13T11:14:19.878 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 12401 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ipv4/tcp_htcp.ko 2023-11-13T11:14:19.879 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 10449 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ipv4/tcp_hybla.ko 2023-11-13T11:14:19.879 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 11473 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ipv4/tcp_illinois.ko 2023-11-13T11:14:19.879 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 10433 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ipv4/tcp_lp.ko 2023-11-13T11:14:19.879 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 8329 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ipv4/tcp_scalable.ko 2023-11-13T11:14:19.880 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 14425 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ipv4/tcp_vegas.ko 2023-11-13T11:14:19.880 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 10089 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ipv4/tcp_veno.ko 2023-11-13T11:14:19.880 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 10953 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ipv4/tcp_westwood.ko 2023-11-13T11:14:19.880 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 10185 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ipv4/tcp_yeah.ko 2023-11-13T11:14:19.880 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 22601 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ipv4/tunnel4.ko 2023-11-13T11:14:19.881 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 17097 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ipv4/udp_diag.ko 2023-11-13T11:14:19.881 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 41665 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ipv4/udp_tunnel.ko 2023-11-13T11:14:19.881 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 11425 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ipv4/xfrm4_tunnel.ko 2023-11-13T11:14:19.881 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ipv6/ 2023-11-13T11:14:19.881 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 26441 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ipv6/ah6.ko 2023-11-13T11:14:19.882 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 39537 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ipv6/esp6.ko 2023-11-13T11:14:19.882 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 14425 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ipv6/fou6.ko 2023-11-13T11:14:19.882 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 80897 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ipv6/ip6_gre.ko 2023-11-13T11:14:19.882 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 93577 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ipv6/ip6_tunnel.ko 2023-11-13T11:14:19.883 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 10825 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ipv6/ip6_udp_tunnel.ko 2023-11-13T11:14:19.883 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 53273 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ipv6/ip6_vti.ko 2023-11-13T11:14:19.883 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 13785 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ipv6/ipcomp6.ko 2023-11-13T11:14:19.883 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 19017 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ipv6/mip6.ko 2023-11-13T11:14:19.884 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ipv6/netfilter/ 2023-11-13T11:14:19.884 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 42169 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ipv6/netfilter/ip6_tables.ko 2023-11-13T11:14:19.884 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 11753 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ipv6/netfilter/ip6t_NPT.ko 2023-11-13T11:14:19.884 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 9753 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2023-11-13T11:14:19.885 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 14201 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2023-11-13T11:14:19.885 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 14337 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ipv6/netfilter/ip6t_ah.ko 2023-11-13T11:14:19.885 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 7801 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2023-11-13T11:14:19.885 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 16209 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ipv6/netfilter/ip6t_frag.ko 2023-11-13T11:14:19.885 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 16033 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2023-11-13T11:14:19.886 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 8913 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2023-11-13T11:14:19.886 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 9897 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ipv6/netfilter/ip6t_mh.ko 2023-11-13T11:14:19.886 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 10937 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2023-11-13T11:14:19.886 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 10897 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ipv6/netfilter/ip6t_rt.ko 2023-11-13T11:14:19.886 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 11321 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ipv6/netfilter/ip6table_filter.ko 2023-11-13T11:14:19.887 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 11121 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2023-11-13T11:14:19.887 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 15009 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ipv6/netfilter/ip6table_nat.ko 2023-11-13T11:14:19.887 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 11617 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ipv6/netfilter/ip6table_raw.ko 2023-11-13T11:14:19.887 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 10433 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ipv6/netfilter/ip6table_security.ko 2023-11-13T11:14:19.887 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 39113 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2023-11-13T11:14:19.888 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 8449 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2023-11-13T11:14:19.888 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 25945 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2023-11-13T11:14:19.888 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 9801 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2023-11-13T11:14:19.888 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 15393 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2023-11-13T11:14:19.889 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 9633 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2023-11-13T11:14:19.889 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 16025 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2023-11-13T11:14:19.889 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 9009 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2023-11-13T11:14:19.889 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 74073 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ipv6/sit.ko 2023-11-13T11:14:19.890 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 24193 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ipv6/tunnel6.ko 2023-11-13T11:14:19.890 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 23297 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ipv6/xfrm6_tunnel.ko 2023-11-13T11:14:19.890 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/key/ 2023-11-13T11:14:19.890 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 82833 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/key/af_key.ko 2023-11-13T11:14:19.891 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/l2tp/ 2023-11-13T11:14:19.891 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 125281 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/l2tp/l2tp_core.ko 2023-11-13T11:14:19.891 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 20177 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/l2tp/l2tp_debugfs.ko 2023-11-13T11:14:19.891 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 25953 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/l2tp/l2tp_eth.ko 2023-11-13T11:14:19.891 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 35569 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/l2tp/l2tp_ip.ko 2023-11-13T11:14:19.892 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 36713 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/l2tp/l2tp_ip6.ko 2023-11-13T11:14:19.892 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 33001 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/l2tp/l2tp_netlink.ko 2023-11-13T11:14:19.892 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 53241 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/l2tp/l2tp_ppp.ko 2023-11-13T11:14:19.892 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/lapb/ 2023-11-13T11:14:19.893 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 47977 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/lapb/lapb.ko 2023-11-13T11:14:19.893 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/llc/ 2023-11-13T11:14:19.893 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 23193 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/llc/llc.ko 2023-11-13T11:14:19.893 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 267777 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/llc/llc2.ko 2023-11-13T11:14:19.893 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/mac802154/ 2023-11-13T11:14:19.894 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 290417 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/mac802154/mac802154.ko 2023-11-13T11:14:19.894 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/mpls/ 2023-11-13T11:14:19.894 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 9393 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/mpls/mpls_gso.ko 2023-11-13T11:14:19.894 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/ 2023-11-13T11:14:19.895 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/ipset/ 2023-11-13T11:14:19.895 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 119585 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/ipset/ip_set.ko 2023-11-13T11:14:19.895 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 28353 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2023-11-13T11:14:19.895 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 26913 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2023-11-13T11:14:19.896 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 26369 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2023-11-13T11:14:19.896 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 100297 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2023-11-13T11:14:19.896 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 101441 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2023-11-13T11:14:19.896 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 102817 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2023-11-13T11:14:19.896 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 103481 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2023-11-13T11:14:19.897 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 112849 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2023-11-13T11:14:19.897 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 60329 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2023-11-13T11:14:19.897 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 109593 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2023-11-13T11:14:19.897 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 113129 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2023-11-13T11:14:19.898 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 112585 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2023-11-13T11:14:19.898 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 111585 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2023-11-13T11:14:19.898 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 114465 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2023-11-13T11:14:19.898 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 30025 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/ipset/ip_set_list_set.ko 2023-11-13T11:14:19.899 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/ipvs/ 2023-11-13T11:14:19.899 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 411729 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/ipvs/ip_vs.ko 2023-11-13T11:14:19.899 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 11961 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2023-11-13T11:14:19.899 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 7625 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2023-11-13T11:14:19.899 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 17729 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2023-11-13T11:14:19.900 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 17905 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2023-11-13T11:14:19.900 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 20737 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2023-11-13T11:14:19.900 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 7689 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2023-11-13T11:14:19.900 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 7689 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2023-11-13T11:14:19.900 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 10681 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2023-11-13T11:14:19.901 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 9233 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2023-11-13T11:14:19.901 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 7697 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2023-11-13T11:14:19.901 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 13521 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2023-11-13T11:14:19.901 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 7697 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2023-11-13T11:14:19.902 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 10993 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2023-11-13T11:14:19.902 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 49257 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/nf_conncount.ko 2023-11-13T11:14:19.902 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 408257 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/nf_conntrack.ko 2023-11-13T11:14:19.902 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 15985 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/nf_conntrack_amanda.ko 2023-11-13T11:14:19.903 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 10177 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/nf_conntrack_broadcast.ko 2023-11-13T11:14:19.903 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 33761 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/nf_conntrack_ftp.ko 2023-11-13T11:14:19.903 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 118145 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/nf_conntrack_h323.ko 2023-11-13T11:14:19.903 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 22185 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/nf_conntrack_irc.ko 2023-11-13T11:14:19.903 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 8817 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2023-11-13T11:14:19.904 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 107297 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/nf_conntrack_netlink.ko 2023-11-13T11:14:19.904 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 33633 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/nf_conntrack_pptp.ko 2023-11-13T11:14:19.904 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 17401 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/nf_conntrack_sane.ko 2023-11-13T11:14:19.904 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 66641 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/nf_conntrack_sip.ko 2023-11-13T11:14:19.905 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 11233 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/nf_conntrack_snmp.ko 2023-11-13T11:14:19.905 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 19185 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/nf_conntrack_tftp.ko 2023-11-13T11:14:19.905 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 10113 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/nf_dup_netdev.ko 2023-11-13T11:14:19.905 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 89473 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/nf_flow_table.ko 2023-11-13T11:14:19.906 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 9593 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/nf_flow_table_inet.ko 2023-11-13T11:14:19.906 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 37129 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/nf_log_syslog.ko 2023-11-13T11:14:19.906 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 95417 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/nf_nat.ko 2023-11-13T11:14:19.906 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 10129 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/nf_nat_amanda.ko 2023-11-13T11:14:19.907 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 12625 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/nf_nat_ftp.ko 2023-11-13T11:14:19.907 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 11857 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/nf_nat_irc.ko 2023-11-13T11:14:19.907 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 28929 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/nf_nat_sip.ko 2023-11-13T11:14:19.907 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 8809 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/nf_nat_tftp.ko 2023-11-13T11:14:19.907 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 44065 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/nf_synproxy_core.ko 2023-11-13T11:14:19.908 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 615313 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/nf_tables.ko 2023-11-13T11:14:19.908 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 42561 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/nfnetlink.ko 2023-11-13T11:14:19.908 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 30233 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/nfnetlink_acct.ko 2023-11-13T11:14:19.908 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 30569 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/nfnetlink_cttimeout.ko 2023-11-13T11:14:19.908 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 39785 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/nfnetlink_log.ko 2023-11-13T11:14:19.909 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 22921 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/nfnetlink_osf.ko 2023-11-13T11:14:19.909 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 49377 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/nfnetlink_queue.ko 2023-11-13T11:14:19.909 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 10457 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/nft_chain_nat.ko 2023-11-13T11:14:19.909 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 33209 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/nft_compat.ko 2023-11-13T11:14:19.909 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 40721 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/nft_ct.ko 2023-11-13T11:14:19.910 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 9601 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/nft_dup_netdev.ko 2023-11-13T11:14:19.910 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 11401 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/nft_fib.ko 2023-11-13T11:14:19.910 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 13745 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/nft_fwd_netdev.ko 2023-11-13T11:14:19.910 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 14185 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/nft_hash.ko 2023-11-13T11:14:19.910 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 20065 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/nft_limit.ko 2023-11-13T11:14:19.911 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 15401 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/nft_log.ko 2023-11-13T11:14:19.911 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 14801 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/nft_masq.ko 2023-11-13T11:14:19.911 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 14329 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/nft_nat.ko 2023-11-13T11:14:19.911 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 13673 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/nft_numgen.ko 2023-11-13T11:14:19.911 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 11841 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/nft_osf.ko 2023-11-13T11:14:19.912 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 14073 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/nft_queue.ko 2023-11-13T11:14:19.912 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 14193 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/nft_redir.ko 2023-11-13T11:14:19.912 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 10497 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/nft_reject.ko 2023-11-13T11:14:19.912 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 10081 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/nft_reject_inet.ko 2023-11-13T11:14:19.912 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 12737 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/nft_socket.ko 2023-11-13T11:14:19.913 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 20369 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/nft_synproxy.ko 2023-11-13T11:14:19.913 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 14849 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/nft_tproxy.ko 2023-11-13T11:14:19.913 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 89313 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/x_tables.ko 2023-11-13T11:14:19.913 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 12097 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/xt_AUDIT.ko 2023-11-13T11:14:19.913 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 9633 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/xt_CHECKSUM.ko 2023-11-13T11:14:19.914 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 7729 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/xt_CLASSIFY.ko 2023-11-13T11:14:19.914 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 11521 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/xt_CONNSECMARK.ko 2023-11-13T11:14:19.914 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 18169 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/xt_CT.ko 2023-11-13T11:14:19.914 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 10497 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/xt_DSCP.ko 2023-11-13T11:14:19.915 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 9465 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/xt_HL.ko 2023-11-13T11:14:19.915 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 13433 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/xt_HMARK.ko 2023-11-13T11:14:19.915 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 38873 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/xt_IDLETIMER.ko 2023-11-13T11:14:19.915 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 13889 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/xt_LED.ko 2023-11-13T11:14:19.916 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 11489 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/xt_LOG.ko 2023-11-13T11:14:19.916 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 11753 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/xt_MASQUERADE.ko 2023-11-13T11:14:19.916 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 11657 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/xt_NETMAP.ko 2023-11-13T11:14:19.916 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 9473 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/xt_NFLOG.ko 2023-11-13T11:14:19.917 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 13289 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/xt_NFQUEUE.ko 2023-11-13T11:14:19.917 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 19665 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/xt_RATEEST.ko 2023-11-13T11:14:19.917 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 11073 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/xt_REDIRECT.ko 2023-11-13T11:14:19.917 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 14337 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/xt_SECMARK.ko 2023-11-13T11:14:19.917 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 16057 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/xt_TCPMSS.ko 2023-11-13T11:14:19.918 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 10433 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2023-11-13T11:14:19.918 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 17361 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/xt_TEE.ko 2023-11-13T11:14:19.918 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 16785 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/xt_TPROXY.ko 2023-11-13T11:14:19.918 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 8321 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/xt_TRACE.ko 2023-11-13T11:14:19.919 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 13897 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/xt_addrtype.ko 2023-11-13T11:14:19.919 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 13897 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/xt_bpf.ko 2023-11-13T11:14:19.919 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 15529 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/xt_cgroup.ko 2023-11-13T11:14:19.919 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 11209 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/xt_cluster.ko 2023-11-13T11:14:19.919 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 7505 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/xt_comment.ko 2023-11-13T11:14:19.920 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 10465 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/xt_connbytes.ko 2023-11-13T11:14:19.920 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 11081 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/xt_connlabel.ko 2023-11-13T11:14:19.920 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 9401 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/xt_connlimit.ko 2023-11-13T11:14:19.920 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 13129 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/xt_connmark.ko 2023-11-13T11:14:19.920 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 12401 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/xt_conntrack.ko 2023-11-13T11:14:19.921 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 7817 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/xt_cpu.ko 2023-11-13T11:14:19.921 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 10969 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/xt_dccp.ko 2023-11-13T11:14:19.921 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 7865 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/xt_devgroup.ko 2023-11-13T11:14:19.921 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 8801 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/xt_dscp.ko 2023-11-13T11:14:19.921 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 10657 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/xt_ecn.ko 2023-11-13T11:14:19.922 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 11473 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/xt_esp.ko 2023-11-13T11:14:19.922 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 43289 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/xt_hashlimit.ko 2023-11-13T11:14:19.922 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 11313 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/xt_helper.ko 2023-11-13T11:14:19.922 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 7865 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/xt_hl.ko 2023-11-13T11:14:19.923 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 11921 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/xt_ipcomp.ko 2023-11-13T11:14:19.923 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 11473 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/xt_iprange.ko 2023-11-13T11:14:19.923 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 11785 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/xt_ipvs.ko 2023-11-13T11:14:19.923 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 16041 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/xt_l2tp.ko 2023-11-13T11:14:19.924 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 8001 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/xt_length.ko 2023-11-13T11:14:19.924 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 10273 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/xt_limit.ko 2023-11-13T11:14:19.924 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 7545 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/xt_mac.ko 2023-11-13T11:14:19.924 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 8641 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/xt_mark.ko 2023-11-13T11:14:19.924 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 11825 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/xt_multiport.ko 2023-11-13T11:14:19.925 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 13817 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/xt_nat.ko 2023-11-13T11:14:19.925 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 10105 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/xt_nfacct.ko 2023-11-13T11:14:19.925 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 8297 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/xt_osf.ko 2023-11-13T11:14:19.925 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 9553 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/xt_owner.ko 2023-11-13T11:14:19.925 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 9729 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/xt_physdev.ko 2023-11-13T11:14:19.926 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 7633 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/xt_pkttype.ko 2023-11-13T11:14:19.926 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 11985 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/xt_policy.ko 2023-11-13T11:14:19.926 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 9473 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/xt_quota.ko 2023-11-13T11:14:19.926 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 10409 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/xt_rateest.ko 2023-11-13T11:14:19.927 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 8257 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/xt_realm.ko 2023-11-13T11:14:19.927 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 36497 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/xt_recent.ko 2023-11-13T11:14:19.927 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 13393 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/xt_sctp.ko 2023-11-13T11:14:19.927 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 30089 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/xt_set.ko 2023-11-13T11:14:19.927 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 16089 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/xt_socket.ko 2023-11-13T11:14:19.928 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 9505 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/xt_state.ko 2023-11-13T11:14:19.928 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 9473 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/xt_statistic.ko 2023-11-13T11:14:19.928 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 8809 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/xt_string.ko 2023-11-13T11:14:19.928 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 8553 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/xt_tcpmss.ko 2023-11-13T11:14:19.929 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 15777 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/xt_tcpudp.ko 2023-11-13T11:14:19.929 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 11129 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/xt_time.ko 2023-11-13T11:14:19.929 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 9401 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/xt_u32.ko 2023-11-13T11:14:19.929 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netlink/ 2023-11-13T11:14:19.929 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 13969 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netlink/netlink_diag.ko 2023-11-13T11:14:19.930 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/nsh/ 2023-11-13T11:14:19.930 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 12425 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/nsh/nsh.ko 2023-11-13T11:14:19.930 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/openvswitch/ 2023-11-13T11:14:19.930 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 380033 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/openvswitch/openvswitch.ko 2023-11-13T11:14:19.931 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 10321 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/openvswitch/vport-geneve.ko 2023-11-13T11:14:19.931 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 9449 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/openvswitch/vport-gre.ko 2023-11-13T11:14:19.931 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 11793 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/openvswitch/vport-vxlan.ko 2023-11-13T11:14:19.931 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/packet/ 2023-11-13T11:14:19.932 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 13057 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/packet/af_packet_diag.ko 2023-11-13T11:14:19.932 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/phonet/ 2023-11-13T11:14:19.932 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 110201 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/phonet/phonet.ko 2023-11-13T11:14:19.932 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 54697 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/phonet/pn_pep.ko 2023-11-13T11:14:19.932 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/rds/ 2023-11-13T11:14:19.933 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 251481 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/rds/rds.ko 2023-11-13T11:14:19.933 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 164937 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/rds/rds_rdma.ko 2023-11-13T11:14:19.933 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 67377 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/rds/rds_tcp.ko 2023-11-13T11:14:19.933 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/rxrpc/ 2023-11-13T11:14:19.933 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 819657 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/rxrpc/rxrpc.ko 2023-11-13T11:14:19.934 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/sched/ 2023-11-13T11:14:19.934 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 32241 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/sched/act_csum.ko 2023-11-13T11:14:19.934 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 23577 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/sched/act_gact.ko 2023-11-13T11:14:19.934 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 26873 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/sched/act_ipt.ko 2023-11-13T11:14:19.935 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 34097 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/sched/act_mirred.ko 2023-11-13T11:14:19.935 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 23401 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/sched/act_nat.ko 2023-11-13T11:14:19.935 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 43449 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/sched/act_pedit.ko 2023-11-13T11:14:19.935 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 31961 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/sched/act_police.ko 2023-11-13T11:14:19.935 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 20289 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/sched/act_simple.ko 2023-11-13T11:14:19.936 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 35297 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/sched/act_skbedit.ko 2023-11-13T11:14:19.936 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 36665 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/sched/act_vlan.ko 2023-11-13T11:14:19.936 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 26169 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/sched/cls_basic.ko 2023-11-13T11:14:19.936 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 33961 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/sched/cls_bpf.ko 2023-11-13T11:14:19.937 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 19233 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/sched/cls_cgroup.ko 2023-11-13T11:14:19.937 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 31401 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/sched/cls_flow.ko 2023-11-13T11:14:19.937 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 31769 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/sched/cls_fw.ko 2023-11-13T11:14:19.937 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 38489 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/sched/cls_route.ko 2023-11-13T11:14:19.937 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 61409 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/sched/cls_u32.ko 2023-11-13T11:14:19.938 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 7441 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/sched/em_cmp.ko 2023-11-13T11:14:19.938 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 13409 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/sched/em_ipset.ko 2023-11-13T11:14:19.938 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 33289 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/sched/em_meta.ko 2023-11-13T11:14:19.938 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 7897 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/sched/em_nbyte.ko 2023-11-13T11:14:19.939 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 10625 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/sched/em_text.ko 2023-11-13T11:14:19.939 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 7249 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/sched/em_u32.ko 2023-11-13T11:14:19.939 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 21649 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/sched/sch_choke.ko 2023-11-13T11:14:19.939 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 20849 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/sched/sch_codel.ko 2023-11-13T11:14:19.939 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 34633 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/sched/sch_drr.ko 2023-11-13T11:14:19.940 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 33609 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/sched/sch_fq.ko 2023-11-13T11:14:19.940 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 31617 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/sched/sch_fq_codel.ko 2023-11-13T11:14:19.940 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 35433 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/sched/sch_gred.ko 2023-11-13T11:14:19.940 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 49601 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/sched/sch_hfsc.ko 2023-11-13T11:14:19.941 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 22089 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/sched/sch_hhf.ko 2023-11-13T11:14:19.941 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 66393 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/sched/sch_htb.ko 2023-11-13T11:14:19.941 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 26073 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/sched/sch_ingress.ko 2023-11-13T11:14:19.941 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 30273 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/sched/sch_mqprio.ko 2023-11-13T11:14:19.941 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 10793 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/sched/sch_mqprio_lib.ko 2023-11-13T11:14:19.942 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 26065 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/sched/sch_multiq.ko 2023-11-13T11:14:19.942 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 36137 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/sched/sch_netem.ko 2023-11-13T11:14:19.942 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 27497 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/sched/sch_pie.ko 2023-11-13T11:14:19.942 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 10625 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/sched/sch_plug.ko 2023-11-13T11:14:19.942 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 24729 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/sched/sch_prio.ko 2023-11-13T11:14:19.943 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 48793 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/sched/sch_qfq.ko 2023-11-13T11:14:19.943 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 32905 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/sched/sch_red.ko 2023-11-13T11:14:19.943 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 26881 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/sched/sch_sfb.ko 2023-11-13T11:14:19.943 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 31353 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/sched/sch_sfq.ko 2023-11-13T11:14:19.944 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 28897 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/sched/sch_tbf.ko 2023-11-13T11:14:19.944 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 28105 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/sched/sch_teql.ko 2023-11-13T11:14:19.944 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/sctp/ 2023-11-13T11:14:19.944 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 929745 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/sctp/sctp.ko 2023-11-13T11:14:19.944 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 19033 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/sctp/sctp_diag.ko 2023-11-13T11:14:19.945 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/sunrpc/ 2023-11-13T11:14:19.945 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/sunrpc/auth_gss/ 2023-11-13T11:14:19.945 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 336529 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2023-11-13T11:14:19.945 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 54737 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2023-11-13T11:14:19.945 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 1520161 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/sunrpc/sunrpc.ko 2023-11-13T11:14:19.946 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/sunrpc/xprtrdma/ 2023-11-13T11:14:19.946 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 707721 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2023-11-13T11:14:19.946 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/tipc/ 2023-11-13T11:14:19.946 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 10025 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/tipc/diag.ko 2023-11-13T11:14:19.947 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 862641 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/tipc/tipc.ko 2023-11-13T11:14:19.947 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/unix/ 2023-11-13T11:14:19.947 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 15729 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/unix/unix_diag.ko 2023-11-13T11:14:19.947 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/vmw_vsock/ 2023-11-13T11:14:19.947 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 85337 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2023-11-13T11:14:19.948 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 68049 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2023-11-13T11:14:19.948 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 96193 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/vmw_vsock/vsock.ko 2023-11-13T11:14:19.948 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 10705 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/vmw_vsock/vsock_diag.ko 2023-11-13T11:14:19.949 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 17521 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/vmw_vsock/vsock_loopback.ko 2023-11-13T11:14:19.949 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/x25/ 2023-11-13T11:14:19.949 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 125177 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/x25/x25.ko 2023-11-13T11:14:19.949 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/xfrm/ 2023-11-13T11:14:19.949 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 22657 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/xfrm/xfrm_algo.ko 2023-11-13T11:14:19.950 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 20649 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/xfrm/xfrm_ipcomp.ko 2023-11-13T11:14:19.950 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 102257 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/xfrm/xfrm_user.ko 2023-11-13T11:14:19.950 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/virt/ 2023-11-13T11:14:19.950 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/virt/lib/ 2023-11-13T11:14:19.951 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 15537 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/virt/lib/irqbypass.ko 2023-11-13T11:14:19.951 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 639863 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/modules.alias 2023-11-13T11:14:19.951 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 623919 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/modules.alias.bin 2023-11-13T11:14:19.951 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 7663 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/modules.builtin 2023-11-13T11:14:19.951 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 23428 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/modules.builtin.alias.bin 2023-11-13T11:14:19.952 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 9821 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/modules.builtin.bin 2023-11-13T11:14:19.952 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 70004 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/modules.builtin.modinfo 2023-11-13T11:14:19.952 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 146313 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/modules.dep 2023-11-13T11:14:19.952 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 232548 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/modules.dep.bin 2023-11-13T11:14:19.953 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 210 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/modules.devname 2023-11-13T11:14:19.953 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 72606 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/modules.order 2023-11-13T11:14:19.953 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 879 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/modules.softdep 2023-11-13T11:14:19.953 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 254438 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/modules.symbols 2023-11-13T11:14:19.953 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 309363 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/modules.symbols.bin 2023-11-13T11:14:19.954 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./usr/ 2023-11-13T11:14:19.954 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./usr/share/ 2023-11-13T11:14:19.954 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./usr/share/doc/ 2023-11-13T11:14:19.954 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./usr/share/doc/linux-image-6.6.0-rc5-g5b73517e0e2f/ 2023-11-13T11:14:19.955 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 174 2023-10-25 03:19 ./usr/share/doc/linux-image-6.6.0-rc5-g5b73517e0e2f/changelog.Debian.gz 2023-11-13T11:14:19.955 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 691 2023-10-25 03:19 ./usr/share/doc/linux-image-6.6.0-rc5-g5b73517e0e2f/copyright 2023-11-13T11:14:19.956 DEBUG:teuthology.task.kernel:get_image_version: 6.6.0-rc5-g5b73517e0e2f 2023-11-13T11:14:19.956 INFO:teuthology.task.kernel:searching for kernel 6.6.0-rc5-g5b73517e0e2f 2023-11-13T11:14:19.957 DEBUG:teuthology.orchestra.run.smithi102:> egrep '(submenu|menuentry.*6.6.0-rc5-g5b73517e0e2f).*{' /boot/grub/grub.cfg 2023-11-13T11:14:19.964 INFO:teuthology.orchestra.run.smithi102.stdout:submenu 'Advanced options for Ubuntu' $menuentry_id_option 'gnulinux-advanced-7e9e2103-8bb7-4452-b35a-3b1230743254' { 2023-11-13T11:14:19.965 INFO:teuthology.orchestra.run.smithi102.stdout: menuentry 'Ubuntu, with Linux 6.6.0-rc5-g5b73517e0e2f' --class ubuntu --class gnu-linux --class gnu --class os $menuentry_id_option 'gnulinux-6.6.0-rc5-g5b73517e0e2f-advanced-7e9e2103-8bb7-4452-b35a-3b1230743254' { 2023-11-13T11:14:19.965 INFO:teuthology.orchestra.run.smithi102.stdout: menuentry 'Ubuntu, with Linux 6.6.0-rc5-g5b73517e0e2f (recovery mode)' --class ubuntu --class gnu-linux --class gnu --class os $menuentry_id_option 'gnulinux-6.6.0-rc5-g5b73517e0e2f-recovery-7e9e2103-8bb7-4452-b35a-3b1230743254' { 2023-11-13T11:14:19.965 INFO:teuthology.task.kernel:submenu_title:Advanced options for Ubuntu> 2023-11-13T11:14:19.966 INFO:teuthology.task.kernel:default_title:Ubuntu, with Linux 6.6.0-rc5-g5b73517e0e2f 2023-11-13T11:14:19.966 DEBUG:teuthology.orchestra.run.smithi102:> /bin/echo -e 'cat </dev/null && sudo chmod a+x -- '/etc/grub.d/01_ceph_kernel.tmp~' && sudo mv -- '/etc/grub.d/01_ceph_kernel.tmp~' /etc/grub.d/01_ceph_kernel && sudo update-grub && rm /tmp/linux-image.deb && ( sleep 1 && sudo shutdown -r now & ) 2023-11-13T11:14:20.009 DEBUG:teuthology.task.kernel:Waiting for install on ubuntu@smithi102.front.sepia.ceph.com to complete... 2023-11-13T11:14:20.429 INFO:teuthology.orchestra.run.smithi102.stderr:Sourcing file `/etc/default/grub' 2023-11-13T11:14:20.431 INFO:teuthology.orchestra.run.smithi102.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2023-11-13T11:14:20.455 INFO:teuthology.orchestra.run.smithi102.stderr:Generating grub configuration file ... 2023-11-13T11:14:20.661 INFO:teuthology.orchestra.run.smithi102.stderr:Found linux image: /boot/vmlinuz-6.6.0-rc5-g5b73517e0e2f 2023-11-13T11:14:20.667 INFO:teuthology.orchestra.run.smithi102.stderr:Found initrd image: /boot/initrd.img-6.6.0-rc5-g5b73517e0e2f 2023-11-13T11:14:20.892 INFO:teuthology.orchestra.run.smithi102.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2023-11-13T11:14:20.898 INFO:teuthology.orchestra.run.smithi102.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2023-11-13T11:14:20.942 INFO:teuthology.orchestra.run.smithi102.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2023-11-13T11:14:20.947 INFO:teuthology.orchestra.run.smithi102.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2023-11-13T11:14:21.114 INFO:teuthology.orchestra.run.smithi102.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2023-11-13T11:14:21.115 INFO:teuthology.orchestra.run.smithi102.stderr:Systems on them will not be added to the GRUB boot configuration. 2023-11-13T11:14:21.115 INFO:teuthology.orchestra.run.smithi102.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2023-11-13T11:14:21.139 INFO:teuthology.orchestra.run.smithi102.stderr:done 2023-11-13T11:14:40.430 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2023-11-13T11:14:40.431 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi154.front.sepia.ceph.com' 2023-11-13T11:14:40.432 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi154.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-13T11:14:52.242 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2023-11-13T11:14:52.243 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi102.front.sepia.ceph.com' 2023-11-13T11:14:52.244 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi102.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-13T11:15:14.938 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.154 2023-11-13T11:15:23.946 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi154.front.sepia.ceph.com' 2023-11-13T11:15:23.947 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi154.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-13T11:15:26.714 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.102 2023-11-13T11:15:27.002 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.154 2023-11-13T11:15:35.724 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi102.front.sepia.ceph.com' 2023-11-13T11:15:35.725 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi102.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-13T11:15:39.006 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi154.front.sepia.ceph.com' 2023-11-13T11:15:39.007 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi154.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-13T11:15:42.074 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.154 2023-11-13T11:15:54.106 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.102 2023-11-13T11:15:57.078 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi154.front.sepia.ceph.com' 2023-11-13T11:15:57.079 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi154.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-13T11:15:57.505 DEBUG:teuthology.orchestra.run.smithi154:> true 2023-11-13T11:15:58.527 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi154.front.sepia.ceph.com' 2023-11-13T11:15:58.527 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.6.0-rc5-g5b73517e0e2f"... 2023-11-13T11:15:58.527 DEBUG:teuthology.orchestra.run.smithi154:> uname -r 2023-11-13T11:15:58.575 INFO:teuthology.orchestra.run.smithi154.stdout:6.6.0-rc5-g5b73517e0e2f 2023-11-13T11:15:58.576 DEBUG:teuthology.task.kernel:current kernel version is 6.6.0-rc5-g5b73517e0e2f vs 6.6.0-rc5-g5b73517e0e2f 2023-11-13T11:15:58.576 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2023-11-13T11:15:58.576 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2023-11-13T11:15:59.577 INFO:teuthology.task.kernel:Enabling kdb on mon.b... 2023-11-13T11:15:59.578 DEBUG:teuthology.orchestra.run.smithi154:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2023-11-13T11:15:59.789 INFO:teuthology.orchestra.run.smithi154.stdout:ttyS1 2023-11-13T11:15:59.855 DEBUG:teuthology.parallel:result is None 2023-11-13T11:16:06.108 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi102.front.sepia.ceph.com' 2023-11-13T11:16:06.108 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi102.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-13T11:16:06.445 DEBUG:teuthology.orchestra.run.smithi102:> true 2023-11-13T11:16:08.203 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi102.front.sepia.ceph.com' 2023-11-13T11:16:08.203 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.6.0-rc5-g5b73517e0e2f"... 2023-11-13T11:16:08.204 DEBUG:teuthology.orchestra.run.smithi102:> uname -r 2023-11-13T11:16:08.213 INFO:teuthology.orchestra.run.smithi102.stdout:6.6.0-rc5-g5b73517e0e2f 2023-11-13T11:16:08.213 DEBUG:teuthology.task.kernel:current kernel version is 6.6.0-rc5-g5b73517e0e2f vs 6.6.0-rc5-g5b73517e0e2f 2023-11-13T11:16:08.213 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2023-11-13T11:16:08.213 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2023-11-13T11:16:09.215 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2023-11-13T11:16:09.215 DEBUG:teuthology.orchestra.run.smithi102:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2023-11-13T11:16:09.378 INFO:teuthology.orchestra.run.smithi102.stdout:ttyS1 2023-11-13T11:16:09.437 DEBUG:teuthology.parallel:result is None 2023-11-13T11:16:09.437 INFO:teuthology.run_tasks:Running task internal.base... 2023-11-13T11:16:09.446 INFO:teuthology.task.internal:Creating test directory... 2023-11-13T11:16:09.446 DEBUG:teuthology.orchestra.run.smithi102:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-11-13T11:16:09.450 DEBUG:teuthology.orchestra.run.smithi154:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-11-13T11:16:09.460 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2023-11-13T11:16:09.472 INFO:teuthology.run_tasks:Running task internal.archive... 2023-11-13T11:16:09.486 INFO:teuthology.task.internal:Creating archive directory... 2023-11-13T11:16:09.486 DEBUG:teuthology.orchestra.run.smithi102:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-11-13T11:16:09.500 DEBUG:teuthology.orchestra.run.smithi154:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-11-13T11:16:09.536 INFO:teuthology.run_tasks:Running task internal.coredump... 2023-11-13T11:16:09.546 INFO:teuthology.task.internal:Enabling coredump saving... 2023-11-13T11:16:09.547 DEBUG:teuthology.orchestra.run.smithi102:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-11-13T11:16:09.581 DEBUG:teuthology.orchestra.run.smithi154:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-11-13T11:16:09.608 INFO:teuthology.orchestra.run.smithi154.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-11-13T11:16:09.625 INFO:teuthology.orchestra.run.smithi154.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-11-13T11:16:09.626 INFO:teuthology.orchestra.run.smithi102.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-11-13T11:16:09.641 INFO:teuthology.orchestra.run.smithi102.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-11-13T11:16:09.644 INFO:teuthology.run_tasks:Running task internal.sudo... 2023-11-13T11:16:09.652 INFO:teuthology.task.internal:Configuring sudo... 2023-11-13T11:16:09.652 DEBUG:teuthology.orchestra.run.smithi102:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-11-13T11:16:09.693 DEBUG:teuthology.orchestra.run.smithi154:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-11-13T11:16:09.715 INFO:teuthology.run_tasks:Running task internal.syslog... 2023-11-13T11:16:09.728 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2023-11-13T11:16:09.728 DEBUG:teuthology.orchestra.run.smithi102:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-11-13T11:16:09.761 DEBUG:teuthology.orchestra.run.smithi154:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-11-13T11:16:09.771 DEBUG:teuthology.orchestra.run.smithi102:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-11-13T11:16:09.823 DEBUG:teuthology.orchestra.run.smithi102:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-11-13T11:16:09.878 DEBUG:teuthology.orchestra.run.smithi102:> set -ex 2023-11-13T11:16:09.879 DEBUG:teuthology.orchestra.run.smithi102:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-11-13T11:16:09.956 DEBUG:teuthology.orchestra.run.smithi154:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-11-13T11:16:09.966 DEBUG:teuthology.orchestra.run.smithi154:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-11-13T11:16:10.020 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2023-11-13T11:16:10.020 DEBUG:teuthology.orchestra.run.smithi154:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-11-13T11:16:10.090 DEBUG:teuthology.orchestra.run.smithi102:> sudo service rsyslog restart 2023-11-13T11:16:10.094 DEBUG:teuthology.orchestra.run.smithi154:> sudo service rsyslog restart 2023-11-13T11:16:10.235 INFO:teuthology.run_tasks:Running task internal.timer... 2023-11-13T11:16:10.244 INFO:teuthology.task.internal:Starting timer... 2023-11-13T11:16:10.244 INFO:teuthology.run_tasks:Running task pcp... 2023-11-13T11:16:10.261 INFO:teuthology.run_tasks:Running task selinux... 2023-11-13T11:16:10.277 DEBUG:teuthology.task.selinux:Excluding smithi102: OS 'ubuntu' does not support SELinux 2023-11-13T11:16:10.278 DEBUG:teuthology.task.selinux:Excluding smithi154: OS 'ubuntu' does not support SELinux 2023-11-13T11:16:10.278 DEBUG:teuthology.task.selinux:Getting current SELinux state 2023-11-13T11:16:10.278 DEBUG:teuthology.task.selinux:Existing SELinux modes: {} 2023-11-13T11:16:10.279 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2023-11-13T11:16:10.279 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2023-11-13T11:16:10.292 INFO:teuthology.repo_utils:/home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main was just updated or references a specific commit; assuming it is current 2023-11-13T11:16:10.293 INFO:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2023-11-13T11:16:10.313 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2023-11-13T11:16:10.314 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi102.front.sepia.ceph.com,smithi154.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2023-11-13T11:24:55.803 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi102.front.sepia.ceph.com'), Remote(name='ubuntu@smithi154.front.sepia.ceph.com')] 2023-11-13T11:24:55.829 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi102.front.sepia.ceph.com' 2023-11-13T11:24:55.830 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi102.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-13T11:24:55.909 DEBUG:teuthology.orchestra.run.smithi102:> true 2023-11-13T11:24:56.037 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi102.front.sepia.ceph.com' 2023-11-13T11:24:56.038 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi154.front.sepia.ceph.com' 2023-11-13T11:24:56.038 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi154.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-13T11:24:56.112 DEBUG:teuthology.orchestra.run.smithi154:> true 2023-11-13T11:24:56.237 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi154.front.sepia.ceph.com' 2023-11-13T11:24:56.238 INFO:teuthology.run_tasks:Running task clock... 2023-11-13T11:24:56.247 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2023-11-13T11:24:56.248 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-11-13T11:24:56.249 DEBUG:teuthology.orchestra.run.smithi102:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-11-13T11:24:56.253 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-11-13T11:24:56.253 DEBUG:teuthology.orchestra.run.smithi154:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-11-13T11:24:56.288 INFO:teuthology.orchestra.run.smithi102.stdout:13 Nov 11:24:56 ntpd[27980]: ntpd 4.2.8p15@1.3728-o Wed Feb 16 17:13:02 UTC 2022 (1): Starting 2023-11-13T11:24:56.288 INFO:teuthology.orchestra.run.smithi102.stdout:13 Nov 11:24:56 ntpd[27980]: Command line: ntpd -gq 2023-11-13T11:24:56.289 INFO:teuthology.orchestra.run.smithi102.stdout:13 Nov 11:24:56 ntpd[27980]: ---------------------------------------------------- 2023-11-13T11:24:56.289 INFO:teuthology.orchestra.run.smithi102.stdout:13 Nov 11:24:56 ntpd[27980]: ntp-4 is maintained by Network Time Foundation, 2023-11-13T11:24:56.289 INFO:teuthology.orchestra.run.smithi102.stdout:13 Nov 11:24:56 ntpd[27980]: Inc. (NTF), a non-profit 501(c)(3) public-benefit 2023-11-13T11:24:56.289 INFO:teuthology.orchestra.run.smithi102.stdout:13 Nov 11:24:56 ntpd[27980]: corporation. Support and training for ntp-4 are 2023-11-13T11:24:56.289 INFO:teuthology.orchestra.run.smithi102.stdout:13 Nov 11:24:56 ntpd[27980]: available at https://www.nwtime.org/support 2023-11-13T11:24:56.290 INFO:teuthology.orchestra.run.smithi102.stdout:13 Nov 11:24:56 ntpd[27980]: ---------------------------------------------------- 2023-11-13T11:24:56.290 INFO:teuthology.orchestra.run.smithi102.stdout:13 Nov 11:24:56 ntpd[27980]: proto: precision = 0.042 usec (-24) 2023-11-13T11:24:56.291 INFO:teuthology.orchestra.run.smithi102.stdout:13 Nov 11:24:56 ntpd[27980]: basedate set to 2022-02-04 2023-11-13T11:24:56.291 INFO:teuthology.orchestra.run.smithi102.stdout:13 Nov 11:24:56 ntpd[27980]: gps base set to 2022-02-06 (week 2196) 2023-11-13T11:24:56.291 INFO:teuthology.orchestra.run.smithi102.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2023-11-13T11:24:56.292 INFO:teuthology.orchestra.run.smithi102.stdout:13 Nov 11:24:56 ntpd[27980]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2023-11-13T11:24:56.292 INFO:teuthology.orchestra.run.smithi102.stderr:restrict ::: KOD does nothing without LIMITED. 2023-11-13T11:24:56.293 INFO:teuthology.orchestra.run.smithi102.stdout:13 Nov 11:24:56 ntpd[27980]: restrict ::: KOD does nothing without LIMITED. 2023-11-13T11:24:56.293 INFO:teuthology.orchestra.run.smithi102.stdout:13 Nov 11:24:56 ntpd[27980]: Listen and drop on 0 v6wildcard [::]:123 2023-11-13T11:24:56.294 INFO:teuthology.orchestra.run.smithi102.stdout:13 Nov 11:24:56 ntpd[27980]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2023-11-13T11:24:56.294 INFO:teuthology.orchestra.run.smithi102.stdout:13 Nov 11:24:56 ntpd[27980]: Listen normally on 2 lo 127.0.0.1:123 2023-11-13T11:24:56.294 INFO:teuthology.orchestra.run.smithi102.stdout:13 Nov 11:24:56 ntpd[27980]: Listen normally on 3 enp3s0f1 172.21.15.102:123 2023-11-13T11:24:56.294 INFO:teuthology.orchestra.run.smithi102.stdout:13 Nov 11:24:56 ntpd[27980]: Listen normally on 4 lo [::1]:123 2023-11-13T11:24:56.294 INFO:teuthology.orchestra.run.smithi102.stdout:13 Nov 11:24:56 ntpd[27980]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:fe8f:d769%5]:123 2023-11-13T11:24:56.295 INFO:teuthology.orchestra.run.smithi102.stdout:13 Nov 11:24:56 ntpd[27980]: Listening on routing socket on fd #22 for interface updates 2023-11-13T11:24:56.318 INFO:teuthology.orchestra.run.smithi154.stdout:13 Nov 11:24:56 ntpd[28015]: ntpd 4.2.8p15@1.3728-o Wed Feb 16 17:13:02 UTC 2022 (1): Starting 2023-11-13T11:24:56.318 INFO:teuthology.orchestra.run.smithi154.stdout:13 Nov 11:24:56 ntpd[28015]: Command line: ntpd -gq 2023-11-13T11:24:56.318 INFO:teuthology.orchestra.run.smithi154.stdout:13 Nov 11:24:56 ntpd[28015]: ---------------------------------------------------- 2023-11-13T11:24:56.319 INFO:teuthology.orchestra.run.smithi154.stdout:13 Nov 11:24:56 ntpd[28015]: ntp-4 is maintained by Network Time Foundation, 2023-11-13T11:24:56.319 INFO:teuthology.orchestra.run.smithi154.stdout:13 Nov 11:24:56 ntpd[28015]: Inc. (NTF), a non-profit 501(c)(3) public-benefit 2023-11-13T11:24:56.319 INFO:teuthology.orchestra.run.smithi154.stdout:13 Nov 11:24:56 ntpd[28015]: corporation. Support and training for ntp-4 are 2023-11-13T11:24:56.319 INFO:teuthology.orchestra.run.smithi154.stdout:13 Nov 11:24:56 ntpd[28015]: available at https://www.nwtime.org/support 2023-11-13T11:24:56.319 INFO:teuthology.orchestra.run.smithi154.stdout:13 Nov 11:24:56 ntpd[28015]: ---------------------------------------------------- 2023-11-13T11:24:56.320 INFO:teuthology.orchestra.run.smithi154.stdout:13 Nov 11:24:56 ntpd[28015]: proto: precision = 0.042 usec (-24) 2023-11-13T11:24:56.320 INFO:teuthology.orchestra.run.smithi154.stdout:13 Nov 11:24:56 ntpd[28015]: basedate set to 2022-02-04 2023-11-13T11:24:56.321 INFO:teuthology.orchestra.run.smithi154.stdout:13 Nov 11:24:56 ntpd[28015]: gps base set to 2022-02-06 (week 2196) 2023-11-13T11:24:56.321 INFO:teuthology.orchestra.run.smithi154.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2023-11-13T11:24:56.322 INFO:teuthology.orchestra.run.smithi154.stdout:13 Nov 11:24:56 ntpd[28015]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2023-11-13T11:24:56.322 INFO:teuthology.orchestra.run.smithi154.stderr:restrict ::: KOD does nothing without LIMITED. 2023-11-13T11:24:56.323 INFO:teuthology.orchestra.run.smithi154.stdout:13 Nov 11:24:56 ntpd[28015]: restrict ::: KOD does nothing without LIMITED. 2023-11-13T11:24:56.323 INFO:teuthology.orchestra.run.smithi154.stdout:13 Nov 11:24:56 ntpd[28015]: Listen and drop on 0 v6wildcard [::]:123 2023-11-13T11:24:56.324 INFO:teuthology.orchestra.run.smithi154.stdout:13 Nov 11:24:56 ntpd[28015]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2023-11-13T11:24:56.324 INFO:teuthology.orchestra.run.smithi154.stdout:13 Nov 11:24:56 ntpd[28015]: Listen normally on 2 lo 127.0.0.1:123 2023-11-13T11:24:56.324 INFO:teuthology.orchestra.run.smithi154.stdout:13 Nov 11:24:56 ntpd[28015]: Listen normally on 3 enp3s0f1 172.21.15.154:123 2023-11-13T11:24:56.325 INFO:teuthology.orchestra.run.smithi154.stdout:13 Nov 11:24:56 ntpd[28015]: Listen normally on 4 lo [::1]:123 2023-11-13T11:24:56.325 INFO:teuthology.orchestra.run.smithi154.stdout:13 Nov 11:24:56 ntpd[28015]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:fe88:7761%5]:123 2023-11-13T11:24:56.325 INFO:teuthology.orchestra.run.smithi154.stdout:13 Nov 11:24:56 ntpd[28015]: Listening on routing socket on fd #22 for interface updates 2023-11-13T11:24:57.289 INFO:teuthology.orchestra.run.smithi102.stderr:13 Nov 11:24:57 ntpd[27980]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-13T11:24:57.289 INFO:teuthology.orchestra.run.smithi102.stderr:13 Nov 11:24:57 ntpd[27980]: can't open /var/log/ntpstats/rawstats.20231113: Permission denied 2023-11-13T11:24:57.289 INFO:teuthology.orchestra.run.smithi102.stderr:13 Nov 11:24:57 ntpd[27980]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-13T11:24:57.290 INFO:teuthology.orchestra.run.smithi102.stderr:13 Nov 11:24:57 ntpd[27980]: can't open /var/log/ntpstats/rawstats.20231113: Permission denied 2023-11-13T11:24:57.290 INFO:teuthology.orchestra.run.smithi102.stderr:13 Nov 11:24:57 ntpd[27980]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-11-13T11:24:57.290 INFO:teuthology.orchestra.run.smithi102.stderr:13 Nov 11:24:57 ntpd[27980]: can't open /var/log/ntpstats/peerstats.20231113: Permission denied 2023-11-13T11:24:57.318 INFO:teuthology.orchestra.run.smithi154.stderr:13 Nov 11:24:57 ntpd[28015]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-13T11:24:57.319 INFO:teuthology.orchestra.run.smithi154.stderr:13 Nov 11:24:57 ntpd[28015]: can't open /var/log/ntpstats/rawstats.20231113: Permission denied 2023-11-13T11:24:57.319 INFO:teuthology.orchestra.run.smithi154.stderr:13 Nov 11:24:57 ntpd[28015]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-13T11:24:57.319 INFO:teuthology.orchestra.run.smithi154.stderr:13 Nov 11:24:57 ntpd[28015]: can't open /var/log/ntpstats/rawstats.20231113: Permission denied 2023-11-13T11:24:57.319 INFO:teuthology.orchestra.run.smithi154.stderr:13 Nov 11:24:57 ntpd[28015]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-11-13T11:24:57.320 INFO:teuthology.orchestra.run.smithi154.stderr:13 Nov 11:24:57 ntpd[28015]: can't open /var/log/ntpstats/peerstats.20231113: Permission denied 2023-11-13T11:24:58.289 INFO:teuthology.orchestra.run.smithi102.stderr:13 Nov 11:24:58 ntpd[27980]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-13T11:24:58.289 INFO:teuthology.orchestra.run.smithi102.stderr:13 Nov 11:24:58 ntpd[27980]: can't open /var/log/ntpstats/rawstats.20231113: Permission denied 2023-11-13T11:24:58.290 INFO:teuthology.orchestra.run.smithi102.stderr:13 Nov 11:24:58 ntpd[27980]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-13T11:24:58.290 INFO:teuthology.orchestra.run.smithi102.stderr:13 Nov 11:24:58 ntpd[27980]: can't open /var/log/ntpstats/rawstats.20231113: Permission denied 2023-11-13T11:24:58.290 INFO:teuthology.orchestra.run.smithi102.stderr:13 Nov 11:24:58 ntpd[27980]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-13T11:24:58.290 INFO:teuthology.orchestra.run.smithi102.stderr:13 Nov 11:24:58 ntpd[27980]: can't open /var/log/ntpstats/rawstats.20231113: Permission denied 2023-11-13T11:24:58.290 INFO:teuthology.orchestra.run.smithi102.stderr:13 Nov 11:24:58 ntpd[27980]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-11-13T11:24:58.291 INFO:teuthology.orchestra.run.smithi102.stderr:13 Nov 11:24:58 ntpd[27980]: can't open /var/log/ntpstats/peerstats.20231113: Permission denied 2023-11-13T11:24:58.319 INFO:teuthology.orchestra.run.smithi154.stderr:13 Nov 11:24:58 ntpd[28015]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-13T11:24:58.319 INFO:teuthology.orchestra.run.smithi154.stderr:13 Nov 11:24:58 ntpd[28015]: can't open /var/log/ntpstats/rawstats.20231113: Permission denied 2023-11-13T11:24:58.319 INFO:teuthology.orchestra.run.smithi154.stderr:13 Nov 11:24:58 ntpd[28015]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-13T11:24:58.319 INFO:teuthology.orchestra.run.smithi154.stderr:13 Nov 11:24:58 ntpd[28015]: can't open /var/log/ntpstats/rawstats.20231113: Permission denied 2023-11-13T11:24:58.320 INFO:teuthology.orchestra.run.smithi154.stderr:13 Nov 11:24:58 ntpd[28015]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-13T11:24:58.320 INFO:teuthology.orchestra.run.smithi154.stderr:13 Nov 11:24:58 ntpd[28015]: can't open /var/log/ntpstats/rawstats.20231113: Permission denied 2023-11-13T11:24:58.320 INFO:teuthology.orchestra.run.smithi154.stderr:13 Nov 11:24:58 ntpd[28015]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-11-13T11:24:58.320 INFO:teuthology.orchestra.run.smithi154.stderr:13 Nov 11:24:58 ntpd[28015]: can't open /var/log/ntpstats/peerstats.20231113: Permission denied 2023-11-13T11:24:59.289 INFO:teuthology.orchestra.run.smithi102.stderr:13 Nov 11:24:59 ntpd[27980]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-13T11:24:59.289 INFO:teuthology.orchestra.run.smithi102.stderr:13 Nov 11:24:59 ntpd[27980]: can't open /var/log/ntpstats/rawstats.20231113: Permission denied 2023-11-13T11:24:59.290 INFO:teuthology.orchestra.run.smithi102.stderr:13 Nov 11:24:59 ntpd[27980]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-13T11:24:59.290 INFO:teuthology.orchestra.run.smithi102.stderr:13 Nov 11:24:59 ntpd[27980]: can't open /var/log/ntpstats/rawstats.20231113: Permission denied 2023-11-13T11:24:59.290 INFO:teuthology.orchestra.run.smithi102.stderr:13 Nov 11:24:59 ntpd[27980]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-11-13T11:24:59.290 INFO:teuthology.orchestra.run.smithi102.stderr:13 Nov 11:24:59 ntpd[27980]: can't open /var/log/ntpstats/peerstats.20231113: Permission denied 2023-11-13T11:24:59.318 INFO:teuthology.orchestra.run.smithi154.stderr:13 Nov 11:24:59 ntpd[28015]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-13T11:24:59.319 INFO:teuthology.orchestra.run.smithi154.stderr:13 Nov 11:24:59 ntpd[28015]: can't open /var/log/ntpstats/rawstats.20231113: Permission denied 2023-11-13T11:24:59.319 INFO:teuthology.orchestra.run.smithi154.stderr:13 Nov 11:24:59 ntpd[28015]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-13T11:24:59.319 INFO:teuthology.orchestra.run.smithi154.stderr:13 Nov 11:24:59 ntpd[28015]: can't open /var/log/ntpstats/rawstats.20231113: Permission denied 2023-11-13T11:24:59.319 INFO:teuthology.orchestra.run.smithi154.stderr:13 Nov 11:24:59 ntpd[28015]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-11-13T11:24:59.320 INFO:teuthology.orchestra.run.smithi154.stderr:13 Nov 11:24:59 ntpd[28015]: can't open /var/log/ntpstats/peerstats.20231113: Permission denied 2023-11-13T11:25:00.289 INFO:teuthology.orchestra.run.smithi102.stderr:13 Nov 11:25:00 ntpd[27980]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-13T11:25:00.290 INFO:teuthology.orchestra.run.smithi102.stderr:13 Nov 11:25:00 ntpd[27980]: can't open /var/log/ntpstats/rawstats.20231113: Permission denied 2023-11-13T11:25:00.290 INFO:teuthology.orchestra.run.smithi102.stderr:13 Nov 11:25:00 ntpd[27980]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-13T11:25:00.290 INFO:teuthology.orchestra.run.smithi102.stderr:13 Nov 11:25:00 ntpd[27980]: can't open /var/log/ntpstats/rawstats.20231113: Permission denied 2023-11-13T11:25:00.290 INFO:teuthology.orchestra.run.smithi102.stderr:13 Nov 11:25:00 ntpd[27980]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-13T11:25:00.291 INFO:teuthology.orchestra.run.smithi102.stderr:13 Nov 11:25:00 ntpd[27980]: can't open /var/log/ntpstats/rawstats.20231113: Permission denied 2023-11-13T11:25:00.291 INFO:teuthology.orchestra.run.smithi102.stderr:13 Nov 11:25:00 ntpd[27980]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-11-13T11:25:00.291 INFO:teuthology.orchestra.run.smithi102.stderr:13 Nov 11:25:00 ntpd[27980]: can't open /var/log/ntpstats/peerstats.20231113: Permission denied 2023-11-13T11:25:00.291 INFO:teuthology.orchestra.run.smithi102.stderr:13 Nov 11:25:00 ntpd[27980]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-13T11:25:00.291 INFO:teuthology.orchestra.run.smithi102.stderr:13 Nov 11:25:00 ntpd[27980]: can't open /var/log/ntpstats/rawstats.20231113: Permission denied 2023-11-13T11:25:00.292 INFO:teuthology.orchestra.run.smithi102.stderr:13 Nov 11:25:00 ntpd[27980]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-11-13T11:25:00.292 INFO:teuthology.orchestra.run.smithi102.stderr:13 Nov 11:25:00 ntpd[27980]: can't open /var/log/ntpstats/peerstats.20231113: Permission denied 2023-11-13T11:25:00.319 INFO:teuthology.orchestra.run.smithi154.stderr:13 Nov 11:25:00 ntpd[28015]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-13T11:25:00.320 INFO:teuthology.orchestra.run.smithi154.stderr:13 Nov 11:25:00 ntpd[28015]: can't open /var/log/ntpstats/rawstats.20231113: Permission denied 2023-11-13T11:25:00.320 INFO:teuthology.orchestra.run.smithi154.stderr:13 Nov 11:25:00 ntpd[28015]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-13T11:25:00.320 INFO:teuthology.orchestra.run.smithi154.stderr:13 Nov 11:25:00 ntpd[28015]: can't open /var/log/ntpstats/rawstats.20231113: Permission denied 2023-11-13T11:25:00.320 INFO:teuthology.orchestra.run.smithi154.stderr:13 Nov 11:25:00 ntpd[28015]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-13T11:25:00.320 INFO:teuthology.orchestra.run.smithi154.stderr:13 Nov 11:25:00 ntpd[28015]: can't open /var/log/ntpstats/rawstats.20231113: Permission denied 2023-11-13T11:25:00.321 INFO:teuthology.orchestra.run.smithi154.stderr:13 Nov 11:25:00 ntpd[28015]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-11-13T11:25:00.321 INFO:teuthology.orchestra.run.smithi154.stderr:13 Nov 11:25:00 ntpd[28015]: can't open /var/log/ntpstats/peerstats.20231113: Permission denied 2023-11-13T11:25:00.321 INFO:teuthology.orchestra.run.smithi154.stderr:13 Nov 11:25:00 ntpd[28015]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-13T11:25:00.321 INFO:teuthology.orchestra.run.smithi154.stderr:13 Nov 11:25:00 ntpd[28015]: can't open /var/log/ntpstats/rawstats.20231113: Permission denied 2023-11-13T11:25:00.321 INFO:teuthology.orchestra.run.smithi154.stderr:13 Nov 11:25:00 ntpd[28015]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-11-13T11:25:00.322 INFO:teuthology.orchestra.run.smithi154.stderr:13 Nov 11:25:00 ntpd[28015]: can't open /var/log/ntpstats/peerstats.20231113: Permission denied 2023-11-13T11:25:01.289 INFO:teuthology.orchestra.run.smithi102.stderr:13 Nov 11:25:01 ntpd[27980]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-13T11:25:01.289 INFO:teuthology.orchestra.run.smithi102.stderr:13 Nov 11:25:01 ntpd[27980]: can't open /var/log/ntpstats/rawstats.20231113: Permission denied 2023-11-13T11:25:01.289 INFO:teuthology.orchestra.run.smithi102.stderr:13 Nov 11:25:01 ntpd[27980]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-13T11:25:01.290 INFO:teuthology.orchestra.run.smithi102.stderr:13 Nov 11:25:01 ntpd[27980]: can't open /var/log/ntpstats/rawstats.20231113: Permission denied 2023-11-13T11:25:01.290 INFO:teuthology.orchestra.run.smithi102.stderr:13 Nov 11:25:01 ntpd[27980]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-11-13T11:25:01.290 INFO:teuthology.orchestra.run.smithi102.stderr:13 Nov 11:25:01 ntpd[27980]: can't open /var/log/ntpstats/peerstats.20231113: Permission denied 2023-11-13T11:25:01.318 INFO:teuthology.orchestra.run.smithi154.stderr:13 Nov 11:25:01 ntpd[28015]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-13T11:25:01.319 INFO:teuthology.orchestra.run.smithi154.stderr:13 Nov 11:25:01 ntpd[28015]: can't open /var/log/ntpstats/rawstats.20231113: Permission denied 2023-11-13T11:25:01.319 INFO:teuthology.orchestra.run.smithi154.stderr:13 Nov 11:25:01 ntpd[28015]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-13T11:25:01.319 INFO:teuthology.orchestra.run.smithi154.stderr:13 Nov 11:25:01 ntpd[28015]: can't open /var/log/ntpstats/rawstats.20231113: Permission denied 2023-11-13T11:25:01.319 INFO:teuthology.orchestra.run.smithi154.stderr:13 Nov 11:25:01 ntpd[28015]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-11-13T11:25:01.319 INFO:teuthology.orchestra.run.smithi154.stderr:13 Nov 11:25:01 ntpd[28015]: can't open /var/log/ntpstats/peerstats.20231113: Permission denied 2023-11-13T11:25:02.289 INFO:teuthology.orchestra.run.smithi102.stderr:13 Nov 11:25:02 ntpd[27980]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-13T11:25:02.290 INFO:teuthology.orchestra.run.smithi102.stderr:13 Nov 11:25:02 ntpd[27980]: can't open /var/log/ntpstats/rawstats.20231113: Permission denied 2023-11-13T11:25:02.290 INFO:teuthology.orchestra.run.smithi102.stderr:13 Nov 11:25:02 ntpd[27980]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-13T11:25:02.290 INFO:teuthology.orchestra.run.smithi102.stderr:13 Nov 11:25:02 ntpd[27980]: can't open /var/log/ntpstats/rawstats.20231113: Permission denied 2023-11-13T11:25:02.290 INFO:teuthology.orchestra.run.smithi102.stderr:13 Nov 11:25:02 ntpd[27980]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-13T11:25:02.290 INFO:teuthology.orchestra.run.smithi102.stderr:13 Nov 11:25:02 ntpd[27980]: can't open /var/log/ntpstats/rawstats.20231113: Permission denied 2023-11-13T11:25:02.291 INFO:teuthology.orchestra.run.smithi102.stderr:13 Nov 11:25:02 ntpd[27980]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-11-13T11:25:02.291 INFO:teuthology.orchestra.run.smithi102.stderr:13 Nov 11:25:02 ntpd[27980]: can't open /var/log/ntpstats/peerstats.20231113: Permission denied 2023-11-13T11:25:02.291 INFO:teuthology.orchestra.run.smithi102.stderr:13 Nov 11:25:02 ntpd[27980]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-13T11:25:02.291 INFO:teuthology.orchestra.run.smithi102.stderr:13 Nov 11:25:02 ntpd[27980]: can't open /var/log/ntpstats/rawstats.20231113: Permission denied 2023-11-13T11:25:02.291 INFO:teuthology.orchestra.run.smithi102.stderr:13 Nov 11:25:02 ntpd[27980]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-11-13T11:25:02.291 INFO:teuthology.orchestra.run.smithi102.stderr:13 Nov 11:25:02 ntpd[27980]: can't open /var/log/ntpstats/peerstats.20231113: Permission denied 2023-11-13T11:25:02.319 INFO:teuthology.orchestra.run.smithi154.stderr:13 Nov 11:25:02 ntpd[28015]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-13T11:25:02.319 INFO:teuthology.orchestra.run.smithi154.stderr:13 Nov 11:25:02 ntpd[28015]: can't open /var/log/ntpstats/rawstats.20231113: Permission denied 2023-11-13T11:25:02.319 INFO:teuthology.orchestra.run.smithi154.stderr:13 Nov 11:25:02 ntpd[28015]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-13T11:25:02.320 INFO:teuthology.orchestra.run.smithi154.stderr:13 Nov 11:25:02 ntpd[28015]: can't open /var/log/ntpstats/rawstats.20231113: Permission denied 2023-11-13T11:25:02.320 INFO:teuthology.orchestra.run.smithi154.stderr:13 Nov 11:25:02 ntpd[28015]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-13T11:25:02.320 INFO:teuthology.orchestra.run.smithi154.stderr:13 Nov 11:25:02 ntpd[28015]: can't open /var/log/ntpstats/rawstats.20231113: Permission denied 2023-11-13T11:25:02.320 INFO:teuthology.orchestra.run.smithi154.stderr:13 Nov 11:25:02 ntpd[28015]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-11-13T11:25:02.320 INFO:teuthology.orchestra.run.smithi154.stderr:13 Nov 11:25:02 ntpd[28015]: can't open /var/log/ntpstats/peerstats.20231113: Permission denied 2023-11-13T11:25:02.321 INFO:teuthology.orchestra.run.smithi154.stderr:13 Nov 11:25:02 ntpd[28015]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-13T11:25:02.321 INFO:teuthology.orchestra.run.smithi154.stderr:13 Nov 11:25:02 ntpd[28015]: can't open /var/log/ntpstats/rawstats.20231113: Permission denied 2023-11-13T11:25:02.321 INFO:teuthology.orchestra.run.smithi154.stderr:13 Nov 11:25:02 ntpd[28015]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-11-13T11:25:02.321 INFO:teuthology.orchestra.run.smithi154.stderr:13 Nov 11:25:02 ntpd[28015]: can't open /var/log/ntpstats/peerstats.20231113: Permission denied 2023-11-13T11:25:03.289 INFO:teuthology.orchestra.run.smithi102.stderr:13 Nov 11:25:03 ntpd[27980]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-13T11:25:03.289 INFO:teuthology.orchestra.run.smithi102.stderr:13 Nov 11:25:03 ntpd[27980]: can't open /var/log/ntpstats/rawstats.20231113: Permission denied 2023-11-13T11:25:03.289 INFO:teuthology.orchestra.run.smithi102.stderr:13 Nov 11:25:03 ntpd[27980]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-13T11:25:03.290 INFO:teuthology.orchestra.run.smithi102.stderr:13 Nov 11:25:03 ntpd[27980]: can't open /var/log/ntpstats/rawstats.20231113: Permission denied 2023-11-13T11:25:03.290 INFO:teuthology.orchestra.run.smithi102.stderr:13 Nov 11:25:03 ntpd[27980]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-11-13T11:25:03.290 INFO:teuthology.orchestra.run.smithi102.stderr:13 Nov 11:25:03 ntpd[27980]: can't open /var/log/ntpstats/peerstats.20231113: Permission denied 2023-11-13T11:25:03.290 INFO:teuthology.orchestra.run.smithi102.stdout:13 Nov 11:25:03 ntpd[27980]: ntpd: time slew -0.000848 s 2023-11-13T11:25:03.291 INFO:teuthology.orchestra.run.smithi102.stdout:ntpd: time slew -0.000848s 2023-11-13T11:25:03.291 INFO:teuthology.orchestra.run.smithi102.stderr:13 Nov 11:25:03 ntpd[27980]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2023-11-13T11:25:03.292 INFO:teuthology.orchestra.run.smithi102.stderr:13 Nov 11:25:03 ntpd[27980]: can't open /var/log/ntpstats/loopstats.20231113: Permission denied 2023-11-13T11:25:03.319 INFO:teuthology.orchestra.run.smithi154.stderr:13 Nov 11:25:03 ntpd[28015]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-13T11:25:03.319 INFO:teuthology.orchestra.run.smithi154.stderr:13 Nov 11:25:03 ntpd[28015]: can't open /var/log/ntpstats/rawstats.20231113: Permission denied 2023-11-13T11:25:03.319 INFO:teuthology.orchestra.run.smithi154.stderr:13 Nov 11:25:03 ntpd[28015]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-13T11:25:03.319 INFO:teuthology.orchestra.run.smithi154.stderr:13 Nov 11:25:03 ntpd[28015]: can't open /var/log/ntpstats/rawstats.20231113: Permission denied 2023-11-13T11:25:03.320 INFO:teuthology.orchestra.run.smithi154.stderr:13 Nov 11:25:03 ntpd[28015]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-11-13T11:25:03.320 INFO:teuthology.orchestra.run.smithi154.stderr:13 Nov 11:25:03 ntpd[28015]: can't open /var/log/ntpstats/peerstats.20231113: Permission denied 2023-11-13T11:25:03.320 INFO:teuthology.orchestra.run.smithi154.stdout:13 Nov 11:25:03 ntpd[28015]: ntpd: time slew -0.001541 s 2023-11-13T11:25:03.320 INFO:teuthology.orchestra.run.smithi154.stdout:ntpd: time slew -0.001541s 2023-11-13T11:25:03.321 INFO:teuthology.orchestra.run.smithi154.stderr:13 Nov 11:25:03 ntpd[28015]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2023-11-13T11:25:03.321 INFO:teuthology.orchestra.run.smithi154.stderr:13 Nov 11:25:03 ntpd[28015]: can't open /var/log/ntpstats/loopstats.20231113: Permission denied 2023-11-13T11:25:03.386 INFO:teuthology.orchestra.run.smithi102.stdout: remote refid st t when poll reach delay offset jitter 2023-11-13T11:25:03.387 INFO:teuthology.orchestra.run.smithi102.stdout:============================================================================== 2023-11-13T11:25:03.387 INFO:teuthology.orchestra.run.smithi102.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2023-11-13T11:25:03.387 INFO:teuthology.orchestra.run.smithi102.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2023-11-13T11:25:03.387 INFO:teuthology.orchestra.run.smithi102.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2023-11-13T11:25:03.387 INFO:teuthology.orchestra.run.smithi102.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2023-11-13T11:25:03.415 INFO:teuthology.orchestra.run.smithi154.stdout: remote refid st t when poll reach delay offset jitter 2023-11-13T11:25:03.415 INFO:teuthology.orchestra.run.smithi154.stdout:============================================================================== 2023-11-13T11:25:03.415 INFO:teuthology.orchestra.run.smithi154.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2023-11-13T11:25:03.416 INFO:teuthology.orchestra.run.smithi154.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2023-11-13T11:25:03.416 INFO:teuthology.orchestra.run.smithi154.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2023-11-13T11:25:03.416 INFO:teuthology.orchestra.run.smithi154.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2023-11-13T11:25:03.417 INFO:teuthology.run_tasks:Running task install... 2023-11-13T11:25:03.430 DEBUG:teuthology.task.install:project ceph 2023-11-13T11:25:03.431 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '35f0debb3cc28955b7132ef4c509cd138a09d56b'}} 2023-11-13T11:25:03.431 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '35f0debb3cc28955b7132ef4c509cd138a09d56b'} 2023-11-13T11:25:03.431 INFO:teuthology.task.install:Using flavor: default 2023-11-13T11:25:03.438 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2023-11-13T11:25:03.438 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']} 2023-11-13T11:25:03.439 DEBUG:teuthology.orchestra.run.smithi102:> sudo apt-key list | grep Ceph 2023-11-13T11:25:03.440 DEBUG:teuthology.orchestra.run.smithi154:> sudo apt-key list | grep Ceph 2023-11-13T11:25:03.543 INFO:teuthology.orchestra.run.smithi102.stderr:Warning: apt-key is deprecated. Manage keyring files in trusted.gpg.d instead (see apt-key(8)). 2023-11-13T11:25:03.569 INFO:teuthology.orchestra.run.smithi154.stderr:Warning: apt-key is deprecated. Manage keyring files in trusted.gpg.d instead (see apt-key(8)). 2023-11-13T11:25:03.596 INFO:teuthology.orchestra.run.smithi102.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2023-11-13T11:25:03.597 INFO:teuthology.orchestra.run.smithi102.stdout:uid [ unknown] Ceph.com (release key) 2023-11-13T11:25:03.597 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror on remote deb x86_64 2023-11-13T11:25:03.597 INFO:teuthology.task.install.deb:Installing system (non-project) packages: bison, flex, libelf-dev, libssl-dev, network-manager, iproute2, util-linux, dump, indent, libaio-dev, libtool-bin, uuid-dev, xfslibs-dev, postgresql, postgresql-client, postgresql-common, postgresql-contrib on remote deb x86_64 2023-11-13T11:25:03.598 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=35f0debb3cc28955b7132ef4c509cd138a09d56b 2023-11-13T11:25:03.622 INFO:teuthology.orchestra.run.smithi154.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2023-11-13T11:25:03.622 INFO:teuthology.orchestra.run.smithi154.stdout:uid [ unknown] Ceph.com (release key) 2023-11-13T11:25:03.623 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror on remote deb x86_64 2023-11-13T11:25:03.623 INFO:teuthology.task.install.deb:Installing system (non-project) packages: bison, flex, libelf-dev, libssl-dev, network-manager, iproute2, util-linux, dump, indent, libaio-dev, libtool-bin, uuid-dev, xfslibs-dev, postgresql, postgresql-client, postgresql-common, postgresql-contrib on remote deb x86_64 2023-11-13T11:25:03.624 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=35f0debb3cc28955b7132ef4c509cd138a09d56b 2023-11-13T11:25:03.753 INFO:teuthology.task.install.deb:Pulling from https://3.chacra.ceph.com/r/ceph/wip-mchangir-testing-20231110.052303/35f0debb3cc28955b7132ef4c509cd138a09d56b/ubuntu/jammy/flavors/default/ 2023-11-13T11:25:03.754 INFO:teuthology.task.install.deb:Package version is 18.0.0-7288-g35f0debb-1jammy 2023-11-13T11:25:04.002 DEBUG:teuthology.orchestra.run.smithi102:> set -ex 2023-11-13T11:25:04.003 DEBUG:teuthology.orchestra.run.smithi102:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2023-11-13T11:25:04.005 INFO:teuthology.task.install.deb:Pulling from https://3.chacra.ceph.com/r/ceph/wip-mchangir-testing-20231110.052303/35f0debb3cc28955b7132ef4c509cd138a09d56b/ubuntu/jammy/flavors/default/ 2023-11-13T11:25:04.005 INFO:teuthology.task.install.deb:Package version is 18.0.0-7288-g35f0debb-1jammy 2023-11-13T11:25:04.029 DEBUG:teuthology.orchestra.run.smithi102:> sudo apt-get update 2023-11-13T11:25:04.346 INFO:teuthology.orchestra.run.smithi102.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2023-11-13T11:25:04.353 INFO:teuthology.orchestra.run.smithi102.stdout:Hit:2 http://security.ubuntu.com/ubuntu jammy-security InRelease 2023-11-13T11:25:04.401 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2023-11-13T11:25:04.401 DEBUG:teuthology.orchestra.run.smithi154:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2023-11-13T11:25:04.417 INFO:teuthology.orchestra.run.smithi102.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2023-11-13T11:25:04.425 DEBUG:teuthology.orchestra.run.smithi154:> sudo apt-get update 2023-11-13T11:25:04.498 INFO:teuthology.orchestra.run.smithi102.stdout:Hit:4 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2023-11-13T11:25:04.599 INFO:teuthology.orchestra.run.smithi102.stdout:Ign:5 https://3.chacra.ceph.com/r/ceph/wip-mchangir-testing-20231110.052303/35f0debb3cc28955b7132ef4c509cd138a09d56b/ubuntu/jammy/flavors/default jammy InRelease 2023-11-13T11:25:04.618 INFO:teuthology.orchestra.run.smithi154.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2023-11-13T11:25:04.662 INFO:teuthology.orchestra.run.smithi154.stdout:Hit:2 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2023-11-13T11:25:04.675 INFO:teuthology.orchestra.run.smithi154.stdout:Hit:3 http://security.ubuntu.com/ubuntu jammy-security InRelease 2023-11-13T11:25:04.688 INFO:teuthology.orchestra.run.smithi102.stdout:Get:6 https://3.chacra.ceph.com/r/ceph/wip-mchangir-testing-20231110.052303/35f0debb3cc28955b7132ef4c509cd138a09d56b/ubuntu/jammy/flavors/default jammy Release [6,978 B] 2023-11-13T11:25:04.694 INFO:teuthology.orchestra.run.smithi154.stdout:Hit:4 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2023-11-13T11:25:04.787 INFO:teuthology.orchestra.run.smithi102.stdout:Ign:7 https://3.chacra.ceph.com/r/ceph/wip-mchangir-testing-20231110.052303/35f0debb3cc28955b7132ef4c509cd138a09d56b/ubuntu/jammy/flavors/default jammy Release.gpg 2023-11-13T11:25:04.814 INFO:teuthology.orchestra.run.smithi154.stdout:Ign:5 https://3.chacra.ceph.com/r/ceph/wip-mchangir-testing-20231110.052303/35f0debb3cc28955b7132ef4c509cd138a09d56b/ubuntu/jammy/flavors/default jammy InRelease 2023-11-13T11:25:04.871 INFO:teuthology.orchestra.run.smithi154.stdout:Get:6 https://3.chacra.ceph.com/r/ceph/wip-mchangir-testing-20231110.052303/35f0debb3cc28955b7132ef4c509cd138a09d56b/ubuntu/jammy/flavors/default jammy Release [6,978 B] 2023-11-13T11:25:04.882 INFO:teuthology.orchestra.run.smithi102.stdout:Get:8 https://3.chacra.ceph.com/r/ceph/wip-mchangir-testing-20231110.052303/35f0debb3cc28955b7132ef4c509cd138a09d56b/ubuntu/jammy/flavors/default jammy/main amd64 Packages [17.5 kB] 2023-11-13T11:25:04.928 INFO:teuthology.orchestra.run.smithi154.stdout:Ign:7 https://3.chacra.ceph.com/r/ceph/wip-mchangir-testing-20231110.052303/35f0debb3cc28955b7132ef4c509cd138a09d56b/ubuntu/jammy/flavors/default jammy Release.gpg 2023-11-13T11:25:04.987 INFO:teuthology.orchestra.run.smithi154.stdout:Get:8 https://3.chacra.ceph.com/r/ceph/wip-mchangir-testing-20231110.052303/35f0debb3cc28955b7132ef4c509cd138a09d56b/ubuntu/jammy/flavors/default jammy/main i386 Packages [3,410 B] 2023-11-13T11:25:05.043 INFO:teuthology.orchestra.run.smithi102.stdout:Get:9 https://3.chacra.ceph.com/r/ceph/wip-mchangir-testing-20231110.052303/35f0debb3cc28955b7132ef4c509cd138a09d56b/ubuntu/jammy/flavors/default jammy/main i386 Packages [3,410 B] 2023-11-13T11:25:05.059 INFO:teuthology.orchestra.run.smithi154.stdout:Get:9 https://3.chacra.ceph.com/r/ceph/wip-mchangir-testing-20231110.052303/35f0debb3cc28955b7132ef4c509cd138a09d56b/ubuntu/jammy/flavors/default jammy/main amd64 Packages [17.5 kB] 2023-11-13T11:25:05.150 INFO:teuthology.orchestra.run.smithi102.stdout:Fetched 27.9 kB in 1s (31.1 kB/s) 2023-11-13T11:25:05.227 INFO:teuthology.orchestra.run.smithi154.stdout:Fetched 27.9 kB in 1s (48.5 kB/s) 2023-11-13T11:25:06.063 INFO:teuthology.orchestra.run.smithi102.stdout:Reading package lists... 2023-11-13T11:25:06.080 DEBUG:teuthology.orchestra.run.smithi102:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=18.0.0-7288-g35f0debb-1jammy cephadm=18.0.0-7288-g35f0debb-1jammy ceph-mds=18.0.0-7288-g35f0debb-1jammy ceph-mgr=18.0.0-7288-g35f0debb-1jammy ceph-common=18.0.0-7288-g35f0debb-1jammy ceph-fuse=18.0.0-7288-g35f0debb-1jammy ceph-test=18.0.0-7288-g35f0debb-1jammy ceph-volume=18.0.0-7288-g35f0debb-1jammy radosgw=18.0.0-7288-g35f0debb-1jammy python3-rados=18.0.0-7288-g35f0debb-1jammy python3-rgw=18.0.0-7288-g35f0debb-1jammy python3-cephfs=18.0.0-7288-g35f0debb-1jammy python3-rbd=18.0.0-7288-g35f0debb-1jammy libcephfs2=18.0.0-7288-g35f0debb-1jammy libcephfs-dev=18.0.0-7288-g35f0debb-1jammy librados2=18.0.0-7288-g35f0debb-1jammy librbd1=18.0.0-7288-g35f0debb-1jammy rbd-fuse=18.0.0-7288-g35f0debb-1jammy python3-cephfs=18.0.0-7288-g35f0debb-1jammy cephfs-shell=18.0.0-7288-g35f0debb-1jammy cephfs-top=18.0.0-7288-g35f0debb-1jammy cephfs-mirror=18.0.0-7288-g35f0debb-1jammy 2023-11-13T11:25:06.143 INFO:teuthology.orchestra.run.smithi154.stdout:Reading package lists... 2023-11-13T11:25:06.155 INFO:teuthology.orchestra.run.smithi102.stdout:Reading package lists... 2023-11-13T11:25:06.160 DEBUG:teuthology.orchestra.run.smithi154:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=18.0.0-7288-g35f0debb-1jammy cephadm=18.0.0-7288-g35f0debb-1jammy ceph-mds=18.0.0-7288-g35f0debb-1jammy ceph-mgr=18.0.0-7288-g35f0debb-1jammy ceph-common=18.0.0-7288-g35f0debb-1jammy ceph-fuse=18.0.0-7288-g35f0debb-1jammy ceph-test=18.0.0-7288-g35f0debb-1jammy ceph-volume=18.0.0-7288-g35f0debb-1jammy radosgw=18.0.0-7288-g35f0debb-1jammy python3-rados=18.0.0-7288-g35f0debb-1jammy python3-rgw=18.0.0-7288-g35f0debb-1jammy python3-cephfs=18.0.0-7288-g35f0debb-1jammy python3-rbd=18.0.0-7288-g35f0debb-1jammy libcephfs2=18.0.0-7288-g35f0debb-1jammy libcephfs-dev=18.0.0-7288-g35f0debb-1jammy librados2=18.0.0-7288-g35f0debb-1jammy librbd1=18.0.0-7288-g35f0debb-1jammy rbd-fuse=18.0.0-7288-g35f0debb-1jammy python3-cephfs=18.0.0-7288-g35f0debb-1jammy cephfs-shell=18.0.0-7288-g35f0debb-1jammy cephfs-top=18.0.0-7288-g35f0debb-1jammy cephfs-mirror=18.0.0-7288-g35f0debb-1jammy 2023-11-13T11:25:06.236 INFO:teuthology.orchestra.run.smithi154.stdout:Reading package lists... 2023-11-13T11:25:06.321 INFO:teuthology.orchestra.run.smithi102.stdout:Building dependency tree... 2023-11-13T11:25:06.321 INFO:teuthology.orchestra.run.smithi102.stdout:Reading state information... 2023-11-13T11:25:06.401 INFO:teuthology.orchestra.run.smithi154.stdout:Building dependency tree... 2023-11-13T11:25:06.402 INFO:teuthology.orchestra.run.smithi154.stdout:Reading state information... 2023-11-13T11:25:06.473 INFO:teuthology.orchestra.run.smithi102.stdout:The following packages were automatically installed and are no longer required: 2023-11-13T11:25:06.473 INFO:teuthology.orchestra.run.smithi102.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2023-11-13T11:25:06.473 INFO:teuthology.orchestra.run.smithi102.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2023-11-13T11:25:06.474 INFO:teuthology.orchestra.run.smithi102.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2023-11-13T11:25:06.474 INFO:teuthology.orchestra.run.smithi102.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2023-11-13T11:25:06.476 INFO:teuthology.orchestra.run.smithi102.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2023-11-13T11:25:06.476 INFO:teuthology.orchestra.run.smithi102.stdout:Use 'sudo apt autoremove' to remove them. 2023-11-13T11:25:06.476 INFO:teuthology.orchestra.run.smithi102.stdout:The following additional packages will be installed: 2023-11-13T11:25:06.477 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2023-11-13T11:25:06.477 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd jq 2023-11-13T11:25:06.477 INFO:teuthology.orchestra.run.smithi102.stdout: libdouble-conversion3 libjq1 liblttng-ust1 liboath0 libonig5 libpcre2-16-0 2023-11-13T11:25:06.477 INFO:teuthology.orchestra.run.smithi102.stdout: libqt5core5a libqt5dbus5 libqt5network5 libradosstriper1 librdkafka1 librgw2 2023-11-13T11:25:06.477 INFO:teuthology.orchestra.run.smithi102.stdout: libsqlite3-mod-ceph libthrift-0.16.0 nvme-cli python-asyncssh-doc 2023-11-13T11:25:06.478 INFO:teuthology.orchestra.run.smithi102.stdout: python-babel-localedata python-pastedeploy-tpl python3-asyncssh 2023-11-13T11:25:06.478 INFO:teuthology.orchestra.run.smithi102.stdout: python3-babel python3-bcrypt python3-cachetools python3-ceph-argparse 2023-11-13T11:25:06.478 INFO:teuthology.orchestra.run.smithi102.stdout: python3-ceph-common python3-certifi python3-cheroot python3-cherrypy3 2023-11-13T11:25:06.478 INFO:teuthology.orchestra.run.smithi102.stdout: python3-cmd2 python3-colorama python3-google-auth python3-idna 2023-11-13T11:25:06.478 INFO:teuthology.orchestra.run.smithi102.stdout: python3-iniconfig python3-jaraco.classes python3-jaraco.collections 2023-11-13T11:25:06.479 INFO:teuthology.orchestra.run.smithi102.stdout: python3-jaraco.functools python3-jaraco.text python3-jinja2 python3-joblib 2023-11-13T11:25:06.479 INFO:teuthology.orchestra.run.smithi102.stdout: python3-kubernetes python3-logutils python3-mako python3-markupsafe 2023-11-13T11:25:06.479 INFO:teuthology.orchestra.run.smithi102.stdout: python3-natsort python3-openssl python3-paste python3-pastedeploy 2023-11-13T11:25:06.479 INFO:teuthology.orchestra.run.smithi102.stdout: python3-pastescript python3-pecan python3-pluggy python3-portend 2023-11-13T11:25:06.480 INFO:teuthology.orchestra.run.smithi102.stdout: python3-prettytable python3-psutil python3-py python3-pyasn1 2023-11-13T11:25:06.480 INFO:teuthology.orchestra.run.smithi102.stdout: python3-pyasn1-modules python3-pygments python3-pyinotify python3-pyperclip 2023-11-13T11:25:06.480 INFO:teuthology.orchestra.run.smithi102.stdout: python3-pytest python3-repoze.lru python3-requests python3-requests-oauthlib 2023-11-13T11:25:06.481 INFO:teuthology.orchestra.run.smithi102.stdout: python3-routes python3-rsa python3-simplegeneric python3-simplejson 2023-11-13T11:25:06.482 INFO:teuthology.orchestra.run.smithi102.stdout: python3-singledispatch python3-sklearn python3-sklearn-lib python3-tempita 2023-11-13T11:25:06.482 INFO:teuthology.orchestra.run.smithi102.stdout: python3-tempora python3-threadpoolctl python3-toml python3-urllib3 2023-11-13T11:25:06.482 INFO:teuthology.orchestra.run.smithi102.stdout: python3-waitress python3-wcwidth python3-webob python3-websocket 2023-11-13T11:25:06.483 INFO:teuthology.orchestra.run.smithi102.stdout: python3-webtest python3-werkzeug python3-zc.lockfile qttranslations5-l10n 2023-11-13T11:25:06.483 INFO:teuthology.orchestra.run.smithi102.stdout: socat xmlstarlet 2023-11-13T11:25:06.483 INFO:teuthology.orchestra.run.smithi102.stdout:Suggested packages: 2023-11-13T11:25:06.483 INFO:teuthology.orchestra.run.smithi102.stdout: python3-influxdb python-jinja2-doc python3-beaker python-mako-doc 2023-11-13T11:25:06.483 INFO:teuthology.orchestra.run.smithi102.stdout: python-natsort-doc python-openssl-doc python3-openssl-dbg httpd-wsgi 2023-11-13T11:25:06.484 INFO:teuthology.orchestra.run.smithi102.stdout: libapache2-mod-python libapache2-mod-scgi libjs-mochikit python-pecan-doc 2023-11-13T11:25:06.484 INFO:teuthology.orchestra.run.smithi102.stdout: python-psutil-doc subversion python-pygments-doc python-pyinotify-doc 2023-11-13T11:25:06.484 INFO:teuthology.orchestra.run.smithi102.stdout: python3-socks python-requests-doc python3-dap python-sklearn-doc ipython3 2023-11-13T11:25:06.484 INFO:teuthology.orchestra.run.smithi102.stdout: python-waitress-doc python-webob-doc python-webtest-doc python-werkzeug-doc 2023-11-13T11:25:06.484 INFO:teuthology.orchestra.run.smithi102.stdout: python3-watchdog 2023-11-13T11:25:06.485 INFO:teuthology.orchestra.run.smithi102.stdout:Recommended packages: 2023-11-13T11:25:06.485 INFO:teuthology.orchestra.run.smithi102.stdout: btrfs-tools 2023-11-13T11:25:06.552 INFO:teuthology.orchestra.run.smithi154.stdout:The following packages were automatically installed and are no longer required: 2023-11-13T11:25:06.552 INFO:teuthology.orchestra.run.smithi154.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2023-11-13T11:25:06.552 INFO:teuthology.orchestra.run.smithi154.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2023-11-13T11:25:06.552 INFO:teuthology.orchestra.run.smithi154.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2023-11-13T11:25:06.553 INFO:teuthology.orchestra.run.smithi154.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2023-11-13T11:25:06.555 INFO:teuthology.orchestra.run.smithi154.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2023-11-13T11:25:06.556 INFO:teuthology.orchestra.run.smithi154.stdout:Use 'sudo apt autoremove' to remove them. 2023-11-13T11:25:06.556 INFO:teuthology.orchestra.run.smithi154.stdout:The following additional packages will be installed: 2023-11-13T11:25:06.556 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2023-11-13T11:25:06.556 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd jq 2023-11-13T11:25:06.557 INFO:teuthology.orchestra.run.smithi154.stdout: libdouble-conversion3 libjq1 liblttng-ust1 liboath0 libonig5 libpcre2-16-0 2023-11-13T11:25:06.557 INFO:teuthology.orchestra.run.smithi154.stdout: libqt5core5a libqt5dbus5 libqt5network5 libradosstriper1 librdkafka1 librgw2 2023-11-13T11:25:06.557 INFO:teuthology.orchestra.run.smithi154.stdout: libsqlite3-mod-ceph libthrift-0.16.0 nvme-cli python-asyncssh-doc 2023-11-13T11:25:06.557 INFO:teuthology.orchestra.run.smithi154.stdout: python-babel-localedata python-pastedeploy-tpl python3-asyncssh 2023-11-13T11:25:06.557 INFO:teuthology.orchestra.run.smithi154.stdout: python3-babel python3-bcrypt python3-cachetools python3-ceph-argparse 2023-11-13T11:25:06.558 INFO:teuthology.orchestra.run.smithi154.stdout: python3-ceph-common python3-certifi python3-cheroot python3-cherrypy3 2023-11-13T11:25:06.558 INFO:teuthology.orchestra.run.smithi154.stdout: python3-cmd2 python3-colorama python3-google-auth python3-idna 2023-11-13T11:25:06.558 INFO:teuthology.orchestra.run.smithi154.stdout: python3-iniconfig python3-jaraco.classes python3-jaraco.collections 2023-11-13T11:25:06.558 INFO:teuthology.orchestra.run.smithi154.stdout: python3-jaraco.functools python3-jaraco.text python3-jinja2 python3-joblib 2023-11-13T11:25:06.558 INFO:teuthology.orchestra.run.smithi154.stdout: python3-kubernetes python3-logutils python3-mako python3-markupsafe 2023-11-13T11:25:06.559 INFO:teuthology.orchestra.run.smithi154.stdout: python3-natsort python3-openssl python3-paste python3-pastedeploy 2023-11-13T11:25:06.559 INFO:teuthology.orchestra.run.smithi154.stdout: python3-pastescript python3-pecan python3-pluggy python3-portend 2023-11-13T11:25:06.559 INFO:teuthology.orchestra.run.smithi154.stdout: python3-prettytable python3-psutil python3-py python3-pyasn1 2023-11-13T11:25:06.560 INFO:teuthology.orchestra.run.smithi154.stdout: python3-pyasn1-modules python3-pygments python3-pyinotify python3-pyperclip 2023-11-13T11:25:06.560 INFO:teuthology.orchestra.run.smithi154.stdout: python3-pytest python3-repoze.lru python3-requests python3-requests-oauthlib 2023-11-13T11:25:06.560 INFO:teuthology.orchestra.run.smithi154.stdout: python3-routes python3-rsa python3-simplegeneric python3-simplejson 2023-11-13T11:25:06.561 INFO:teuthology.orchestra.run.smithi154.stdout: python3-singledispatch python3-sklearn python3-sklearn-lib python3-tempita 2023-11-13T11:25:06.561 INFO:teuthology.orchestra.run.smithi154.stdout: python3-tempora python3-threadpoolctl python3-toml python3-urllib3 2023-11-13T11:25:06.561 INFO:teuthology.orchestra.run.smithi154.stdout: python3-waitress python3-wcwidth python3-webob python3-websocket 2023-11-13T11:25:06.561 INFO:teuthology.orchestra.run.smithi154.stdout: python3-webtest python3-werkzeug python3-zc.lockfile qttranslations5-l10n 2023-11-13T11:25:06.561 INFO:teuthology.orchestra.run.smithi154.stdout: socat xmlstarlet 2023-11-13T11:25:06.562 INFO:teuthology.orchestra.run.smithi154.stdout:Suggested packages: 2023-11-13T11:25:06.562 INFO:teuthology.orchestra.run.smithi154.stdout: python3-influxdb python-jinja2-doc python3-beaker python-mako-doc 2023-11-13T11:25:06.562 INFO:teuthology.orchestra.run.smithi154.stdout: python-natsort-doc python-openssl-doc python3-openssl-dbg httpd-wsgi 2023-11-13T11:25:06.562 INFO:teuthology.orchestra.run.smithi154.stdout: libapache2-mod-python libapache2-mod-scgi libjs-mochikit python-pecan-doc 2023-11-13T11:25:06.563 INFO:teuthology.orchestra.run.smithi154.stdout: python-psutil-doc subversion python-pygments-doc python-pyinotify-doc 2023-11-13T11:25:06.563 INFO:teuthology.orchestra.run.smithi154.stdout: python3-socks python-requests-doc python3-dap python-sklearn-doc ipython3 2023-11-13T11:25:06.563 INFO:teuthology.orchestra.run.smithi154.stdout: python-waitress-doc python-webob-doc python-webtest-doc python-werkzeug-doc 2023-11-13T11:25:06.563 INFO:teuthology.orchestra.run.smithi154.stdout: python3-watchdog 2023-11-13T11:25:06.563 INFO:teuthology.orchestra.run.smithi154.stdout:Recommended packages: 2023-11-13T11:25:06.563 INFO:teuthology.orchestra.run.smithi154.stdout: btrfs-tools 2023-11-13T11:25:06.622 INFO:teuthology.orchestra.run.smithi102.stdout:The following NEW packages will be installed: 2023-11-13T11:25:06.622 INFO:teuthology.orchestra.run.smithi102.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2023-11-13T11:25:06.622 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2023-11-13T11:25:06.622 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm 2023-11-13T11:25:06.623 INFO:teuthology.orchestra.run.smithi102.stdout: cephfs-mirror cephfs-shell cephfs-top jq libcephfs-dev libcephfs2 2023-11-13T11:25:06.623 INFO:teuthology.orchestra.run.smithi102.stdout: libdouble-conversion3 libjq1 liblttng-ust1 liboath0 libonig5 libpcre2-16-0 2023-11-13T11:25:06.623 INFO:teuthology.orchestra.run.smithi102.stdout: libqt5core5a libqt5dbus5 libqt5network5 librados2 libradosstriper1 librbd1 2023-11-13T11:25:06.624 INFO:teuthology.orchestra.run.smithi102.stdout: librdkafka1 librgw2 libsqlite3-mod-ceph libthrift-0.16.0 nvme-cli 2023-11-13T11:25:06.624 INFO:teuthology.orchestra.run.smithi102.stdout: python-asyncssh-doc python-babel-localedata python-pastedeploy-tpl 2023-11-13T11:25:06.625 INFO:teuthology.orchestra.run.smithi102.stdout: python3-asyncssh python3-babel python3-bcrypt python3-cachetools 2023-11-13T11:25:06.625 INFO:teuthology.orchestra.run.smithi102.stdout: python3-ceph-argparse python3-ceph-common python3-cephfs python3-certifi 2023-11-13T11:25:06.625 INFO:teuthology.orchestra.run.smithi102.stdout: python3-cheroot python3-cherrypy3 python3-cmd2 python3-colorama 2023-11-13T11:25:06.625 INFO:teuthology.orchestra.run.smithi102.stdout: python3-google-auth python3-idna python3-iniconfig python3-jaraco.classes 2023-11-13T11:25:06.626 INFO:teuthology.orchestra.run.smithi102.stdout: python3-jaraco.collections python3-jaraco.functools python3-jaraco.text 2023-11-13T11:25:06.626 INFO:teuthology.orchestra.run.smithi102.stdout: python3-jinja2 python3-joblib python3-kubernetes python3-logutils 2023-11-13T11:25:06.626 INFO:teuthology.orchestra.run.smithi102.stdout: python3-mako python3-markupsafe python3-natsort python3-openssl 2023-11-13T11:25:06.626 INFO:teuthology.orchestra.run.smithi102.stdout: python3-paste python3-pastedeploy python3-pastescript python3-pecan 2023-11-13T11:25:06.627 INFO:teuthology.orchestra.run.smithi102.stdout: python3-pluggy python3-portend python3-prettytable python3-psutil python3-py 2023-11-13T11:25:06.627 INFO:teuthology.orchestra.run.smithi102.stdout: python3-pyasn1 python3-pyasn1-modules python3-pygments python3-pyinotify 2023-11-13T11:25:06.627 INFO:teuthology.orchestra.run.smithi102.stdout: python3-pyperclip python3-pytest python3-rados python3-rbd 2023-11-13T11:25:06.627 INFO:teuthology.orchestra.run.smithi102.stdout: python3-repoze.lru python3-requests python3-requests-oauthlib python3-rgw 2023-11-13T11:25:06.627 INFO:teuthology.orchestra.run.smithi102.stdout: python3-routes python3-rsa python3-simplegeneric python3-simplejson 2023-11-13T11:25:06.628 INFO:teuthology.orchestra.run.smithi102.stdout: python3-singledispatch python3-sklearn python3-sklearn-lib python3-tempita 2023-11-13T11:25:06.628 INFO:teuthology.orchestra.run.smithi102.stdout: python3-tempora python3-threadpoolctl python3-toml python3-urllib3 2023-11-13T11:25:06.628 INFO:teuthology.orchestra.run.smithi102.stdout: python3-waitress python3-wcwidth python3-webob python3-websocket 2023-11-13T11:25:06.628 INFO:teuthology.orchestra.run.smithi102.stdout: python3-webtest python3-werkzeug python3-zc.lockfile qttranslations5-l10n 2023-11-13T11:25:06.628 INFO:teuthology.orchestra.run.smithi102.stdout: radosgw rbd-fuse socat xmlstarlet 2023-11-13T11:25:06.694 INFO:teuthology.orchestra.run.smithi102.stdout:0 upgraded, 114 newly installed, 0 to remove and 261 not upgraded. 2023-11-13T11:25:06.695 INFO:teuthology.orchestra.run.smithi102.stdout:Need to get 186 MB of archives. 2023-11-13T11:25:06.695 INFO:teuthology.orchestra.run.smithi102.stdout:After this operation, 829 MB of additional disk space will be used. 2023-11-13T11:25:06.695 INFO:teuthology.orchestra.run.smithi102.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyperclip all 1.8.2-2 [11.5 kB] 2023-11-13T11:25:06.699 INFO:teuthology.orchestra.run.smithi154.stdout:The following NEW packages will be installed: 2023-11-13T11:25:06.700 INFO:teuthology.orchestra.run.smithi154.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2023-11-13T11:25:06.700 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2023-11-13T11:25:06.700 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm 2023-11-13T11:25:06.701 INFO:teuthology.orchestra.run.smithi154.stdout: cephfs-mirror cephfs-shell cephfs-top jq libcephfs-dev libcephfs2 2023-11-13T11:25:06.702 INFO:teuthology.orchestra.run.smithi154.stdout: libdouble-conversion3 libjq1 liblttng-ust1 liboath0 libonig5 libpcre2-16-0 2023-11-13T11:25:06.702 INFO:teuthology.orchestra.run.smithi154.stdout: libqt5core5a libqt5dbus5 libqt5network5 librados2 libradosstriper1 librbd1 2023-11-13T11:25:06.702 INFO:teuthology.orchestra.run.smithi154.stdout: librdkafka1 librgw2 libsqlite3-mod-ceph libthrift-0.16.0 nvme-cli 2023-11-13T11:25:06.702 INFO:teuthology.orchestra.run.smithi154.stdout: python-asyncssh-doc python-babel-localedata python-pastedeploy-tpl 2023-11-13T11:25:06.703 INFO:teuthology.orchestra.run.smithi154.stdout: python3-asyncssh python3-babel python3-bcrypt python3-cachetools 2023-11-13T11:25:06.703 INFO:teuthology.orchestra.run.smithi154.stdout: python3-ceph-argparse python3-ceph-common python3-cephfs python3-certifi 2023-11-13T11:25:06.703 INFO:teuthology.orchestra.run.smithi154.stdout: python3-cheroot python3-cherrypy3 python3-cmd2 python3-colorama 2023-11-13T11:25:06.703 INFO:teuthology.orchestra.run.smithi154.stdout: python3-google-auth python3-idna python3-iniconfig python3-jaraco.classes 2023-11-13T11:25:06.703 INFO:teuthology.orchestra.run.smithi154.stdout: python3-jaraco.collections python3-jaraco.functools python3-jaraco.text 2023-11-13T11:25:06.704 INFO:teuthology.orchestra.run.smithi154.stdout: python3-jinja2 python3-joblib python3-kubernetes python3-logutils 2023-11-13T11:25:06.704 INFO:teuthology.orchestra.run.smithi154.stdout: python3-mako python3-markupsafe python3-natsort python3-openssl 2023-11-13T11:25:06.704 INFO:teuthology.orchestra.run.smithi154.stdout: python3-paste python3-pastedeploy python3-pastescript python3-pecan 2023-11-13T11:25:06.704 INFO:teuthology.orchestra.run.smithi154.stdout: python3-pluggy python3-portend python3-prettytable python3-psutil python3-py 2023-11-13T11:25:06.704 INFO:teuthology.orchestra.run.smithi154.stdout: python3-pyasn1 python3-pyasn1-modules python3-pygments python3-pyinotify 2023-11-13T11:25:06.704 INFO:teuthology.orchestra.run.smithi154.stdout: python3-pyperclip python3-pytest python3-rados python3-rbd 2023-11-13T11:25:06.705 INFO:teuthology.orchestra.run.smithi154.stdout: python3-repoze.lru python3-requests python3-requests-oauthlib python3-rgw 2023-11-13T11:25:06.705 INFO:teuthology.orchestra.run.smithi154.stdout: python3-routes python3-rsa python3-simplegeneric python3-simplejson 2023-11-13T11:25:06.705 INFO:teuthology.orchestra.run.smithi154.stdout: python3-singledispatch python3-sklearn python3-sklearn-lib python3-tempita 2023-11-13T11:25:06.705 INFO:teuthology.orchestra.run.smithi154.stdout: python3-tempora python3-threadpoolctl python3-toml python3-urllib3 2023-11-13T11:25:06.705 INFO:teuthology.orchestra.run.smithi154.stdout: python3-waitress python3-wcwidth python3-webob python3-websocket 2023-11-13T11:25:06.706 INFO:teuthology.orchestra.run.smithi154.stdout: python3-webtest python3-werkzeug python3-zc.lockfile qttranslations5-l10n 2023-11-13T11:25:06.706 INFO:teuthology.orchestra.run.smithi154.stdout: radosgw rbd-fuse socat xmlstarlet 2023-11-13T11:25:06.720 INFO:teuthology.orchestra.run.smithi102.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-wcwidth all 0.2.5+dfsg1-1 [21.9 kB] 2023-11-13T11:25:06.729 INFO:teuthology.orchestra.run.smithi102.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cmd2 all 2.3.3-1 [124 kB] 2023-11-13T11:25:06.780 INFO:teuthology.orchestra.run.smithi154.stdout:0 upgraded, 114 newly installed, 0 to remove and 261 not upgraded. 2023-11-13T11:25:06.780 INFO:teuthology.orchestra.run.smithi154.stdout:Need to get 186 MB of archives. 2023-11-13T11:25:06.780 INFO:teuthology.orchestra.run.smithi154.stdout:After this operation, 829 MB of additional disk space will be used. 2023-11-13T11:25:06.780 INFO:teuthology.orchestra.run.smithi154.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyperclip all 1.8.2-2 [11.5 kB] 2023-11-13T11:25:06.810 INFO:teuthology.orchestra.run.smithi154.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-wcwidth all 0.2.5+dfsg1-1 [21.9 kB] 2023-11-13T11:25:06.811 INFO:teuthology.orchestra.run.smithi102.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblttng-ust1 amd64 2.13.1-1ubuntu1 [190 kB] 2023-11-13T11:25:06.822 INFO:teuthology.orchestra.run.smithi154.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cmd2 all 2.3.3-1 [124 kB] 2023-11-13T11:25:06.863 INFO:teuthology.orchestra.run.smithi102.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libdouble-conversion3 amd64 3.1.7-4 [39.0 kB] 2023-11-13T11:25:06.870 INFO:teuthology.orchestra.run.smithi102.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpcre2-16-0 amd64 10.39-3ubuntu0.1 [203 kB] 2023-11-13T11:25:06.871 INFO:teuthology.orchestra.run.smithi154.stdout:Get:4 https://3.chacra.ceph.com/r/ceph/wip-mchangir-testing-20231110.052303/35f0debb3cc28955b7132ef4c509cd138a09d56b/ubuntu/jammy/flavors/default jammy/main amd64 librados2 amd64 18.0.0-7288-g35f0debb-1jammy [3,467 kB] 2023-11-13T11:25:06.905 INFO:teuthology.orchestra.run.smithi102.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5core5a amd64 5.15.3+dfsg-2ubuntu0.2 [2,006 kB] 2023-11-13T11:25:06.918 INFO:teuthology.orchestra.run.smithi102.stdout:Get:8 https://3.chacra.ceph.com/r/ceph/wip-mchangir-testing-20231110.052303/35f0debb3cc28955b7132ef4c509cd138a09d56b/ubuntu/jammy/flavors/default jammy/main amd64 librados2 amd64 18.0.0-7288-g35f0debb-1jammy [3,467 kB] 2023-11-13T11:25:06.940 INFO:teuthology.orchestra.run.smithi154.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblttng-ust1 amd64 2.13.1-1ubuntu1 [190 kB] 2023-11-13T11:25:07.031 INFO:teuthology.orchestra.run.smithi154.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libdouble-conversion3 amd64 3.1.7-4 [39.0 kB] 2023-11-13T11:25:07.050 INFO:teuthology.orchestra.run.smithi154.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpcre2-16-0 amd64 10.39-3ubuntu0.1 [203 kB] 2023-11-13T11:25:07.072 INFO:teuthology.orchestra.run.smithi102.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5dbus5 amd64 5.15.3+dfsg-2ubuntu0.2 [222 kB] 2023-11-13T11:25:07.091 INFO:teuthology.orchestra.run.smithi102.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5network5 amd64 5.15.3+dfsg-2ubuntu0.2 [731 kB] 2023-11-13T11:25:07.110 INFO:teuthology.orchestra.run.smithi154.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5core5a amd64 5.15.3+dfsg-2ubuntu0.2 [2,006 kB] 2023-11-13T11:25:07.114 INFO:teuthology.orchestra.run.smithi154.stdout:Get:9 https://3.chacra.ceph.com/r/ceph/wip-mchangir-testing-20231110.052303/35f0debb3cc28955b7132ef4c509cd138a09d56b/ubuntu/jammy/flavors/default jammy/main amd64 librbd1 amd64 18.0.0-7288-g35f0debb-1jammy [3,110 kB] 2023-11-13T11:25:07.127 INFO:teuthology.orchestra.run.smithi102.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libthrift-0.16.0 amd64 0.16.0-2 [267 kB] 2023-11-13T11:25:07.143 INFO:teuthology.orchestra.run.smithi102.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-prettytable all 2.5.0-2 [31.3 kB] 2023-11-13T11:25:07.144 INFO:teuthology.orchestra.run.smithi102.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/universe amd64 librdkafka1 amd64 1.8.0-1build1 [633 kB] 2023-11-13T11:25:07.177 INFO:teuthology.orchestra.run.smithi102.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy/main amd64 liboath0 amd64 2.6.7-3build1 [41.1 kB] 2023-11-13T11:25:07.178 INFO:teuthology.orchestra.run.smithi102.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.functools all 3.4.0-2 [9,030 B] 2023-11-13T11:25:07.179 INFO:teuthology.orchestra.run.smithi102.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-cheroot all 8.5.2+ds1-1ubuntu3.1 [71.1 kB] 2023-11-13T11:25:07.180 INFO:teuthology.orchestra.run.smithi102.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.classes all 3.2.1-3 [6,452 B] 2023-11-13T11:25:07.180 INFO:teuthology.orchestra.run.smithi102.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.text all 3.6.0-2 [8,716 B] 2023-11-13T11:25:07.181 INFO:teuthology.orchestra.run.smithi102.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.collections all 3.4.0-2 [11.4 kB] 2023-11-13T11:25:07.216 INFO:teuthology.orchestra.run.smithi154.stdout:Get:10 https://3.chacra.ceph.com/r/ceph/wip-mchangir-testing-20231110.052303/35f0debb3cc28955b7132ef4c509cd138a09d56b/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs2 amd64 18.0.0-7288-g35f0debb-1jammy [690 kB] 2023-11-13T11:25:07.223 INFO:teuthology.orchestra.run.smithi102.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempora all 4.1.2-1 [14.8 kB] 2023-11-13T11:25:07.223 INFO:teuthology.orchestra.run.smithi102.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-portend all 3.0.0-1 [7,240 B] 2023-11-13T11:25:07.224 INFO:teuthology.orchestra.run.smithi102.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-zc.lockfile all 2.0-1 [8,980 B] 2023-11-13T11:25:07.238 INFO:teuthology.orchestra.run.smithi154.stdout:Get:11 https://3.chacra.ceph.com/r/ceph/wip-mchangir-testing-20231110.052303/35f0debb3cc28955b7132ef4c509cd138a09d56b/ubuntu/jammy/flavors/default jammy/main amd64 python3-rados amd64 18.0.0-7288-g35f0debb-1jammy [356 kB] 2023-11-13T11:25:07.252 INFO:teuthology.orchestra.run.smithi154.stdout:Get:12 https://3.chacra.ceph.com/r/ceph/wip-mchangir-testing-20231110.052303/35f0debb3cc28955b7132ef4c509cd138a09d56b/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-argparse all 18.0.0-7288-g35f0debb-1jammy [32.8 kB] 2023-11-13T11:25:07.252 INFO:teuthology.orchestra.run.smithi154.stdout:Get:13 https://3.chacra.ceph.com/r/ceph/wip-mchangir-testing-20231110.052303/35f0debb3cc28955b7132ef4c509cd138a09d56b/ubuntu/jammy/flavors/default jammy/main amd64 python3-cephfs amd64 18.0.0-7288-g35f0debb-1jammy [180 kB] 2023-11-13T11:25:07.259 INFO:teuthology.orchestra.run.smithi154.stdout:Get:14 https://3.chacra.ceph.com/r/ceph/wip-mchangir-testing-20231110.052303/35f0debb3cc28955b7132ef4c509cd138a09d56b/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-common all 18.0.0-7288-g35f0debb-1jammy [62.4 kB] 2023-11-13T11:25:07.261 INFO:teuthology.orchestra.run.smithi154.stdout:Get:15 https://3.chacra.ceph.com/r/ceph/wip-mchangir-testing-20231110.052303/35f0debb3cc28955b7132ef4c509cd138a09d56b/ubuntu/jammy/flavors/default jammy/main amd64 python3-rbd amd64 18.0.0-7288-g35f0debb-1jammy [330 kB] 2023-11-13T11:25:07.266 INFO:teuthology.orchestra.run.smithi102.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cherrypy3 all 18.6.1-4 [208 kB] 2023-11-13T11:25:07.270 INFO:teuthology.orchestra.run.smithi102.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-natsort all 8.0.2-1 [35.3 kB] 2023-11-13T11:25:07.271 INFO:teuthology.orchestra.run.smithi102.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-logutils all 0.3.3-8 [17.6 kB] 2023-11-13T11:25:07.272 INFO:teuthology.orchestra.run.smithi102.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-markupsafe amd64 2.0.1-2build1 [12.7 kB] 2023-11-13T11:25:07.273 INFO:teuthology.orchestra.run.smithi102.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-mako all 1.1.3+ds1-2ubuntu0.1 [60.5 kB] 2023-11-13T11:25:07.275 INFO:teuthology.orchestra.run.smithi102.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2023-11-13T11:25:07.276 INFO:teuthology.orchestra.run.smithi102.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-singledispatch all 3.4.0.3-3 [7,320 B] 2023-11-13T11:25:07.280 INFO:teuthology.orchestra.run.smithi154.stdout:Get:16 https://3.chacra.ceph.com/r/ceph/wip-mchangir-testing-20231110.052303/35f0debb3cc28955b7132ef4c509cd138a09d56b/ubuntu/jammy/flavors/default jammy/main amd64 librgw2 amd64 18.0.0-7288-g35f0debb-1jammy [6,226 kB] 2023-11-13T11:25:07.311 INFO:teuthology.orchestra.run.smithi102.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webob all 1:1.8.6-1.1 [85.2 kB] 2023-11-13T11:25:07.313 INFO:teuthology.orchestra.run.smithi102.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-waitress all 1.4.4-1.1ubuntu1 [47.3 kB] 2023-11-13T11:25:07.316 INFO:teuthology.orchestra.run.smithi102.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempita all 0.5.2-6ubuntu1 [15.1 kB] 2023-11-13T11:25:07.361 INFO:teuthology.orchestra.run.smithi102.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-paste all 3.5.0+dfsg1-1 [456 kB] 2023-11-13T11:25:07.370 INFO:teuthology.orchestra.run.smithi102.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-pastedeploy-tpl all 2.1.1-1 [4,892 B] 2023-11-13T11:25:07.371 INFO:teuthology.orchestra.run.smithi102.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastedeploy all 2.1.1-1 [26.6 kB] 2023-11-13T11:25:07.372 INFO:teuthology.orchestra.run.smithi102.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webtest all 2.0.35-1 [28.5 kB] 2023-11-13T11:25:07.373 INFO:teuthology.orchestra.run.smithi102.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pecan all 1.3.3-4ubuntu2 [87.3 kB] 2023-11-13T11:25:07.374 INFO:teuthology.orchestra.run.smithi102.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-certifi all 2020.6.20-1 [150 kB] 2023-11-13T11:25:07.377 INFO:teuthology.orchestra.run.smithi102.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-idna all 3.3-1 [49.3 kB] 2023-11-13T11:25:07.411 INFO:teuthology.orchestra.run.smithi102.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-urllib3 all 1.26.5-1~exp1ubuntu0.1 [98.2 kB] 2023-11-13T11:25:07.413 INFO:teuthology.orchestra.run.smithi102.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-requests all 2.25.1+dfsg-2ubuntu0.1 [48.8 kB] 2023-11-13T11:25:07.414 INFO:teuthology.orchestra.run.smithi102.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-werkzeug all 2.0.2+dfsg1-1ubuntu0.22.04.1 [181 kB] 2023-11-13T11:25:07.434 INFO:teuthology.orchestra.run.smithi154.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5dbus5 amd64 5.15.3+dfsg-2ubuntu0.2 [222 kB] 2023-11-13T11:25:07.445 INFO:teuthology.orchestra.run.smithi154.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5network5 amd64 5.15.3+dfsg-2ubuntu0.2 [731 kB] 2023-11-13T11:25:07.457 INFO:teuthology.orchestra.run.smithi102.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-openssl all 21.0.0-1 [45.2 kB] 2023-11-13T11:25:07.458 INFO:teuthology.orchestra.run.smithi102.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-asyncssh all 2.5.0-1 [185 kB] 2023-11-13T11:25:07.462 INFO:teuthology.orchestra.run.smithi102.stdout:Get:45 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-babel-localedata all 2.8.0+dfsg.1-7 [4,982 kB] 2023-11-13T11:25:07.513 INFO:teuthology.orchestra.run.smithi154.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libthrift-0.16.0 amd64 0.16.0-2 [267 kB] 2023-11-13T11:25:07.554 INFO:teuthology.orchestra.run.smithi154.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-prettytable all 2.5.0-2 [31.3 kB] 2023-11-13T11:25:07.556 INFO:teuthology.orchestra.run.smithi154.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy/universe amd64 librdkafka1 amd64 1.8.0-1build1 [633 kB] 2023-11-13T11:25:07.661 INFO:teuthology.orchestra.run.smithi154.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy/main amd64 liboath0 amd64 2.6.7-3build1 [41.1 kB] 2023-11-13T11:25:07.661 INFO:teuthology.orchestra.run.smithi154.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.functools all 3.4.0-2 [9,030 B] 2023-11-13T11:25:07.662 INFO:teuthology.orchestra.run.smithi154.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-cheroot all 8.5.2+ds1-1ubuntu3.1 [71.1 kB] 2023-11-13T11:25:07.663 INFO:teuthology.orchestra.run.smithi154.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.classes all 3.2.1-3 [6,452 B] 2023-11-13T11:25:07.663 INFO:teuthology.orchestra.run.smithi154.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.text all 3.6.0-2 [8,716 B] 2023-11-13T11:25:07.664 INFO:teuthology.orchestra.run.smithi154.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.collections all 3.4.0-2 [11.4 kB] 2023-11-13T11:25:07.664 INFO:teuthology.orchestra.run.smithi154.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempora all 4.1.2-1 [14.8 kB] 2023-11-13T11:25:07.665 INFO:teuthology.orchestra.run.smithi154.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-portend all 3.0.0-1 [7,240 B] 2023-11-13T11:25:07.665 INFO:teuthology.orchestra.run.smithi154.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-zc.lockfile all 2.0-1 [8,980 B] 2023-11-13T11:25:07.706 INFO:teuthology.orchestra.run.smithi154.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cherrypy3 all 18.6.1-4 [208 kB] 2023-11-13T11:25:07.711 INFO:teuthology.orchestra.run.smithi102.stdout:Get:46 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-babel all 2.8.0+dfsg.1-7 [85.1 kB] 2023-11-13T11:25:07.721 INFO:teuthology.orchestra.run.smithi102.stdout:Get:47 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jinja2 all 3.0.3-1 [108 kB] 2023-11-13T11:25:07.723 INFO:teuthology.orchestra.run.smithi154.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-natsort all 8.0.2-1 [35.3 kB] 2023-11-13T11:25:07.726 INFO:teuthology.orchestra.run.smithi154.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-logutils all 0.3.3-8 [17.6 kB] 2023-11-13T11:25:07.727 INFO:teuthology.orchestra.run.smithi154.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-markupsafe amd64 2.0.1-2build1 [12.7 kB] 2023-11-13T11:25:07.729 INFO:teuthology.orchestra.run.smithi154.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-mako all 1.1.3+ds1-2ubuntu0.1 [60.5 kB] 2023-11-13T11:25:07.734 INFO:teuthology.orchestra.run.smithi154.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2023-11-13T11:25:07.735 INFO:teuthology.orchestra.run.smithi102.stdout:Get:48 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-bcrypt amd64 3.2.0-1build1 [32.7 kB] 2023-11-13T11:25:07.735 INFO:teuthology.orchestra.run.smithi154.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-singledispatch all 3.4.0.3-3 [7,320 B] 2023-11-13T11:25:07.736 INFO:teuthology.orchestra.run.smithi154.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webob all 1:1.8.6-1.1 [85.2 kB] 2023-11-13T11:25:07.736 INFO:teuthology.orchestra.run.smithi102.stdout:Get:49 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2023-11-13T11:25:07.737 INFO:teuthology.orchestra.run.smithi102.stdout:Get:50 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-routes all 2.5.1-1ubuntu1 [89.0 kB] 2023-11-13T11:25:07.742 INFO:teuthology.orchestra.run.smithi102.stdout:Get:51 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn-lib amd64 0.23.2-5ubuntu6 [2,058 kB] 2023-11-13T11:25:07.744 INFO:teuthology.orchestra.run.smithi154.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-waitress all 1.4.4-1.1ubuntu1 [47.3 kB] 2023-11-13T11:25:07.750 INFO:teuthology.orchestra.run.smithi154.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempita all 0.5.2-6ubuntu1 [15.1 kB] 2023-11-13T11:25:07.794 INFO:teuthology.orchestra.run.smithi154.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-paste all 3.5.0+dfsg1-1 [456 kB] 2023-11-13T11:25:07.844 INFO:teuthology.orchestra.run.smithi154.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-pastedeploy-tpl all 2.1.1-1 [4,892 B] 2023-11-13T11:25:07.845 INFO:teuthology.orchestra.run.smithi154.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastedeploy all 2.1.1-1 [26.6 kB] 2023-11-13T11:25:07.849 INFO:teuthology.orchestra.run.smithi154.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webtest all 2.0.35-1 [28.5 kB] 2023-11-13T11:25:07.853 INFO:teuthology.orchestra.run.smithi154.stdout:Get:45 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pecan all 1.3.3-4ubuntu2 [87.3 kB] 2023-11-13T11:25:07.856 INFO:teuthology.orchestra.run.smithi102.stdout:Get:52 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-joblib all 0.17.0-4ubuntu1 [204 kB] 2023-11-13T11:25:07.863 INFO:teuthology.orchestra.run.smithi154.stdout:Get:46 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-certifi all 2020.6.20-1 [150 kB] 2023-11-13T11:25:07.865 INFO:teuthology.orchestra.run.smithi102.stdout:Get:53 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-threadpoolctl all 3.1.0-1 [21.3 kB] 2023-11-13T11:25:07.866 INFO:teuthology.orchestra.run.smithi102.stdout:Get:54 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn all 0.23.2-5ubuntu6 [1,829 kB] 2023-11-13T11:25:07.877 INFO:teuthology.orchestra.run.smithi154.stdout:Get:47 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-idna all 3.3-1 [49.3 kB] 2023-11-13T11:25:07.881 INFO:teuthology.orchestra.run.smithi154.stdout:Get:48 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-urllib3 all 1.26.5-1~exp1ubuntu0.1 [98.2 kB] 2023-11-13T11:25:07.891 INFO:teuthology.orchestra.run.smithi154.stdout:Get:49 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-requests all 2.25.1+dfsg-2ubuntu0.1 [48.8 kB] 2023-11-13T11:25:07.897 INFO:teuthology.orchestra.run.smithi154.stdout:Get:50 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-werkzeug all 2.0.2+dfsg1-1ubuntu0.22.04.1 [181 kB] 2023-11-13T11:25:07.915 INFO:teuthology.orchestra.run.smithi154.stdout:Get:51 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-openssl all 21.0.0-1 [45.2 kB] 2023-11-13T11:25:07.918 INFO:teuthology.orchestra.run.smithi154.stdout:Get:52 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-asyncssh all 2.5.0-1 [185 kB] 2023-11-13T11:25:07.931 INFO:teuthology.orchestra.run.smithi154.stdout:Get:53 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-babel-localedata all 2.8.0+dfsg.1-7 [4,982 kB] 2023-11-13T11:25:07.946 INFO:teuthology.orchestra.run.smithi102.stdout:Get:55 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cachetools all 5.0.0-1 [9,722 B] 2023-11-13T11:25:07.946 INFO:teuthology.orchestra.run.smithi102.stdout:Get:56 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1 all 0.4.8-1 [50.9 kB] 2023-11-13T11:25:07.947 INFO:teuthology.orchestra.run.smithi102.stdout:Get:57 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1-modules all 0.2.1-1 [33.0 kB] 2023-11-13T11:25:07.948 INFO:teuthology.orchestra.run.smithi102.stdout:Get:58 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-rsa all 4.8-1 [28.4 kB] 2023-11-13T11:25:07.949 INFO:teuthology.orchestra.run.smithi102.stdout:Get:59 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-google-auth all 1.5.1-3 [35.7 kB] 2023-11-13T11:25:07.951 INFO:teuthology.orchestra.run.smithi102.stdout:Get:60 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-requests-oauthlib all 1.3.0+ds-0.1 [18.7 kB] 2023-11-13T11:25:07.951 INFO:teuthology.orchestra.run.smithi102.stdout:Get:61 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-websocket all 1.2.3-1 [34.7 kB] 2023-11-13T11:25:07.965 INFO:teuthology.orchestra.run.smithi102.stdout:Get:62 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-kubernetes all 12.0.1-1ubuntu1 [353 kB] 2023-11-13T11:25:07.977 INFO:teuthology.orchestra.run.smithi102.stdout:Get:63 http://archive.ubuntu.com/ubuntu jammy/main amd64 libonig5 amd64 6.9.7.1-2build1 [172 kB] 2023-11-13T11:25:08.007 INFO:teuthology.orchestra.run.smithi102.stdout:Get:64 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjq1 amd64 1.6-2.1ubuntu3 [133 kB] 2023-11-13T11:25:08.013 INFO:teuthology.orchestra.run.smithi102.stdout:Get:65 http://archive.ubuntu.com/ubuntu jammy/main amd64 jq amd64 1.6-2.1ubuntu3 [52.5 kB] 2023-11-13T11:25:08.014 INFO:teuthology.orchestra.run.smithi102.stdout:Get:66 http://archive.ubuntu.com/ubuntu jammy/main amd64 socat amd64 1.7.4.1-3ubuntu4 [349 kB] 2023-11-13T11:25:08.033 INFO:teuthology.orchestra.run.smithi102.stdout:Get:67 http://archive.ubuntu.com/ubuntu jammy/universe amd64 xmlstarlet amd64 1.6.1-2.1 [265 kB] 2023-11-13T11:25:08.049 INFO:teuthology.orchestra.run.smithi102.stdout:Get:68 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-colorama all 0.4.4-1 [24.5 kB] 2023-11-13T11:25:08.049 INFO:teuthology.orchestra.run.smithi102.stdout:Get:69 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 nvme-cli amd64 1.16-3ubuntu0.1 [474 kB] 2023-11-13T11:25:08.074 INFO:teuthology.orchestra.run.smithi102.stdout:Get:70 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python-asyncssh-doc all 2.5.0-1 [318 kB] 2023-11-13T11:25:08.086 INFO:teuthology.orchestra.run.smithi102.stdout:Get:71 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-iniconfig all 1.1.1-2 [6,024 B] 2023-11-13T11:25:08.086 INFO:teuthology.orchestra.run.smithi102.stdout:Get:72 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2023-11-13T11:25:08.088 INFO:teuthology.orchestra.run.smithi102.stdout:Get:73 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pluggy all 0.13.0-7.1 [19.0 kB] 2023-11-13T11:25:08.104 INFO:teuthology.orchestra.run.smithi102.stdout:Get:74 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-psutil amd64 5.9.0-1build1 [158 kB] 2023-11-13T11:25:08.113 INFO:teuthology.orchestra.run.smithi102.stdout:Get:75 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-py all 1.10.0-1 [71.9 kB] 2023-11-13T11:25:08.115 INFO:teuthology.orchestra.run.smithi102.stdout:Get:76 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pygments all 2.11.2+dfsg-2 [750 kB] 2023-11-13T11:25:08.152 INFO:teuthology.orchestra.run.smithi102.stdout:Get:77 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyinotify all 0.9.6-1.3 [24.8 kB] 2023-11-13T11:25:08.152 INFO:teuthology.orchestra.run.smithi102.stdout:Get:78 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-toml all 0.10.2-1 [16.5 kB] 2023-11-13T11:25:08.154 INFO:teuthology.orchestra.run.smithi102.stdout:Get:79 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pytest all 6.2.5-1ubuntu2 [214 kB] 2023-11-13T11:25:08.164 INFO:teuthology.orchestra.run.smithi102.stdout:Get:80 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplejson amd64 3.17.6-1build1 [54.7 kB] 2023-11-13T11:25:08.164 INFO:teuthology.orchestra.run.smithi102.stdout:Get:81 http://archive.ubuntu.com/ubuntu jammy/universe amd64 qttranslations5-l10n all 5.15.3-1 [1,983 kB] 2023-11-13T11:25:08.385 INFO:teuthology.orchestra.run.smithi154.stdout:Get:54 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-babel all 2.8.0+dfsg.1-7 [85.1 kB] 2023-11-13T11:25:08.389 INFO:teuthology.orchestra.run.smithi154.stdout:Get:55 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jinja2 all 3.0.3-1 [108 kB] 2023-11-13T11:25:08.397 INFO:teuthology.orchestra.run.smithi154.stdout:Get:56 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-bcrypt amd64 3.2.0-1build1 [32.7 kB] 2023-11-13T11:25:08.401 INFO:teuthology.orchestra.run.smithi154.stdout:Get:57 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2023-11-13T11:25:08.402 INFO:teuthology.orchestra.run.smithi154.stdout:Get:58 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-routes all 2.5.1-1ubuntu1 [89.0 kB] 2023-11-13T11:25:08.411 INFO:teuthology.orchestra.run.smithi154.stdout:Get:59 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn-lib amd64 0.23.2-5ubuntu6 [2,058 kB] 2023-11-13T11:25:08.581 INFO:teuthology.orchestra.run.smithi154.stdout:Get:60 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-joblib all 0.17.0-4ubuntu1 [204 kB] 2023-11-13T11:25:08.595 INFO:teuthology.orchestra.run.smithi154.stdout:Get:61 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-threadpoolctl all 3.1.0-1 [21.3 kB] 2023-11-13T11:25:08.597 INFO:teuthology.orchestra.run.smithi154.stdout:Get:62 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn all 0.23.2-5ubuntu6 [1,829 kB] 2023-11-13T11:25:08.740 INFO:teuthology.orchestra.run.smithi154.stdout:Get:63 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cachetools all 5.0.0-1 [9,722 B] 2023-11-13T11:25:08.740 INFO:teuthology.orchestra.run.smithi154.stdout:Get:64 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1 all 0.4.8-1 [50.9 kB] 2023-11-13T11:25:08.743 INFO:teuthology.orchestra.run.smithi154.stdout:Get:65 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1-modules all 0.2.1-1 [33.0 kB] 2023-11-13T11:25:08.746 INFO:teuthology.orchestra.run.smithi154.stdout:Get:66 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-rsa all 4.8-1 [28.4 kB] 2023-11-13T11:25:08.748 INFO:teuthology.orchestra.run.smithi154.stdout:Get:67 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-google-auth all 1.5.1-3 [35.7 kB] 2023-11-13T11:25:08.750 INFO:teuthology.orchestra.run.smithi154.stdout:Get:68 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-requests-oauthlib all 1.3.0+ds-0.1 [18.7 kB] 2023-11-13T11:25:08.751 INFO:teuthology.orchestra.run.smithi154.stdout:Get:69 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-websocket all 1.2.3-1 [34.7 kB] 2023-11-13T11:25:08.755 INFO:teuthology.orchestra.run.smithi154.stdout:Get:70 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-kubernetes all 12.0.1-1ubuntu1 [353 kB] 2023-11-13T11:25:08.786 INFO:teuthology.orchestra.run.smithi154.stdout:Get:71 http://archive.ubuntu.com/ubuntu jammy/main amd64 libonig5 amd64 6.9.7.1-2build1 [172 kB] 2023-11-13T11:25:08.799 INFO:teuthology.orchestra.run.smithi154.stdout:Get:72 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjq1 amd64 1.6-2.1ubuntu3 [133 kB] 2023-11-13T11:25:08.829 INFO:teuthology.orchestra.run.smithi154.stdout:Get:73 http://archive.ubuntu.com/ubuntu jammy/main amd64 jq amd64 1.6-2.1ubuntu3 [52.5 kB] 2023-11-13T11:25:08.832 INFO:teuthology.orchestra.run.smithi154.stdout:Get:74 http://archive.ubuntu.com/ubuntu jammy/main amd64 socat amd64 1.7.4.1-3ubuntu4 [349 kB] 2023-11-13T11:25:08.860 INFO:teuthology.orchestra.run.smithi154.stdout:Get:75 http://archive.ubuntu.com/ubuntu jammy/universe amd64 xmlstarlet amd64 1.6.1-2.1 [265 kB] 2023-11-13T11:25:08.888 INFO:teuthology.orchestra.run.smithi154.stdout:Get:76 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-colorama all 0.4.4-1 [24.5 kB] 2023-11-13T11:25:08.890 INFO:teuthology.orchestra.run.smithi154.stdout:Get:77 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 nvme-cli amd64 1.16-3ubuntu0.1 [474 kB] 2023-11-13T11:25:08.934 INFO:teuthology.orchestra.run.smithi154.stdout:Get:78 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python-asyncssh-doc all 2.5.0-1 [318 kB] 2023-11-13T11:25:08.962 INFO:teuthology.orchestra.run.smithi154.stdout:Get:79 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-iniconfig all 1.1.1-2 [6,024 B] 2023-11-13T11:25:08.963 INFO:teuthology.orchestra.run.smithi154.stdout:Get:80 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2023-11-13T11:25:08.966 INFO:teuthology.orchestra.run.smithi154.stdout:Get:81 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pluggy all 0.13.0-7.1 [19.0 kB] 2023-11-13T11:25:08.968 INFO:teuthology.orchestra.run.smithi154.stdout:Get:82 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-psutil amd64 5.9.0-1build1 [158 kB] 2023-11-13T11:25:08.984 INFO:teuthology.orchestra.run.smithi154.stdout:Get:83 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-py all 1.10.0-1 [71.9 kB] 2023-11-13T11:25:08.993 INFO:teuthology.orchestra.run.smithi154.stdout:Get:84 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pygments all 2.11.2+dfsg-2 [750 kB] 2023-11-13T11:25:09.050 INFO:teuthology.orchestra.run.smithi154.stdout:Get:85 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyinotify all 0.9.6-1.3 [24.8 kB] 2023-11-13T11:25:09.051 INFO:teuthology.orchestra.run.smithi154.stdout:Get:86 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-toml all 0.10.2-1 [16.5 kB] 2023-11-13T11:25:09.052 INFO:teuthology.orchestra.run.smithi154.stdout:Get:87 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pytest all 6.2.5-1ubuntu2 [214 kB] 2023-11-13T11:25:09.064 INFO:teuthology.orchestra.run.smithi154.stdout:Get:88 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplejson amd64 3.17.6-1build1 [54.7 kB] 2023-11-13T11:25:09.067 INFO:teuthology.orchestra.run.smithi154.stdout:Get:89 http://archive.ubuntu.com/ubuntu jammy/universe amd64 qttranslations5-l10n all 5.15.3-1 [1,983 kB] 2023-11-13T11:25:09.407 INFO:teuthology.orchestra.run.smithi154.stdout:Get:90 https://3.chacra.ceph.com/r/ceph/wip-mchangir-testing-20231110.052303/35f0debb3cc28955b7132ef4c509cd138a09d56b/ubuntu/jammy/flavors/default jammy/main amd64 python3-rgw amd64 18.0.0-7288-g35f0debb-1jammy [112 kB] 2023-11-13T11:25:09.416 INFO:teuthology.orchestra.run.smithi154.stdout:Get:91 https://3.chacra.ceph.com/r/ceph/wip-mchangir-testing-20231110.052303/35f0debb3cc28955b7132ef4c509cd138a09d56b/ubuntu/jammy/flavors/default jammy/main amd64 libradosstriper1 amd64 18.0.0-7288-g35f0debb-1jammy [439 kB] 2023-11-13T11:25:09.428 INFO:teuthology.orchestra.run.smithi154.stdout:Get:92 https://3.chacra.ceph.com/r/ceph/wip-mchangir-testing-20231110.052303/35f0debb3cc28955b7132ef4c509cd138a09d56b/ubuntu/jammy/flavors/default jammy/main amd64 ceph-common amd64 18.0.0-7288-g35f0debb-1jammy [22.6 MB] 2023-11-13T11:25:10.339 INFO:teuthology.orchestra.run.smithi154.stdout:Get:93 https://3.chacra.ceph.com/r/ceph/wip-mchangir-testing-20231110.052303/35f0debb3cc28955b7132ef4c509cd138a09d56b/ubuntu/jammy/flavors/default jammy/main amd64 ceph-base amd64 18.0.0-7288-g35f0debb-1jammy [6,900 kB] 2023-11-13T11:25:10.578 INFO:teuthology.orchestra.run.smithi154.stdout:Get:94 https://3.chacra.ceph.com/r/ceph/wip-mchangir-testing-20231110.052303/35f0debb3cc28955b7132ef4c509cd138a09d56b/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-modules-core all 18.0.0-7288-g35f0debb-1jammy [238 kB] 2023-11-13T11:25:10.591 INFO:teuthology.orchestra.run.smithi154.stdout:Get:95 https://3.chacra.ceph.com/r/ceph/wip-mchangir-testing-20231110.052303/35f0debb3cc28955b7132ef4c509cd138a09d56b/ubuntu/jammy/flavors/default jammy/main amd64 libsqlite3-mod-ceph amd64 18.0.0-7288-g35f0debb-1jammy [124 kB] 2023-11-13T11:25:10.595 INFO:teuthology.orchestra.run.smithi154.stdout:Get:96 https://3.chacra.ceph.com/r/ceph/wip-mchangir-testing-20231110.052303/35f0debb3cc28955b7132ef4c509cd138a09d56b/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr amd64 18.0.0-7288-g35f0debb-1jammy [1,495 kB] 2023-11-13T11:25:10.643 INFO:teuthology.orchestra.run.smithi154.stdout:Get:97 https://3.chacra.ceph.com/r/ceph/wip-mchangir-testing-20231110.052303/35f0debb3cc28955b7132ef4c509cd138a09d56b/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mon amd64 18.0.0-7288-g35f0debb-1jammy [9,949 kB] 2023-11-13T11:25:11.007 INFO:teuthology.orchestra.run.smithi154.stdout:Get:98 https://3.chacra.ceph.com/r/ceph/wip-mchangir-testing-20231110.052303/35f0debb3cc28955b7132ef4c509cd138a09d56b/ubuntu/jammy/flavors/default jammy/main amd64 ceph-osd amd64 18.0.0-7288-g35f0debb-1jammy [31.8 MB] 2023-11-13T11:25:12.352 INFO:teuthology.orchestra.run.smithi154.stdout:Get:99 https://3.chacra.ceph.com/r/ceph/wip-mchangir-testing-20231110.052303/35f0debb3cc28955b7132ef4c509cd138a09d56b/ubuntu/jammy/flavors/default jammy/main amd64 ceph amd64 18.0.0-7288-g35f0debb-1jammy [14.0 kB] 2023-11-13T11:25:12.352 INFO:teuthology.orchestra.run.smithi154.stdout:Get:100 https://3.chacra.ceph.com/r/ceph/wip-mchangir-testing-20231110.052303/35f0debb3cc28955b7132ef4c509cd138a09d56b/ubuntu/jammy/flavors/default jammy/main amd64 ceph-fuse amd64 18.0.0-7288-g35f0debb-1jammy [839 kB] 2023-11-13T11:25:12.422 INFO:teuthology.orchestra.run.smithi154.stdout:Get:101 https://3.chacra.ceph.com/r/ceph/wip-mchangir-testing-20231110.052303/35f0debb3cc28955b7132ef4c509cd138a09d56b/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mds amd64 18.0.0-7288-g35f0debb-1jammy [2,144 kB] 2023-11-13T11:25:12.493 INFO:teuthology.orchestra.run.smithi154.stdout:Get:102 https://3.chacra.ceph.com/r/ceph/wip-mchangir-testing-20231110.052303/35f0debb3cc28955b7132ef4c509cd138a09d56b/ubuntu/jammy/flavors/default jammy/main amd64 cephadm amd64 18.0.0-7288-g35f0debb-1jammy [800 kB] 2023-11-13T11:25:12.519 INFO:teuthology.orchestra.run.smithi154.stdout:Get:103 https://3.chacra.ceph.com/r/ceph/wip-mchangir-testing-20231110.052303/35f0debb3cc28955b7132ef4c509cd138a09d56b/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-cephadm all 18.0.0-7288-g35f0debb-1jammy [138 kB] 2023-11-13T11:25:12.522 INFO:teuthology.orchestra.run.smithi154.stdout:Get:104 https://3.chacra.ceph.com/r/ceph/wip-mchangir-testing-20231110.052303/35f0debb3cc28955b7132ef4c509cd138a09d56b/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-dashboard all 18.0.0-7288-g35f0debb-1jammy [1,900 kB] 2023-11-13T11:25:12.587 INFO:teuthology.orchestra.run.smithi154.stdout:Get:105 https://3.chacra.ceph.com/r/ceph/wip-mchangir-testing-20231110.052303/35f0debb3cc28955b7132ef4c509cd138a09d56b/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-diskprediction-local all 18.0.0-7288-g35f0debb-1jammy [8,625 kB] 2023-11-13T11:25:12.881 INFO:teuthology.orchestra.run.smithi154.stdout:Get:106 https://3.chacra.ceph.com/r/ceph/wip-mchangir-testing-20231110.052303/35f0debb3cc28955b7132ef4c509cd138a09d56b/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-k8sevents all 18.0.0-7288-g35f0debb-1jammy [14.2 kB] 2023-11-13T11:25:12.881 INFO:teuthology.orchestra.run.smithi154.stdout:Get:107 https://3.chacra.ceph.com/r/ceph/wip-mchangir-testing-20231110.052303/35f0debb3cc28955b7132ef4c509cd138a09d56b/ubuntu/jammy/flavors/default jammy/main amd64 ceph-test amd64 18.0.0-7288-g35f0debb-1jammy [48.6 MB] 2023-11-13T11:25:17.137 INFO:teuthology.orchestra.run.smithi102.stdout:Get:82 https://3.chacra.ceph.com/r/ceph/wip-mchangir-testing-20231110.052303/35f0debb3cc28955b7132ef4c509cd138a09d56b/ubuntu/jammy/flavors/default jammy/main amd64 librbd1 amd64 18.0.0-7288-g35f0debb-1jammy [3,110 kB] 2023-11-13T11:25:17.904 INFO:teuthology.orchestra.run.smithi154.stdout:Get:108 https://3.chacra.ceph.com/r/ceph/wip-mchangir-testing-20231110.052303/35f0debb3cc28955b7132ef4c509cd138a09d56b/ubuntu/jammy/flavors/default jammy/main amd64 ceph-volume all 18.0.0-7288-g35f0debb-1jammy [120 kB] 2023-11-13T11:25:17.905 INFO:teuthology.orchestra.run.smithi154.stdout:Get:109 https://3.chacra.ceph.com/r/ceph/wip-mchangir-testing-20231110.052303/35f0debb3cc28955b7132ef4c509cd138a09d56b/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-mirror amd64 18.0.0-7288-g35f0debb-1jammy [225 kB] 2023-11-13T11:25:17.907 INFO:teuthology.orchestra.run.smithi154.stdout:Get:110 https://3.chacra.ceph.com/r/ceph/wip-mchangir-testing-20231110.052303/35f0debb3cc28955b7132ef4c509cd138a09d56b/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-shell all 18.0.0-7288-g35f0debb-1jammy [34.0 kB] 2023-11-13T11:25:17.908 INFO:teuthology.orchestra.run.smithi154.stdout:Get:111 https://3.chacra.ceph.com/r/ceph/wip-mchangir-testing-20231110.052303/35f0debb3cc28955b7132ef4c509cd138a09d56b/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-top all 18.0.0-7288-g35f0debb-1jammy [23.4 kB] 2023-11-13T11:25:17.908 INFO:teuthology.orchestra.run.smithi154.stdout:Get:112 https://3.chacra.ceph.com/r/ceph/wip-mchangir-testing-20231110.052303/35f0debb3cc28955b7132ef4c509cd138a09d56b/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs-dev amd64 18.0.0-7288-g35f0debb-1jammy [38.3 kB] 2023-11-13T11:25:17.909 INFO:teuthology.orchestra.run.smithi154.stdout:Get:113 https://3.chacra.ceph.com/r/ceph/wip-mchangir-testing-20231110.052303/35f0debb3cc28955b7132ef4c509cd138a09d56b/ubuntu/jammy/flavors/default jammy/main amd64 radosgw amd64 18.0.0-7288-g35f0debb-1jammy [12.3 MB] 2023-11-13T11:25:18.363 INFO:teuthology.orchestra.run.smithi102.stdout:Get:83 https://3.chacra.ceph.com/r/ceph/wip-mchangir-testing-20231110.052303/35f0debb3cc28955b7132ef4c509cd138a09d56b/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs2 amd64 18.0.0-7288-g35f0debb-1jammy [690 kB] 2023-11-13T11:25:18.401 INFO:teuthology.orchestra.run.smithi154.stdout:Get:114 https://3.chacra.ceph.com/r/ceph/wip-mchangir-testing-20231110.052303/35f0debb3cc28955b7132ef4c509cd138a09d56b/ubuntu/jammy/flavors/default jammy/main amd64 rbd-fuse amd64 18.0.0-7288-g35f0debb-1jammy [91.4 kB] 2023-11-13T11:25:18.476 INFO:teuthology.orchestra.run.smithi102.stdout:Get:84 https://3.chacra.ceph.com/r/ceph/wip-mchangir-testing-20231110.052303/35f0debb3cc28955b7132ef4c509cd138a09d56b/ubuntu/jammy/flavors/default jammy/main amd64 python3-rados amd64 18.0.0-7288-g35f0debb-1jammy [356 kB] 2023-11-13T11:25:18.519 INFO:teuthology.orchestra.run.smithi102.stdout:Get:85 https://3.chacra.ceph.com/r/ceph/wip-mchangir-testing-20231110.052303/35f0debb3cc28955b7132ef4c509cd138a09d56b/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-argparse all 18.0.0-7288-g35f0debb-1jammy [32.8 kB] 2023-11-13T11:25:18.548 INFO:teuthology.orchestra.run.smithi102.stdout:Get:86 https://3.chacra.ceph.com/r/ceph/wip-mchangir-testing-20231110.052303/35f0debb3cc28955b7132ef4c509cd138a09d56b/ubuntu/jammy/flavors/default jammy/main amd64 python3-cephfs amd64 18.0.0-7288-g35f0debb-1jammy [180 kB] 2023-11-13T11:25:18.557 INFO:teuthology.orchestra.run.smithi102.stdout:Get:87 https://3.chacra.ceph.com/r/ceph/wip-mchangir-testing-20231110.052303/35f0debb3cc28955b7132ef4c509cd138a09d56b/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-common all 18.0.0-7288-g35f0debb-1jammy [62.4 kB] 2023-11-13T11:25:18.560 INFO:teuthology.orchestra.run.smithi102.stdout:Get:88 https://3.chacra.ceph.com/r/ceph/wip-mchangir-testing-20231110.052303/35f0debb3cc28955b7132ef4c509cd138a09d56b/ubuntu/jammy/flavors/default jammy/main amd64 python3-rbd amd64 18.0.0-7288-g35f0debb-1jammy [330 kB] 2023-11-13T11:25:18.603 INFO:teuthology.orchestra.run.smithi102.stdout:Get:89 https://3.chacra.ceph.com/r/ceph/wip-mchangir-testing-20231110.052303/35f0debb3cc28955b7132ef4c509cd138a09d56b/ubuntu/jammy/flavors/default jammy/main amd64 librgw2 amd64 18.0.0-7288-g35f0debb-1jammy [6,226 kB] 2023-11-13T11:25:18.990 INFO:teuthology.orchestra.run.smithi154.stdout:Fetched 186 MB in 12s (15.9 MB/s) 2023-11-13T11:25:19.134 INFO:teuthology.orchestra.run.smithi102.stdout:Get:90 https://3.chacra.ceph.com/r/ceph/wip-mchangir-testing-20231110.052303/35f0debb3cc28955b7132ef4c509cd138a09d56b/ubuntu/jammy/flavors/default jammy/main amd64 python3-rgw amd64 18.0.0-7288-g35f0debb-1jammy [112 kB] 2023-11-13T11:25:19.146 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-pyperclip. 2023-11-13T11:25:19.154 INFO:teuthology.orchestra.run.smithi102.stdout:Get:91 https://3.chacra.ceph.com/r/ceph/wip-mchangir-testing-20231110.052303/35f0debb3cc28955b7132ef4c509cd138a09d56b/ubuntu/jammy/flavors/default jammy/main amd64 libradosstriper1 amd64 18.0.0-7288-g35f0debb-1jammy [439 kB] 2023-11-13T11:25:19.171 INFO:teuthology.orchestra.run.smithi102.stdout:Get:92 https://3.chacra.ceph.com/r/ceph/wip-mchangir-testing-20231110.052303/35f0debb3cc28955b7132ef4c509cd138a09d56b/ubuntu/jammy/flavors/default jammy/main amd64 ceph-common amd64 18.0.0-7288-g35f0debb-1jammy [22.6 MB] 2023-11-13T11:25:19.214 INFO:teuthology.orchestra.run.smithi154.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 132932 files and directories currently installed.) 2023-11-13T11:25:19.217 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../000-python3-pyperclip_1.8.2-2_all.deb ... 2023-11-13T11:25:19.270 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-pyperclip (1.8.2-2) ... 2023-11-13T11:25:19.639 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-wcwidth. 2023-11-13T11:25:19.652 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../001-python3-wcwidth_0.2.5+dfsg1-1_all.deb ... 2023-11-13T11:25:19.705 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-wcwidth (0.2.5+dfsg1-1) ... 2023-11-13T11:25:20.083 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-cmd2. 2023-11-13T11:25:20.097 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../002-python3-cmd2_2.3.3-1_all.deb ... 2023-11-13T11:25:20.142 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-cmd2 (2.3.3-1) ... 2023-11-13T11:25:20.177 INFO:teuthology.orchestra.run.smithi102.stdout:Get:93 https://3.chacra.ceph.com/r/ceph/wip-mchangir-testing-20231110.052303/35f0debb3cc28955b7132ef4c509cd138a09d56b/ubuntu/jammy/flavors/default jammy/main amd64 ceph-base amd64 18.0.0-7288-g35f0debb-1jammy [6,900 kB] 2023-11-13T11:25:20.398 INFO:teuthology.orchestra.run.smithi102.stdout:Get:94 https://3.chacra.ceph.com/r/ceph/wip-mchangir-testing-20231110.052303/35f0debb3cc28955b7132ef4c509cd138a09d56b/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-modules-core all 18.0.0-7288-g35f0debb-1jammy [238 kB] 2023-11-13T11:25:20.403 INFO:teuthology.orchestra.run.smithi102.stdout:Get:95 https://3.chacra.ceph.com/r/ceph/wip-mchangir-testing-20231110.052303/35f0debb3cc28955b7132ef4c509cd138a09d56b/ubuntu/jammy/flavors/default jammy/main amd64 libsqlite3-mod-ceph amd64 18.0.0-7288-g35f0debb-1jammy [124 kB] 2023-11-13T11:25:20.407 INFO:teuthology.orchestra.run.smithi102.stdout:Get:96 https://3.chacra.ceph.com/r/ceph/wip-mchangir-testing-20231110.052303/35f0debb3cc28955b7132ef4c509cd138a09d56b/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr amd64 18.0.0-7288-g35f0debb-1jammy [1,495 kB] 2023-11-13T11:25:20.461 INFO:teuthology.orchestra.run.smithi102.stdout:Get:97 https://3.chacra.ceph.com/r/ceph/wip-mchangir-testing-20231110.052303/35f0debb3cc28955b7132ef4c509cd138a09d56b/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mon amd64 18.0.0-7288-g35f0debb-1jammy [9,949 kB] 2023-11-13T11:25:20.503 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package liblttng-ust1:amd64. 2023-11-13T11:25:20.517 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../003-liblttng-ust1_2.13.1-1ubuntu1_amd64.deb ... 2023-11-13T11:25:20.612 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2023-11-13T11:25:20.882 INFO:teuthology.orchestra.run.smithi102.stdout:Get:98 https://3.chacra.ceph.com/r/ceph/wip-mchangir-testing-20231110.052303/35f0debb3cc28955b7132ef4c509cd138a09d56b/ubuntu/jammy/flavors/default jammy/main amd64 ceph-osd amd64 18.0.0-7288-g35f0debb-1jammy [31.8 MB] 2023-11-13T11:25:21.031 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2023-11-13T11:25:21.046 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../004-libdouble-conversion3_3.1.7-4_amd64.deb ... 2023-11-13T11:25:21.098 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking libdouble-conversion3:amd64 (3.1.7-4) ... 2023-11-13T11:25:21.501 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2023-11-13T11:25:21.516 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../005-libpcre2-16-0_10.39-3ubuntu0.1_amd64.deb ... 2023-11-13T11:25:21.568 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2023-11-13T11:25:22.005 INFO:teuthology.orchestra.run.smithi102.stdout:Get:99 https://3.chacra.ceph.com/r/ceph/wip-mchangir-testing-20231110.052303/35f0debb3cc28955b7132ef4c509cd138a09d56b/ubuntu/jammy/flavors/default jammy/main amd64 ceph amd64 18.0.0-7288-g35f0debb-1jammy [14.0 kB] 2023-11-13T11:25:22.005 INFO:teuthology.orchestra.run.smithi102.stdout:Get:100 https://3.chacra.ceph.com/r/ceph/wip-mchangir-testing-20231110.052303/35f0debb3cc28955b7132ef4c509cd138a09d56b/ubuntu/jammy/flavors/default jammy/main amd64 ceph-fuse amd64 18.0.0-7288-g35f0debb-1jammy [839 kB] 2023-11-13T11:25:22.028 INFO:teuthology.orchestra.run.smithi102.stdout:Get:101 https://3.chacra.ceph.com/r/ceph/wip-mchangir-testing-20231110.052303/35f0debb3cc28955b7132ef4c509cd138a09d56b/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mds amd64 18.0.0-7288-g35f0debb-1jammy [2,144 kB] 2023-11-13T11:25:22.063 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package libqt5core5a:amd64. 2023-11-13T11:25:22.078 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../006-libqt5core5a_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2023-11-13T11:25:22.105 INFO:teuthology.orchestra.run.smithi102.stdout:Get:102 https://3.chacra.ceph.com/r/ceph/wip-mchangir-testing-20231110.052303/35f0debb3cc28955b7132ef4c509cd138a09d56b/ubuntu/jammy/flavors/default jammy/main amd64 cephadm amd64 18.0.0-7288-g35f0debb-1jammy [800 kB] 2023-11-13T11:25:22.129 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-11-13T11:25:22.131 INFO:teuthology.orchestra.run.smithi102.stdout:Get:103 https://3.chacra.ceph.com/r/ceph/wip-mchangir-testing-20231110.052303/35f0debb3cc28955b7132ef4c509cd138a09d56b/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-cephadm all 18.0.0-7288-g35f0debb-1jammy [138 kB] 2023-11-13T11:25:22.136 INFO:teuthology.orchestra.run.smithi102.stdout:Get:104 https://3.chacra.ceph.com/r/ceph/wip-mchangir-testing-20231110.052303/35f0debb3cc28955b7132ef4c509cd138a09d56b/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-dashboard all 18.0.0-7288-g35f0debb-1jammy [1,900 kB] 2023-11-13T11:25:22.209 INFO:teuthology.orchestra.run.smithi102.stdout:Get:105 https://3.chacra.ceph.com/r/ceph/wip-mchangir-testing-20231110.052303/35f0debb3cc28955b7132ef4c509cd138a09d56b/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-diskprediction-local all 18.0.0-7288-g35f0debb-1jammy [8,625 kB] 2023-11-13T11:25:22.523 INFO:teuthology.orchestra.run.smithi102.stdout:Get:106 https://3.chacra.ceph.com/r/ceph/wip-mchangir-testing-20231110.052303/35f0debb3cc28955b7132ef4c509cd138a09d56b/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-k8sevents all 18.0.0-7288-g35f0debb-1jammy [14.2 kB] 2023-11-13T11:25:22.523 INFO:teuthology.orchestra.run.smithi102.stdout:Get:107 https://3.chacra.ceph.com/r/ceph/wip-mchangir-testing-20231110.052303/35f0debb3cc28955b7132ef4c509cd138a09d56b/ubuntu/jammy/flavors/default jammy/main amd64 ceph-test amd64 18.0.0-7288-g35f0debb-1jammy [48.6 MB] 2023-11-13T11:25:22.541 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2023-11-13T11:25:22.555 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../007-libqt5dbus5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2023-11-13T11:25:22.599 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-11-13T11:25:23.253 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package libqt5network5:amd64. 2023-11-13T11:25:23.268 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../008-libqt5network5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2023-11-13T11:25:23.319 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-11-13T11:25:23.681 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package libthrift-0.16.0:amd64. 2023-11-13T11:25:23.695 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../009-libthrift-0.16.0_0.16.0-2_amd64.deb ... 2023-11-13T11:25:23.741 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking libthrift-0.16.0:amd64 (0.16.0-2) ... 2023-11-13T11:25:24.158 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package librados2. 2023-11-13T11:25:24.173 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../010-librados2_18.0.0-7288-g35f0debb-1jammy_amd64.deb ... 2023-11-13T11:25:24.225 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking librados2 (18.0.0-7288-g35f0debb-1jammy) ... 2023-11-13T11:25:24.301 INFO:teuthology.orchestra.run.smithi102.stdout:Get:108 https://3.chacra.ceph.com/r/ceph/wip-mchangir-testing-20231110.052303/35f0debb3cc28955b7132ef4c509cd138a09d56b/ubuntu/jammy/flavors/default jammy/main amd64 ceph-volume all 18.0.0-7288-g35f0debb-1jammy [120 kB] 2023-11-13T11:25:24.303 INFO:teuthology.orchestra.run.smithi102.stdout:Get:109 https://3.chacra.ceph.com/r/ceph/wip-mchangir-testing-20231110.052303/35f0debb3cc28955b7132ef4c509cd138a09d56b/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-mirror amd64 18.0.0-7288-g35f0debb-1jammy [225 kB] 2023-11-13T11:25:24.304 INFO:teuthology.orchestra.run.smithi102.stdout:Get:110 https://3.chacra.ceph.com/r/ceph/wip-mchangir-testing-20231110.052303/35f0debb3cc28955b7132ef4c509cd138a09d56b/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-shell all 18.0.0-7288-g35f0debb-1jammy [34.0 kB] 2023-11-13T11:25:24.304 INFO:teuthology.orchestra.run.smithi102.stdout:Get:111 https://3.chacra.ceph.com/r/ceph/wip-mchangir-testing-20231110.052303/35f0debb3cc28955b7132ef4c509cd138a09d56b/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-top all 18.0.0-7288-g35f0debb-1jammy [23.4 kB] 2023-11-13T11:25:24.305 INFO:teuthology.orchestra.run.smithi102.stdout:Get:112 https://3.chacra.ceph.com/r/ceph/wip-mchangir-testing-20231110.052303/35f0debb3cc28955b7132ef4c509cd138a09d56b/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs-dev amd64 18.0.0-7288-g35f0debb-1jammy [38.3 kB] 2023-11-13T11:25:24.305 INFO:teuthology.orchestra.run.smithi102.stdout:Get:113 https://3.chacra.ceph.com/r/ceph/wip-mchangir-testing-20231110.052303/35f0debb3cc28955b7132ef4c509cd138a09d56b/ubuntu/jammy/flavors/default jammy/main amd64 radosgw amd64 18.0.0-7288-g35f0debb-1jammy [12.3 MB] 2023-11-13T11:25:24.711 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package librbd1. 2023-11-13T11:25:24.726 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../011-librbd1_18.0.0-7288-g35f0debb-1jammy_amd64.deb ... 2023-11-13T11:25:24.733 INFO:teuthology.orchestra.run.smithi102.stdout:Get:114 https://3.chacra.ceph.com/r/ceph/wip-mchangir-testing-20231110.052303/35f0debb3cc28955b7132ef4c509cd138a09d56b/ubuntu/jammy/flavors/default jammy/main amd64 rbd-fuse amd64 18.0.0-7288-g35f0debb-1jammy [91.4 kB] 2023-11-13T11:25:24.778 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking librbd1 (18.0.0-7288-g35f0debb-1jammy) ... 2023-11-13T11:25:25.264 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package libcephfs2. 2023-11-13T11:25:25.278 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../012-libcephfs2_18.0.0-7288-g35f0debb-1jammy_amd64.deb ... 2023-11-13T11:25:25.302 INFO:teuthology.orchestra.run.smithi102.stdout:Fetched 186 MB in 18s (10.3 MB/s) 2023-11-13T11:25:25.322 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking libcephfs2 (18.0.0-7288-g35f0debb-1jammy) ... 2023-11-13T11:25:25.436 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package python3-pyperclip. 2023-11-13T11:25:25.505 INFO:teuthology.orchestra.run.smithi102.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 132932 files and directories currently installed.) 2023-11-13T11:25:25.508 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../000-python3-pyperclip_1.8.2-2_all.deb ... 2023-11-13T11:25:25.544 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking python3-pyperclip (1.8.2-2) ... 2023-11-13T11:25:25.624 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-rados. 2023-11-13T11:25:25.639 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../013-python3-rados_18.0.0-7288-g35f0debb-1jammy_amd64.deb ... 2023-11-13T11:25:25.691 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-rados (18.0.0-7288-g35f0debb-1jammy) ... 2023-11-13T11:25:26.047 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package python3-wcwidth. 2023-11-13T11:25:26.060 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../001-python3-wcwidth_0.2.5+dfsg1-1_all.deb ... 2023-11-13T11:25:26.097 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking python3-wcwidth (0.2.5+dfsg1-1) ... 2023-11-13T11:25:26.111 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-ceph-argparse. 2023-11-13T11:25:26.125 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../014-python3-ceph-argparse_18.0.0-7288-g35f0debb-1jammy_all.deb ... 2023-11-13T11:25:26.177 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-ceph-argparse (18.0.0-7288-g35f0debb-1jammy) ... 2023-11-13T11:25:26.441 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package python3-cmd2. 2023-11-13T11:25:26.454 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../002-python3-cmd2_2.3.3-1_all.deb ... 2023-11-13T11:25:26.480 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-cephfs. 2023-11-13T11:25:26.494 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../015-python3-cephfs_18.0.0-7288-g35f0debb-1jammy_amd64.deb ... 2023-11-13T11:25:26.499 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking python3-cmd2 (2.3.3-1) ... 2023-11-13T11:25:26.547 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-cephfs (18.0.0-7288-g35f0debb-1jammy) ... 2023-11-13T11:25:26.844 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package liblttng-ust1:amd64. 2023-11-13T11:25:26.857 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../003-liblttng-ust1_2.13.1-1ubuntu1_amd64.deb ... 2023-11-13T11:25:26.949 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-ceph-common. 2023-11-13T11:25:26.964 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../016-python3-ceph-common_18.0.0-7288-g35f0debb-1jammy_all.deb ... 2023-11-13T11:25:26.967 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2023-11-13T11:25:27.007 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-ceph-common (18.0.0-7288-g35f0debb-1jammy) ... 2023-11-13T11:25:27.273 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2023-11-13T11:25:27.287 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../004-libdouble-conversion3_3.1.7-4_amd64.deb ... 2023-11-13T11:25:27.322 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking libdouble-conversion3:amd64 (3.1.7-4) ... 2023-11-13T11:25:27.346 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-prettytable. 2023-11-13T11:25:27.361 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../017-python3-prettytable_2.5.0-2_all.deb ... 2023-11-13T11:25:27.404 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-prettytable (2.5.0-2) ... 2023-11-13T11:25:27.642 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2023-11-13T11:25:27.656 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../005-libpcre2-16-0_10.39-3ubuntu0.1_amd64.deb ... 2023-11-13T11:25:27.665 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-rbd. 2023-11-13T11:25:27.680 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../018-python3-rbd_18.0.0-7288-g35f0debb-1jammy_amd64.deb ... 2023-11-13T11:25:27.700 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2023-11-13T11:25:27.723 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-rbd (18.0.0-7288-g35f0debb-1jammy) ... 2023-11-13T11:25:28.093 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package librdkafka1:amd64. 2023-11-13T11:25:28.108 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../019-librdkafka1_1.8.0-1build1_amd64.deb ... 2023-11-13T11:25:28.151 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking librdkafka1:amd64 (1.8.0-1build1) ... 2023-11-13T11:25:28.171 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package libqt5core5a:amd64. 2023-11-13T11:25:28.185 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../006-libqt5core5a_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2023-11-13T11:25:28.238 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-11-13T11:25:28.430 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package librgw2. 2023-11-13T11:25:28.443 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../020-librgw2_18.0.0-7288-g35f0debb-1jammy_amd64.deb ... 2023-11-13T11:25:28.482 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking librgw2 (18.0.0-7288-g35f0debb-1jammy) ... 2023-11-13T11:25:28.632 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2023-11-13T11:25:28.646 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../007-libqt5dbus5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2023-11-13T11:25:28.682 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-11-13T11:25:28.948 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-rgw. 2023-11-13T11:25:28.962 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../021-python3-rgw_18.0.0-7288-g35f0debb-1jammy_amd64.deb ... 2023-11-13T11:25:28.993 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package libqt5network5:amd64. 2023-11-13T11:25:29.006 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-rgw (18.0.0-7288-g35f0debb-1jammy) ... 2023-11-13T11:25:29.007 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../008-libqt5network5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2023-11-13T11:25:29.052 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-11-13T11:25:29.342 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package liboath0:amd64. 2023-11-13T11:25:29.357 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../022-liboath0_2.6.7-3build1_amd64.deb ... 2023-11-13T11:25:29.401 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking liboath0:amd64 (2.6.7-3build1) ... 2023-11-13T11:25:29.430 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package libthrift-0.16.0:amd64. 2023-11-13T11:25:29.444 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../009-libthrift-0.16.0_0.16.0-2_amd64.deb ... 2023-11-13T11:25:29.488 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking libthrift-0.16.0:amd64 (0.16.0-2) ... 2023-11-13T11:25:29.679 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package libradosstriper1. 2023-11-13T11:25:29.693 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../023-libradosstriper1_18.0.0-7288-g35f0debb-1jammy_amd64.deb ... 2023-11-13T11:25:29.729 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking libradosstriper1 (18.0.0-7288-g35f0debb-1jammy) ... 2023-11-13T11:25:29.803 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package librados2. 2023-11-13T11:25:29.813 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../010-librados2_18.0.0-7288-g35f0debb-1jammy_amd64.deb ... 2023-11-13T11:25:29.849 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking librados2 (18.0.0-7288-g35f0debb-1jammy) ... 2023-11-13T11:25:30.132 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package ceph-common. 2023-11-13T11:25:30.147 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../024-ceph-common_18.0.0-7288-g35f0debb-1jammy_amd64.deb ... 2023-11-13T11:25:30.190 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking ceph-common (18.0.0-7288-g35f0debb-1jammy) ... 2023-11-13T11:25:30.202 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package librbd1. 2023-11-13T11:25:30.216 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../011-librbd1_18.0.0-7288-g35f0debb-1jammy_amd64.deb ... 2023-11-13T11:25:30.268 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking librbd1 (18.0.0-7288-g35f0debb-1jammy) ... 2023-11-13T11:25:30.671 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package libcephfs2. 2023-11-13T11:25:30.685 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../012-libcephfs2_18.0.0-7288-g35f0debb-1jammy_amd64.deb ... 2023-11-13T11:25:30.730 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking libcephfs2 (18.0.0-7288-g35f0debb-1jammy) ... 2023-11-13T11:25:31.074 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package python3-rados. 2023-11-13T11:25:31.087 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../013-python3-rados_18.0.0-7288-g35f0debb-1jammy_amd64.deb ... 2023-11-13T11:25:31.140 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking python3-rados (18.0.0-7288-g35f0debb-1jammy) ... 2023-11-13T11:25:31.279 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package ceph-base. 2023-11-13T11:25:31.294 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../025-ceph-base_18.0.0-7288-g35f0debb-1jammy_amd64.deb ... 2023-11-13T11:25:31.347 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking ceph-base (18.0.0-7288-g35f0debb-1jammy) ... 2023-11-13T11:25:31.552 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package python3-ceph-argparse. 2023-11-13T11:25:31.566 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../014-python3-ceph-argparse_18.0.0-7288-g35f0debb-1jammy_all.deb ... 2023-11-13T11:25:31.618 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking python3-ceph-argparse (18.0.0-7288-g35f0debb-1jammy) ... 2023-11-13T11:25:31.954 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package python3-cephfs. 2023-11-13T11:25:31.968 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../015-python3-cephfs_18.0.0-7288-g35f0debb-1jammy_amd64.deb ... 2023-11-13T11:25:32.021 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking python3-cephfs (18.0.0-7288-g35f0debb-1jammy) ... 2023-11-13T11:25:32.050 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-jaraco.functools. 2023-11-13T11:25:32.064 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../026-python3-jaraco.functools_3.4.0-2_all.deb ... 2023-11-13T11:25:32.109 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-jaraco.functools (3.4.0-2) ... 2023-11-13T11:25:32.349 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package python3-ceph-common. 2023-11-13T11:25:32.362 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-cheroot. 2023-11-13T11:25:32.363 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../016-python3-ceph-common_18.0.0-7288-g35f0debb-1jammy_all.deb ... 2023-11-13T11:25:32.375 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../027-python3-cheroot_8.5.2+ds1-1ubuntu3.1_all.deb ... 2023-11-13T11:25:32.420 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2023-11-13T11:25:32.440 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking python3-ceph-common (18.0.0-7288-g35f0debb-1jammy) ... 2023-11-13T11:25:32.714 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-jaraco.classes. 2023-11-13T11:25:32.729 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../028-python3-jaraco.classes_3.2.1-3_all.deb ... 2023-11-13T11:25:32.789 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-jaraco.classes (3.2.1-3) ... 2023-11-13T11:25:32.801 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package python3-prettytable. 2023-11-13T11:25:32.816 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../017-python3-prettytable_2.5.0-2_all.deb ... 2023-11-13T11:25:32.868 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking python3-prettytable (2.5.0-2) ... 2023-11-13T11:25:33.204 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package python3-rbd. 2023-11-13T11:25:33.219 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../018-python3-rbd_18.0.0-7288-g35f0debb-1jammy_amd64.deb ... 2023-11-13T11:25:33.271 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking python3-rbd (18.0.0-7288-g35f0debb-1jammy) ... 2023-11-13T11:25:33.284 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-jaraco.text. 2023-11-13T11:25:33.298 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../029-python3-jaraco.text_3.6.0-2_all.deb ... 2023-11-13T11:25:33.342 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-jaraco.text (3.6.0-2) ... 2023-11-13T11:25:33.653 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-jaraco.collections. 2023-11-13T11:25:33.668 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../030-python3-jaraco.collections_3.4.0-2_all.deb ... 2023-11-13T11:25:33.699 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package librdkafka1:amd64. 2023-11-13T11:25:33.711 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-jaraco.collections (3.4.0-2) ... 2023-11-13T11:25:33.713 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../019-librdkafka1_1.8.0-1build1_amd64.deb ... 2023-11-13T11:25:33.765 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking librdkafka1:amd64 (1.8.0-1build1) ... 2023-11-13T11:25:33.998 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-tempora. 2023-11-13T11:25:34.013 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../031-python3-tempora_4.1.2-1_all.deb ... 2023-11-13T11:25:34.056 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-tempora (4.1.2-1) ... 2023-11-13T11:25:34.160 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package librgw2. 2023-11-13T11:25:34.174 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../020-librgw2_18.0.0-7288-g35f0debb-1jammy_amd64.deb ... 2023-11-13T11:25:34.218 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking librgw2 (18.0.0-7288-g35f0debb-1jammy) ... 2023-11-13T11:25:34.359 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-portend. 2023-11-13T11:25:34.374 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../032-python3-portend_3.0.0-1_all.deb ... 2023-11-13T11:25:34.417 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-portend (3.0.0-1) ... 2023-11-13T11:25:34.737 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package python3-rgw. 2023-11-13T11:25:34.751 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../021-python3-rgw_18.0.0-7288-g35f0debb-1jammy_amd64.deb ... 2023-11-13T11:25:34.753 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-zc.lockfile. 2023-11-13T11:25:34.769 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../033-python3-zc.lockfile_2.0-1_all.deb ... 2023-11-13T11:25:34.812 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-zc.lockfile (2.0-1) ... 2023-11-13T11:25:34.812 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking python3-rgw (18.0.0-7288-g35f0debb-1jammy) ... 2023-11-13T11:25:35.081 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-cherrypy3. 2023-11-13T11:25:35.096 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../034-python3-cherrypy3_18.6.1-4_all.deb ... 2023-11-13T11:25:35.134 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-cherrypy3 (18.6.1-4) ... 2023-11-13T11:25:35.240 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package liboath0:amd64. 2023-11-13T11:25:35.255 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../022-liboath0_2.6.7-3build1_amd64.deb ... 2023-11-13T11:25:35.307 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking liboath0:amd64 (2.6.7-3build1) ... 2023-11-13T11:25:35.468 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-natsort. 2023-11-13T11:25:35.482 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../035-python3-natsort_8.0.2-1_all.deb ... 2023-11-13T11:25:35.526 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-natsort (8.0.2-1) ... 2023-11-13T11:25:35.710 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package libradosstriper1. 2023-11-13T11:25:35.724 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../023-libradosstriper1_18.0.0-7288-g35f0debb-1jammy_amd64.deb ... 2023-11-13T11:25:35.776 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking libradosstriper1 (18.0.0-7288-g35f0debb-1jammy) ... 2023-11-13T11:25:35.863 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-logutils. 2023-11-13T11:25:35.878 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../036-python3-logutils_0.3.3-8_all.deb ... 2023-11-13T11:25:35.921 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-logutils (0.3.3-8) ... 2023-11-13T11:25:36.182 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-markupsafe. 2023-11-13T11:25:36.197 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../037-python3-markupsafe_2.0.1-2build1_amd64.deb ... 2023-11-13T11:25:36.240 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-markupsafe (2.0.1-2build1) ... 2023-11-13T11:25:36.246 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package ceph-common. 2023-11-13T11:25:36.261 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../024-ceph-common_18.0.0-7288-g35f0debb-1jammy_amd64.deb ... 2023-11-13T11:25:36.313 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking ceph-common (18.0.0-7288-g35f0debb-1jammy) ... 2023-11-13T11:25:36.543 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-mako. 2023-11-13T11:25:36.558 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../038-python3-mako_1.1.3+ds1-2ubuntu0.1_all.deb ... 2023-11-13T11:25:36.601 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2023-11-13T11:25:36.972 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-simplegeneric. 2023-11-13T11:25:36.987 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../039-python3-simplegeneric_0.8.1-3_all.deb ... 2023-11-13T11:25:37.030 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2023-11-13T11:25:37.350 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-singledispatch. 2023-11-13T11:25:37.365 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../040-python3-singledispatch_3.4.0.3-3_all.deb ... 2023-11-13T11:25:37.378 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package ceph-base. 2023-11-13T11:25:37.392 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../025-ceph-base_18.0.0-7288-g35f0debb-1jammy_amd64.deb ... 2023-11-13T11:25:37.408 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-singledispatch (3.4.0.3-3) ... 2023-11-13T11:25:37.436 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking ceph-base (18.0.0-7288-g35f0debb-1jammy) ... 2023-11-13T11:25:37.661 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-webob. 2023-11-13T11:25:37.675 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../041-python3-webob_1%3a1.8.6-1.1_all.deb ... 2023-11-13T11:25:37.743 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-webob (1:1.8.6-1.1) ... 2023-11-13T11:25:38.080 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-waitress. 2023-11-13T11:25:38.095 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../042-python3-waitress_1.4.4-1.1ubuntu1_all.deb ... 2023-11-13T11:25:38.140 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package python3-jaraco.functools. 2023-11-13T11:25:38.141 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-waitress (1.4.4-1.1ubuntu1) ... 2023-11-13T11:25:38.154 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../026-python3-jaraco.functools_3.4.0-2_all.deb ... 2023-11-13T11:25:38.198 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking python3-jaraco.functools (3.4.0-2) ... 2023-11-13T11:25:38.450 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-tempita. 2023-11-13T11:25:38.464 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../043-python3-tempita_0.5.2-6ubuntu1_all.deb ... 2023-11-13T11:25:38.501 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package python3-cheroot. 2023-11-13T11:25:38.508 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-tempita (0.5.2-6ubuntu1) ... 2023-11-13T11:25:38.515 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../027-python3-cheroot_8.5.2+ds1-1ubuntu3.1_all.deb ... 2023-11-13T11:25:38.577 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2023-11-13T11:25:38.853 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-paste. 2023-11-13T11:25:38.869 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../044-python3-paste_3.5.0+dfsg1-1_all.deb ... 2023-11-13T11:25:38.904 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package python3-jaraco.classes. 2023-11-13T11:25:38.911 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-paste (3.5.0+dfsg1-1) ... 2023-11-13T11:25:38.918 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../028-python3-jaraco.classes_3.2.1-3_all.deb ... 2023-11-13T11:25:38.962 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking python3-jaraco.classes (3.2.1-3) ... 2023-11-13T11:25:39.239 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2023-11-13T11:25:39.254 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../045-python-pastedeploy-tpl_2.1.1-1_all.deb ... 2023-11-13T11:25:39.297 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python-pastedeploy-tpl (2.1.1-1) ... 2023-11-13T11:25:39.916 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package python3-jaraco.text. 2023-11-13T11:25:39.931 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../029-python3-jaraco.text_3.6.0-2_all.deb ... 2023-11-13T11:25:39.965 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking python3-jaraco.text (3.6.0-2) ... 2023-11-13T11:25:40.225 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-pastedeploy. 2023-11-13T11:25:40.241 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../046-python3-pastedeploy_2.1.1-1_all.deb ... 2023-11-13T11:25:40.251 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package python3-jaraco.collections. 2023-11-13T11:25:40.266 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../030-python3-jaraco.collections_3.4.0-2_all.deb ... 2023-11-13T11:25:40.283 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-pastedeploy (2.1.1-1) ... 2023-11-13T11:25:40.310 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking python3-jaraco.collections (3.4.0-2) ... 2023-11-13T11:25:40.570 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-webtest. 2023-11-13T11:25:40.585 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../047-python3-webtest_2.0.35-1_all.deb ... 2023-11-13T11:25:40.621 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package python3-tempora. 2023-11-13T11:25:40.635 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../031-python3-tempora_4.1.2-1_all.deb ... 2023-11-13T11:25:40.636 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-webtest (2.0.35-1) ... 2023-11-13T11:25:40.679 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking python3-tempora (4.1.2-1) ... 2023-11-13T11:25:40.906 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-pecan. 2023-11-13T11:25:40.921 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../048-python3-pecan_1.3.3-4ubuntu2_all.deb ... 2023-11-13T11:25:40.979 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-pecan (1.3.3-4ubuntu2) ... 2023-11-13T11:25:41.241 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package python3-portend. 2023-11-13T11:25:41.255 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../032-python3-portend_3.0.0-1_all.deb ... 2023-11-13T11:25:41.299 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking python3-portend (3.0.0-1) ... 2023-11-13T11:25:41.302 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-certifi. 2023-11-13T11:25:41.318 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../049-python3-certifi_2020.6.20-1_all.deb ... 2023-11-13T11:25:41.352 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-certifi (2020.6.20-1) ... 2023-11-13T11:25:41.593 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package python3-zc.lockfile. 2023-11-13T11:25:41.608 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../033-python3-zc.lockfile_2.0-1_all.deb ... 2023-11-13T11:25:41.652 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking python3-zc.lockfile (2.0-1) ... 2023-11-13T11:25:41.672 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-idna. 2023-11-13T11:25:41.687 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../050-python3-idna_3.3-1_all.deb ... 2023-11-13T11:25:41.730 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-idna (3.3-1) ... 2023-11-13T11:25:41.987 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package python3-cherrypy3. 2023-11-13T11:25:42.001 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../034-python3-cherrypy3_18.6.1-4_all.deb ... 2023-11-13T11:25:42.046 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking python3-cherrypy3 (18.6.1-4) ... 2023-11-13T11:25:42.066 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-urllib3. 2023-11-13T11:25:42.081 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../051-python3-urllib3_1.26.5-1~exp1ubuntu0.1_all.deb ... 2023-11-13T11:25:42.125 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2023-11-13T11:25:42.349 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package python3-natsort. 2023-11-13T11:25:42.364 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../035-python3-natsort_8.0.2-1_all.deb ... 2023-11-13T11:25:42.408 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking python3-natsort (8.0.2-1) ... 2023-11-13T11:25:42.428 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-requests. 2023-11-13T11:25:42.443 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../052-python3-requests_2.25.1+dfsg-2ubuntu0.1_all.deb ... 2023-11-13T11:25:42.478 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2023-11-13T11:25:42.744 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package python3-logutils. 2023-11-13T11:25:42.758 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../036-python3-logutils_0.3.3-8_all.deb ... 2023-11-13T11:25:42.781 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-werkzeug. 2023-11-13T11:25:42.796 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../053-python3-werkzeug_2.0.2+dfsg1-1ubuntu0.22.04.1_all.deb ... 2023-11-13T11:25:42.802 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking python3-logutils (0.3.3-8) ... 2023-11-13T11:25:42.839 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2023-11-13T11:25:43.122 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package python3-markupsafe. 2023-11-13T11:25:43.134 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2023-11-13T11:25:43.136 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../037-python3-markupsafe_2.0.1-2build1_amd64.deb ... 2023-11-13T11:25:43.147 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../054-ceph-mgr-modules-core_18.0.0-7288-g35f0debb-1jammy_all.deb ... 2023-11-13T11:25:43.180 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking python3-markupsafe (2.0.1-2build1) ... 2023-11-13T11:25:43.350 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking ceph-mgr-modules-core (18.0.0-7288-g35f0debb-1jammy) ... 2023-11-13T11:25:43.500 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package python3-mako. 2023-11-13T11:25:43.514 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../038-python3-mako_1.1.3+ds1-2ubuntu0.1_all.deb ... 2023-11-13T11:25:43.558 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2023-11-13T11:25:43.722 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2023-11-13T11:25:43.736 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../055-libsqlite3-mod-ceph_18.0.0-7288-g35f0debb-1jammy_amd64.deb ... 2023-11-13T11:25:43.780 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking libsqlite3-mod-ceph (18.0.0-7288-g35f0debb-1jammy) ... 2023-11-13T11:25:43.970 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package python3-simplegeneric. 2023-11-13T11:25:43.984 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../039-python3-simplegeneric_0.8.1-3_all.deb ... 2023-11-13T11:25:44.036 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2023-11-13T11:25:44.125 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-openssl. 2023-11-13T11:25:44.140 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../056-python3-openssl_21.0.0-1_all.deb ... 2023-11-13T11:25:44.174 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-openssl (21.0.0-1) ... 2023-11-13T11:25:44.447 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package python3-singledispatch. 2023-11-13T11:25:44.462 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../040-python3-singledispatch_3.4.0.3-3_all.deb ... 2023-11-13T11:25:44.503 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package ceph-mgr. 2023-11-13T11:25:44.514 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking python3-singledispatch (3.4.0.3-3) ... 2023-11-13T11:25:44.518 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../057-ceph-mgr_18.0.0-7288-g35f0debb-1jammy_amd64.deb ... 2023-11-13T11:25:44.561 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking ceph-mgr (18.0.0-7288-g35f0debb-1jammy) ... 2023-11-13T11:25:44.900 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package python3-webob. 2023-11-13T11:25:44.915 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../041-python3-webob_1%3a1.8.6-1.1_all.deb ... 2023-11-13T11:25:44.967 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking python3-webob (1:1.8.6-1.1) ... 2023-11-13T11:25:44.973 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package ceph-mon. 2023-11-13T11:25:44.988 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../058-ceph-mon_18.0.0-7288-g35f0debb-1jammy_amd64.deb ... 2023-11-13T11:25:45.030 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking ceph-mon (18.0.0-7288-g35f0debb-1jammy) ... 2023-11-13T11:25:45.405 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package python3-waitress. 2023-11-13T11:25:45.417 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../042-python3-waitress_1.4.4-1.1ubuntu1_all.deb ... 2023-11-13T11:25:45.464 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking python3-waitress (1.4.4-1.1ubuntu1) ... 2023-11-13T11:25:45.801 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package ceph-osd. 2023-11-13T11:25:45.816 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../059-ceph-osd_18.0.0-7288-g35f0debb-1jammy_amd64.deb ... 2023-11-13T11:25:45.850 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking ceph-osd (18.0.0-7288-g35f0debb-1jammy) ... 2023-11-13T11:25:45.866 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package python3-tempita. 2023-11-13T11:25:45.881 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../043-python3-tempita_0.5.2-6ubuntu1_all.deb ... 2023-11-13T11:25:45.933 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking python3-tempita (0.5.2-6ubuntu1) ... 2023-11-13T11:25:46.286 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package python3-paste. 2023-11-13T11:25:46.300 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../044-python3-paste_3.5.0+dfsg1-1_all.deb ... 2023-11-13T11:25:46.369 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking python3-paste (3.5.0+dfsg1-1) ... 2023-11-13T11:25:46.705 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2023-11-13T11:25:46.720 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../045-python-pastedeploy-tpl_2.1.1-1_all.deb ... 2023-11-13T11:25:46.764 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking python-pastedeploy-tpl (2.1.1-1) ... 2023-11-13T11:25:47.046 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package ceph. 2023-11-13T11:25:47.061 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../060-ceph_18.0.0-7288-g35f0debb-1jammy_amd64.deb ... 2023-11-13T11:25:47.092 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package python3-pastedeploy. 2023-11-13T11:25:47.104 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking ceph (18.0.0-7288-g35f0debb-1jammy) ... 2023-11-13T11:25:47.106 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../046-python3-pastedeploy_2.1.1-1_all.deb ... 2023-11-13T11:25:47.142 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking python3-pastedeploy (2.1.1-1) ... 2023-11-13T11:25:47.399 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package ceph-fuse. 2023-11-13T11:25:47.414 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../061-ceph-fuse_18.0.0-7288-g35f0debb-1jammy_amd64.deb ... 2023-11-13T11:25:47.457 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking ceph-fuse (18.0.0-7288-g35f0debb-1jammy) ... 2023-11-13T11:25:47.462 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package python3-webtest. 2023-11-13T11:25:47.476 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../047-python3-webtest_2.0.35-1_all.deb ... 2023-11-13T11:25:47.519 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking python3-webtest (2.0.35-1) ... 2023-11-13T11:25:47.819 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package ceph-mds. 2023-11-13T11:25:47.831 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package python3-pecan. 2023-11-13T11:25:47.833 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../062-ceph-mds_18.0.0-7288-g35f0debb-1jammy_amd64.deb ... 2023-11-13T11:25:47.845 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../048-python3-pecan_1.3.3-4ubuntu2_all.deb ... 2023-11-13T11:25:47.876 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking ceph-mds (18.0.0-7288-g35f0debb-1jammy) ... 2023-11-13T11:25:47.889 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking python3-pecan (1.3.3-4ubuntu2) ... 2023-11-13T11:25:48.269 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package python3-certifi. 2023-11-13T11:25:48.280 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package cephadm. 2023-11-13T11:25:48.283 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../049-python3-certifi_2020.6.20-1_all.deb ... 2023-11-13T11:25:48.295 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../063-cephadm_18.0.0-7288-g35f0debb-1jammy_amd64.deb ... 2023-11-13T11:25:48.327 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking python3-certifi (2020.6.20-1) ... 2023-11-13T11:25:48.338 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking cephadm (18.0.0-7288-g35f0debb-1jammy) ... 2023-11-13T11:25:48.633 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-asyncssh. 2023-11-13T11:25:48.648 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../064-python3-asyncssh_2.5.0-1_all.deb ... 2023-11-13T11:25:48.688 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package python3-idna. 2023-11-13T11:25:48.691 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-asyncssh (2.5.0-1) ... 2023-11-13T11:25:48.703 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../050-python3-idna_3.3-1_all.deb ... 2023-11-13T11:25:48.746 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking python3-idna (3.3-1) ... 2023-11-13T11:25:49.027 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python-babel-localedata. 2023-11-13T11:25:49.042 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../065-python-babel-localedata_2.8.0+dfsg.1-7_all.deb ... 2023-11-13T11:25:49.083 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package python3-urllib3. 2023-11-13T11:25:49.086 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python-babel-localedata (2.8.0+dfsg.1-7) ... 2023-11-13T11:25:49.097 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../051-python3-urllib3_1.26.5-1~exp1ubuntu0.1_all.deb ... 2023-11-13T11:25:49.132 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2023-11-13T11:25:49.444 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package python3-requests. 2023-11-13T11:25:49.458 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../052-python3-requests_2.25.1+dfsg-2ubuntu0.1_all.deb ... 2023-11-13T11:25:49.494 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2023-11-13T11:25:49.780 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package python3-werkzeug. 2023-11-13T11:25:49.795 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../053-python3-werkzeug_2.0.2+dfsg1-1ubuntu0.22.04.1_all.deb ... 2023-11-13T11:25:49.838 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2023-11-13T11:25:50.074 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-babel. 2023-11-13T11:25:50.088 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../066-python3-babel_2.8.0+dfsg.1-7_all.deb ... 2023-11-13T11:25:50.132 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-babel (2.8.0+dfsg.1-7) ... 2023-11-13T11:25:50.150 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2023-11-13T11:25:50.165 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../054-ceph-mgr-modules-core_18.0.0-7288-g35f0debb-1jammy_all.deb ... 2023-11-13T11:25:50.200 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking ceph-mgr-modules-core (18.0.0-7288-g35f0debb-1jammy) ... 2023-11-13T11:25:50.435 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-jinja2. 2023-11-13T11:25:50.449 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../067-python3-jinja2_3.0.3-1_all.deb ... 2023-11-13T11:25:50.494 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-jinja2 (3.0.3-1) ... 2023-11-13T11:25:50.588 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2023-11-13T11:25:50.601 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../055-libsqlite3-mod-ceph_18.0.0-7288-g35f0debb-1jammy_amd64.deb ... 2023-11-13T11:25:50.646 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking libsqlite3-mod-ceph (18.0.0-7288-g35f0debb-1jammy) ... 2023-11-13T11:25:50.831 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2023-11-13T11:25:50.844 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../068-ceph-mgr-cephadm_18.0.0-7288-g35f0debb-1jammy_all.deb ... 2023-11-13T11:25:50.914 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking ceph-mgr-cephadm (18.0.0-7288-g35f0debb-1jammy) ... 2023-11-13T11:25:50.982 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package python3-openssl. 2023-11-13T11:25:50.996 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../056-python3-openssl_21.0.0-1_all.deb ... 2023-11-13T11:25:51.040 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking python3-openssl (21.0.0-1) ... 2023-11-13T11:25:51.242 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-bcrypt. 2023-11-13T11:25:51.256 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../069-python3-bcrypt_3.2.0-1build1_amd64.deb ... 2023-11-13T11:25:51.300 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-bcrypt (3.2.0-1build1) ... 2023-11-13T11:25:51.352 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package ceph-mgr. 2023-11-13T11:25:51.366 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../057-ceph-mgr_18.0.0-7288-g35f0debb-1jammy_amd64.deb ... 2023-11-13T11:25:51.401 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking ceph-mgr (18.0.0-7288-g35f0debb-1jammy) ... 2023-11-13T11:25:51.553 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-repoze.lru. 2023-11-13T11:25:51.568 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../070-python3-repoze.lru_0.7-2_all.deb ... 2023-11-13T11:25:51.605 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2023-11-13T11:25:51.821 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package ceph-mon. 2023-11-13T11:25:51.835 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../058-ceph-mon_18.0.0-7288-g35f0debb-1jammy_amd64.deb ... 2023-11-13T11:25:51.879 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking ceph-mon (18.0.0-7288-g35f0debb-1jammy) ... 2023-11-13T11:25:51.931 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-routes. 2023-11-13T11:25:51.946 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../071-python3-routes_2.5.1-1ubuntu1_all.deb ... 2023-11-13T11:25:51.989 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-routes (2.5.1-1ubuntu1) ... 2023-11-13T11:25:52.310 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2023-11-13T11:25:52.325 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../072-ceph-mgr-dashboard_18.0.0-7288-g35f0debb-1jammy_all.deb ... 2023-11-13T11:25:52.368 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking ceph-mgr-dashboard (18.0.0-7288-g35f0debb-1jammy) ... 2023-11-13T11:25:52.691 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package ceph-osd. 2023-11-13T11:25:52.706 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../059-ceph-osd_18.0.0-7288-g35f0debb-1jammy_amd64.deb ... 2023-11-13T11:25:52.750 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking ceph-osd (18.0.0-7288-g35f0debb-1jammy) ... 2023-11-13T11:25:52.771 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-sklearn-lib:amd64. 2023-11-13T11:25:52.785 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../073-python3-sklearn-lib_0.23.2-5ubuntu6_amd64.deb ... 2023-11-13T11:25:52.821 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2023-11-13T11:25:53.317 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-joblib. 2023-11-13T11:25:53.331 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../074-python3-joblib_0.17.0-4ubuntu1_all.deb ... 2023-11-13T11:25:53.375 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-joblib (0.17.0-4ubuntu1) ... 2023-11-13T11:25:53.937 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-threadpoolctl. 2023-11-13T11:25:53.944 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package ceph. 2023-11-13T11:25:53.951 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../075-python3-threadpoolctl_3.1.0-1_all.deb ... 2023-11-13T11:25:53.959 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../060-ceph_18.0.0-7288-g35f0debb-1jammy_amd64.deb ... 2023-11-13T11:25:53.995 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking ceph (18.0.0-7288-g35f0debb-1jammy) ... 2023-11-13T11:25:53.995 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-threadpoolctl (3.1.0-1) ... 2023-11-13T11:25:54.290 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-sklearn. 2023-11-13T11:25:54.304 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../076-python3-sklearn_0.23.2-5ubuntu6_all.deb ... 2023-11-13T11:25:54.340 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-sklearn (0.23.2-5ubuntu6) ... 2023-11-13T11:25:54.356 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package ceph-fuse. 2023-11-13T11:25:54.370 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../061-ceph-fuse_18.0.0-7288-g35f0debb-1jammy_amd64.deb ... 2023-11-13T11:25:54.414 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking ceph-fuse (18.0.0-7288-g35f0debb-1jammy) ... 2023-11-13T11:25:54.834 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package ceph-mds. 2023-11-13T11:25:54.848 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../062-ceph-mds_18.0.0-7288-g35f0debb-1jammy_amd64.deb ... 2023-11-13T11:25:54.900 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking ceph-mds (18.0.0-7288-g35f0debb-1jammy) ... 2023-11-13T11:25:54.998 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2023-11-13T11:25:55.013 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../077-ceph-mgr-diskprediction-local_18.0.0-7288-g35f0debb-1jammy_all.deb ... 2023-11-13T11:25:55.057 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking ceph-mgr-diskprediction-local (18.0.0-7288-g35f0debb-1jammy) ... 2023-11-13T11:25:55.312 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package cephadm. 2023-11-13T11:25:55.327 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../063-cephadm_18.0.0-7288-g35f0debb-1jammy_amd64.deb ... 2023-11-13T11:25:55.362 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking cephadm (18.0.0-7288-g35f0debb-1jammy) ... 2023-11-13T11:25:55.649 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package python3-asyncssh. 2023-11-13T11:25:55.663 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../064-python3-asyncssh_2.5.0-1_all.deb ... 2023-11-13T11:25:55.740 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking python3-asyncssh (2.5.0-1) ... 2023-11-13T11:25:56.026 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package python-babel-localedata. 2023-11-13T11:25:56.041 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../065-python-babel-localedata_2.8.0+dfsg.1-7_all.deb ... 2023-11-13T11:25:56.060 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-cachetools. 2023-11-13T11:25:56.075 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../078-python3-cachetools_5.0.0-1_all.deb ... 2023-11-13T11:25:56.084 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking python-babel-localedata (2.8.0+dfsg.1-7) ... 2023-11-13T11:25:56.110 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-cachetools (5.0.0-1) ... 2023-11-13T11:25:56.380 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-pyasn1. 2023-11-13T11:25:56.396 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../079-python3-pyasn1_0.4.8-1_all.deb ... 2023-11-13T11:25:56.438 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-pyasn1 (0.4.8-1) ... 2023-11-13T11:25:56.742 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-pyasn1-modules. 2023-11-13T11:25:56.757 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../080-python3-pyasn1-modules_0.2.1-1_all.deb ... 2023-11-13T11:25:56.800 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-pyasn1-modules (0.2.1-1) ... 2023-11-13T11:25:57.144 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-rsa. 2023-11-13T11:25:57.159 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../081-python3-rsa_4.8-1_all.deb ... 2023-11-13T11:25:57.202 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-rsa (4.8-1) ... 2023-11-13T11:25:57.373 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package python3-babel. 2023-11-13T11:25:57.387 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../066-python3-babel_2.8.0+dfsg.1-7_all.deb ... 2023-11-13T11:25:57.431 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking python3-babel (2.8.0+dfsg.1-7) ... 2023-11-13T11:25:57.523 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-google-auth. 2023-11-13T11:25:57.538 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../082-python3-google-auth_1.5.1-3_all.deb ... 2023-11-13T11:25:57.581 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-google-auth (1.5.1-3) ... 2023-11-13T11:25:57.751 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package python3-jinja2. 2023-11-13T11:25:57.765 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../067-python3-jinja2_3.0.3-1_all.deb ... 2023-11-13T11:25:57.809 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking python3-jinja2 (3.0.3-1) ... 2023-11-13T11:25:57.968 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-requests-oauthlib. 2023-11-13T11:25:57.984 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../083-python3-requests-oauthlib_1.3.0+ds-0.1_all.deb ... 2023-11-13T11:25:58.018 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-requests-oauthlib (1.3.0+ds-0.1) ... 2023-11-13T11:25:58.171 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2023-11-13T11:25:58.185 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../068-ceph-mgr-cephadm_18.0.0-7288-g35f0debb-1jammy_all.deb ... 2023-11-13T11:25:58.221 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking ceph-mgr-cephadm (18.0.0-7288-g35f0debb-1jammy) ... 2023-11-13T11:25:58.397 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-websocket. 2023-11-13T11:25:58.412 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../084-python3-websocket_1.2.3-1_all.deb ... 2023-11-13T11:25:58.455 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-websocket (1.2.3-1) ... 2023-11-13T11:25:58.574 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package python3-bcrypt. 2023-11-13T11:25:58.589 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../069-python3-bcrypt_3.2.0-1build1_amd64.deb ... 2023-11-13T11:25:58.633 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking python3-bcrypt (3.2.0-1build1) ... 2023-11-13T11:25:58.775 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-kubernetes. 2023-11-13T11:25:58.790 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../085-python3-kubernetes_12.0.1-1ubuntu1_all.deb ... 2023-11-13T11:25:58.858 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-kubernetes (12.0.1-1ubuntu1) ... 2023-11-13T11:25:58.919 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package python3-repoze.lru. 2023-11-13T11:25:58.933 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../070-python3-repoze.lru_0.7-2_all.deb ... 2023-11-13T11:25:58.969 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2023-11-13T11:25:59.280 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package python3-routes. 2023-11-13T11:25:59.295 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../071-python3-routes_2.5.1-1ubuntu1_all.deb ... 2023-11-13T11:25:59.338 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking python3-routes (2.5.1-1ubuntu1) ... 2023-11-13T11:25:59.539 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2023-11-13T11:25:59.553 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../086-ceph-mgr-k8sevents_18.0.0-7288-g35f0debb-1jammy_all.deb ... 2023-11-13T11:25:59.597 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking ceph-mgr-k8sevents (18.0.0-7288-g35f0debb-1jammy) ... 2023-11-13T11:25:59.675 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2023-11-13T11:25:59.690 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../072-ceph-mgr-dashboard_18.0.0-7288-g35f0debb-1jammy_all.deb ... 2023-11-13T11:25:59.733 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking ceph-mgr-dashboard (18.0.0-7288-g35f0debb-1jammy) ... 2023-11-13T11:25:59.891 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package libonig5:amd64. 2023-11-13T11:25:59.905 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../087-libonig5_6.9.7.1-2build1_amd64.deb ... 2023-11-13T11:25:59.941 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking libonig5:amd64 (6.9.7.1-2build1) ... 2023-11-13T11:26:00.136 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package python3-sklearn-lib:amd64. 2023-11-13T11:26:00.151 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../073-python3-sklearn-lib_0.23.2-5ubuntu6_amd64.deb ... 2023-11-13T11:26:00.228 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2023-11-13T11:26:00.261 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package libjq1:amd64. 2023-11-13T11:26:00.275 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../088-libjq1_1.6-2.1ubuntu3_amd64.deb ... 2023-11-13T11:26:00.319 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking libjq1:amd64 (1.6-2.1ubuntu3) ... 2023-11-13T11:26:00.581 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package jq. 2023-11-13T11:26:00.595 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../089-jq_1.6-2.1ubuntu3_amd64.deb ... 2023-11-13T11:26:00.639 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking jq (1.6-2.1ubuntu3) ... 2023-11-13T11:26:00.665 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package python3-joblib. 2023-11-13T11:26:00.679 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../074-python3-joblib_0.17.0-4ubuntu1_all.deb ... 2023-11-13T11:26:00.740 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking python3-joblib (0.17.0-4ubuntu1) ... 2023-11-13T11:26:00.916 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package socat. 2023-11-13T11:26:00.931 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../090-socat_1.7.4.1-3ubuntu4_amd64.deb ... 2023-11-13T11:26:00.975 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking socat (1.7.4.1-3ubuntu4) ... 2023-11-13T11:26:01.102 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package python3-threadpoolctl. 2023-11-13T11:26:01.116 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../075-python3-threadpoolctl_3.1.0-1_all.deb ... 2023-11-13T11:26:01.160 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking python3-threadpoolctl (3.1.0-1) ... 2023-11-13T11:26:01.261 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package xmlstarlet. 2023-11-13T11:26:01.276 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../091-xmlstarlet_1.6.1-2.1_amd64.deb ... 2023-11-13T11:26:01.311 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking xmlstarlet (1.6.1-2.1) ... 2023-11-13T11:26:01.455 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package python3-sklearn. 2023-11-13T11:26:01.469 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../076-python3-sklearn_0.23.2-5ubuntu6_all.deb ... 2023-11-13T11:26:01.504 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking python3-sklearn (0.23.2-5ubuntu6) ... 2023-11-13T11:26:01.640 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package ceph-test. 2023-11-13T11:26:01.654 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../092-ceph-test_18.0.0-7288-g35f0debb-1jammy_amd64.deb ... 2023-11-13T11:26:01.698 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking ceph-test (18.0.0-7288-g35f0debb-1jammy) ... 2023-11-13T11:26:02.197 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2023-11-13T11:26:02.210 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../077-ceph-mgr-diskprediction-local_18.0.0-7288-g35f0debb-1jammy_all.deb ... 2023-11-13T11:26:02.254 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking ceph-mgr-diskprediction-local (18.0.0-7288-g35f0debb-1jammy) ... 2023-11-13T11:26:03.266 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package python3-cachetools. 2023-11-13T11:26:03.281 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../078-python3-cachetools_5.0.0-1_all.deb ... 2023-11-13T11:26:03.324 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking python3-cachetools (5.0.0-1) ... 2023-11-13T11:26:03.552 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package ceph-volume. 2023-11-13T11:26:03.568 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../093-ceph-volume_18.0.0-7288-g35f0debb-1jammy_all.deb ... 2023-11-13T11:26:03.602 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking ceph-volume (18.0.0-7288-g35f0debb-1jammy) ... 2023-11-13T11:26:03.627 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package python3-pyasn1. 2023-11-13T11:26:03.642 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../079-python3-pyasn1_0.4.8-1_all.deb ... 2023-11-13T11:26:03.685 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking python3-pyasn1 (0.4.8-1) ... 2023-11-13T11:26:03.988 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package python3-pyasn1-modules. 2023-11-13T11:26:04.003 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../080-python3-pyasn1-modules_0.2.1-1_all.deb ... 2023-11-13T11:26:04.080 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking python3-pyasn1-modules (0.2.1-1) ... 2023-11-13T11:26:04.182 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package cephfs-mirror. 2023-11-13T11:26:04.198 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../094-cephfs-mirror_18.0.0-7288-g35f0debb-1jammy_amd64.deb ... 2023-11-13T11:26:04.232 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking cephfs-mirror (18.0.0-7288-g35f0debb-1jammy) ... 2023-11-13T11:26:04.391 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package python3-rsa. 2023-11-13T11:26:04.406 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../081-python3-rsa_4.8-1_all.deb ... 2023-11-13T11:26:04.449 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking python3-rsa (4.8-1) ... 2023-11-13T11:26:04.535 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-colorama. 2023-11-13T11:26:04.551 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../095-python3-colorama_0.4.4-1_all.deb ... 2023-11-13T11:26:04.601 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-colorama (0.4.4-1) ... 2023-11-13T11:26:04.803 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package python3-google-auth. 2023-11-13T11:26:04.818 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../082-python3-google-auth_1.5.1-3_all.deb ... 2023-11-13T11:26:04.861 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking python3-google-auth (1.5.1-3) ... 2023-11-13T11:26:04.879 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package cephfs-shell. 2023-11-13T11:26:04.894 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../096-cephfs-shell_18.0.0-7288-g35f0debb-1jammy_all.deb ... 2023-11-13T11:26:04.937 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking cephfs-shell (18.0.0-7288-g35f0debb-1jammy) ... 2023-11-13T11:26:05.150 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package cephfs-top. 2023-11-13T11:26:05.166 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../097-cephfs-top_18.0.0-7288-g35f0debb-1jammy_all.deb ... 2023-11-13T11:26:05.209 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking cephfs-top (18.0.0-7288-g35f0debb-1jammy) ... 2023-11-13T11:26:05.274 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package python3-requests-oauthlib. 2023-11-13T11:26:05.289 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../083-python3-requests-oauthlib_1.3.0+ds-0.1_all.deb ... 2023-11-13T11:26:05.324 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking python3-requests-oauthlib (1.3.0+ds-0.1) ... 2023-11-13T11:26:05.419 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package libcephfs-dev. 2023-11-13T11:26:05.434 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../098-libcephfs-dev_18.0.0-7288-g35f0debb-1jammy_amd64.deb ... 2023-11-13T11:26:05.470 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking libcephfs-dev (18.0.0-7288-g35f0debb-1jammy) ... 2023-11-13T11:26:05.627 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package python3-websocket. 2023-11-13T11:26:05.642 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../084-python3-websocket_1.2.3-1_all.deb ... 2023-11-13T11:26:05.711 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking python3-websocket (1.2.3-1) ... 2023-11-13T11:26:05.856 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package nvme-cli. 2023-11-13T11:26:05.870 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../099-nvme-cli_1.16-3ubuntu0.1_amd64.deb ... 2023-11-13T11:26:05.914 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking nvme-cli (1.16-3ubuntu0.1) ... 2023-11-13T11:26:06.030 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package python3-kubernetes. 2023-11-13T11:26:06.046 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../085-python3-kubernetes_12.0.1-1ubuntu1_all.deb ... 2023-11-13T11:26:06.088 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking python3-kubernetes (12.0.1-1ubuntu1) ... 2023-11-13T11:26:06.244 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python-asyncssh-doc. 2023-11-13T11:26:06.259 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../100-python-asyncssh-doc_2.5.0-1_all.deb ... 2023-11-13T11:26:06.302 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python-asyncssh-doc (2.5.0-1) ... 2023-11-13T11:26:06.730 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-iniconfig. 2023-11-13T11:26:06.745 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../101-python3-iniconfig_1.1.1-2_all.deb ... 2023-11-13T11:26:06.794 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2023-11-13T11:26:06.805 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-iniconfig (1.1.1-2) ... 2023-11-13T11:26:06.808 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../086-ceph-mgr-k8sevents_18.0.0-7288-g35f0debb-1jammy_all.deb ... 2023-11-13T11:26:06.844 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking ceph-mgr-k8sevents (18.0.0-7288-g35f0debb-1jammy) ... 2023-11-13T11:26:07.092 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-pastescript. 2023-11-13T11:26:07.106 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../102-python3-pastescript_2.0.2-4_all.deb ... 2023-11-13T11:26:07.138 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package libonig5:amd64. 2023-11-13T11:26:07.150 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2023-11-13T11:26:07.152 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../087-libonig5_6.9.7.1-2build1_amd64.deb ... 2023-11-13T11:26:07.196 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking libonig5:amd64 (6.9.7.1-2build1) ... 2023-11-13T11:26:07.470 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-pluggy. 2023-11-13T11:26:07.484 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../103-python3-pluggy_0.13.0-7.1_all.deb ... 2023-11-13T11:26:07.528 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-pluggy (0.13.0-7.1) ... 2023-11-13T11:26:07.566 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package libjq1:amd64. 2023-11-13T11:26:07.580 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../088-libjq1_1.6-2.1ubuntu3_amd64.deb ... 2023-11-13T11:26:07.624 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking libjq1:amd64 (1.6-2.1ubuntu3) ... 2023-11-13T11:26:07.847 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-psutil. 2023-11-13T11:26:07.862 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../104-python3-psutil_5.9.0-1build1_amd64.deb ... 2023-11-13T11:26:07.906 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-psutil (5.9.0-1build1) ... 2023-11-13T11:26:07.927 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package jq. 2023-11-13T11:26:07.942 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../089-jq_1.6-2.1ubuntu3_amd64.deb ... 2023-11-13T11:26:07.986 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking jq (1.6-2.1ubuntu3) ... 2023-11-13T11:26:08.230 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package socat. 2023-11-13T11:26:08.242 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-py. 2023-11-13T11:26:08.244 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../090-socat_1.7.4.1-3ubuntu4_amd64.deb ... 2023-11-13T11:26:08.257 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../105-python3-py_1.10.0-1_all.deb ... 2023-11-13T11:26:08.280 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking socat (1.7.4.1-3ubuntu4) ... 2023-11-13T11:26:08.300 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-py (1.10.0-1) ... 2023-11-13T11:26:08.591 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package xmlstarlet. 2023-11-13T11:26:08.605 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../091-xmlstarlet_1.6.1-2.1_amd64.deb ... 2023-11-13T11:26:08.620 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-pygments. 2023-11-13T11:26:08.635 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../106-python3-pygments_2.11.2+dfsg-2_all.deb ... 2023-11-13T11:26:08.649 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking xmlstarlet (1.6.1-2.1) ... 2023-11-13T11:26:08.678 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-pygments (2.11.2+dfsg-2) ... 2023-11-13T11:26:09.003 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package ceph-test. 2023-11-13T11:26:09.018 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../092-ceph-test_18.0.0-7288-g35f0debb-1jammy_amd64.deb ... 2023-11-13T11:26:09.053 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking ceph-test (18.0.0-7288-g35f0debb-1jammy) ... 2023-11-13T11:26:09.124 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-pyinotify. 2023-11-13T11:26:09.138 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../107-python3-pyinotify_0.9.6-1.3_all.deb ... 2023-11-13T11:26:09.174 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-pyinotify (0.9.6-1.3) ... 2023-11-13T11:26:09.477 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-toml. 2023-11-13T11:26:09.491 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../108-python3-toml_0.10.2-1_all.deb ... 2023-11-13T11:26:09.535 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-toml (0.10.2-1) ... 2023-11-13T11:26:09.854 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-pytest. 2023-11-13T11:26:09.868 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../109-python3-pytest_6.2.5-1ubuntu2_all.deb ... 2023-11-13T11:26:09.913 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-pytest (6.2.5-1ubuntu2) ... 2023-11-13T11:26:10.241 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-simplejson. 2023-11-13T11:26:10.255 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../110-python3-simplejson_3.17.6-1build1_amd64.deb ... 2023-11-13T11:26:10.300 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-simplejson (3.17.6-1build1) ... 2023-11-13T11:26:10.552 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package qttranslations5-l10n. 2023-11-13T11:26:10.566 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../111-qttranslations5-l10n_5.15.3-1_all.deb ... 2023-11-13T11:26:10.610 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking qttranslations5-l10n (5.15.3-1) ... 2023-11-13T11:26:10.915 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package ceph-volume. 2023-11-13T11:26:10.931 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../093-ceph-volume_18.0.0-7288-g35f0debb-1jammy_all.deb ... 2023-11-13T11:26:10.974 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking ceph-volume (18.0.0-7288-g35f0debb-1jammy) ... 2023-11-13T11:26:11.328 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package cephfs-mirror. 2023-11-13T11:26:11.342 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../094-cephfs-mirror_18.0.0-7288-g35f0debb-1jammy_amd64.deb ... 2023-11-13T11:26:11.347 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package radosgw. 2023-11-13T11:26:11.362 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../112-radosgw_18.0.0-7288-g35f0debb-1jammy_amd64.deb ... 2023-11-13T11:26:11.388 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking cephfs-mirror (18.0.0-7288-g35f0debb-1jammy) ... 2023-11-13T11:26:11.405 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking radosgw (18.0.0-7288-g35f0debb-1jammy) ... 2023-11-13T11:26:11.981 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package python3-colorama. 2023-11-13T11:26:11.997 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../095-python3-colorama_0.4.4-1_all.deb ... 2023-11-13T11:26:12.000 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package rbd-fuse. 2023-11-13T11:26:12.015 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../113-rbd-fuse_18.0.0-7288-g35f0debb-1jammy_amd64.deb ... 2023-11-13T11:26:12.039 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking python3-colorama (0.4.4-1) ... 2023-11-13T11:26:12.059 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking rbd-fuse (18.0.0-7288-g35f0debb-1jammy) ... 2023-11-13T11:26:12.292 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package cephfs-shell. 2023-11-13T11:26:12.307 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../096-cephfs-shell_18.0.0-7288-g35f0debb-1jammy_all.deb ... 2023-11-13T11:26:12.342 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking cephfs-shell (18.0.0-7288-g35f0debb-1jammy) ... 2023-11-13T11:26:12.352 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-iniconfig (1.1.1-2) ... 2023-11-13T11:26:12.605 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up libdouble-conversion3:amd64 (3.1.7-4) ... 2023-11-13T11:26:12.611 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package cephfs-top. 2023-11-13T11:26:12.626 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../097-cephfs-top_18.0.0-7288-g35f0debb-1jammy_all.deb ... 2023-11-13T11:26:12.669 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking cephfs-top (18.0.0-7288-g35f0debb-1jammy) ... 2023-11-13T11:26:12.706 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up nvme-cli (1.16-3ubuntu0.1) ... 2023-11-13T11:26:12.922 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package libcephfs-dev. 2023-11-13T11:26:12.937 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../098-libcephfs-dev_18.0.0-7288-g35f0debb-1jammy_amd64.deb ... 2023-11-13T11:26:12.980 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking libcephfs-dev (18.0.0-7288-g35f0debb-1jammy) ... 2023-11-13T11:26:12.998 INFO:teuthology.orchestra.run.smithi154.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service -> /lib/systemd/system/nvmefc-boot-connections.service. 2023-11-13T11:26:13.376 INFO:teuthology.orchestra.run.smithi154.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmf-autoconnect.service -> /lib/systemd/system/nvmf-autoconnect.service. 2023-11-13T11:26:13.392 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package nvme-cli. 2023-11-13T11:26:13.407 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../099-nvme-cli_1.16-3ubuntu0.1_amd64.deb ... 2023-11-13T11:26:13.450 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking nvme-cli (1.16-3ubuntu0.1) ... 2023-11-13T11:26:13.822 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package python-asyncssh-doc. 2023-11-13T11:26:13.837 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../100-python-asyncssh-doc_2.5.0-1_all.deb ... 2023-11-13T11:26:13.880 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking python-asyncssh-doc (2.5.0-1) ... 2023-11-13T11:26:14.008 INFO:teuthology.orchestra.run.smithi154.stdout:nvmf-connect.target is a disabled or a static unit, not starting it. 2023-11-13T11:26:14.022 INFO:teuthology.orchestra.run.smithi154.stdout:Could not execute systemctl: at /usr/bin/deb-systemd-invoke line 142. 2023-11-13T11:26:14.083 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up cephadm (18.0.0-7288-g35f0debb-1jammy) ... 2023-11-13T11:26:14.325 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package python3-iniconfig. 2023-11-13T11:26:14.339 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../101-python3-iniconfig_1.1.1-2_all.deb ... 2023-11-13T11:26:14.383 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking python3-iniconfig (1.1.1-2) ... 2023-11-13T11:26:14.728 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package python3-pastescript. 2023-11-13T11:26:14.743 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../102-python3-pastescript_2.0.2-4_all.deb ... 2023-11-13T11:26:14.786 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2023-11-13T11:26:14.913 INFO:teuthology.orchestra.run.smithi154.stdout:Adding system user cephadm....done 2023-11-13T11:26:15.089 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package python3-pluggy. 2023-11-13T11:26:15.090 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-waitress (1.4.4-1.1ubuntu1) ... 2023-11-13T11:26:15.103 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../103-python3-pluggy_0.13.0-7.1_all.deb ... 2023-11-13T11:26:15.139 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking python3-pluggy (0.13.0-7.1) ... 2023-11-13T11:26:15.425 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package python3-psutil. 2023-11-13T11:26:15.440 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../104-python3-psutil_5.9.0-1build1_amd64.deb ... 2023-11-13T11:26:15.483 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking python3-psutil (5.9.0-1build1) ... 2023-11-13T11:26:15.667 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-jaraco.classes (3.2.1-3) ... 2023-11-13T11:26:15.828 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package python3-py. 2023-11-13T11:26:15.844 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../105-python3-py_1.10.0-1_all.deb ... 2023-11-13T11:26:15.886 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking python3-py (1.10.0-1) ... 2023-11-13T11:26:15.943 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python-asyncssh-doc (2.5.0-1) ... 2023-11-13T11:26:16.070 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-jaraco.functools (3.4.0-2) ... 2023-11-13T11:26:16.206 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package python3-pygments. 2023-11-13T11:26:16.221 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../106-python3-pygments_2.11.2+dfsg-2_all.deb ... 2023-11-13T11:26:16.264 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking python3-pygments (2.11.2+dfsg-2) ... 2023-11-13T11:26:16.329 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-repoze.lru (0.7-2) ... 2023-11-13T11:26:16.580 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up liboath0:amd64 (2.6.7-3build1) ... 2023-11-13T11:26:16.698 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-py (1.10.0-1) ... 2023-11-13T11:26:16.735 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package python3-pyinotify. 2023-11-13T11:26:16.750 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../107-python3-pyinotify_0.9.6-1.3_all.deb ... 2023-11-13T11:26:16.794 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking python3-pyinotify (0.9.6-1.3) ... 2023-11-13T11:26:17.050 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-joblib (0.17.0-4ubuntu1) ... 2023-11-13T11:26:17.121 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package python3-toml. 2023-11-13T11:26:17.135 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../108-python3-toml_0.10.2-1_all.deb ... 2023-11-13T11:26:17.179 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking python3-toml (0.10.2-1) ... 2023-11-13T11:26:17.418 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-cachetools (5.0.0-1) ... 2023-11-13T11:26:17.482 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package python3-pytest. 2023-11-13T11:26:17.496 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../109-python3-pytest_6.2.5-1ubuntu2_all.deb ... 2023-11-13T11:26:17.532 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking python3-pytest (6.2.5-1ubuntu2) ... 2023-11-13T11:26:17.686 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-colorama (0.4.4-1) ... 2023-11-13T11:26:17.868 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package python3-simplejson. 2023-11-13T11:26:17.883 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../110-python3-simplejson_3.17.6-1build1_amd64.deb ... 2023-11-13T11:26:17.956 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking python3-simplejson (3.17.6-1build1) ... 2023-11-13T11:26:17.979 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-openssl (21.0.0-1) ... 2023-11-13T11:26:18.229 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package qttranslations5-l10n. 2023-11-13T11:26:18.244 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../111-qttranslations5-l10n_5.15.3-1_all.deb ... 2023-11-13T11:26:18.287 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking qttranslations5-l10n (5.15.3-1) ... 2023-11-13T11:26:18.338 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-bcrypt (3.2.0-1build1) ... 2023-11-13T11:26:18.589 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-pyinotify (0.9.6-1.3) ... 2023-11-13T11:26:18.857 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-threadpoolctl (3.1.0-1) ... 2023-11-13T11:26:19.029 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package radosgw. 2023-11-13T11:26:19.043 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../112-radosgw_18.0.0-7288-g35f0debb-1jammy_amd64.deb ... 2023-11-13T11:26:19.083 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking radosgw (18.0.0-7288-g35f0debb-1jammy) ... 2023-11-13T11:26:19.117 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-ceph-argparse (18.0.0-7288-g35f0debb-1jammy) ... 2023-11-13T11:26:19.384 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2023-11-13T11:26:19.510 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-pyperclip (1.8.2-2) ... 2023-11-13T11:26:19.694 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package rbd-fuse. 2023-11-13T11:26:19.709 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../113-rbd-fuse_18.0.0-7288-g35f0debb-1jammy_amd64.deb ... 2023-11-13T11:26:19.752 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking rbd-fuse (18.0.0-7288-g35f0debb-1jammy) ... 2023-11-13T11:26:19.778 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-markupsafe (2.0.1-2build1) ... 2023-11-13T11:26:20.021 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2023-11-13T11:26:20.036 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up python3-iniconfig (1.1.1-2) ... 2023-11-13T11:26:20.122 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-psutil (5.9.0-1build1) ... 2023-11-13T11:26:20.340 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up libdouble-conversion3:amd64 (3.1.7-4) ... 2023-11-13T11:26:20.465 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python-babel-localedata (2.8.0+dfsg.1-7) ... 2023-11-13T11:26:20.466 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up nvme-cli (1.16-3ubuntu0.1) ... 2023-11-13T11:26:20.591 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-natsort (8.0.2-1) ... 2023-11-13T11:26:20.727 INFO:teuthology.orchestra.run.smithi102.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service -> /lib/systemd/system/nvmefc-boot-connections.service. 2023-11-13T11:26:20.859 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-routes (2.5.1-1ubuntu1) ... 2023-11-13T11:26:21.135 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-simplejson (3.17.6-1build1) ... 2023-11-13T11:26:21.144 INFO:teuthology.orchestra.run.smithi102.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmf-autoconnect.service -> /lib/systemd/system/nvmf-autoconnect.service. 2023-11-13T11:26:21.444 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-pygments (2.11.2+dfsg-2) ... 2023-11-13T11:26:21.748 INFO:teuthology.orchestra.run.smithi102.stdout:nvmf-connect.target is a disabled or a static unit, not starting it. 2023-11-13T11:26:21.804 INFO:teuthology.orchestra.run.smithi102.stdout:Could not execute systemctl: at /usr/bin/deb-systemd-invoke line 142. 2023-11-13T11:26:21.852 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up cephadm (18.0.0-7288-g35f0debb-1jammy) ... 2023-11-13T11:26:22.121 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-tempita (0.5.2-6ubuntu1) ... 2023-11-13T11:26:22.381 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python-pastedeploy-tpl (2.1.1-1) ... 2023-11-13T11:26:22.431 INFO:teuthology.orchestra.run.smithi102.stdout:Adding system user cephadm....done 2023-11-13T11:26:22.507 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up qttranslations5-l10n (5.15.3-1) ... 2023-11-13T11:26:22.591 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up python3-waitress (1.4.4-1.1ubuntu1) ... 2023-11-13T11:26:22.633 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-wcwidth (0.2.5+dfsg1-1) ... 2023-11-13T11:26:22.884 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up python3-jaraco.classes (3.2.1-3) ... 2023-11-13T11:26:22.976 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-asyncssh (2.5.0-1) ... 2023-11-13T11:26:23.144 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up python-asyncssh-doc (2.5.0-1) ... 2023-11-13T11:26:23.253 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up python3-jaraco.functools (3.4.0-2) ... 2023-11-13T11:26:23.377 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-certifi (2020.6.20-1) ... 2023-11-13T11:26:23.504 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up python3-repoze.lru (0.7-2) ... 2023-11-13T11:26:23.637 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-paste (3.5.0+dfsg1-1) ... 2023-11-13T11:26:23.764 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up liboath0:amd64 (2.6.7-3build1) ... 2023-11-13T11:26:23.890 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up python3-py (1.10.0-1) ... 2023-11-13T11:26:24.046 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2023-11-13T11:26:24.233 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up python3-joblib (0.17.0-4ubuntu1) ... 2023-11-13T11:26:24.340 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-cmd2 (2.3.3-1) ... 2023-11-13T11:26:24.610 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up python3-cachetools (5.0.0-1) ... 2023-11-13T11:26:24.658 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2023-11-13T11:26:24.878 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up python3-colorama (0.4.4-1) ... 2023-11-13T11:26:25.034 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-jaraco.text (3.6.0-2) ... 2023-11-13T11:26:25.137 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up python3-openssl (21.0.0-1) ... 2023-11-13T11:26:25.327 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up socat (1.7.4.1-3ubuntu4) ... 2023-11-13T11:26:25.414 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up python3-bcrypt (3.2.0-1build1) ... 2023-11-13T11:26:25.452 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-ceph-common (18.0.0-7288-g35f0debb-1jammy) ... 2023-11-13T11:26:25.656 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up python3-pyinotify (0.9.6-1.3) ... 2023-11-13T11:26:25.746 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-idna (3.3-1) ... 2023-11-13T11:26:25.924 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up python3-threadpoolctl (3.1.0-1) ... 2023-11-13T11:26:26.063 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-sklearn (0.23.2-5ubuntu6) ... 2023-11-13T11:26:26.192 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up python3-ceph-argparse (18.0.0-7288-g35f0debb-1jammy) ... 2023-11-13T11:26:26.487 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2023-11-13T11:26:26.613 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up python3-pyperclip (1.8.2-2) ... 2023-11-13T11:26:26.897 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up python3-markupsafe (2.0.1-2build1) ... 2023-11-13T11:26:27.165 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2023-11-13T11:26:27.278 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-11-13T11:26:27.316 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up python3-psutil (5.9.0-1build1) ... 2023-11-13T11:26:27.395 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-toml (0.10.2-1) ... 2023-11-13T11:26:27.663 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up librdkafka1:amd64 (1.8.0-1build1) ... 2023-11-13T11:26:27.684 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up python-babel-localedata (2.8.0+dfsg.1-7) ... 2023-11-13T11:26:27.772 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up xmlstarlet (1.6.1-2.1) ... 2023-11-13T11:26:27.843 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up python3-natsort (8.0.2-1) ... 2023-11-13T11:26:27.907 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2023-11-13T11:26:28.111 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up python3-routes (2.5.1-1ubuntu1) ... 2023-11-13T11:26:28.208 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-pluggy (0.13.0-7.1) ... 2023-11-13T11:26:28.370 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up python3-simplejson (3.17.6-1build1) ... 2023-11-13T11:26:28.484 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-zc.lockfile (2.0-1) ... 2023-11-13T11:26:28.680 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up python3-pygments (2.11.2+dfsg-2) ... 2023-11-13T11:26:28.752 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-11-13T11:26:28.870 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-pyasn1 (0.4.8-1) ... 2023-11-13T11:26:29.171 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-singledispatch (3.4.0.3-3) ... 2023-11-13T11:26:29.390 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up python3-tempita (0.5.2-6ubuntu1) ... 2023-11-13T11:26:29.423 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-logutils (0.3.3-8) ... 2023-11-13T11:26:29.666 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up python-pastedeploy-tpl (2.1.1-1) ... 2023-11-13T11:26:29.699 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-tempora (4.1.2-1) ... 2023-11-13T11:26:29.792 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up qttranslations5-l10n (5.15.3-1) ... 2023-11-13T11:26:29.943 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up python3-wcwidth (0.2.5+dfsg1-1) ... 2023-11-13T11:26:29.975 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2023-11-13T11:26:30.243 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-prettytable (2.5.0-2) ... 2023-11-13T11:26:30.261 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up python3-asyncssh (2.5.0-1) ... 2023-11-13T11:26:30.519 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2023-11-13T11:26:30.679 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up python3-certifi (2020.6.20-1) ... 2023-11-13T11:26:30.686 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-websocket (1.2.3-1) ... 2023-11-13T11:26:30.939 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up python3-paste (3.5.0+dfsg1-1) ... 2023-11-13T11:26:30.962 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up libonig5:amd64 (6.9.7.1-2build1) ... 2023-11-13T11:26:31.072 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2023-11-13T11:26:31.340 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2023-11-13T11:26:31.357 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-webob (1:1.8.6-1.1) ... 2023-11-13T11:26:31.641 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up python3-cmd2 (2.3.3-1) ... 2023-11-13T11:26:31.674 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-jaraco.collections (3.4.0-2) ... 2023-11-13T11:26:31.942 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-babel (2.8.0+dfsg.1-7) ... 2023-11-13T11:26:31.959 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2023-11-13T11:26:32.347 INFO:teuthology.orchestra.run.smithi154.stdout:update-alternatives: using /usr/bin/pybabel-python3 to provide /usr/bin/pybabel (pybabel) in auto mode 2023-11-13T11:26:32.427 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up python3-jaraco.text (3.6.0-2) ... 2023-11-13T11:26:32.595 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up libjq1:amd64 (1.6-2.1ubuntu3) ... 2023-11-13T11:26:32.687 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up socat (1.7.4.1-3ubuntu4) ... 2023-11-13T11:26:32.730 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-pytest (6.2.5-1ubuntu2) ... 2023-11-13T11:26:32.813 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up python3-ceph-common (18.0.0-7288-g35f0debb-1jammy) ... 2023-11-13T11:26:33.114 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up python3-idna (3.3-1) ... 2023-11-13T11:26:33.115 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-pastedeploy (2.1.1-1) ... 2023-11-13T11:26:33.382 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-portend (3.0.0-1) ... 2023-11-13T11:26:33.482 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up python3-sklearn (0.23.2-5ubuntu6) ... 2023-11-13T11:26:33.650 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-11-13T11:26:33.776 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-jinja2 (3.0.3-1) ... 2023-11-13T11:26:34.102 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-pyasn1-modules (0.2.1-1) ... 2023-11-13T11:26:34.403 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2023-11-13T11:26:34.671 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up jq (1.6-2.1ubuntu3) ... 2023-11-13T11:26:34.696 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-11-13T11:26:34.789 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-rsa (4.8-1) ... 2023-11-13T11:26:34.822 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up python3-toml (0.10.2-1) ... 2023-11-13T11:26:35.091 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up librdkafka1:amd64 (1.8.0-1build1) ... 2023-11-13T11:26:35.099 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-webtest (2.0.35-1) ... 2023-11-13T11:26:35.224 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up xmlstarlet (1.6.1-2.1) ... 2023-11-13T11:26:35.375 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-requests-oauthlib (1.3.0+ds-0.1) ... 2023-11-13T11:26:35.384 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2023-11-13T11:26:35.651 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-cherrypy3 (18.6.1-4) ... 2023-11-13T11:26:35.685 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up python3-pluggy (0.13.0-7.1) ... 2023-11-13T11:26:35.945 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up python3-zc.lockfile (2.0-1) ... 2023-11-13T11:26:36.044 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-pastescript (2.0.2-4) ... 2023-11-13T11:26:36.196 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-11-13T11:26:36.321 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-pecan (1.3.3-4ubuntu2) ... 2023-11-13T11:26:36.322 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up python3-pyasn1 (0.4.8-1) ... 2023-11-13T11:26:36.632 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up python3-singledispatch (3.4.0.3-3) ... 2023-11-13T11:26:36.656 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up libthrift-0.16.0:amd64 (0.16.0-2) ... 2023-11-13T11:26:36.782 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up librados2 (18.0.0-7288-g35f0debb-1jammy) ... 2023-11-13T11:26:36.891 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up python3-logutils (0.3.3-8) ... 2023-11-13T11:26:36.908 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up librgw2 (18.0.0-7288-g35f0debb-1jammy) ... 2023-11-13T11:26:37.034 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up libsqlite3-mod-ceph (18.0.0-7288-g35f0debb-1jammy) ... 2023-11-13T11:26:37.192 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up python3-tempora (4.1.2-1) ... 2023-11-13T11:26:37.229 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up libcephfs2 (18.0.0-7288-g35f0debb-1jammy) ... 2023-11-13T11:26:37.330 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up libradosstriper1 (18.0.0-7288-g35f0debb-1jammy) ... 2023-11-13T11:26:37.456 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-google-auth (1.5.1-3) ... 2023-11-13T11:26:37.459 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2023-11-13T11:26:37.741 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up librbd1 (18.0.0-7288-g35f0debb-1jammy) ... 2023-11-13T11:26:37.744 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up python3-prettytable (2.5.0-2) ... 2023-11-13T11:26:37.867 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up ceph-mgr-modules-core (18.0.0-7288-g35f0debb-1jammy) ... 2023-11-13T11:26:37.993 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up ceph-fuse (18.0.0-7288-g35f0debb-1jammy) ... 2023-11-13T11:26:38.004 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2023-11-13T11:26:38.147 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up python3-websocket (1.2.3-1) ... 2023-11-13T11:26:38.205 INFO:teuthology.orchestra.run.smithi154.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2023-11-13T11:26:38.205 INFO:teuthology.orchestra.run.smithi154.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2023-11-13T11:26:38.424 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up libonig5:amd64 (6.9.7.1-2build1) ... 2023-11-13T11:26:38.550 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2023-11-13T11:26:38.861 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up libcephfs-dev (18.0.0-7288-g35f0debb-1jammy) ... 2023-11-13T11:26:38.875 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up python3-webob (1:1.8.6-1.1) ... 2023-11-13T11:26:38.963 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-rados (18.0.0-7288-g35f0debb-1jammy) ... 2023-11-13T11:26:39.063 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up cephfs-top (18.0.0-7288-g35f0debb-1jammy) ... 2023-11-13T11:26:39.197 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-kubernetes (12.0.1-1ubuntu1) ... 2023-11-13T11:26:39.209 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up python3-jaraco.collections (3.4.0-2) ... 2023-11-13T11:26:39.486 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up python3-babel (2.8.0+dfsg.1-7) ... 2023-11-13T11:26:39.920 INFO:teuthology.orchestra.run.smithi102.stdout:update-alternatives: using /usr/bin/pybabel-python3 to provide /usr/bin/pybabel (pybabel) in auto mode 2023-11-13T11:26:40.189 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up libjq1:amd64 (1.6-2.1ubuntu3) ... 2023-11-13T11:26:40.331 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up python3-pytest (6.2.5-1ubuntu2) ... 2023-11-13T11:26:40.469 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-rbd (18.0.0-7288-g35f0debb-1jammy) ... 2023-11-13T11:26:40.612 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up rbd-fuse (18.0.0-7288-g35f0debb-1jammy) ... 2023-11-13T11:26:40.712 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-rgw (18.0.0-7288-g35f0debb-1jammy) ... 2023-11-13T11:26:40.733 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up python3-pastedeploy (2.1.1-1) ... 2023-11-13T11:26:40.813 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-cephfs (18.0.0-7288-g35f0debb-1jammy) ... 2023-11-13T11:26:40.931 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up cephfs-shell (18.0.0-7288-g35f0debb-1jammy) ... 2023-11-13T11:26:41.034 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up python3-portend (3.0.0-1) ... 2023-11-13T11:26:41.082 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up ceph-common (18.0.0-7288-g35f0debb-1jammy) ... 2023-11-13T11:26:41.294 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-11-13T11:26:41.436 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up python3-jinja2 (3.0.3-1) ... 2023-11-13T11:26:41.628 INFO:teuthology.orchestra.run.smithi154.stdout:Adding group ceph....done 2023-11-13T11:26:41.754 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up python3-pyasn1-modules (0.2.1-1) ... 2023-11-13T11:26:42.014 INFO:teuthology.orchestra.run.smithi154.stdout:Adding system user ceph....done 2023-11-13T11:26:42.046 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2023-11-13T11:26:42.198 INFO:teuthology.orchestra.run.smithi154.stdout:Setting system user ceph properties....done 2023-11-13T11:26:42.214 INFO:teuthology.orchestra.run.smithi154.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2023-11-13T11:26:42.323 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up jq (1.6-2.1ubuntu3) ... 2023-11-13T11:26:42.356 INFO:teuthology.orchestra.run.smithi154.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2023-11-13T11:26:42.474 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up python3-rsa (4.8-1) ... 2023-11-13T11:26:42.750 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up python3-webtest (2.0.35-1) ... 2023-11-13T11:26:42.761 INFO:teuthology.orchestra.run.smithi154.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2023-11-13T11:26:43.026 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up python3-requests-oauthlib (1.3.0+ds-0.1) ... 2023-11-13T11:26:43.294 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up python3-cherrypy3 (18.6.1-4) ... 2023-11-13T11:26:43.425 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up cephfs-mirror (18.0.0-7288-g35f0debb-1jammy) ... 2023-11-13T11:26:43.633 INFO:teuthology.orchestra.run.smithi154.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2023-11-13T11:26:43.634 INFO:teuthology.orchestra.run.smithi154.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2023-11-13T11:26:43.679 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up python3-pastescript (2.0.2-4) ... 2023-11-13T11:26:43.963 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up python3-pecan (1.3.3-4ubuntu2) ... 2023-11-13T11:26:44.276 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up ceph-test (18.0.0-7288-g35f0debb-1jammy) ... 2023-11-13T11:26:44.343 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up libthrift-0.16.0:amd64 (0.16.0-2) ... 2023-11-13T11:26:44.386 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up radosgw (18.0.0-7288-g35f0debb-1jammy) ... 2023-11-13T11:26:44.466 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up librados2 (18.0.0-7288-g35f0debb-1jammy) ... 2023-11-13T11:26:44.617 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up librgw2 (18.0.0-7288-g35f0debb-1jammy) ... 2023-11-13T11:26:44.743 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up libsqlite3-mod-ceph (18.0.0-7288-g35f0debb-1jammy) ... 2023-11-13T11:26:44.908 INFO:teuthology.orchestra.run.smithi154.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2023-11-13T11:26:44.908 INFO:teuthology.orchestra.run.smithi154.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2023-11-13T11:26:44.964 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up libcephfs2 (18.0.0-7288-g35f0debb-1jammy) ... 2023-11-13T11:26:45.073 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up libradosstriper1 (18.0.0-7288-g35f0debb-1jammy) ... 2023-11-13T11:26:45.224 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up python3-google-auth (1.5.1-3) ... 2023-11-13T11:26:45.509 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up librbd1 (18.0.0-7288-g35f0debb-1jammy) ... 2023-11-13T11:26:45.563 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up ceph-base (18.0.0-7288-g35f0debb-1jammy) ... 2023-11-13T11:26:45.635 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up ceph-mgr-modules-core (18.0.0-7288-g35f0debb-1jammy) ... 2023-11-13T11:26:45.794 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up ceph-fuse (18.0.0-7288-g35f0debb-1jammy) ... 2023-11-13T11:26:45.920 INFO:teuthology.orchestra.run.smithi154.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2023-11-13T11:26:46.016 INFO:teuthology.orchestra.run.smithi102.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2023-11-13T11:26:46.016 INFO:teuthology.orchestra.run.smithi102.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2023-11-13T11:26:46.581 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up ceph-mds (18.0.0-7288-g35f0debb-1jammy) ... 2023-11-13T11:26:46.671 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up libcephfs-dev (18.0.0-7288-g35f0debb-1jammy) ... 2023-11-13T11:26:46.812 INFO:teuthology.orchestra.run.smithi154.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2023-11-13T11:26:46.812 INFO:teuthology.orchestra.run.smithi154.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2023-11-13T11:26:46.872 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up python3-rados (18.0.0-7288-g35f0debb-1jammy) ... 2023-11-13T11:26:47.006 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up cephfs-top (18.0.0-7288-g35f0debb-1jammy) ... 2023-11-13T11:26:47.133 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up python3-kubernetes (12.0.1-1ubuntu1) ... 2023-11-13T11:26:47.458 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up ceph-mgr (18.0.0-7288-g35f0debb-1jammy) ... 2023-11-13T11:26:47.697 INFO:teuthology.orchestra.run.smithi154.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2023-11-13T11:26:47.697 INFO:teuthology.orchestra.run.smithi154.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2023-11-13T11:26:48.359 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up ceph-osd (18.0.0-7288-g35f0debb-1jammy) ... 2023-11-13T11:26:48.464 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up python3-rbd (18.0.0-7288-g35f0debb-1jammy) ... 2023-11-13T11:26:48.573 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up rbd-fuse (18.0.0-7288-g35f0debb-1jammy) ... 2023-11-13T11:26:48.699 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up python3-rgw (18.0.0-7288-g35f0debb-1jammy) ... 2023-11-13T11:26:48.755 INFO:teuthology.orchestra.run.smithi154.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2023-11-13T11:26:48.755 INFO:teuthology.orchestra.run.smithi154.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2023-11-13T11:26:48.825 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up python3-cephfs (18.0.0-7288-g35f0debb-1jammy) ... 2023-11-13T11:26:48.984 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up cephfs-shell (18.0.0-7288-g35f0debb-1jammy) ... 2023-11-13T11:26:49.110 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up ceph-common (18.0.0-7288-g35f0debb-1jammy) ... 2023-11-13T11:26:49.386 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up ceph-mgr-k8sevents (18.0.0-7288-g35f0debb-1jammy) ... 2023-11-13T11:26:49.488 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up ceph-mgr-diskprediction-local (18.0.0-7288-g35f0debb-1jammy) ... 2023-11-13T11:26:49.638 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up ceph-mon (18.0.0-7288-g35f0debb-1jammy) ... 2023-11-13T11:26:49.681 INFO:teuthology.orchestra.run.smithi102.stdout:Adding group ceph....done 2023-11-13T11:26:49.846 INFO:teuthology.orchestra.run.smithi154.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2023-11-13T11:26:49.847 INFO:teuthology.orchestra.run.smithi154.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2023-11-13T11:26:50.018 INFO:teuthology.orchestra.run.smithi102.stdout:Adding system user ceph....done 2023-11-13T11:26:50.210 INFO:teuthology.orchestra.run.smithi102.stdout:Setting system user ceph properties....done 2023-11-13T11:26:50.231 INFO:teuthology.orchestra.run.smithi102.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2023-11-13T11:26:50.372 INFO:teuthology.orchestra.run.smithi102.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2023-11-13T11:26:50.532 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up ceph-mgr-cephadm (18.0.0-7288-g35f0debb-1jammy) ... 2023-11-13T11:26:50.675 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up ceph (18.0.0-7288-g35f0debb-1jammy) ... 2023-11-13T11:26:50.782 INFO:teuthology.orchestra.run.smithi102.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2023-11-13T11:26:50.800 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up ceph-mgr-dashboard (18.0.0-7288-g35f0debb-1jammy) ... 2023-11-13T11:26:50.943 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up ceph-volume (18.0.0-7288-g35f0debb-1jammy) ... 2023-11-13T11:26:51.280 INFO:teuthology.orchestra.run.smithi154.stdout:Processing triggers for man-db (2.10.2-1) ... 2023-11-13T11:26:51.437 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up cephfs-mirror (18.0.0-7288-g35f0debb-1jammy) ... 2023-11-13T11:26:51.637 INFO:teuthology.orchestra.run.smithi102.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2023-11-13T11:26:51.638 INFO:teuthology.orchestra.run.smithi102.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2023-11-13T11:26:52.280 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up ceph-test (18.0.0-7288-g35f0debb-1jammy) ... 2023-11-13T11:26:52.372 INFO:teuthology.orchestra.run.smithi154.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2023-11-13T11:26:52.381 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up radosgw (18.0.0-7288-g35f0debb-1jammy) ... 2023-11-13T11:26:52.883 INFO:teuthology.orchestra.run.smithi154.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2023-11-13T11:26:52.888 DEBUG:teuthology.orchestra.run.smithi154:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install bison flex libelf-dev libssl-dev network-manager iproute2 util-linux dump indent libaio-dev libtool-bin uuid-dev xfslibs-dev postgresql postgresql-client postgresql-common postgresql-contrib 2023-11-13T11:26:52.924 INFO:teuthology.orchestra.run.smithi102.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2023-11-13T11:26:52.924 INFO:teuthology.orchestra.run.smithi102.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2023-11-13T11:26:52.962 INFO:teuthology.orchestra.run.smithi154.stdout:Reading package lists... 2023-11-13T11:26:53.129 INFO:teuthology.orchestra.run.smithi154.stdout:Building dependency tree... 2023-11-13T11:26:53.130 INFO:teuthology.orchestra.run.smithi154.stdout:Reading state information... 2023-11-13T11:26:53.281 INFO:teuthology.orchestra.run.smithi154.stdout:iproute2 is already the newest version (5.15.0-1ubuntu2). 2023-11-13T11:26:53.281 INFO:teuthology.orchestra.run.smithi154.stdout:libtool-bin is already the newest version (2.4.6-15build2). 2023-11-13T11:26:53.281 INFO:teuthology.orchestra.run.smithi154.stdout:util-linux is already the newest version (2.37.2-4ubuntu3). 2023-11-13T11:26:53.282 INFO:teuthology.orchestra.run.smithi154.stdout:uuid-dev is already the newest version (2.37.2-4ubuntu3). 2023-11-13T11:26:53.282 INFO:teuthology.orchestra.run.smithi154.stdout:xfslibs-dev is already the newest version (5.13.0-1ubuntu2). 2023-11-13T11:26:53.282 INFO:teuthology.orchestra.run.smithi154.stdout:The following packages were automatically installed and are no longer required: 2023-11-13T11:26:53.282 INFO:teuthology.orchestra.run.smithi154.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2023-11-13T11:26:53.282 INFO:teuthology.orchestra.run.smithi154.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2023-11-13T11:26:53.283 INFO:teuthology.orchestra.run.smithi154.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2023-11-13T11:26:53.283 INFO:teuthology.orchestra.run.smithi154.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2023-11-13T11:26:53.284 INFO:teuthology.orchestra.run.smithi154.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2023-11-13T11:26:53.284 INFO:teuthology.orchestra.run.smithi154.stdout:Use 'sudo apt autoremove' to remove them. 2023-11-13T11:26:53.285 INFO:teuthology.orchestra.run.smithi154.stdout:The following additional packages will be installed: 2023-11-13T11:26:53.285 INFO:teuthology.orchestra.run.smithi154.stdout: libbluetooth3 libfl-dev libfl2 libjson-perl libllvm14 liblzo2-2 2023-11-13T11:26:53.285 INFO:teuthology.orchestra.run.smithi154.stdout: libmbim-glib4 libmbim-proxy libmm-glib0 libndp0 libnm0 libpq5 libqmi-glib5 2023-11-13T11:26:53.285 INFO:teuthology.orchestra.run.smithi154.stdout: libqmi-proxy libssl3 libteamdctl0 modemmanager network-manager-pptp 2023-11-13T11:26:53.285 INFO:teuthology.orchestra.run.smithi154.stdout: postgresql-14 postgresql-client-14 postgresql-client-common ppp pptp-linux 2023-11-13T11:26:53.286 INFO:teuthology.orchestra.run.smithi154.stdout: tcl tcl8.6 usb-modeswitch usb-modeswitch-data wpasupplicant 2023-11-13T11:26:53.286 INFO:teuthology.orchestra.run.smithi154.stdout:Suggested packages: 2023-11-13T11:26:53.286 INFO:teuthology.orchestra.run.smithi154.stdout: bison-doc flex-doc indent-doc libssl-doc avahi-autoipd libteam-utils 2023-11-13T11:26:53.286 INFO:teuthology.orchestra.run.smithi154.stdout: postgresql-doc postgresql-doc-14 tcl-tclreadline comgt wvdial wpagui 2023-11-13T11:26:53.286 INFO:teuthology.orchestra.run.smithi154.stdout: libengine-pkcs11-openssl 2023-11-13T11:26:53.332 INFO:teuthology.orchestra.run.smithi154.stdout:The following NEW packages will be installed: 2023-11-13T11:26:53.333 INFO:teuthology.orchestra.run.smithi154.stdout: bison dump flex indent libaio-dev libbluetooth3 libelf-dev libfl-dev libfl2 2023-11-13T11:26:53.334 INFO:teuthology.orchestra.run.smithi154.stdout: libjson-perl libllvm14 liblzo2-2 libmbim-glib4 libmbim-proxy libmm-glib0 2023-11-13T11:26:53.334 INFO:teuthology.orchestra.run.smithi154.stdout: libndp0 libnm0 libpq5 libqmi-glib5 libqmi-proxy libssl-dev libteamdctl0 2023-11-13T11:26:53.334 INFO:teuthology.orchestra.run.smithi154.stdout: modemmanager network-manager network-manager-pptp postgresql postgresql-14 2023-11-13T11:26:53.334 INFO:teuthology.orchestra.run.smithi154.stdout: postgresql-client postgresql-client-14 postgresql-client-common 2023-11-13T11:26:53.335 INFO:teuthology.orchestra.run.smithi154.stdout: postgresql-common postgresql-contrib ppp pptp-linux tcl tcl8.6 2023-11-13T11:26:53.335 INFO:teuthology.orchestra.run.smithi154.stdout: usb-modeswitch usb-modeswitch-data wpasupplicant 2023-11-13T11:26:53.335 INFO:teuthology.orchestra.run.smithi154.stdout:The following packages will be upgraded: 2023-11-13T11:26:53.336 INFO:teuthology.orchestra.run.smithi154.stdout: libssl3 2023-11-13T11:26:53.395 INFO:teuthology.orchestra.run.smithi154.stdout:1 upgraded, 39 newly installed, 0 to remove and 260 not upgraded. 2023-11-13T11:26:53.395 INFO:teuthology.orchestra.run.smithi154.stdout:Need to get 54.6 MB of archives. 2023-11-13T11:26:53.396 INFO:teuthology.orchestra.run.smithi154.stdout:After this operation, 202 MB of additional disk space will be used. 2023-11-13T11:26:53.396 INFO:teuthology.orchestra.run.smithi154.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/main amd64 flex amd64 2.6.4-8build2 [307 kB] 2023-11-13T11:26:53.515 INFO:teuthology.orchestra.run.smithi154.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl3 amd64 3.0.2-0ubuntu1.12 [1,901 kB] 2023-11-13T11:26:53.559 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up ceph-base (18.0.0-7288-g35f0debb-1jammy) ... 2023-11-13T11:26:53.586 INFO:teuthology.orchestra.run.smithi154.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy/main amd64 bison amd64 2:3.8.2+dfsg-1build1 [748 kB] 2023-11-13T11:26:53.600 INFO:teuthology.orchestra.run.smithi154.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblzo2-2 amd64 2.10-2build3 [53.7 kB] 2023-11-13T11:26:53.600 INFO:teuthology.orchestra.run.smithi154.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy/universe amd64 dump amd64 0.4b47-3 [133 kB] 2023-11-13T11:26:53.603 INFO:teuthology.orchestra.run.smithi154.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 indent amd64 2.2.12-1ubuntu0.22.04.1 [90.8 kB] 2023-11-13T11:26:53.604 INFO:teuthology.orchestra.run.smithi154.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy/main amd64 libaio-dev amd64 0.3.112-13build1 [21.2 kB] 2023-11-13T11:26:53.605 INFO:teuthology.orchestra.run.smithi154.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy/main amd64 libbluetooth3 amd64 5.64-0ubuntu1 [86.9 kB] 2023-11-13T11:26:53.605 INFO:teuthology.orchestra.run.smithi154.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy/main amd64 libelf-dev amd64 0.186-1build1 [64.4 kB] 2023-11-13T11:26:53.606 INFO:teuthology.orchestra.run.smithi154.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl2 amd64 2.6.4-8build2 [10.7 kB] 2023-11-13T11:26:53.607 INFO:teuthology.orchestra.run.smithi154.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl-dev amd64 2.6.4-8build2 [6,236 B] 2023-11-13T11:26:53.615 INFO:teuthology.orchestra.run.smithi154.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjson-perl all 4.04000-1 [81.8 kB] 2023-11-13T11:26:53.629 INFO:teuthology.orchestra.run.smithi154.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libllvm14 amd64 1:14.0.0-1ubuntu1.1 [24.0 MB] 2023-11-13T11:26:53.910 INFO:teuthology.orchestra.run.smithi102.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2023-11-13T11:26:54.015 INFO:teuthology.orchestra.run.smithi154.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmbim-glib4 amd64 1.28.0-1~ubuntu20.04.1 [191 kB] 2023-11-13T11:26:54.017 INFO:teuthology.orchestra.run.smithi154.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmbim-proxy amd64 1.28.0-1~ubuntu20.04.1 [6,130 B] 2023-11-13T11:26:54.017 INFO:teuthology.orchestra.run.smithi154.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmm-glib0 amd64 1.20.0-1~ubuntu22.04.2 [263 kB] 2023-11-13T11:26:54.019 INFO:teuthology.orchestra.run.smithi154.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy/main amd64 libndp0 amd64 1.8-0ubuntu3 [12.3 kB] 2023-11-13T11:26:54.020 INFO:teuthology.orchestra.run.smithi154.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libnm0 amd64 1.36.6-0ubuntu2 [456 kB] 2023-11-13T11:26:54.024 INFO:teuthology.orchestra.run.smithi154.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpq5 amd64 14.9-0ubuntu0.22.04.1 [141 kB] 2023-11-13T11:26:54.026 INFO:teuthology.orchestra.run.smithi154.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libqmi-glib5 amd64 1.32.0-1ubuntu0.22.04.1 [772 kB] 2023-11-13T11:26:54.033 INFO:teuthology.orchestra.run.smithi154.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libqmi-proxy amd64 1.32.0-1ubuntu0.22.04.1 [6,072 B] 2023-11-13T11:26:54.034 INFO:teuthology.orchestra.run.smithi154.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl-dev amd64 3.0.2-0ubuntu1.12 [2,373 kB] 2023-11-13T11:26:54.073 INFO:teuthology.orchestra.run.smithi154.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy/main amd64 libteamdctl0 amd64 1.31-1build2 [12.6 kB] 2023-11-13T11:26:54.077 INFO:teuthology.orchestra.run.smithi154.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 modemmanager amd64 1.20.0-1~ubuntu22.04.2 [1,094 kB] 2023-11-13T11:26:54.092 INFO:teuthology.orchestra.run.smithi154.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 network-manager amd64 1.36.6-0ubuntu2 [2,203 kB] 2023-11-13T11:26:54.121 INFO:teuthology.orchestra.run.smithi154.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 ppp amd64 2.4.9-1+1ubuntu3 [363 kB] 2023-11-13T11:26:54.125 INFO:teuthology.orchestra.run.smithi154.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/main amd64 pptp-linux amd64 1.10.0-1build3 [42.5 kB] 2023-11-13T11:26:54.137 INFO:teuthology.orchestra.run.smithi154.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy/main amd64 network-manager-pptp amd64 1.2.10-1 [30.9 kB] 2023-11-13T11:26:54.138 INFO:teuthology.orchestra.run.smithi154.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-client-common all 238 [29.6 kB] 2023-11-13T11:26:54.138 INFO:teuthology.orchestra.run.smithi154.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 postgresql-client-14 amd64 14.9-0ubuntu0.22.04.1 [1,222 kB] 2023-11-13T11:26:54.152 INFO:teuthology.orchestra.run.smithi154.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-common all 238 [169 kB] 2023-11-13T11:26:54.165 INFO:teuthology.orchestra.run.smithi154.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 postgresql-14 amd64 14.9-0ubuntu0.22.04.1 [16.1 MB] 2023-11-13T11:26:54.460 INFO:teuthology.orchestra.run.smithi154.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql all 14+238 [3,288 B] 2023-11-13T11:26:54.460 INFO:teuthology.orchestra.run.smithi154.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-client all 14+238 [3,292 B] 2023-11-13T11:26:54.460 INFO:teuthology.orchestra.run.smithi154.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-contrib all 14+238 [3,292 B] 2023-11-13T11:26:54.461 INFO:teuthology.orchestra.run.smithi154.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 tcl8.6 amd64 8.6.12+dfsg-1build1 [15.0 kB] 2023-11-13T11:26:54.461 INFO:teuthology.orchestra.run.smithi154.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 tcl amd64 8.6.11+1build2 [4,678 B] 2023-11-13T11:26:54.462 INFO:teuthology.orchestra.run.smithi154.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 wpasupplicant amd64 2:2.10-6ubuntu2 [1,481 kB] 2023-11-13T11:26:54.477 INFO:teuthology.orchestra.run.smithi154.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 usb-modeswitch-data all 20191128-4 [33.2 kB] 2023-11-13T11:26:54.478 INFO:teuthology.orchestra.run.smithi154.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 usb-modeswitch amd64 2.6.1-3ubuntu2 [46.0 kB] 2023-11-13T11:26:54.586 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up ceph-mds (18.0.0-7288-g35f0debb-1jammy) ... 2023-11-13T11:26:54.817 INFO:teuthology.orchestra.run.smithi102.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2023-11-13T11:26:54.818 INFO:teuthology.orchestra.run.smithi102.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2023-11-13T11:26:54.854 INFO:teuthology.orchestra.run.smithi154.stdout:Preconfiguring packages ... 2023-11-13T11:26:54.995 INFO:teuthology.orchestra.run.smithi154.stdout:Fetched 54.6 MB in 1s (48.1 MB/s) 2023-11-13T11:26:55.247 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package flex. 2023-11-13T11:26:55.320 INFO:teuthology.orchestra.run.smithi154.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 139847 files and directories currently installed.) 2023-11-13T11:26:55.323 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../flex_2.6.4-8build2_amd64.deb ... 2023-11-13T11:26:55.362 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking flex (2.6.4-8build2) ... 2023-11-13T11:26:55.455 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up ceph-mgr (18.0.0-7288-g35f0debb-1jammy) ... 2023-11-13T11:26:55.692 INFO:teuthology.orchestra.run.smithi102.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2023-11-13T11:26:55.693 INFO:teuthology.orchestra.run.smithi102.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2023-11-13T11:26:55.873 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../libssl3_3.0.2-0ubuntu1.12_amd64.deb ... 2023-11-13T11:26:56.026 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking libssl3:amd64 (3.0.2-0ubuntu1.12) over (3.0.2-0ubuntu1.7) ... 2023-11-13T11:26:56.331 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up ceph-osd (18.0.0-7288-g35f0debb-1jammy) ... 2023-11-13T11:26:56.382 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up libssl3:amd64 (3.0.2-0ubuntu1.12) ... 2023-11-13T11:26:56.629 INFO:teuthology.orchestra.run.smithi102.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2023-11-13T11:26:56.630 INFO:teuthology.orchestra.run.smithi102.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2023-11-13T11:26:56.919 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package bison. 2023-11-13T11:26:56.991 INFO:teuthology.orchestra.run.smithi154.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 139920 files and directories currently installed.) 2023-11-13T11:26:56.995 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../00-bison_2%3a3.8.2+dfsg-1build1_amd64.deb ... 2023-11-13T11:26:57.046 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking bison (2:3.8.2+dfsg-1build1) ... 2023-11-13T11:26:57.266 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up ceph-mgr-k8sevents (18.0.0-7288-g35f0debb-1jammy) ... 2023-11-13T11:26:57.392 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up ceph-mgr-diskprediction-local (18.0.0-7288-g35f0debb-1jammy) ... 2023-11-13T11:26:57.480 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package liblzo2-2:amd64. 2023-11-13T11:26:57.495 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../01-liblzo2-2_2.10-2build3_amd64.deb ... 2023-11-13T11:26:57.534 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up ceph-mon (18.0.0-7288-g35f0debb-1jammy) ... 2023-11-13T11:26:57.538 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking liblzo2-2:amd64 (2.10-2build3) ... 2023-11-13T11:26:57.747 INFO:teuthology.orchestra.run.smithi102.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2023-11-13T11:26:57.747 INFO:teuthology.orchestra.run.smithi102.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2023-11-13T11:26:57.800 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package dump. 2023-11-13T11:26:57.815 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../02-dump_0.4b47-3_amd64.deb ... 2023-11-13T11:26:57.850 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking dump (0.4b47-3) ... 2023-11-13T11:26:58.112 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package indent. 2023-11-13T11:26:58.126 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../03-indent_2.2.12-1ubuntu0.22.04.1_amd64.deb ... 2023-11-13T11:26:58.170 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking indent (2.2.12-1ubuntu0.22.04.1) ... 2023-11-13T11:26:58.397 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up ceph-mgr-cephadm (18.0.0-7288-g35f0debb-1jammy) ... 2023-11-13T11:26:58.441 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package libaio-dev:amd64. 2023-11-13T11:26:58.456 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../04-libaio-dev_0.3.112-13build1_amd64.deb ... 2023-11-13T11:26:58.500 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking libaio-dev:amd64 (0.3.112-13build1) ... 2023-11-13T11:26:58.524 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up ceph (18.0.0-7288-g35f0debb-1jammy) ... 2023-11-13T11:26:58.649 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up ceph-mgr-dashboard (18.0.0-7288-g35f0debb-1jammy) ... 2023-11-13T11:26:58.811 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package libbluetooth3:amd64. 2023-11-13T11:26:58.827 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../05-libbluetooth3_5.64-0ubuntu1_amd64.deb ... 2023-11-13T11:26:58.842 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up ceph-volume (18.0.0-7288-g35f0debb-1jammy) ... 2023-11-13T11:26:58.861 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking libbluetooth3:amd64 (5.64-0ubuntu1) ... 2023-11-13T11:26:59.195 INFO:teuthology.orchestra.run.smithi102.stdout:Processing triggers for man-db (2.10.2-1) ... 2023-11-13T11:26:59.197 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package libelf-dev:amd64. 2023-11-13T11:26:59.213 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../06-libelf-dev_0.186-1build1_amd64.deb ... 2023-11-13T11:26:59.256 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking libelf-dev:amd64 (0.186-1build1) ... 2023-11-13T11:26:59.650 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package libfl2:amd64. 2023-11-13T11:26:59.666 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../07-libfl2_2.6.4-8build2_amd64.deb ... 2023-11-13T11:26:59.709 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking libfl2:amd64 (2.6.4-8build2) ... 2023-11-13T11:26:59.961 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package libfl-dev:amd64. 2023-11-13T11:26:59.977 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../08-libfl-dev_2.6.4-8build2_amd64.deb ... 2023-11-13T11:27:00.019 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking libfl-dev:amd64 (2.6.4-8build2) ... 2023-11-13T11:27:00.305 INFO:teuthology.orchestra.run.smithi102.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2023-11-13T11:27:00.365 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package libjson-perl. 2023-11-13T11:27:00.381 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../09-libjson-perl_4.04000-1_all.deb ... 2023-11-13T11:27:00.457 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking libjson-perl (4.04000-1) ... 2023-11-13T11:27:00.768 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package libllvm14:amd64. 2023-11-13T11:27:00.784 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../10-libllvm14_1%3a14.0.0-1ubuntu1.1_amd64.deb ... 2023-11-13T11:27:00.820 INFO:teuthology.orchestra.run.smithi102.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2023-11-13T11:27:00.825 DEBUG:teuthology.orchestra.run.smithi102:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install bison flex libelf-dev libssl-dev network-manager iproute2 util-linux dump indent libaio-dev libtool-bin uuid-dev xfslibs-dev postgresql postgresql-client postgresql-common postgresql-contrib 2023-11-13T11:27:00.826 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking libllvm14:amd64 (1:14.0.0-1ubuntu1.1) ... 2023-11-13T11:27:00.901 INFO:teuthology.orchestra.run.smithi102.stdout:Reading package lists... 2023-11-13T11:27:01.068 INFO:teuthology.orchestra.run.smithi102.stdout:Building dependency tree... 2023-11-13T11:27:01.068 INFO:teuthology.orchestra.run.smithi102.stdout:Reading state information... 2023-11-13T11:27:01.215 INFO:teuthology.orchestra.run.smithi102.stdout:iproute2 is already the newest version (5.15.0-1ubuntu2). 2023-11-13T11:27:01.216 INFO:teuthology.orchestra.run.smithi102.stdout:libtool-bin is already the newest version (2.4.6-15build2). 2023-11-13T11:27:01.216 INFO:teuthology.orchestra.run.smithi102.stdout:util-linux is already the newest version (2.37.2-4ubuntu3). 2023-11-13T11:27:01.216 INFO:teuthology.orchestra.run.smithi102.stdout:uuid-dev is already the newest version (2.37.2-4ubuntu3). 2023-11-13T11:27:01.216 INFO:teuthology.orchestra.run.smithi102.stdout:xfslibs-dev is already the newest version (5.13.0-1ubuntu2). 2023-11-13T11:27:01.216 INFO:teuthology.orchestra.run.smithi102.stdout:The following packages were automatically installed and are no longer required: 2023-11-13T11:27:01.217 INFO:teuthology.orchestra.run.smithi102.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2023-11-13T11:27:01.217 INFO:teuthology.orchestra.run.smithi102.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2023-11-13T11:27:01.217 INFO:teuthology.orchestra.run.smithi102.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2023-11-13T11:27:01.217 INFO:teuthology.orchestra.run.smithi102.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2023-11-13T11:27:01.219 INFO:teuthology.orchestra.run.smithi102.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2023-11-13T11:27:01.219 INFO:teuthology.orchestra.run.smithi102.stdout:Use 'sudo apt autoremove' to remove them. 2023-11-13T11:27:01.219 INFO:teuthology.orchestra.run.smithi102.stdout:The following additional packages will be installed: 2023-11-13T11:27:01.219 INFO:teuthology.orchestra.run.smithi102.stdout: libbluetooth3 libfl-dev libfl2 libjson-perl libllvm14 liblzo2-2 2023-11-13T11:27:01.219 INFO:teuthology.orchestra.run.smithi102.stdout: libmbim-glib4 libmbim-proxy libmm-glib0 libndp0 libnm0 libpq5 libqmi-glib5 2023-11-13T11:27:01.220 INFO:teuthology.orchestra.run.smithi102.stdout: libqmi-proxy libssl3 libteamdctl0 modemmanager network-manager-pptp 2023-11-13T11:27:01.220 INFO:teuthology.orchestra.run.smithi102.stdout: postgresql-14 postgresql-client-14 postgresql-client-common ppp pptp-linux 2023-11-13T11:27:01.220 INFO:teuthology.orchestra.run.smithi102.stdout: tcl tcl8.6 usb-modeswitch usb-modeswitch-data wpasupplicant 2023-11-13T11:27:01.220 INFO:teuthology.orchestra.run.smithi102.stdout:Suggested packages: 2023-11-13T11:27:01.220 INFO:teuthology.orchestra.run.smithi102.stdout: bison-doc flex-doc indent-doc libssl-doc avahi-autoipd libteam-utils 2023-11-13T11:27:01.221 INFO:teuthology.orchestra.run.smithi102.stdout: postgresql-doc postgresql-doc-14 tcl-tclreadline comgt wvdial wpagui 2023-11-13T11:27:01.221 INFO:teuthology.orchestra.run.smithi102.stdout: libengine-pkcs11-openssl 2023-11-13T11:27:01.269 INFO:teuthology.orchestra.run.smithi102.stdout:The following NEW packages will be installed: 2023-11-13T11:27:01.270 INFO:teuthology.orchestra.run.smithi102.stdout: bison dump flex indent libaio-dev libbluetooth3 libelf-dev libfl-dev libfl2 2023-11-13T11:27:01.270 INFO:teuthology.orchestra.run.smithi102.stdout: libjson-perl libllvm14 liblzo2-2 libmbim-glib4 libmbim-proxy libmm-glib0 2023-11-13T11:27:01.271 INFO:teuthology.orchestra.run.smithi102.stdout: libndp0 libnm0 libpq5 libqmi-glib5 libqmi-proxy libssl-dev libteamdctl0 2023-11-13T11:27:01.271 INFO:teuthology.orchestra.run.smithi102.stdout: modemmanager network-manager network-manager-pptp postgresql postgresql-14 2023-11-13T11:27:01.271 INFO:teuthology.orchestra.run.smithi102.stdout: postgresql-client postgresql-client-14 postgresql-client-common 2023-11-13T11:27:01.271 INFO:teuthology.orchestra.run.smithi102.stdout: postgresql-common postgresql-contrib ppp pptp-linux tcl tcl8.6 2023-11-13T11:27:01.272 INFO:teuthology.orchestra.run.smithi102.stdout: usb-modeswitch usb-modeswitch-data wpasupplicant 2023-11-13T11:27:01.272 INFO:teuthology.orchestra.run.smithi102.stdout:The following packages will be upgraded: 2023-11-13T11:27:01.273 INFO:teuthology.orchestra.run.smithi102.stdout: libssl3 2023-11-13T11:27:01.458 INFO:teuthology.orchestra.run.smithi102.stdout:1 upgraded, 39 newly installed, 0 to remove and 260 not upgraded. 2023-11-13T11:27:01.458 INFO:teuthology.orchestra.run.smithi102.stdout:Need to get 54.6 MB of archives. 2023-11-13T11:27:01.458 INFO:teuthology.orchestra.run.smithi102.stdout:After this operation, 202 MB of additional disk space will be used. 2023-11-13T11:27:01.459 INFO:teuthology.orchestra.run.smithi102.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/main amd64 flex amd64 2.6.4-8build2 [307 kB] 2023-11-13T11:27:01.951 INFO:teuthology.orchestra.run.smithi102.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl3 amd64 3.0.2-0ubuntu1.12 [1,901 kB] 2023-11-13T11:27:02.209 INFO:teuthology.orchestra.run.smithi102.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy/main amd64 bison amd64 2:3.8.2+dfsg-1build1 [748 kB] 2023-11-13T11:27:02.221 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package libmbim-glib4:amd64. 2023-11-13T11:27:02.236 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../11-libmbim-glib4_1.28.0-1~ubuntu20.04.1_amd64.deb ... 2023-11-13T11:27:02.243 INFO:teuthology.orchestra.run.smithi102.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblzo2-2 amd64 2.10-2build3 [53.7 kB] 2023-11-13T11:27:02.245 INFO:teuthology.orchestra.run.smithi102.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy/universe amd64 dump amd64 0.4b47-3 [133 kB] 2023-11-13T11:27:02.250 INFO:teuthology.orchestra.run.smithi102.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 indent amd64 2.2.12-1ubuntu0.22.04.1 [90.8 kB] 2023-11-13T11:27:02.253 INFO:teuthology.orchestra.run.smithi102.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy/main amd64 libaio-dev amd64 0.3.112-13build1 [21.2 kB] 2023-11-13T11:27:02.255 INFO:teuthology.orchestra.run.smithi102.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy/main amd64 libbluetooth3 amd64 5.64-0ubuntu1 [86.9 kB] 2023-11-13T11:27:02.258 INFO:teuthology.orchestra.run.smithi102.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy/main amd64 libelf-dev amd64 0.186-1build1 [64.4 kB] 2023-11-13T11:27:02.260 INFO:teuthology.orchestra.run.smithi102.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl2 amd64 2.6.4-8build2 [10.7 kB] 2023-11-13T11:27:02.260 INFO:teuthology.orchestra.run.smithi102.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl-dev amd64 2.6.4-8build2 [6,236 B] 2023-11-13T11:27:02.279 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking libmbim-glib4:amd64 (1.28.0-1~ubuntu20.04.1) ... 2023-11-13T11:27:02.424 INFO:teuthology.orchestra.run.smithi102.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjson-perl all 4.04000-1 [81.8 kB] 2023-11-13T11:27:02.481 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package libmbim-proxy. 2023-11-13T11:27:02.497 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../12-libmbim-proxy_1.28.0-1~ubuntu20.04.1_amd64.deb ... 2023-11-13T11:27:02.531 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking libmbim-proxy (1.28.0-1~ubuntu20.04.1) ... 2023-11-13T11:27:02.757 INFO:teuthology.orchestra.run.smithi102.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libllvm14 amd64 1:14.0.0-1ubuntu1.1 [24.0 MB] 2023-11-13T11:27:02.876 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package libmm-glib0:amd64. 2023-11-13T11:27:02.892 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../13-libmm-glib0_1.20.0-1~ubuntu22.04.2_amd64.deb ... 2023-11-13T11:27:02.935 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking libmm-glib0:amd64 (1.20.0-1~ubuntu22.04.2) ... 2023-11-13T11:27:03.253 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package libndp0:amd64. 2023-11-13T11:27:03.269 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../14-libndp0_1.8-0ubuntu3_amd64.deb ... 2023-11-13T11:27:03.312 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking libndp0:amd64 (1.8-0ubuntu3) ... 2023-11-13T11:27:03.622 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package libnm0:amd64. 2023-11-13T11:27:03.639 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../15-libnm0_1.36.6-0ubuntu2_amd64.deb ... 2023-11-13T11:27:03.681 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking libnm0:amd64 (1.36.6-0ubuntu2) ... 2023-11-13T11:27:03.819 INFO:teuthology.orchestra.run.smithi102.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmbim-glib4 amd64 1.28.0-1~ubuntu20.04.1 [191 kB] 2023-11-13T11:27:03.820 INFO:teuthology.orchestra.run.smithi102.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmbim-proxy amd64 1.28.0-1~ubuntu20.04.1 [6,130 B] 2023-11-13T11:27:03.821 INFO:teuthology.orchestra.run.smithi102.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmm-glib0 amd64 1.20.0-1~ubuntu22.04.2 [263 kB] 2023-11-13T11:27:03.823 INFO:teuthology.orchestra.run.smithi102.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy/main amd64 libndp0 amd64 1.8-0ubuntu3 [12.3 kB] 2023-11-13T11:27:03.824 INFO:teuthology.orchestra.run.smithi102.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libnm0 amd64 1.36.6-0ubuntu2 [456 kB] 2023-11-13T11:27:03.843 INFO:teuthology.orchestra.run.smithi102.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpq5 amd64 14.9-0ubuntu0.22.04.1 [141 kB] 2023-11-13T11:27:03.844 INFO:teuthology.orchestra.run.smithi102.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libqmi-glib5 amd64 1.32.0-1ubuntu0.22.04.1 [772 kB] 2023-11-13T11:27:03.852 INFO:teuthology.orchestra.run.smithi102.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libqmi-proxy amd64 1.32.0-1ubuntu0.22.04.1 [6,072 B] 2023-11-13T11:27:03.852 INFO:teuthology.orchestra.run.smithi102.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl-dev amd64 3.0.2-0ubuntu1.12 [2,373 kB] 2023-11-13T11:27:04.017 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package libpq5:amd64. 2023-11-13T11:27:04.033 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../16-libpq5_14.9-0ubuntu0.22.04.1_amd64.deb ... 2023-11-13T11:27:04.075 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking libpq5:amd64 (14.9-0ubuntu0.22.04.1) ... 2023-11-13T11:27:04.094 INFO:teuthology.orchestra.run.smithi102.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy/main amd64 libteamdctl0 amd64 1.31-1build2 [12.6 kB] 2023-11-13T11:27:04.176 INFO:teuthology.orchestra.run.smithi102.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 modemmanager amd64 1.20.0-1~ubuntu22.04.2 [1,094 kB] 2023-11-13T11:27:04.420 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package libqmi-glib5:amd64. 2023-11-13T11:27:04.435 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../17-libqmi-glib5_1.32.0-1ubuntu0.22.04.1_amd64.deb ... 2023-11-13T11:27:04.478 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking libqmi-glib5:amd64 (1.32.0-1ubuntu0.22.04.1) ... 2023-11-13T11:27:04.648 INFO:teuthology.orchestra.run.smithi102.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 network-manager amd64 1.36.6-0ubuntu2 [2,203 kB] 2023-11-13T11:27:04.764 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package libqmi-proxy. 2023-11-13T11:27:04.778 INFO:teuthology.orchestra.run.smithi102.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 ppp amd64 2.4.9-1+1ubuntu3 [363 kB] 2023-11-13T11:27:04.779 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../18-libqmi-proxy_1.32.0-1ubuntu0.22.04.1_amd64.deb ... 2023-11-13T11:27:04.789 INFO:teuthology.orchestra.run.smithi102.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/main amd64 pptp-linux amd64 1.10.0-1build3 [42.5 kB] 2023-11-13T11:27:04.790 INFO:teuthology.orchestra.run.smithi102.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy/main amd64 network-manager-pptp amd64 1.2.10-1 [30.9 kB] 2023-11-13T11:27:04.790 INFO:teuthology.orchestra.run.smithi102.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-client-common all 238 [29.6 kB] 2023-11-13T11:27:04.792 INFO:teuthology.orchestra.run.smithi102.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 postgresql-client-14 amd64 14.9-0ubuntu0.22.04.1 [1,222 kB] 2023-11-13T11:27:04.829 INFO:teuthology.orchestra.run.smithi102.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-common all 238 [169 kB] 2023-11-13T11:27:04.832 INFO:teuthology.orchestra.run.smithi102.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 postgresql-14 amd64 14.9-0ubuntu0.22.04.1 [16.1 MB] 2023-11-13T11:27:04.857 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking libqmi-proxy (1.32.0-1ubuntu0.22.04.1) ... 2023-11-13T11:27:05.066 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package libssl-dev:amd64. 2023-11-13T11:27:05.082 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../19-libssl-dev_3.0.2-0ubuntu1.12_amd64.deb ... 2023-11-13T11:27:05.124 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking libssl-dev:amd64 (3.0.2-0ubuntu1.12) ... 2023-11-13T11:27:05.304 INFO:teuthology.orchestra.run.smithi102.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql all 14+238 [3,288 B] 2023-11-13T11:27:05.468 INFO:teuthology.orchestra.run.smithi102.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-client all 14+238 [3,292 B] 2023-11-13T11:27:05.550 INFO:teuthology.orchestra.run.smithi102.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-contrib all 14+238 [3,292 B] 2023-11-13T11:27:05.551 INFO:teuthology.orchestra.run.smithi102.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 tcl8.6 amd64 8.6.12+dfsg-1build1 [15.0 kB] 2023-11-13T11:27:05.631 INFO:teuthology.orchestra.run.smithi102.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 tcl amd64 8.6.11+1build2 [4,678 B] 2023-11-13T11:27:05.640 INFO:teuthology.orchestra.run.smithi102.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 wpasupplicant amd64 2:2.10-6ubuntu2 [1,481 kB] 2023-11-13T11:27:05.670 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package libteamdctl0:amd64. 2023-11-13T11:27:05.684 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../20-libteamdctl0_1.31-1build2_amd64.deb ... 2023-11-13T11:27:05.728 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking libteamdctl0:amd64 (1.31-1build2) ... 2023-11-13T11:27:06.098 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package modemmanager. 2023-11-13T11:27:06.108 INFO:teuthology.orchestra.run.smithi102.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 usb-modeswitch-data all 20191128-4 [33.2 kB] 2023-11-13T11:27:06.109 INFO:teuthology.orchestra.run.smithi102.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 usb-modeswitch amd64 2.6.1-3ubuntu2 [46.0 kB] 2023-11-13T11:27:06.112 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../21-modemmanager_1.20.0-1~ubuntu22.04.2_amd64.deb ... 2023-11-13T11:27:06.156 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking modemmanager (1.20.0-1~ubuntu22.04.2) ... 2023-11-13T11:27:06.495 INFO:teuthology.orchestra.run.smithi102.stdout:Preconfiguring packages ... 2023-11-13T11:27:06.645 INFO:teuthology.orchestra.run.smithi102.stdout:Fetched 54.6 MB in 5s (11.3 MB/s) 2023-11-13T11:27:06.713 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package network-manager. 2023-11-13T11:27:06.726 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../22-network-manager_1.36.6-0ubuntu2_amd64.deb ... 2023-11-13T11:27:06.770 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking network-manager (1.36.6-0ubuntu2) ... 2023-11-13T11:27:06.787 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package flex. 2023-11-13T11:27:06.857 INFO:teuthology.orchestra.run.smithi102.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 139847 files and directories currently installed.) 2023-11-13T11:27:06.860 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../flex_2.6.4-8build2_amd64.deb ... 2023-11-13T11:27:06.919 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking flex (2.6.4-8build2) ... 2023-11-13T11:27:07.411 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package ppp. 2023-11-13T11:27:07.425 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../23-ppp_2.4.9-1+1ubuntu3_amd64.deb ... 2023-11-13T11:27:07.430 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../libssl3_3.0.2-0ubuntu1.12_amd64.deb ... 2023-11-13T11:27:07.633 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking libssl3:amd64 (3.0.2-0ubuntu1.12) over (3.0.2-0ubuntu1.7) ... 2023-11-13T11:27:07.770 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking ppp (2.4.9-1+1ubuntu3) ... 2023-11-13T11:27:08.023 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up libssl3:amd64 (3.0.2-0ubuntu1.12) ... 2023-11-13T11:27:08.116 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package pptp-linux. 2023-11-13T11:27:08.129 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../24-pptp-linux_1.10.0-1build3_amd64.deb ... 2023-11-13T11:27:08.174 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking pptp-linux (1.10.0-1build3) ... 2023-11-13T11:27:08.401 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package network-manager-pptp. 2023-11-13T11:27:08.416 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../25-network-manager-pptp_1.2.10-1_amd64.deb ... 2023-11-13T11:27:08.451 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking network-manager-pptp (1.2.10-1) ... 2023-11-13T11:27:08.567 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package bison. 2023-11-13T11:27:08.639 INFO:teuthology.orchestra.run.smithi102.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 139920 files and directories currently installed.) 2023-11-13T11:27:08.643 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../00-bison_2%3a3.8.2+dfsg-1build1_amd64.deb ... 2023-11-13T11:27:08.686 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking bison (2:3.8.2+dfsg-1build1) ... 2023-11-13T11:27:08.738 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package postgresql-client-common. 2023-11-13T11:27:08.752 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../26-postgresql-client-common_238_all.deb ... 2023-11-13T11:27:08.829 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking postgresql-client-common (238) ... 2023-11-13T11:27:09.096 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package liblzo2-2:amd64. 2023-11-13T11:27:09.110 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../01-liblzo2-2_2.10-2build3_amd64.deb ... 2023-11-13T11:27:09.141 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package postgresql-client-14. 2023-11-13T11:27:09.156 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../27-postgresql-client-14_14.9-0ubuntu0.22.04.1_amd64.deb ... 2023-11-13T11:27:09.171 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking liblzo2-2:amd64 (2.10-2build3) ... 2023-11-13T11:27:09.200 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking postgresql-client-14 (14.9-0ubuntu0.22.04.1) ... 2023-11-13T11:27:09.490 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package dump. 2023-11-13T11:27:09.504 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../02-dump_0.4b47-3_amd64.deb ... 2023-11-13T11:27:09.548 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking dump (0.4b47-3) ... 2023-11-13T11:27:09.721 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package postgresql-common. 2023-11-13T11:27:09.735 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../28-postgresql-common_238_all.deb ... 2023-11-13T11:27:09.829 INFO:teuthology.orchestra.run.smithi154.stdout:Adding 'diversion of /usr/bin/pg_config to /usr/bin/pg_config.libpq-dev by postgresql-common' 2023-11-13T11:27:09.860 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package indent. 2023-11-13T11:27:09.870 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking postgresql-common (238) ... 2023-11-13T11:27:09.874 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../03-indent_2.2.12-1ubuntu0.22.04.1_amd64.deb ... 2023-11-13T11:27:09.918 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking indent (2.2.12-1ubuntu0.22.04.1) ... 2023-11-13T11:27:10.188 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package libaio-dev:amd64. 2023-11-13T11:27:10.202 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../04-libaio-dev_0.3.112-13build1_amd64.deb ... 2023-11-13T11:27:10.271 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking libaio-dev:amd64 (0.3.112-13build1) ... 2023-11-13T11:27:10.279 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package postgresql-14. 2023-11-13T11:27:10.293 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../29-postgresql-14_14.9-0ubuntu0.22.04.1_amd64.deb ... 2023-11-13T11:27:10.331 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking postgresql-14 (14.9-0ubuntu0.22.04.1) ... 2023-11-13T11:27:10.558 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package libbluetooth3:amd64. 2023-11-13T11:27:10.572 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../05-libbluetooth3_5.64-0ubuntu1_amd64.deb ... 2023-11-13T11:27:10.616 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking libbluetooth3:amd64 (5.64-0ubuntu1) ... 2023-11-13T11:27:10.885 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package libelf-dev:amd64. 2023-11-13T11:27:10.901 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../06-libelf-dev_0.186-1build1_amd64.deb ... 2023-11-13T11:27:10.943 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking libelf-dev:amd64 (0.186-1build1) ... 2023-11-13T11:27:11.280 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package libfl2:amd64. 2023-11-13T11:27:11.296 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../07-libfl2_2.6.4-8build2_amd64.deb ... 2023-11-13T11:27:11.355 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking libfl2:amd64 (2.6.4-8build2) ... 2023-11-13T11:27:11.599 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package libfl-dev:amd64. 2023-11-13T11:27:11.609 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package postgresql. 2023-11-13T11:27:11.615 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../08-libfl-dev_2.6.4-8build2_amd64.deb ... 2023-11-13T11:27:11.624 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../30-postgresql_14+238_all.deb ... 2023-11-13T11:27:11.658 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking libfl-dev:amd64 (2.6.4-8build2) ... 2023-11-13T11:27:11.658 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking postgresql (14+238) ... 2023-11-13T11:27:11.902 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package postgresql-client. 2023-11-13T11:27:11.917 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../31-postgresql-client_14+238_all.deb ... 2023-11-13T11:27:11.935 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package libjson-perl. 2023-11-13T11:27:11.950 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../09-libjson-perl_4.04000-1_all.deb ... 2023-11-13T11:27:11.961 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking postgresql-client (14+238) ... 2023-11-13T11:27:11.994 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking libjson-perl (4.04000-1) ... 2023-11-13T11:27:12.204 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package postgresql-contrib. 2023-11-13T11:27:12.220 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../32-postgresql-contrib_14+238_all.deb ... 2023-11-13T11:27:12.263 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking postgresql-contrib (14+238) ... 2023-11-13T11:27:12.297 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package libllvm14:amd64. 2023-11-13T11:27:12.312 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../10-libllvm14_1%3a14.0.0-1ubuntu1.1_amd64.deb ... 2023-11-13T11:27:12.356 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking libllvm14:amd64 (1:14.0.0-1ubuntu1.1) ... 2023-11-13T11:27:12.565 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package tcl8.6. 2023-11-13T11:27:12.580 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../33-tcl8.6_8.6.12+dfsg-1build1_amd64.deb ... 2023-11-13T11:27:12.624 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking tcl8.6 (8.6.12+dfsg-1build1) ... 2023-11-13T11:27:12.935 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package tcl. 2023-11-13T11:27:12.951 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../34-tcl_8.6.11+1build2_amd64.deb ... 2023-11-13T11:27:12.998 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking tcl (8.6.11+1build2) ... 2023-11-13T11:27:13.296 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package wpasupplicant. 2023-11-13T11:27:13.312 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../35-wpasupplicant_2%3a2.10-6ubuntu2_amd64.deb ... 2023-11-13T11:27:13.354 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking wpasupplicant (2:2.10-6ubuntu2) ... 2023-11-13T11:27:13.700 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package usb-modeswitch-data. 2023-11-13T11:27:13.715 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../36-usb-modeswitch-data_20191128-4_all.deb ... 2023-11-13T11:27:13.774 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package libmbim-glib4:amd64. 2023-11-13T11:27:13.783 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking usb-modeswitch-data (20191128-4) ... 2023-11-13T11:27:13.789 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../11-libmbim-glib4_1.28.0-1~ubuntu20.04.1_amd64.deb ... 2023-11-13T11:27:13.833 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking libmbim-glib4:amd64 (1.28.0-1~ubuntu20.04.1) ... 2023-11-13T11:27:14.060 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package libmbim-proxy. 2023-11-13T11:27:14.075 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../12-libmbim-proxy_1.28.0-1~ubuntu20.04.1_amd64.deb ... 2023-11-13T11:27:14.119 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking libmbim-proxy (1.28.0-1~ubuntu20.04.1) ... 2023-11-13T11:27:14.170 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package usb-modeswitch. 2023-11-13T11:27:14.186 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../37-usb-modeswitch_2.6.1-3ubuntu2_amd64.deb ... 2023-11-13T11:27:14.237 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking usb-modeswitch (2.6.1-3ubuntu2) ... 2023-11-13T11:27:14.438 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package libmm-glib0:amd64. 2023-11-13T11:27:14.453 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../13-libmm-glib0_1.20.0-1~ubuntu22.04.2_amd64.deb ... 2023-11-13T11:27:14.520 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up postgresql-client-common (238) ... 2023-11-13T11:27:14.521 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking libmm-glib0:amd64 (1.20.0-1~ubuntu22.04.2) ... 2023-11-13T11:27:14.726 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up flex (2.6.4-8build2) ... 2023-11-13T11:27:14.869 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up tcl8.6 (8.6.12+dfsg-1build1) ... 2023-11-13T11:27:14.883 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package libndp0:amd64. 2023-11-13T11:27:14.898 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../14-libndp0_1.8-0ubuntu3_amd64.deb ... 2023-11-13T11:27:14.941 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking libndp0:amd64 (1.8-0ubuntu3) ... 2023-11-13T11:27:14.978 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up libpq5:amd64 (14.9-0ubuntu0.22.04.1) ... 2023-11-13T11:27:15.104 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up liblzo2-2:amd64 (2.10-2build3) ... 2023-11-13T11:27:15.230 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up libaio-dev:amd64 (0.3.112-13build1) ... 2023-11-13T11:27:15.294 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package libnm0:amd64. 2023-11-13T11:27:15.308 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../15-libnm0_1.36.6-0ubuntu2_amd64.deb ... 2023-11-13T11:27:15.343 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking libnm0:amd64 (1.36.6-0ubuntu2) ... 2023-11-13T11:27:15.356 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up postgresql-client-14 (14.9-0ubuntu0.22.04.1) ... 2023-11-13T11:27:15.705 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package libpq5:amd64. 2023-11-13T11:27:15.720 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../16-libpq5_14.9-0ubuntu0.22.04.1_amd64.deb ... 2023-11-13T11:27:15.763 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking libpq5:amd64 (14.9-0ubuntu0.22.04.1) ... 2023-11-13T11:27:16.119 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package libqmi-glib5:amd64. 2023-11-13T11:27:16.134 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../17-libqmi-glib5_1.32.0-1ubuntu0.22.04.1_amd64.deb ... 2023-11-13T11:27:16.182 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking libqmi-glib5:amd64 (1.32.0-1ubuntu0.22.04.1) ... 2023-11-13T11:27:16.364 INFO:teuthology.orchestra.run.smithi154.stdout:update-alternatives: using /usr/share/postgresql/14/man/man1/psql.1.gz to provide /usr/share/man/man1/psql.1.gz (psql.1.gz) in auto mode 2023-11-13T11:27:16.472 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up wpasupplicant (2:2.10-6ubuntu2) ... 2023-11-13T11:27:16.476 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package libqmi-proxy. 2023-11-13T11:27:16.491 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../18-libqmi-proxy_1.32.0-1ubuntu0.22.04.1_amd64.deb ... 2023-11-13T11:27:16.535 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking libqmi-proxy (1.32.0-1ubuntu0.22.04.1) ... 2023-11-13T11:27:16.779 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package libssl-dev:amd64. 2023-11-13T11:27:16.794 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../19-libssl-dev_3.0.2-0ubuntu1.12_amd64.deb ... 2023-11-13T11:27:16.841 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking libssl-dev:amd64 (3.0.2-0ubuntu1.12) ... 2023-11-13T11:27:16.849 INFO:teuthology.orchestra.run.smithi154.stdout:Created symlink /etc/systemd/system/dbus-fi.w1.wpa_supplicant1.service -> /lib/systemd/system/wpa_supplicant.service. 2023-11-13T11:27:16.849 INFO:teuthology.orchestra.run.smithi154.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/wpa_supplicant.service -> /lib/systemd/system/wpa_supplicant.service. 2023-11-13T11:27:17.341 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package libteamdctl0:amd64. 2023-11-13T11:27:17.356 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../20-libteamdctl0_1.31-1build2_amd64.deb ... 2023-11-13T11:27:17.400 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking libteamdctl0:amd64 (1.31-1build2) ... 2023-11-13T11:27:17.548 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up libteamdctl0:amd64 (1.31-1build2) ... 2023-11-13T11:27:17.674 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up libssl-dev:amd64 (3.0.2-0ubuntu1.12) ... 2023-11-13T11:27:17.760 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package modemmanager. 2023-11-13T11:27:17.775 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../21-modemmanager_1.20.0-1~ubuntu22.04.2_amd64.deb ... 2023-11-13T11:27:17.810 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking modemmanager (1.20.0-1~ubuntu22.04.2) ... 2023-11-13T11:27:17.825 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up usb-modeswitch-data (20191128-4) ... 2023-11-13T11:27:17.943 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up libelf-dev:amd64 (0.186-1build1) ... 2023-11-13T11:27:18.052 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up libfl2:amd64 (2.6.4-8build2) ... 2023-11-13T11:27:18.170 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up libnm0:amd64 (1.36.6-0ubuntu2) ... 2023-11-13T11:27:18.296 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up ppp (2.4.9-1+1ubuntu3) ... 2023-11-13T11:27:18.483 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package network-manager. 2023-11-13T11:27:18.498 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../22-network-manager_1.36.6-0ubuntu2_amd64.deb ... 2023-11-13T11:27:18.549 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking network-manager (1.36.6-0ubuntu2) ... 2023-11-13T11:27:19.034 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up libllvm14:amd64 (1:14.0.0-1ubuntu1.1) ... 2023-11-13T11:27:19.161 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up dump (0.4b47-3) ... 2023-11-13T11:27:19.173 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package ppp. 2023-11-13T11:27:19.189 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../23-ppp_2.4.9-1+1ubuntu3_amd64.deb ... 2023-11-13T11:27:19.239 INFO:teuthology.orchestra.run.smithi154.stdout:update-alternatives: using /usr/sbin/rmt-dump to provide /usr/sbin/rmt (rmt) in auto mode 2023-11-13T11:27:19.296 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up libmm-glib0:amd64 (1.20.0-1~ubuntu22.04.2) ... 2023-11-13T11:27:19.421 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up libbluetooth3:amd64 (5.64-0ubuntu1) ... 2023-11-13T11:27:19.547 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up tcl (8.6.11+1build2) ... 2023-11-13T11:27:19.549 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking ppp (2.4.9-1+1ubuntu3) ... 2023-11-13T11:27:19.674 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up libjson-perl (4.04000-1) ... 2023-11-13T11:27:19.824 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up bison (2:3.8.2+dfsg-1build1) ... 2023-11-13T11:27:19.886 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package pptp-linux. 2023-11-13T11:27:19.900 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../24-pptp-linux_1.10.0-1build3_amd64.deb ... 2023-11-13T11:27:19.923 INFO:teuthology.orchestra.run.smithi154.stdout:update-alternatives: using /usr/bin/bison.yacc to provide /usr/bin/yacc (yacc) in auto mode 2023-11-13T11:27:19.961 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking pptp-linux (1.10.0-1build3) ... 2023-11-13T11:27:19.993 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up indent (2.2.12-1ubuntu0.22.04.1) ... 2023-11-13T11:27:20.110 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up usb-modeswitch (2.6.1-3ubuntu2) ... 2023-11-13T11:27:20.222 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package network-manager-pptp. 2023-11-13T11:27:20.236 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../25-network-manager-pptp_1.2.10-1_amd64.deb ... 2023-11-13T11:27:20.262 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up libndp0:amd64 (1.8-0ubuntu3) ... 2023-11-13T11:27:20.283 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking network-manager-pptp (1.2.10-1) ... 2023-11-13T11:27:20.388 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up libmbim-glib4:amd64 (1.28.0-1~ubuntu20.04.1) ... 2023-11-13T11:27:20.514 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up pptp-linux (1.10.0-1build3) ... 2023-11-13T11:27:20.583 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package postgresql-client-common. 2023-11-13T11:27:20.598 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../26-postgresql-client-common_238_all.deb ... 2023-11-13T11:27:20.642 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking postgresql-client-common (238) ... 2023-11-13T11:27:20.682 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up postgresql-client (14+238) ... 2023-11-13T11:27:20.858 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up network-manager (1.36.6-0ubuntu2) ... 2023-11-13T11:27:20.945 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package postgresql-client-14. 2023-11-13T11:27:20.960 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../27-postgresql-client-14_14.9-0ubuntu0.22.04.1_amd64.deb ... 2023-11-13T11:27:21.039 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking postgresql-client-14 (14.9-0ubuntu0.22.04.1) ... 2023-11-13T11:27:21.483 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-13T11:27:21.484 INFO:teuthology.orchestra.run.smithi154.stdout:The following network interfaces were found in /etc/network/interfaces 2023-11-13T11:27:21.484 INFO:teuthology.orchestra.run.smithi154.stdout:which means they are currently configured by ifupdown: 2023-11-13T11:27:21.484 INFO:teuthology.orchestra.run.smithi154.stdout:- enp3s0f1 2023-11-13T11:27:21.485 INFO:teuthology.orchestra.run.smithi154.stdout:If you want to manage those interfaces with NetworkManager instead 2023-11-13T11:27:21.486 INFO:teuthology.orchestra.run.smithi154.stdout:remove their configuration from /etc/network/interfaces. 2023-11-13T11:27:21.486 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-13T11:27:21.569 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package postgresql-common. 2023-11-13T11:27:21.583 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../28-postgresql-common_238_all.deb ... 2023-11-13T11:27:21.615 INFO:teuthology.orchestra.run.smithi154.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.nm-dispatcher.service -> /lib/systemd/system/NetworkManager-dispatcher.service. 2023-11-13T11:27:21.638 INFO:teuthology.orchestra.run.smithi102.stdout:Adding 'diversion of /usr/bin/pg_config to /usr/bin/pg_config.libpq-dev by postgresql-common' 2023-11-13T11:27:21.659 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking postgresql-common (238) ... 2023-11-13T11:27:22.024 INFO:teuthology.orchestra.run.smithi154.stdout:Created symlink /etc/systemd/system/network-online.target.wants/NetworkManager-wait-online.service -> /lib/systemd/system/NetworkManager-wait-online.service. 2023-11-13T11:27:22.143 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package postgresql-14. 2023-11-13T11:27:22.158 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../29-postgresql-14_14.9-0ubuntu0.22.04.1_amd64.deb ... 2023-11-13T11:27:22.204 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking postgresql-14 (14.9-0ubuntu0.22.04.1) ... 2023-11-13T11:27:22.448 INFO:teuthology.orchestra.run.smithi154.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/NetworkManager.service -> /lib/systemd/system/NetworkManager.service. 2023-11-13T11:27:23.135 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up libmbim-proxy (1.28.0-1~ubuntu20.04.1) ... 2023-11-13T11:27:23.270 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up libfl-dev:amd64 (2.6.4-8build2) ... 2023-11-13T11:27:23.396 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up network-manager-pptp (1.2.10-1) ... 2023-11-13T11:27:23.404 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package postgresql. 2023-11-13T11:27:23.419 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../30-postgresql_14+238_all.deb ... 2023-11-13T11:27:23.463 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking postgresql (14+238) ... 2023-11-13T11:27:23.522 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up postgresql-common (238) ... 2023-11-13T11:27:23.674 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package postgresql-client. 2023-11-13T11:27:23.688 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../31-postgresql-client_14+238_all.deb ... 2023-11-13T11:27:23.757 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking postgresql-client (14+238) ... 2023-11-13T11:27:24.001 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package postgresql-contrib. 2023-11-13T11:27:24.015 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../32-postgresql-contrib_14+238_all.deb ... 2023-11-13T11:27:24.059 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking postgresql-contrib (14+238) ... 2023-11-13T11:27:24.411 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package tcl8.6. 2023-11-13T11:27:24.427 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../33-tcl8.6_8.6.12+dfsg-1build1_amd64.deb ... 2023-11-13T11:27:24.469 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking tcl8.6 (8.6.12+dfsg-1build1) ... 2023-11-13T11:27:24.484 INFO:teuthology.orchestra.run.smithi154.stdout:Adding user postgres to group ssl-cert 2023-11-13T11:27:24.747 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package tcl. 2023-11-13T11:27:24.753 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-13T11:27:24.753 INFO:teuthology.orchestra.run.smithi154.stdout:Creating config file /etc/postgresql-common/createcluster.conf with new version 2023-11-13T11:27:24.763 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../34-tcl_8.6.11+1build2_amd64.deb ... 2023-11-13T11:27:24.848 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking tcl (8.6.11+1build2) ... 2023-11-13T11:27:25.011 INFO:teuthology.orchestra.run.smithi154.stdout:Building PostgreSQL dictionaries from installed myspell/hunspell packages... 2023-11-13T11:27:25.012 INFO:teuthology.orchestra.run.smithi154.stdout:Removing obsolete dictionary files: 2023-11-13T11:27:25.167 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package wpasupplicant. 2023-11-13T11:27:25.182 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../35-wpasupplicant_2%3a2.10-6ubuntu2_amd64.deb ... 2023-11-13T11:27:25.225 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking wpasupplicant (2:2.10-6ubuntu2) ... 2023-11-13T11:27:25.596 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package usb-modeswitch-data. 2023-11-13T11:27:25.612 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../36-usb-modeswitch-data_20191128-4_all.deb ... 2023-11-13T11:27:25.654 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking usb-modeswitch-data (20191128-4) ... 2023-11-13T11:27:25.753 INFO:teuthology.orchestra.run.smithi154.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/postgresql.service -> /lib/systemd/system/postgresql.service. 2023-11-13T11:27:26.066 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package usb-modeswitch. 2023-11-13T11:27:26.081 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../37-usb-modeswitch_2.6.1-3ubuntu2_amd64.deb ... 2023-11-13T11:27:26.133 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking usb-modeswitch (2.6.1-3ubuntu2) ... 2023-11-13T11:27:26.199 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up postgresql-14 (14.9-0ubuntu0.22.04.1) ... 2023-11-13T11:27:26.408 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up postgresql-client-common (238) ... 2023-11-13T11:27:26.540 INFO:teuthology.orchestra.run.smithi154.stdout:Creating new PostgreSQL cluster 14/main ... 2023-11-13T11:27:26.557 INFO:teuthology.orchestra.run.smithi154.stdout:/usr/lib/postgresql/14/bin/initdb -D /var/lib/postgresql/14/main --auth-local peer --auth-host scram-sha-256 --no-instructions 2023-11-13T11:27:26.614 INFO:teuthology.orchestra.run.smithi154.stdout:The files belonging to this database system will be owned by user "postgres". 2023-11-13T11:27:26.614 INFO:teuthology.orchestra.run.smithi154.stdout:This user must also own the server process. 2023-11-13T11:27:26.614 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-13T11:27:26.614 INFO:teuthology.orchestra.run.smithi154.stdout:The database cluster will be initialized with locale "en_US". 2023-11-13T11:27:26.615 INFO:teuthology.orchestra.run.smithi154.stdout:The default database encoding has accordingly been set to "LATIN1". 2023-11-13T11:27:26.615 INFO:teuthology.orchestra.run.smithi154.stdout:The default text search configuration will be set to "english". 2023-11-13T11:27:26.615 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-13T11:27:26.615 INFO:teuthology.orchestra.run.smithi154.stdout:Data page checksums are disabled. 2023-11-13T11:27:26.615 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-13T11:27:26.616 INFO:teuthology.orchestra.run.smithi154.stdout:fixing permissions on existing directory /var/lib/postgresql/14/main ... ok 2023-11-13T11:27:26.616 INFO:teuthology.orchestra.run.smithi154.stdout:creating subdirectories ... ok 2023-11-13T11:27:26.616 INFO:teuthology.orchestra.run.smithi154.stdout:selecting dynamic shared memory implementation ... posix 2023-11-13T11:27:26.639 INFO:teuthology.orchestra.run.smithi154.stdout:selecting default max_connections ... 100 2023-11-13T11:27:26.655 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up flex (2.6.4-8build2) ... 2023-11-13T11:27:26.674 INFO:teuthology.orchestra.run.smithi154.stdout:selecting default shared_buffers ... 128MB 2023-11-13T11:27:26.687 INFO:teuthology.orchestra.run.smithi154.stdout:selecting default time zone ... Etc/UTC 2023-11-13T11:27:26.688 INFO:teuthology.orchestra.run.smithi154.stdout:creating configuration files ... ok 2023-11-13T11:27:26.781 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up tcl8.6 (8.6.12+dfsg-1build1) ... 2023-11-13T11:27:26.856 INFO:teuthology.orchestra.run.smithi154.stdout:running bootstrap script ... ok 2023-11-13T11:27:26.907 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up libpq5:amd64 (14.9-0ubuntu0.22.04.1) ... 2023-11-13T11:27:27.058 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up liblzo2-2:amd64 (2.10-2build3) ... 2023-11-13T11:27:27.176 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up libaio-dev:amd64 (0.3.112-13build1) ... 2023-11-13T11:27:27.285 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up postgresql-client-14 (14.9-0ubuntu0.22.04.1) ... 2023-11-13T11:27:27.488 INFO:teuthology.orchestra.run.smithi154.stdout:performing post-bootstrap initialization ... ok 2023-11-13T11:27:28.053 INFO:teuthology.orchestra.run.smithi154.stdout:syncing data to disk ... ok 2023-11-13T11:27:28.278 INFO:teuthology.orchestra.run.smithi102.stdout:update-alternatives: using /usr/share/postgresql/14/man/man1/psql.1.gz to provide /usr/share/man/man1/psql.1.gz (psql.1.gz) in auto mode 2023-11-13T11:27:28.380 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up wpasupplicant (2:2.10-6ubuntu2) ... 2023-11-13T11:27:28.588 INFO:teuthology.orchestra.run.smithi154.stdout:update-alternatives: using /usr/share/postgresql/14/man/man1/postmaster.1.gz to provide /usr/share/man/man1/postmaster.1.gz (postmaster.1.gz) in auto mode 2023-11-13T11:27:28.778 INFO:teuthology.orchestra.run.smithi102.stdout:Created symlink /etc/systemd/system/dbus-fi.w1.wpa_supplicant1.service -> /lib/systemd/system/wpa_supplicant.service. 2023-11-13T11:27:28.779 INFO:teuthology.orchestra.run.smithi102.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/wpa_supplicant.service -> /lib/systemd/system/wpa_supplicant.service. 2023-11-13T11:27:29.494 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up libteamdctl0:amd64 (1.31-1build2) ... 2023-11-13T11:27:29.620 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up libssl-dev:amd64 (3.0.2-0ubuntu1.12) ... 2023-11-13T11:27:29.771 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up usb-modeswitch-data (20191128-4) ... 2023-11-13T11:27:29.897 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up libelf-dev:amd64 (0.186-1build1) ... 2023-11-13T11:27:30.023 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up libfl2:amd64 (2.6.4-8build2) ... 2023-11-13T11:27:30.149 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up libnm0:amd64 (1.36.6-0ubuntu2) ... 2023-11-13T11:27:30.292 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up ppp (2.4.9-1+1ubuntu3) ... 2023-11-13T11:27:31.031 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up libllvm14:amd64 (1:14.0.0-1ubuntu1.1) ... 2023-11-13T11:27:31.166 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up dump (0.4b47-3) ... 2023-11-13T11:27:31.260 INFO:teuthology.orchestra.run.smithi102.stdout:update-alternatives: using /usr/sbin/rmt-dump to provide /usr/sbin/rmt (rmt) in auto mode 2023-11-13T11:27:31.325 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up libmm-glib0:amd64 (1.20.0-1~ubuntu22.04.2) ... 2023-11-13T11:27:31.468 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up libbluetooth3:amd64 (5.64-0ubuntu1) ... 2023-11-13T11:27:31.577 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up tcl (8.6.11+1build2) ... 2023-11-13T11:27:31.695 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up libjson-perl (4.04000-1) ... 2023-11-13T11:27:31.821 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up bison (2:3.8.2+dfsg-1build1) ... 2023-11-13T11:27:31.936 INFO:teuthology.orchestra.run.smithi102.stdout:update-alternatives: using /usr/bin/bison.yacc to provide /usr/bin/yacc (yacc) in auto mode 2023-11-13T11:27:31.964 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up libqmi-glib5:amd64 (1.32.0-1ubuntu0.22.04.1) ... 2023-11-13T11:27:32.006 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up indent (2.2.12-1ubuntu0.22.04.1) ... 2023-11-13T11:27:32.093 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up postgresql-contrib (14+238) ... 2023-11-13T11:27:32.140 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up usb-modeswitch (2.6.1-3ubuntu2) ... 2023-11-13T11:27:32.217 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up postgresql (14+238) ... 2023-11-13T11:27:32.333 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up libndp0:amd64 (1.8-0ubuntu3) ... 2023-11-13T11:27:32.342 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up libqmi-proxy (1.32.0-1ubuntu0.22.04.1) ... 2023-11-13T11:27:32.460 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up modemmanager (1.20.0-1~ubuntu22.04.2) ... 2023-11-13T11:27:32.501 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up libmbim-glib4:amd64 (1.28.0-1~ubuntu20.04.1) ... 2023-11-13T11:27:32.619 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up pptp-linux (1.10.0-1build3) ... 2023-11-13T11:27:32.695 INFO:teuthology.orchestra.run.smithi154.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.ModemManager1.service -> /lib/systemd/system/ModemManager.service. 2023-11-13T11:27:32.695 INFO:teuthology.orchestra.run.smithi154.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ModemManager.service -> /lib/systemd/system/ModemManager.service. 2023-11-13T11:27:32.761 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up postgresql-client (14+238) ... 2023-11-13T11:27:32.887 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up network-manager (1.36.6-0ubuntu2) ... 2023-11-13T11:27:33.438 INFO:teuthology.orchestra.run.smithi154.stdout:Processing triggers for hicolor-icon-theme (0.17-2) ... 2023-11-13T11:27:33.782 INFO:teuthology.orchestra.run.smithi154.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2023-11-13T11:27:33.842 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T11:27:33.843 INFO:teuthology.orchestra.run.smithi102.stdout:The following network interfaces were found in /etc/network/interfaces 2023-11-13T11:27:33.843 INFO:teuthology.orchestra.run.smithi102.stdout:which means they are currently configured by ifupdown: 2023-11-13T11:27:33.843 INFO:teuthology.orchestra.run.smithi102.stdout:- enp3s0f1 2023-11-13T11:27:33.843 INFO:teuthology.orchestra.run.smithi102.stdout:If you want to manage those interfaces with NetworkManager instead 2023-11-13T11:27:33.843 INFO:teuthology.orchestra.run.smithi102.stdout:remove their configuration from /etc/network/interfaces. 2023-11-13T11:27:33.844 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T11:27:33.941 INFO:teuthology.orchestra.run.smithi154.stdout:Processing triggers for man-db (2.10.2-1) ... 2023-11-13T11:27:33.975 INFO:teuthology.orchestra.run.smithi102.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.nm-dispatcher.service -> /lib/systemd/system/NetworkManager-dispatcher.service. 2023-11-13T11:27:34.378 INFO:teuthology.orchestra.run.smithi102.stdout:Created symlink /etc/systemd/system/network-online.target.wants/NetworkManager-wait-online.service -> /lib/systemd/system/NetworkManager-wait-online.service. 2023-11-13T11:27:34.779 INFO:teuthology.orchestra.run.smithi102.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/NetworkManager.service -> /lib/systemd/system/NetworkManager.service. 2023-11-13T11:27:35.344 INFO:teuthology.orchestra.run.smithi154.stdout:Processing triggers for dbus (1.12.20-2ubuntu4.1) ... 2023-11-13T11:27:35.436 INFO:teuthology.orchestra.run.smithi154.stdout:Processing triggers for install-info (6.8-4build1) ... 2023-11-13T11:27:35.566 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up libmbim-proxy (1.28.0-1~ubuntu20.04.1) ... 2023-11-13T11:27:35.684 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up libfl-dev:amd64 (2.6.4-8build2) ... 2023-11-13T11:27:35.826 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up network-manager-pptp (1.2.10-1) ... 2023-11-13T11:27:35.930 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up postgresql-common (238) ... 2023-11-13T11:27:36.118 INFO:teuthology.orchestra.run.smithi154.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2023-11-13T11:27:36.123 DEBUG:teuthology.parallel:result is None 2023-11-13T11:27:36.819 INFO:teuthology.orchestra.run.smithi102.stdout:Adding user postgres to group ssl-cert 2023-11-13T11:27:37.087 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T11:27:37.088 INFO:teuthology.orchestra.run.smithi102.stdout:Creating config file /etc/postgresql-common/createcluster.conf with new version 2023-11-13T11:27:37.343 INFO:teuthology.orchestra.run.smithi102.stdout:Building PostgreSQL dictionaries from installed myspell/hunspell packages... 2023-11-13T11:27:37.344 INFO:teuthology.orchestra.run.smithi102.stdout:Removing obsolete dictionary files: 2023-11-13T11:27:38.051 INFO:teuthology.orchestra.run.smithi102.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/postgresql.service -> /lib/systemd/system/postgresql.service. 2023-11-13T11:27:38.554 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up postgresql-14 (14.9-0ubuntu0.22.04.1) ... 2023-11-13T11:27:38.893 INFO:teuthology.orchestra.run.smithi102.stdout:Creating new PostgreSQL cluster 14/main ... 2023-11-13T11:27:38.911 INFO:teuthology.orchestra.run.smithi102.stdout:/usr/lib/postgresql/14/bin/initdb -D /var/lib/postgresql/14/main --auth-local peer --auth-host scram-sha-256 --no-instructions 2023-11-13T11:27:38.962 INFO:teuthology.orchestra.run.smithi102.stdout:The files belonging to this database system will be owned by user "postgres". 2023-11-13T11:27:38.962 INFO:teuthology.orchestra.run.smithi102.stdout:This user must also own the server process. 2023-11-13T11:27:38.962 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T11:27:38.962 INFO:teuthology.orchestra.run.smithi102.stdout:The database cluster will be initialized with locale "en_US". 2023-11-13T11:27:38.963 INFO:teuthology.orchestra.run.smithi102.stdout:The default database encoding has accordingly been set to "LATIN1". 2023-11-13T11:27:38.963 INFO:teuthology.orchestra.run.smithi102.stdout:The default text search configuration will be set to "english". 2023-11-13T11:27:38.963 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T11:27:38.963 INFO:teuthology.orchestra.run.smithi102.stdout:Data page checksums are disabled. 2023-11-13T11:27:38.964 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T11:27:38.964 INFO:teuthology.orchestra.run.smithi102.stdout:fixing permissions on existing directory /var/lib/postgresql/14/main ... ok 2023-11-13T11:27:38.964 INFO:teuthology.orchestra.run.smithi102.stdout:creating subdirectories ... ok 2023-11-13T11:27:38.964 INFO:teuthology.orchestra.run.smithi102.stdout:selecting dynamic shared memory implementation ... posix 2023-11-13T11:27:38.986 INFO:teuthology.orchestra.run.smithi102.stdout:selecting default max_connections ... 100 2023-11-13T11:27:39.022 INFO:teuthology.orchestra.run.smithi102.stdout:selecting default shared_buffers ... 128MB 2023-11-13T11:27:39.035 INFO:teuthology.orchestra.run.smithi102.stdout:selecting default time zone ... Etc/UTC 2023-11-13T11:27:39.036 INFO:teuthology.orchestra.run.smithi102.stdout:creating configuration files ... ok 2023-11-13T11:27:39.205 INFO:teuthology.orchestra.run.smithi102.stdout:running bootstrap script ... ok 2023-11-13T11:27:39.813 INFO:teuthology.orchestra.run.smithi102.stdout:performing post-bootstrap initialization ... ok 2023-11-13T11:27:40.368 INFO:teuthology.orchestra.run.smithi102.stdout:syncing data to disk ... ok 2023-11-13T11:27:40.874 INFO:teuthology.orchestra.run.smithi102.stdout:update-alternatives: using /usr/share/postgresql/14/man/man1/postmaster.1.gz to provide /usr/share/man/man1/postmaster.1.gz (postmaster.1.gz) in auto mode 2023-11-13T11:27:43.887 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up libqmi-glib5:amd64 (1.32.0-1ubuntu0.22.04.1) ... 2023-11-13T11:27:44.013 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up postgresql-contrib (14+238) ... 2023-11-13T11:27:44.138 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up postgresql (14+238) ... 2023-11-13T11:27:44.265 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up libqmi-proxy (1.32.0-1ubuntu0.22.04.1) ... 2023-11-13T11:27:44.374 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up modemmanager (1.20.0-1~ubuntu22.04.2) ... 2023-11-13T11:27:44.656 INFO:teuthology.orchestra.run.smithi102.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.ModemManager1.service -> /lib/systemd/system/ModemManager.service. 2023-11-13T11:27:44.656 INFO:teuthology.orchestra.run.smithi102.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ModemManager.service -> /lib/systemd/system/ModemManager.service. 2023-11-13T11:27:45.393 INFO:teuthology.orchestra.run.smithi102.stdout:Processing triggers for hicolor-icon-theme (0.17-2) ... 2023-11-13T11:27:45.703 INFO:teuthology.orchestra.run.smithi102.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2023-11-13T11:27:45.863 INFO:teuthology.orchestra.run.smithi102.stdout:Processing triggers for man-db (2.10.2-1) ... 2023-11-13T11:27:47.267 INFO:teuthology.orchestra.run.smithi102.stdout:Processing triggers for dbus (1.12.20-2ubuntu4.1) ... 2023-11-13T11:27:47.367 INFO:teuthology.orchestra.run.smithi102.stdout:Processing triggers for install-info (6.8-4build1) ... 2023-11-13T11:27:48.077 INFO:teuthology.orchestra.run.smithi102.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2023-11-13T11:27:48.082 DEBUG:teuthology.parallel:result is None 2023-11-13T11:27:48.083 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=35f0debb3cc28955b7132ef4c509cd138a09d56b 2023-11-13T11:27:48.225 DEBUG:teuthology.orchestra.run.smithi102:> dpkg-query -W -f '${Version}' ceph 2023-11-13T11:27:48.248 INFO:teuthology.orchestra.run.smithi102.stdout:18.0.0-7288-g35f0debb-1jammy 2023-11-13T11:27:48.249 INFO:teuthology.packaging:The installed version of ceph is 18.0.0-7288-g35f0debb-1jammy 2023-11-13T11:27:48.250 INFO:teuthology.task.install:The correct ceph version 18.0.0-7288-g35f0debb-1jammy is installed. 2023-11-13T11:27:48.250 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=35f0debb3cc28955b7132ef4c509cd138a09d56b 2023-11-13T11:27:48.387 DEBUG:teuthology.orchestra.run.smithi154:> dpkg-query -W -f '${Version}' ceph 2023-11-13T11:27:48.411 INFO:teuthology.orchestra.run.smithi154.stdout:18.0.0-7288-g35f0debb-1jammy 2023-11-13T11:27:48.412 INFO:teuthology.packaging:The installed version of ceph is 18.0.0-7288-g35f0debb-1jammy 2023-11-13T11:27:48.412 INFO:teuthology.task.install:The correct ceph version 18.0.0-7288-g35f0debb-1jammy is installed. 2023-11-13T11:27:48.413 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2023-11-13T11:27:48.413 DEBUG:teuthology.orchestra.run.smithi102:> set -ex 2023-11-13T11:27:48.414 DEBUG:teuthology.orchestra.run.smithi102:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-11-13T11:27:48.434 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2023-11-13T11:27:48.435 DEBUG:teuthology.orchestra.run.smithi154:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-11-13T11:27:48.480 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2023-11-13T11:27:48.480 DEBUG:teuthology.orchestra.run.smithi102:> set -ex 2023-11-13T11:27:48.481 DEBUG:teuthology.orchestra.run.smithi102:> sudo dd of=/usr/bin/daemon-helper 2023-11-13T11:27:48.501 DEBUG:teuthology.orchestra.run.smithi102:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-11-13T11:27:48.569 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2023-11-13T11:27:48.569 DEBUG:teuthology.orchestra.run.smithi154:> sudo dd of=/usr/bin/daemon-helper 2023-11-13T11:27:48.591 DEBUG:teuthology.orchestra.run.smithi154:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-11-13T11:27:48.654 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2023-11-13T11:27:48.655 DEBUG:teuthology.orchestra.run.smithi102:> set -ex 2023-11-13T11:27:48.655 DEBUG:teuthology.orchestra.run.smithi102:> sudo dd of=/usr/bin/adjust-ulimits 2023-11-13T11:27:48.675 DEBUG:teuthology.orchestra.run.smithi102:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-11-13T11:27:48.736 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2023-11-13T11:27:48.737 DEBUG:teuthology.orchestra.run.smithi154:> sudo dd of=/usr/bin/adjust-ulimits 2023-11-13T11:27:48.759 DEBUG:teuthology.orchestra.run.smithi154:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-11-13T11:27:48.829 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2023-11-13T11:27:48.829 DEBUG:teuthology.orchestra.run.smithi102:> set -ex 2023-11-13T11:27:48.829 DEBUG:teuthology.orchestra.run.smithi102:> sudo dd of=/usr/bin/stdin-killer 2023-11-13T11:27:48.850 DEBUG:teuthology.orchestra.run.smithi102:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-11-13T11:27:48.912 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2023-11-13T11:27:48.913 DEBUG:teuthology.orchestra.run.smithi154:> sudo dd of=/usr/bin/stdin-killer 2023-11-13T11:27:48.935 DEBUG:teuthology.orchestra.run.smithi154:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-11-13T11:27:48.999 INFO:teuthology.run_tasks:Running task ceph... 2023-11-13T11:27:49.105 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2023-11-13T11:27:49.106 DEBUG:teuthology.orchestra.run.smithi102:> sudo chmod 777 /var/log/ceph 2023-11-13T11:27:49.111 DEBUG:teuthology.orchestra.run.smithi154:> sudo chmod 777 /var/log/ceph 2023-11-13T11:27:49.133 INFO:tasks.ceph:Disabling ceph logrotate... 2023-11-13T11:27:49.133 DEBUG:teuthology.orchestra.run.smithi102:> sudo rm -f -- /etc/logrotate.d/ceph 2023-11-13T11:27:49.172 DEBUG:teuthology.orchestra.run.smithi154:> sudo rm -f -- /etc/logrotate.d/ceph 2023-11-13T11:27:49.194 INFO:tasks.ceph:Creating extra log directories... 2023-11-13T11:27:49.194 DEBUG:teuthology.orchestra.run.smithi102:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-11-13T11:27:49.232 DEBUG:teuthology.orchestra.run.smithi154:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-11-13T11:27:49.291 INFO:tasks.ceph:Setting up log rotation with {'ceph-mds': '10G', 'ceph-osd': '10G'} 2023-11-13T11:27:49.291 INFO:tasks.ceph:writing logrotate stanza for ceph-mds 2023-11-13T11:27:49.292 INFO:tasks.ceph:writing logrotate stanza for ceph-osd 2023-11-13T11:27:49.293 DEBUG:teuthology.orchestra.run.smithi102:> set -ex 2023-11-13T11:27:49.293 DEBUG:teuthology.orchestra.run.smithi102:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2023-11-13T11:27:49.308 DEBUG:teuthology.orchestra.run.smithi102:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2023-11-13T11:27:49.401 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2023-11-13T11:27:49.402 DEBUG:teuthology.orchestra.run.smithi154:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2023-11-13T11:27:49.411 DEBUG:teuthology.orchestra.run.smithi154:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2023-11-13T11:27:49.515 INFO:tasks.ceph:Creating ceph cluster ceph... 2023-11-13T11:27:49.515 INFO:tasks.ceph:config {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2023-11-13T11:27:49.516 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/mchangir-2023-11-13_10:27:15-fs-wip-mchangir-testing-20231110.052303-testing-default-smithi/7456244', 'branch': 'wip-mchangir-testing-20231110.052303', 'description': 'fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/fuse objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/xfstests-dev}', 'email': 'mchangir@redhat.com', 'first_in_suite': False, 'job_id': '7456244', 'kernel': {'flavor': 'default', 'kdb': True, 'sha1': '5b73517e0e2fa132ea79290e5fc06ea5349b2288'}, 'ktype': 'distro', 'last_in_suite': False, 'log-rotate': {'ceph-mds': '10G', 'ceph-osd': '10G'}, 'machine_type': 'smithi', 'name': 'mchangir-2023-11-13_10:27:15-fs-wip-mchangir-testing-20231110.052303-testing-default-smithi', 'no_nested_subset': False, 'nuke-on-error': True, 'openstack': [{'volumes': {'count': 4, 'size': 20}}, {'machine': {'disk': 200}}], 'os_type': 'ubuntu', 'os_version': '22.04', 'overrides': {'admin_socket': {'branch': 'wip-mchangir-testing-20231110.052303'}, 'ceph': {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding'], 'sha1': '35f0debb3cc28955b7132ef4c509cd138a09d56b'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': '35f0debb3cc28955b7132ef4c509cd138a09d56b'}}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'wip-mchangir-testing-20231110.052303', 'sha1': '35f0debb3cc28955b7132ef4c509cd138a09d56b'}}, 'owner': 'mchangir', 'priority': 1000, 'repo': 'https://git.ceph.com/ceph-ci.git', 'roles': [['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'], ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3']], 'seed': 9746, 'sha1': '35f0debb3cc28955b7132ef4c509cd138a09d56b', 'sleep_before_teardown': 0, 'subset': '768/1024', 'suite': 'fs', 'suite_branch': 'wip-mchangir-testing-20231110.052303', 'suite_path': '/home/teuthworker/src/git.ceph.com_ceph-c_35f0debb3cc28955b7132ef4c509cd138a09d56b/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://git.ceph.com/ceph-ci.git', 'suite_sha1': '35f0debb3cc28955b7132ef4c509cd138a09d56b', 'syslog': {'ignorelist': ['WARNING*.*check_session_state', 'WARNING*.*__ceph_remove_cap']}, 'targets': {'smithi102.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBBcI2TSV0qNd3ch5a4V0vVrn/qrvbcXY5EvKVSqfgxKssxe7YmgPyNbPgkMrTHjeTHRtcG4DzJjr16P5Wl3BdR4=', 'smithi154.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBA/UR6tY53tV/hRttaw/xRNVkHsaF9+RzBacTuDQ8FbEkk+ZJpl2LrtnIQHlRgvBJ9kiTJfKmB/+kxyKYllN5Zs='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'flavor': 'default', 'kdb': True, 'sha1': '5b73517e0e2fa132ea79290e5fc06ea5349b2288'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '35f0debb3cc28955b7132ef4c509cd138a09d56b'}}, {'ceph': {'create_rbd_pool': False, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding'], 'sha1': '35f0debb3cc28955b7132ef4c509cd138a09d56b', 'cluster': 'ceph'}}, {'ceph-fuse': None}, {'cephfs_test_runner': {'fail_on_skip': False, 'modules': ['tasks.cephfs.tests_from_xfstests_dev']}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': ['local function is_kupstream() return false end', 'local function is_kdistro() return false end', 'local function is_fuse() return true end', "local function syntax_version() return '' end"]}, 'teuthology_branch': 'main', 'teuthology_sha1': '6899cd26fceddb2fec83dc1a1349394b28c8998e', 'timestamp': '2023-11-13_10:27:15', 'tube': 'smithi', 'user': 'mchangir', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.3590714'} 2023-11-13T11:27:49.518 DEBUG:teuthology.orchestra.run.smithi102:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-11-13T11:27:49.522 DEBUG:teuthology.orchestra.run.smithi154:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-11-13T11:27:49.535 DEBUG:teuthology.orchestra.run.smithi102:> sudo install -d -m0777 -- /var/run/ceph 2023-11-13T11:27:49.572 DEBUG:teuthology.orchestra.run.smithi154:> sudo install -d -m0777 -- /var/run/ceph 2023-11-13T11:27:49.602 DEBUG:teuthology.orchestra.run.smithi102:> set -ex 2023-11-13T11:27:49.602 DEBUG:teuthology.orchestra.run.smithi102:> dd if=/scratch_devs of=/dev/stdout 2023-11-13T11:27:49.641 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-11-13T11:27:49.642 DEBUG:teuthology.orchestra.run.smithi102:> stat /dev/vg_nvme/lv_1 2023-11-13T11:27:49.697 INFO:teuthology.orchestra.run.smithi102.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-11-13T11:27:49.698 INFO:teuthology.orchestra.run.smithi102.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-11-13T11:27:49.698 INFO:teuthology.orchestra.run.smithi102.stdout:Device: 5h/5d Inode: 902 Links: 1 2023-11-13T11:27:49.698 INFO:teuthology.orchestra.run.smithi102.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-11-13T11:27:49.698 INFO:teuthology.orchestra.run.smithi102.stdout:Access: 2023-11-13 11:21:18.797089240 +0000 2023-11-13T11:27:49.699 INFO:teuthology.orchestra.run.smithi102.stdout:Modify: 2023-11-13 11:21:18.793089274 +0000 2023-11-13T11:27:49.699 INFO:teuthology.orchestra.run.smithi102.stdout:Change: 2023-11-13 11:21:18.793089274 +0000 2023-11-13T11:27:49.699 INFO:teuthology.orchestra.run.smithi102.stdout: Birth: 2023-11-13 11:21:18.793089274 +0000 2023-11-13T11:27:49.699 DEBUG:teuthology.orchestra.run.smithi102:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-11-13T11:27:49.759 INFO:teuthology.orchestra.run.smithi102.stderr:1+0 records in 2023-11-13T11:27:49.759 INFO:teuthology.orchestra.run.smithi102.stderr:1+0 records out 2023-11-13T11:27:49.759 INFO:teuthology.orchestra.run.smithi102.stderr:512 bytes copied, 0.000391822 s, 1.3 MB/s 2023-11-13T11:27:49.761 DEBUG:teuthology.orchestra.run.smithi102:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-11-13T11:27:49.815 DEBUG:teuthology.orchestra.run.smithi102:> stat /dev/vg_nvme/lv_2 2023-11-13T11:27:49.869 INFO:teuthology.orchestra.run.smithi102.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-11-13T11:27:49.869 INFO:teuthology.orchestra.run.smithi102.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-11-13T11:27:49.869 INFO:teuthology.orchestra.run.smithi102.stdout:Device: 5h/5d Inode: 919 Links: 1 2023-11-13T11:27:49.870 INFO:teuthology.orchestra.run.smithi102.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-11-13T11:27:49.870 INFO:teuthology.orchestra.run.smithi102.stdout:Access: 2023-11-13 11:21:19.861079736 +0000 2023-11-13T11:27:49.870 INFO:teuthology.orchestra.run.smithi102.stdout:Modify: 2023-11-13 11:21:19.453083379 +0000 2023-11-13T11:27:49.870 INFO:teuthology.orchestra.run.smithi102.stdout:Change: 2023-11-13 11:21:19.453083379 +0000 2023-11-13T11:27:49.870 INFO:teuthology.orchestra.run.smithi102.stdout: Birth: 2023-11-13 11:21:19.453083379 +0000 2023-11-13T11:27:49.871 DEBUG:teuthology.orchestra.run.smithi102:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-11-13T11:27:49.935 INFO:teuthology.orchestra.run.smithi102.stderr:1+0 records in 2023-11-13T11:27:49.936 INFO:teuthology.orchestra.run.smithi102.stderr:1+0 records out 2023-11-13T11:27:49.936 INFO:teuthology.orchestra.run.smithi102.stderr:512 bytes copied, 0.000630671 s, 812 kB/s 2023-11-13T11:27:49.937 DEBUG:teuthology.orchestra.run.smithi102:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-11-13T11:27:49.995 DEBUG:teuthology.orchestra.run.smithi102:> stat /dev/vg_nvme/lv_3 2023-11-13T11:27:50.045 INFO:teuthology.orchestra.run.smithi102.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-11-13T11:27:50.046 INFO:teuthology.orchestra.run.smithi102.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-11-13T11:27:50.046 INFO:teuthology.orchestra.run.smithi102.stdout:Device: 5h/5d Inode: 938 Links: 1 2023-11-13T11:27:50.046 INFO:teuthology.orchestra.run.smithi102.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-11-13T11:27:50.047 INFO:teuthology.orchestra.run.smithi102.stdout:Access: 2023-11-13 11:21:20.525073804 +0000 2023-11-13T11:27:50.047 INFO:teuthology.orchestra.run.smithi102.stdout:Modify: 2023-11-13 11:21:20.117077448 +0000 2023-11-13T11:27:50.047 INFO:teuthology.orchestra.run.smithi102.stdout:Change: 2023-11-13 11:21:20.117077448 +0000 2023-11-13T11:27:50.047 INFO:teuthology.orchestra.run.smithi102.stdout: Birth: 2023-11-13 11:21:20.117077448 +0000 2023-11-13T11:27:50.048 DEBUG:teuthology.orchestra.run.smithi102:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-11-13T11:27:50.106 INFO:teuthology.orchestra.run.smithi102.stderr:1+0 records in 2023-11-13T11:27:50.107 INFO:teuthology.orchestra.run.smithi102.stderr:1+0 records out 2023-11-13T11:27:50.107 INFO:teuthology.orchestra.run.smithi102.stderr:512 bytes copied, 0.000372428 s, 1.4 MB/s 2023-11-13T11:27:50.108 DEBUG:teuthology.orchestra.run.smithi102:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-11-13T11:27:50.158 DEBUG:teuthology.orchestra.run.smithi102:> stat /dev/vg_nvme/lv_4 2023-11-13T11:27:50.208 INFO:teuthology.orchestra.run.smithi102.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-11-13T11:27:50.209 INFO:teuthology.orchestra.run.smithi102.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-11-13T11:27:50.209 INFO:teuthology.orchestra.run.smithi102.stdout:Device: 5h/5d Inode: 955 Links: 1 2023-11-13T11:27:50.209 INFO:teuthology.orchestra.run.smithi102.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-11-13T11:27:50.210 INFO:teuthology.orchestra.run.smithi102.stdout:Access: 2023-11-13 11:21:21.221067587 +0000 2023-11-13T11:27:50.210 INFO:teuthology.orchestra.run.smithi102.stdout:Modify: 2023-11-13 11:21:20.797071375 +0000 2023-11-13T11:27:50.210 INFO:teuthology.orchestra.run.smithi102.stdout:Change: 2023-11-13 11:21:20.797071375 +0000 2023-11-13T11:27:50.210 INFO:teuthology.orchestra.run.smithi102.stdout: Birth: 2023-11-13 11:21:20.797071375 +0000 2023-11-13T11:27:50.210 DEBUG:teuthology.orchestra.run.smithi102:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-11-13T11:27:50.274 INFO:teuthology.orchestra.run.smithi102.stderr:1+0 records in 2023-11-13T11:27:50.274 INFO:teuthology.orchestra.run.smithi102.stderr:1+0 records out 2023-11-13T11:27:50.274 INFO:teuthology.orchestra.run.smithi102.stderr:512 bytes copied, 0.000364637 s, 1.4 MB/s 2023-11-13T11:27:50.276 DEBUG:teuthology.orchestra.run.smithi102:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-11-13T11:27:50.331 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-11-13T11:27:50.332 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2023-11-13T11:27:50.332 DEBUG:teuthology.orchestra.run.smithi154:> dd if=/scratch_devs of=/dev/stdout 2023-11-13T11:27:50.342 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-11-13T11:27:50.342 DEBUG:teuthology.orchestra.run.smithi154:> stat /dev/vg_nvme/lv_1 2023-11-13T11:27:50.399 INFO:teuthology.orchestra.run.smithi154.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-11-13T11:27:50.399 INFO:teuthology.orchestra.run.smithi154.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-11-13T11:27:50.399 INFO:teuthology.orchestra.run.smithi154.stdout:Device: 5h/5d Inode: 898 Links: 1 2023-11-13T11:27:50.399 INFO:teuthology.orchestra.run.smithi154.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-11-13T11:27:50.400 INFO:teuthology.orchestra.run.smithi154.stdout:Access: 2023-11-13 11:21:19.173253332 +0000 2023-11-13T11:27:50.400 INFO:teuthology.orchestra.run.smithi154.stdout:Modify: 2023-11-13 11:21:18.761257012 +0000 2023-11-13T11:27:50.400 INFO:teuthology.orchestra.run.smithi154.stdout:Change: 2023-11-13 11:21:18.761257012 +0000 2023-11-13T11:27:50.400 INFO:teuthology.orchestra.run.smithi154.stdout: Birth: 2023-11-13 11:21:18.761257012 +0000 2023-11-13T11:27:50.401 DEBUG:teuthology.orchestra.run.smithi154:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-11-13T11:27:50.465 INFO:teuthology.orchestra.run.smithi154.stderr:1+0 records in 2023-11-13T11:27:50.465 INFO:teuthology.orchestra.run.smithi154.stderr:1+0 records out 2023-11-13T11:27:50.465 INFO:teuthology.orchestra.run.smithi154.stderr:512 bytes copied, 0.000415414 s, 1.2 MB/s 2023-11-13T11:27:50.467 DEBUG:teuthology.orchestra.run.smithi154:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-11-13T11:27:50.520 DEBUG:teuthology.orchestra.run.smithi154:> stat /dev/vg_nvme/lv_2 2023-11-13T11:27:50.570 INFO:teuthology.orchestra.run.smithi154.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-11-13T11:27:50.570 INFO:teuthology.orchestra.run.smithi154.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-11-13T11:27:50.571 INFO:teuthology.orchestra.run.smithi154.stdout:Device: 5h/5d Inode: 913 Links: 1 2023-11-13T11:27:50.571 INFO:teuthology.orchestra.run.smithi154.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-11-13T11:27:50.571 INFO:teuthology.orchestra.run.smithi154.stdout:Access: 2023-11-13 11:21:19.825247508 +0000 2023-11-13T11:27:50.571 INFO:teuthology.orchestra.run.smithi154.stdout:Modify: 2023-11-13 11:21:19.421251117 +0000 2023-11-13T11:27:50.571 INFO:teuthology.orchestra.run.smithi154.stdout:Change: 2023-11-13 11:21:19.421251117 +0000 2023-11-13T11:27:50.572 INFO:teuthology.orchestra.run.smithi154.stdout: Birth: 2023-11-13 11:21:19.421251117 +0000 2023-11-13T11:27:50.572 DEBUG:teuthology.orchestra.run.smithi154:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-11-13T11:27:50.637 INFO:teuthology.orchestra.run.smithi154.stderr:1+0 records in 2023-11-13T11:27:50.637 INFO:teuthology.orchestra.run.smithi154.stderr:1+0 records out 2023-11-13T11:27:50.638 INFO:teuthology.orchestra.run.smithi154.stderr:512 bytes copied, 0.000651965 s, 785 kB/s 2023-11-13T11:27:50.639 DEBUG:teuthology.orchestra.run.smithi154:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-11-13T11:27:50.692 DEBUG:teuthology.orchestra.run.smithi154:> stat /dev/vg_nvme/lv_3 2023-11-13T11:27:50.743 INFO:teuthology.orchestra.run.smithi154.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-11-13T11:27:50.743 INFO:teuthology.orchestra.run.smithi154.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-11-13T11:27:50.743 INFO:teuthology.orchestra.run.smithi154.stdout:Device: 5h/5d Inode: 932 Links: 1 2023-11-13T11:27:50.743 INFO:teuthology.orchestra.run.smithi154.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-11-13T11:27:50.743 INFO:teuthology.orchestra.run.smithi154.stdout:Access: 2023-11-13 11:21:20.089245149 +0000 2023-11-13T11:27:50.744 INFO:teuthology.orchestra.run.smithi154.stdout:Modify: 2023-11-13 11:21:20.085245186 +0000 2023-11-13T11:27:50.744 INFO:teuthology.orchestra.run.smithi154.stdout:Change: 2023-11-13 11:21:20.085245186 +0000 2023-11-13T11:27:50.744 INFO:teuthology.orchestra.run.smithi154.stdout: Birth: 2023-11-13 11:21:20.085245186 +0000 2023-11-13T11:27:50.744 DEBUG:teuthology.orchestra.run.smithi154:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-11-13T11:27:50.805 INFO:teuthology.orchestra.run.smithi154.stderr:1+0 records in 2023-11-13T11:27:50.805 INFO:teuthology.orchestra.run.smithi154.stderr:1+0 records out 2023-11-13T11:27:50.805 INFO:teuthology.orchestra.run.smithi154.stderr:512 bytes copied, 0.000386272 s, 1.3 MB/s 2023-11-13T11:27:50.807 DEBUG:teuthology.orchestra.run.smithi154:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-11-13T11:27:50.862 DEBUG:teuthology.orchestra.run.smithi154:> stat /dev/vg_nvme/lv_4 2023-11-13T11:27:50.914 INFO:teuthology.orchestra.run.smithi154.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-11-13T11:27:50.915 INFO:teuthology.orchestra.run.smithi154.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-11-13T11:27:50.915 INFO:teuthology.orchestra.run.smithi154.stdout:Device: 5h/5d Inode: 948 Links: 1 2023-11-13T11:27:50.915 INFO:teuthology.orchestra.run.smithi154.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-11-13T11:27:50.915 INFO:teuthology.orchestra.run.smithi154.stdout:Access: 2023-11-13 11:21:21.177235431 +0000 2023-11-13T11:27:50.916 INFO:teuthology.orchestra.run.smithi154.stdout:Modify: 2023-11-13 11:21:20.773239040 +0000 2023-11-13T11:27:50.916 INFO:teuthology.orchestra.run.smithi154.stdout:Change: 2023-11-13 11:21:20.773239040 +0000 2023-11-13T11:27:50.916 INFO:teuthology.orchestra.run.smithi154.stdout: Birth: 2023-11-13 11:21:20.773239040 +0000 2023-11-13T11:27:50.916 DEBUG:teuthology.orchestra.run.smithi154:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-11-13T11:27:50.981 INFO:teuthology.orchestra.run.smithi154.stderr:1+0 records in 2023-11-13T11:27:50.981 INFO:teuthology.orchestra.run.smithi154.stderr:1+0 records out 2023-11-13T11:27:50.982 INFO:teuthology.orchestra.run.smithi154.stderr:512 bytes copied, 0.000383899 s, 1.3 MB/s 2023-11-13T11:27:50.983 DEBUG:teuthology.orchestra.run.smithi154:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-11-13T11:27:51.040 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-11-13T11:27:51.041 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi102.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi154.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2023-11-13T11:27:51.041 INFO:tasks.ceph:Generating config... 2023-11-13T11:27:51.042 INFO:tasks.ceph:[client] client mount timeout = 600 2023-11-13T11:27:51.043 INFO:tasks.ceph:[client] debug client = 20 2023-11-13T11:27:51.043 INFO:tasks.ceph:[client] debug ms = 1 2023-11-13T11:27:51.043 INFO:tasks.ceph:[client] pid file = 2023-11-13T11:27:51.043 INFO:tasks.ceph:[client] rados mon op timeout = 900 2023-11-13T11:27:51.044 INFO:tasks.ceph:[client] rados osd op timeout = 900 2023-11-13T11:27:51.044 INFO:tasks.ceph:[mds] debug mds = 20 2023-11-13T11:27:51.044 INFO:tasks.ceph:[mds] debug mds balancer = 20 2023-11-13T11:27:51.044 INFO:tasks.ceph:[mds] debug ms = 1 2023-11-13T11:27:51.045 INFO:tasks.ceph:[mds] mds debug frag = True 2023-11-13T11:27:51.045 INFO:tasks.ceph:[mds] mds debug scatterstat = True 2023-11-13T11:27:51.045 INFO:tasks.ceph:[mds] mds op complaint time = 180 2023-11-13T11:27:51.045 INFO:tasks.ceph:[mds] mds verify scatter = True 2023-11-13T11:27:51.046 INFO:tasks.ceph:[mds] osd op complaint time = 180 2023-11-13T11:27:51.046 INFO:tasks.ceph:[mds] rados mon op timeout = 900 2023-11-13T11:27:51.046 INFO:tasks.ceph:[mds] rados osd op timeout = 900 2023-11-13T11:27:51.046 INFO:tasks.ceph:[mgr] debug mgr = 20 2023-11-13T11:27:51.047 INFO:tasks.ceph:[mgr] debug ms = 1 2023-11-13T11:27:51.047 INFO:tasks.ceph:[mon] debug mon = 20 2023-11-13T11:27:51.047 INFO:tasks.ceph:[mon] debug ms = 1 2023-11-13T11:27:51.047 INFO:tasks.ceph:[mon] debug paxos = 20 2023-11-13T11:27:51.048 INFO:tasks.ceph:[mon] mon op complaint time = 120 2023-11-13T11:27:51.048 INFO:tasks.ceph:[osd] bdev async discard = True 2023-11-13T11:27:51.050 INFO:tasks.ceph:[osd] bdev enable discard = True 2023-11-13T11:27:51.050 INFO:tasks.ceph:[osd] bluestore allocator = bitmap 2023-11-13T11:27:51.051 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2023-11-13T11:27:51.051 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2023-11-13T11:27:51.051 INFO:tasks.ceph:[osd] debug bluefs = 1/20 2023-11-13T11:27:51.052 INFO:tasks.ceph:[osd] debug bluestore = 1/20 2023-11-13T11:27:51.052 INFO:tasks.ceph:[osd] debug ms = 1 2023-11-13T11:27:51.053 INFO:tasks.ceph:[osd] debug osd = 20 2023-11-13T11:27:51.053 INFO:tasks.ceph:[osd] debug rocksdb = 4/10 2023-11-13T11:27:51.053 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2023-11-13T11:27:51.053 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2023-11-13T11:27:51.054 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2023-11-13T11:27:51.054 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2023-11-13T11:27:51.054 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2023-11-13T11:27:51.054 INFO:tasks.ceph:[osd] osd op complaint time = 180 2023-11-13T11:27:51.055 INFO:tasks.ceph:Setting up mon.a... 2023-11-13T11:27:51.055 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2023-11-13T11:27:51.100 INFO:teuthology.orchestra.run.smithi102.stdout:creating /etc/ceph/ceph.keyring 2023-11-13T11:27:51.115 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2023-11-13T11:27:51.208 DEBUG:teuthology.orchestra.run.smithi102:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-11-13T11:27:51.230 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.102'), ('mon.b', '172.21.15.154'), ('mon.c', '[v2:172.21.15.154:3301,v1:172.21.15.154:6790]')] 2023-11-13T11:27:51.231 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.102,172.21.15.154,[v2:172.21.15.154:3301,v1:172.21.15.154:6790]'}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd debug trim objects': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon op complaint time': 120}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mds.a': {}, 'mds.c': {}, 'mds.b': {}, 'mds.d': {}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}} 2023-11-13T11:27:51.232 DEBUG:teuthology.orchestra.run.smithi102:> set -ex 2023-11-13T11:27:51.232 DEBUG:teuthology.orchestra.run.smithi102:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2023-11-13T11:27:51.281 DEBUG:teuthology.orchestra.run.smithi102:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.102 --add b 172.21.15.154 --addv c '[v2:172.21.15.154:3301,v1:172.21.15.154:6790]' --print /home/ubuntu/cephtest/ceph.monmap 2023-11-13T11:27:51.375 INFO:teuthology.orchestra.run.smithi102.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2023-11-13T11:27:51.375 INFO:teuthology.orchestra.run.smithi102.stdout:monmaptool: generated fsid 97b3eb2b-7ccf-4aae-8d92-bff986c671ea 2023-11-13T11:27:51.375 INFO:teuthology.orchestra.run.smithi102.stdout:setting min_mon_release = pacific 2023-11-13T11:27:51.376 INFO:teuthology.orchestra.run.smithi102.stdout:epoch 0 2023-11-13T11:27:51.376 INFO:teuthology.orchestra.run.smithi102.stdout:fsid 97b3eb2b-7ccf-4aae-8d92-bff986c671ea 2023-11-13T11:27:51.376 INFO:teuthology.orchestra.run.smithi102.stdout:last_changed 2023-11-13T11:27:51.374606+0000 2023-11-13T11:27:51.376 INFO:teuthology.orchestra.run.smithi102.stdout:created 2023-11-13T11:27:51.374606+0000 2023-11-13T11:27:51.376 INFO:teuthology.orchestra.run.smithi102.stdout:min_mon_release 16 (pacific) 2023-11-13T11:27:51.377 INFO:teuthology.orchestra.run.smithi102.stdout:election_strategy: 1 2023-11-13T11:27:51.377 INFO:teuthology.orchestra.run.smithi102.stdout:0: [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] mon.a 2023-11-13T11:27:51.377 INFO:teuthology.orchestra.run.smithi102.stdout:1: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.b 2023-11-13T11:27:51.377 INFO:teuthology.orchestra.run.smithi102.stdout:2: [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] mon.c 2023-11-13T11:27:51.377 INFO:teuthology.orchestra.run.smithi102.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2023-11-13T11:27:51.379 DEBUG:teuthology.orchestra.run.smithi102:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2023-11-13T11:27:51.387 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID 97b3eb2b-7ccf-4aae-8d92-bff986c671ea... 2023-11-13T11:27:51.388 DEBUG:teuthology.orchestra.run.smithi102:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-11-13T11:27:51.432 DEBUG:teuthology.orchestra.run.smithi154:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-11-13T11:27:51.472 INFO:teuthology.orchestra.run.smithi102.stdout:[global] 2023-11-13T11:27:51.472 INFO:teuthology.orchestra.run.smithi102.stdout: chdir = "" 2023-11-13T11:27:51.473 INFO:teuthology.orchestra.run.smithi102.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-11-13T11:27:51.473 INFO:teuthology.orchestra.run.smithi102.stdout: auth supported = cephx 2023-11-13T11:27:51.473 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T11:27:51.473 INFO:teuthology.orchestra.run.smithi102.stdout: filestore xattr use omap = true 2023-11-13T11:27:51.473 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T11:27:51.474 INFO:teuthology.orchestra.run.smithi102.stdout: mon clock drift allowed = 1.000 2023-11-13T11:27:51.474 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T11:27:51.474 INFO:teuthology.orchestra.run.smithi102.stdout: osd crush chooseleaf type = 0 2023-11-13T11:27:51.474 INFO:teuthology.orchestra.run.smithi102.stdout: auth debug = true 2023-11-13T11:27:51.474 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T11:27:51.475 INFO:teuthology.orchestra.run.smithi102.stdout: ms die on old message = true 2023-11-13T11:27:51.475 INFO:teuthology.orchestra.run.smithi102.stdout: ms die on bug = true 2023-11-13T11:27:51.475 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T11:27:51.475 INFO:teuthology.orchestra.run.smithi102.stdout: mon max pg per osd = 10000 # >= luminous 2023-11-13T11:27:51.475 INFO:teuthology.orchestra.run.smithi102.stdout: mon pg warn max object skew = 0 2023-11-13T11:27:51.476 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T11:27:51.476 INFO:teuthology.orchestra.run.smithi102.stdout: # disable pg_autoscaler by default for new pools 2023-11-13T11:27:51.476 INFO:teuthology.orchestra.run.smithi102.stdout: osd_pool_default_pg_autoscale_mode = off 2023-11-13T11:27:51.476 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T11:27:51.476 INFO:teuthology.orchestra.run.smithi102.stdout: osd pool default size = 2 2023-11-13T11:27:51.477 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T11:27:51.477 INFO:teuthology.orchestra.run.smithi102.stdout: mon osd allow primary affinity = true 2023-11-13T11:27:51.477 INFO:teuthology.orchestra.run.smithi102.stdout: mon osd allow pg remap = true 2023-11-13T11:27:51.477 INFO:teuthology.orchestra.run.smithi102.stdout: mon warn on legacy crush tunables = false 2023-11-13T11:27:51.477 INFO:teuthology.orchestra.run.smithi102.stdout: mon warn on crush straw calc version zero = false 2023-11-13T11:27:51.477 INFO:teuthology.orchestra.run.smithi102.stdout: mon warn on no sortbitwise = false 2023-11-13T11:27:51.478 INFO:teuthology.orchestra.run.smithi102.stdout: mon warn on osd down out interval zero = false 2023-11-13T11:27:51.478 INFO:teuthology.orchestra.run.smithi102.stdout: mon warn on too few osds = false 2023-11-13T11:27:51.478 INFO:teuthology.orchestra.run.smithi102.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-11-13T11:27:51.478 INFO:teuthology.orchestra.run.smithi102.stdout: mon_warn_on_pool_no_redundancy = false 2023-11-13T11:27:51.478 INFO:teuthology.orchestra.run.smithi102.stdout: mon_allow_pool_size_one = true 2023-11-13T11:27:51.481 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T11:27:51.482 INFO:teuthology.orchestra.run.smithi102.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-11-13T11:27:51.482 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T11:27:51.482 INFO:teuthology.orchestra.run.smithi102.stdout: osd default data pool replay window = 5 2023-11-13T11:27:51.482 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T11:27:51.482 INFO:teuthology.orchestra.run.smithi102.stdout: mon allow pool delete = true 2023-11-13T11:27:51.483 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T11:27:51.483 INFO:teuthology.orchestra.run.smithi102.stdout: mon cluster log file level = debug 2023-11-13T11:27:51.483 INFO:teuthology.orchestra.run.smithi102.stdout: debug asserts on shutdown = true 2023-11-13T11:27:51.483 INFO:teuthology.orchestra.run.smithi102.stdout: mon health detail to clog = false 2023-11-13T11:27:51.483 INFO:teuthology.orchestra.run.smithi102.stdout: mon host = "172.21.15.102,172.21.15.154,[v2:172.21.15.154:3301,v1:172.21.15.154:6790]" 2023-11-13T11:27:51.484 INFO:teuthology.orchestra.run.smithi102.stdout: fsid = 97b3eb2b-7ccf-4aae-8d92-bff986c671ea 2023-11-13T11:27:51.484 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T11:27:51.484 INFO:teuthology.orchestra.run.smithi102.stdout:[osd] 2023-11-13T11:27:51.484 INFO:teuthology.orchestra.run.smithi102.stdout: osd journal size = 100 2023-11-13T11:27:51.484 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T11:27:51.485 INFO:teuthology.orchestra.run.smithi102.stdout: osd scrub load threshold = 5.0 2023-11-13T11:27:51.485 INFO:teuthology.orchestra.run.smithi102.stdout: osd scrub max interval = 600 2023-11-13T11:27:51.485 INFO:teuthology.orchestra.run.smithi102.stdout: osd mclock profile = high_recovery_ops 2023-11-13T11:27:51.485 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T11:27:51.486 INFO:teuthology.orchestra.run.smithi102.stdout: osd recover clone overlap = true 2023-11-13T11:27:51.486 INFO:teuthology.orchestra.run.smithi102.stdout: osd recovery max chunk = 1048576 2023-11-13T11:27:51.486 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T11:27:51.486 INFO:teuthology.orchestra.run.smithi102.stdout: osd debug shutdown = true 2023-11-13T11:27:51.486 INFO:teuthology.orchestra.run.smithi102.stdout: osd debug op order = true 2023-11-13T11:27:51.486 INFO:teuthology.orchestra.run.smithi102.stdout: osd debug verify stray on activate = true 2023-11-13T11:27:51.487 INFO:teuthology.orchestra.run.smithi102.stdout: osd debug trim objects = true 2023-11-13T11:27:51.487 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T11:27:51.487 INFO:teuthology.orchestra.run.smithi102.stdout: osd open classes on start = true 2023-11-13T11:27:51.487 INFO:teuthology.orchestra.run.smithi102.stdout: osd debug pg log writeout = true 2023-11-13T11:27:51.487 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T11:27:51.488 INFO:teuthology.orchestra.run.smithi102.stdout: osd deep scrub update digest min age = 30 2023-11-13T11:27:51.488 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T11:27:51.488 INFO:teuthology.orchestra.run.smithi102.stdout: osd map max advance = 10 2023-11-13T11:27:51.488 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T11:27:51.488 INFO:teuthology.orchestra.run.smithi102.stdout: journal zero on create = true 2023-11-13T11:27:51.489 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T11:27:51.489 INFO:teuthology.orchestra.run.smithi102.stdout: filestore ondisk finisher threads = 3 2023-11-13T11:27:51.489 INFO:teuthology.orchestra.run.smithi102.stdout: filestore apply finisher threads = 3 2023-11-13T11:27:51.489 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T11:27:51.489 INFO:teuthology.orchestra.run.smithi102.stdout: bdev debug aio = true 2023-11-13T11:27:51.490 INFO:teuthology.orchestra.run.smithi102.stdout: osd debug misdirected ops = true 2023-11-13T11:27:51.490 INFO:teuthology.orchestra.run.smithi102.stdout: bdev async discard = True 2023-11-13T11:27:51.490 INFO:teuthology.orchestra.run.smithi102.stdout: bdev enable discard = True 2023-11-13T11:27:51.490 INFO:teuthology.orchestra.run.smithi102.stdout: bluestore allocator = bitmap 2023-11-13T11:27:51.490 INFO:teuthology.orchestra.run.smithi102.stdout: bluestore block size = 96636764160 2023-11-13T11:27:51.490 INFO:teuthology.orchestra.run.smithi102.stdout: bluestore fsck on mount = True 2023-11-13T11:27:51.491 INFO:teuthology.orchestra.run.smithi102.stdout: debug bluefs = 1/20 2023-11-13T11:27:51.491 INFO:teuthology.orchestra.run.smithi102.stdout: debug bluestore = 1/20 2023-11-13T11:27:51.491 INFO:teuthology.orchestra.run.smithi102.stdout: debug ms = 1 2023-11-13T11:27:51.491 INFO:teuthology.orchestra.run.smithi102.stdout: debug osd = 20 2023-11-13T11:27:51.491 INFO:teuthology.orchestra.run.smithi102.stdout: debug rocksdb = 4/10 2023-11-13T11:27:51.492 INFO:teuthology.orchestra.run.smithi102.stdout: mon osd backfillfull_ratio = 0.85 2023-11-13T11:27:51.492 INFO:teuthology.orchestra.run.smithi102.stdout: mon osd full ratio = 0.9 2023-11-13T11:27:51.492 INFO:teuthology.orchestra.run.smithi102.stdout: mon osd nearfull ratio = 0.8 2023-11-13T11:27:51.492 INFO:teuthology.orchestra.run.smithi102.stdout: osd failsafe full ratio = 0.95 2023-11-13T11:27:51.492 INFO:teuthology.orchestra.run.smithi102.stdout: osd objectstore = bluestore 2023-11-13T11:27:51.493 INFO:teuthology.orchestra.run.smithi102.stdout: osd op complaint time = 180 2023-11-13T11:27:51.493 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T11:27:51.493 INFO:teuthology.orchestra.run.smithi102.stdout:[mgr] 2023-11-13T11:27:51.493 INFO:teuthology.orchestra.run.smithi102.stdout: debug ms = 1 2023-11-13T11:27:51.493 INFO:teuthology.orchestra.run.smithi102.stdout: debug mgr = 20 2023-11-13T11:27:51.493 INFO:teuthology.orchestra.run.smithi102.stdout: debug mon = 20 2023-11-13T11:27:51.494 INFO:teuthology.orchestra.run.smithi102.stdout: debug auth = 20 2023-11-13T11:27:51.494 INFO:teuthology.orchestra.run.smithi102.stdout: mon reweight min pgs per osd = 4 2023-11-13T11:27:51.494 INFO:teuthology.orchestra.run.smithi102.stdout: mon reweight min bytes per osd = 10 2023-11-13T11:27:51.494 INFO:teuthology.orchestra.run.smithi102.stdout: mgr/telemetry/nag = false 2023-11-13T11:27:51.494 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T11:27:51.495 INFO:teuthology.orchestra.run.smithi102.stdout:[mon] 2023-11-13T11:27:51.495 INFO:teuthology.orchestra.run.smithi102.stdout: debug ms = 1 2023-11-13T11:27:51.495 INFO:teuthology.orchestra.run.smithi102.stdout: debug mon = 20 2023-11-13T11:27:51.495 INFO:teuthology.orchestra.run.smithi102.stdout: debug paxos = 20 2023-11-13T11:27:51.495 INFO:teuthology.orchestra.run.smithi102.stdout: debug auth = 20 2023-11-13T11:27:51.495 INFO:teuthology.orchestra.run.smithi102.stdout: mon data avail warn = 5 2023-11-13T11:27:51.496 INFO:teuthology.orchestra.run.smithi102.stdout: mon mgr mkfs grace = 240 2023-11-13T11:27:51.496 INFO:teuthology.orchestra.run.smithi102.stdout: mon reweight min pgs per osd = 4 2023-11-13T11:27:51.496 INFO:teuthology.orchestra.run.smithi102.stdout: mon osd reporter subtree level = osd 2023-11-13T11:27:51.496 INFO:teuthology.orchestra.run.smithi102.stdout: mon osd prime pg temp = true 2023-11-13T11:27:51.496 INFO:teuthology.orchestra.run.smithi102.stdout: mon reweight min bytes per osd = 10 2023-11-13T11:27:51.497 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T11:27:51.497 INFO:teuthology.orchestra.run.smithi102.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-11-13T11:27:51.497 INFO:teuthology.orchestra.run.smithi102.stdout: auth mon ticket ttl = 660 # 11m 2023-11-13T11:27:51.497 INFO:teuthology.orchestra.run.smithi102.stdout: auth service ticket ttl = 240 # 4m 2023-11-13T11:27:51.497 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T11:27:51.498 INFO:teuthology.orchestra.run.smithi102.stdout: # don't complain about insecure global_id in the test suite 2023-11-13T11:27:51.498 INFO:teuthology.orchestra.run.smithi102.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-11-13T11:27:51.498 INFO:teuthology.orchestra.run.smithi102.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-11-13T11:27:51.498 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T11:27:51.498 INFO:teuthology.orchestra.run.smithi102.stdout: # 1m isn't quite enough 2023-11-13T11:27:51.499 INFO:teuthology.orchestra.run.smithi102.stdout: mon_down_mkfs_grace = 2m 2023-11-13T11:27:51.499 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T11:27:51.499 INFO:teuthology.orchestra.run.smithi102.stdout: mon_warn_on_filestore_osds = false 2023-11-13T11:27:51.499 INFO:teuthology.orchestra.run.smithi102.stdout: mon op complaint time = 120 2023-11-13T11:27:51.499 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T11:27:51.499 INFO:teuthology.orchestra.run.smithi102.stdout:[client] 2023-11-13T11:27:51.500 INFO:teuthology.orchestra.run.smithi102.stdout: rgw cache enabled = true 2023-11-13T11:27:51.500 INFO:teuthology.orchestra.run.smithi102.stdout: rgw enable ops log = true 2023-11-13T11:27:51.500 INFO:teuthology.orchestra.run.smithi102.stdout: rgw enable usage log = true 2023-11-13T11:27:51.500 INFO:teuthology.orchestra.run.smithi102.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-11-13T11:27:51.500 INFO:teuthology.orchestra.run.smithi102.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-11-13T11:27:51.501 INFO:teuthology.orchestra.run.smithi102.stdout: client mount timeout = 600 2023-11-13T11:27:51.501 INFO:teuthology.orchestra.run.smithi102.stdout: debug client = 20 2023-11-13T11:27:51.501 INFO:teuthology.orchestra.run.smithi102.stdout: debug ms = 1 2023-11-13T11:27:51.501 INFO:teuthology.orchestra.run.smithi102.stdout: pid file = "" 2023-11-13T11:27:51.501 INFO:teuthology.orchestra.run.smithi102.stdout: rados mon op timeout = 900 2023-11-13T11:27:51.501 INFO:teuthology.orchestra.run.smithi102.stdout: rados osd op timeout = 900 2023-11-13T11:27:51.502 INFO:teuthology.orchestra.run.smithi102.stdout:[mon.a] 2023-11-13T11:27:51.502 INFO:teuthology.orchestra.run.smithi102.stdout:[mon.b] 2023-11-13T11:27:51.502 INFO:teuthology.orchestra.run.smithi102.stdout:[mon.c] 2023-11-13T11:27:51.502 INFO:teuthology.orchestra.run.smithi102.stdout:[mds.a] 2023-11-13T11:27:51.502 INFO:teuthology.orchestra.run.smithi102.stdout:[mds.c] 2023-11-13T11:27:51.503 INFO:teuthology.orchestra.run.smithi102.stdout:[mds.b] 2023-11-13T11:27:51.503 INFO:teuthology.orchestra.run.smithi102.stdout:[mds.d] 2023-11-13T11:27:51.503 INFO:teuthology.orchestra.run.smithi102.stdout:[mds] 2023-11-13T11:27:51.503 INFO:teuthology.orchestra.run.smithi102.stdout: debug mds = 20 2023-11-13T11:27:51.503 INFO:teuthology.orchestra.run.smithi102.stdout: debug mds balancer = 20 2023-11-13T11:27:51.504 INFO:teuthology.orchestra.run.smithi102.stdout: debug ms = 1 2023-11-13T11:27:51.504 INFO:teuthology.orchestra.run.smithi102.stdout: mds debug frag = True 2023-11-13T11:27:51.504 INFO:teuthology.orchestra.run.smithi102.stdout: mds debug scatterstat = True 2023-11-13T11:27:51.504 INFO:teuthology.orchestra.run.smithi102.stdout: mds op complaint time = 180 2023-11-13T11:27:51.504 INFO:teuthology.orchestra.run.smithi102.stdout: mds verify scatter = True 2023-11-13T11:27:51.505 INFO:teuthology.orchestra.run.smithi102.stdout: osd op complaint time = 180 2023-11-13T11:27:51.505 INFO:teuthology.orchestra.run.smithi102.stdout: rados mon op timeout = 900 2023-11-13T11:27:51.505 INFO:teuthology.orchestra.run.smithi102.stdout: rados osd op timeout = 900 2023-11-13T11:27:51.507 INFO:teuthology.orchestra.run.smithi154.stdout:[global] 2023-11-13T11:27:51.507 INFO:teuthology.orchestra.run.smithi154.stdout: chdir = "" 2023-11-13T11:27:51.507 INFO:teuthology.orchestra.run.smithi154.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-11-13T11:27:51.507 INFO:teuthology.orchestra.run.smithi154.stdout: auth supported = cephx 2023-11-13T11:27:51.507 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-13T11:27:51.508 INFO:teuthology.orchestra.run.smithi154.stdout: filestore xattr use omap = true 2023-11-13T11:27:51.508 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-13T11:27:51.508 INFO:teuthology.orchestra.run.smithi154.stdout: mon clock drift allowed = 1.000 2023-11-13T11:27:51.508 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-13T11:27:51.508 INFO:teuthology.orchestra.run.smithi154.stdout: osd crush chooseleaf type = 0 2023-11-13T11:27:51.509 INFO:teuthology.orchestra.run.smithi154.stdout: auth debug = true 2023-11-13T11:27:51.509 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-13T11:27:51.509 INFO:teuthology.orchestra.run.smithi154.stdout: ms die on old message = true 2023-11-13T11:27:51.509 INFO:teuthology.orchestra.run.smithi154.stdout: ms die on bug = true 2023-11-13T11:27:51.509 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-13T11:27:51.510 INFO:teuthology.orchestra.run.smithi154.stdout: mon max pg per osd = 10000 # >= luminous 2023-11-13T11:27:51.510 INFO:teuthology.orchestra.run.smithi154.stdout: mon pg warn max object skew = 0 2023-11-13T11:27:51.510 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-13T11:27:51.510 INFO:teuthology.orchestra.run.smithi154.stdout: # disable pg_autoscaler by default for new pools 2023-11-13T11:27:51.510 INFO:teuthology.orchestra.run.smithi154.stdout: osd_pool_default_pg_autoscale_mode = off 2023-11-13T11:27:51.511 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-13T11:27:51.511 INFO:teuthology.orchestra.run.smithi154.stdout: osd pool default size = 2 2023-11-13T11:27:51.511 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-13T11:27:51.511 INFO:teuthology.orchestra.run.smithi154.stdout: mon osd allow primary affinity = true 2023-11-13T11:27:51.511 INFO:teuthology.orchestra.run.smithi154.stdout: mon osd allow pg remap = true 2023-11-13T11:27:51.512 INFO:teuthology.orchestra.run.smithi154.stdout: mon warn on legacy crush tunables = false 2023-11-13T11:27:51.512 INFO:teuthology.orchestra.run.smithi154.stdout: mon warn on crush straw calc version zero = false 2023-11-13T11:27:51.512 INFO:teuthology.orchestra.run.smithi154.stdout: mon warn on no sortbitwise = false 2023-11-13T11:27:51.512 INFO:teuthology.orchestra.run.smithi154.stdout: mon warn on osd down out interval zero = false 2023-11-13T11:27:51.512 INFO:teuthology.orchestra.run.smithi154.stdout: mon warn on too few osds = false 2023-11-13T11:27:51.512 INFO:teuthology.orchestra.run.smithi154.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-11-13T11:27:51.513 INFO:teuthology.orchestra.run.smithi154.stdout: mon_warn_on_pool_no_redundancy = false 2023-11-13T11:27:51.513 INFO:teuthology.orchestra.run.smithi154.stdout: mon_allow_pool_size_one = true 2023-11-13T11:27:51.513 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-13T11:27:51.513 INFO:teuthology.orchestra.run.smithi154.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-11-13T11:27:51.513 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-13T11:27:51.514 INFO:teuthology.orchestra.run.smithi154.stdout: osd default data pool replay window = 5 2023-11-13T11:27:51.514 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-13T11:27:51.514 INFO:teuthology.orchestra.run.smithi154.stdout: mon allow pool delete = true 2023-11-13T11:27:51.514 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-13T11:27:51.514 INFO:teuthology.orchestra.run.smithi154.stdout: mon cluster log file level = debug 2023-11-13T11:27:51.515 INFO:teuthology.orchestra.run.smithi154.stdout: debug asserts on shutdown = true 2023-11-13T11:27:51.515 INFO:teuthology.orchestra.run.smithi154.stdout: mon health detail to clog = false 2023-11-13T11:27:51.515 INFO:teuthology.orchestra.run.smithi154.stdout: mon host = "172.21.15.102,172.21.15.154,[v2:172.21.15.154:3301,v1:172.21.15.154:6790]" 2023-11-13T11:27:51.515 INFO:teuthology.orchestra.run.smithi154.stdout: fsid = 97b3eb2b-7ccf-4aae-8d92-bff986c671ea 2023-11-13T11:27:51.515 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-13T11:27:51.516 INFO:teuthology.orchestra.run.smithi154.stdout:[osd] 2023-11-13T11:27:51.516 INFO:teuthology.orchestra.run.smithi154.stdout: osd journal size = 100 2023-11-13T11:27:51.516 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-13T11:27:51.516 INFO:teuthology.orchestra.run.smithi154.stdout: osd scrub load threshold = 5.0 2023-11-13T11:27:51.516 INFO:teuthology.orchestra.run.smithi154.stdout: osd scrub max interval = 600 2023-11-13T11:27:51.517 INFO:teuthology.orchestra.run.smithi154.stdout: osd mclock profile = high_recovery_ops 2023-11-13T11:27:51.517 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-13T11:27:51.517 INFO:teuthology.orchestra.run.smithi154.stdout: osd recover clone overlap = true 2023-11-13T11:27:51.517 INFO:teuthology.orchestra.run.smithi154.stdout: osd recovery max chunk = 1048576 2023-11-13T11:27:51.517 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-13T11:27:51.517 INFO:teuthology.orchestra.run.smithi154.stdout: osd debug shutdown = true 2023-11-13T11:27:51.518 INFO:teuthology.orchestra.run.smithi154.stdout: osd debug op order = true 2023-11-13T11:27:51.518 INFO:teuthology.orchestra.run.smithi154.stdout: osd debug verify stray on activate = true 2023-11-13T11:27:51.518 INFO:teuthology.orchestra.run.smithi154.stdout: osd debug trim objects = true 2023-11-13T11:27:51.518 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-13T11:27:51.518 INFO:teuthology.orchestra.run.smithi154.stdout: osd open classes on start = true 2023-11-13T11:27:51.519 INFO:teuthology.orchestra.run.smithi154.stdout: osd debug pg log writeout = true 2023-11-13T11:27:51.519 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-13T11:27:51.519 INFO:teuthology.orchestra.run.smithi154.stdout: osd deep scrub update digest min age = 30 2023-11-13T11:27:51.519 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-13T11:27:51.519 INFO:teuthology.orchestra.run.smithi154.stdout: osd map max advance = 10 2023-11-13T11:27:51.520 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-13T11:27:51.520 INFO:teuthology.orchestra.run.smithi154.stdout: journal zero on create = true 2023-11-13T11:27:51.520 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-13T11:27:51.520 INFO:teuthology.orchestra.run.smithi154.stdout: filestore ondisk finisher threads = 3 2023-11-13T11:27:51.520 INFO:teuthology.orchestra.run.smithi154.stdout: filestore apply finisher threads = 3 2023-11-13T11:27:51.520 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-13T11:27:51.521 INFO:teuthology.orchestra.run.smithi154.stdout: bdev debug aio = true 2023-11-13T11:27:51.521 INFO:teuthology.orchestra.run.smithi154.stdout: osd debug misdirected ops = true 2023-11-13T11:27:51.521 INFO:teuthology.orchestra.run.smithi154.stdout: bdev async discard = True 2023-11-13T11:27:51.521 INFO:teuthology.orchestra.run.smithi154.stdout: bdev enable discard = True 2023-11-13T11:27:51.521 INFO:teuthology.orchestra.run.smithi154.stdout: bluestore allocator = bitmap 2023-11-13T11:27:51.522 INFO:teuthology.orchestra.run.smithi154.stdout: bluestore block size = 96636764160 2023-11-13T11:27:51.522 INFO:teuthology.orchestra.run.smithi154.stdout: bluestore fsck on mount = True 2023-11-13T11:27:51.522 INFO:teuthology.orchestra.run.smithi154.stdout: debug bluefs = 1/20 2023-11-13T11:27:51.522 INFO:teuthology.orchestra.run.smithi154.stdout: debug bluestore = 1/20 2023-11-13T11:27:51.522 INFO:teuthology.orchestra.run.smithi154.stdout: debug ms = 1 2023-11-13T11:27:51.523 INFO:teuthology.orchestra.run.smithi154.stdout: debug osd = 20 2023-11-13T11:27:51.523 INFO:teuthology.orchestra.run.smithi154.stdout: debug rocksdb = 4/10 2023-11-13T11:27:51.523 INFO:teuthology.orchestra.run.smithi154.stdout: mon osd backfillfull_ratio = 0.85 2023-11-13T11:27:51.523 INFO:teuthology.orchestra.run.smithi154.stdout: mon osd full ratio = 0.9 2023-11-13T11:27:51.523 INFO:teuthology.orchestra.run.smithi154.stdout: mon osd nearfull ratio = 0.8 2023-11-13T11:27:51.524 INFO:teuthology.orchestra.run.smithi154.stdout: osd failsafe full ratio = 0.95 2023-11-13T11:27:51.524 INFO:teuthology.orchestra.run.smithi154.stdout: osd objectstore = bluestore 2023-11-13T11:27:51.524 INFO:teuthology.orchestra.run.smithi154.stdout: osd op complaint time = 180 2023-11-13T11:27:51.524 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-13T11:27:51.524 INFO:teuthology.orchestra.run.smithi154.stdout:[mgr] 2023-11-13T11:27:51.524 INFO:teuthology.orchestra.run.smithi154.stdout: debug ms = 1 2023-11-13T11:27:51.525 INFO:teuthology.orchestra.run.smithi154.stdout: debug mgr = 20 2023-11-13T11:27:51.525 INFO:teuthology.orchestra.run.smithi154.stdout: debug mon = 20 2023-11-13T11:27:51.525 INFO:teuthology.orchestra.run.smithi154.stdout: debug auth = 20 2023-11-13T11:27:51.525 INFO:teuthology.orchestra.run.smithi154.stdout: mon reweight min pgs per osd = 4 2023-11-13T11:27:51.525 INFO:teuthology.orchestra.run.smithi154.stdout: mon reweight min bytes per osd = 10 2023-11-13T11:27:51.526 INFO:teuthology.orchestra.run.smithi154.stdout: mgr/telemetry/nag = false 2023-11-13T11:27:51.526 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-13T11:27:51.526 INFO:teuthology.orchestra.run.smithi154.stdout:[mon] 2023-11-13T11:27:51.526 INFO:teuthology.orchestra.run.smithi154.stdout: debug ms = 1 2023-11-13T11:27:51.527 INFO:teuthology.orchestra.run.smithi154.stdout: debug mon = 20 2023-11-13T11:27:51.527 INFO:teuthology.orchestra.run.smithi154.stdout: debug paxos = 20 2023-11-13T11:27:51.527 INFO:teuthology.orchestra.run.smithi154.stdout: debug auth = 20 2023-11-13T11:27:51.527 INFO:teuthology.orchestra.run.smithi154.stdout: mon data avail warn = 5 2023-11-13T11:27:51.527 INFO:teuthology.orchestra.run.smithi154.stdout: mon mgr mkfs grace = 240 2023-11-13T11:27:51.528 INFO:teuthology.orchestra.run.smithi154.stdout: mon reweight min pgs per osd = 4 2023-11-13T11:27:51.528 INFO:teuthology.orchestra.run.smithi154.stdout: mon osd reporter subtree level = osd 2023-11-13T11:27:51.528 INFO:teuthology.orchestra.run.smithi154.stdout: mon osd prime pg temp = true 2023-11-13T11:27:51.528 INFO:teuthology.orchestra.run.smithi154.stdout: mon reweight min bytes per osd = 10 2023-11-13T11:27:51.528 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-13T11:27:51.529 INFO:teuthology.orchestra.run.smithi154.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-11-13T11:27:51.529 INFO:teuthology.orchestra.run.smithi154.stdout: auth mon ticket ttl = 660 # 11m 2023-11-13T11:27:51.529 INFO:teuthology.orchestra.run.smithi154.stdout: auth service ticket ttl = 240 # 4m 2023-11-13T11:27:51.529 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-13T11:27:51.529 INFO:teuthology.orchestra.run.smithi154.stdout: # don't complain about insecure global_id in the test suite 2023-11-13T11:27:51.530 INFO:teuthology.orchestra.run.smithi154.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-11-13T11:27:51.530 INFO:teuthology.orchestra.run.smithi154.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-11-13T11:27:51.530 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-13T11:27:51.530 INFO:teuthology.orchestra.run.smithi154.stdout: # 1m isn't quite enough 2023-11-13T11:27:51.530 INFO:teuthology.orchestra.run.smithi154.stdout: mon_down_mkfs_grace = 2m 2023-11-13T11:27:51.531 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-13T11:27:51.531 INFO:teuthology.orchestra.run.smithi154.stdout: mon_warn_on_filestore_osds = false 2023-11-13T11:27:51.531 INFO:teuthology.orchestra.run.smithi154.stdout: mon op complaint time = 120 2023-11-13T11:27:51.531 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-13T11:27:51.532 INFO:teuthology.orchestra.run.smithi154.stdout:[client] 2023-11-13T11:27:51.532 INFO:teuthology.orchestra.run.smithi154.stdout: rgw cache enabled = true 2023-11-13T11:27:51.532 INFO:teuthology.orchestra.run.smithi154.stdout: rgw enable ops log = true 2023-11-13T11:27:51.532 INFO:teuthology.orchestra.run.smithi154.stdout: rgw enable usage log = true 2023-11-13T11:27:51.532 INFO:teuthology.orchestra.run.smithi154.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-11-13T11:27:51.533 INFO:teuthology.orchestra.run.smithi154.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-11-13T11:27:51.533 INFO:teuthology.orchestra.run.smithi154.stdout: client mount timeout = 600 2023-11-13T11:27:51.533 INFO:teuthology.orchestra.run.smithi154.stdout: debug client = 20 2023-11-13T11:27:51.533 INFO:teuthology.orchestra.run.smithi154.stdout: debug ms = 1 2023-11-13T11:27:51.533 INFO:teuthology.orchestra.run.smithi154.stdout: pid file = "" 2023-11-13T11:27:51.534 INFO:teuthology.orchestra.run.smithi154.stdout: rados mon op timeout = 900 2023-11-13T11:27:51.534 INFO:teuthology.orchestra.run.smithi154.stdout: rados osd op timeout = 900 2023-11-13T11:27:51.534 INFO:teuthology.orchestra.run.smithi154.stdout:[mon.a] 2023-11-13T11:27:51.534 INFO:teuthology.orchestra.run.smithi154.stdout:[mon.b] 2023-11-13T11:27:51.534 INFO:teuthology.orchestra.run.smithi154.stdout:[mon.c] 2023-11-13T11:27:51.535 INFO:teuthology.orchestra.run.smithi154.stdout:[mds.a] 2023-11-13T11:27:51.535 INFO:teuthology.orchestra.run.smithi154.stdout:[mds.c] 2023-11-13T11:27:51.535 INFO:teuthology.orchestra.run.smithi154.stdout:[mds.b] 2023-11-13T11:27:51.535 INFO:teuthology.orchestra.run.smithi154.stdout:[mds.d] 2023-11-13T11:27:51.535 INFO:teuthology.orchestra.run.smithi154.stdout:[mds] 2023-11-13T11:27:51.536 INFO:teuthology.orchestra.run.smithi154.stdout: debug mds = 20 2023-11-13T11:27:51.536 INFO:teuthology.orchestra.run.smithi154.stdout: debug mds balancer = 20 2023-11-13T11:27:51.536 INFO:teuthology.orchestra.run.smithi154.stdout: debug ms = 1 2023-11-13T11:27:51.536 INFO:teuthology.orchestra.run.smithi154.stdout: mds debug frag = True 2023-11-13T11:27:51.536 INFO:teuthology.orchestra.run.smithi154.stdout: mds debug scatterstat = True 2023-11-13T11:27:51.536 INFO:teuthology.orchestra.run.smithi154.stdout: mds op complaint time = 180 2023-11-13T11:27:51.537 INFO:teuthology.orchestra.run.smithi154.stdout: mds verify scatter = True 2023-11-13T11:27:51.537 INFO:teuthology.orchestra.run.smithi154.stdout: osd op complaint time = 180 2023-11-13T11:27:51.537 INFO:teuthology.orchestra.run.smithi154.stdout: rados mon op timeout = 900 2023-11-13T11:27:51.537 INFO:teuthology.orchestra.run.smithi154.stdout: rados osd op timeout = 900 2023-11-13T11:27:51.538 INFO:tasks.ceph:Creating admin key on mon.a... 2023-11-13T11:27:51.538 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2023-11-13T11:27:51.610 INFO:tasks.ceph:Copying monmap to all nodes... 2023-11-13T11:27:51.611 DEBUG:teuthology.orchestra.run.smithi102:> set -ex 2023-11-13T11:27:51.611 DEBUG:teuthology.orchestra.run.smithi102:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2023-11-13T11:27:51.623 DEBUG:teuthology.orchestra.run.smithi102:> set -ex 2023-11-13T11:27:51.623 DEBUG:teuthology.orchestra.run.smithi102:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2023-11-13T11:27:51.672 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi102.front.sepia.ceph.com 2023-11-13T11:27:51.673 DEBUG:teuthology.orchestra.run.smithi102:> set -ex 2023-11-13T11:27:51.673 DEBUG:teuthology.orchestra.run.smithi102:> sudo dd of=/etc/ceph/ceph.keyring 2023-11-13T11:27:51.673 DEBUG:teuthology.orchestra.run.smithi102:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-11-13T11:27:51.749 DEBUG:teuthology.orchestra.run.smithi102:> set -ex 2023-11-13T11:27:51.749 DEBUG:teuthology.orchestra.run.smithi102:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-11-13T11:27:51.801 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi154.front.sepia.ceph.com 2023-11-13T11:27:51.801 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2023-11-13T11:27:51.802 DEBUG:teuthology.orchestra.run.smithi154:> sudo dd of=/etc/ceph/ceph.keyring 2023-11-13T11:27:51.802 DEBUG:teuthology.orchestra.run.smithi154:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-11-13T11:27:51.838 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2023-11-13T11:27:51.838 DEBUG:teuthology.orchestra.run.smithi154:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-11-13T11:27:51.893 INFO:tasks.ceph:Setting up mon nodes... 2023-11-13T11:27:51.894 INFO:tasks.ceph:Setting up mgr nodes... 2023-11-13T11:27:51.894 DEBUG:teuthology.orchestra.run.smithi102:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2023-11-13T11:27:51.949 INFO:teuthology.orchestra.run.smithi102.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2023-11-13T11:27:51.954 DEBUG:teuthology.orchestra.run.smithi154:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2023-11-13T11:27:52.015 INFO:teuthology.orchestra.run.smithi154.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2023-11-13T11:27:52.033 INFO:tasks.ceph:Setting up mds nodes... 2023-11-13T11:27:52.034 DEBUG:teuthology.orchestra.run.smithi102:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2023-11-13T11:27:52.090 INFO:teuthology.orchestra.run.smithi102.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2023-11-13T11:27:52.094 DEBUG:teuthology.orchestra.run.smithi102:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2023-11-13T11:27:52.115 DEBUG:teuthology.orchestra.run.smithi102:> sudo mkdir -p /var/lib/ceph/mds/ceph-c && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.c /var/lib/ceph/mds/ceph-c/keyring 2023-11-13T11:27:52.215 INFO:teuthology.orchestra.run.smithi102.stdout:creating /var/lib/ceph/mds/ceph-c/keyring 2023-11-13T11:27:52.219 DEBUG:teuthology.orchestra.run.smithi102:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-c 2023-11-13T11:27:52.240 DEBUG:teuthology.orchestra.run.smithi154:> sudo mkdir -p /var/lib/ceph/mds/ceph-b && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.b /var/lib/ceph/mds/ceph-b/keyring 2023-11-13T11:27:52.301 INFO:teuthology.orchestra.run.smithi154.stdout:creating /var/lib/ceph/mds/ceph-b/keyring 2023-11-13T11:27:52.306 DEBUG:teuthology.orchestra.run.smithi154:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-b 2023-11-13T11:27:52.327 DEBUG:teuthology.orchestra.run.smithi154:> sudo mkdir -p /var/lib/ceph/mds/ceph-d && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.d /var/lib/ceph/mds/ceph-d/keyring 2023-11-13T11:27:52.430 INFO:teuthology.orchestra.run.smithi154.stdout:creating /var/lib/ceph/mds/ceph-d/keyring 2023-11-13T11:27:52.435 DEBUG:teuthology.orchestra.run.smithi154:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-d 2023-11-13T11:27:52.456 INFO:tasks.ceph_client:Setting up client nodes... 2023-11-13T11:27:52.456 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2023-11-13T11:27:52.500 INFO:teuthology.orchestra.run.smithi102.stdout:creating /etc/ceph/ceph.client.0.keyring 2023-11-13T11:27:52.518 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.2 /etc/ceph/ceph.client.2.keyring && sudo chmod 0644 /etc/ceph/ceph.client.2.keyring 2023-11-13T11:27:52.603 INFO:teuthology.orchestra.run.smithi102.stdout:creating /etc/ceph/ceph.client.2.keyring 2023-11-13T11:27:52.620 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/ceph.client.1.keyring && sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2023-11-13T11:27:52.662 INFO:teuthology.orchestra.run.smithi154.stdout:creating /etc/ceph/ceph.client.1.keyring 2023-11-13T11:27:52.679 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.3 /etc/ceph/ceph.client.3.keyring && sudo chmod 0644 /etc/ceph/ceph.client.3.keyring 2023-11-13T11:27:52.764 INFO:teuthology.orchestra.run.smithi154.stdout:creating /etc/ceph/ceph.client.3.keyring 2023-11-13T11:27:52.781 INFO:tasks.ceph:Running mkfs on osd nodes... 2023-11-13T11:27:52.781 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi102.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi154.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2023-11-13T11:27:52.782 DEBUG:teuthology.orchestra.run.smithi102:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2023-11-13T11:27:52.802 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-11-13T11:27:52.803 INFO:tasks.ceph:role: osd.0 2023-11-13T11:27:52.803 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi102.front.sepia.ceph.com 2023-11-13T11:27:52.803 DEBUG:teuthology.orchestra.run.smithi102:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2023-11-13T11:27:52.876 INFO:teuthology.orchestra.run.smithi102.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2023-11-13T11:27:52.876 INFO:teuthology.orchestra.run.smithi102.stdout: = sectsz=512 attr=2, projid32bit=1 2023-11-13T11:27:52.876 INFO:teuthology.orchestra.run.smithi102.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-11-13T11:27:52.877 INFO:teuthology.orchestra.run.smithi102.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-11-13T11:27:52.877 INFO:teuthology.orchestra.run.smithi102.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-11-13T11:27:52.877 INFO:teuthology.orchestra.run.smithi102.stdout: = sunit=0 swidth=0 blks 2023-11-13T11:27:52.877 INFO:teuthology.orchestra.run.smithi102.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-11-13T11:27:52.877 INFO:teuthology.orchestra.run.smithi102.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-11-13T11:27:52.878 INFO:teuthology.orchestra.run.smithi102.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-11-13T11:27:52.878 INFO:teuthology.orchestra.run.smithi102.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-11-13T11:27:53.331 INFO:teuthology.orchestra.run.smithi102.stdout:Discarding blocks...Done. 2023-11-13T11:27:53.334 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi102.front.sepia.ceph.com -o noatime 2023-11-13T11:27:53.334 DEBUG:teuthology.orchestra.run.smithi102:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2023-11-13T11:27:53.435 DEBUG:teuthology.orchestra.run.smithi102:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2023-11-13T11:27:53.452 INFO:teuthology.orchestra.run.smithi102.stderr:sudo: /sbin/restorecon: command not found 2023-11-13T11:27:53.452 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-13T11:27:53.453 DEBUG:teuthology.orchestra.run.smithi102:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2023-11-13T11:27:53.517 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-11-13T11:27:53.517 INFO:tasks.ceph:role: osd.1 2023-11-13T11:27:53.517 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi102.front.sepia.ceph.com 2023-11-13T11:27:53.518 DEBUG:teuthology.orchestra.run.smithi102:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2023-11-13T11:27:53.592 INFO:teuthology.orchestra.run.smithi102.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2023-11-13T11:27:53.592 INFO:teuthology.orchestra.run.smithi102.stdout: = sectsz=512 attr=2, projid32bit=1 2023-11-13T11:27:53.593 INFO:teuthology.orchestra.run.smithi102.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-11-13T11:27:53.593 INFO:teuthology.orchestra.run.smithi102.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-11-13T11:27:53.593 INFO:teuthology.orchestra.run.smithi102.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-11-13T11:27:53.593 INFO:teuthology.orchestra.run.smithi102.stdout: = sunit=0 swidth=0 blks 2023-11-13T11:27:53.593 INFO:teuthology.orchestra.run.smithi102.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-11-13T11:27:53.594 INFO:teuthology.orchestra.run.smithi102.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-11-13T11:27:53.594 INFO:teuthology.orchestra.run.smithi102.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-11-13T11:27:53.594 INFO:teuthology.orchestra.run.smithi102.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-11-13T11:27:54.085 INFO:teuthology.orchestra.run.smithi102.stdout:Discarding blocks...Done. 2023-11-13T11:27:54.088 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi102.front.sepia.ceph.com -o noatime 2023-11-13T11:27:54.088 DEBUG:teuthology.orchestra.run.smithi102:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2023-11-13T11:27:54.231 DEBUG:teuthology.orchestra.run.smithi102:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2023-11-13T11:27:54.249 INFO:teuthology.orchestra.run.smithi102.stderr:sudo: /sbin/restorecon: command not found 2023-11-13T11:27:54.250 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-13T11:27:54.251 DEBUG:teuthology.orchestra.run.smithi102:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2023-11-13T11:27:54.313 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-11-13T11:27:54.314 INFO:tasks.ceph:role: osd.2 2023-11-13T11:27:54.314 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi102.front.sepia.ceph.com 2023-11-13T11:27:54.314 DEBUG:teuthology.orchestra.run.smithi102:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2023-11-13T11:27:54.386 INFO:teuthology.orchestra.run.smithi102.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2023-11-13T11:27:54.386 INFO:teuthology.orchestra.run.smithi102.stdout: = sectsz=512 attr=2, projid32bit=1 2023-11-13T11:27:54.386 INFO:teuthology.orchestra.run.smithi102.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-11-13T11:27:54.387 INFO:teuthology.orchestra.run.smithi102.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-11-13T11:27:54.387 INFO:teuthology.orchestra.run.smithi102.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-11-13T11:27:54.387 INFO:teuthology.orchestra.run.smithi102.stdout: = sunit=0 swidth=0 blks 2023-11-13T11:27:54.387 INFO:teuthology.orchestra.run.smithi102.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-11-13T11:27:54.387 INFO:teuthology.orchestra.run.smithi102.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-11-13T11:27:54.388 INFO:teuthology.orchestra.run.smithi102.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-11-13T11:27:54.388 INFO:teuthology.orchestra.run.smithi102.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-11-13T11:27:54.866 INFO:teuthology.orchestra.run.smithi102.stdout:Discarding blocks...Done. 2023-11-13T11:27:54.869 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi102.front.sepia.ceph.com -o noatime 2023-11-13T11:27:54.870 DEBUG:teuthology.orchestra.run.smithi102:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2023-11-13T11:27:55.005 DEBUG:teuthology.orchestra.run.smithi102:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2023-11-13T11:27:55.022 INFO:teuthology.orchestra.run.smithi102.stderr:sudo: /sbin/restorecon: command not found 2023-11-13T11:27:55.023 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-13T11:27:55.024 DEBUG:teuthology.orchestra.run.smithi102:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2023-11-13T11:27:55.086 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-11-13T11:27:55.087 INFO:tasks.ceph:role: osd.3 2023-11-13T11:27:55.087 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi102.front.sepia.ceph.com 2023-11-13T11:27:55.087 DEBUG:teuthology.orchestra.run.smithi102:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2023-11-13T11:27:55.161 INFO:teuthology.orchestra.run.smithi102.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2023-11-13T11:27:55.162 INFO:teuthology.orchestra.run.smithi102.stdout: = sectsz=512 attr=2, projid32bit=1 2023-11-13T11:27:55.162 INFO:teuthology.orchestra.run.smithi102.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-11-13T11:27:55.162 INFO:teuthology.orchestra.run.smithi102.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-11-13T11:27:55.162 INFO:teuthology.orchestra.run.smithi102.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-11-13T11:27:55.162 INFO:teuthology.orchestra.run.smithi102.stdout: = sunit=0 swidth=0 blks 2023-11-13T11:27:55.163 INFO:teuthology.orchestra.run.smithi102.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-11-13T11:27:55.163 INFO:teuthology.orchestra.run.smithi102.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-11-13T11:27:55.163 INFO:teuthology.orchestra.run.smithi102.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-11-13T11:27:55.163 INFO:teuthology.orchestra.run.smithi102.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-11-13T11:27:55.606 INFO:teuthology.orchestra.run.smithi102.stdout:Discarding blocks...Done. 2023-11-13T11:27:55.609 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi102.front.sepia.ceph.com -o noatime 2023-11-13T11:27:55.609 DEBUG:teuthology.orchestra.run.smithi102:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2023-11-13T11:27:55.723 DEBUG:teuthology.orchestra.run.smithi102:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2023-11-13T11:27:55.740 INFO:teuthology.orchestra.run.smithi102.stderr:sudo: /sbin/restorecon: command not found 2023-11-13T11:27:55.741 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-13T11:27:55.741 DEBUG:teuthology.orchestra.run.smithi102:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-11-13T11:27:55.895 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:27:55.890+0000 7fc0b9dfd640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2023-11-13T11:27:55.901 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:27:55.894+0000 7fc0b9dfd640 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2023-11-13T11:27:55.901 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:27:55.894+0000 7fc0b9dfd640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-11-13T11:27:55.901 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:27:55.894+0000 7fc0b9dfd640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-11-13T11:27:55.901 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:27:55.894+0000 7fc0b9dfd640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-11-13T11:27:55.903 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:27:55.898+0000 7fc0b9dfd640 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2023-11-13T11:27:58.885 DEBUG:teuthology.orchestra.run.smithi102:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2023-11-13T11:27:58.908 DEBUG:teuthology.orchestra.run.smithi102:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-11-13T11:27:59.007 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:27:59.002+0000 7f4318b19640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2023-11-13T11:27:59.009 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:27:59.002+0000 7f4318b19640 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2023-11-13T11:27:59.009 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:27:59.002+0000 7f4318b19640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-11-13T11:27:59.009 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:27:59.002+0000 7f4318b19640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-11-13T11:27:59.009 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:27:59.002+0000 7f4318b19640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-11-13T11:27:59.010 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:27:59.006+0000 7f4318b19640 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2023-11-13T11:28:02.005 DEBUG:teuthology.orchestra.run.smithi102:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2023-11-13T11:28:02.026 DEBUG:teuthology.orchestra.run.smithi102:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-11-13T11:28:02.124 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:02.118+0000 7f6a0462d640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2023-11-13T11:28:02.125 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:02.122+0000 7f6a0462d640 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2023-11-13T11:28:02.125 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:02.122+0000 7f6a0462d640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-11-13T11:28:02.125 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:02.122+0000 7f6a0462d640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-11-13T11:28:02.126 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:02.122+0000 7f6a0462d640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-11-13T11:28:02.126 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:02.122+0000 7f6a0462d640 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2023-11-13T11:28:05.112 DEBUG:teuthology.orchestra.run.smithi102:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2023-11-13T11:28:05.133 DEBUG:teuthology.orchestra.run.smithi102:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-11-13T11:28:05.237 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:05.230+0000 7f33d0eba640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2023-11-13T11:28:05.237 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:05.230+0000 7f33d0eba640 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2023-11-13T11:28:05.237 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:05.230+0000 7f33d0eba640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-11-13T11:28:05.238 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:05.230+0000 7f33d0eba640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-11-13T11:28:05.238 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:05.230+0000 7f33d0eba640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-11-13T11:28:05.238 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:05.234+0000 7f33d0eba640 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2023-11-13T11:28:08.228 DEBUG:teuthology.orchestra.run.smithi102:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2023-11-13T11:28:08.251 DEBUG:teuthology.orchestra.run.smithi154:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2023-11-13T11:28:08.274 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-11-13T11:28:08.275 INFO:tasks.ceph:role: osd.4 2023-11-13T11:28:08.275 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi154.front.sepia.ceph.com 2023-11-13T11:28:08.276 DEBUG:teuthology.orchestra.run.smithi154:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2023-11-13T11:28:08.345 INFO:teuthology.orchestra.run.smithi154.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2023-11-13T11:28:08.346 INFO:teuthology.orchestra.run.smithi154.stdout: = sectsz=512 attr=2, projid32bit=1 2023-11-13T11:28:08.346 INFO:teuthology.orchestra.run.smithi154.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-11-13T11:28:08.346 INFO:teuthology.orchestra.run.smithi154.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-11-13T11:28:08.346 INFO:teuthology.orchestra.run.smithi154.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-11-13T11:28:08.347 INFO:teuthology.orchestra.run.smithi154.stdout: = sunit=0 swidth=0 blks 2023-11-13T11:28:08.347 INFO:teuthology.orchestra.run.smithi154.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-11-13T11:28:08.348 INFO:teuthology.orchestra.run.smithi154.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-11-13T11:28:08.348 INFO:teuthology.orchestra.run.smithi154.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-11-13T11:28:08.348 INFO:teuthology.orchestra.run.smithi154.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-11-13T11:28:08.806 INFO:teuthology.orchestra.run.smithi154.stdout:Discarding blocks...Done. 2023-11-13T11:28:08.808 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi154.front.sepia.ceph.com -o noatime 2023-11-13T11:28:08.809 DEBUG:teuthology.orchestra.run.smithi154:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2023-11-13T11:28:08.924 DEBUG:teuthology.orchestra.run.smithi154:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2023-11-13T11:28:08.943 INFO:teuthology.orchestra.run.smithi154.stderr:sudo: /sbin/restorecon: command not found 2023-11-13T11:28:08.944 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-13T11:28:08.945 DEBUG:teuthology.orchestra.run.smithi154:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2023-11-13T11:28:09.015 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-11-13T11:28:09.015 INFO:tasks.ceph:role: osd.5 2023-11-13T11:28:09.015 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi154.front.sepia.ceph.com 2023-11-13T11:28:09.016 DEBUG:teuthology.orchestra.run.smithi154:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2023-11-13T11:28:09.087 INFO:teuthology.orchestra.run.smithi154.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2023-11-13T11:28:09.088 INFO:teuthology.orchestra.run.smithi154.stdout: = sectsz=512 attr=2, projid32bit=1 2023-11-13T11:28:09.088 INFO:teuthology.orchestra.run.smithi154.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-11-13T11:28:09.089 INFO:teuthology.orchestra.run.smithi154.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-11-13T11:28:09.089 INFO:teuthology.orchestra.run.smithi154.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-11-13T11:28:09.089 INFO:teuthology.orchestra.run.smithi154.stdout: = sunit=0 swidth=0 blks 2023-11-13T11:28:09.090 INFO:teuthology.orchestra.run.smithi154.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-11-13T11:28:09.090 INFO:teuthology.orchestra.run.smithi154.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-11-13T11:28:09.090 INFO:teuthology.orchestra.run.smithi154.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-11-13T11:28:09.091 INFO:teuthology.orchestra.run.smithi154.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-11-13T11:28:09.582 INFO:teuthology.orchestra.run.smithi154.stdout:Discarding blocks...Done. 2023-11-13T11:28:09.585 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi154.front.sepia.ceph.com -o noatime 2023-11-13T11:28:09.585 DEBUG:teuthology.orchestra.run.smithi154:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2023-11-13T11:28:09.731 DEBUG:teuthology.orchestra.run.smithi154:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2023-11-13T11:28:09.750 INFO:teuthology.orchestra.run.smithi154.stderr:sudo: /sbin/restorecon: command not found 2023-11-13T11:28:09.751 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-13T11:28:09.752 DEBUG:teuthology.orchestra.run.smithi154:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2023-11-13T11:28:09.815 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-11-13T11:28:09.816 INFO:tasks.ceph:role: osd.6 2023-11-13T11:28:09.817 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi154.front.sepia.ceph.com 2023-11-13T11:28:09.817 DEBUG:teuthology.orchestra.run.smithi154:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2023-11-13T11:28:09.887 INFO:teuthology.orchestra.run.smithi154.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2023-11-13T11:28:09.887 INFO:teuthology.orchestra.run.smithi154.stdout: = sectsz=512 attr=2, projid32bit=1 2023-11-13T11:28:09.887 INFO:teuthology.orchestra.run.smithi154.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-11-13T11:28:09.888 INFO:teuthology.orchestra.run.smithi154.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-11-13T11:28:09.888 INFO:teuthology.orchestra.run.smithi154.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-11-13T11:28:09.888 INFO:teuthology.orchestra.run.smithi154.stdout: = sunit=0 swidth=0 blks 2023-11-13T11:28:09.888 INFO:teuthology.orchestra.run.smithi154.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-11-13T11:28:09.888 INFO:teuthology.orchestra.run.smithi154.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-11-13T11:28:09.889 INFO:teuthology.orchestra.run.smithi154.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-11-13T11:28:09.889 INFO:teuthology.orchestra.run.smithi154.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-11-13T11:28:10.371 INFO:teuthology.orchestra.run.smithi154.stdout:Discarding blocks...Done. 2023-11-13T11:28:10.375 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi154.front.sepia.ceph.com -o noatime 2023-11-13T11:28:10.376 DEBUG:teuthology.orchestra.run.smithi154:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2023-11-13T11:28:10.487 DEBUG:teuthology.orchestra.run.smithi154:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2023-11-13T11:28:10.506 INFO:teuthology.orchestra.run.smithi154.stderr:sudo: /sbin/restorecon: command not found 2023-11-13T11:28:10.506 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-13T11:28:10.507 DEBUG:teuthology.orchestra.run.smithi154:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2023-11-13T11:28:10.575 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-11-13T11:28:10.575 INFO:tasks.ceph:role: osd.7 2023-11-13T11:28:10.576 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi154.front.sepia.ceph.com 2023-11-13T11:28:10.576 DEBUG:teuthology.orchestra.run.smithi154:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2023-11-13T11:28:10.646 INFO:teuthology.orchestra.run.smithi154.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2023-11-13T11:28:10.646 INFO:teuthology.orchestra.run.smithi154.stdout: = sectsz=512 attr=2, projid32bit=1 2023-11-13T11:28:10.646 INFO:teuthology.orchestra.run.smithi154.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-11-13T11:28:10.647 INFO:teuthology.orchestra.run.smithi154.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-11-13T11:28:10.647 INFO:teuthology.orchestra.run.smithi154.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-11-13T11:28:10.647 INFO:teuthology.orchestra.run.smithi154.stdout: = sunit=0 swidth=0 blks 2023-11-13T11:28:10.647 INFO:teuthology.orchestra.run.smithi154.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-11-13T11:28:10.647 INFO:teuthology.orchestra.run.smithi154.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-11-13T11:28:10.648 INFO:teuthology.orchestra.run.smithi154.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-11-13T11:28:10.648 INFO:teuthology.orchestra.run.smithi154.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-11-13T11:28:11.093 INFO:teuthology.orchestra.run.smithi154.stdout:Discarding blocks...Done. 2023-11-13T11:28:11.096 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi154.front.sepia.ceph.com -o noatime 2023-11-13T11:28:11.097 DEBUG:teuthology.orchestra.run.smithi154:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2023-11-13T11:28:11.205 DEBUG:teuthology.orchestra.run.smithi154:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2023-11-13T11:28:11.226 INFO:teuthology.orchestra.run.smithi154.stderr:sudo: /sbin/restorecon: command not found 2023-11-13T11:28:11.227 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-13T11:28:11.228 DEBUG:teuthology.orchestra.run.smithi154:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-11-13T11:28:11.356 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-13T11:28:11.350+0000 7f842342c640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2023-11-13T11:28:11.360 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-13T11:28:11.354+0000 7f842342c640 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2023-11-13T11:28:11.360 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-13T11:28:11.354+0000 7f842342c640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-11-13T11:28:11.360 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-13T11:28:11.354+0000 7f842342c640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-11-13T11:28:11.360 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-13T11:28:11.354+0000 7f842342c640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-11-13T11:28:11.363 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-13T11:28:11.358+0000 7f842342c640 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2023-11-13T11:28:14.358 DEBUG:teuthology.orchestra.run.smithi154:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2023-11-13T11:28:14.380 DEBUG:teuthology.orchestra.run.smithi154:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-11-13T11:28:14.477 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-13T11:28:14.470+0000 7f04c8ef3640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2023-11-13T11:28:14.477 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-13T11:28:14.470+0000 7f04c8ef3640 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2023-11-13T11:28:14.478 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-13T11:28:14.470+0000 7f04c8ef3640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-11-13T11:28:14.478 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-13T11:28:14.470+0000 7f04c8ef3640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-11-13T11:28:14.478 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-13T11:28:14.470+0000 7f04c8ef3640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-11-13T11:28:14.479 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-13T11:28:14.474+0000 7f04c8ef3640 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2023-11-13T11:28:17.477 DEBUG:teuthology.orchestra.run.smithi154:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2023-11-13T11:28:17.498 DEBUG:teuthology.orchestra.run.smithi154:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-11-13T11:28:17.596 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-13T11:28:17.590+0000 7fc6e3988640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2023-11-13T11:28:17.597 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-13T11:28:17.590+0000 7fc6e3988640 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2023-11-13T11:28:17.597 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-13T11:28:17.590+0000 7fc6e3988640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-11-13T11:28:17.597 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-13T11:28:17.590+0000 7fc6e3988640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-11-13T11:28:17.597 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-13T11:28:17.590+0000 7fc6e3988640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-11-13T11:28:17.598 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-13T11:28:17.594+0000 7fc6e3988640 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2023-11-13T11:28:19.520 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T11:28:19.524 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T11:28:20.612 DEBUG:teuthology.orchestra.run.smithi154:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2023-11-13T11:28:20.633 DEBUG:teuthology.orchestra.run.smithi154:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-11-13T11:28:20.732 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-13T11:28:20.726+0000 7f89eee72640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2023-11-13T11:28:20.734 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-13T11:28:20.726+0000 7f89eee72640 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2023-11-13T11:28:20.734 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-13T11:28:20.726+0000 7f89eee72640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-11-13T11:28:20.734 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-13T11:28:20.726+0000 7f89eee72640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-11-13T11:28:20.734 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-13T11:28:20.726+0000 7f89eee72640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-11-13T11:28:20.735 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-13T11:28:20.730+0000 7f89eee72640 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2023-11-13T11:28:23.715 DEBUG:teuthology.orchestra.run.smithi154:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2023-11-13T11:28:23.736 INFO:tasks.ceph:Reading keys from all nodes... 2023-11-13T11:28:23.737 DEBUG:teuthology.orchestra.run.smithi102:> set -ex 2023-11-13T11:28:23.737 DEBUG:teuthology.orchestra.run.smithi102:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2023-11-13T11:28:23.760 DEBUG:teuthology.orchestra.run.smithi102:> set -ex 2023-11-13T11:28:23.760 DEBUG:teuthology.orchestra.run.smithi102:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2023-11-13T11:28:23.821 DEBUG:teuthology.orchestra.run.smithi102:> set -ex 2023-11-13T11:28:23.821 DEBUG:teuthology.orchestra.run.smithi102:> sudo dd if=/var/lib/ceph/mds/ceph-c/keyring of=/dev/stdout 2023-11-13T11:28:23.885 DEBUG:teuthology.orchestra.run.smithi102:> set -ex 2023-11-13T11:28:23.885 DEBUG:teuthology.orchestra.run.smithi102:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2023-11-13T11:28:23.948 DEBUG:teuthology.orchestra.run.smithi102:> set -ex 2023-11-13T11:28:23.949 DEBUG:teuthology.orchestra.run.smithi102:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2023-11-13T11:28:24.016 DEBUG:teuthology.orchestra.run.smithi102:> set -ex 2023-11-13T11:28:24.017 DEBUG:teuthology.orchestra.run.smithi102:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2023-11-13T11:28:24.084 DEBUG:teuthology.orchestra.run.smithi102:> set -ex 2023-11-13T11:28:24.085 DEBUG:teuthology.orchestra.run.smithi102:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2023-11-13T11:28:24.148 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2023-11-13T11:28:24.149 DEBUG:teuthology.orchestra.run.smithi154:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2023-11-13T11:28:24.170 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2023-11-13T11:28:24.170 DEBUG:teuthology.orchestra.run.smithi154:> sudo dd if=/var/lib/ceph/mds/ceph-b/keyring of=/dev/stdout 2023-11-13T11:28:24.233 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2023-11-13T11:28:24.233 DEBUG:teuthology.orchestra.run.smithi154:> sudo dd if=/var/lib/ceph/mds/ceph-d/keyring of=/dev/stdout 2023-11-13T11:28:24.299 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2023-11-13T11:28:24.299 DEBUG:teuthology.orchestra.run.smithi154:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2023-11-13T11:28:24.365 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2023-11-13T11:28:24.366 DEBUG:teuthology.orchestra.run.smithi154:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2023-11-13T11:28:24.429 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2023-11-13T11:28:24.430 DEBUG:teuthology.orchestra.run.smithi154:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2023-11-13T11:28:24.494 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2023-11-13T11:28:24.494 DEBUG:teuthology.orchestra.run.smithi154:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2023-11-13T11:28:24.557 DEBUG:teuthology.orchestra.run.smithi102:> set -ex 2023-11-13T11:28:24.557 DEBUG:teuthology.orchestra.run.smithi102:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2023-11-13T11:28:24.567 DEBUG:teuthology.orchestra.run.smithi102:> set -ex 2023-11-13T11:28:24.567 DEBUG:teuthology.orchestra.run.smithi102:> dd if=/etc/ceph/ceph.client.2.keyring of=/dev/stdout 2023-11-13T11:28:24.617 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2023-11-13T11:28:24.617 DEBUG:teuthology.orchestra.run.smithi154:> dd if=/etc/ceph/ceph.client.1.keyring of=/dev/stdout 2023-11-13T11:28:24.627 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2023-11-13T11:28:24.627 DEBUG:teuthology.orchestra.run.smithi154:> dd if=/etc/ceph/ceph.client.3.keyring of=/dev/stdout 2023-11-13T11:28:24.681 INFO:tasks.ceph:Adding keys to all mons... 2023-11-13T11:28:24.682 DEBUG:teuthology.orchestra.run.smithi102:> sudo tee -a /etc/ceph/ceph.keyring 2023-11-13T11:28:24.685 DEBUG:teuthology.orchestra.run.smithi154:> sudo tee -a /etc/ceph/ceph.keyring 2023-11-13T11:28:24.729 INFO:teuthology.orchestra.run.smithi102.stdout:[mgr.y] 2023-11-13T11:28:24.729 INFO:teuthology.orchestra.run.smithi102.stdout: key = AQA3CFJlBW+UOBAAq/Q6BMOG8BqhQfgScI+IFw== 2023-11-13T11:28:24.729 INFO:teuthology.orchestra.run.smithi102.stdout:[mds.a] 2023-11-13T11:28:24.730 INFO:teuthology.orchestra.run.smithi102.stdout: key = AQA4CFJl7F5cBRAAmR6QoqWujj7xEB2F594TOQ== 2023-11-13T11:28:24.730 INFO:teuthology.orchestra.run.smithi102.stdout:[mds.c] 2023-11-13T11:28:24.730 INFO:teuthology.orchestra.run.smithi102.stdout: key = AQA4CFJlp+bJDBAAJVNL/tAnvXTkNqdqeJbT9w== 2023-11-13T11:28:24.730 INFO:teuthology.orchestra.run.smithi102.stdout:[osd.0] 2023-11-13T11:28:24.731 INFO:teuthology.orchestra.run.smithi102.stdout: key = AQA7CFJlUupYNRAAZyoKBEduTZIysbwHQzrSag== 2023-11-13T11:28:24.731 INFO:teuthology.orchestra.run.smithi102.stdout:[osd.1] 2023-11-13T11:28:24.731 INFO:teuthology.orchestra.run.smithi102.stdout: key = AQA/CFJlUnxvABAABNod7jDUWVe64fEwtHMb9w== 2023-11-13T11:28:24.731 INFO:teuthology.orchestra.run.smithi102.stdout:[osd.2] 2023-11-13T11:28:24.731 INFO:teuthology.orchestra.run.smithi102.stdout: key = AQBCCFJlYhdbBxAAYTzu9d9ofGtmfvMfedtmTw== 2023-11-13T11:28:24.732 INFO:teuthology.orchestra.run.smithi102.stdout:[osd.3] 2023-11-13T11:28:24.732 INFO:teuthology.orchestra.run.smithi102.stdout: key = AQBFCFJlZbUKDhAAwtM/e4oDPF5sztblOH77uQ== 2023-11-13T11:28:24.732 INFO:teuthology.orchestra.run.smithi102.stdout:[mgr.x] 2023-11-13T11:28:24.732 INFO:teuthology.orchestra.run.smithi102.stdout: key = AQA4CFJll6/mABAAiasnzrTfVz84ZR3TWn1dfw== 2023-11-13T11:28:24.732 INFO:teuthology.orchestra.run.smithi102.stdout:[mds.b] 2023-11-13T11:28:24.732 INFO:teuthology.orchestra.run.smithi102.stdout: key = AQA4CFJlDRD4ERAAH1DZyCXwbycSRrc5HuGQhg== 2023-11-13T11:28:24.733 INFO:teuthology.orchestra.run.smithi102.stdout:[mds.d] 2023-11-13T11:28:24.733 INFO:teuthology.orchestra.run.smithi102.stdout: key = AQA4CFJlrPOqGRAAilDvVa/CQc6sEAmBy2KElw== 2023-11-13T11:28:24.733 INFO:teuthology.orchestra.run.smithi102.stdout:[osd.4] 2023-11-13T11:28:24.733 INFO:teuthology.orchestra.run.smithi102.stdout: key = AQBLCFJlYKE5FRAAJdvXzuMVHeeaCw5jYQdClQ== 2023-11-13T11:28:24.734 INFO:teuthology.orchestra.run.smithi102.stdout:[osd.5] 2023-11-13T11:28:24.734 INFO:teuthology.orchestra.run.smithi102.stdout: key = AQBOCFJlVX5tHBAANS/0oCJ85BV7fWKU/YkehA== 2023-11-13T11:28:24.734 INFO:teuthology.orchestra.run.smithi102.stdout:[osd.6] 2023-11-13T11:28:24.734 INFO:teuthology.orchestra.run.smithi102.stdout: key = AQBRCFJlYuKJIxAAWvYLo7/JBcfEtOd3Uf+E1w== 2023-11-13T11:28:24.734 INFO:teuthology.orchestra.run.smithi102.stdout:[osd.7] 2023-11-13T11:28:24.735 INFO:teuthology.orchestra.run.smithi102.stdout: key = AQBUCFJlohOuKxAA3UTlSgmg0xLcZg0xENEuCg== 2023-11-13T11:28:24.735 INFO:teuthology.orchestra.run.smithi102.stdout:[client.0] 2023-11-13T11:28:24.735 INFO:teuthology.orchestra.run.smithi102.stdout: key = AQA4CFJlCrzJHRAAifnfqFe57iLwnoWmhavnMA== 2023-11-13T11:28:24.736 INFO:teuthology.orchestra.run.smithi102.stdout:[client.2] 2023-11-13T11:28:24.736 INFO:teuthology.orchestra.run.smithi102.stdout: key = AQA4CFJlS13vIxAAnXgB5W2MZzaQsqMhrplKAA== 2023-11-13T11:28:24.736 INFO:teuthology.orchestra.run.smithi102.stdout:[client.1] 2023-11-13T11:28:24.736 INFO:teuthology.orchestra.run.smithi102.stdout: key = AQA4CFJlKSR/JxAAfL/MN+5b3AbDF3C3G2VsGw== 2023-11-13T11:28:24.736 INFO:teuthology.orchestra.run.smithi102.stdout:[client.3] 2023-11-13T11:28:24.738 INFO:teuthology.orchestra.run.smithi102.stdout: key = AQA4CFJlf8yILRAAN9OTWaqlZBaTfkTPvpoO/g== 2023-11-13T11:28:24.745 INFO:teuthology.orchestra.run.smithi154.stdout:[mgr.y] 2023-11-13T11:28:24.745 INFO:teuthology.orchestra.run.smithi154.stdout: key = AQA3CFJlBW+UOBAAq/Q6BMOG8BqhQfgScI+IFw== 2023-11-13T11:28:24.745 INFO:teuthology.orchestra.run.smithi154.stdout:[mds.a] 2023-11-13T11:28:24.746 INFO:teuthology.orchestra.run.smithi154.stdout: key = AQA4CFJl7F5cBRAAmR6QoqWujj7xEB2F594TOQ== 2023-11-13T11:28:24.746 INFO:teuthology.orchestra.run.smithi154.stdout:[mds.c] 2023-11-13T11:28:24.746 INFO:teuthology.orchestra.run.smithi154.stdout: key = AQA4CFJlp+bJDBAAJVNL/tAnvXTkNqdqeJbT9w== 2023-11-13T11:28:24.746 INFO:teuthology.orchestra.run.smithi154.stdout:[osd.0] 2023-11-13T11:28:24.747 INFO:teuthology.orchestra.run.smithi154.stdout: key = AQA7CFJlUupYNRAAZyoKBEduTZIysbwHQzrSag== 2023-11-13T11:28:24.747 INFO:teuthology.orchestra.run.smithi154.stdout:[osd.1] 2023-11-13T11:28:24.747 INFO:teuthology.orchestra.run.smithi154.stdout: key = AQA/CFJlUnxvABAABNod7jDUWVe64fEwtHMb9w== 2023-11-13T11:28:24.747 INFO:teuthology.orchestra.run.smithi154.stdout:[osd.2] 2023-11-13T11:28:24.747 INFO:teuthology.orchestra.run.smithi154.stdout: key = AQBCCFJlYhdbBxAAYTzu9d9ofGtmfvMfedtmTw== 2023-11-13T11:28:24.747 INFO:teuthology.orchestra.run.smithi154.stdout:[osd.3] 2023-11-13T11:28:24.748 INFO:teuthology.orchestra.run.smithi154.stdout: key = AQBFCFJlZbUKDhAAwtM/e4oDPF5sztblOH77uQ== 2023-11-13T11:28:24.748 INFO:teuthology.orchestra.run.smithi154.stdout:[mgr.x] 2023-11-13T11:28:24.748 INFO:teuthology.orchestra.run.smithi154.stdout: key = AQA4CFJll6/mABAAiasnzrTfVz84ZR3TWn1dfw== 2023-11-13T11:28:24.748 INFO:teuthology.orchestra.run.smithi154.stdout:[mds.b] 2023-11-13T11:28:24.749 INFO:teuthology.orchestra.run.smithi154.stdout: key = AQA4CFJlDRD4ERAAH1DZyCXwbycSRrc5HuGQhg== 2023-11-13T11:28:24.749 INFO:teuthology.orchestra.run.smithi154.stdout:[mds.d] 2023-11-13T11:28:24.749 INFO:teuthology.orchestra.run.smithi154.stdout: key = AQA4CFJlrPOqGRAAilDvVa/CQc6sEAmBy2KElw== 2023-11-13T11:28:24.749 INFO:teuthology.orchestra.run.smithi154.stdout:[osd.4] 2023-11-13T11:28:24.749 INFO:teuthology.orchestra.run.smithi154.stdout: key = AQBLCFJlYKE5FRAAJdvXzuMVHeeaCw5jYQdClQ== 2023-11-13T11:28:24.750 INFO:teuthology.orchestra.run.smithi154.stdout:[osd.5] 2023-11-13T11:28:24.750 INFO:teuthology.orchestra.run.smithi154.stdout: key = AQBOCFJlVX5tHBAANS/0oCJ85BV7fWKU/YkehA== 2023-11-13T11:28:24.750 INFO:teuthology.orchestra.run.smithi154.stdout:[osd.6] 2023-11-13T11:28:24.750 INFO:teuthology.orchestra.run.smithi154.stdout: key = AQBRCFJlYuKJIxAAWvYLo7/JBcfEtOd3Uf+E1w== 2023-11-13T11:28:24.750 INFO:teuthology.orchestra.run.smithi154.stdout:[osd.7] 2023-11-13T11:28:24.750 INFO:teuthology.orchestra.run.smithi154.stdout: key = AQBUCFJlohOuKxAA3UTlSgmg0xLcZg0xENEuCg== 2023-11-13T11:28:24.751 INFO:teuthology.orchestra.run.smithi154.stdout:[client.0] 2023-11-13T11:28:24.751 INFO:teuthology.orchestra.run.smithi154.stdout: key = AQA4CFJlCrzJHRAAifnfqFe57iLwnoWmhavnMA== 2023-11-13T11:28:24.751 INFO:teuthology.orchestra.run.smithi154.stdout:[client.2] 2023-11-13T11:28:24.751 INFO:teuthology.orchestra.run.smithi154.stdout: key = AQA4CFJlS13vIxAAnXgB5W2MZzaQsqMhrplKAA== 2023-11-13T11:28:24.752 INFO:teuthology.orchestra.run.smithi154.stdout:[client.1] 2023-11-13T11:28:24.752 INFO:teuthology.orchestra.run.smithi154.stdout: key = AQA4CFJlKSR/JxAAfL/MN+5b3AbDF3C3G2VsGw== 2023-11-13T11:28:24.752 INFO:teuthology.orchestra.run.smithi154.stdout:[client.3] 2023-11-13T11:28:24.752 INFO:teuthology.orchestra.run.smithi154.stdout: key = AQA4CFJlf8yILRAAN9OTWaqlZBaTfkTPvpoO/g== 2023-11-13T11:28:24.754 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-11-13T11:28:24.788 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-11-13T11:28:24.856 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-11-13T11:28:24.860 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-11-13T11:28:24.919 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-11-13T11:28:24.922 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-11-13T11:28:24.980 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-13T11:28:24.983 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-13T11:28:25.039 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-13T11:28:25.043 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-13T11:28:25.098 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-13T11:28:25.102 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-13T11:28:25.157 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-13T11:28:25.161 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-13T11:28:25.216 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-11-13T11:28:25.220 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-11-13T11:28:25.275 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-11-13T11:28:25.279 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-11-13T11:28:25.337 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-11-13T11:28:25.341 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-11-13T11:28:25.398 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-13T11:28:25.402 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-13T11:28:25.457 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-13T11:28:25.460 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-13T11:28:25.514 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-13T11:28:25.518 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-13T11:28:25.574 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-13T11:28:25.611 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-13T11:28:25.666 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-11-13T11:28:25.671 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-11-13T11:28:25.731 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-11-13T11:28:25.736 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-11-13T11:28:25.794 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-11-13T11:28:25.798 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-11-13T11:28:25.855 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-11-13T11:28:25.859 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-11-13T11:28:25.916 INFO:tasks.ceph:Running mkfs on mon nodes... 2023-11-13T11:28:25.917 DEBUG:teuthology.orchestra.run.smithi102:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2023-11-13T11:28:25.937 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-11-13T11:28:26.057 DEBUG:teuthology.orchestra.run.smithi102:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2023-11-13T11:28:26.078 DEBUG:teuthology.orchestra.run.smithi154:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2023-11-13T11:28:26.099 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-11-13T11:28:26.211 DEBUG:teuthology.orchestra.run.smithi154:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2023-11-13T11:28:26.232 DEBUG:teuthology.orchestra.run.smithi154:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2023-11-13T11:28:26.296 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-11-13T11:28:26.411 DEBUG:teuthology.orchestra.run.smithi154:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2023-11-13T11:28:26.433 DEBUG:teuthology.orchestra.run.smithi102:> rm -- /home/ubuntu/cephtest/ceph.monmap 2023-11-13T11:28:26.437 DEBUG:teuthology.orchestra.run.smithi154:> rm -- /home/ubuntu/cephtest/ceph.monmap 2023-11-13T11:28:26.488 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2023-11-13T11:28:26.489 INFO:tasks.ceph.mon.a:Restarting daemon 2023-11-13T11:28:26.490 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2023-11-13T11:28:26.493 INFO:tasks.ceph.mon.a:Started 2023-11-13T11:28:26.494 INFO:tasks.ceph.mon.b:Restarting daemon 2023-11-13T11:28:26.494 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2023-11-13T11:28:26.536 INFO:tasks.ceph.mon.b:Started 2023-11-13T11:28:26.536 INFO:tasks.ceph.mon.c:Restarting daemon 2023-11-13T11:28:26.537 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2023-11-13T11:28:26.540 INFO:tasks.ceph.mon.c:Started 2023-11-13T11:28:26.540 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2023-11-13T11:28:26.541 INFO:tasks.ceph.mgr.y:Restarting daemon 2023-11-13T11:28:26.541 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2023-11-13T11:28:26.545 INFO:tasks.ceph.mgr.y:Started 2023-11-13T11:28:26.545 INFO:tasks.ceph.mgr.x:Restarting daemon 2023-11-13T11:28:26.546 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2023-11-13T11:28:26.554 INFO:tasks.ceph.mgr.x:Started 2023-11-13T11:28:26.555 INFO:tasks.ceph:Setting crush tunables to default 2023-11-13T11:28:26.555 DEBUG:teuthology.orchestra.run.smithi102:> sudo ceph --cluster ceph osd crush tunables default 2023-11-13T11:28:26.695 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:26.689+0000 7fb1c85df640 1 Processor -- start 2023-11-13T11:28:26.695 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:26.689+0000 7fb1c85df640 1 -- start start 2023-11-13T11:28:26.697 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:26.689+0000 7fb1c85df640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fb1c00cf2d0 0x7fb1c015b3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:28:26.697 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:26.689+0000 7fb1c85df640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb1c015c150 con 0x7fb1c006c800 2023-11-13T11:28:26.697 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:26.689+0000 7fb1c85df640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb1c006bd20 con 0x7fb1c01553c0 2023-11-13T11:28:26.697 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:26.689+0000 7fb1c85df640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb1c006c3e0 con 0x7fb1c00cf2d0 2023-11-13T11:28:26.697 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:26.689+0000 7fb1c6b7c640 1 --1- >> v1:172.21.15.102:6789/0 conn(0x7fb1c006c800 0x7fb1c015b8f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.102:6789/0 says I am v1:172.21.15.102:56582/0 (socket says 172.21.15.102:56582) 2023-11-13T11:28:26.698 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:26.689+0000 7fb1c6b7c640 1 -- 172.21.15.102:0/3864027710 learned_addr learned my addr 172.21.15.102:0/3864027710 (peer_addr_for_me v1:172.21.15.102:0/0) 2023-11-13T11:28:26.698 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:26.693+0000 7fb1c5b7a640 1 --2- 172.21.15.102:0/3864027710 >> v2:172.21.15.154:3300/0 conn(0x7fb1c00cf2d0 0x7fb1c015b3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:28:26.698 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:26.693+0000 7fb1c5b7a640 1 -- 172.21.15.102:0/3864027710 >> v2:172.21.15.154:3300/0 conn(0x7fb1c00cf2d0 msgr2=0x7fb1c015b3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-11-13T11:28:26.699 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:26.693+0000 7fb1c5b7a640 1 -- 172.21.15.102:0/3864027710 >> v2:172.21.15.154:3300/0 conn(0x7fb1c00cf2d0 msgr2=0x7fb1c015b3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-13T11:28:26.699 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:26.693+0000 7fb1c5b7a640 1 --2- 172.21.15.102:0/3864027710 >> v2:172.21.15.154:3300/0 conn(0x7fb1c00cf2d0 0x7fb1c015b3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-13T11:28:26.699 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:26.693+0000 7fb1c5b7a640 1 --2- 172.21.15.102:0/3864027710 >> v2:172.21.15.154:3300/0 conn(0x7fb1c00cf2d0 0x7fb1c015b3b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-13T11:28:26.901 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:26.897+0000 7fb1c5b7a640 1 --2- 172.21.15.102:0/3864027710 >> v2:172.21.15.154:3300/0 conn(0x7fb1c00cf2d0 0x7fb1c015b3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:28:26.902 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:26.897+0000 7fb1c5b7a640 1 -- 172.21.15.102:0/3864027710 >> v2:172.21.15.154:3300/0 conn(0x7fb1c00cf2d0 msgr2=0x7fb1c015b3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-11-13T11:28:26.902 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:26.897+0000 7fb1c5b7a640 1 -- 172.21.15.102:0/3864027710 >> v2:172.21.15.154:3300/0 conn(0x7fb1c00cf2d0 msgr2=0x7fb1c015b3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-13T11:28:26.902 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:26.897+0000 7fb1c5b7a640 1 --2- 172.21.15.102:0/3864027710 >> v2:172.21.15.154:3300/0 conn(0x7fb1c00cf2d0 0x7fb1c015b3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-13T11:28:26.902 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:26.897+0000 7fb1c5b7a640 1 --2- 172.21.15.102:0/3864027710 >> v2:172.21.15.154:3300/0 conn(0x7fb1c00cf2d0 0x7fb1c015b3b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-13T11:28:27.306 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:27.301+0000 7fb1c5b7a640 1 --2- 172.21.15.102:0/3864027710 >> v2:172.21.15.154:3300/0 conn(0x7fb1c00cf2d0 0x7fb1c015b3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:28:27.306 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:27.301+0000 7fb1c5b7a640 1 -- 172.21.15.102:0/3864027710 >> v2:172.21.15.154:3300/0 conn(0x7fb1c00cf2d0 msgr2=0x7fb1c015b3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-11-13T11:28:27.306 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:27.301+0000 7fb1c5b7a640 1 -- 172.21.15.102:0/3864027710 >> v2:172.21.15.154:3300/0 conn(0x7fb1c00cf2d0 msgr2=0x7fb1c015b3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-13T11:28:27.307 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:27.301+0000 7fb1c5b7a640 1 --2- 172.21.15.102:0/3864027710 >> v2:172.21.15.154:3300/0 conn(0x7fb1c00cf2d0 0x7fb1c015b3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-13T11:28:27.307 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:27.301+0000 7fb1c5b7a640 1 --2- 172.21.15.102:0/3864027710 >> v2:172.21.15.154:3300/0 conn(0x7fb1c00cf2d0 0x7fb1c015b3b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-13T11:28:28.110 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:28.105+0000 7fb1c5b7a640 1 --2- 172.21.15.102:0/3864027710 >> v2:172.21.15.154:3300/0 conn(0x7fb1c00cf2d0 0x7fb1c015b3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:28:28.110 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:28.105+0000 7fb1c5b7a640 1 -- 172.21.15.102:0/3864027710 >> v2:172.21.15.154:3300/0 conn(0x7fb1c00cf2d0 msgr2=0x7fb1c015b3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-11-13T11:28:28.111 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:28.105+0000 7fb1c5b7a640 1 -- 172.21.15.102:0/3864027710 >> v2:172.21.15.154:3300/0 conn(0x7fb1c00cf2d0 msgr2=0x7fb1c015b3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-13T11:28:28.111 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:28.105+0000 7fb1c5b7a640 1 --2- 172.21.15.102:0/3864027710 >> v2:172.21.15.154:3300/0 conn(0x7fb1c00cf2d0 0x7fb1c015b3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-13T11:28:28.111 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:28.105+0000 7fb1c5b7a640 1 --2- 172.21.15.102:0/3864027710 >> v2:172.21.15.154:3300/0 conn(0x7fb1c00cf2d0 0x7fb1c015b3b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-13T11:28:29.698 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:29.689+0000 7fb1b7fff640 1 -- 172.21.15.102:0/3864027710 >> v2:172.21.15.154:3300/0 conn(0x7fb1c00cf2d0 msgr2=0x7fb1c015b3b0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-13T11:28:29.698 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:29.689+0000 7fb1b7fff640 1 --2- 172.21.15.102:0/3864027710 >> v2:172.21.15.154:3300/0 conn(0x7fb1c00cf2d0 0x7fb1c015b3b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:28:29.698 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:29.689+0000 7fb1b7fff640 1 -- 172.21.15.102:0/3864027710 >> v1:172.21.15.154:6789/0 conn(0x7fb1c01553c0 legacy=0x7fb1c00cebc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:28:29.699 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:29.689+0000 7fb1b7fff640 1 -- 172.21.15.102:0/3864027710 >> v1:172.21.15.102:6789/0 conn(0x7fb1c006c800 legacy=0x7fb1c015b8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:28:29.699 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:29.689+0000 7fb1b7fff640 1 --2- 172.21.15.102:0/3864027710 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb1a4003720 0x7fb1a4005b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:28:29.699 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:29.689+0000 7fb1b7fff640 1 --2- 172.21.15.102:0/3864027710 >> v2:172.21.15.102:3300/0 conn(0x7fb1a4006200 0x7fb1a40086a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:28:29.699 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:29.689+0000 7fb1b7fff640 1 -- 172.21.15.102:0/3864027710 --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb1c006c3e0 con 0x7fb1a4006200 2023-11-13T11:28:29.700 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:29.689+0000 7fb1b7fff640 1 -- 172.21.15.102:0/3864027710 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb1a4008d60 con 0x7fb1a4003720 2023-11-13T11:28:29.700 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:29.693+0000 7fb1c5b7a640 1 --2- 172.21.15.102:0/3864027710 >> v2:172.21.15.102:3300/0 conn(0x7fb1a4006200 0x7fb1a40086a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:28:29.700 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:29.693+0000 7fb1c5b7a640 1 -- 172.21.15.102:0/3864027710 >> v2:172.21.15.102:3300/0 conn(0x7fb1a4006200 msgr2=0x7fb1a40086a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-11-13T11:28:29.700 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:29.693+0000 7fb1c637b640 1 --2- 172.21.15.102:0/3864027710 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb1a4003720 0x7fb1a4005b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:28:29.700 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:29.693+0000 7fb1c5b7a640 1 -- 172.21.15.102:0/3864027710 >> v2:172.21.15.102:3300/0 conn(0x7fb1a4006200 msgr2=0x7fb1a40086a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-13T11:28:29.701 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:29.693+0000 7fb1c5b7a640 1 --2- 172.21.15.102:0/3864027710 >> v2:172.21.15.102:3300/0 conn(0x7fb1a4006200 0x7fb1a40086a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-13T11:28:29.701 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:29.693+0000 7fb1c5b7a640 1 --2- 172.21.15.102:0/3864027710 >> v2:172.21.15.102:3300/0 conn(0x7fb1a4006200 0x7fb1a40086a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-13T11:28:29.701 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:29.693+0000 7fb1c637b640 1 -- 172.21.15.102:0/3864027710 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb1a4003720 msgr2=0x7fb1a4005b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-11-13T11:28:29.701 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:29.693+0000 7fb1c637b640 1 -- 172.21.15.102:0/3864027710 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb1a4003720 msgr2=0x7fb1a4005b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-13T11:28:29.701 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:29.693+0000 7fb1c637b640 1 --2- 172.21.15.102:0/3864027710 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb1a4003720 0x7fb1a4005b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-13T11:28:29.702 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:29.693+0000 7fb1c637b640 1 --2- 172.21.15.102:0/3864027710 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb1a4003720 0x7fb1a4005b70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-13T11:28:29.899 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:29.897+0000 7fb1c5b7a640 1 --2- 172.21.15.102:0/3864027710 >> v2:172.21.15.102:3300/0 conn(0x7fb1a4006200 0x7fb1a40086a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:28:29.899 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:29.897+0000 7fb1c5b7a640 1 -- 172.21.15.102:0/3864027710 >> v2:172.21.15.102:3300/0 conn(0x7fb1a4006200 msgr2=0x7fb1a40086a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-11-13T11:28:29.899 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:29.897+0000 7fb1c5b7a640 1 -- 172.21.15.102:0/3864027710 >> v2:172.21.15.102:3300/0 conn(0x7fb1a4006200 msgr2=0x7fb1a40086a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-13T11:28:29.900 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:29.897+0000 7fb1c5b7a640 1 --2- 172.21.15.102:0/3864027710 >> v2:172.21.15.102:3300/0 conn(0x7fb1a4006200 0x7fb1a40086a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-13T11:28:29.900 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:29.897+0000 7fb1c5b7a640 1 --2- 172.21.15.102:0/3864027710 >> v2:172.21.15.102:3300/0 conn(0x7fb1a4006200 0x7fb1a40086a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-13T11:28:29.900 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:29.897+0000 7fb1c637b640 1 --2- 172.21.15.102:0/3864027710 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb1a4003720 0x7fb1a4005b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:28:29.900 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:29.897+0000 7fb1c637b640 1 -- 172.21.15.102:0/3864027710 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb1a4003720 msgr2=0x7fb1a4005b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-11-13T11:28:29.900 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:29.897+0000 7fb1c637b640 1 -- 172.21.15.102:0/3864027710 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb1a4003720 msgr2=0x7fb1a4005b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-13T11:28:29.901 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:29.897+0000 7fb1c637b640 1 --2- 172.21.15.102:0/3864027710 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb1a4003720 0x7fb1a4005b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-13T11:28:29.901 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:29.897+0000 7fb1c637b640 1 --2- 172.21.15.102:0/3864027710 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb1a4003720 0x7fb1a4005b70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-13T11:28:30.306 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:30.301+0000 7fb1c5b7a640 1 --2- 172.21.15.102:0/3864027710 >> v2:172.21.15.102:3300/0 conn(0x7fb1a4006200 0x7fb1a40086a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:28:30.307 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:30.301+0000 7fb1c5b7a640 1 -- 172.21.15.102:0/3864027710 >> v2:172.21.15.102:3300/0 conn(0x7fb1a4006200 msgr2=0x7fb1a40086a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-11-13T11:28:30.307 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:30.301+0000 7fb1c5b7a640 1 -- 172.21.15.102:0/3864027710 >> v2:172.21.15.102:3300/0 conn(0x7fb1a4006200 msgr2=0x7fb1a40086a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-13T11:28:30.307 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:30.301+0000 7fb1c5b7a640 1 --2- 172.21.15.102:0/3864027710 >> v2:172.21.15.102:3300/0 conn(0x7fb1a4006200 0x7fb1a40086a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-13T11:28:30.307 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:30.301+0000 7fb1c5b7a640 1 --2- 172.21.15.102:0/3864027710 >> v2:172.21.15.102:3300/0 conn(0x7fb1a4006200 0x7fb1a40086a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-13T11:28:30.307 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:30.301+0000 7fb1c637b640 1 --2- 172.21.15.102:0/3864027710 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb1a4003720 0x7fb1a4005b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:28:30.308 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:30.301+0000 7fb1c637b640 1 -- 172.21.15.102:0/3864027710 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb1a4003720 msgr2=0x7fb1a4005b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-11-13T11:28:30.308 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:30.301+0000 7fb1c637b640 1 -- 172.21.15.102:0/3864027710 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb1a4003720 msgr2=0x7fb1a4005b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-13T11:28:30.308 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:30.301+0000 7fb1c637b640 1 --2- 172.21.15.102:0/3864027710 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb1a4003720 0x7fb1a4005b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-13T11:28:30.308 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:30.301+0000 7fb1c637b640 1 --2- 172.21.15.102:0/3864027710 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb1a4003720 0x7fb1a4005b70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-13T11:28:31.110 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:31.105+0000 7fb1c5b7a640 1 --2- 172.21.15.102:0/3864027710 >> v2:172.21.15.102:3300/0 conn(0x7fb1a4006200 0x7fb1a40086a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:28:31.111 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:31.105+0000 7fb1c5b7a640 1 -- 172.21.15.102:0/3864027710 >> v2:172.21.15.102:3300/0 conn(0x7fb1a4006200 msgr2=0x7fb1a40086a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-11-13T11:28:31.111 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:31.105+0000 7fb1c5b7a640 1 -- 172.21.15.102:0/3864027710 >> v2:172.21.15.102:3300/0 conn(0x7fb1a4006200 msgr2=0x7fb1a40086a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-13T11:28:31.111 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:31.105+0000 7fb1c5b7a640 1 --2- 172.21.15.102:0/3864027710 >> v2:172.21.15.102:3300/0 conn(0x7fb1a4006200 0x7fb1a40086a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-13T11:28:31.111 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:31.105+0000 7fb1c5b7a640 1 --2- 172.21.15.102:0/3864027710 >> v2:172.21.15.102:3300/0 conn(0x7fb1a4006200 0x7fb1a40086a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-13T11:28:31.111 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:31.105+0000 7fb1c637b640 1 --2- 172.21.15.102:0/3864027710 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb1a4003720 0x7fb1a4005b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:28:31.112 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:31.105+0000 7fb1c637b640 1 -- 172.21.15.102:0/3864027710 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb1a4003720 msgr2=0x7fb1a4005b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-11-13T11:28:31.112 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:31.105+0000 7fb1c637b640 1 -- 172.21.15.102:0/3864027710 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb1a4003720 msgr2=0x7fb1a4005b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-13T11:28:31.112 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:31.105+0000 7fb1c637b640 1 --2- 172.21.15.102:0/3864027710 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb1a4003720 0x7fb1a4005b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-13T11:28:31.112 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:31.105+0000 7fb1c637b640 1 --2- 172.21.15.102:0/3864027710 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb1a4003720 0x7fb1a4005b70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-13T11:28:32.105 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-11-13T11:28:32.097+0000 7f059c834180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-11-13T11:28:32.109 INFO:tasks.ceph.mgr.y.smithi102.stderr:2023-11-13T11:28:32.101+0000 7f471a1f6180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-11-13T11:28:32.653 INFO:tasks.ceph.mgr.y.smithi102.stderr:2023-11-13T11:28:32.644+0000 7f471a1f6180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-11-13T11:28:32.655 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-11-13T11:28:32.653+0000 7f059c834180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-11-13T11:28:32.698 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:32.688+0000 7fb1b7fff640 1 -- 172.21.15.102:0/3864027710 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb1a4003720 msgr2=0x7fb1a4005b70 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-13T11:28:32.698 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:32.688+0000 7fb1b7fff640 1 --2- 172.21.15.102:0/3864027710 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb1a4003720 0x7fb1a4005b70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:28:32.698 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:32.692+0000 7fb1b7fff640 1 -- 172.21.15.102:0/3864027710 >> v2:172.21.15.102:3300/0 conn(0x7fb1a4006200 msgr2=0x7fb1a40086a0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-13T11:28:32.699 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:32.692+0000 7fb1b7fff640 1 --2- 172.21.15.102:0/3864027710 >> v2:172.21.15.102:3300/0 conn(0x7fb1a4006200 0x7fb1a40086a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:28:32.699 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:32.692+0000 7fb1b7fff640 1 --2- 172.21.15.102:0/3864027710 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb1a4003720 0x7fb1a4005b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:28:32.699 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:32.692+0000 7fb1c6b7c640 1 -- 172.21.15.102:0/3864027710 reap_dead start 2023-11-13T11:28:32.699 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:32.692+0000 7fb1b7fff640 1 --2- 172.21.15.102:0/3864027710 >> v2:172.21.15.102:3300/0 conn(0x7fb1a4006200 0x7fb1a40086a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:28:32.699 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:32.692+0000 7fb1b7fff640 1 -- 172.21.15.102:0/3864027710 --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb1c006c000 con 0x7fb1c006c800 2023-11-13T11:28:32.700 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:32.692+0000 7fb1b7fff640 1 -- 172.21.15.102:0/3864027710 --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb1c006c3e0 con 0x7fb1a4006200 2023-11-13T11:28:32.700 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:32.692+0000 7fb1b7fff640 1 -- 172.21.15.102:0/3864027710 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb1a4008d60 con 0x7fb1a4003720 2023-11-13T11:28:32.700 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:32.692+0000 7fb1c637b640 1 --2- 172.21.15.102:0/3864027710 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb1a4003720 0x7fb1a4005b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:28:32.700 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:32.692+0000 7fb1c5b7a640 1 --2- 172.21.15.102:0/3864027710 >> v2:172.21.15.102:3300/0 conn(0x7fb1a4006200 0x7fb1a40086a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:28:32.701 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:32.692+0000 7fb1c637b640 1 -- 172.21.15.102:0/3864027710 >> v2:172.21.15.102:3300/0 conn(0x7fb1a4006200 msgr2=0x7fb1a40086a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-13T11:28:32.701 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:32.692+0000 7fb1c637b640 1 --2- 172.21.15.102:0/3864027710 >> v2:172.21.15.102:3300/0 conn(0x7fb1a4006200 0x7fb1a40086a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:28:32.701 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:32.692+0000 7fb1c637b640 1 -- 172.21.15.102:0/3864027710 >> v1:172.21.15.102:6789/0 conn(0x7fb1c006c800 legacy=0x7fb1a400b190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:28:32.701 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:32.692+0000 7fb1c637b640 1 -- 172.21.15.102:0/3864027710 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1a400d9e0 con 0x7fb1a4003720 2023-11-13T11:28:32.703 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:32.696+0000 7fb1c637b640 1 --2- 172.21.15.102:0/3864027710 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb1a4003720 0x7fb1a4005b70 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fb1bc007c40 tx=0x7fb1bc01cc90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3cf9903f54f4f2b3 server_cookie=0 in_seq=0 out_seq=0 2023-11-13T11:28:32.703 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:32.696+0000 7fb1c5379640 1 -- 172.21.15.102:0/3864027710 <== mon.2 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1bc0a5b30 con 0x7fb1a4003720 2023-11-13T11:28:32.703 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:32.696+0000 7fb1c5379640 1 -- 172.21.15.102:0/3864027710 <== mon.2 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb1bc0a9070 con 0x7fb1a4003720 2023-11-13T11:28:32.703 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:32.696+0000 7fb1c5379640 1 -- 172.21.15.102:0/3864027710 <== mon.2 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1bc007030 con 0x7fb1a4003720 2023-11-13T11:28:32.703 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:32.696+0000 7fb1c85df640 1 -- 172.21.15.102:0/3864027710 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb1a4003720 msgr2=0x7fb1a4005b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:28:32.704 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:32.696+0000 7fb1c85df640 1 --2- 172.21.15.102:0/3864027710 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb1a4003720 0x7fb1a4005b70 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fb1bc007c40 tx=0x7fb1bc01cc90 comp rx=0 tx=0).stop 2023-11-13T11:28:32.704 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:32.696+0000 7fb1c85df640 1 -- 172.21.15.102:0/3864027710 shutdown_connections 2023-11-13T11:28:32.704 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:32.696+0000 7fb1c85df640 1 --2- 172.21.15.102:0/3864027710 >> v2:172.21.15.102:3300/0 conn(0x7fb1a4006200 0x7fb1a40086a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:28:32.704 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:32.696+0000 7fb1c85df640 1 --2- 172.21.15.102:0/3864027710 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb1a4003720 0x7fb1a4005b70 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:28:32.704 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:32.696+0000 7fb1c85df640 1 -- 172.21.15.102:0/3864027710 >> 172.21.15.102:0/3864027710 conn(0x7fb1c006a410 msgr2=0x7fb1c006a820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-13T11:28:32.705 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:32.696+0000 7fb1c85df640 1 -- 172.21.15.102:0/3864027710 shutdown_connections 2023-11-13T11:28:32.705 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:32.696+0000 7fb1c85df640 1 -- 172.21.15.102:0/3864027710 wait complete. 2023-11-13T11:28:32.707 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:32.696+0000 7fb1c85df640 1 Processor -- start 2023-11-13T11:28:32.708 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:32.696+0000 7fb1c85df640 1 -- start start 2023-11-13T11:28:32.708 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:32.700+0000 7fb1c85df640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb1a4003720 0x7fb1c014d9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:28:32.708 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:32.700+0000 7fb1c85df640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb1a4006200 0x7fb1c0141360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:28:32.708 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:32.700+0000 7fb1c85df640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb1c006c800 0x7fb1c014f220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:28:32.708 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:32.700+0000 7fb1c85df640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1c0150330 con 0x7fb1a4006200 2023-11-13T11:28:32.709 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:32.700+0000 7fb1c85df640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1c014fa90 con 0x7fb1c006c800 2023-11-13T11:28:32.709 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:32.700+0000 7fb1c85df640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb1c014fd70 con 0x7fb1a4003720 2023-11-13T11:28:32.709 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:32.700+0000 7fb1c5b7a640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb1a4006200 0x7fb1c0141360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:28:32.709 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:32.700+0000 7fb1c637b640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb1a4003720 0x7fb1c014d9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:28:32.709 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:32.700+0000 7fb1c5b7a640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb1a4006200 0x7fb1c0141360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:48614/0 (socket says 172.21.15.102:48614) 2023-11-13T11:28:32.710 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:32.700+0000 7fb1c637b640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb1a4003720 0x7fb1c014d9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.102:39956/0 (socket says 172.21.15.102:39956) 2023-11-13T11:28:32.710 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:32.700+0000 7fb1c5b7a640 1 -- 172.21.15.102:0/3164162258 learned_addr learned my addr 172.21.15.102:0/3164162258 (peer_addr_for_me v2:172.21.15.102:0/0) 2023-11-13T11:28:32.710 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:32.700+0000 7fb1c6b7c640 1 --2- 172.21.15.102:0/3164162258 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb1c006c800 0x7fb1c014f220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:28:32.710 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:32.700+0000 7fb1c5b7a640 1 -- 172.21.15.102:0/3164162258 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb1a4003720 msgr2=0x7fb1c014d9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:28:32.710 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:32.700+0000 7fb1c5b7a640 1 --2- 172.21.15.102:0/3164162258 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb1a4003720 0x7fb1c014d9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:28:32.711 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:32.700+0000 7fb1c5b7a640 1 -- 172.21.15.102:0/3164162258 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb1c006c800 msgr2=0x7fb1c014f220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:28:32.711 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:32.700+0000 7fb1c5b7a640 1 --2- 172.21.15.102:0/3164162258 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb1c006c800 0x7fb1c014f220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:28:32.711 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:32.700+0000 7fb1c5b7a640 1 -- 172.21.15.102:0/3164162258 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1bc00f040 con 0x7fb1a4006200 2023-11-13T11:28:32.711 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:32.700+0000 7fb1c5b7a640 1 --2- 172.21.15.102:0/3164162258 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb1a4006200 0x7fb1c0141360 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fb1b00189e0 tx=0x7fb1b0018ea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-13T11:28:32.711 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:32.700+0000 7fb1b6ffd640 1 -- 172.21.15.102:0/3164162258 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1b0004440 con 0x7fb1a4006200 2023-11-13T11:28:32.711 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:32.700+0000 7fb1b6ffd640 1 -- 172.21.15.102:0/3164162258 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb1b001f040 con 0x7fb1a4006200 2023-11-13T11:28:32.712 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:32.700+0000 7fb1b6ffd640 1 -- 172.21.15.102:0/3164162258 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1b0014b20 con 0x7fb1a4006200 2023-11-13T11:28:32.712 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:32.700+0000 7fb1c85df640 1 -- 172.21.15.102:0/3164162258 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb1c0150050 con 0x7fb1a4006200 2023-11-13T11:28:32.712 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:32.700+0000 7fb1c85df640 1 -- 172.21.15.102:0/3164162258 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb1c01418a0 con 0x7fb1a4006200 2023-11-13T11:28:32.712 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:32.700+0000 7fb1b6ffd640 1 -- 172.21.15.102:0/3164162258 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fb1b00059a0 con 0x7fb1a4006200 2023-11-13T11:28:32.712 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:32.700+0000 7fb1b6ffd640 1 -- 172.21.15.102:0/3164162258 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7fb1b0006020 con 0x7fb1a4006200 2023-11-13T11:28:32.713 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:32.700+0000 7fb1c85df640 1 -- 172.21.15.102:0/3164162258 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb1c0067640 con 0x7fb1a4006200 2023-11-13T11:28:32.713 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:32.704+0000 7fb1b6ffd640 1 -- 172.21.15.102:0/3164162258 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72898 (secure 0 0 0) 0x7fb1b0028070 con 0x7fb1a4006200 2023-11-13T11:28:32.772 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:32.764+0000 7fb1c85df640 1 -- 172.21.15.102:0/3164162258 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) v1 -- 0x7fb1c0068520 con 0x7fb1a4006200 2023-11-13T11:28:32.774 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:32.768+0000 7fb1b6ffd640 1 -- 172.21.15.102:0/3164162258 <== mon.0 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) v1 ==== 124+0+0 (secure 0 0 0) 0x7fb1b000f040 con 0x7fb1a4006200 2023-11-13T11:28:32.774 INFO:teuthology.orchestra.run.smithi102.stderr:adjusted tunables profile to default 2023-11-13T11:28:32.776 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:32.768+0000 7fb1c85df640 1 -- 172.21.15.102:0/3164162258 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb1a4006200 msgr2=0x7fb1c0141360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:28:32.776 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:32.768+0000 7fb1c85df640 1 --2- 172.21.15.102:0/3164162258 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb1a4006200 0x7fb1c0141360 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fb1b00189e0 tx=0x7fb1b0018ea0 comp rx=0 tx=0).stop 2023-11-13T11:28:32.776 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:32.768+0000 7fb1c85df640 1 -- 172.21.15.102:0/3164162258 shutdown_connections 2023-11-13T11:28:32.776 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:32.768+0000 7fb1c85df640 1 --2- 172.21.15.102:0/3164162258 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb1c006c800 0x7fb1c014f220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:28:32.777 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:32.768+0000 7fb1c85df640 1 --2- 172.21.15.102:0/3164162258 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb1a4006200 0x7fb1c0141360 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:28:32.777 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:32.768+0000 7fb1c85df640 1 --2- 172.21.15.102:0/3164162258 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb1a4003720 0x7fb1c014d9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:28:32.777 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:32.768+0000 7fb1c85df640 1 -- 172.21.15.102:0/3164162258 >> 172.21.15.102:0/3164162258 conn(0x7fb1c006a410 msgr2=0x7fb1c00b0e70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-13T11:28:32.777 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:32.768+0000 7fb1c85df640 1 -- 172.21.15.102:0/3164162258 shutdown_connections 2023-11-13T11:28:32.777 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:32.768+0000 7fb1c85df640 1 -- 172.21.15.102:0/3164162258 wait complete. 2023-11-13T11:28:32.794 INFO:tasks.ceph:check_enable_crimson: False 2023-11-13T11:28:32.795 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2023-11-13T11:28:32.795 DEBUG:teuthology.orchestra.run.smithi102:> set -ex 2023-11-13T11:28:32.796 DEBUG:teuthology.orchestra.run.smithi102:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2023-11-13T11:28:32.816 DEBUG:teuthology.orchestra.run.smithi102:> set -ex 2023-11-13T11:28:32.817 DEBUG:teuthology.orchestra.run.smithi102:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2023-11-13T11:28:32.859 INFO:tasks.ceph.mgr.y.smithi102.stderr:2023-11-13T11:28:32.852+0000 7f471a1f6180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-11-13T11:28:32.861 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-11-13T11:28:32.857+0000 7f059c834180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-11-13T11:28:32.879 DEBUG:teuthology.orchestra.run.smithi102:> set -ex 2023-11-13T11:28:32.880 DEBUG:teuthology.orchestra.run.smithi102:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2023-11-13T11:28:32.941 DEBUG:teuthology.orchestra.run.smithi102:> set -ex 2023-11-13T11:28:32.941 DEBUG:teuthology.orchestra.run.smithi102:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2023-11-13T11:28:33.009 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2023-11-13T11:28:33.009 DEBUG:teuthology.orchestra.run.smithi154:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2023-11-13T11:28:33.029 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2023-11-13T11:28:33.030 DEBUG:teuthology.orchestra.run.smithi154:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2023-11-13T11:28:33.093 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2023-11-13T11:28:33.094 DEBUG:teuthology.orchestra.run.smithi154:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2023-11-13T11:28:33.157 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2023-11-13T11:28:33.158 DEBUG:teuthology.orchestra.run.smithi154:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2023-11-13T11:28:33.221 DEBUG:teuthology.orchestra.run.smithi154:> sudo ceph --cluster ceph osd new bdefaa17-fcca-4c86-aa40-27dc33a789af 0 2023-11-13T11:28:33.398 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-13T11:28:33.393+0000 7f28d8a5a640 1 Processor -- start 2023-11-13T11:28:33.398 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-13T11:28:33.393+0000 7f28d8a5a640 1 -- start start 2023-11-13T11:28:33.400 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-13T11:28:33.397+0000 7f28d8a5a640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f28d415d220 0x7f28d40d3910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:28:33.400 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-13T11:28:33.397+0000 7f28d8a5a640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f28d415d600 0x7f28d40b2750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:28:33.400 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-13T11:28:33.397+0000 7f28d8a5a640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f28d40b3f60 0x7f28d40b2c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:28:33.400 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-13T11:28:33.397+0000 7f28d8a5a640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f28d40b3840 con 0x7f28d415d220 2023-11-13T11:28:33.401 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-13T11:28:33.397+0000 7f28d8a5a640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f28d40cecb0 con 0x7f28d415d600 2023-11-13T11:28:33.401 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-13T11:28:33.397+0000 7f28d8a5a640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28d40d0d00 con 0x7f28d40b3f60 2023-11-13T11:28:33.401 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-13T11:28:33.397+0000 7f28cbfff640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f28d415d600 0x7f28d40b2750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:28:33.401 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-13T11:28:33.397+0000 7f28d2d9d640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f28d40b3f60 0x7f28d40b2c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:28:33.401 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-13T11:28:33.397+0000 7f28cbfff640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f28d415d600 0x7f28d40b2750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:36642/0 (socket says 172.21.15.154:36642) 2023-11-13T11:28:33.402 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-13T11:28:33.397+0000 7f28cbfff640 1 -- 172.21.15.154:0/3615274691 learned_addr learned my addr 172.21.15.154:0/3615274691 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-11-13T11:28:33.402 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-13T11:28:33.397+0000 7f28d259c640 1 --2- 172.21.15.154:0/3615274691 >> v2:172.21.15.102:3300/0 conn(0x7f28d415d220 0x7f28d40d3910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:28:33.402 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-13T11:28:33.397+0000 7f28cbfff640 1 -- 172.21.15.154:0/3615274691 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f28d40b3f60 msgr2=0x7f28d40b2c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-13T11:28:33.402 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-13T11:28:33.397+0000 7f28cbfff640 1 --2- 172.21.15.154:0/3615274691 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f28d40b3f60 0x7f28d40b2c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:28:33.403 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-13T11:28:33.397+0000 7f28cbfff640 1 -- 172.21.15.154:0/3615274691 >> v2:172.21.15.102:3300/0 conn(0x7f28d415d220 msgr2=0x7f28d40d3910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-13T11:28:33.403 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-13T11:28:33.397+0000 7f28cbfff640 1 --2- 172.21.15.154:0/3615274691 >> v2:172.21.15.102:3300/0 conn(0x7f28d415d220 0x7f28d40d3910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:28:33.403 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-13T11:28:33.397+0000 7f28cbfff640 1 -- 172.21.15.154:0/3615274691 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28d40d0fe0 con 0x7f28d415d600 2023-11-13T11:28:33.404 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-13T11:28:33.397+0000 7f28d259c640 1 --2- 172.21.15.154:0/3615274691 >> v2:172.21.15.102:3300/0 conn(0x7f28d415d220 0x7f28d40d3910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-13T11:28:33.405 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-13T11:28:33.401+0000 7f28cbfff640 1 --2- 172.21.15.154:0/3615274691 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f28d415d600 0x7f28d40b2750 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f28d40ceea0 tx=0x7f28bc01c3b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=98f7554ac827362 server_cookie=0 in_seq=0 out_seq=0 2023-11-13T11:28:33.405 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-13T11:28:33.401+0000 7f28d1d9b640 1 -- 172.21.15.154:0/3615274691 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28bc0ab600 con 0x7f28d415d600 2023-11-13T11:28:33.405 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-13T11:28:33.401+0000 7f28d1d9b640 1 -- 172.21.15.154:0/3615274691 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f28bc0a7050 con 0x7f28d415d600 2023-11-13T11:28:33.405 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-13T11:28:33.401+0000 7f28d1d9b640 1 -- 172.21.15.154:0/3615274691 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28bc0ab980 con 0x7f28d415d600 2023-11-13T11:28:33.406 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-13T11:28:33.401+0000 7f28d8a5a640 1 -- 172.21.15.154:0/3615274691 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f28d415d600 msgr2=0x7f28d40b2750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:28:33.406 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-13T11:28:33.401+0000 7f28d8a5a640 1 --2- 172.21.15.154:0/3615274691 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f28d415d600 0x7f28d40b2750 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f28d40ceea0 tx=0x7f28bc01c3b0 comp rx=0 tx=0).stop 2023-11-13T11:28:33.406 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-13T11:28:33.401+0000 7f28d8a5a640 1 -- 172.21.15.154:0/3615274691 shutdown_connections 2023-11-13T11:28:33.406 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-13T11:28:33.401+0000 7f28d8a5a640 1 --2- 172.21.15.154:0/3615274691 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f28d40b3f60 0x7f28d40b2c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:28:33.406 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-13T11:28:33.401+0000 7f28d8a5a640 1 --2- 172.21.15.154:0/3615274691 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f28d415d600 0x7f28d40b2750 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:28:33.407 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-13T11:28:33.401+0000 7f28d8a5a640 1 --2- 172.21.15.154:0/3615274691 >> v2:172.21.15.102:3300/0 conn(0x7f28d415d220 0x7f28d40d3910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:28:33.407 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-13T11:28:33.401+0000 7f28d8a5a640 1 -- 172.21.15.154:0/3615274691 >> 172.21.15.154:0/3615274691 conn(0x7f28d40d2df0 msgr2=0x7f28d40d3200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-13T11:28:33.407 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-13T11:28:33.401+0000 7f28d8a5a640 1 -- 172.21.15.154:0/3615274691 shutdown_connections 2023-11-13T11:28:33.407 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-13T11:28:33.401+0000 7f28d8a5a640 1 -- 172.21.15.154:0/3615274691 wait complete. 2023-11-13T11:28:33.409 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-13T11:28:33.401+0000 7f28d8a5a640 1 Processor -- start 2023-11-13T11:28:33.410 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-13T11:28:33.401+0000 7f28d8a5a640 1 -- start start 2023-11-13T11:28:33.410 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-13T11:28:33.405+0000 7f28d8a5a640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f28d40b3f60 0x7f28d4152860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:28:33.410 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-13T11:28:33.405+0000 7f28d8a5a640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f28d415d220 0x7f28d414e5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:28:33.410 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-13T11:28:33.405+0000 7f28d8a5a640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f28d415d600 0x7f28d414ee50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:28:33.410 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-13T11:28:33.405+0000 7f28d8a5a640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28d4152da0 con 0x7f28d40b3f60 2023-11-13T11:28:33.411 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-13T11:28:33.405+0000 7f28d8a5a640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28d415a3b0 con 0x7f28d415d600 2023-11-13T11:28:33.411 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-13T11:28:33.405+0000 7f28d8a5a640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28d4159980 con 0x7f28d415d220 2023-11-13T11:28:33.411 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-13T11:28:33.405+0000 7f28cbfff640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f28d415d220 0x7f28d414e5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:28:33.411 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-13T11:28:33.405+0000 7f28d259c640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f28d40b3f60 0x7f28d4152860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:28:33.411 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-13T11:28:33.405+0000 7f28cbfff640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f28d415d220 0x7f28d414e5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:35368/0 (socket says 172.21.15.154:35368) 2023-11-13T11:28:33.412 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-13T11:28:33.405+0000 7f28cbfff640 1 -- 172.21.15.154:0/1442597097 learned_addr learned my addr 172.21.15.154:0/1442597097 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-11-13T11:28:33.412 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-13T11:28:33.405+0000 7f28d2d9d640 1 --2- 172.21.15.154:0/1442597097 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f28d415d600 0x7f28d414ee50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:28:33.412 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-13T11:28:33.405+0000 7f28cbfff640 1 -- 172.21.15.154:0/1442597097 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f28d415d600 msgr2=0x7f28d414ee50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:28:33.412 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-13T11:28:33.405+0000 7f28cbfff640 1 --2- 172.21.15.154:0/1442597097 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f28d415d600 0x7f28d414ee50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:28:33.412 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-13T11:28:33.405+0000 7f28cbfff640 1 -- 172.21.15.154:0/1442597097 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f28d40b3f60 msgr2=0x7f28d4152860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:28:33.413 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-13T11:28:33.405+0000 7f28cbfff640 1 --2- 172.21.15.154:0/1442597097 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f28d40b3f60 0x7f28d4152860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:28:33.413 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-13T11:28:33.405+0000 7f28cbfff640 1 -- 172.21.15.154:0/1442597097 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28bc0094d0 con 0x7f28d415d220 2023-11-13T11:28:33.413 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-13T11:28:33.405+0000 7f28d2d9d640 1 --2- 172.21.15.154:0/1442597097 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f28d415d600 0x7f28d414ee50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-13T11:28:33.413 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-13T11:28:33.405+0000 7f28d259c640 1 --2- 172.21.15.154:0/1442597097 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f28d40b3f60 0x7f28d4152860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-13T11:28:33.413 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-13T11:28:33.405+0000 7f28cbfff640 1 --2- 172.21.15.154:0/1442597097 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f28d415d220 0x7f28d414e5e0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f28bc0ae040 tx=0x7f28bc019150 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-13T11:28:33.414 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-13T11:28:33.405+0000 7f28caffd640 1 -- 172.21.15.154:0/1442597097 <== mon.2 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28bc0b6420 con 0x7f28d415d220 2023-11-13T11:28:33.414 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-13T11:28:33.405+0000 7f28caffd640 1 -- 172.21.15.154:0/1442597097 <== mon.2 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f28bc0b65a0 con 0x7f28d415d220 2023-11-13T11:28:33.414 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-13T11:28:33.405+0000 7f28d8a5a640 1 -- 172.21.15.154:0/1442597097 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f28d4159c60 con 0x7f28d415d220 2023-11-13T11:28:33.415 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-13T11:28:33.405+0000 7f28caffd640 1 -- 172.21.15.154:0/1442597097 <== mon.2 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28bc0b6950 con 0x7f28d415d220 2023-11-13T11:28:33.415 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-13T11:28:33.405+0000 7f28d8a5a640 1 -- 172.21.15.154:0/1442597097 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f28d415a8e0 con 0x7f28d415d220 2023-11-13T11:28:33.415 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-13T11:28:33.405+0000 7f28caffd640 1 -- 172.21.15.154:0/1442597097 <== mon.2 v2:172.21.15.154:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f28bc0b2040 con 0x7f28d415d220 2023-11-13T11:28:33.415 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-13T11:28:33.405+0000 7f28caffd640 1 -- 172.21.15.154:0/1442597097 <== mon.2 v2:172.21.15.154:3301/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 725+0+0 (secure 0 0 0) 0x7f28bc0b43f0 con 0x7f28d415d220 2023-11-13T11:28:33.415 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-13T11:28:33.405+0000 7f28d8a5a640 1 -- 172.21.15.154:0/1442597097 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f28d4159e20 con 0x7f28d415d220 2023-11-13T11:28:33.416 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-13T11:28:33.409+0000 7f28caffd640 1 -- 172.21.15.154:0/1442597097 <== mon.2 v2:172.21.15.154:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72898 (secure 0 0 0) 0x7f28bc0ba070 con 0x7f28d415d220 2023-11-13T11:28:33.477 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-13T11:28:33.473+0000 7f28d8a5a640 1 -- 172.21.15.154:0/1442597097 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "osd new", "uuid": "bdefaa17-fcca-4c86-aa40-27dc33a789af", "id": 0} v 0) v1 -- 0x7f28d4068520 con 0x7f28d415d220 2023-11-13T11:28:33.482 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-13T11:28:33.481+0000 7f28caffd640 1 -- 172.21.15.154:0/1442597097 <== mon.2 v2:172.21.15.154:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "bdefaa17-fcca-4c86-aa40-27dc33a789af", "id": 0}]=0 v3) v1 ==== 112+0+2 (secure 0 0 0) 0x7f28bc0b0070 con 0x7f28d415d220 2023-11-13T11:28:33.483 INFO:teuthology.orchestra.run.smithi154.stdout:0 2023-11-13T11:28:33.484 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-13T11:28:33.481+0000 7f28d8a5a640 1 -- 172.21.15.154:0/1442597097 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f28d415d220 msgr2=0x7f28d414e5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:28:33.484 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-13T11:28:33.481+0000 7f28d8a5a640 1 --2- 172.21.15.154:0/1442597097 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f28d415d220 0x7f28d414e5e0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f28bc0ae040 tx=0x7f28bc019150 comp rx=0 tx=0).stop 2023-11-13T11:28:33.484 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-13T11:28:33.481+0000 7f28d8a5a640 1 -- 172.21.15.154:0/1442597097 shutdown_connections 2023-11-13T11:28:33.484 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-13T11:28:33.481+0000 7f28d8a5a640 1 --2- 172.21.15.154:0/1442597097 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f28d415d600 0x7f28d414ee50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:28:33.485 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-13T11:28:33.481+0000 7f28d8a5a640 1 --2- 172.21.15.154:0/1442597097 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f28d415d220 0x7f28d414e5e0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:28:33.485 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-13T11:28:33.481+0000 7f28d8a5a640 1 --2- 172.21.15.154:0/1442597097 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f28d40b3f60 0x7f28d4152860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:28:33.485 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-13T11:28:33.481+0000 7f28d8a5a640 1 -- 172.21.15.154:0/1442597097 >> 172.21.15.154:0/1442597097 conn(0x7f28d40d2df0 msgr2=0x7f28d40d3750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-13T11:28:33.485 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-13T11:28:33.481+0000 7f28d8a5a640 1 -- 172.21.15.154:0/1442597097 shutdown_connections 2023-11-13T11:28:33.485 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-13T11:28:33.481+0000 7f28d8a5a640 1 -- 172.21.15.154:0/1442597097 wait complete. 2023-11-13T11:28:33.500 INFO:tasks.ceph.mgr.y.smithi102.stderr:2023-11-13T11:28:33.492+0000 7f471a1f6180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-11-13T11:28:33.502 DEBUG:teuthology.orchestra.run.smithi154:> sudo ceph --cluster ceph osd new f0033196-dec9-4ae9-945e-6aeef6dbb47f 1 2023-11-13T11:28:33.506 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-11-13T11:28:33.505+0000 7f059c834180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-11-13T11:28:33.562 INFO:tasks.ceph.mgr.y.smithi102.stderr:2023-11-13T11:28:33.556+0000 7f471a1f6180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-11-13T11:28:33.570 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-11-13T11:28:33.569+0000 7f059c834180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-11-13T11:28:33.622 INFO:tasks.ceph.mgr.y.smithi102.stderr:2023-11-13T11:28:33.616+0000 7f471a1f6180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-11-13T11:28:33.632 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-11-13T11:28:33.629+0000 7f059c834180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-11-13T11:28:33.638 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-13T11:28:33.633+0000 7f7351c68640 1 Processor -- start 2023-11-13T11:28:33.638 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-13T11:28:33.637+0000 7f7351c68640 1 -- start start 2023-11-13T11:28:33.640 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-13T11:28:33.637+0000 7f7351c68640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f734c15d220 0x7f734c0d3910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:28:33.640 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-13T11:28:33.637+0000 7f7351c68640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f734c0b3f60 0x7f734c0b2e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:28:33.640 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-13T11:28:33.637+0000 7f7351c68640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f734c0b3840 con 0x7f734c15d600 2023-11-13T11:28:33.641 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-13T11:28:33.637+0000 7f7351c68640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f734c0cecb0 con 0x7f734c0b3f60 2023-11-13T11:28:33.641 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-13T11:28:33.637+0000 7f7351c68640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f734c0d0d00 con 0x7f734c15d220 2023-11-13T11:28:33.641 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-13T11:28:33.637+0000 7f734b7fe640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f734c15d220 0x7f734c0d3910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:28:33.641 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-13T11:28:33.637+0000 7f734b7fe640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f734c15d220 0x7f734c0d3910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:36650/0 (socket says 172.21.15.154:36650) 2023-11-13T11:28:33.641 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-13T11:28:33.637+0000 7f734b7fe640 1 -- 172.21.15.154:0/394619991 learned_addr learned my addr 172.21.15.154:0/394619991 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-11-13T11:28:33.642 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-13T11:28:33.637+0000 7f734bfff640 1 --2- 172.21.15.154:0/394619991 >> v2:172.21.15.102:3300/0 conn(0x7f734c0b3f60 0x7f734c0b2e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:28:33.642 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-13T11:28:33.637+0000 7f734b7fe640 1 -- 172.21.15.154:0/394619991 >> v2:172.21.15.102:3300/0 conn(0x7f734c0b3f60 msgr2=0x7f734c0b2e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-13T11:28:33.643 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-13T11:28:33.637+0000 7f734b7fe640 1 --2- 172.21.15.154:0/394619991 >> v2:172.21.15.102:3300/0 conn(0x7f734c0b3f60 0x7f734c0b2e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:28:33.643 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-13T11:28:33.637+0000 7f734b7fe640 1 -- 172.21.15.154:0/394619991 >> v1:172.21.15.102:6789/0 conn(0x7f734c15d600 legacy=0x7f734c0b2750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:28:33.643 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-13T11:28:33.637+0000 7f734b7fe640 1 -- 172.21.15.154:0/394619991 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f734c0d0fe0 con 0x7f734c15d220 2023-11-13T11:28:33.644 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-13T11:28:33.641+0000 7f734b7fe640 1 --2- 172.21.15.154:0/394619991 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f734c15d220 0x7f734c0d3910 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f734c08afe0 tx=0x7f733c01c3b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=243adc1d97a7617d server_cookie=0 in_seq=0 out_seq=0 2023-11-13T11:28:33.644 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-13T11:28:33.641+0000 7f734a7fc640 1 -- 172.21.15.154:0/394619991 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f733c0ab600 con 0x7f734c15d220 2023-11-13T11:28:33.644 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-13T11:28:33.641+0000 7f734a7fc640 1 -- 172.21.15.154:0/394619991 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f733c0a7050 con 0x7f734c15d220 2023-11-13T11:28:33.644 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-13T11:28:33.641+0000 7f734a7fc640 1 -- 172.21.15.154:0/394619991 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f733c0ab980 con 0x7f734c15d220 2023-11-13T11:28:33.645 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-13T11:28:33.641+0000 7f7351c68640 1 -- 172.21.15.154:0/394619991 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f734c15d220 msgr2=0x7f734c0d3910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:28:33.645 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-13T11:28:33.641+0000 7f7351c68640 1 --2- 172.21.15.154:0/394619991 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f734c15d220 0x7f734c0d3910 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f734c08afe0 tx=0x7f733c01c3b0 comp rx=0 tx=0).stop 2023-11-13T11:28:33.646 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-13T11:28:33.641+0000 7f7351c68640 1 -- 172.21.15.154:0/394619991 shutdown_connections 2023-11-13T11:28:33.646 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-13T11:28:33.641+0000 7f7351c68640 1 --2- 172.21.15.154:0/394619991 >> v2:172.21.15.102:3300/0 conn(0x7f734c0b3f60 0x7f734c0b2e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:28:33.646 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-13T11:28:33.641+0000 7f7351c68640 1 --2- 172.21.15.154:0/394619991 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f734c15d220 0x7f734c0d3910 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:28:33.646 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-13T11:28:33.641+0000 7f7351c68640 1 -- 172.21.15.154:0/394619991 >> 172.21.15.154:0/394619991 conn(0x7f734c0d2df0 msgr2=0x7f734c0d3200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-13T11:28:33.646 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-13T11:28:33.641+0000 7f7351c68640 1 -- 172.21.15.154:0/394619991 shutdown_connections 2023-11-13T11:28:33.647 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-13T11:28:33.641+0000 7f7351c68640 1 -- 172.21.15.154:0/394619991 wait complete. 2023-11-13T11:28:33.649 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-13T11:28:33.645+0000 7f7351c68640 1 Processor -- start 2023-11-13T11:28:33.649 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-13T11:28:33.645+0000 7f7351c68640 1 -- start start 2023-11-13T11:28:33.649 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-13T11:28:33.645+0000 7f7351c68640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f734c0b3f60 0x7f734c0c9ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:28:33.650 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-13T11:28:33.645+0000 7f7351c68640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f734c15d220 0x7f734c1548e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:28:33.650 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-13T11:28:33.645+0000 7f7351c68640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f734c15d600 0x7f734c15ea30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:28:33.650 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-13T11:28:33.645+0000 7f7351c68640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f734c0b5c50 con 0x7f734c15d220 2023-11-13T11:28:33.650 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-13T11:28:33.645+0000 7f7351c68640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f734c0b5f30 con 0x7f734c15d600 2023-11-13T11:28:33.650 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-13T11:28:33.645+0000 7f7351c68640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f734c0ca400 con 0x7f734c0b3f60 2023-11-13T11:28:33.651 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-13T11:28:33.645+0000 7f734b7fe640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f734c0b3f60 0x7f734c0c9ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:28:33.651 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-13T11:28:33.645+0000 7f734bfff640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f734c15d600 0x7f734c15ea30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:28:33.651 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-13T11:28:33.645+0000 7f734b7fe640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f734c0b3f60 0x7f734c0c9ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:35370/0 (socket says 172.21.15.154:35370) 2023-11-13T11:28:33.651 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-13T11:28:33.645+0000 7f734b7fe640 1 -- 172.21.15.154:0/1430502217 learned_addr learned my addr 172.21.15.154:0/1430502217 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-11-13T11:28:33.651 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-13T11:28:33.645+0000 7f734affd640 1 --2- 172.21.15.154:0/1430502217 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f734c15d220 0x7f734c1548e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:28:33.652 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-13T11:28:33.645+0000 7f734bfff640 1 -- 172.21.15.154:0/1430502217 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f734c0b3f60 msgr2=0x7f734c0c9ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:28:33.652 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-13T11:28:33.645+0000 7f734bfff640 1 --2- 172.21.15.154:0/1430502217 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f734c0b3f60 0x7f734c0c9ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:28:33.652 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-13T11:28:33.645+0000 7f734bfff640 1 -- 172.21.15.154:0/1430502217 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f734c15d220 msgr2=0x7f734c1548e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:28:33.652 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-13T11:28:33.645+0000 7f734bfff640 1 --2- 172.21.15.154:0/1430502217 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f734c15d220 0x7f734c1548e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:28:33.652 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-13T11:28:33.645+0000 7f734bfff640 1 -- 172.21.15.154:0/1430502217 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f733c0094d0 con 0x7f734c15d600 2023-11-13T11:28:33.653 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-13T11:28:33.645+0000 7f734b7fe640 1 --2- 172.21.15.154:0/1430502217 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f734c0b3f60 0x7f734c0c9ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-13T11:28:33.653 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-13T11:28:33.645+0000 7f734bfff640 1 --2- 172.21.15.154:0/1430502217 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f734c15d600 0x7f734c15ea30 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f734400eba0 tx=0x7f734400c490 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-13T11:28:33.653 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-13T11:28:33.645+0000 7f7333fff640 1 -- 172.21.15.154:0/1430502217 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f734400cd20 con 0x7f734c15d600 2023-11-13T11:28:33.653 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-13T11:28:33.645+0000 7f7333fff640 1 -- 172.21.15.154:0/1430502217 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f734400f040 con 0x7f734c15d600 2023-11-13T11:28:33.653 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-13T11:28:33.645+0000 7f7333fff640 1 -- 172.21.15.154:0/1430502217 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73440146c0 con 0x7f734c15d600 2023-11-13T11:28:33.654 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-13T11:28:33.645+0000 7f7351c68640 1 -- 172.21.15.154:0/1430502217 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f734c0ccaa0 con 0x7f734c15d600 2023-11-13T11:28:33.654 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-13T11:28:33.645+0000 7f7333fff640 1 -- 172.21.15.154:0/1430502217 <== mon.1 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f7344014b20 con 0x7f734c15d600 2023-11-13T11:28:33.654 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-13T11:28:33.645+0000 7f7351c68640 1 -- 172.21.15.154:0/1430502217 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f734c0cd060 con 0x7f734c15d600 2023-11-13T11:28:33.654 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-13T11:28:33.645+0000 7f7333fff640 1 -- 172.21.15.154:0/1430502217 <== mon.1 v2:172.21.15.154:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 840+0+0 (secure 0 0 0) 0x7f734401d400 con 0x7f734c15d600 2023-11-13T11:28:33.655 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-13T11:28:33.649+0000 7f7351c68640 1 -- 172.21.15.154:0/1430502217 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f734c0b60a0 con 0x7f734c15d600 2023-11-13T11:28:33.658 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-13T11:28:33.657+0000 7f7333fff640 1 -- 172.21.15.154:0/1430502217 <== mon.1 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72898 (secure 0 0 0) 0x7f734403bce0 con 0x7f734c15d600 2023-11-13T11:28:33.712 INFO:tasks.ceph.mgr.y.smithi102.stderr:2023-11-13T11:28:33.704+0000 7f471a1f6180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-11-13T11:28:33.723 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-13T11:28:33.721+0000 7f7351c68640 1 -- 172.21.15.154:0/1430502217 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd new", "uuid": "f0033196-dec9-4ae9-945e-6aeef6dbb47f", "id": 1} v 0) v1 -- 0x7f734c068520 con 0x7f734c15d600 2023-11-13T11:28:33.725 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-11-13T11:28:33.721+0000 7f059c834180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-11-13T11:28:33.730 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-13T11:28:33.729+0000 7f7333fff640 1 -- 172.21.15.154:0/1430502217 <== mon.1 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "f0033196-dec9-4ae9-945e-6aeef6dbb47f", "id": 1}]=0 v4) v1 ==== 112+0+2 (secure 0 0 0) 0x7f734402a070 con 0x7f734c15d600 2023-11-13T11:28:33.731 INFO:teuthology.orchestra.run.smithi154.stdout:1 2023-11-13T11:28:33.732 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-13T11:28:33.729+0000 7f7351c68640 1 -- 172.21.15.154:0/1430502217 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f734c15d600 msgr2=0x7f734c15ea30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:28:33.732 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-13T11:28:33.729+0000 7f7351c68640 1 --2- 172.21.15.154:0/1430502217 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f734c15d600 0x7f734c15ea30 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f734400eba0 tx=0x7f734400c490 comp rx=0 tx=0).stop 2023-11-13T11:28:33.732 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-13T11:28:33.729+0000 7f7351c68640 1 -- 172.21.15.154:0/1430502217 shutdown_connections 2023-11-13T11:28:33.732 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-13T11:28:33.729+0000 7f7351c68640 1 --2- 172.21.15.154:0/1430502217 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f734c15d600 0x7f734c15ea30 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:28:33.732 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-13T11:28:33.729+0000 7f7351c68640 1 --2- 172.21.15.154:0/1430502217 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f734c15d220 0x7f734c1548e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:28:33.733 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-13T11:28:33.729+0000 7f7351c68640 1 --2- 172.21.15.154:0/1430502217 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f734c0b3f60 0x7f734c0c9ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:28:33.733 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-13T11:28:33.729+0000 7f7351c68640 1 -- 172.21.15.154:0/1430502217 >> 172.21.15.154:0/1430502217 conn(0x7f734c0d2df0 msgr2=0x7f734c0b46c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-13T11:28:33.733 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-13T11:28:33.729+0000 7f7351c68640 1 -- 172.21.15.154:0/1430502217 shutdown_connections 2023-11-13T11:28:33.733 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-13T11:28:33.729+0000 7f7351c68640 1 -- 172.21.15.154:0/1430502217 wait complete. 2023-11-13T11:28:33.750 DEBUG:teuthology.orchestra.run.smithi154:> sudo ceph --cluster ceph osd new 496b0834-351e-4ec2-a714-86ed0c0ff4fd 2 2023-11-13T11:28:33.771 INFO:tasks.ceph.mgr.y.smithi102.stderr:2023-11-13T11:28:33.764+0000 7f471a1f6180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-11-13T11:28:33.788 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-11-13T11:28:33.785+0000 7f059c834180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-11-13T11:28:33.860 INFO:tasks.ceph.mgr.y.smithi102.stderr:2023-11-13T11:28:33.852+0000 7f471a1f6180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-11-13T11:28:33.880 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-11-13T11:28:33.877+0000 7f059c834180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-11-13T11:28:33.888 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-13T11:28:33.885+0000 7fea0626b640 1 Processor -- start 2023-11-13T11:28:33.888 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-13T11:28:33.885+0000 7fea0626b640 1 -- start start 2023-11-13T11:28:33.889 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-13T11:28:33.885+0000 7fea0626b640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fea0015d220 0x7fea000d3910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:28:33.889 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-13T11:28:33.885+0000 7fea0626b640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7fea000b3f60 0x7fea000b2e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:28:33.889 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-13T11:28:33.885+0000 7fea0626b640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fea000b3840 con 0x7fea0015d600 2023-11-13T11:28:33.890 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-13T11:28:33.885+0000 7fea0626b640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fea000cecb0 con 0x7fea000b3f60 2023-11-13T11:28:33.890 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-13T11:28:33.885+0000 7fea0626b640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fea000d0d00 con 0x7fea0015d220 2023-11-13T11:28:33.890 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-13T11:28:33.885+0000 7fe9fffff640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fea0015d220 0x7fea000d3910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:28:33.890 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-13T11:28:33.885+0000 7fe9fffff640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fea0015d220 0x7fea000d3910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:35384/0 (socket says 172.21.15.154:35384) 2023-11-13T11:28:33.891 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-13T11:28:33.885+0000 7fe9fffff640 1 -- 172.21.15.154:0/3678648711 learned_addr learned my addr 172.21.15.154:0/3678648711 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-11-13T11:28:33.891 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-13T11:28:33.885+0000 7fea04808640 1 --2- 172.21.15.154:0/3678648711 >> v2:172.21.15.102:3300/0 conn(0x7fea000b3f60 0x7fea000b2e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:28:33.891 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-13T11:28:33.885+0000 7fe9fffff640 1 -- 172.21.15.154:0/3678648711 >> v2:172.21.15.102:3300/0 conn(0x7fea000b3f60 msgr2=0x7fea000b2e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-13T11:28:33.892 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-13T11:28:33.885+0000 7fe9fffff640 1 --2- 172.21.15.154:0/3678648711 >> v2:172.21.15.102:3300/0 conn(0x7fea000b3f60 0x7fea000b2e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:28:33.892 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-13T11:28:33.885+0000 7fe9fffff640 1 -- 172.21.15.154:0/3678648711 >> v1:172.21.15.102:6789/0 conn(0x7fea0015d600 legacy=0x7fea000b2750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:28:33.892 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-13T11:28:33.885+0000 7fe9fffff640 1 -- 172.21.15.154:0/3678648711 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea000d0fe0 con 0x7fea0015d220 2023-11-13T11:28:33.894 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-13T11:28:33.889+0000 7fe9fffff640 1 --2- 172.21.15.154:0/3678648711 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fea0015d220 0x7fea000d3910 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fe9f0009870 tx=0x7fe9f001c3f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5a45ca3a4ea9c79b server_cookie=0 in_seq=0 out_seq=0 2023-11-13T11:28:33.894 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-13T11:28:33.889+0000 7fe9ff7fe640 1 -- 172.21.15.154:0/3678648711 <== mon.2 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9f00ac410 con 0x7fea0015d220 2023-11-13T11:28:33.894 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-13T11:28:33.889+0000 7fe9ff7fe640 1 -- 172.21.15.154:0/3678648711 <== mon.2 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe9f00ac570 con 0x7fea0015d220 2023-11-13T11:28:33.894 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-13T11:28:33.889+0000 7fe9ff7fe640 1 -- 172.21.15.154:0/3678648711 <== mon.2 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9f00ac900 con 0x7fea0015d220 2023-11-13T11:28:33.895 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-13T11:28:33.889+0000 7fea0626b640 1 -- 172.21.15.154:0/3678648711 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fea0015d220 msgr2=0x7fea000d3910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:28:33.895 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-13T11:28:33.889+0000 7fea0626b640 1 --2- 172.21.15.154:0/3678648711 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fea0015d220 0x7fea000d3910 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fe9f0009870 tx=0x7fe9f001c3f0 comp rx=0 tx=0).stop 2023-11-13T11:28:33.895 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-13T11:28:33.889+0000 7fea0626b640 1 -- 172.21.15.154:0/3678648711 shutdown_connections 2023-11-13T11:28:33.895 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-13T11:28:33.889+0000 7fea0626b640 1 --2- 172.21.15.154:0/3678648711 >> v2:172.21.15.102:3300/0 conn(0x7fea000b3f60 0x7fea000b2e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:28:33.895 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-13T11:28:33.889+0000 7fea0626b640 1 --2- 172.21.15.154:0/3678648711 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fea0015d220 0x7fea000d3910 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:28:33.896 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-13T11:28:33.889+0000 7fea0626b640 1 -- 172.21.15.154:0/3678648711 >> 172.21.15.154:0/3678648711 conn(0x7fea000d2df0 msgr2=0x7fea000d3200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-13T11:28:33.896 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-13T11:28:33.889+0000 7fea0626b640 1 -- 172.21.15.154:0/3678648711 shutdown_connections 2023-11-13T11:28:33.896 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-13T11:28:33.889+0000 7fea0626b640 1 -- 172.21.15.154:0/3678648711 wait complete. 2023-11-13T11:28:33.898 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-13T11:28:33.893+0000 7fea0626b640 1 Processor -- start 2023-11-13T11:28:33.898 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-13T11:28:33.893+0000 7fea0626b640 1 -- start start 2023-11-13T11:28:33.899 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-13T11:28:33.893+0000 7fea0626b640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fea000b3f60 0x7fea001603a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:28:33.899 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-13T11:28:33.893+0000 7fea0626b640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fea0015d220 0x7fea0015b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:28:33.899 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-13T11:28:33.893+0000 7fea0626b640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fea0015d600 0x7fea000c92c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:28:33.899 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-13T11:28:33.893+0000 7fea0626b640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea0015efd0 con 0x7fea0015d600 2023-11-13T11:28:33.900 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-13T11:28:33.893+0000 7fea0626b640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea0015a6f0 con 0x7fea0015d220 2023-11-13T11:28:33.900 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-13T11:28:33.893+0000 7fea0626b640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fea0015a900 con 0x7fea000b3f60 2023-11-13T11:28:33.900 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-13T11:28:33.893+0000 7fe9fffff640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fea000b3f60 0x7fea001603a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:28:33.900 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-13T11:28:33.893+0000 7fe9fffff640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fea000b3f60 0x7fea001603a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:35400/0 (socket says 172.21.15.154:35400) 2023-11-13T11:28:33.901 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-13T11:28:33.893+0000 7fe9fffff640 1 -- 172.21.15.154:0/3162504891 learned_addr learned my addr 172.21.15.154:0/3162504891 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-11-13T11:28:33.901 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-13T11:28:33.893+0000 7fe9f7fff640 1 --2- 172.21.15.154:0/3162504891 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fea0015d220 0x7fea0015b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:28:33.901 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-13T11:28:33.893+0000 7fea04808640 1 --2- 172.21.15.154:0/3162504891 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fea0015d600 0x7fea000c92c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:28:33.901 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-13T11:28:33.893+0000 7fe9fffff640 1 -- 172.21.15.154:0/3162504891 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fea0015d220 msgr2=0x7fea0015b6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:28:33.901 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-13T11:28:33.893+0000 7fe9fffff640 1 --2- 172.21.15.154:0/3162504891 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fea0015d220 0x7fea0015b6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:28:33.901 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-13T11:28:33.893+0000 7fe9fffff640 1 -- 172.21.15.154:0/3162504891 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fea0015d600 msgr2=0x7fea000c92c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:28:33.902 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-13T11:28:33.893+0000 7fe9fffff640 1 --2- 172.21.15.154:0/3162504891 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fea0015d600 0x7fea000c92c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:28:33.902 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-13T11:28:33.893+0000 7fe9fffff640 1 -- 172.21.15.154:0/3162504891 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9f00094d0 con 0x7fea000b3f60 2023-11-13T11:28:33.902 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-13T11:28:33.893+0000 7fe9fffff640 1 --2- 172.21.15.154:0/3162504891 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fea000b3f60 0x7fea001603a0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fe9f00af040 tx=0x7fe9f0019190 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-13T11:28:33.902 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-13T11:28:33.893+0000 7fe9fd7fa640 1 -- 172.21.15.154:0/3162504891 <== mon.2 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9f00ac410 con 0x7fea000b3f60 2023-11-13T11:28:33.903 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-13T11:28:33.893+0000 7fe9fd7fa640 1 -- 172.21.15.154:0/3162504891 <== mon.2 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe9f00b65f0 con 0x7fea000b3f60 2023-11-13T11:28:33.903 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-13T11:28:33.893+0000 7fe9fd7fa640 1 -- 172.21.15.154:0/3162504891 <== mon.2 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9f00b69a0 con 0x7fea000b3f60 2023-11-13T11:28:33.903 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-13T11:28:33.893+0000 7fea0626b640 1 -- 172.21.15.154:0/3162504891 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fea0015abe0 con 0x7fea000b3f60 2023-11-13T11:28:33.903 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-13T11:28:33.897+0000 7fea0626b640 1 -- 172.21.15.154:0/3162504891 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fea0015b1a0 con 0x7fea000b3f60 2023-11-13T11:28:33.903 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-13T11:28:33.897+0000 7fe9fd7fa640 1 -- 172.21.15.154:0/3162504891 <== mon.2 v2:172.21.15.154:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fe9f00b7480 con 0x7fea000b3f60 2023-11-13T11:28:33.904 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-13T11:28:33.897+0000 7fe9fd7fa640 1 -- 172.21.15.154:0/3162504891 <== mon.2 v2:172.21.15.154:3301/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 955+0+0 (secure 0 0 0) 0x7fe9f00b6e00 con 0x7fea000b3f60 2023-11-13T11:28:33.904 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-13T11:28:33.897+0000 7fea0626b640 1 -- 172.21.15.154:0/3162504891 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fea0015ad70 con 0x7fea000b3f60 2023-11-13T11:28:33.905 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-13T11:28:33.897+0000 7fe9fd7fa640 1 -- 172.21.15.154:0/3162504891 <== mon.2 v2:172.21.15.154:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72898 (secure 0 0 0) 0x7fe9f00b1070 con 0x7fea000b3f60 2023-11-13T11:28:33.922 INFO:tasks.ceph.mgr.y.smithi102.stderr:2023-11-13T11:28:33.916+0000 7f471a1f6180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-11-13T11:28:33.956 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-11-13T11:28:33.953+0000 7f059c834180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-11-13T11:28:33.983 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-13T11:28:33.981+0000 7fea0626b640 1 -- 172.21.15.154:0/3162504891 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "osd new", "uuid": "496b0834-351e-4ec2-a714-86ed0c0ff4fd", "id": 2} v 0) v1 -- 0x7fea0015b390 con 0x7fea000b3f60 2023-11-13T11:28:33.989 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-13T11:28:33.985+0000 7fe9fd7fa640 1 -- 172.21.15.154:0/3162504891 <== mon.2 v2:172.21.15.154:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "496b0834-351e-4ec2-a714-86ed0c0ff4fd", "id": 2}]=0 v5) v1 ==== 112+0+2 (secure 0 0 0) 0x7fe9f00b7730 con 0x7fea000b3f60 2023-11-13T11:28:33.989 INFO:teuthology.orchestra.run.smithi154.stdout:2 2023-11-13T11:28:33.990 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-13T11:28:33.989+0000 7fea0626b640 1 -- 172.21.15.154:0/3162504891 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fea000b3f60 msgr2=0x7fea001603a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:28:33.991 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-13T11:28:33.989+0000 7fea0626b640 1 --2- 172.21.15.154:0/3162504891 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fea000b3f60 0x7fea001603a0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fe9f00af040 tx=0x7fe9f0019190 comp rx=0 tx=0).stop 2023-11-13T11:28:33.991 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-13T11:28:33.989+0000 7fea0626b640 1 -- 172.21.15.154:0/3162504891 shutdown_connections 2023-11-13T11:28:33.991 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-13T11:28:33.989+0000 7fea0626b640 1 --2- 172.21.15.154:0/3162504891 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fea0015d600 0x7fea000c92c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:28:33.991 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-13T11:28:33.989+0000 7fea0626b640 1 --2- 172.21.15.154:0/3162504891 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fea0015d220 0x7fea0015b6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:28:33.991 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-13T11:28:33.989+0000 7fea0626b640 1 --2- 172.21.15.154:0/3162504891 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fea000b3f60 0x7fea001603a0 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:28:33.992 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-13T11:28:33.989+0000 7fea0626b640 1 -- 172.21.15.154:0/3162504891 >> 172.21.15.154:0/3162504891 conn(0x7fea000d2df0 msgr2=0x7fea000b0140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-13T11:28:33.992 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-13T11:28:33.989+0000 7fea0626b640 1 -- 172.21.15.154:0/3162504891 shutdown_connections 2023-11-13T11:28:33.992 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-13T11:28:33.989+0000 7fea0626b640 1 -- 172.21.15.154:0/3162504891 wait complete. 2023-11-13T11:28:34.009 DEBUG:teuthology.orchestra.run.smithi154:> sudo ceph --cluster ceph osd new 3ba6cc41-e0a0-4273-86cb-90000c06a55a 3 2023-11-13T11:28:34.077 INFO:tasks.ceph.mgr.y.smithi102.stderr:2023-11-13T11:28:34.068+0000 7f471a1f6180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-11-13T11:28:34.117 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-11-13T11:28:34.113+0000 7f059c834180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-11-13T11:28:34.145 INFO:tasks.ceph.mgr.y.smithi102.stderr:2023-11-13T11:28:34.136+0000 7f471a1f6180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-11-13T11:28:34.184 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-13T11:28:34.181+0000 7f3e4531c640 1 Processor -- start 2023-11-13T11:28:34.184 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-13T11:28:34.181+0000 7f3e4531c640 1 -- start start 2023-11-13T11:28:34.186 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-13T11:28:34.181+0000 7f3e4531c640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f3e400cf2d0 0x7f3e4006c120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:28:34.186 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-13T11:28:34.181+0000 7f3e4531c640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f3e400b1920 0x7f3e4006c660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:28:34.187 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-13T11:28:34.181+0000 7f3e4531c640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3e40070030 con 0x7f3e4015d0b0 2023-11-13T11:28:34.187 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-13T11:28:34.181+0000 7f3e4531c640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3e40070310 con 0x7f3e400b1920 2023-11-13T11:28:34.187 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-13T11:28:34.181+0000 7f3e4531c640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3e400705f0 con 0x7f3e400cf2d0 2023-11-13T11:28:34.187 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-13T11:28:34.181+0000 7f3e3e7fc640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f3e400cf2d0 0x7f3e4006c120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:28:34.187 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-13T11:28:34.181+0000 7f3e3e7fc640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f3e400cf2d0 0x7f3e4006c120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:36680/0 (socket says 172.21.15.154:36680) 2023-11-13T11:28:34.188 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-13T11:28:34.181+0000 7f3e3e7fc640 1 -- 172.21.15.154:0/1496775728 learned_addr learned my addr 172.21.15.154:0/1496775728 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-11-13T11:28:34.188 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-13T11:28:34.185+0000 7f3e3f7fe640 1 --2- 172.21.15.154:0/1496775728 >> v2:172.21.15.102:3300/0 conn(0x7f3e400b1920 0x7f3e4006c660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:28:34.188 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-13T11:28:34.185+0000 7f3e3e7fc640 1 -- 172.21.15.154:0/1496775728 >> v2:172.21.15.102:3300/0 conn(0x7f3e400b1920 msgr2=0x7f3e4006c660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-13T11:28:34.188 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-13T11:28:34.185+0000 7f3e3e7fc640 1 --2- 172.21.15.154:0/1496775728 >> v2:172.21.15.102:3300/0 conn(0x7f3e400b1920 0x7f3e4006c660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:28:34.188 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-13T11:28:34.185+0000 7f3e3e7fc640 1 -- 172.21.15.154:0/1496775728 >> v1:172.21.15.154:6789/0 conn(0x7f3e4015d0b0 legacy=0x7f3e400cebc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:28:34.188 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-13T11:28:34.185+0000 7f3e3e7fc640 1 -- 172.21.15.154:0/1496775728 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e400708d0 con 0x7f3e400cf2d0 2023-11-13T11:28:34.189 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-11-13T11:28:34.185+0000 7f059c834180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-11-13T11:28:34.190 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-13T11:28:34.185+0000 7f3e3e7fc640 1 --2- 172.21.15.154:0/1496775728 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3e400cf2d0 0x7f3e4006c120 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f3e400ae440 tx=0x7f3e3401ecf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b9c6d024effde572 server_cookie=0 in_seq=0 out_seq=0 2023-11-13T11:28:34.190 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-13T11:28:34.185+0000 7f3e3dffb640 1 -- 172.21.15.154:0/1496775728 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e340a89f0 con 0x7f3e400cf2d0 2023-11-13T11:28:34.191 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-13T11:28:34.185+0000 7f3e3dffb640 1 -- 172.21.15.154:0/1496775728 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e340a8b50 con 0x7f3e400cf2d0 2023-11-13T11:28:34.191 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-13T11:28:34.185+0000 7f3e3dffb640 1 -- 172.21.15.154:0/1496775728 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e340b0440 con 0x7f3e400cf2d0 2023-11-13T11:28:34.191 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-13T11:28:34.185+0000 7f3e4531c640 1 -- 172.21.15.154:0/1496775728 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3e400cf2d0 msgr2=0x7f3e4006c120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:28:34.191 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-13T11:28:34.185+0000 7f3e4531c640 1 --2- 172.21.15.154:0/1496775728 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3e400cf2d0 0x7f3e4006c120 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f3e400ae440 tx=0x7f3e3401ecf0 comp rx=0 tx=0).stop 2023-11-13T11:28:34.191 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-13T11:28:34.189+0000 7f3e4531c640 1 -- 172.21.15.154:0/1496775728 shutdown_connections 2023-11-13T11:28:34.192 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-13T11:28:34.189+0000 7f3e4531c640 1 --2- 172.21.15.154:0/1496775728 >> v2:172.21.15.102:3300/0 conn(0x7f3e400b1920 0x7f3e4006c660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:28:34.192 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-13T11:28:34.189+0000 7f3e4531c640 1 --2- 172.21.15.154:0/1496775728 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3e400cf2d0 0x7f3e4006c120 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:28:34.192 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-13T11:28:34.189+0000 7f3e4531c640 1 -- 172.21.15.154:0/1496775728 >> 172.21.15.154:0/1496775728 conn(0x7f3e4006a410 msgr2=0x7f3e4006a820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-13T11:28:34.192 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-13T11:28:34.189+0000 7f3e4531c640 1 -- 172.21.15.154:0/1496775728 shutdown_connections 2023-11-13T11:28:34.192 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-13T11:28:34.189+0000 7f3e4531c640 1 -- 172.21.15.154:0/1496775728 wait complete. 2023-11-13T11:28:34.194 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-13T11:28:34.189+0000 7f3e4531c640 1 Processor -- start 2023-11-13T11:28:34.195 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-13T11:28:34.189+0000 7f3e4531c640 1 -- start start 2023-11-13T11:28:34.195 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-13T11:28:34.189+0000 7f3e4531c640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3e400b1920 0x7f3e401e57e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:28:34.195 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-13T11:28:34.189+0000 7f3e4531c640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3e400cf2d0 0x7f3e40155870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:28:34.195 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-13T11:28:34.189+0000 7f3e4531c640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3e4015d0b0 0x7f3e4015bf70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:28:34.195 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-13T11:28:34.189+0000 7f3e4531c640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e40155540 con 0x7f3e400cf2d0 2023-11-13T11:28:34.196 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-13T11:28:34.189+0000 7f3e4531c640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e4015fd50 con 0x7f3e400b1920 2023-11-13T11:28:34.196 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-13T11:28:34.189+0000 7f3e4531c640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3e40160030 con 0x7f3e4015d0b0 2023-11-13T11:28:34.196 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-13T11:28:34.189+0000 7f3e3f7fe640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3e4015d0b0 0x7f3e4015bf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:28:34.196 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-13T11:28:34.189+0000 7f3e3effd640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3e400b1920 0x7f3e401e57e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:28:34.196 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-13T11:28:34.189+0000 7f3e3f7fe640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3e4015d0b0 0x7f3e4015bf70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:35404/0 (socket says 172.21.15.154:35404) 2023-11-13T11:28:34.197 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-13T11:28:34.189+0000 7f3e3effd640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3e400b1920 0x7f3e401e57e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:36690/0 (socket says 172.21.15.154:36690) 2023-11-13T11:28:34.197 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-13T11:28:34.189+0000 7f3e3f7fe640 1 -- 172.21.15.154:0/1450654162 learned_addr learned my addr 172.21.15.154:0/1450654162 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-11-13T11:28:34.197 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-13T11:28:34.189+0000 7f3e3e7fc640 1 --2- 172.21.15.154:0/1450654162 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3e400cf2d0 0x7f3e40155870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:28:34.197 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-13T11:28:34.189+0000 7f3e3effd640 1 -- 172.21.15.154:0/1450654162 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3e4015d0b0 msgr2=0x7f3e4015bf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:28:34.198 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-13T11:28:34.189+0000 7f3e3effd640 1 --2- 172.21.15.154:0/1450654162 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3e4015d0b0 0x7f3e4015bf70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:28:34.198 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-13T11:28:34.189+0000 7f3e3effd640 1 -- 172.21.15.154:0/1450654162 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3e400cf2d0 msgr2=0x7f3e40155870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:28:34.198 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-13T11:28:34.189+0000 7f3e3effd640 1 --2- 172.21.15.154:0/1450654162 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3e400cf2d0 0x7f3e40155870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:28:34.198 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-13T11:28:34.189+0000 7f3e3effd640 1 -- 172.21.15.154:0/1450654162 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e340094d0 con 0x7f3e400b1920 2023-11-13T11:28:34.198 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-13T11:28:34.189+0000 7f3e3e7fc640 1 --2- 172.21.15.154:0/1450654162 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3e400cf2d0 0x7f3e40155870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-13T11:28:34.199 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-13T11:28:34.193+0000 7f3e3effd640 1 --2- 172.21.15.154:0/1450654162 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3e400b1920 0x7f3e401e57e0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f3e30000f70 tx=0x7f3e3000c890 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-13T11:28:34.199 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-13T11:28:34.193+0000 7f3e277fe640 1 -- 172.21.15.154:0/1450654162 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e300052d0 con 0x7f3e400b1920 2023-11-13T11:28:34.199 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-13T11:28:34.193+0000 7f3e277fe640 1 -- 172.21.15.154:0/1450654162 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e30005430 con 0x7f3e400b1920 2023-11-13T11:28:34.199 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-13T11:28:34.193+0000 7f3e4531c640 1 -- 172.21.15.154:0/1450654162 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3e40160310 con 0x7f3e400b1920 2023-11-13T11:28:34.199 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-13T11:28:34.193+0000 7f3e277fe640 1 -- 172.21.15.154:0/1450654162 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e30003840 con 0x7f3e400b1920 2023-11-13T11:28:34.200 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-13T11:28:34.193+0000 7f3e4531c640 1 -- 172.21.15.154:0/1450654162 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3e40155f70 con 0x7f3e400b1920 2023-11-13T11:28:34.200 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-13T11:28:34.193+0000 7f3e277fe640 1 -- 172.21.15.154:0/1450654162 <== mon.1 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f3e30003ca0 con 0x7f3e400b1920 2023-11-13T11:28:34.200 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-13T11:28:34.193+0000 7f3e277fe640 1 -- 172.21.15.154:0/1450654162 <== mon.1 v2:172.21.15.154:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1070+0+0 (secure 0 0 0) 0x7f3e30011a20 con 0x7f3e400b1920 2023-11-13T11:28:34.201 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-13T11:28:34.193+0000 7f3e4531c640 1 -- 172.21.15.154:0/1450654162 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3e4006fd00 con 0x7f3e400b1920 2023-11-13T11:28:34.201 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-13T11:28:34.197+0000 7f3e277fe640 1 -- 172.21.15.154:0/1450654162 <== mon.1 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72898 (secure 0 0 0) 0x7f3e4006fd00 con 0x7f3e400b1920 2023-11-13T11:28:34.264 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-13T11:28:34.261+0000 7f3e4531c640 1 -- 172.21.15.154:0/1450654162 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd new", "uuid": "3ba6cc41-e0a0-4273-86cb-90000c06a55a", "id": 3} v 0) v1 -- 0x7f3e40067640 con 0x7f3e400b1920 2023-11-13T11:28:34.270 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-13T11:28:34.269+0000 7f3e277fe640 1 -- 172.21.15.154:0/1450654162 <== mon.1 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "3ba6cc41-e0a0-4273-86cb-90000c06a55a", "id": 3}]=0 v6) v1 ==== 112+0+2 (secure 0 0 0) 0x7f3e30017070 con 0x7f3e400b1920 2023-11-13T11:28:34.271 INFO:teuthology.orchestra.run.smithi154.stdout:3 2023-11-13T11:28:34.272 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-13T11:28:34.269+0000 7f3e4531c640 1 -- 172.21.15.154:0/1450654162 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3e400b1920 msgr2=0x7f3e401e57e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:28:34.272 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-13T11:28:34.269+0000 7f3e4531c640 1 --2- 172.21.15.154:0/1450654162 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3e400b1920 0x7f3e401e57e0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f3e30000f70 tx=0x7f3e3000c890 comp rx=0 tx=0).stop 2023-11-13T11:28:34.272 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-13T11:28:34.269+0000 7f3e4531c640 1 -- 172.21.15.154:0/1450654162 shutdown_connections 2023-11-13T11:28:34.272 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-13T11:28:34.269+0000 7f3e4531c640 1 --2- 172.21.15.154:0/1450654162 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3e4015d0b0 0x7f3e4015bf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:28:34.272 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-13T11:28:34.269+0000 7f3e4531c640 1 --2- 172.21.15.154:0/1450654162 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3e400cf2d0 0x7f3e40155870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:28:34.273 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-13T11:28:34.269+0000 7f3e4531c640 1 --2- 172.21.15.154:0/1450654162 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3e400b1920 0x7f3e401e57e0 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:28:34.273 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-13T11:28:34.269+0000 7f3e4531c640 1 -- 172.21.15.154:0/1450654162 >> 172.21.15.154:0/1450654162 conn(0x7f3e4006a410 msgr2=0x7f3e400ae590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-13T11:28:34.273 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-13T11:28:34.269+0000 7f3e4531c640 1 -- 172.21.15.154:0/1450654162 shutdown_connections 2023-11-13T11:28:34.273 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-13T11:28:34.269+0000 7f3e4531c640 1 -- 172.21.15.154:0/1450654162 wait complete. 2023-11-13T11:28:34.290 DEBUG:teuthology.orchestra.run.smithi154:> sudo ceph --cluster ceph osd new 16e797d8-e6e7-4140-95c3-b85283c42a2a 4 2023-11-13T11:28:34.427 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-13T11:28:34.425+0000 7fee1366b640 1 Processor -- start 2023-11-13T11:28:34.427 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-13T11:28:34.425+0000 7fee1366b640 1 -- start start 2023-11-13T11:28:34.429 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-13T11:28:34.425+0000 7fee1366b640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fee0c15d2c0 0x7fee0c0ce790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:28:34.429 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-13T11:28:34.425+0000 7fee1366b640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7fee0c0d03b0 0x7fee0c0cecd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:28:34.430 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-13T11:28:34.425+0000 7fee1366b640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fee0c0cff20 con 0x7fee0c0b32c0 2023-11-13T11:28:34.430 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-13T11:28:34.425+0000 7fee1366b640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fee0c06fc50 con 0x7fee0c0d03b0 2023-11-13T11:28:34.430 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-13T11:28:34.425+0000 7fee1366b640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee0c06f970 con 0x7fee0c15d2c0 2023-11-13T11:28:34.430 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-13T11:28:34.425+0000 7fee11407640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fee0c15d2c0 0x7fee0c0ce790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:28:34.430 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-13T11:28:34.425+0000 7fee11407640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fee0c15d2c0 0x7fee0c0ce790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:35420/0 (socket says 172.21.15.154:35420) 2023-11-13T11:28:34.431 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-13T11:28:34.425+0000 7fee11407640 1 -- 172.21.15.154:0/3706499087 learned_addr learned my addr 172.21.15.154:0/3706499087 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-11-13T11:28:34.431 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-13T11:28:34.425+0000 7fee10c06640 1 --2- 172.21.15.154:0/3706499087 >> v2:172.21.15.102:3300/0 conn(0x7fee0c0d03b0 0x7fee0c0cecd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:28:34.431 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-13T11:28:34.425+0000 7fee11407640 1 -- 172.21.15.154:0/3706499087 >> v2:172.21.15.102:3300/0 conn(0x7fee0c0d03b0 msgr2=0x7fee0c0cecd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-13T11:28:34.431 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-13T11:28:34.425+0000 7fee11407640 1 --2- 172.21.15.154:0/3706499087 >> v2:172.21.15.102:3300/0 conn(0x7fee0c0d03b0 0x7fee0c0cecd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:28:34.432 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-13T11:28:34.425+0000 7fee11407640 1 -- 172.21.15.154:0/3706499087 >> v1:172.21.15.102:6789/0 conn(0x7fee0c0b32c0 legacy=0x7fee0c06b350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-13T11:28:34.432 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-13T11:28:34.425+0000 7fee11407640 1 -- 172.21.15.154:0/3706499087 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee0c0cf8d0 con 0x7fee0c15d2c0 2023-11-13T11:28:34.433 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-13T11:28:34.429+0000 7fee11407640 1 --2- 172.21.15.154:0/3706499087 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fee0c15d2c0 0x7fee0c0ce790 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fee08009870 tx=0x7fee0801c4d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5bed81ec9c253a67 server_cookie=0 in_seq=0 out_seq=0 2023-11-13T11:28:34.434 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-13T11:28:34.429+0000 7fee03fff640 1 -- 172.21.15.154:0/3706499087 <== mon.2 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee080aa410 con 0x7fee0c15d2c0 2023-11-13T11:28:34.434 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-13T11:28:34.429+0000 7fee03fff640 1 -- 172.21.15.154:0/3706499087 <== mon.2 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee080a6040 con 0x7fee0c15d2c0 2023-11-13T11:28:34.434 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-13T11:28:34.429+0000 7fee03fff640 1 -- 172.21.15.154:0/3706499087 <== mon.2 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee080aa790 con 0x7fee0c15d2c0 2023-11-13T11:28:34.434 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-13T11:28:34.429+0000 7fee1366b640 1 -- 172.21.15.154:0/3706499087 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fee0c15d2c0 msgr2=0x7fee0c0ce790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:28:34.434 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-13T11:28:34.429+0000 7fee1366b640 1 --2- 172.21.15.154:0/3706499087 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fee0c15d2c0 0x7fee0c0ce790 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fee08009870 tx=0x7fee0801c4d0 comp rx=0 tx=0).stop 2023-11-13T11:28:34.435 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-13T11:28:34.429+0000 7fee1366b640 1 -- 172.21.15.154:0/3706499087 shutdown_connections 2023-11-13T11:28:34.435 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-13T11:28:34.429+0000 7fee1366b640 1 --2- 172.21.15.154:0/3706499087 >> v2:172.21.15.102:3300/0 conn(0x7fee0c0d03b0 0x7fee0c0cecd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:28:34.435 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-13T11:28:34.429+0000 7fee1366b640 1 --2- 172.21.15.154:0/3706499087 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fee0c15d2c0 0x7fee0c0ce790 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:28:34.435 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-13T11:28:34.429+0000 7fee1366b640 1 -- 172.21.15.154:0/3706499087 >> 172.21.15.154:0/3706499087 conn(0x7fee0c0b27d0 msgr2=0x7fee0c0b2bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-13T11:28:34.436 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-13T11:28:34.429+0000 7fee1366b640 1 -- 172.21.15.154:0/3706499087 shutdown_connections 2023-11-13T11:28:34.436 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-13T11:28:34.429+0000 7fee1366b640 1 -- 172.21.15.154:0/3706499087 wait complete. 2023-11-13T11:28:34.438 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-13T11:28:34.433+0000 7fee1366b640 1 Processor -- start 2023-11-13T11:28:34.439 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-13T11:28:34.433+0000 7fee1366b640 1 -- start start 2023-11-13T11:28:34.439 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-13T11:28:34.433+0000 7fee1366b640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fee0c0b32c0 0x7fee0c153af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:28:34.439 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-13T11:28:34.433+0000 7fee1366b640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fee0c0d03b0 0x7fee0c159600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:28:34.439 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-13T11:28:34.433+0000 7fee1366b640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fee0c15d2c0 0x7fee0c0adab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:28:34.439 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-13T11:28:34.433+0000 7fee1366b640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee0c153660 con 0x7fee0c0b32c0 2023-11-13T11:28:34.440 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-13T11:28:34.433+0000 7fee1366b640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee0c152a50 con 0x7fee0c15d2c0 2023-11-13T11:28:34.440 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-13T11:28:34.433+0000 7fee1366b640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee0c152d30 con 0x7fee0c0d03b0 2023-11-13T11:28:34.440 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-13T11:28:34.433+0000 7fee10c06640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fee0c0d03b0 0x7fee0c159600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:28:34.440 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-13T11:28:34.433+0000 7fee11407640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fee0c0b32c0 0x7fee0c153af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:28:34.440 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-13T11:28:34.433+0000 7fee11c08640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fee0c15d2c0 0x7fee0c0adab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:28:34.441 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-13T11:28:34.433+0000 7fee10c06640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fee0c0d03b0 0x7fee0c159600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:35422/0 (socket says 172.21.15.154:35422) 2023-11-13T11:28:34.441 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-13T11:28:34.433+0000 7fee10c06640 1 -- 172.21.15.154:0/692234484 learned_addr learned my addr 172.21.15.154:0/692234484 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-11-13T11:28:34.441 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-13T11:28:34.433+0000 7fee11407640 1 -- 172.21.15.154:0/692234484 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fee0c0d03b0 msgr2=0x7fee0c159600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:28:34.441 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-13T11:28:34.433+0000 7fee11407640 1 --2- 172.21.15.154:0/692234484 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fee0c0d03b0 0x7fee0c159600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:28:34.441 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-13T11:28:34.433+0000 7fee11407640 1 -- 172.21.15.154:0/692234484 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fee0c15d2c0 msgr2=0x7fee0c0adab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:28:34.442 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-13T11:28:34.433+0000 7fee11407640 1 --2- 172.21.15.154:0/692234484 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fee0c15d2c0 0x7fee0c0adab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:28:34.442 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-13T11:28:34.433+0000 7fee11407640 1 -- 172.21.15.154:0/692234484 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee080094d0 con 0x7fee0c0b32c0 2023-11-13T11:28:34.442 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-13T11:28:34.433+0000 7fee10c06640 1 --2- 172.21.15.154:0/692234484 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fee0c0d03b0 0x7fee0c159600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-13T11:28:34.442 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-13T11:28:34.433+0000 7fee11407640 1 --2- 172.21.15.154:0/692234484 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fee0c0b32c0 0x7fee0c153af0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fee080ab000 tx=0x7fee0801ad10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-13T11:28:34.443 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-13T11:28:34.433+0000 7fee01ffb640 1 -- 172.21.15.154:0/692234484 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee080bd5f0 con 0x7fee0c0b32c0 2023-11-13T11:28:34.443 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-13T11:28:34.433+0000 7fee01ffb640 1 -- 172.21.15.154:0/692234484 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee080bd770 con 0x7fee0c0b32c0 2023-11-13T11:28:34.443 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-13T11:28:34.433+0000 7fee01ffb640 1 -- 172.21.15.154:0/692234484 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee080bdb20 con 0x7fee0c0b32c0 2023-11-13T11:28:34.443 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-13T11:28:34.433+0000 7fee1366b640 1 -- 172.21.15.154:0/692234484 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fee0c153010 con 0x7fee0c0b32c0 2023-11-13T11:28:34.443 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-13T11:28:34.437+0000 7fee1366b640 1 -- 172.21.15.154:0/692234484 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fee0c152690 con 0x7fee0c0b32c0 2023-11-13T11:28:34.444 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-13T11:28:34.437+0000 7fee01ffb640 1 -- 172.21.15.154:0/692234484 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fee080b33f0 con 0x7fee0c0b32c0 2023-11-13T11:28:34.444 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-13T11:28:34.437+0000 7fee01ffb640 1 -- 172.21.15.154:0/692234484 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(6..6 src has 1..6) v4 ==== 1185+0+0 (secure 0 0 0) 0x7fee080c78b0 con 0x7fee0c0b32c0 2023-11-13T11:28:34.444 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-13T11:28:34.437+0000 7fee1366b640 1 -- 172.21.15.154:0/692234484 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fee0c068520 con 0x7fee0c0b32c0 2023-11-13T11:28:34.453 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-13T11:28:34.449+0000 7fee01ffb640 1 -- 172.21.15.154:0/692234484 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72898 (secure 0 0 0) 0x7fee080c3060 con 0x7fee0c0b32c0 2023-11-13T11:28:34.562 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-13T11:28:34.561+0000 7fee1366b640 1 -- 172.21.15.154:0/692234484 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "osd new", "uuid": "16e797d8-e6e7-4140-95c3-b85283c42a2a", "id": 4} v 0) v1 -- 0x7fee0c152e70 con 0x7fee0c0b32c0 2023-11-13T11:28:34.566 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-13T11:28:34.565+0000 7fee01ffb640 1 -- 172.21.15.154:0/692234484 <== mon.0 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "16e797d8-e6e7-4140-95c3-b85283c42a2a", "id": 4}]=0 v7) v1 ==== 112+0+2 (secure 0 0 0) 0x7fee0c152e70 con 0x7fee0c0b32c0 2023-11-13T11:28:34.566 INFO:teuthology.orchestra.run.smithi154.stdout:4 2023-11-13T11:28:34.567 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-13T11:28:34.565+0000 7fee1366b640 1 -- 172.21.15.154:0/692234484 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fee0c0b32c0 msgr2=0x7fee0c153af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:28:34.567 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-13T11:28:34.565+0000 7fee1366b640 1 --2- 172.21.15.154:0/692234484 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fee0c0b32c0 0x7fee0c153af0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fee080ab000 tx=0x7fee0801ad10 comp rx=0 tx=0).stop 2023-11-13T11:28:34.568 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-13T11:28:34.565+0000 7fee1366b640 1 -- 172.21.15.154:0/692234484 shutdown_connections 2023-11-13T11:28:34.568 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-13T11:28:34.565+0000 7fee1366b640 1 --2- 172.21.15.154:0/692234484 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fee0c15d2c0 0x7fee0c0adab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:28:34.569 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-13T11:28:34.565+0000 7fee1366b640 1 --2- 172.21.15.154:0/692234484 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fee0c0d03b0 0x7fee0c159600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:28:34.569 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-13T11:28:34.565+0000 7fee1366b640 1 --2- 172.21.15.154:0/692234484 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fee0c0b32c0 0x7fee0c153af0 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:28:34.569 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-13T11:28:34.565+0000 7fee1366b640 1 -- 172.21.15.154:0/692234484 >> 172.21.15.154:0/692234484 conn(0x7fee0c0b27d0 msgr2=0x7fee0c0c6450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-13T11:28:34.569 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-13T11:28:34.565+0000 7fee1366b640 1 -- 172.21.15.154:0/692234484 shutdown_connections 2023-11-13T11:28:34.569 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-13T11:28:34.565+0000 7fee1366b640 1 -- 172.21.15.154:0/692234484 wait complete. 2023-11-13T11:28:34.587 DEBUG:teuthology.orchestra.run.smithi154:> sudo ceph --cluster ceph osd new d6ab225c-1b55-450a-89a9-abe5c3f8d6af 5 2023-11-13T11:28:34.725 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-13T11:28:34.721+0000 7f6c5726b640 1 Processor -- start 2023-11-13T11:28:34.726 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-13T11:28:34.721+0000 7f6c5726b640 1 -- start start 2023-11-13T11:28:34.727 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-13T11:28:34.725+0000 7f6c5726b640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6c501605f0 0x7f6c500afad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:28:34.727 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-13T11:28:34.725+0000 7f6c5726b640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f6c501609d0 0x7f6c500d0200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:28:34.727 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-13T11:28:34.725+0000 7f6c5726b640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6c500cdb40 con 0x7f6c500b1d10 2023-11-13T11:28:34.727 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-13T11:28:34.725+0000 7f6c5726b640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6c500d0740 con 0x7f6c501609d0 2023-11-13T11:28:34.728 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-13T11:28:34.725+0000 7f6c5726b640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c500d3640 con 0x7f6c501605f0 2023-11-13T11:28:34.728 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-13T11:28:34.725+0000 7f6c55007640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6c501605f0 0x7f6c500afad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:28:34.728 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-13T11:28:34.725+0000 7f6c55808640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f6c500b1d10 0x7f6c500d1110 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:54094/0 (socket says 172.21.15.154:54094) 2023-11-13T11:28:34.728 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-13T11:28:34.725+0000 7f6c55808640 1 -- 172.21.15.154:0/3460533958 learned_addr learned my addr 172.21.15.154:0/3460533958 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-11-13T11:28:34.728 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-13T11:28:34.725+0000 7f6c54806640 1 --2- 172.21.15.154:0/3460533958 >> v2:172.21.15.102:3300/0 conn(0x7f6c501609d0 0x7f6c500d0200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:28:34.729 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-13T11:28:34.725+0000 7f6c47fff640 1 -- 172.21.15.154:0/3460533958 <== mon.1 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3999807711 0 0) 0x7f6c500cdb40 con 0x7f6c500b1d10 2023-11-13T11:28:34.729 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-13T11:28:34.725+0000 7f6c55007640 1 -- 172.21.15.154:0/3460533958 >> v2:172.21.15.102:3300/0 conn(0x7f6c501609d0 msgr2=0x7f6c500d0200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-13T11:28:34.730 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-13T11:28:34.725+0000 7f6c55007640 1 --2- 172.21.15.154:0/3460533958 >> v2:172.21.15.102:3300/0 conn(0x7f6c501609d0 0x7f6c500d0200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:28:34.730 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-13T11:28:34.725+0000 7f6c55007640 1 -- 172.21.15.154:0/3460533958 >> v1:172.21.15.154:6789/0 conn(0x7f6c500b1d10 legacy=0x7f6c500d1110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:28:34.730 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-13T11:28:34.725+0000 7f6c55007640 1 -- 172.21.15.154:0/3460533958 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c500d3920 con 0x7f6c501605f0 2023-11-13T11:28:34.732 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-13T11:28:34.729+0000 7f6c55007640 1 --2- 172.21.15.154:0/3460533958 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6c501605f0 0x7f6c500afad0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f6c4c0097c0 tx=0x7f6c4c01c3c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2c4af3b428603ec3 server_cookie=0 in_seq=0 out_seq=0 2023-11-13T11:28:34.732 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-13T11:28:34.729+0000 7f6c47fff640 1 -- 172.21.15.154:0/3460533958 <== mon.2 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c4c0ac640 con 0x7f6c501605f0 2023-11-13T11:28:34.732 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-13T11:28:34.729+0000 7f6c47fff640 1 -- 172.21.15.154:0/3460533958 <== mon.2 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c4c0ac7a0 con 0x7f6c501605f0 2023-11-13T11:28:34.733 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-13T11:28:34.729+0000 7f6c47fff640 1 -- 172.21.15.154:0/3460533958 <== mon.2 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c4c0acb30 con 0x7f6c501605f0 2023-11-13T11:28:34.733 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-13T11:28:34.729+0000 7f6c5726b640 1 -- 172.21.15.154:0/3460533958 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6c501605f0 msgr2=0x7f6c500afad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:28:34.733 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-13T11:28:34.729+0000 7f6c5726b640 1 --2- 172.21.15.154:0/3460533958 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6c501605f0 0x7f6c500afad0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f6c4c0097c0 tx=0x7f6c4c01c3c0 comp rx=0 tx=0).stop 2023-11-13T11:28:34.733 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-13T11:28:34.729+0000 7f6c5726b640 1 -- 172.21.15.154:0/3460533958 shutdown_connections 2023-11-13T11:28:34.734 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-13T11:28:34.729+0000 7f6c5726b640 1 --2- 172.21.15.154:0/3460533958 >> v2:172.21.15.102:3300/0 conn(0x7f6c501609d0 0x7f6c500d0200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:28:34.734 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-13T11:28:34.729+0000 7f6c5726b640 1 --2- 172.21.15.154:0/3460533958 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6c501605f0 0x7f6c500afad0 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:28:34.734 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-13T11:28:34.729+0000 7f6c5726b640 1 -- 172.21.15.154:0/3460533958 >> 172.21.15.154:0/3460533958 conn(0x7f6c5009c100 msgr2=0x7f6c500d2e00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-13T11:28:34.735 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-13T11:28:34.729+0000 7f6c5726b640 1 -- 172.21.15.154:0/3460533958 shutdown_connections 2023-11-13T11:28:34.735 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-13T11:28:34.729+0000 7f6c5726b640 1 -- 172.21.15.154:0/3460533958 wait complete. 2023-11-13T11:28:34.739 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-13T11:28:34.729+0000 7f6c5726b640 1 Processor -- start 2023-11-13T11:28:34.739 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-13T11:28:34.729+0000 7f6c5726b640 1 -- start start 2023-11-13T11:28:34.739 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-13T11:28:34.729+0000 7f6c5726b640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6c500b1d10 0x7f6c500b6e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:28:34.740 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-13T11:28:34.729+0000 7f6c5726b640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6c501605f0 0x7f6c500b7fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:28:34.740 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-13T11:28:34.729+0000 7f6c5726b640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6c501609d0 0x7f6c500cc020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:28:34.740 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-13T11:28:34.729+0000 7f6c5726b640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c501523f0 con 0x7f6c500b1d10 2023-11-13T11:28:34.740 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-13T11:28:34.729+0000 7f6c5726b640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c500b69a0 con 0x7f6c501609d0 2023-11-13T11:28:34.741 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-13T11:28:34.733+0000 7f6c5726b640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c500b5d90 con 0x7f6c501605f0 2023-11-13T11:28:34.741 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-13T11:28:34.733+0000 7f6c54806640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6c501605f0 0x7f6c500b7fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:28:34.741 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-13T11:28:34.733+0000 7f6c55007640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6c500b1d10 0x7f6c500b6e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:28:34.742 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-13T11:28:34.733+0000 7f6c55808640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6c501609d0 0x7f6c500cc020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:28:34.742 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-13T11:28:34.733+0000 7f6c54806640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6c501605f0 0x7f6c500b7fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:35434/0 (socket says 172.21.15.154:35434) 2023-11-13T11:28:34.742 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-13T11:28:34.733+0000 7f6c55007640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6c500b1d10 0x7f6c500b6e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.154:51744/0 (socket says 172.21.15.154:51744) 2023-11-13T11:28:34.742 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-13T11:28:34.733+0000 7f6c54806640 1 -- 172.21.15.154:0/2746679460 learned_addr learned my addr 172.21.15.154:0/2746679460 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-11-13T11:28:34.742 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-13T11:28:34.733+0000 7f6c54806640 1 -- 172.21.15.154:0/2746679460 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6c501609d0 msgr2=0x7f6c500cc020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:28:34.743 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-13T11:28:34.733+0000 7f6c54806640 1 --2- 172.21.15.154:0/2746679460 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6c501609d0 0x7f6c500cc020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:28:34.743 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-13T11:28:34.733+0000 7f6c54806640 1 -- 172.21.15.154:0/2746679460 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6c500b1d10 msgr2=0x7f6c500b6e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:28:34.743 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-13T11:28:34.733+0000 7f6c54806640 1 --2- 172.21.15.154:0/2746679460 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6c500b1d10 0x7f6c500b6e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:28:34.745 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-13T11:28:34.733+0000 7f6c54806640 1 -- 172.21.15.154:0/2746679460 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c4c009420 con 0x7f6c501605f0 2023-11-13T11:28:34.745 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-13T11:28:34.733+0000 7f6c55007640 1 --2- 172.21.15.154:0/2746679460 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6c500b1d10 0x7f6c500b6e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-13T11:28:34.745 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-13T11:28:34.733+0000 7f6c54806640 1 --2- 172.21.15.154:0/2746679460 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6c501605f0 0x7f6c500b7fb0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f6c4000e8a0 tx=0x7f6c4000eca0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-13T11:28:34.746 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-13T11:28:34.733+0000 7f6c45ffb640 1 -- 172.21.15.154:0/2746679460 <== mon.2 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c40009510 con 0x7f6c501605f0 2023-11-13T11:28:34.746 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-13T11:28:34.733+0000 7f6c45ffb640 1 -- 172.21.15.154:0/2746679460 <== mon.2 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c4000c940 con 0x7f6c501605f0 2023-11-13T11:28:34.746 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-13T11:28:34.733+0000 7f6c45ffb640 1 -- 172.21.15.154:0/2746679460 <== mon.2 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c4000ccb0 con 0x7f6c501605f0 2023-11-13T11:28:34.746 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-13T11:28:34.733+0000 7f6c5726b640 1 -- 172.21.15.154:0/2746679460 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6c500b6070 con 0x7f6c501605f0 2023-11-13T11:28:34.746 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-13T11:28:34.733+0000 7f6c5726b640 1 -- 172.21.15.154:0/2746679460 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6c500b6630 con 0x7f6c501605f0 2023-11-13T11:28:34.747 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-13T11:28:34.733+0000 7f6c45ffb640 1 -- 172.21.15.154:0/2746679460 <== mon.2 v2:172.21.15.154:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f6c40005ca0 con 0x7f6c501605f0 2023-11-13T11:28:34.747 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-13T11:28:34.733+0000 7f6c45ffb640 1 -- 172.21.15.154:0/2746679460 <== mon.2 v2:172.21.15.154:3301/0 5 ==== osd_map(7..7 src has 1..7) v4 ==== 1300+0+0 (secure 0 0 0) 0x7f6c4000ce10 con 0x7f6c501605f0 2023-11-13T11:28:34.747 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-13T11:28:34.733+0000 7f6c5726b640 1 -- 172.21.15.154:0/2746679460 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6c50068520 con 0x7f6c501605f0 2023-11-13T11:28:34.747 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-13T11:28:34.737+0000 7f6c45ffb640 1 -- 172.21.15.154:0/2746679460 <== mon.2 v2:172.21.15.154:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72898 (secure 0 0 0) 0x7f6c40021060 con 0x7f6c501605f0 2023-11-13T11:28:34.804 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-13T11:28:34.801+0000 7f6c5726b640 1 -- 172.21.15.154:0/2746679460 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "osd new", "uuid": "d6ab225c-1b55-450a-89a9-abe5c3f8d6af", "id": 5} v 0) v1 -- 0x7f6c5009c5e0 con 0x7f6c501605f0 2023-11-13T11:28:34.810 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-13T11:28:34.805+0000 7f6c45ffb640 1 -- 172.21.15.154:0/2746679460 <== mon.2 v2:172.21.15.154:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "d6ab225c-1b55-450a-89a9-abe5c3f8d6af", "id": 5}]=0 v8) v1 ==== 112+0+2 (secure 0 0 0) 0x7f6c40029020 con 0x7f6c501605f0 2023-11-13T11:28:34.810 INFO:teuthology.orchestra.run.smithi154.stdout:5 2023-11-13T11:28:34.811 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-13T11:28:34.809+0000 7f6c5726b640 1 -- 172.21.15.154:0/2746679460 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6c501605f0 msgr2=0x7f6c500b7fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:28:34.811 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-13T11:28:34.809+0000 7f6c5726b640 1 --2- 172.21.15.154:0/2746679460 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6c501605f0 0x7f6c500b7fb0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f6c4000e8a0 tx=0x7f6c4000eca0 comp rx=0 tx=0).stop 2023-11-13T11:28:34.812 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-13T11:28:34.809+0000 7f6c5726b640 1 -- 172.21.15.154:0/2746679460 shutdown_connections 2023-11-13T11:28:34.812 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-13T11:28:34.809+0000 7f6c5726b640 1 --2- 172.21.15.154:0/2746679460 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6c501609d0 0x7f6c500cc020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:28:34.812 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-13T11:28:34.809+0000 7f6c5726b640 1 --2- 172.21.15.154:0/2746679460 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6c501605f0 0x7f6c500b7fb0 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:28:34.812 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-13T11:28:34.809+0000 7f6c5726b640 1 --2- 172.21.15.154:0/2746679460 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6c500b1d10 0x7f6c500b6e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:28:34.812 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-13T11:28:34.809+0000 7f6c5726b640 1 -- 172.21.15.154:0/2746679460 >> 172.21.15.154:0/2746679460 conn(0x7f6c5009c100 msgr2=0x7f6c500b0aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-13T11:28:34.813 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-13T11:28:34.809+0000 7f6c5726b640 1 -- 172.21.15.154:0/2746679460 shutdown_connections 2023-11-13T11:28:34.813 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-13T11:28:34.809+0000 7f6c5726b640 1 -- 172.21.15.154:0/2746679460 wait complete. 2023-11-13T11:28:34.822 INFO:tasks.ceph.mgr.y.smithi102.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2023-11-13T11:28:34.822 INFO:tasks.ceph.mgr.y.smithi102.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2023-11-13T11:28:34.823 INFO:tasks.ceph.mgr.y.smithi102.stderr: from numpy import show_config as show_numpy_config 2023-11-13T11:28:34.830 DEBUG:teuthology.orchestra.run.smithi154:> sudo ceph --cluster ceph osd new 96f905ac-491c-4662-8e2b-5bb8e929ab9d 6 2023-11-13T11:28:34.882 INFO:tasks.ceph.mgr.y.smithi102.stderr:2023-11-13T11:28:34.876+0000 7f471a1f6180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-11-13T11:28:34.884 INFO:tasks.ceph.mgr.x.smithi154.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2023-11-13T11:28:34.885 INFO:tasks.ceph.mgr.x.smithi154.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2023-11-13T11:28:34.885 INFO:tasks.ceph.mgr.x.smithi154.stderr: from numpy import show_config as show_numpy_config 2023-11-13T11:28:34.943 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-11-13T11:28:34.941+0000 7f059c834180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-11-13T11:28:34.968 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-13T11:28:34.965+0000 7f73093ec640 1 Processor -- start 2023-11-13T11:28:34.968 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-13T11:28:34.965+0000 7f73093ec640 1 -- start start 2023-11-13T11:28:34.969 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-13T11:28:34.965+0000 7f73093ec640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7304159420 0x7f73040b3580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:28:34.969 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-13T11:28:34.965+0000 7f73093ec640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f7304070320 0x7f730406c160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:28:34.970 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-13T11:28:34.965+0000 7f73093ec640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f73040b2af0 con 0x7f73040ce320 2023-11-13T11:28:34.970 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-13T11:28:34.965+0000 7f73093ec640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f73040b2dd0 con 0x7f7304070320 2023-11-13T11:28:34.970 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-13T11:28:34.965+0000 7f73093ec640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f73040b30b0 con 0x7f7304159420 2023-11-13T11:28:34.970 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-13T11:28:34.965+0000 7f72fbfff640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f73040ce320 0x7f730406fc10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:54104/0 (socket says 172.21.15.154:54104) 2023-11-13T11:28:34.971 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-13T11:28:34.965+0000 7f72fbfff640 1 -- 172.21.15.154:0/1855063348 learned_addr learned my addr 172.21.15.154:0/1855063348 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-11-13T11:28:34.971 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-13T11:28:34.965+0000 7f7302ffd640 1 --2- 172.21.15.154:0/1855063348 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7304159420 0x7f73040b3580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:28:34.971 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-13T11:28:34.965+0000 7f73037fe640 1 --2- 172.21.15.154:0/1855063348 >> v2:172.21.15.102:3300/0 conn(0x7f7304070320 0x7f730406c160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:28:34.972 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-13T11:28:34.965+0000 7f7302ffd640 1 -- 172.21.15.154:0/1855063348 >> v2:172.21.15.102:3300/0 conn(0x7f7304070320 msgr2=0x7f730406c160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-13T11:28:34.972 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-13T11:28:34.965+0000 7f7302ffd640 1 --2- 172.21.15.154:0/1855063348 >> v2:172.21.15.102:3300/0 conn(0x7f7304070320 0x7f730406c160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:28:34.972 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-13T11:28:34.965+0000 7f7302ffd640 1 -- 172.21.15.154:0/1855063348 >> v1:172.21.15.154:6789/0 conn(0x7f73040ce320 legacy=0x7f730406fc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:28:34.972 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-13T11:28:34.965+0000 7f7302ffd640 1 -- 172.21.15.154:0/1855063348 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f730406bc40 con 0x7f7304159420 2023-11-13T11:28:34.973 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-13T11:28:34.965+0000 7f73027fc640 1 -- 172.21.15.154:0/1855063348 <== mon.1 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4164455717 0 0) 0x7f73040b2af0 con 0x7f73040ce320 2023-11-13T11:28:34.974 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-13T11:28:34.969+0000 7f7302ffd640 1 --2- 172.21.15.154:0/1855063348 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7304159420 0x7f73040b3580 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f72f40097f0 tx=0x7f72f401c480 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6980a857d5572441 server_cookie=0 in_seq=0 out_seq=0 2023-11-13T11:28:34.974 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-13T11:28:34.969+0000 7f73027fc640 1 -- 172.21.15.154:0/1855063348 <== mon.2 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72f40ab600 con 0x7f7304159420 2023-11-13T11:28:34.974 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-13T11:28:34.969+0000 7f73027fc640 1 -- 172.21.15.154:0/1855063348 <== mon.2 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f72f40a7050 con 0x7f7304159420 2023-11-13T11:28:34.975 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-13T11:28:34.969+0000 7f73027fc640 1 -- 172.21.15.154:0/1855063348 <== mon.2 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72f40ab980 con 0x7f7304159420 2023-11-13T11:28:34.975 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-13T11:28:34.969+0000 7f73093ec640 1 -- 172.21.15.154:0/1855063348 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7304159420 msgr2=0x7f73040b3580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:28:34.975 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-13T11:28:34.969+0000 7f73093ec640 1 --2- 172.21.15.154:0/1855063348 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7304159420 0x7f73040b3580 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f72f40097f0 tx=0x7f72f401c480 comp rx=0 tx=0).stop 2023-11-13T11:28:34.975 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-13T11:28:34.969+0000 7f73093ec640 1 -- 172.21.15.154:0/1855063348 shutdown_connections 2023-11-13T11:28:34.975 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-13T11:28:34.969+0000 7f73093ec640 1 --2- 172.21.15.154:0/1855063348 >> v2:172.21.15.102:3300/0 conn(0x7f7304070320 0x7f730406c160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:28:34.976 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-13T11:28:34.969+0000 7f73093ec640 1 --2- 172.21.15.154:0/1855063348 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7304159420 0x7f73040b3580 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:28:34.976 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-13T11:28:34.969+0000 7f73093ec640 1 -- 172.21.15.154:0/1855063348 >> 172.21.15.154:0/1855063348 conn(0x7f730406a410 msgr2=0x7f730406a820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-13T11:28:34.976 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-13T11:28:34.969+0000 7f73093ec640 1 -- 172.21.15.154:0/1855063348 shutdown_connections 2023-11-13T11:28:34.976 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-13T11:28:34.969+0000 7f73093ec640 1 -- 172.21.15.154:0/1855063348 wait complete. 2023-11-13T11:28:34.979 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-13T11:28:34.973+0000 7f73093ec640 1 Processor -- start 2023-11-13T11:28:34.979 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-13T11:28:34.973+0000 7f73093ec640 1 -- start start 2023-11-13T11:28:34.979 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-13T11:28:34.973+0000 7f73093ec640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7304070320 0x7f73041460d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:28:34.979 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-13T11:28:34.973+0000 7f73093ec640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f73040ce320 0x7f730415cf90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:28:34.980 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-13T11:28:34.973+0000 7f73093ec640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7304159420 0x7f730415d4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:28:34.980 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-13T11:28:34.973+0000 7f73093ec640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7304146b80 con 0x7f73040ce320 2023-11-13T11:28:34.980 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-13T11:28:34.973+0000 7f73093ec640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73041639b0 con 0x7f7304070320 2023-11-13T11:28:34.980 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-13T11:28:34.973+0000 7f73093ec640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7304146610 con 0x7f7304159420 2023-11-13T11:28:34.980 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-13T11:28:34.973+0000 7f7302ffd640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7304070320 0x7f73041460d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:28:34.981 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-13T11:28:34.973+0000 7f7302ffd640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7304070320 0x7f73041460d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:36714/0 (socket says 172.21.15.154:36714) 2023-11-13T11:28:34.981 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-13T11:28:34.973+0000 7f7302ffd640 1 -- 172.21.15.154:0/3105429948 learned_addr learned my addr 172.21.15.154:0/3105429948 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-11-13T11:28:34.981 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-13T11:28:34.973+0000 7f73037fe640 1 --2- 172.21.15.154:0/3105429948 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7304159420 0x7f730415d4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:28:34.981 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-13T11:28:34.973+0000 7f72fbfff640 1 --2- 172.21.15.154:0/3105429948 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f73040ce320 0x7f730415cf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:28:34.981 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-13T11:28:34.973+0000 7f7302ffd640 1 -- 172.21.15.154:0/3105429948 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7304159420 msgr2=0x7f730415d4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:28:34.982 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-13T11:28:34.973+0000 7f7302ffd640 1 --2- 172.21.15.154:0/3105429948 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7304159420 0x7f730415d4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:28:34.982 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-13T11:28:34.973+0000 7f7302ffd640 1 -- 172.21.15.154:0/3105429948 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f73040ce320 msgr2=0x7f730415cf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:28:34.982 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-13T11:28:34.973+0000 7f7302ffd640 1 --2- 172.21.15.154:0/3105429948 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f73040ce320 0x7f730415cf90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:28:34.982 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-13T11:28:34.973+0000 7f7302ffd640 1 -- 172.21.15.154:0/3105429948 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72f4009420 con 0x7f7304070320 2023-11-13T11:28:34.982 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-13T11:28:34.973+0000 7f73037fe640 1 --2- 172.21.15.154:0/3105429948 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7304159420 0x7f730415d4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-13T11:28:34.983 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-13T11:28:34.973+0000 7f72fbfff640 1 --2- 172.21.15.154:0/3105429948 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f73040ce320 0x7f730415cf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-13T11:28:34.983 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-13T11:28:34.973+0000 7f7302ffd640 1 --2- 172.21.15.154:0/3105429948 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7304070320 0x7f73041460d0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f72f40ae040 tx=0x7f72f401acc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-13T11:28:34.983 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-13T11:28:34.977+0000 7f72fb7fe640 1 -- 172.21.15.154:0/3105429948 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72f40b7450 con 0x7f7304070320 2023-11-13T11:28:34.983 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-13T11:28:34.977+0000 7f72fb7fe640 1 -- 172.21.15.154:0/3105429948 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f72f40b75b0 con 0x7f7304070320 2023-11-13T11:28:34.983 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-13T11:28:34.977+0000 7f72fb7fe640 1 -- 172.21.15.154:0/3105429948 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72f40b7960 con 0x7f7304070320 2023-11-13T11:28:34.984 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-13T11:28:34.977+0000 7f73093ec640 1 -- 172.21.15.154:0/3105429948 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f73041f9f00 con 0x7f7304070320 2023-11-13T11:28:34.984 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-13T11:28:34.977+0000 7f73093ec640 1 -- 172.21.15.154:0/3105429948 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f730415a2a0 con 0x7f7304070320 2023-11-13T11:28:34.984 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-13T11:28:34.977+0000 7f72fb7fe640 1 -- 172.21.15.154:0/3105429948 <== mon.1 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f72f40c0400 con 0x7f7304070320 2023-11-13T11:28:34.984 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-13T11:28:34.977+0000 7f72fb7fe640 1 -- 172.21.15.154:0/3105429948 <== mon.1 v2:172.21.15.154:3300/0 5 ==== osd_map(8..8 src has 1..8) v4 ==== 1415+0+0 (secure 0 0 0) 0x7f72f40b7dc0 con 0x7f7304070320 2023-11-13T11:28:34.985 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-13T11:28:34.977+0000 7f73093ec640 1 -- 172.21.15.154:0/3105429948 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7304067640 con 0x7f7304070320 2023-11-13T11:28:34.985 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-13T11:28:34.981+0000 7f72fb7fe640 1 -- 172.21.15.154:0/3105429948 <== mon.1 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72898 (secure 0 0 0) 0x7f72f40dece0 con 0x7f7304070320 2023-11-13T11:28:35.018 INFO:tasks.ceph.mgr.y.smithi102.stderr:2023-11-13T11:28:35.012+0000 7f471a1f6180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-11-13T11:28:35.057 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-13T11:28:35.053+0000 7f73093ec640 1 -- 172.21.15.154:0/3105429948 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd new", "uuid": "96f905ac-491c-4662-8e2b-5bb8e929ab9d", "id": 6} v 0) v1 -- 0x7f7304068520 con 0x7f7304070320 2023-11-13T11:28:35.062 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-13T11:28:35.061+0000 7f72fb7fe640 1 -- 172.21.15.154:0/3105429948 <== mon.1 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "96f905ac-491c-4662-8e2b-5bb8e929ab9d", "id": 6}]=0 v9) v1 ==== 112+0+2 (secure 0 0 0) 0x7f72f40cd030 con 0x7f7304070320 2023-11-13T11:28:35.063 INFO:teuthology.orchestra.run.smithi154.stdout:6 2023-11-13T11:28:35.064 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-13T11:28:35.061+0000 7f73093ec640 1 -- 172.21.15.154:0/3105429948 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7304070320 msgr2=0x7f73041460d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:28:35.064 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-13T11:28:35.061+0000 7f73093ec640 1 --2- 172.21.15.154:0/3105429948 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7304070320 0x7f73041460d0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f72f40ae040 tx=0x7f72f401acc0 comp rx=0 tx=0).stop 2023-11-13T11:28:35.064 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-13T11:28:35.061+0000 7f73093ec640 1 -- 172.21.15.154:0/3105429948 shutdown_connections 2023-11-13T11:28:35.064 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-13T11:28:35.061+0000 7f73093ec640 1 --2- 172.21.15.154:0/3105429948 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7304159420 0x7f730415d4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:28:35.064 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-13T11:28:35.061+0000 7f73093ec640 1 --2- 172.21.15.154:0/3105429948 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f73040ce320 0x7f730415cf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:28:35.065 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-13T11:28:35.061+0000 7f73093ec640 1 --2- 172.21.15.154:0/3105429948 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7304070320 0x7f73041460d0 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:28:35.065 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-13T11:28:35.061+0000 7f73093ec640 1 -- 172.21.15.154:0/3105429948 >> 172.21.15.154:0/3105429948 conn(0x7f730406a410 msgr2=0x7f73040b10a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-13T11:28:35.065 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-13T11:28:35.061+0000 7f73093ec640 1 -- 172.21.15.154:0/3105429948 shutdown_connections 2023-11-13T11:28:35.065 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-13T11:28:35.061+0000 7f73093ec640 1 -- 172.21.15.154:0/3105429948 wait complete. 2023-11-13T11:28:35.082 DEBUG:teuthology.orchestra.run.smithi154:> sudo ceph --cluster ceph osd new 07012d3b-3ab4-40df-a471-93caed22e2dc 7 2023-11-13T11:28:35.094 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-11-13T11:28:35.093+0000 7f059c834180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-11-13T11:28:35.198 INFO:tasks.ceph.mgr.y.smithi102.stderr:2023-11-13T11:28:35.192+0000 7f471a1f6180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-11-13T11:28:35.219 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-13T11:28:35.217+0000 7fd41c632640 1 Processor -- start 2023-11-13T11:28:35.220 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-13T11:28:35.217+0000 7fd41c632640 1 -- start start 2023-11-13T11:28:35.221 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-13T11:28:35.217+0000 7fd41c632640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fd4140b31f0 0x7fd4140cf7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:28:35.222 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-13T11:28:35.217+0000 7fd41c632640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7fd4140b38b0 0x7fd4140cfd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:28:35.222 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-13T11:28:35.217+0000 7fd41c632640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd4140d0b90 con 0x7fd4140b5fc0 2023-11-13T11:28:35.222 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-13T11:28:35.217+0000 7fd41c632640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd4140d38d0 con 0x7fd4140b38b0 2023-11-13T11:28:35.222 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-13T11:28:35.217+0000 7fd41c632640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd4140d0de0 con 0x7fd4140b31f0 2023-11-13T11:28:35.222 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-13T11:28:35.217+0000 7fd41a3ce640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fd4140b31f0 0x7fd4140cf7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:28:35.223 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-13T11:28:35.217+0000 7fd41a3ce640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fd4140b31f0 0x7fd4140cf7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:36718/0 (socket says 172.21.15.154:36718) 2023-11-13T11:28:35.223 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-13T11:28:35.217+0000 7fd41a3ce640 1 -- 172.21.15.154:0/2476794198 learned_addr learned my addr 172.21.15.154:0/2476794198 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-11-13T11:28:35.223 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-13T11:28:35.217+0000 7fd419bcd640 1 --2- 172.21.15.154:0/2476794198 >> v2:172.21.15.102:3300/0 conn(0x7fd4140b38b0 0x7fd4140cfd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:28:35.223 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-13T11:28:35.217+0000 7fd41a3ce640 1 -- 172.21.15.154:0/2476794198 >> v2:172.21.15.102:3300/0 conn(0x7fd4140b38b0 msgr2=0x7fd4140cfd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-13T11:28:35.223 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-13T11:28:35.217+0000 7fd41a3ce640 1 --2- 172.21.15.154:0/2476794198 >> v2:172.21.15.102:3300/0 conn(0x7fd4140b38b0 0x7fd4140cfd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:28:35.224 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-13T11:28:35.217+0000 7fd41a3ce640 1 -- 172.21.15.154:0/2476794198 >> v1:172.21.15.102:6789/0 conn(0x7fd4140b5fc0 legacy=0x7fd4140b63c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:28:35.224 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-13T11:28:35.217+0000 7fd41a3ce640 1 -- 172.21.15.154:0/2476794198 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4140d3ae0 con 0x7fd4140b31f0 2023-11-13T11:28:35.224 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-13T11:28:35.221+0000 7fd41a3ce640 1 --2- 172.21.15.154:0/2476794198 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd4140b31f0 0x7fd4140cf7c0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fd41408c030 tx=0x7fd41001c470 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7210f2a8a5141b74 server_cookie=0 in_seq=0 out_seq=0 2023-11-13T11:28:35.225 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-13T11:28:35.221+0000 7fd4193cc640 1 -- 172.21.15.154:0/2476794198 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4100ad680 con 0x7fd4140b31f0 2023-11-13T11:28:35.225 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-13T11:28:35.221+0000 7fd4193cc640 1 -- 172.21.15.154:0/2476794198 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd4100ad7e0 con 0x7fd4140b31f0 2023-11-13T11:28:35.226 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-13T11:28:35.221+0000 7fd4193cc640 1 -- 172.21.15.154:0/2476794198 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4100adb70 con 0x7fd4140b31f0 2023-11-13T11:28:35.226 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-13T11:28:35.221+0000 7fd41c632640 1 -- 172.21.15.154:0/2476794198 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd4140b31f0 msgr2=0x7fd4140cf7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:28:35.227 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-13T11:28:35.221+0000 7fd41c632640 1 --2- 172.21.15.154:0/2476794198 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd4140b31f0 0x7fd4140cf7c0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fd41408c030 tx=0x7fd41001c470 comp rx=0 tx=0).stop 2023-11-13T11:28:35.227 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-13T11:28:35.221+0000 7fd41c632640 1 -- 172.21.15.154:0/2476794198 shutdown_connections 2023-11-13T11:28:35.227 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-13T11:28:35.221+0000 7fd41c632640 1 --2- 172.21.15.154:0/2476794198 >> v2:172.21.15.102:3300/0 conn(0x7fd4140b38b0 0x7fd4140cfd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:28:35.227 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-13T11:28:35.221+0000 7fd41c632640 1 --2- 172.21.15.154:0/2476794198 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd4140b31f0 0x7fd4140cf7c0 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:28:35.227 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-13T11:28:35.221+0000 7fd41c632640 1 -- 172.21.15.154:0/2476794198 >> 172.21.15.154:0/2476794198 conn(0x7fd4140d2db0 msgr2=0x7fd4140d31c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-13T11:28:35.228 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-13T11:28:35.221+0000 7fd41c632640 1 -- 172.21.15.154:0/2476794198 shutdown_connections 2023-11-13T11:28:35.228 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-13T11:28:35.221+0000 7fd41c632640 1 -- 172.21.15.154:0/2476794198 wait complete. 2023-11-13T11:28:35.230 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-13T11:28:35.225+0000 7fd41c632640 1 Processor -- start 2023-11-13T11:28:35.230 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-13T11:28:35.225+0000 7fd41c632640 1 -- start start 2023-11-13T11:28:35.230 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-13T11:28:35.225+0000 7fd41c632640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd4140b31f0 0x7fd414157680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:28:35.231 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-13T11:28:35.225+0000 7fd41c632640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd4140b38b0 0x7fd4140cc050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:28:35.231 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-13T11:28:35.225+0000 7fd41c632640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd4140b5fc0 0x7fd4140cc590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:28:35.231 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-13T11:28:35.225+0000 7fd41c632640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd414157bc0 con 0x7fd4140b38b0 2023-11-13T11:28:35.231 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-13T11:28:35.225+0000 7fd41c632640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4140b2190 con 0x7fd4140b31f0 2023-11-13T11:28:35.232 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-13T11:28:35.225+0000 7fd41c632640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd4140afe10 con 0x7fd4140b5fc0 2023-11-13T11:28:35.232 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-13T11:28:35.225+0000 7fd41a3ce640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd4140b31f0 0x7fd414157680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:28:35.232 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-13T11:28:35.225+0000 7fd41a3ce640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd4140b31f0 0x7fd414157680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:36732/0 (socket says 172.21.15.154:36732) 2023-11-13T11:28:35.232 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-13T11:28:35.225+0000 7fd41abcf640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd4140b5fc0 0x7fd4140cc590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:28:35.233 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-13T11:28:35.225+0000 7fd41a3ce640 1 -- 172.21.15.154:0/3653603410 learned_addr learned my addr 172.21.15.154:0/3653603410 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-11-13T11:28:35.233 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-13T11:28:35.225+0000 7fd419bcd640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd4140b38b0 0x7fd4140cc050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:28:35.233 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-13T11:28:35.225+0000 7fd41a3ce640 1 -- 172.21.15.154:0/3653603410 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd4140b5fc0 msgr2=0x7fd4140cc590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:28:35.233 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-13T11:28:35.225+0000 7fd41a3ce640 1 --2- 172.21.15.154:0/3653603410 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd4140b5fc0 0x7fd4140cc590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:28:35.233 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-13T11:28:35.225+0000 7fd41a3ce640 1 -- 172.21.15.154:0/3653603410 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd4140b38b0 msgr2=0x7fd4140cc050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:28:35.234 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-13T11:28:35.225+0000 7fd41a3ce640 1 --2- 172.21.15.154:0/3653603410 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd4140b38b0 0x7fd4140cc050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:28:35.234 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-13T11:28:35.225+0000 7fd41a3ce640 1 -- 172.21.15.154:0/3653603410 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4100094d0 con 0x7fd4140b31f0 2023-11-13T11:28:35.234 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-13T11:28:35.225+0000 7fd419bcd640 1 --2- 172.21.15.154:0/3653603410 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd4140b38b0 0x7fd4140cc050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-13T11:28:35.234 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-13T11:28:35.225+0000 7fd41a3ce640 1 --2- 172.21.15.154:0/3653603410 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd4140b31f0 0x7fd414157680 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fd41001a0a0 tx=0x7fd41001acb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-13T11:28:35.234 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-13T11:28:35.225+0000 7fd40affd640 1 -- 172.21.15.154:0/3653603410 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4100ade60 con 0x7fd4140b31f0 2023-11-13T11:28:35.235 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-13T11:28:35.225+0000 7fd40affd640 1 -- 172.21.15.154:0/3653603410 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd4100b8450 con 0x7fd4140b31f0 2023-11-13T11:28:35.235 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-13T11:28:35.225+0000 7fd41c632640 1 -- 172.21.15.154:0/3653603410 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd4140b23c0 con 0x7fd4140b31f0 2023-11-13T11:28:35.236 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-13T11:28:35.225+0000 7fd40affd640 1 -- 172.21.15.154:0/3653603410 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4100b87e0 con 0x7fd4140b31f0 2023-11-13T11:28:35.236 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-13T11:28:35.225+0000 7fd41c632640 1 -- 172.21.15.154:0/3653603410 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd4140b2980 con 0x7fd4140b31f0 2023-11-13T11:28:35.236 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-13T11:28:35.229+0000 7fd40affd640 1 -- 172.21.15.154:0/3653603410 <== mon.1 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fd4100b4070 con 0x7fd4140b31f0 2023-11-13T11:28:35.236 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-13T11:28:35.229+0000 7fd40affd640 1 -- 172.21.15.154:0/3653603410 <== mon.1 v2:172.21.15.154:3300/0 5 ==== osd_map(9..9 src has 1..9) v4 ==== 1530+0+0 (secure 0 0 0) 0x7fd4100c1a90 con 0x7fd4140b31f0 2023-11-13T11:28:35.237 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-13T11:28:35.229+0000 7fd41c632640 1 -- 172.21.15.154:0/3653603410 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd4140b2b70 con 0x7fd4140b31f0 2023-11-13T11:28:35.237 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-13T11:28:35.229+0000 7fd40affd640 1 -- 172.21.15.154:0/3653603410 <== mon.1 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72898 (secure 0 0 0) 0x7fd4100bc020 con 0x7fd4140b31f0 2023-11-13T11:28:35.272 INFO:tasks.ceph.mgr.y.smithi102.stderr:2023-11-13T11:28:35.264+0000 7f471a1f6180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-11-13T11:28:35.287 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-11-13T11:28:35.285+0000 7f059c834180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-11-13T11:28:35.313 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-13T11:28:35.309+0000 7fd41c632640 1 -- 172.21.15.154:0/3653603410 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd new", "uuid": "07012d3b-3ab4-40df-a471-93caed22e2dc", "id": 7} v 0) v1 -- 0x7fd414068520 con 0x7fd4140b31f0 2023-11-13T11:28:35.317 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-13T11:28:35.313+0000 7fd40affd640 1 -- 172.21.15.154:0/3653603410 <== mon.1 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "07012d3b-3ab4-40df-a471-93caed22e2dc", "id": 7}]=0 v10) v1 ==== 112+0+2 (secure 0 0 0) 0x7fd4100b2070 con 0x7fd4140b31f0 2023-11-13T11:28:35.318 INFO:teuthology.orchestra.run.smithi154.stdout:7 2023-11-13T11:28:35.319 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-13T11:28:35.317+0000 7fd41c632640 1 -- 172.21.15.154:0/3653603410 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd4140b31f0 msgr2=0x7fd414157680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:28:35.320 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-13T11:28:35.317+0000 7fd41c632640 1 --2- 172.21.15.154:0/3653603410 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd4140b31f0 0x7fd414157680 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fd41001a0a0 tx=0x7fd41001acb0 comp rx=0 tx=0).stop 2023-11-13T11:28:35.320 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-13T11:28:35.317+0000 7fd41c632640 1 -- 172.21.15.154:0/3653603410 shutdown_connections 2023-11-13T11:28:35.320 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-13T11:28:35.317+0000 7fd41c632640 1 --2- 172.21.15.154:0/3653603410 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd4140b5fc0 0x7fd4140cc590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:28:35.320 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-13T11:28:35.317+0000 7fd41c632640 1 --2- 172.21.15.154:0/3653603410 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd4140b38b0 0x7fd4140cc050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:28:35.320 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-13T11:28:35.317+0000 7fd41c632640 1 --2- 172.21.15.154:0/3653603410 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd4140b31f0 0x7fd414157680 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:28:35.321 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-13T11:28:35.317+0000 7fd41c632640 1 -- 172.21.15.154:0/3653603410 >> 172.21.15.154:0/3653603410 conn(0x7fd4140d2db0 msgr2=0x7fd4141603c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-13T11:28:35.321 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-13T11:28:35.317+0000 7fd41c632640 1 -- 172.21.15.154:0/3653603410 shutdown_connections 2023-11-13T11:28:35.321 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-13T11:28:35.317+0000 7fd41c632640 1 -- 172.21.15.154:0/3653603410 wait complete. 2023-11-13T11:28:35.345 INFO:tasks.ceph.osd.0:Restarting daemon 2023-11-13T11:28:35.346 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2023-11-13T11:28:35.351 INFO:tasks.ceph.osd.0:Started 2023-11-13T11:28:35.351 INFO:tasks.ceph.osd.1:Restarting daemon 2023-11-13T11:28:35.351 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2023-11-13T11:28:35.357 INFO:tasks.ceph.osd.1:Started 2023-11-13T11:28:35.357 INFO:tasks.ceph.osd.2:Restarting daemon 2023-11-13T11:28:35.357 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2023-11-13T11:28:35.363 INFO:tasks.ceph.osd.2:Started 2023-11-13T11:28:35.363 INFO:tasks.ceph.osd.3:Restarting daemon 2023-11-13T11:28:35.364 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2023-11-13T11:28:35.369 INFO:tasks.ceph.osd.3:Started 2023-11-13T11:28:35.369 INFO:tasks.ceph.osd.4:Restarting daemon 2023-11-13T11:28:35.370 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2023-11-13T11:28:35.371 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-11-13T11:28:35.369+0000 7f059c834180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-11-13T11:28:35.374 INFO:tasks.ceph.osd.4:Started 2023-11-13T11:28:35.375 INFO:tasks.ceph.osd.5:Restarting daemon 2023-11-13T11:28:35.375 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2023-11-13T11:28:35.378 INFO:tasks.ceph.osd.5:Started 2023-11-13T11:28:35.379 INFO:tasks.ceph.osd.6:Restarting daemon 2023-11-13T11:28:35.379 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2023-11-13T11:28:35.382 INFO:tasks.ceph.osd.6:Started 2023-11-13T11:28:35.383 INFO:tasks.ceph.osd.7:Restarting daemon 2023-11-13T11:28:35.383 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2023-11-13T11:28:35.388 INFO:tasks.ceph.osd.7:Started 2023-11-13T11:28:35.389 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-13T11:28:35.428 INFO:tasks.ceph.mgr.y.smithi102.stderr:2023-11-13T11:28:35.420+0000 7f471a1f6180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-11-13T11:28:35.552 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-11-13T11:28:35.549+0000 7f059c834180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-11-13T11:28:35.569 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:35.560+0000 7fe194217640 1 Processor -- start 2023-11-13T11:28:35.569 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:35.560+0000 7fe194217640 1 -- start start 2023-11-13T11:28:35.571 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:35.564+0000 7fe194217640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe18c0d0c40 0x7fe18c0c69b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:28:35.571 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:35.564+0000 7fe194217640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fe18c0cf490 0x7fe18c0cf920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:28:35.572 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:35.564+0000 7fe194217640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe18c0d1440 con 0x7fe18c1606e0 2023-11-13T11:28:35.573 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:35.564+0000 7fe194217640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe18c0cfe60 con 0x7fe18c0cf490 2023-11-13T11:28:35.573 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:35.564+0000 7fe194217640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe18c0cdb10 con 0x7fe18c0d0c40 2023-11-13T11:28:35.573 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:35.564+0000 7fe191fb3640 1 --1- >> v1:172.21.15.102:6789/0 conn(0x7fe18c1606e0 0x7fe18c0b3e20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.102:6789/0 says I am v1:172.21.15.102:42182/0 (socket says 172.21.15.102:42182) 2023-11-13T11:28:35.573 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:35.564+0000 7fe191fb3640 1 -- 172.21.15.102:0/2534122864 learned_addr learned my addr 172.21.15.102:0/2534122864 (peer_addr_for_me v1:172.21.15.102:0/0) 2023-11-13T11:28:35.573 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:35.564+0000 7fe1927b4640 1 --2- 172.21.15.102:0/2534122864 >> v2:172.21.15.154:3300/0 conn(0x7fe18c0cf490 0x7fe18c0cf920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:28:35.574 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:35.564+0000 7fe1917b2640 1 --2- 172.21.15.102:0/2534122864 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe18c0d0c40 0x7fe18c0c69b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:28:35.574 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:35.564+0000 7fe190fb1640 1 -- 172.21.15.102:0/2534122864 <== mon.0 v1:172.21.15.102:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 215016342 0 0) 0x7fe18c0d1440 con 0x7fe18c1606e0 2023-11-13T11:28:35.574 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:35.564+0000 7fe190fb1640 1 -- 172.21.15.102:0/2534122864 --> v1:172.21.15.102:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe178003530 con 0x7fe18c1606e0 2023-11-13T11:28:35.574 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:35.564+0000 7fe1917b2640 1 -- 172.21.15.102:0/2534122864 >> v2:172.21.15.154:3300/0 conn(0x7fe18c0cf490 msgr2=0x7fe18c0cf920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-13T11:28:35.574 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:35.564+0000 7fe1917b2640 1 --2- 172.21.15.102:0/2534122864 >> v2:172.21.15.154:3300/0 conn(0x7fe18c0cf490 0x7fe18c0cf920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:28:35.575 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:35.564+0000 7fe1917b2640 1 -- 172.21.15.102:0/2534122864 >> v1:172.21.15.102:6789/0 conn(0x7fe18c1606e0 legacy=0x7fe18c0b3e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:28:35.575 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:35.564+0000 7fe1917b2640 1 -- 172.21.15.102:0/2534122864 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe18c0d1690 con 0x7fe18c0d0c40 2023-11-13T11:28:35.575 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:35.564+0000 7fe1927b4640 1 --2- 172.21.15.102:0/2534122864 >> v2:172.21.15.154:3300/0 conn(0x7fe18c0cf490 0x7fe18c0cf920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-13T11:28:35.576 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:35.568+0000 7fe1917b2640 1 --2- 172.21.15.102:0/2534122864 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe18c0d0c40 0x7fe18c0c69b0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fe17c0097c0 tx=0x7fe17c01c3c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=36738f59dfc3392b server_cookie=0 in_seq=0 out_seq=0 2023-11-13T11:28:35.577 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:35.568+0000 7fe190fb1640 1 -- 172.21.15.102:0/2534122864 <== mon.2 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe17c0ac640 con 0x7fe18c0d0c40 2023-11-13T11:28:35.577 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:35.568+0000 7fe190fb1640 1 -- 172.21.15.102:0/2534122864 <== mon.2 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe17c0ac7a0 con 0x7fe18c0d0c40 2023-11-13T11:28:35.577 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:35.568+0000 7fe190fb1640 1 -- 172.21.15.102:0/2534122864 <== mon.2 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe17c0acb30 con 0x7fe18c0d0c40 2023-11-13T11:28:35.577 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:35.568+0000 7fe194217640 1 -- 172.21.15.102:0/2534122864 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe18c0d0c40 msgr2=0x7fe18c0c69b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:28:35.577 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:35.568+0000 7fe194217640 1 --2- 172.21.15.102:0/2534122864 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe18c0d0c40 0x7fe18c0c69b0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fe17c0097c0 tx=0x7fe17c01c3c0 comp rx=0 tx=0).stop 2023-11-13T11:28:35.578 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:35.568+0000 7fe194217640 1 -- 172.21.15.102:0/2534122864 shutdown_connections 2023-11-13T11:28:35.578 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:35.568+0000 7fe194217640 1 --2- 172.21.15.102:0/2534122864 >> v2:172.21.15.154:3300/0 conn(0x7fe18c0cf490 0x7fe18c0cf920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:28:35.578 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:35.568+0000 7fe194217640 1 --2- 172.21.15.102:0/2534122864 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe18c0d0c40 0x7fe18c0c69b0 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:28:35.578 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:35.568+0000 7fe194217640 1 -- 172.21.15.102:0/2534122864 >> 172.21.15.102:0/2534122864 conn(0x7fe18c09c130 msgr2=0x7fe18c0d2e60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-13T11:28:35.578 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:35.568+0000 7fe194217640 1 -- 172.21.15.102:0/2534122864 shutdown_connections 2023-11-13T11:28:35.579 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:35.568+0000 7fe194217640 1 -- 172.21.15.102:0/2534122864 wait complete. 2023-11-13T11:28:35.581 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:35.572+0000 7fe194217640 1 Processor -- start 2023-11-13T11:28:35.581 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:35.572+0000 7fe194217640 1 -- start start 2023-11-13T11:28:35.581 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:35.572+0000 7fe194217640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe18c0cf490 0x7fe18c159e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:28:35.581 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:35.572+0000 7fe194217640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe18c0d0c40 0x7fe18c15c870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:28:35.582 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:35.572+0000 7fe194217640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe18c1606e0 0x7fe18c158750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:28:35.582 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:35.572+0000 7fe194217640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe18c1576b0 con 0x7fe18c0cf490 2023-11-13T11:28:35.582 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:35.572+0000 7fe194217640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe18c157990 con 0x7fe18c0d0c40 2023-11-13T11:28:35.582 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:35.572+0000 7fe194217640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe18c157c70 con 0x7fe18c1606e0 2023-11-13T11:28:35.582 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:35.572+0000 7fe191fb3640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe18c0cf490 0x7fe18c159e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:28:35.583 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:35.572+0000 7fe191fb3640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe18c0cf490 0x7fe18c159e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:48674/0 (socket says 172.21.15.102:48674) 2023-11-13T11:28:35.583 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:35.572+0000 7fe191fb3640 1 -- 172.21.15.102:0/1863381027 learned_addr learned my addr 172.21.15.102:0/1863381027 (peer_addr_for_me v2:172.21.15.102:0/0) 2023-11-13T11:28:35.583 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:35.572+0000 7fe1917b2640 1 --2- 172.21.15.102:0/1863381027 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe18c0d0c40 0x7fe18c15c870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:28:35.583 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:35.572+0000 7fe1927b4640 1 --2- 172.21.15.102:0/1863381027 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe18c1606e0 0x7fe18c158750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:28:35.583 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:35.572+0000 7fe191fb3640 1 -- 172.21.15.102:0/1863381027 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe18c1606e0 msgr2=0x7fe18c158750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:28:35.584 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:35.572+0000 7fe191fb3640 1 --2- 172.21.15.102:0/1863381027 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe18c1606e0 0x7fe18c158750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:28:35.584 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:35.572+0000 7fe191fb3640 1 -- 172.21.15.102:0/1863381027 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe18c0d0c40 msgr2=0x7fe18c15c870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:28:35.584 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:35.572+0000 7fe191fb3640 1 --2- 172.21.15.102:0/1863381027 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe18c0d0c40 0x7fe18c15c870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:28:35.584 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:35.572+0000 7fe191fb3640 1 -- 172.21.15.102:0/1863381027 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe184009a70 con 0x7fe18c0cf490 2023-11-13T11:28:35.584 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:35.572+0000 7fe191fb3640 1 --2- 172.21.15.102:0/1863381027 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe18c0cf490 0x7fe18c159e40 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fe18800c420 tx=0x7fe18800c820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-13T11:28:35.584 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:35.572+0000 7fe1827fc640 1 -- 172.21.15.102:0/1863381027 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe188005cf0 con 0x7fe18c0cf490 2023-11-13T11:28:35.585 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:35.572+0000 7fe1827fc640 1 -- 172.21.15.102:0/1863381027 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe188005e50 con 0x7fe18c0cf490 2023-11-13T11:28:35.585 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:35.572+0000 7fe1827fc640 1 -- 172.21.15.102:0/1863381027 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1880072d0 con 0x7fe18c0cf490 2023-11-13T11:28:35.585 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:35.572+0000 7fe194217640 1 -- 172.21.15.102:0/1863381027 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe17c009420 con 0x7fe18c0cf490 2023-11-13T11:28:35.585 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:35.572+0000 7fe194217640 1 -- 172.21.15.102:0/1863381027 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe18c158230 con 0x7fe18c0cf490 2023-11-13T11:28:35.585 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:35.572+0000 7fe1827fc640 1 -- 172.21.15.102:0/1863381027 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fe18801c440 con 0x7fe18c0cf490 2023-11-13T11:28:35.586 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:35.572+0000 7fe1827fc640 1 -- 172.21.15.102:0/1863381027 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1645+0+0 (secure 0 0 0) 0x7fe18801cdc0 con 0x7fe18c0cf490 2023-11-13T11:28:35.586 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:35.576+0000 7fe194217640 1 -- 172.21.15.102:0/1863381027 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe18c158420 con 0x7fe18c0cf490 2023-11-13T11:28:35.586 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:35.576+0000 7fe1827fc640 1 -- 172.21.15.102:0/1863381027 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72898 (secure 0 0 0) 0x7fe188021060 con 0x7fe18c0cf490 2023-11-13T11:28:35.640 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:35.632+0000 7fe194217640 1 -- 172.21.15.102:0/1863381027 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe18c068520 con 0x7fe18c0cf490 2023-11-13T11:28:35.640 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:35.632+0000 7fe1827fc640 1 -- 172.21.15.102:0/1863381027 <== mon.0 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7057 (secure 0 0 0) 0x7fe188017070 con 0x7fe18c0cf490 2023-11-13T11:28:35.641 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T11:28:35.641 INFO:teuthology.orchestra.run.smithi102.stdout:{"epoch":10,"fsid":"97b3eb2b-7ccf-4aae-8d92-bff986c671ea","created":"2023-11-13T11:28:31.836724+0000","modified":"2023-11-13T11:28:35.312740+0000","last_up_change":"0.000000","last_in_change":"2023-11-13T11:28:35.312740+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"bdefaa17-fcca-4c86-aa40-27dc33a789af","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"f0033196-dec9-4ae9-945e-6aeef6dbb47f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"496b0834-351e-4ec2-a714-86ed0c0ff4fd","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"3ba6cc41-e0a0-4273-86cb-90000c06a55a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"16e797d8-e6e7-4140-95c3-b85283c42a2a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"d6ab225c-1b55-450a-89a9-abe5c3f8d6af","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"96f905ac-491c-4662-8e2b-5bb8e929ab9d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"07012d3b-3ab4-40df-a471-93caed22e2dc","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-13T11:28:35.642 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:35.632+0000 7fe194217640 1 -- 172.21.15.102:0/1863381027 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe18c0cf490 msgr2=0x7fe18c159e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:28:35.642 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:35.632+0000 7fe194217640 1 --2- 172.21.15.102:0/1863381027 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe18c0cf490 0x7fe18c159e40 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fe18800c420 tx=0x7fe18800c820 comp rx=0 tx=0).stop 2023-11-13T11:28:35.642 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:35.632+0000 7fe194217640 1 -- 172.21.15.102:0/1863381027 shutdown_connections 2023-11-13T11:28:35.643 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:35.632+0000 7fe194217640 1 --2- 172.21.15.102:0/1863381027 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe18c1606e0 0x7fe18c158750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:28:35.643 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:35.632+0000 7fe194217640 1 --2- 172.21.15.102:0/1863381027 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe18c0d0c40 0x7fe18c15c870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:28:35.643 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:35.632+0000 7fe194217640 1 --2- 172.21.15.102:0/1863381027 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe18c0cf490 0x7fe18c159e40 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:28:35.643 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:35.632+0000 7fe194217640 1 -- 172.21.15.102:0/1863381027 >> 172.21.15.102:0/1863381027 conn(0x7fe18c09c130 msgr2=0x7fe18c1592e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-13T11:28:35.643 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:35.636+0000 7fe194217640 1 -- 172.21.15.102:0/1863381027 shutdown_connections 2023-11-13T11:28:35.644 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:35.636+0000 7fe194217640 1 -- 172.21.15.102:0/1863381027 wait complete. 2023-11-13T11:28:35.660 INFO:tasks.ceph.ceph_manager.ceph:[] 2023-11-13T11:28:35.661 INFO:tasks.ceph:Waiting for OSDs to come up 2023-11-13T11:28:36.019 INFO:tasks.ceph.osd.0.smithi102.stderr:2023-11-13T11:28:36.012+0000 7efedb42f640 -1 Falling back to public interface 2023-11-13T11:28:36.023 INFO:tasks.ceph.osd.5.smithi154.stderr:2023-11-13T11:28:36.021+0000 7f77f015f640 -1 Falling back to public interface 2023-11-13T11:28:36.027 INFO:tasks.ceph.osd.1.smithi102.stderr:2023-11-13T11:28:36.020+0000 7f33d495a640 -1 Falling back to public interface 2023-11-13T11:28:36.027 INFO:tasks.ceph.osd.2.smithi102.stderr:2023-11-13T11:28:36.020+0000 7f180002c640 -1 Falling back to public interface 2023-11-13T11:28:36.039 INFO:tasks.ceph.osd.4.smithi154.stderr:2023-11-13T11:28:36.037+0000 7fce0a3fd640 -1 Falling back to public interface 2023-11-13T11:28:36.042 INFO:tasks.ceph.osd.3.smithi102.stderr:2023-11-13T11:28:36.036+0000 7f48d4fe8640 -1 Falling back to public interface 2023-11-13T11:28:36.047 INFO:tasks.ceph.osd.6.smithi154.stderr:2023-11-13T11:28:36.045+0000 7f3c83c26640 -1 Falling back to public interface 2023-11-13T11:28:36.059 INFO:tasks.ceph.osd.7.smithi154.stderr:2023-11-13T11:28:36.057+0000 7f10be7a1640 -1 Falling back to public interface 2023-11-13T11:28:36.141 INFO:tasks.ceph.mgr.y.smithi102.stderr:2023-11-13T11:28:36.132+0000 7f471a1f6180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-11-13T11:28:36.227 INFO:tasks.ceph.mgr.y.smithi102.stderr:2023-11-13T11:28:36.220+0000 7f471a1f6180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-11-13T11:28:36.247 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-11-13T11:28:36.245+0000 7f059c834180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-11-13T11:28:36.333 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-11-13T11:28:36.329+0000 7f059c834180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-11-13T11:28:36.421 INFO:tasks.ceph.mgr.y.smithi102.stderr:2023-11-13T11:28:36.412+0000 7f471a1f6180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-11-13T11:28:36.467 DEBUG:teuthology.orchestra.run.smithi102:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-11-13T11:28:36.504 INFO:tasks.ceph.mgr.y.smithi102.stderr:2023-11-13T11:28:36.496+0000 7f471a1f6180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-11-13T11:28:36.523 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-11-13T11:28:36.521+0000 7f059c834180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-11-13T11:28:36.595 INFO:teuthology.misc.health.smithi102.stderr:2023-11-13T11:28:36.588+0000 7f165f1f8640 1 Processor -- start 2023-11-13T11:28:36.595 INFO:teuthology.misc.health.smithi102.stderr:2023-11-13T11:28:36.588+0000 7f165f1f8640 1 -- start start 2023-11-13T11:28:36.597 INFO:teuthology.misc.health.smithi102.stderr:2023-11-13T11:28:36.588+0000 7f165f1f8640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1658140540 0x7f165815e3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:28:36.597 INFO:teuthology.misc.health.smithi102.stderr:2023-11-13T11:28:36.588+0000 7f165f1f8640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f165806caa0 0x7f16580711f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:28:36.597 INFO:teuthology.misc.health.smithi102.stderr:2023-11-13T11:28:36.588+0000 7f165f1f8640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f165815e910 con 0x7f1658071730 2023-11-13T11:28:36.597 INFO:teuthology.misc.health.smithi102.stderr:2023-11-13T11:28:36.588+0000 7f165f1f8640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1658071be0 con 0x7f165806caa0 2023-11-13T11:28:36.598 INFO:teuthology.misc.health.smithi102.stderr:2023-11-13T11:28:36.588+0000 7f165f1f8640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1658140920 con 0x7f1658140540 2023-11-13T11:28:36.598 INFO:teuthology.misc.health.smithi102.stderr:2023-11-13T11:28:36.588+0000 7f165d795640 1 --1- >> v1:172.21.15.102:6789/0 conn(0x7f1658071730 0x7f165806fd10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.102:6789/0 says I am v1:172.21.15.102:42186/0 (socket says 172.21.15.102:42186) 2023-11-13T11:28:36.598 INFO:teuthology.misc.health.smithi102.stderr:2023-11-13T11:28:36.588+0000 7f165d795640 1 -- 172.21.15.102:0/2462094995 learned_addr learned my addr 172.21.15.102:0/2462094995 (peer_addr_for_me v1:172.21.15.102:0/0) 2023-11-13T11:28:36.598 INFO:teuthology.misc.health.smithi102.stderr:2023-11-13T11:28:36.588+0000 7f1657fff640 1 --2- 172.21.15.102:0/2462094995 >> v2:172.21.15.154:3300/0 conn(0x7f165806caa0 0x7f16580711f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:28:36.598 INFO:teuthology.misc.health.smithi102.stderr:2023-11-13T11:28:36.588+0000 7f165cf94640 1 --2- 172.21.15.102:0/2462094995 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1658140540 0x7f165815e3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:28:36.599 INFO:teuthology.misc.health.smithi102.stderr:2023-11-13T11:28:36.588+0000 7f16577fe640 1 -- 172.21.15.102:0/2462094995 <== mon.0 v1:172.21.15.102:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1371670697 0 0) 0x7f16500014a0 con 0x7f1658071730 2023-11-13T11:28:36.599 INFO:teuthology.misc.health.smithi102.stderr:2023-11-13T11:28:36.588+0000 7f16577fe640 1 -- 172.21.15.102:0/2462094995 --> v1:172.21.15.102:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1648003530 con 0x7f1658071730 2023-11-13T11:28:36.599 INFO:teuthology.misc.health.smithi102.stderr:2023-11-13T11:28:36.588+0000 7f1657fff640 1 -- 172.21.15.102:0/2462094995 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1658140540 msgr2=0x7f165815e3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-13T11:28:36.599 INFO:teuthology.misc.health.smithi102.stderr:2023-11-13T11:28:36.588+0000 7f1657fff640 1 --2- 172.21.15.102:0/2462094995 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1658140540 0x7f165815e3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:28:36.599 INFO:teuthology.misc.health.smithi102.stderr:2023-11-13T11:28:36.588+0000 7f1657fff640 1 -- 172.21.15.102:0/2462094995 >> v1:172.21.15.102:6789/0 conn(0x7f1658071730 legacy=0x7f165806fd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:28:36.600 INFO:teuthology.misc.health.smithi102.stderr:2023-11-13T11:28:36.588+0000 7f1657fff640 1 -- 172.21.15.102:0/2462094995 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16580ccc50 con 0x7f165806caa0 2023-11-13T11:28:36.600 INFO:teuthology.misc.health.smithi102.stderr:2023-11-13T11:28:36.592+0000 7f1657fff640 1 --2- 172.21.15.102:0/2462094995 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f165806caa0 0x7f16580711f0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f16440097c0 tx=0x7f164401c450 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ed0b5061cf6b279d server_cookie=0 in_seq=0 out_seq=0 2023-11-13T11:28:36.602 INFO:teuthology.misc.health.smithi102.stderr:2023-11-13T11:28:36.592+0000 7f16577fe640 1 -- 172.21.15.102:0/2462094995 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16440ab650 con 0x7f165806caa0 2023-11-13T11:28:36.603 INFO:teuthology.misc.health.smithi102.stderr:2023-11-13T11:28:36.592+0000 7f16577fe640 1 -- 172.21.15.102:0/2462094995 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f16440ab7b0 con 0x7f165806caa0 2023-11-13T11:28:36.603 INFO:teuthology.misc.health.smithi102.stderr:2023-11-13T11:28:36.592+0000 7f16577fe640 1 -- 172.21.15.102:0/2462094995 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16440abb40 con 0x7f165806caa0 2023-11-13T11:28:36.603 INFO:teuthology.misc.health.smithi102.stderr:2023-11-13T11:28:36.596+0000 7f165f1f8640 1 -- 172.21.15.102:0/2462094995 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f165806caa0 msgr2=0x7f16580711f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:28:36.603 INFO:teuthology.misc.health.smithi102.stderr:2023-11-13T11:28:36.596+0000 7f165f1f8640 1 --2- 172.21.15.102:0/2462094995 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f165806caa0 0x7f16580711f0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f16440097c0 tx=0x7f164401c450 comp rx=0 tx=0).stop 2023-11-13T11:28:36.604 INFO:teuthology.misc.health.smithi102.stderr:2023-11-13T11:28:36.596+0000 7f165f1f8640 1 -- 172.21.15.102:0/2462094995 shutdown_connections 2023-11-13T11:28:36.604 INFO:teuthology.misc.health.smithi102.stderr:2023-11-13T11:28:36.596+0000 7f165f1f8640 1 --2- 172.21.15.102:0/2462094995 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f165806caa0 0x7f16580711f0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:28:36.604 INFO:teuthology.misc.health.smithi102.stderr:2023-11-13T11:28:36.596+0000 7f165f1f8640 1 --2- 172.21.15.102:0/2462094995 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1658140540 0x7f165815e3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:28:36.604 INFO:teuthology.misc.health.smithi102.stderr:2023-11-13T11:28:36.596+0000 7f165f1f8640 1 -- 172.21.15.102:0/2462094995 >> 172.21.15.102:0/2462094995 conn(0x7f16580b0870 msgr2=0x7f16580b0c80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-13T11:28:36.605 INFO:teuthology.misc.health.smithi102.stderr:2023-11-13T11:28:36.596+0000 7f165f1f8640 1 -- 172.21.15.102:0/2462094995 shutdown_connections 2023-11-13T11:28:36.605 INFO:teuthology.misc.health.smithi102.stderr:2023-11-13T11:28:36.596+0000 7f165f1f8640 1 -- 172.21.15.102:0/2462094995 wait complete. 2023-11-13T11:28:36.608 INFO:teuthology.misc.health.smithi102.stderr:2023-11-13T11:28:36.596+0000 7f165f1f8640 1 Processor -- start 2023-11-13T11:28:36.608 INFO:teuthology.misc.health.smithi102.stderr:2023-11-13T11:28:36.596+0000 7f165f1f8640 1 -- start start 2023-11-13T11:28:36.608 INFO:teuthology.misc.health.smithi102.stderr:2023-11-13T11:28:36.596+0000 7f165f1f8640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f165806caa0 0x7f165813ce30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:28:36.609 INFO:teuthology.misc.health.smithi102.stderr:2023-11-13T11:28:36.596+0000 7f165f1f8640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1658071730 0x7f1658155940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:28:36.609 INFO:teuthology.misc.health.smithi102.stderr:2023-11-13T11:28:36.596+0000 7f165f1f8640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1658140540 0x7f1658155e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:28:36.609 INFO:teuthology.misc.health.smithi102.stderr:2023-11-13T11:28:36.596+0000 7f165f1f8640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16581538c0 con 0x7f1658140540 2023-11-13T11:28:36.609 INFO:teuthology.misc.health.smithi102.stderr:2023-11-13T11:28:36.596+0000 7f165f1f8640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1658154070 con 0x7f1658071730 2023-11-13T11:28:36.610 INFO:teuthology.misc.health.smithi102.stderr:2023-11-13T11:28:36.596+0000 7f165f1f8640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f165813e030 con 0x7f165806caa0 2023-11-13T11:28:36.610 INFO:teuthology.misc.health.smithi102.stderr:2023-11-13T11:28:36.596+0000 7f165d795640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1658140540 0x7f1658155e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:28:36.610 INFO:teuthology.misc.health.smithi102.stderr:2023-11-13T11:28:36.600+0000 7f165d795640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1658140540 0x7f1658155e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:48688/0 (socket says 172.21.15.102:48688) 2023-11-13T11:28:36.610 INFO:teuthology.misc.health.smithi102.stderr:2023-11-13T11:28:36.600+0000 7f165d795640 1 -- 172.21.15.102:0/892710037 learned_addr learned my addr 172.21.15.102:0/892710037 (peer_addr_for_me v2:172.21.15.102:0/0) 2023-11-13T11:28:36.610 INFO:teuthology.misc.health.smithi102.stderr:2023-11-13T11:28:36.600+0000 7f165cf94640 1 --2- 172.21.15.102:0/892710037 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f165806caa0 0x7f165813ce30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:28:36.611 INFO:teuthology.misc.health.smithi102.stderr:2023-11-13T11:28:36.600+0000 7f1657fff640 1 --2- 172.21.15.102:0/892710037 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1658071730 0x7f1658155940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:28:36.611 INFO:teuthology.misc.health.smithi102.stderr:2023-11-13T11:28:36.600+0000 7f165d795640 1 -- 172.21.15.102:0/892710037 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f165806caa0 msgr2=0x7f165813ce30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:28:36.611 INFO:teuthology.misc.health.smithi102.stderr:2023-11-13T11:28:36.600+0000 7f165d795640 1 --2- 172.21.15.102:0/892710037 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f165806caa0 0x7f165813ce30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:28:36.612 INFO:teuthology.misc.health.smithi102.stderr:2023-11-13T11:28:36.600+0000 7f165d795640 1 -- 172.21.15.102:0/892710037 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1658071730 msgr2=0x7f1658155940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:28:36.612 INFO:teuthology.misc.health.smithi102.stderr:2023-11-13T11:28:36.600+0000 7f165d795640 1 --2- 172.21.15.102:0/892710037 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1658071730 0x7f1658155940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:28:36.612 INFO:teuthology.misc.health.smithi102.stderr:2023-11-13T11:28:36.600+0000 7f165d795640 1 -- 172.21.15.102:0/892710037 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1644009420 con 0x7f1658140540 2023-11-13T11:28:36.612 INFO:teuthology.misc.health.smithi102.stderr:2023-11-13T11:28:36.600+0000 7f165d795640 1 --2- 172.21.15.102:0/892710037 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1658140540 0x7f1658155e80 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f165000cb40 tx=0x7f165000a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-13T11:28:36.613 INFO:teuthology.misc.health.smithi102.stderr:2023-11-13T11:28:36.600+0000 7f16557fa640 1 -- 172.21.15.102:0/892710037 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f165000aca0 con 0x7f1658140540 2023-11-13T11:28:36.613 INFO:teuthology.misc.health.smithi102.stderr:2023-11-13T11:28:36.600+0000 7f16557fa640 1 -- 172.21.15.102:0/892710037 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f165000ae00 con 0x7f1658140540 2023-11-13T11:28:36.613 INFO:teuthology.misc.health.smithi102.stderr:2023-11-13T11:28:36.600+0000 7f165f1f8640 1 -- 172.21.15.102:0/892710037 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1658153ab0 con 0x7f1658140540 2023-11-13T11:28:36.613 INFO:teuthology.misc.health.smithi102.stderr:2023-11-13T11:28:36.600+0000 7f16557fa640 1 -- 172.21.15.102:0/892710037 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1650012620 con 0x7f1658140540 2023-11-13T11:28:36.614 INFO:teuthology.misc.health.smithi102.stderr:2023-11-13T11:28:36.600+0000 7f165f1f8640 1 -- 172.21.15.102:0/892710037 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f165813dcc0 con 0x7f1658140540 2023-11-13T11:28:36.614 INFO:teuthology.misc.health.smithi102.stderr:2023-11-13T11:28:36.600+0000 7f16557fa640 1 -- 172.21.15.102:0/892710037 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f1650012a80 con 0x7f1658140540 2023-11-13T11:28:36.614 INFO:teuthology.misc.health.smithi102.stderr:2023-11-13T11:28:36.600+0000 7f16557fa640 1 -- 172.21.15.102:0/892710037 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1645+0+0 (secure 0 0 0) 0x7f1650012d30 con 0x7f1658140540 2023-11-13T11:28:36.614 INFO:teuthology.misc.health.smithi102.stderr:2023-11-13T11:28:36.600+0000 7f165f1f8640 1 -- 172.21.15.102:0/892710037 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f165813e1a0 con 0x7f1658140540 2023-11-13T11:28:36.615 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-11-13T11:28:36.605+0000 7f059c834180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-11-13T11:28:36.615 INFO:teuthology.misc.health.smithi102.stderr:2023-11-13T11:28:36.604+0000 7f16557fa640 1 -- 172.21.15.102:0/892710037 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72898 (secure 0 0 0) 0x7f1650017070 con 0x7f1658140540 2023-11-13T11:28:36.666 INFO:teuthology.misc.health.smithi102.stderr:2023-11-13T11:28:36.660+0000 7f165f1f8640 1 -- 172.21.15.102:0/892710037 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f1658068520 con 0x7f1658140540 2023-11-13T11:28:36.667 INFO:teuthology.misc.health.smithi102.stderr:2023-11-13T11:28:36.660+0000 7f16557fa640 1 -- 172.21.15.102:0/892710037 <== mon.0 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7057 (secure 0 0 0) 0x7f165815e910 con 0x7f1658140540 2023-11-13T11:28:36.667 INFO:teuthology.misc.health.smithi102.stdout: 2023-11-13T11:28:36.667 INFO:teuthology.misc.health.smithi102.stdout:{"epoch":10,"fsid":"97b3eb2b-7ccf-4aae-8d92-bff986c671ea","created":"2023-11-13T11:28:31.836724+0000","modified":"2023-11-13T11:28:35.312740+0000","last_up_change":"0.000000","last_in_change":"2023-11-13T11:28:35.312740+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"bdefaa17-fcca-4c86-aa40-27dc33a789af","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"f0033196-dec9-4ae9-945e-6aeef6dbb47f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"496b0834-351e-4ec2-a714-86ed0c0ff4fd","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"3ba6cc41-e0a0-4273-86cb-90000c06a55a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"16e797d8-e6e7-4140-95c3-b85283c42a2a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"d6ab225c-1b55-450a-89a9-abe5c3f8d6af","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"96f905ac-491c-4662-8e2b-5bb8e929ab9d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"07012d3b-3ab4-40df-a471-93caed22e2dc","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-13T11:28:36.668 INFO:teuthology.misc.health.smithi102.stderr:2023-11-13T11:28:36.660+0000 7f165f1f8640 1 -- 172.21.15.102:0/892710037 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1658140540 msgr2=0x7f1658155e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:28:36.669 INFO:teuthology.misc.health.smithi102.stderr:2023-11-13T11:28:36.660+0000 7f165f1f8640 1 --2- 172.21.15.102:0/892710037 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1658140540 0x7f1658155e80 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f165000cb40 tx=0x7f165000a060 comp rx=0 tx=0).stop 2023-11-13T11:28:36.669 INFO:teuthology.misc.health.smithi102.stderr:2023-11-13T11:28:36.660+0000 7f165f1f8640 1 -- 172.21.15.102:0/892710037 shutdown_connections 2023-11-13T11:28:36.669 INFO:teuthology.misc.health.smithi102.stderr:2023-11-13T11:28:36.660+0000 7f165f1f8640 1 --2- 172.21.15.102:0/892710037 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1658140540 0x7f1658155e80 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:28:36.669 INFO:teuthology.misc.health.smithi102.stderr:2023-11-13T11:28:36.660+0000 7f165f1f8640 1 --2- 172.21.15.102:0/892710037 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1658071730 0x7f1658155940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:28:36.669 INFO:teuthology.misc.health.smithi102.stderr:2023-11-13T11:28:36.660+0000 7f165f1f8640 1 --2- 172.21.15.102:0/892710037 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f165806caa0 0x7f165813ce30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:28:36.670 INFO:teuthology.misc.health.smithi102.stderr:2023-11-13T11:28:36.660+0000 7f165f1f8640 1 -- 172.21.15.102:0/892710037 >> 172.21.15.102:0/892710037 conn(0x7f16580b0870 msgr2=0x7f16580cdc20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-13T11:28:36.670 INFO:teuthology.misc.health.smithi102.stderr:2023-11-13T11:28:36.660+0000 7f165f1f8640 1 -- 172.21.15.102:0/892710037 shutdown_connections 2023-11-13T11:28:36.670 INFO:teuthology.misc.health.smithi102.stderr:2023-11-13T11:28:36.660+0000 7f165f1f8640 1 -- 172.21.15.102:0/892710037 wait complete. 2023-11-13T11:28:36.685 DEBUG:teuthology.misc:0 of 8 OSDs are up 2023-11-13T11:28:36.839 INFO:tasks.ceph.mgr.y.smithi102.stderr:2023-11-13T11:28:36.832+0000 7f471a1f6180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-11-13T11:28:36.908 INFO:tasks.ceph.mgr.y.smithi102.stderr:2023-11-13T11:28:36.900+0000 7f471a1f6180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-11-13T11:28:36.937 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-11-13T11:28:36.933+0000 7f059c834180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-11-13T11:28:37.009 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-11-13T11:28:37.005+0000 7f059c834180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-11-13T11:28:37.931 INFO:tasks.ceph.mgr.y.smithi102.stderr:2023-11-13T11:28:37.928+0000 7f46c1877640 -1 mgr.server handle_report got status from non-daemon mon.b 2023-11-13T11:28:37.931 INFO:tasks.ceph.mgr.y.smithi102.stderr:2023-11-13T11:28:37.928+0000 7f46c1877640 -1 mgr.server handle_report got status from non-daemon mon.c 2023-11-13T11:28:39.862 INFO:tasks.ceph.osd.7.smithi154.stderr:2023-11-13T11:28:39.857+0000 7f10be7a1640 -1 osd.7 0 log_to_monitors true 2023-11-13T11:28:39.970 INFO:tasks.ceph.osd.4.smithi154.stderr:2023-11-13T11:28:39.965+0000 7fce0a3fd640 -1 osd.4 0 log_to_monitors true 2023-11-13T11:28:40.003 INFO:tasks.ceph.osd.0.smithi102.stderr:2023-11-13T11:28:40.000+0000 7efedb42f640 -1 osd.0 0 log_to_monitors true 2023-11-13T11:28:40.040 INFO:tasks.ceph.osd.5.smithi154.stderr:2023-11-13T11:28:40.037+0000 7f77f015f640 -1 osd.5 0 log_to_monitors true 2023-11-13T11:28:40.068 INFO:tasks.ceph.osd.6.smithi154.stderr:2023-11-13T11:28:40.065+0000 7f3c83c26640 -1 osd.6 0 log_to_monitors true 2023-11-13T11:28:40.180 INFO:tasks.ceph.osd.3.smithi102.stderr:2023-11-13T11:28:40.176+0000 7f48d4fe8640 -1 osd.3 0 log_to_monitors true 2023-11-13T11:28:40.191 INFO:tasks.ceph.osd.2.smithi102.stderr:2023-11-13T11:28:40.188+0000 7f180002c640 -1 osd.2 0 log_to_monitors true 2023-11-13T11:28:40.195 INFO:tasks.ceph.osd.1.smithi102.stderr:2023-11-13T11:28:40.192+0000 7f33d495a640 -1 osd.1 0 log_to_monitors true 2023-11-13T11:28:42.071 INFO:tasks.ceph.osd.7.smithi154.stderr:2023-11-13T11:28:42.068+0000 7f10b9f28640 -1 osd.7 0 waiting for initial osdmap 2023-11-13T11:28:42.228 INFO:tasks.ceph.osd.7.smithi154.stderr:2023-11-13T11:28:42.224+0000 7f10b2575640 -1 osd.7 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-11-13T11:28:43.492 DEBUG:teuthology.orchestra.run.smithi102:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-11-13T11:28:43.698 INFO:teuthology.misc.health.smithi102.stderr:2023-11-13T11:28:43.696+0000 7fa62fafe640 1 Processor -- start 2023-11-13T11:28:43.700 INFO:teuthology.misc.health.smithi102.stderr:2023-11-13T11:28:43.696+0000 7fa62fafe640 1 -- start start 2023-11-13T11:28:43.701 INFO:teuthology.misc.health.smithi102.stderr:2023-11-13T11:28:43.696+0000 7fa62fafe640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7fa62815d290 0x7fa6280d38f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:28:43.701 INFO:teuthology.misc.health.smithi102.stderr:2023-11-13T11:28:43.696+0000 7fa62fafe640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fa6280d1380 0x7fa6280cf7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:28:43.701 INFO:teuthology.misc.health.smithi102.stderr:2023-11-13T11:28:43.696+0000 7fa62fafe640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa6280b2660 con 0x7fa6280cfce0 2023-11-13T11:28:43.701 INFO:teuthology.misc.health.smithi102.stderr:2023-11-13T11:28:43.696+0000 7fa62fafe640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa6280d0110 con 0x7fa62815d290 2023-11-13T11:28:43.701 INFO:teuthology.misc.health.smithi102.stderr:2023-11-13T11:28:43.696+0000 7fa62fafe640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa6280d18b0 con 0x7fa6280d1380 2023-11-13T11:28:43.702 INFO:teuthology.misc.health.smithi102.stderr:2023-11-13T11:28:43.696+0000 7fa62d89a640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7fa62815d290 0x7fa6280d38f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:28:43.703 INFO:teuthology.misc.health.smithi102.stderr:2023-11-13T11:28:43.696+0000 7fa62d099640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fa6280d1380 0x7fa6280cf7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:28:43.703 INFO:teuthology.misc.health.smithi102.stderr:2023-11-13T11:28:43.696+0000 7fa62d89a640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7fa62815d290 0x7fa6280d38f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:57326/0 (socket says 172.21.15.102:57326) 2023-11-13T11:28:43.703 INFO:teuthology.misc.health.smithi102.stderr:2023-11-13T11:28:43.696+0000 7fa62d89a640 1 -- 172.21.15.102:0/1881010777 learned_addr learned my addr 172.21.15.102:0/1881010777 (peer_addr_for_me v2:172.21.15.102:0/0) 2023-11-13T11:28:43.703 INFO:teuthology.misc.health.smithi102.stderr:2023-11-13T11:28:43.700+0000 7fa62d099640 1 -- 172.21.15.102:0/1881010777 >> v2:172.21.15.102:3300/0 conn(0x7fa62815d290 msgr2=0x7fa6280d38f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-13T11:28:43.703 INFO:teuthology.misc.health.smithi102.stderr:2023-11-13T11:28:43.700+0000 7fa62d099640 1 --2- 172.21.15.102:0/1881010777 >> v2:172.21.15.102:3300/0 conn(0x7fa62815d290 0x7fa6280d38f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:28:43.704 INFO:teuthology.misc.health.smithi102.stderr:2023-11-13T11:28:43.700+0000 7fa62d099640 1 -- 172.21.15.102:0/1881010777 >> v1:172.21.15.154:6789/0 conn(0x7fa6280cfce0 legacy=0x7fa6280cd8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:28:43.704 INFO:teuthology.misc.health.smithi102.stderr:2023-11-13T11:28:43.700+0000 7fa62d099640 1 -- 172.21.15.102:0/1881010777 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6280d1b90 con 0x7fa6280d1380 2023-11-13T11:28:43.704 INFO:teuthology.misc.health.smithi102.stderr:2023-11-13T11:28:43.700+0000 7fa62d89a640 1 --2- 172.21.15.102:0/1881010777 >> v2:172.21.15.102:3300/0 conn(0x7fa62815d290 0x7fa6280d38f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-13T11:28:43.704 INFO:teuthology.misc.health.smithi102.stderr:2023-11-13T11:28:43.700+0000 7fa62c898640 1 -- 172.21.15.102:0/1881010777 <== mon.1 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1978258174 0 0) 0x7fa6280b2660 con 0x7fa6280cfce0 2023-11-13T11:28:43.707 INFO:teuthology.misc.health.smithi102.stderr:2023-11-13T11:28:43.704+0000 7fa62d099640 1 --2- 172.21.15.102:0/1881010777 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa6280d1380 0x7fa6280cf7a0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fa6280d0890 tx=0x7fa61801c460 comp rx=0 tx=0).ready entity=mon.1 client_cookie=737633a4dc9a1b60 server_cookie=0 in_seq=0 out_seq=0 2023-11-13T11:28:43.708 INFO:teuthology.misc.health.smithi102.stderr:2023-11-13T11:28:43.704+0000 7fa62c898640 1 -- 172.21.15.102:0/1881010777 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa618004230 con 0x7fa6280d1380 2023-11-13T11:28:43.708 INFO:teuthology.misc.health.smithi102.stderr:2023-11-13T11:28:43.704+0000 7fa62c898640 1 -- 172.21.15.102:0/1881010777 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa6180a7050 con 0x7fa6280d1380 2023-11-13T11:28:43.710 INFO:teuthology.misc.health.smithi102.stderr:2023-11-13T11:28:43.704+0000 7fa62c898640 1 -- 172.21.15.102:0/1881010777 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa618003620 con 0x7fa6280d1380 2023-11-13T11:28:43.710 INFO:teuthology.misc.health.smithi102.stderr:2023-11-13T11:28:43.704+0000 7fa62fafe640 1 -- 172.21.15.102:0/1881010777 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa6280d1380 msgr2=0x7fa6280cf7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:28:43.711 INFO:teuthology.misc.health.smithi102.stderr:2023-11-13T11:28:43.704+0000 7fa62fafe640 1 --2- 172.21.15.102:0/1881010777 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa6280d1380 0x7fa6280cf7a0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fa6280d0890 tx=0x7fa61801c460 comp rx=0 tx=0).stop 2023-11-13T11:28:43.711 INFO:teuthology.misc.health.smithi102.stderr:2023-11-13T11:28:43.708+0000 7fa62fafe640 1 -- 172.21.15.102:0/1881010777 shutdown_connections 2023-11-13T11:28:43.711 INFO:teuthology.misc.health.smithi102.stderr:2023-11-13T11:28:43.708+0000 7fa62fafe640 1 --2- 172.21.15.102:0/1881010777 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa6280d1380 0x7fa6280cf7a0 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:28:43.711 INFO:teuthology.misc.health.smithi102.stderr:2023-11-13T11:28:43.708+0000 7fa62fafe640 1 --2- 172.21.15.102:0/1881010777 >> v2:172.21.15.102:3300/0 conn(0x7fa62815d290 0x7fa6280d38f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:28:43.712 INFO:teuthology.misc.health.smithi102.stderr:2023-11-13T11:28:43.708+0000 7fa62fafe640 1 -- 172.21.15.102:0/1881010777 >> 172.21.15.102:0/1881010777 conn(0x7fa6280d2dd0 msgr2=0x7fa6280d31e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-13T11:28:43.712 INFO:teuthology.misc.health.smithi102.stderr:2023-11-13T11:28:43.708+0000 7fa62fafe640 1 -- 172.21.15.102:0/1881010777 shutdown_connections 2023-11-13T11:28:43.712 INFO:teuthology.misc.health.smithi102.stderr:2023-11-13T11:28:43.708+0000 7fa62fafe640 1 -- 172.21.15.102:0/1881010777 wait complete. 2023-11-13T11:28:43.713 INFO:teuthology.misc.health.smithi102.stderr:2023-11-13T11:28:43.708+0000 7fa62fafe640 1 Processor -- start 2023-11-13T11:28:43.715 INFO:teuthology.misc.health.smithi102.stderr:2023-11-13T11:28:43.708+0000 7fa62fafe640 1 -- start start 2023-11-13T11:28:43.715 INFO:teuthology.misc.health.smithi102.stderr:2023-11-13T11:28:43.712+0000 7fa62fafe640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa6280cfce0 0x7fa6281552d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:28:43.715 INFO:teuthology.misc.health.smithi102.stderr:2023-11-13T11:28:43.712+0000 7fa62fafe640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa6280d1380 0x7fa62815d700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:28:43.716 INFO:teuthology.misc.health.smithi102.stderr:2023-11-13T11:28:43.712+0000 7fa62fafe640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa62815d290 0x7fa628154c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:28:43.716 INFO:teuthology.misc.health.smithi102.stderr:2023-11-13T11:28:43.712+0000 7fa62fafe640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa628155140 con 0x7fa6280cfce0 2023-11-13T11:28:43.716 INFO:teuthology.misc.health.smithi102.stderr:2023-11-13T11:28:43.712+0000 7fa62fafe640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6280c5eb0 con 0x7fa62815d290 2023-11-13T11:28:43.716 INFO:teuthology.misc.health.smithi102.stderr:2023-11-13T11:28:43.712+0000 7fa62fafe640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa62815c1b0 con 0x7fa6280d1380 2023-11-13T11:28:43.717 INFO:teuthology.misc.health.smithi102.stderr:2023-11-13T11:28:43.712+0000 7fa62d099640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa6280d1380 0x7fa62815d700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:28:43.717 INFO:teuthology.misc.health.smithi102.stderr:2023-11-13T11:28:43.712+0000 7fa62d099640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa6280d1380 0x7fa62815d700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.102:58280/0 (socket says 172.21.15.102:58280) 2023-11-13T11:28:43.717 INFO:teuthology.misc.health.smithi102.stderr:2023-11-13T11:28:43.712+0000 7fa62d099640 1 -- 172.21.15.102:0/2019920616 learned_addr learned my addr 172.21.15.102:0/2019920616 (peer_addr_for_me v2:172.21.15.102:0/0) 2023-11-13T11:28:43.718 INFO:teuthology.misc.health.smithi102.stderr:2023-11-13T11:28:43.712+0000 7fa62d89a640 1 --2- 172.21.15.102:0/2019920616 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa6280cfce0 0x7fa6281552d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:28:43.718 INFO:teuthology.misc.health.smithi102.stderr:2023-11-13T11:28:43.712+0000 7fa62d099640 1 -- 172.21.15.102:0/2019920616 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa62815d290 msgr2=0x7fa628154c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:28:43.719 INFO:teuthology.misc.health.smithi102.stderr:2023-11-13T11:28:43.712+0000 7fa62d099640 1 --2- 172.21.15.102:0/2019920616 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa62815d290 0x7fa628154c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:28:43.719 INFO:teuthology.misc.health.smithi102.stderr:2023-11-13T11:28:43.712+0000 7fa62d099640 1 -- 172.21.15.102:0/2019920616 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa6280cfce0 msgr2=0x7fa6281552d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:28:43.719 INFO:teuthology.misc.health.smithi102.stderr:2023-11-13T11:28:43.712+0000 7fa62d099640 1 --2- 172.21.15.102:0/2019920616 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa6280cfce0 0x7fa6281552d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:28:43.719 INFO:teuthology.misc.health.smithi102.stderr:2023-11-13T11:28:43.712+0000 7fa62d099640 1 -- 172.21.15.102:0/2019920616 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6240094d0 con 0x7fa6280d1380 2023-11-13T11:28:43.719 INFO:teuthology.misc.health.smithi102.stderr:2023-11-13T11:28:43.712+0000 7fa62d099640 1 --2- 172.21.15.102:0/2019920616 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa6280d1380 0x7fa62815d700 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fa6180ae040 tx=0x7fa618019200 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-13T11:28:43.720 INFO:teuthology.misc.health.smithi102.stderr:2023-11-13T11:28:43.712+0000 7fa61e7fc640 1 -- 172.21.15.102:0/2019920616 <== mon.2 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa618003b70 con 0x7fa6280d1380 2023-11-13T11:28:43.720 INFO:teuthology.misc.health.smithi102.stderr:2023-11-13T11:28:43.712+0000 7fa61e7fc640 1 -- 172.21.15.102:0/2019920616 <== mon.2 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa618003cd0 con 0x7fa6280d1380 2023-11-13T11:28:43.720 INFO:teuthology.misc.health.smithi102.stderr:2023-11-13T11:28:43.712+0000 7fa61e7fc640 1 -- 172.21.15.102:0/2019920616 <== mon.2 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6180ab680 con 0x7fa6280d1380 2023-11-13T11:28:43.721 INFO:teuthology.misc.health.smithi102.stderr:2023-11-13T11:28:43.716+0000 7fa62fafe640 1 -- 172.21.15.102:0/2019920616 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa618009420 con 0x7fa6280d1380 2023-11-13T11:28:43.721 INFO:teuthology.misc.health.smithi102.stderr:2023-11-13T11:28:43.716+0000 7fa62fafe640 1 -- 172.21.15.102:0/2019920616 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa628160480 con 0x7fa6280d1380 2023-11-13T11:28:43.725 INFO:teuthology.misc.health.smithi102.stderr:2023-11-13T11:28:43.720+0000 7fa61e7fc640 1 -- 172.21.15.102:0/2019920616 <== mon.2 v2:172.21.15.154:3301/0 4 ==== mgrmap(e 4) v1 ==== 85796+0+0 (secure 0 0 0) 0x7fa6180b2040 con 0x7fa6280d1380 2023-11-13T11:28:43.725 INFO:teuthology.misc.health.smithi102.stderr:2023-11-13T11:28:43.720+0000 7fa62fafe640 1 -- 172.21.15.102:0/2019920616 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa6280c7120 con 0x7fa6280d1380 2023-11-13T11:28:43.725 INFO:teuthology.misc.health.smithi102.stderr:2023-11-13T11:28:43.720+0000 7fa61e7fc640 1 --2- 172.21.15.102:0/2019920616 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7fa60c066460 0x7fa60c068920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:28:43.725 INFO:teuthology.misc.health.smithi102.stderr:2023-11-13T11:28:43.720+0000 7fa61e7fc640 1 -- 172.21.15.102:0/2019920616 <== mon.2 v2:172.21.15.154:3301/0 5 ==== osd_map(14..14 src has 1..14) v4 ==== 2511+0+0 (secure 0 0 0) 0x7fa61811d110 con 0x7fa6280d1380 2023-11-13T11:28:43.726 INFO:teuthology.misc.health.smithi102.stderr:2023-11-13T11:28:43.720+0000 7fa62d89a640 1 --2- 172.21.15.102:0/2019920616 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7fa60c066460 0x7fa60c068920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:28:43.730 INFO:teuthology.misc.health.smithi102.stderr:2023-11-13T11:28:43.724+0000 7fa62d89a640 1 --2- 172.21.15.102:0/2019920616 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7fa60c066460 0x7fa60c068920 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fa6280c9860 tx=0x7fa624008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-13T11:28:43.740 INFO:teuthology.misc.health.smithi102.stderr:2023-11-13T11:28:43.736+0000 7fa61e7fc640 1 -- 172.21.15.102:0/2019920616 <== mon.2 v2:172.21.15.154:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fa6280c7120 con 0x7fa6280d1380 2023-11-13T11:28:43.855 INFO:tasks.ceph.osd.5.smithi154.stderr:2023-11-13T11:28:43.852+0000 7f77eb8e6640 -1 osd.5 0 waiting for initial osdmap 2023-11-13T11:28:43.870 INFO:tasks.ceph.osd.6.smithi154.stderr:2023-11-13T11:28:43.864+0000 7f3c7f3ad640 -1 osd.6 0 waiting for initial osdmap 2023-11-13T11:28:43.889 INFO:tasks.ceph.osd.5.smithi154.stderr:2023-11-13T11:28:43.884+0000 7f77e3f33640 -1 osd.5 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-11-13T11:28:43.900 INFO:tasks.ceph.osd.6.smithi154.stderr:2023-11-13T11:28:43.896+0000 7f3c779fa640 -1 osd.6 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-11-13T11:28:43.933 INFO:tasks.ceph.osd.4.smithi154.stderr:2023-11-13T11:28:43.928+0000 7fce073bc640 -1 osd.4 0 waiting for initial osdmap 2023-11-13T11:28:43.968 INFO:tasks.ceph.osd.4.smithi154.stderr:2023-11-13T11:28:43.964+0000 7fcdfe1d3640 -1 osd.4 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-11-13T11:28:44.054 INFO:teuthology.misc.health.smithi102.stderr:2023-11-13T11:28:44.048+0000 7fa62fafe640 1 -- 172.21.15.102:0/2019920616 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa6280c7120 con 0x7fa6280d1380 2023-11-13T11:28:44.055 INFO:teuthology.misc.health.smithi102.stderr:2023-11-13T11:28:44.052+0000 7fa61e7fc640 1 -- 172.21.15.102:0/2019920616 <== mon.2 v2:172.21.15.154:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v14) v1 ==== 74+0+7566 (secure 0 0 0) 0x7fa6280c7120 con 0x7fa6280d1380 2023-11-13T11:28:44.056 INFO:teuthology.misc.health.smithi102.stdout: 2023-11-13T11:28:44.057 INFO:teuthology.misc.health.smithi102.stdout:{"epoch":14,"fsid":"97b3eb2b-7ccf-4aae-8d92-bff986c671ea","created":"2023-11-13T11:28:31.836724+0000","modified":"2023-11-13T11:28:43.188265+0000","last_up_change":"2023-11-13T11:28:43.188265+0000","last_in_change":"2023-11-13T11:28:35.312740+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"bdefaa17-fcca-4c86-aa40-27dc33a789af","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"f0033196-dec9-4ae9-945e-6aeef6dbb47f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"496b0834-351e-4ec2-a714-86ed0c0ff4fd","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"3ba6cc41-e0a0-4273-86cb-90000c06a55a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"16e797d8-e6e7-4140-95c3-b85283c42a2a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"d6ab225c-1b55-450a-89a9-abe5c3f8d6af","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"96f905ac-491c-4662-8e2b-5bb8e929ab9d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"07012d3b-3ab4-40df-a471-93caed22e2dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6824","nonce":1753500785},{"type":"v1","addr":"172.21.15.154:6825","nonce":1753500785}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6826","nonce":1753500785},{"type":"v1","addr":"172.21.15.154:6827","nonce":1753500785}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6830","nonce":1753500785},{"type":"v1","addr":"172.21.15.154:6831","nonce":1753500785}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6828","nonce":1753500785},{"type":"v1","addr":"172.21.15.154:6829","nonce":1753500785}]},"public_addr":"172.21.15.154:6825/1753500785","cluster_addr":"172.21.15.154:6827/1753500785","heartbeat_back_addr":"172.21.15.154:6831/1753500785","heartbeat_front_addr":"172.21.15.154:6829/1753500785","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-13T11:28:44.059 INFO:teuthology.misc.health.smithi102.stderr:2023-11-13T11:28:44.056+0000 7fa62fafe640 1 -- 172.21.15.102:0/2019920616 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7fa60c066460 msgr2=0x7fa60c068920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:28:44.060 INFO:teuthology.misc.health.smithi102.stderr:2023-11-13T11:28:44.056+0000 7fa62fafe640 1 --2- 172.21.15.102:0/2019920616 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7fa60c066460 0x7fa60c068920 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fa6280c9860 tx=0x7fa624008040 comp rx=0 tx=0).stop 2023-11-13T11:28:44.060 INFO:teuthology.misc.health.smithi102.stderr:2023-11-13T11:28:44.056+0000 7fa62fafe640 1 -- 172.21.15.102:0/2019920616 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa6280d1380 msgr2=0x7fa62815d700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:28:44.060 INFO:teuthology.misc.health.smithi102.stderr:2023-11-13T11:28:44.056+0000 7fa62fafe640 1 --2- 172.21.15.102:0/2019920616 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa6280d1380 0x7fa62815d700 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fa6180ae040 tx=0x7fa618019200 comp rx=0 tx=0).stop 2023-11-13T11:28:44.061 INFO:teuthology.misc.health.smithi102.stderr:2023-11-13T11:28:44.056+0000 7fa62fafe640 1 -- 172.21.15.102:0/2019920616 shutdown_connections 2023-11-13T11:28:44.061 INFO:teuthology.misc.health.smithi102.stderr:2023-11-13T11:28:44.056+0000 7fa62fafe640 1 --2- 172.21.15.102:0/2019920616 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa62815d290 0x7fa628154c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:28:44.061 INFO:teuthology.misc.health.smithi102.stderr:2023-11-13T11:28:44.056+0000 7fa62fafe640 1 --2- 172.21.15.102:0/2019920616 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa6280d1380 0x7fa62815d700 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:28:44.061 INFO:teuthology.misc.health.smithi102.stderr:2023-11-13T11:28:44.056+0000 7fa62fafe640 1 --2- 172.21.15.102:0/2019920616 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7fa60c066460 0x7fa60c068920 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:28:44.062 INFO:teuthology.misc.health.smithi102.stderr:2023-11-13T11:28:44.056+0000 7fa62fafe640 1 --2- 172.21.15.102:0/2019920616 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa6280cfce0 0x7fa6281552d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:28:44.062 INFO:teuthology.misc.health.smithi102.stderr:2023-11-13T11:28:44.056+0000 7fa62fafe640 1 -- 172.21.15.102:0/2019920616 >> 172.21.15.102:0/2019920616 conn(0x7fa6280d2dd0 msgr2=0x7fa628159bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-13T11:28:44.063 INFO:teuthology.misc.health.smithi102.stderr:2023-11-13T11:28:44.056+0000 7fa62fafe640 1 -- 172.21.15.102:0/2019920616 shutdown_connections 2023-11-13T11:28:44.063 INFO:teuthology.misc.health.smithi102.stderr:2023-11-13T11:28:44.056+0000 7fa62fafe640 1 -- 172.21.15.102:0/2019920616 wait complete. 2023-11-13T11:28:44.090 DEBUG:teuthology.misc:1 of 8 OSDs are up 2023-11-13T11:28:44.312 INFO:tasks.ceph.osd.0.smithi102.stderr:2023-11-13T11:28:44.308+0000 7efed6bb8640 -1 osd.0 0 waiting for initial osdmap 2023-11-13T11:28:44.344 INFO:tasks.ceph.osd.0.smithi102.stderr:2023-11-13T11:28:44.340+0000 7efecf205640 -1 osd.0 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-11-13T11:28:44.426 INFO:tasks.ceph.osd.3.smithi102.stderr:2023-11-13T11:28:44.424+0000 7f48d0771640 -1 osd.3 0 waiting for initial osdmap 2023-11-13T11:28:44.428 INFO:tasks.ceph.osd.2.smithi102.stderr:2023-11-13T11:28:44.424+0000 7f17fc635640 -1 osd.2 0 waiting for initial osdmap 2023-11-13T11:28:44.434 INFO:tasks.ceph.osd.1.smithi102.stderr:2023-11-13T11:28:44.432+0000 7f33d1917640 -1 osd.1 0 waiting for initial osdmap 2023-11-13T11:28:44.451 INFO:tasks.ceph.osd.3.smithi102.stderr:2023-11-13T11:28:44.448+0000 7f48c8dbe640 -1 osd.3 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-11-13T11:28:44.463 INFO:tasks.ceph.osd.1.smithi102.stderr:2023-11-13T11:28:44.460+0000 7f33c872e640 -1 osd.1 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-11-13T11:28:44.464 INFO:tasks.ceph.osd.2.smithi102.stderr:2023-11-13T11:28:44.460+0000 7f17f344c640 -1 osd.2 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-11-13T11:28:49.663 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T11:28:49.668 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T11:28:50.897 DEBUG:teuthology.orchestra.run.smithi102:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-11-13T11:28:51.026 INFO:teuthology.misc.health.smithi102.stderr:2023-11-13T11:28:51.019+0000 7fbe8749c640 1 Processor -- start 2023-11-13T11:28:51.026 INFO:teuthology.misc.health.smithi102.stderr:2023-11-13T11:28:51.019+0000 7fbe8749c640 1 -- start start 2023-11-13T11:28:51.027 INFO:teuthology.misc.health.smithi102.stderr:2023-11-13T11:28:51.023+0000 7fbe8749c640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fbe8006b250 0x7fbe8006b6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:28:51.027 INFO:teuthology.misc.health.smithi102.stderr:2023-11-13T11:28:51.023+0000 7fbe8749c640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fbe800adc00 0x7fbe800ae040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:28:51.028 INFO:teuthology.misc.health.smithi102.stderr:2023-11-13T11:28:51.023+0000 7fbe8749c640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbe8006e4b0 con 0x7fbe8006e0d0 2023-11-13T11:28:51.028 INFO:teuthology.misc.health.smithi102.stderr:2023-11-13T11:28:51.023+0000 7fbe8749c640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbe8006bc20 con 0x7fbe8006b250 2023-11-13T11:28:51.028 INFO:teuthology.misc.health.smithi102.stderr:2023-11-13T11:28:51.023+0000 7fbe8749c640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe8006c430 con 0x7fbe800adc00 2023-11-13T11:28:51.028 INFO:teuthology.misc.health.smithi102.stderr:2023-11-13T11:28:51.023+0000 7fbe85238640 1 --1- >> v1:172.21.15.102:6789/0 conn(0x7fbe8006e0d0 0x7fbe800b2de0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.102:6789/0 says I am v1:172.21.15.102:50432/0 (socket says 172.21.15.102:50432) 2023-11-13T11:28:51.028 INFO:teuthology.misc.health.smithi102.stderr:2023-11-13T11:28:51.023+0000 7fbe85238640 1 -- 172.21.15.102:0/2605804074 learned_addr learned my addr 172.21.15.102:0/2605804074 (peer_addr_for_me v1:172.21.15.102:0/0) 2023-11-13T11:28:51.029 INFO:teuthology.misc.health.smithi102.stderr:2023-11-13T11:28:51.023+0000 7fbe84a37640 1 --2- 172.21.15.102:0/2605804074 >> v2:172.21.15.154:3300/0 conn(0x7fbe8006b250 0x7fbe8006b6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:28:51.029 INFO:teuthology.misc.health.smithi102.stderr:2023-11-13T11:28:51.023+0000 7fbe85a39640 1 --2- 172.21.15.102:0/2605804074 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fbe800adc00 0x7fbe800ae040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:28:51.031 INFO:teuthology.misc.health.smithi102.stderr:2023-11-13T11:28:51.023+0000 7fbe77fff640 1 -- 172.21.15.102:0/2605804074 <== mon.0 v1:172.21.15.102:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 429080269 0 0) 0x7fbe7c001120 con 0x7fbe8006e0d0 2023-11-13T11:28:51.031 INFO:teuthology.misc.health.smithi102.stderr:2023-11-13T11:28:51.023+0000 7fbe77fff640 1 -- 172.21.15.102:0/2605804074 --> v1:172.21.15.102:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbe6c003530 con 0x7fbe8006e0d0 2023-11-13T11:28:51.032 INFO:teuthology.misc.health.smithi102.stderr:2023-11-13T11:28:51.023+0000 7fbe77fff640 1 -- 172.21.15.102:0/2605804074 <== mon.0 v1:172.21.15.102:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2109279549 0 0) 0x7fbe6c003530 con 0x7fbe8006e0d0 2023-11-13T11:28:51.032 INFO:teuthology.misc.health.smithi102.stderr:2023-11-13T11:28:51.023+0000 7fbe77fff640 1 -- 172.21.15.102:0/2605804074 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fbe800adc00 msgr2=0x7fbe800ae040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-13T11:28:51.032 INFO:teuthology.misc.health.smithi102.stderr:2023-11-13T11:28:51.023+0000 7fbe77fff640 1 --2- 172.21.15.102:0/2605804074 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fbe800adc00 0x7fbe800ae040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:28:51.032 INFO:teuthology.misc.health.smithi102.stderr:2023-11-13T11:28:51.023+0000 7fbe77fff640 1 -- 172.21.15.102:0/2605804074 >> v2:172.21.15.154:3300/0 conn(0x7fbe8006b250 msgr2=0x7fbe8006b6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-13T11:28:51.032 INFO:teuthology.misc.health.smithi102.stderr:2023-11-13T11:28:51.023+0000 7fbe77fff640 1 --2- 172.21.15.102:0/2605804074 >> v2:172.21.15.154:3300/0 conn(0x7fbe8006b250 0x7fbe8006b6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:28:51.033 INFO:teuthology.misc.health.smithi102.stderr:2023-11-13T11:28:51.023+0000 7fbe77fff640 1 -- 172.21.15.102:0/2605804074 --> v1:172.21.15.102:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe800b34f0 con 0x7fbe8006e0d0 2023-11-13T11:28:51.033 INFO:teuthology.misc.health.smithi102.stderr:2023-11-13T11:28:51.023+0000 7fbe77fff640 1 -- 172.21.15.102:0/2605804074 <== mon.0 v1:172.21.15.102:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 895381068 0 0) 0x7fbe7c001830 con 0x7fbe8006e0d0 2023-11-13T11:28:51.033 INFO:teuthology.misc.health.smithi102.stderr:2023-11-13T11:28:51.023+0000 7fbe84a37640 1 --2- 172.21.15.102:0/2605804074 >> v2:172.21.15.154:3300/0 conn(0x7fbe8006b250 0x7fbe8006b6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-13T11:28:51.033 INFO:teuthology.misc.health.smithi102.stderr:2023-11-13T11:28:51.023+0000 7fbe77fff640 1 -- 172.21.15.102:0/2605804074 >> v1:172.21.15.102:6789/0 conn(0x7fbe8006e0d0 legacy=0x7fbe800b2de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:28:51.034 INFO:teuthology.misc.health.smithi102.stderr:2023-11-13T11:28:51.023+0000 7fbe77fff640 1 --2- 172.21.15.102:0/2605804074 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbe6c003980 0x7fbe6c003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:28:51.034 INFO:teuthology.misc.health.smithi102.stderr:2023-11-13T11:28:51.023+0000 7fbe77fff640 1 --2- 172.21.15.102:0/2605804074 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fbe800adc00 0x7fbe6c0047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:28:51.035 INFO:teuthology.misc.health.smithi102.stderr:2023-11-13T11:28:51.023+0000 7fbe77fff640 1 --2- 172.21.15.102:0/2605804074 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fbe6c004d10 0x7fbe6c005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:28:51.035 INFO:teuthology.misc.health.smithi102.stderr:2023-11-13T11:28:51.023+0000 7fbe77fff640 1 -- 172.21.15.102:0/2605804074 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe8006bc20 con 0x7fbe6c004d10 2023-11-13T11:28:51.035 INFO:teuthology.misc.health.smithi102.stderr:2023-11-13T11:28:51.023+0000 7fbe77fff640 1 -- 172.21.15.102:0/2605804074 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe8006c430 con 0x7fbe6c003980 2023-11-13T11:28:51.035 INFO:teuthology.misc.health.smithi102.stderr:2023-11-13T11:28:51.023+0000 7fbe77fff640 1 -- 172.21.15.102:0/2605804074 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe6c00b990 con 0x7fbe800adc00 2023-11-13T11:28:51.035 INFO:teuthology.misc.health.smithi102.stderr:2023-11-13T11:28:51.023+0000 7fbe85a39640 1 --2- 172.21.15.102:0/2605804074 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fbe6c004d10 0x7fbe6c005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:28:51.036 INFO:teuthology.misc.health.smithi102.stderr:2023-11-13T11:28:51.023+0000 7fbe85238640 1 --2- 172.21.15.102:0/2605804074 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbe6c003980 0x7fbe6c003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:28:51.036 INFO:teuthology.misc.health.smithi102.stderr:2023-11-13T11:28:51.023+0000 7fbe84a37640 1 --2- 172.21.15.102:0/2605804074 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fbe800adc00 0x7fbe6c0047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:28:51.036 INFO:teuthology.misc.health.smithi102.stderr:2023-11-13T11:28:51.023+0000 7fbe85a39640 1 -- 172.21.15.102:0/2605804074 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fbe800adc00 msgr2=0x7fbe6c0047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-13T11:28:51.036 INFO:teuthology.misc.health.smithi102.stderr:2023-11-13T11:28:51.023+0000 7fbe85a39640 1 --2- 172.21.15.102:0/2605804074 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fbe800adc00 0x7fbe6c0047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:28:51.036 INFO:teuthology.misc.health.smithi102.stderr:2023-11-13T11:28:51.023+0000 7fbe85a39640 1 -- 172.21.15.102:0/2605804074 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbe6c003980 msgr2=0x7fbe6c003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-13T11:28:51.037 INFO:teuthology.misc.health.smithi102.stderr:2023-11-13T11:28:51.023+0000 7fbe85a39640 1 --2- 172.21.15.102:0/2605804074 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbe6c003980 0x7fbe6c003da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:28:51.037 INFO:teuthology.misc.health.smithi102.stderr:2023-11-13T11:28:51.023+0000 7fbe85a39640 1 -- 172.21.15.102:0/2605804074 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe6c003530 con 0x7fbe6c004d10 2023-11-13T11:28:51.042 INFO:teuthology.misc.health.smithi102.stderr:2023-11-13T11:28:51.027+0000 7fbe85a39640 1 --2- 172.21.15.102:0/2605804074 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fbe6c004d10 0x7fbe6c005190 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fbe7800e170 tx=0x7fbe7801cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bf0ea3d23812e384 server_cookie=0 in_seq=0 out_seq=0 2023-11-13T11:28:51.042 INFO:teuthology.misc.health.smithi102.stderr:2023-11-13T11:28:51.027+0000 7fbe77fff640 1 -- 172.21.15.102:0/2605804074 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe780a5c50 con 0x7fbe6c004d10 2023-11-13T11:28:51.043 INFO:teuthology.misc.health.smithi102.stderr:2023-11-13T11:28:51.027+0000 7fbe77fff640 1 -- 172.21.15.102:0/2605804074 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe7800f040 con 0x7fbe6c004d10 2023-11-13T11:28:51.043 INFO:teuthology.misc.health.smithi102.stderr:2023-11-13T11:28:51.027+0000 7fbe77fff640 1 -- 172.21.15.102:0/2605804074 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe780ad440 con 0x7fbe6c004d10 2023-11-13T11:28:51.043 INFO:teuthology.misc.health.smithi102.stderr:2023-11-13T11:28:51.027+0000 7fbe8749c640 1 -- 172.21.15.102:0/2605804074 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fbe6c004d10 msgr2=0x7fbe6c005190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:28:51.043 INFO:teuthology.misc.health.smithi102.stderr:2023-11-13T11:28:51.027+0000 7fbe8749c640 1 --2- 172.21.15.102:0/2605804074 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fbe6c004d10 0x7fbe6c005190 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fbe7800e170 tx=0x7fbe7801cc40 comp rx=0 tx=0).stop 2023-11-13T11:28:51.044 INFO:teuthology.misc.health.smithi102.stderr:2023-11-13T11:28:51.027+0000 7fbe85a39640 1 -- 172.21.15.102:0/2605804074 reap_dead start 2023-11-13T11:28:51.044 INFO:teuthology.misc.health.smithi102.stderr:2023-11-13T11:28:51.027+0000 7fbe8749c640 1 -- 172.21.15.102:0/2605804074 shutdown_connections 2023-11-13T11:28:51.044 INFO:teuthology.misc.health.smithi102.stderr:2023-11-13T11:28:51.027+0000 7fbe8749c640 1 -- 172.21.15.102:0/2605804074 >> 172.21.15.102:0/2605804074 conn(0x7fbe80070590 msgr2=0x7fbe800709a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-13T11:28:51.044 INFO:teuthology.misc.health.smithi102.stderr:2023-11-13T11:28:51.027+0000 7fbe8749c640 1 -- 172.21.15.102:0/2605804074 shutdown_connections 2023-11-13T11:28:51.044 INFO:teuthology.misc.health.smithi102.stderr:2023-11-13T11:28:51.027+0000 7fbe8749c640 1 -- 172.21.15.102:0/2605804074 wait complete. 2023-11-13T11:28:51.044 INFO:teuthology.misc.health.smithi102.stderr:2023-11-13T11:28:51.031+0000 7fbe8749c640 1 Processor -- start 2023-11-13T11:28:51.045 INFO:teuthology.misc.health.smithi102.stderr:2023-11-13T11:28:51.031+0000 7fbe8749c640 1 -- start start 2023-11-13T11:28:51.045 INFO:teuthology.misc.health.smithi102.stderr:2023-11-13T11:28:51.031+0000 7fbe8749c640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fbe6c004d10 0x7fbe8015b710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:28:51.045 INFO:teuthology.misc.health.smithi102.stderr:2023-11-13T11:28:51.031+0000 7fbe8749c640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbe80145bf0 0x7fbe80158560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:28:51.045 INFO:teuthology.misc.health.smithi102.stderr:2023-11-13T11:28:51.031+0000 7fbe8749c640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fbe80158aa0 0x7fbe801e85c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:28:51.045 INFO:teuthology.misc.health.smithi102.stderr:2023-11-13T11:28:51.031+0000 7fbe8749c640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe8015a670 con 0x7fbe80158aa0 2023-11-13T11:28:51.046 INFO:teuthology.misc.health.smithi102.stderr:2023-11-13T11:28:51.031+0000 7fbe8749c640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe8015a950 con 0x7fbe80145bf0 2023-11-13T11:28:51.046 INFO:teuthology.misc.health.smithi102.stderr:2023-11-13T11:28:51.031+0000 7fbe8749c640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe8015ac30 con 0x7fbe6c004d10 2023-11-13T11:28:51.046 INFO:teuthology.misc.health.smithi102.stderr:2023-11-13T11:28:51.031+0000 7fbe85a39640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fbe80158aa0 0x7fbe801e85c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:28:51.046 INFO:teuthology.misc.health.smithi102.stderr:2023-11-13T11:28:51.031+0000 7fbe85a39640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fbe80158aa0 0x7fbe801e85c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:49514/0 (socket says 172.21.15.102:49514) 2023-11-13T11:28:51.046 INFO:teuthology.misc.health.smithi102.stderr:2023-11-13T11:28:51.031+0000 7fbe85a39640 1 -- 172.21.15.102:0/1861992085 learned_addr learned my addr 172.21.15.102:0/1861992085 (peer_addr_for_me v2:172.21.15.102:0/0) 2023-11-13T11:28:51.047 INFO:teuthology.misc.health.smithi102.stderr:2023-11-13T11:28:51.031+0000 7fbe84a37640 1 --2- 172.21.15.102:0/1861992085 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbe80145bf0 0x7fbe80158560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:28:51.047 INFO:teuthology.misc.health.smithi102.stderr:2023-11-13T11:28:51.031+0000 7fbe85a39640 1 -- 172.21.15.102:0/1861992085 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fbe6c004d10 msgr2=0x7fbe8015b710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:28:51.047 INFO:teuthology.misc.health.smithi102.stderr:2023-11-13T11:28:51.031+0000 7fbe85238640 1 --2- 172.21.15.102:0/1861992085 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fbe6c004d10 0x7fbe8015b710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:28:51.047 INFO:teuthology.misc.health.smithi102.stderr:2023-11-13T11:28:51.031+0000 7fbe85a39640 1 --2- 172.21.15.102:0/1861992085 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fbe6c004d10 0x7fbe8015b710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:28:51.047 INFO:teuthology.misc.health.smithi102.stderr:2023-11-13T11:28:51.031+0000 7fbe85a39640 1 -- 172.21.15.102:0/1861992085 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbe80145bf0 msgr2=0x7fbe80158560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:28:51.048 INFO:teuthology.misc.health.smithi102.stderr:2023-11-13T11:28:51.031+0000 7fbe85a39640 1 --2- 172.21.15.102:0/1861992085 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbe80145bf0 0x7fbe80158560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:28:51.048 INFO:teuthology.misc.health.smithi102.stderr:2023-11-13T11:28:51.031+0000 7fbe85a39640 1 -- 172.21.15.102:0/1861992085 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe8015af10 con 0x7fbe80158aa0 2023-11-13T11:28:51.048 INFO:teuthology.misc.health.smithi102.stderr:2023-11-13T11:28:51.031+0000 7fbe84a37640 1 --2- 172.21.15.102:0/1861992085 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbe80145bf0 0x7fbe80158560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-13T11:28:51.048 INFO:teuthology.misc.health.smithi102.stderr:2023-11-13T11:28:51.031+0000 7fbe85238640 1 --2- 172.21.15.102:0/1861992085 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fbe6c004d10 0x7fbe8015b710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-13T11:28:51.048 INFO:teuthology.misc.health.smithi102.stderr:2023-11-13T11:28:51.031+0000 7fbe85a39640 1 --2- 172.21.15.102:0/1861992085 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fbe80158aa0 0x7fbe801e85c0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fbe7800e170 tx=0x7fbe78009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-13T11:28:51.049 INFO:teuthology.misc.health.smithi102.stderr:2023-11-13T11:28:51.031+0000 7fbe75ffb640 1 -- 172.21.15.102:0/1861992085 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe780039a0 con 0x7fbe80158aa0 2023-11-13T11:28:51.049 INFO:teuthology.misc.health.smithi102.stderr:2023-11-13T11:28:51.031+0000 7fbe75ffb640 1 -- 172.21.15.102:0/1861992085 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe78003b00 con 0x7fbe80158aa0 2023-11-13T11:28:51.049 INFO:teuthology.misc.health.smithi102.stderr:2023-11-13T11:28:51.031+0000 7fbe8749c640 1 -- 172.21.15.102:0/1861992085 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbe8015b1f0 con 0x7fbe80158aa0 2023-11-13T11:28:51.049 INFO:teuthology.misc.health.smithi102.stderr:2023-11-13T11:28:51.031+0000 7fbe75ffb640 1 -- 172.21.15.102:0/1861992085 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe780ae950 con 0x7fbe80158aa0 2023-11-13T11:28:51.049 INFO:teuthology.misc.health.smithi102.stderr:2023-11-13T11:28:51.031+0000 7fbe8749c640 1 -- 172.21.15.102:0/1861992085 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbe80146070 con 0x7fbe80158aa0 2023-11-13T11:28:51.050 INFO:teuthology.misc.health.smithi102.stderr:2023-11-13T11:28:51.035+0000 7fbe8749c640 1 -- 172.21.15.102:0/1861992085 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbe800669c0 con 0x7fbe80158aa0 2023-11-13T11:28:51.050 INFO:teuthology.misc.health.smithi102.stderr:2023-11-13T11:28:51.035+0000 7fbe75ffb640 1 -- 172.21.15.102:0/1861992085 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fbe780b4040 con 0x7fbe80158aa0 2023-11-13T11:28:51.050 INFO:teuthology.misc.health.smithi102.stderr:2023-11-13T11:28:51.035+0000 7fbe75ffb640 1 --2- 172.21.15.102:0/1861992085 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7fbe64066470 0x7fbe64068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:28:51.050 INFO:teuthology.misc.health.smithi102.stderr:2023-11-13T11:28:51.035+0000 7fbe75ffb640 1 -- 172.21.15.102:0/1861992085 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fbe7811dbe0 con 0x7fbe80158aa0 2023-11-13T11:28:51.050 INFO:teuthology.misc.health.smithi102.stderr:2023-11-13T11:28:51.035+0000 7fbe85238640 1 --2- 172.21.15.102:0/1861992085 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7fbe64066470 0x7fbe64068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:28:51.051 INFO:teuthology.misc.health.smithi102.stderr:2023-11-13T11:28:51.035+0000 7fbe85238640 1 --2- 172.21.15.102:0/1861992085 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7fbe64066470 0x7fbe64068930 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fbe7c000c10 tx=0x7fbe7c009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-13T11:28:51.051 INFO:teuthology.misc.health.smithi102.stderr:2023-11-13T11:28:51.039+0000 7fbe75ffb640 1 -- 172.21.15.102:0/1861992085 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fbe780eb3a0 con 0x7fbe80158aa0 2023-11-13T11:28:51.195 INFO:teuthology.misc.health.smithi102.stderr:2023-11-13T11:28:51.191+0000 7fbe8749c640 1 -- 172.21.15.102:0/1861992085 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fbe80068520 con 0x7fbe80158aa0 2023-11-13T11:28:51.196 INFO:teuthology.misc.health.smithi102.stderr:2023-11-13T11:28:51.191+0000 7fbe75ffb640 1 -- 172.21.15.102:0/1861992085 <== mon.0 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v18) v1 ==== 74+0+12886 (secure 0 0 0) 0x7fbe780ee9c0 con 0x7fbe80158aa0 2023-11-13T11:28:51.196 INFO:teuthology.misc.health.smithi102.stdout: 2023-11-13T11:28:51.197 INFO:teuthology.misc.health.smithi102.stdout:{"epoch":18,"fsid":"97b3eb2b-7ccf-4aae-8d92-bff986c671ea","created":"2023-11-13T11:28:31.836724+0000","modified":"2023-11-13T11:28:47.893877+0000","last_up_change":"2023-11-13T11:28:44.876638+0000","last_in_change":"2023-11-13T11:28:35.312740+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-13T11:28:44.981356+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"bdefaa17-fcca-4c86-aa40-27dc33a789af","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6800","nonce":53303834},{"type":"v1","addr":"172.21.15.102:6801","nonce":53303834}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6802","nonce":53303834},{"type":"v1","addr":"172.21.15.102:6803","nonce":53303834}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6806","nonce":53303834},{"type":"v1","addr":"172.21.15.102:6807","nonce":53303834}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6804","nonce":53303834},{"type":"v1","addr":"172.21.15.102:6805","nonce":53303834}]},"public_addr":"172.21.15.102:6801/53303834","cluster_addr":"172.21.15.102:6803/53303834","heartbeat_back_addr":"172.21.15.102:6807/53303834","heartbeat_front_addr":"172.21.15.102:6805/53303834","state":["exists","up"]},{"osd":1,"uuid":"f0033196-dec9-4ae9-945e-6aeef6dbb47f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6808","nonce":1732708348},{"type":"v1","addr":"172.21.15.102:6809","nonce":1732708348}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6811","nonce":1732708348},{"type":"v1","addr":"172.21.15.102:6813","nonce":1732708348}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6818","nonce":1732708348},{"type":"v1","addr":"172.21.15.102:6820","nonce":1732708348}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6815","nonce":1732708348},{"type":"v1","addr":"172.21.15.102:6817","nonce":1732708348}]},"public_addr":"172.21.15.102:6809/1732708348","cluster_addr":"172.21.15.102:6813/1732708348","heartbeat_back_addr":"172.21.15.102:6820/1732708348","heartbeat_front_addr":"172.21.15.102:6817/1732708348","state":["exists","up"]},{"osd":2,"uuid":"496b0834-351e-4ec2-a714-86ed0c0ff4fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6810","nonce":1825475150},{"type":"v1","addr":"172.21.15.102:6812","nonce":1825475150}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6814","nonce":1825475150},{"type":"v1","addr":"172.21.15.102:6816","nonce":1825475150}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6822","nonce":1825475150},{"type":"v1","addr":"172.21.15.102:6823","nonce":1825475150}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6819","nonce":1825475150},{"type":"v1","addr":"172.21.15.102:6821","nonce":1825475150}]},"public_addr":"172.21.15.102:6812/1825475150","cluster_addr":"172.21.15.102:6816/1825475150","heartbeat_back_addr":"172.21.15.102:6823/1825475150","heartbeat_front_addr":"172.21.15.102:6821/1825475150","state":["exists","up"]},{"osd":3,"uuid":"3ba6cc41-e0a0-4273-86cb-90000c06a55a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6824","nonce":4149355528},{"type":"v1","addr":"172.21.15.102:6825","nonce":4149355528}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6826","nonce":4149355528},{"type":"v1","addr":"172.21.15.102:6827","nonce":4149355528}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6830","nonce":4149355528},{"type":"v1","addr":"172.21.15.102:6831","nonce":4149355528}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6828","nonce":4149355528},{"type":"v1","addr":"172.21.15.102:6829","nonce":4149355528}]},"public_addr":"172.21.15.102:6825/4149355528","cluster_addr":"172.21.15.102:6827/4149355528","heartbeat_back_addr":"172.21.15.102:6831/4149355528","heartbeat_front_addr":"172.21.15.102:6829/4149355528","state":["exists","up"]},{"osd":4,"uuid":"16e797d8-e6e7-4140-95c3-b85283c42a2a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6808","nonce":4028899241},{"type":"v1","addr":"172.21.15.154:6809","nonce":4028899241}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6810","nonce":4028899241},{"type":"v1","addr":"172.21.15.154:6811","nonce":4028899241}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6814","nonce":4028899241},{"type":"v1","addr":"172.21.15.154:6815","nonce":4028899241}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6812","nonce":4028899241},{"type":"v1","addr":"172.21.15.154:6813","nonce":4028899241}]},"public_addr":"172.21.15.154:6809/4028899241","cluster_addr":"172.21.15.154:6811/4028899241","heartbeat_back_addr":"172.21.15.154:6815/4028899241","heartbeat_front_addr":"172.21.15.154:6813/4028899241","state":["exists","up"]},{"osd":5,"uuid":"d6ab225c-1b55-450a-89a9-abe5c3f8d6af","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":3562396827},{"type":"v1","addr":"172.21.15.154:6801","nonce":3562396827}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":3562396827},{"type":"v1","addr":"172.21.15.154:6803","nonce":3562396827}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6806","nonce":3562396827},{"type":"v1","addr":"172.21.15.154:6807","nonce":3562396827}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6804","nonce":3562396827},{"type":"v1","addr":"172.21.15.154:6805","nonce":3562396827}]},"public_addr":"172.21.15.154:6801/3562396827","cluster_addr":"172.21.15.154:6803/3562396827","heartbeat_back_addr":"172.21.15.154:6807/3562396827","heartbeat_front_addr":"172.21.15.154:6805/3562396827","state":["exists","up"]},{"osd":6,"uuid":"96f905ac-491c-4662-8e2b-5bb8e929ab9d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6816","nonce":2933728751},{"type":"v1","addr":"172.21.15.154:6817","nonce":2933728751}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6818","nonce":2933728751},{"type":"v1","addr":"172.21.15.154:6819","nonce":2933728751}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6822","nonce":2933728751},{"type":"v1","addr":"172.21.15.154:6823","nonce":2933728751}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6820","nonce":2933728751},{"type":"v1","addr":"172.21.15.154:6821","nonce":2933728751}]},"public_addr":"172.21.15.154:6817/2933728751","cluster_addr":"172.21.15.154:6819/2933728751","heartbeat_back_addr":"172.21.15.154:6823/2933728751","heartbeat_front_addr":"172.21.15.154:6821/2933728751","state":["exists","up"]},{"osd":7,"uuid":"07012d3b-3ab4-40df-a471-93caed22e2dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6824","nonce":1753500785},{"type":"v1","addr":"172.21.15.154:6825","nonce":1753500785}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6826","nonce":1753500785},{"type":"v1","addr":"172.21.15.154:6827","nonce":1753500785}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6830","nonce":1753500785},{"type":"v1","addr":"172.21.15.154:6831","nonce":1753500785}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6828","nonce":1753500785},{"type":"v1","addr":"172.21.15.154:6829","nonce":1753500785}]},"public_addr":"172.21.15.154:6825/1753500785","cluster_addr":"172.21.15.154:6827/1753500785","heartbeat_back_addr":"172.21.15.154:6831/1753500785","heartbeat_front_addr":"172.21.15.154:6829/1753500785","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-13T11:28:40.978603+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-13T11:28:41.200985+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-13T11:28:41.222815+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-13T11:28:41.202162+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-13T11:28:40.925911+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-13T11:28:41.087725+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-13T11:28:41.072208+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-13T11:28:40.875257+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-13T11:28:51.198 INFO:teuthology.misc.health.smithi102.stderr:2023-11-13T11:28:51.195+0000 7fbe8749c640 1 -- 172.21.15.102:0/1861992085 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7fbe64066470 msgr2=0x7fbe64068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:28:51.199 INFO:teuthology.misc.health.smithi102.stderr:2023-11-13T11:28:51.195+0000 7fbe8749c640 1 --2- 172.21.15.102:0/1861992085 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7fbe64066470 0x7fbe64068930 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fbe7c000c10 tx=0x7fbe7c009040 comp rx=0 tx=0).stop 2023-11-13T11:28:51.199 INFO:teuthology.misc.health.smithi102.stderr:2023-11-13T11:28:51.195+0000 7fbe8749c640 1 -- 172.21.15.102:0/1861992085 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fbe80158aa0 msgr2=0x7fbe801e85c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:28:51.199 INFO:teuthology.misc.health.smithi102.stderr:2023-11-13T11:28:51.195+0000 7fbe8749c640 1 --2- 172.21.15.102:0/1861992085 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fbe80158aa0 0x7fbe801e85c0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fbe7800e170 tx=0x7fbe78009750 comp rx=0 tx=0).stop 2023-11-13T11:28:51.199 INFO:teuthology.misc.health.smithi102.stderr:2023-11-13T11:28:51.195+0000 7fbe8749c640 1 -- 172.21.15.102:0/1861992085 shutdown_connections 2023-11-13T11:28:51.200 INFO:teuthology.misc.health.smithi102.stderr:2023-11-13T11:28:51.195+0000 7fbe8749c640 1 --2- 172.21.15.102:0/1861992085 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7fbe64066470 0x7fbe64068930 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:28:51.200 INFO:teuthology.misc.health.smithi102.stderr:2023-11-13T11:28:51.195+0000 7fbe8749c640 1 --2- 172.21.15.102:0/1861992085 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fbe80158aa0 0x7fbe801e85c0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:28:51.200 INFO:teuthology.misc.health.smithi102.stderr:2023-11-13T11:28:51.195+0000 7fbe8749c640 1 --2- 172.21.15.102:0/1861992085 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbe80145bf0 0x7fbe80158560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:28:51.200 INFO:teuthology.misc.health.smithi102.stderr:2023-11-13T11:28:51.195+0000 7fbe8749c640 1 --2- 172.21.15.102:0/1861992085 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fbe6c004d10 0x7fbe8015b710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:28:51.200 INFO:teuthology.misc.health.smithi102.stderr:2023-11-13T11:28:51.195+0000 7fbe8749c640 1 -- 172.21.15.102:0/1861992085 >> 172.21.15.102:0/1861992085 conn(0x7fbe80070590 msgr2=0x7fbe800730f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-13T11:28:51.200 INFO:teuthology.misc.health.smithi102.stderr:2023-11-13T11:28:51.195+0000 7fbe8749c640 1 -- 172.21.15.102:0/1861992085 shutdown_connections 2023-11-13T11:28:51.201 INFO:teuthology.misc.health.smithi102.stderr:2023-11-13T11:28:51.195+0000 7fbe8749c640 1 -- 172.21.15.102:0/1861992085 wait complete. 2023-11-13T11:28:51.216 DEBUG:teuthology.misc:8 of 8 OSDs are up 2023-11-13T11:28:51.216 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2023-11-13T11:28:51.217 INFO:tasks.ceph.mds.a:Restarting daemon 2023-11-13T11:28:51.217 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-11-13T11:28:51.221 INFO:tasks.ceph.mds.a:Started 2023-11-13T11:28:51.221 INFO:tasks.ceph.mds.c:Restarting daemon 2023-11-13T11:28:51.221 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-11-13T11:28:51.225 INFO:tasks.ceph.mds.c:Started 2023-11-13T11:28:51.225 INFO:tasks.ceph.mds.b:Restarting daemon 2023-11-13T11:28:51.225 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-11-13T11:28:51.229 INFO:tasks.ceph.mds.b:Started 2023-11-13T11:28:51.230 INFO:tasks.ceph.mds.d:Restarting daemon 2023-11-13T11:28:51.230 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-11-13T11:28:51.234 INFO:tasks.ceph.mds.d:Started 2023-11-13T11:28:51.234 INFO:tasks.ceph:Setting up CephFS filesystem(s)... 2023-11-13T11:28:51.235 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-13T11:28:51.321 INFO:tasks.ceph.mds.a.smithi102.stdout:starting mds.a at 2023-11-13T11:28:51.321 INFO:tasks.ceph.mds.c.smithi102.stdout:starting mds.c at 2023-11-13T11:28:51.330 INFO:tasks.ceph.mds.d.smithi154.stdout:starting mds.d at 2023-11-13T11:28:51.330 INFO:tasks.ceph.mds.b.smithi154.stdout:starting mds.b at 2023-11-13T11:28:51.382 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:51.379+0000 7f217351e640 1 Processor -- start 2023-11-13T11:28:51.383 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:51.379+0000 7f217351e640 1 -- start start 2023-11-13T11:28:51.384 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:51.379+0000 7f217351e640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f216c0cfc80 0x7f216c0b5a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:28:51.385 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:51.379+0000 7f217351e640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f216c0d3650 con 0x7f216c0d1990 2023-11-13T11:28:51.385 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:51.379+0000 7f217351e640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f216c0d08f0 con 0x7f216c15cdf0 2023-11-13T11:28:51.385 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:51.379+0000 7f217351e640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f216c0d0bd0 con 0x7f216c0cfc80 2023-11-13T11:28:51.385 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:51.379+0000 7f2171d1b640 1 --1- >> v1:172.21.15.102:6789/0 conn(0x7f216c0d1990 0x7f216c0cf570 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.102:6789/0 says I am v1:172.21.15.102:50458/0 (socket says 172.21.15.102:50458) 2023-11-13T11:28:51.386 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:51.379+0000 7f2171d1b640 1 -- 172.21.15.102:0/2864847047 learned_addr learned my addr 172.21.15.102:0/2864847047 (peer_addr_for_me v1:172.21.15.102:0/0) 2023-11-13T11:28:51.386 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:51.379+0000 7f2172d1d640 1 --2- 172.21.15.102:0/2864847047 >> v2:172.21.15.154:3300/0 conn(0x7f216c0cfc80 0x7f216c0b5a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:28:51.386 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:51.379+0000 7f217151a640 1 -- 172.21.15.102:0/2864847047 <== mon.0 v1:172.21.15.102:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2330688621 0 0) 0x7f216c0d3650 con 0x7f216c0d1990 2023-11-13T11:28:51.386 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:51.379+0000 7f217151a640 1 -- 172.21.15.102:0/2864847047 --> v1:172.21.15.102:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2158003530 con 0x7f216c0d1990 2023-11-13T11:28:51.386 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:51.379+0000 7f217151a640 1 -- 172.21.15.102:0/2864847047 <== mon.1 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2724341288 0 0) 0x7f216c0d08f0 con 0x7f216c15cdf0 2023-11-13T11:28:51.387 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:51.379+0000 7f217151a640 1 -- 172.21.15.102:0/2864847047 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f216c0d3650 con 0x7f216c15cdf0 2023-11-13T11:28:51.387 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:51.379+0000 7f2172d1d640 1 -- 172.21.15.102:0/2864847047 >> v1:172.21.15.154:6789/0 conn(0x7f216c15cdf0 legacy=0x7f216c0ce3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:28:51.387 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:51.379+0000 7f2172d1d640 1 -- 172.21.15.102:0/2864847047 >> v1:172.21.15.102:6789/0 conn(0x7f216c0d1990 legacy=0x7f216c0cf570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:28:51.387 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:51.379+0000 7f2172d1d640 1 -- 172.21.15.102:0/2864847047 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f216c0d0eb0 con 0x7f216c0cfc80 2023-11-13T11:28:51.388 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:51.383+0000 7f2172d1d640 1 --2- 172.21.15.102:0/2864847047 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f216c0cfc80 0x7f216c0b5a40 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f2164009d90 tx=0x7f216401c800 comp rx=0 tx=0).ready entity=mon.1 client_cookie=dd59d3a373474b4d server_cookie=0 in_seq=0 out_seq=0 2023-11-13T11:28:51.388 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:51.383+0000 7f217151a640 1 -- 172.21.15.102:0/2864847047 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21640a57d0 con 0x7f216c0cfc80 2023-11-13T11:28:51.388 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:51.383+0000 7f217151a640 1 -- 172.21.15.102:0/2864847047 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f21640a5930 con 0x7f216c0cfc80 2023-11-13T11:28:51.389 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:51.383+0000 7f217151a640 1 -- 172.21.15.102:0/2864847047 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21640a5cc0 con 0x7f216c0cfc80 2023-11-13T11:28:51.389 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:51.383+0000 7f217351e640 1 -- 172.21.15.102:0/2864847047 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f216c0cfc80 msgr2=0x7f216c0b5a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:28:51.389 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:51.383+0000 7f217351e640 1 --2- 172.21.15.102:0/2864847047 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f216c0cfc80 0x7f216c0b5a40 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f2164009d90 tx=0x7f216401c800 comp rx=0 tx=0).stop 2023-11-13T11:28:51.390 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:51.383+0000 7f217351e640 1 -- 172.21.15.102:0/2864847047 shutdown_connections 2023-11-13T11:28:51.390 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:51.383+0000 7f217351e640 1 --2- 172.21.15.102:0/2864847047 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f216c0cfc80 0x7f216c0b5a40 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:28:51.390 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:51.383+0000 7f217351e640 1 -- 172.21.15.102:0/2864847047 >> 172.21.15.102:0/2864847047 conn(0x7f216c09bf60 msgr2=0x7f216c0d2bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-13T11:28:51.390 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:51.383+0000 7f217351e640 1 -- 172.21.15.102:0/2864847047 shutdown_connections 2023-11-13T11:28:51.390 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:51.383+0000 7f217351e640 1 -- 172.21.15.102:0/2864847047 wait complete. 2023-11-13T11:28:51.392 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:51.387+0000 7f217351e640 1 Processor -- start 2023-11-13T11:28:51.393 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:51.387+0000 7f217351e640 1 -- start start 2023-11-13T11:28:51.393 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:51.387+0000 7f217351e640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f216c0cfc80 0x7f216c0ca6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:28:51.393 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:51.387+0000 7f217351e640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f216c0d1990 0x7f216c157050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:28:51.393 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:51.387+0000 7f217351e640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f216c15cdf0 0x7f216c14a9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:28:51.393 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:51.387+0000 7f217351e640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f216c0cb600 con 0x7f216c0cfc80 2023-11-13T11:28:51.394 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:51.387+0000 7f217351e640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f216c15e820 con 0x7f216c15cdf0 2023-11-13T11:28:51.394 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:51.387+0000 7f217351e640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f216c15eda0 con 0x7f216c0d1990 2023-11-13T11:28:51.394 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:51.387+0000 7f217251c640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f216c0cfc80 0x7f216c0ca6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:28:51.394 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:51.387+0000 7f217251c640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f216c0cfc80 0x7f216c0ca6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:49550/0 (socket says 172.21.15.102:49550) 2023-11-13T11:28:51.394 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:51.387+0000 7f217251c640 1 -- 172.21.15.102:0/1548568784 learned_addr learned my addr 172.21.15.102:0/1548568784 (peer_addr_for_me v2:172.21.15.102:0/0) 2023-11-13T11:28:51.395 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:51.387+0000 7f2172d1d640 1 --2- 172.21.15.102:0/1548568784 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f216c15cdf0 0x7f216c14a9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:28:51.395 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:51.387+0000 7f2171d1b640 1 --2- 172.21.15.102:0/1548568784 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f216c0d1990 0x7f216c157050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:28:51.395 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:51.387+0000 7f217251c640 1 -- 172.21.15.102:0/1548568784 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f216c0d1990 msgr2=0x7f216c157050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:28:51.395 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:51.387+0000 7f217251c640 1 --2- 172.21.15.102:0/1548568784 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f216c0d1990 0x7f216c157050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:28:51.395 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:51.387+0000 7f217251c640 1 -- 172.21.15.102:0/1548568784 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f216c15cdf0 msgr2=0x7f216c14a9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:28:51.396 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:51.387+0000 7f217251c640 1 --2- 172.21.15.102:0/1548568784 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f216c15cdf0 0x7f216c14a9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:28:51.396 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:51.387+0000 7f217251c640 1 -- 172.21.15.102:0/1548568784 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2164009a70 con 0x7f216c0cfc80 2023-11-13T11:28:51.396 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:51.387+0000 7f2171d1b640 1 --2- 172.21.15.102:0/1548568784 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f216c0d1990 0x7f216c157050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-13T11:28:51.396 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:51.387+0000 7f217251c640 1 --2- 172.21.15.102:0/1548568784 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f216c0cfc80 0x7f216c0ca6d0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f216800c430 tx=0x7f216800c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-13T11:28:51.396 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:51.387+0000 7f2162ffd640 1 -- 172.21.15.102:0/1548568784 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21680052d0 con 0x7f216c0cfc80 2023-11-13T11:28:51.397 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:51.387+0000 7f2162ffd640 1 -- 172.21.15.102:0/1548568784 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2168005450 con 0x7f216c0cfc80 2023-11-13T11:28:51.397 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:51.387+0000 7f217351e640 1 -- 172.21.15.102:0/1548568784 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f216c14bbf0 con 0x7f216c0cfc80 2023-11-13T11:28:51.397 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:51.387+0000 7f2162ffd640 1 -- 172.21.15.102:0/1548568784 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2168003840 con 0x7f216c0cfc80 2023-11-13T11:28:51.398 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:51.387+0000 7f217351e640 1 -- 172.21.15.102:0/1548568784 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f216c0cb320 con 0x7f216c0cfc80 2023-11-13T11:28:51.398 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:51.387+0000 7f217351e640 1 -- 172.21.15.102:0/1548568784 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f216c068520 con 0x7f216c0cfc80 2023-11-13T11:28:51.398 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:51.391+0000 7f2162ffd640 1 -- 172.21.15.102:0/1548568784 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f21680039a0 con 0x7f216c0cfc80 2023-11-13T11:28:51.399 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:51.391+0000 7f2162ffd640 1 --2- 172.21.15.102:0/1548568784 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f2150066470 0x7f2150068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:28:51.399 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:51.391+0000 7f2162ffd640 1 -- 172.21.15.102:0/1548568784 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f2168083120 con 0x7f216c0cfc80 2023-11-13T11:28:51.399 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:51.391+0000 7f2171d1b640 1 --2- 172.21.15.102:0/1548568784 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f2150066470 0x7f2150068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:28:51.399 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:51.391+0000 7f2171d1b640 1 --2- 172.21.15.102:0/1548568784 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f2150066470 0x7f2150068930 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f216c15c8d0 tx=0x7f215c009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-13T11:28:51.400 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:51.395+0000 7f2162ffd640 1 -- 172.21.15.102:0/1548568784 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f2168050900 con 0x7f216c0cfc80 2023-11-13T11:28:51.551 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:51.547+0000 7f217351e640 1 -- 172.21.15.102:0/1548568784 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f216c0d0270 con 0x7f216c0cfc80 2023-11-13T11:28:51.552 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:51.547+0000 7f2162ffd640 1 -- 172.21.15.102:0/1548568784 <== mon.0 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v18) v1 ==== 74+0+12886 (secure 0 0 0) 0x7f2168053f20 con 0x7f216c0cfc80 2023-11-13T11:28:51.553 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T11:28:51.553 INFO:teuthology.orchestra.run.smithi102.stdout:{"epoch":18,"fsid":"97b3eb2b-7ccf-4aae-8d92-bff986c671ea","created":"2023-11-13T11:28:31.836724+0000","modified":"2023-11-13T11:28:47.893877+0000","last_up_change":"2023-11-13T11:28:44.876638+0000","last_in_change":"2023-11-13T11:28:35.312740+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-13T11:28:44.981356+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"bdefaa17-fcca-4c86-aa40-27dc33a789af","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6800","nonce":53303834},{"type":"v1","addr":"172.21.15.102:6801","nonce":53303834}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6802","nonce":53303834},{"type":"v1","addr":"172.21.15.102:6803","nonce":53303834}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6806","nonce":53303834},{"type":"v1","addr":"172.21.15.102:6807","nonce":53303834}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6804","nonce":53303834},{"type":"v1","addr":"172.21.15.102:6805","nonce":53303834}]},"public_addr":"172.21.15.102:6801/53303834","cluster_addr":"172.21.15.102:6803/53303834","heartbeat_back_addr":"172.21.15.102:6807/53303834","heartbeat_front_addr":"172.21.15.102:6805/53303834","state":["exists","up"]},{"osd":1,"uuid":"f0033196-dec9-4ae9-945e-6aeef6dbb47f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6808","nonce":1732708348},{"type":"v1","addr":"172.21.15.102:6809","nonce":1732708348}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6811","nonce":1732708348},{"type":"v1","addr":"172.21.15.102:6813","nonce":1732708348}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6818","nonce":1732708348},{"type":"v1","addr":"172.21.15.102:6820","nonce":1732708348}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6815","nonce":1732708348},{"type":"v1","addr":"172.21.15.102:6817","nonce":1732708348}]},"public_addr":"172.21.15.102:6809/1732708348","cluster_addr":"172.21.15.102:6813/1732708348","heartbeat_back_addr":"172.21.15.102:6820/1732708348","heartbeat_front_addr":"172.21.15.102:6817/1732708348","state":["exists","up"]},{"osd":2,"uuid":"496b0834-351e-4ec2-a714-86ed0c0ff4fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6810","nonce":1825475150},{"type":"v1","addr":"172.21.15.102:6812","nonce":1825475150}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6814","nonce":1825475150},{"type":"v1","addr":"172.21.15.102:6816","nonce":1825475150}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6822","nonce":1825475150},{"type":"v1","addr":"172.21.15.102:6823","nonce":1825475150}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6819","nonce":1825475150},{"type":"v1","addr":"172.21.15.102:6821","nonce":1825475150}]},"public_addr":"172.21.15.102:6812/1825475150","cluster_addr":"172.21.15.102:6816/1825475150","heartbeat_back_addr":"172.21.15.102:6823/1825475150","heartbeat_front_addr":"172.21.15.102:6821/1825475150","state":["exists","up"]},{"osd":3,"uuid":"3ba6cc41-e0a0-4273-86cb-90000c06a55a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6824","nonce":4149355528},{"type":"v1","addr":"172.21.15.102:6825","nonce":4149355528}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6826","nonce":4149355528},{"type":"v1","addr":"172.21.15.102:6827","nonce":4149355528}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6830","nonce":4149355528},{"type":"v1","addr":"172.21.15.102:6831","nonce":4149355528}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6828","nonce":4149355528},{"type":"v1","addr":"172.21.15.102:6829","nonce":4149355528}]},"public_addr":"172.21.15.102:6825/4149355528","cluster_addr":"172.21.15.102:6827/4149355528","heartbeat_back_addr":"172.21.15.102:6831/4149355528","heartbeat_front_addr":"172.21.15.102:6829/4149355528","state":["exists","up"]},{"osd":4,"uuid":"16e797d8-e6e7-4140-95c3-b85283c42a2a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6808","nonce":4028899241},{"type":"v1","addr":"172.21.15.154:6809","nonce":4028899241}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6810","nonce":4028899241},{"type":"v1","addr":"172.21.15.154:6811","nonce":4028899241}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6814","nonce":4028899241},{"type":"v1","addr":"172.21.15.154:6815","nonce":4028899241}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6812","nonce":4028899241},{"type":"v1","addr":"172.21.15.154:6813","nonce":4028899241}]},"public_addr":"172.21.15.154:6809/4028899241","cluster_addr":"172.21.15.154:6811/4028899241","heartbeat_back_addr":"172.21.15.154:6815/4028899241","heartbeat_front_addr":"172.21.15.154:6813/4028899241","state":["exists","up"]},{"osd":5,"uuid":"d6ab225c-1b55-450a-89a9-abe5c3f8d6af","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":3562396827},{"type":"v1","addr":"172.21.15.154:6801","nonce":3562396827}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":3562396827},{"type":"v1","addr":"172.21.15.154:6803","nonce":3562396827}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6806","nonce":3562396827},{"type":"v1","addr":"172.21.15.154:6807","nonce":3562396827}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6804","nonce":3562396827},{"type":"v1","addr":"172.21.15.154:6805","nonce":3562396827}]},"public_addr":"172.21.15.154:6801/3562396827","cluster_addr":"172.21.15.154:6803/3562396827","heartbeat_back_addr":"172.21.15.154:6807/3562396827","heartbeat_front_addr":"172.21.15.154:6805/3562396827","state":["exists","up"]},{"osd":6,"uuid":"96f905ac-491c-4662-8e2b-5bb8e929ab9d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6816","nonce":2933728751},{"type":"v1","addr":"172.21.15.154:6817","nonce":2933728751}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6818","nonce":2933728751},{"type":"v1","addr":"172.21.15.154:6819","nonce":2933728751}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6822","nonce":2933728751},{"type":"v1","addr":"172.21.15.154:6823","nonce":2933728751}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6820","nonce":2933728751},{"type":"v1","addr":"172.21.15.154:6821","nonce":2933728751}]},"public_addr":"172.21.15.154:6817/2933728751","cluster_addr":"172.21.15.154:6819/2933728751","heartbeat_back_addr":"172.21.15.154:6823/2933728751","heartbeat_front_addr":"172.21.15.154:6821/2933728751","state":["exists","up"]},{"osd":7,"uuid":"07012d3b-3ab4-40df-a471-93caed22e2dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6824","nonce":1753500785},{"type":"v1","addr":"172.21.15.154:6825","nonce":1753500785}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6826","nonce":1753500785},{"type":"v1","addr":"172.21.15.154:6827","nonce":1753500785}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6830","nonce":1753500785},{"type":"v1","addr":"172.21.15.154:6831","nonce":1753500785}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6828","nonce":1753500785},{"type":"v1","addr":"172.21.15.154:6829","nonce":1753500785}]},"public_addr":"172.21.15.154:6825/1753500785","cluster_addr":"172.21.15.154:6827/1753500785","heartbeat_back_addr":"172.21.15.154:6831/1753500785","heartbeat_front_addr":"172.21.15.154:6829/1753500785","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-13T11:28:40.978603+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-13T11:28:41.200985+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-13T11:28:41.222815+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-13T11:28:41.202162+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-13T11:28:40.925911+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-13T11:28:41.087725+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-13T11:28:41.072208+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-13T11:28:40.875257+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-13T11:28:51.554 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:51.551+0000 7f217351e640 1 -- 172.21.15.102:0/1548568784 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f2150066470 msgr2=0x7f2150068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:28:51.555 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:51.551+0000 7f217351e640 1 --2- 172.21.15.102:0/1548568784 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f2150066470 0x7f2150068930 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f216c15c8d0 tx=0x7f215c009040 comp rx=0 tx=0).stop 2023-11-13T11:28:51.555 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:51.551+0000 7f217351e640 1 -- 172.21.15.102:0/1548568784 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f216c0cfc80 msgr2=0x7f216c0ca6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:28:51.555 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:51.551+0000 7f217351e640 1 --2- 172.21.15.102:0/1548568784 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f216c0cfc80 0x7f216c0ca6d0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f216800c430 tx=0x7f216800c8f0 comp rx=0 tx=0).stop 2023-11-13T11:28:51.555 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:51.551+0000 7f217351e640 1 -- 172.21.15.102:0/1548568784 shutdown_connections 2023-11-13T11:28:51.556 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:51.551+0000 7f217351e640 1 --2- 172.21.15.102:0/1548568784 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f216c15cdf0 0x7f216c14a9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:28:51.556 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:51.551+0000 7f217351e640 1 --2- 172.21.15.102:0/1548568784 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f216c0d1990 0x7f216c157050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:28:51.556 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:51.551+0000 7f217351e640 1 --2- 172.21.15.102:0/1548568784 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f2150066470 0x7f2150068930 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:28:51.556 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:51.551+0000 7f217351e640 1 --2- 172.21.15.102:0/1548568784 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f216c0cfc80 0x7f216c0ca6d0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:28:51.556 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:51.551+0000 7f217351e640 1 -- 172.21.15.102:0/1548568784 >> 172.21.15.102:0/1548568784 conn(0x7f216c09bf60 msgr2=0x7f216c0b5810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-13T11:28:51.557 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:51.551+0000 7f217351e640 1 -- 172.21.15.102:0/1548568784 shutdown_connections 2023-11-13T11:28:51.557 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:51.551+0000 7f217351e640 1 -- 172.21.15.102:0/1548568784 wait complete. 2023-11-13T11:28:51.573 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-13T11:28:44.981356+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-13T11:28:51.574 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-13T11:28:51.716 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:51.711+0000 7f1acbfaa640 1 Processor -- start 2023-11-13T11:28:51.716 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:51.711+0000 7f1acbfaa640 1 -- start start 2023-11-13T11:28:51.717 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:51.711+0000 7f1acbfaa640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f1ac415d220 0x7f1ac40d3910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:28:51.717 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:51.711+0000 7f1acbfaa640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1ac40b3840 con 0x7f1ac415d600 2023-11-13T11:28:51.717 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:51.711+0000 7f1acbfaa640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1ac40cecb0 con 0x7f1ac40b3f60 2023-11-13T11:28:51.718 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:51.711+0000 7f1acbfaa640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1ac40d0d00 con 0x7f1ac415d220 2023-11-13T11:28:51.718 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:51.711+0000 7f1ac9545640 1 --1- >> v1:172.21.15.102:6789/0 conn(0x7f1ac415d600 0x7f1ac40b2750 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.102:6789/0 says I am v1:172.21.15.102:50468/0 (socket says 172.21.15.102:50468) 2023-11-13T11:28:51.718 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:51.711+0000 7f1ac9545640 1 -- 172.21.15.102:0/3128365932 learned_addr learned my addr 172.21.15.102:0/3128365932 (peer_addr_for_me v1:172.21.15.102:0/0) 2023-11-13T11:28:51.719 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:51.711+0000 7f1ac9d46640 1 --2- 172.21.15.102:0/3128365932 >> v2:172.21.15.154:3300/0 conn(0x7f1ac415d220 0x7f1ac40d3910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:28:51.719 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:51.711+0000 7f1ac8d44640 1 -- 172.21.15.102:0/3128365932 <== mon.0 v1:172.21.15.102:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3788536769 0 0) 0x7f1ac40b3840 con 0x7f1ac415d600 2023-11-13T11:28:51.719 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:51.711+0000 7f1ac8d44640 1 -- 172.21.15.102:0/3128365932 --> v1:172.21.15.102:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1ab0003530 con 0x7f1ac415d600 2023-11-13T11:28:51.720 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:51.711+0000 7f1ac9d46640 1 -- 172.21.15.102:0/3128365932 >> v1:172.21.15.154:6789/0 conn(0x7f1ac40b3f60 legacy=0x7f1ac40cf420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:28:51.720 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:51.711+0000 7f1ac9d46640 1 -- 172.21.15.102:0/3128365932 >> v1:172.21.15.102:6789/0 conn(0x7f1ac415d600 legacy=0x7f1ac40b2750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:28:51.720 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:51.711+0000 7f1ac9d46640 1 -- 172.21.15.102:0/3128365932 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ac40d0fe0 con 0x7f1ac415d220 2023-11-13T11:28:51.720 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:51.715+0000 7f1ac9d46640 1 --2- 172.21.15.102:0/3128365932 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1ac415d220 0x7f1ac40d3910 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f1ac00097c0 tx=0x7f1ac001c330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9cd4e8254858b7c1 server_cookie=0 in_seq=0 out_seq=0 2023-11-13T11:28:51.721 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:51.715+0000 7f1ac8d44640 1 -- 172.21.15.102:0/3128365932 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ac00ab600 con 0x7f1ac415d220 2023-11-13T11:28:51.722 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:51.715+0000 7f1ac8d44640 1 -- 172.21.15.102:0/3128365932 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ac00a7050 con 0x7f1ac415d220 2023-11-13T11:28:51.722 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:51.715+0000 7f1ac8d44640 1 -- 172.21.15.102:0/3128365932 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ac00ab980 con 0x7f1ac415d220 2023-11-13T11:28:51.722 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:51.715+0000 7f1acbfaa640 1 -- 172.21.15.102:0/3128365932 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1ac415d220 msgr2=0x7f1ac40d3910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:28:51.722 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:51.715+0000 7f1acbfaa640 1 --2- 172.21.15.102:0/3128365932 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1ac415d220 0x7f1ac40d3910 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f1ac00097c0 tx=0x7f1ac001c330 comp rx=0 tx=0).stop 2023-11-13T11:28:51.722 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:51.715+0000 7f1acbfaa640 1 -- 172.21.15.102:0/3128365932 shutdown_connections 2023-11-13T11:28:51.723 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:51.715+0000 7f1acbfaa640 1 --2- 172.21.15.102:0/3128365932 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1ac415d220 0x7f1ac40d3910 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:28:51.723 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:51.715+0000 7f1acbfaa640 1 -- 172.21.15.102:0/3128365932 >> 172.21.15.102:0/3128365932 conn(0x7f1ac40d2df0 msgr2=0x7f1ac40d3200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-13T11:28:51.724 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:51.715+0000 7f1acbfaa640 1 -- 172.21.15.102:0/3128365932 shutdown_connections 2023-11-13T11:28:51.724 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:51.715+0000 7f1acbfaa640 1 -- 172.21.15.102:0/3128365932 wait complete. 2023-11-13T11:28:51.724 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:51.719+0000 7f1acbfaa640 1 Processor -- start 2023-11-13T11:28:51.724 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:51.719+0000 7f1acbfaa640 1 -- start start 2023-11-13T11:28:51.726 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:51.719+0000 7f1acbfaa640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1ac40b3f60 0x7f1ac4157120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:28:51.726 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:51.719+0000 7f1acbfaa640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1ac415d220 0x7f1ac40c9450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:28:51.727 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:51.719+0000 7f1acbfaa640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1ac415d600 0x7f1ac414a920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:28:51.727 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:51.719+0000 7f1acbfaa640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ac40c9990 con 0x7f1ac40b3f60 2023-11-13T11:28:51.727 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:51.719+0000 7f1acbfaa640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ac4156680 con 0x7f1ac415d600 2023-11-13T11:28:51.727 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:51.719+0000 7f1acbfaa640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ac415d9e0 con 0x7f1ac415d220 2023-11-13T11:28:51.727 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:51.719+0000 7f1ac9d46640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1ac40b3f60 0x7f1ac4157120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:28:51.728 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:51.719+0000 7f1ac9d46640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1ac40b3f60 0x7f1ac4157120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:49554/0 (socket says 172.21.15.102:49554) 2023-11-13T11:28:51.728 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:51.719+0000 7f1ac9d46640 1 -- 172.21.15.102:0/3706577064 learned_addr learned my addr 172.21.15.102:0/3706577064 (peer_addr_for_me v2:172.21.15.102:0/0) 2023-11-13T11:28:51.728 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:51.719+0000 7f1aca547640 1 --2- 172.21.15.102:0/3706577064 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1ac415d600 0x7f1ac414a920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:28:51.728 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:51.719+0000 7f1ac9545640 1 --2- 172.21.15.102:0/3706577064 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1ac415d220 0x7f1ac40c9450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:28:51.728 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:51.719+0000 7f1ac9d46640 1 -- 172.21.15.102:0/3706577064 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1ac415d220 msgr2=0x7f1ac40c9450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:28:51.729 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:51.719+0000 7f1ac9d46640 1 --2- 172.21.15.102:0/3706577064 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1ac415d220 0x7f1ac40c9450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:28:51.729 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:51.719+0000 7f1ac9d46640 1 -- 172.21.15.102:0/3706577064 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1ac415d600 msgr2=0x7f1ac414a920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:28:51.729 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:51.719+0000 7f1ac9d46640 1 --2- 172.21.15.102:0/3706577064 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1ac415d600 0x7f1ac414a920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:28:51.729 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:51.719+0000 7f1ac9d46640 1 -- 172.21.15.102:0/3706577064 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ac0009420 con 0x7f1ac40b3f60 2023-11-13T11:28:51.729 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:51.719+0000 7f1ac9545640 1 --2- 172.21.15.102:0/3706577064 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1ac415d220 0x7f1ac40c9450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-13T11:28:51.730 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:51.719+0000 7f1ac9d46640 1 --2- 172.21.15.102:0/3706577064 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1ac40b3f60 0x7f1ac4157120 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f1ac0018f40 tx=0x7f1ac001ab70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-13T11:28:51.730 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:51.719+0000 7f1aba7fc640 1 -- 172.21.15.102:0/3706577064 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ac00b7450 con 0x7f1ac40b3f60 2023-11-13T11:28:51.730 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:51.719+0000 7f1aba7fc640 1 -- 172.21.15.102:0/3706577064 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ac00b75b0 con 0x7f1ac40b3f60 2023-11-13T11:28:51.730 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:51.719+0000 7f1acbfaa640 1 -- 172.21.15.102:0/3706577064 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1ac415dcc0 con 0x7f1ac40b3f60 2023-11-13T11:28:51.730 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:51.719+0000 7f1aba7fc640 1 -- 172.21.15.102:0/3706577064 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ac00b7960 con 0x7f1ac40b3f60 2023-11-13T11:28:51.731 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:51.723+0000 7f1acbfaa640 1 -- 172.21.15.102:0/3706577064 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1ac4156c00 con 0x7f1ac40b3f60 2023-11-13T11:28:51.731 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:51.723+0000 7f1acbfaa640 1 -- 172.21.15.102:0/3706577064 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1ac4068520 con 0x7f1ac40b3f60 2023-11-13T11:28:51.732 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:51.723+0000 7f1aba7fc640 1 -- 172.21.15.102:0/3706577064 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f1ac00b7ac0 con 0x7f1ac40b3f60 2023-11-13T11:28:51.732 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:51.723+0000 7f1aba7fc640 1 --2- 172.21.15.102:0/3706577064 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f1aa8066470 0x7f1aa8068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:28:51.732 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:51.723+0000 7f1aba7fc640 1 -- 172.21.15.102:0/3706577064 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f1ac011e270 con 0x7f1ac40b3f60 2023-11-13T11:28:51.732 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:51.723+0000 7f1ac9545640 1 --2- 172.21.15.102:0/3706577064 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f1aa8066470 0x7f1aa8068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:28:51.732 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:51.723+0000 7f1ac9545640 1 --2- 172.21.15.102:0/3706577064 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f1aa8066470 0x7f1aa8068930 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f1ac4158770 tx=0x7f1ab4009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-13T11:28:51.733 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:51.727+0000 7f1aba7fc640 1 -- 172.21.15.102:0/3706577064 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f1ac00eba30 con 0x7f1ac40b3f60 2023-11-13T11:28:51.884 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:51.879+0000 7f1acbfaa640 1 -- 172.21.15.102:0/3706577064 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f1ac40b8bd0 con 0x7f1ac40b3f60 2023-11-13T11:28:51.884 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:51.879+0000 7f1aba7fc640 1 -- 172.21.15.102:0/3706577064 <== mon.0 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v18) v1 ==== 93+0+10 (secure 0 0 0) 0x7f1ac00bb020 con 0x7f1ac40b3f60 2023-11-13T11:28:51.885 INFO:teuthology.orchestra.run.smithi102.stdout:pg_num: 1 2023-11-13T11:28:51.886 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:51.879+0000 7f1acbfaa640 1 -- 172.21.15.102:0/3706577064 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f1aa8066470 msgr2=0x7f1aa8068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:28:51.886 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:51.879+0000 7f1acbfaa640 1 --2- 172.21.15.102:0/3706577064 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f1aa8066470 0x7f1aa8068930 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f1ac4158770 tx=0x7f1ab4009040 comp rx=0 tx=0).stop 2023-11-13T11:28:51.887 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:51.879+0000 7f1acbfaa640 1 -- 172.21.15.102:0/3706577064 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1ac40b3f60 msgr2=0x7f1ac4157120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:28:51.887 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:51.879+0000 7f1acbfaa640 1 --2- 172.21.15.102:0/3706577064 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1ac40b3f60 0x7f1ac4157120 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f1ac0018f40 tx=0x7f1ac001ab70 comp rx=0 tx=0).stop 2023-11-13T11:28:51.887 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:51.879+0000 7f1acbfaa640 1 -- 172.21.15.102:0/3706577064 shutdown_connections 2023-11-13T11:28:51.887 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:51.879+0000 7f1acbfaa640 1 --2- 172.21.15.102:0/3706577064 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1ac415d600 0x7f1ac414a920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:28:51.888 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:51.879+0000 7f1acbfaa640 1 --2- 172.21.15.102:0/3706577064 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1ac415d220 0x7f1ac40c9450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:28:51.888 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:51.879+0000 7f1acbfaa640 1 --2- 172.21.15.102:0/3706577064 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f1aa8066470 0x7f1aa8068930 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:28:51.888 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:51.879+0000 7f1acbfaa640 1 --2- 172.21.15.102:0/3706577064 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1ac40b3f60 0x7f1ac4157120 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:28:51.888 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:51.883+0000 7f1acbfaa640 1 -- 172.21.15.102:0/3706577064 >> 172.21.15.102:0/3706577064 conn(0x7f1ac40d2df0 msgr2=0x7f1ac40afb80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-13T11:28:51.888 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:51.883+0000 7f1acbfaa640 1 -- 172.21.15.102:0/3706577064 shutdown_connections 2023-11-13T11:28:51.888 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:51.883+0000 7f1acbfaa640 1 -- 172.21.15.102:0/3706577064 wait complete. 2023-11-13T11:28:51.905 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-13T11:28:52.044 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:52.039+0000 7f5ed2f57640 1 Processor -- start 2023-11-13T11:28:52.045 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:52.039+0000 7f5ed2f57640 1 -- start start 2023-11-13T11:28:52.046 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:52.039+0000 7f5ed2f57640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5ecc06a4a0 0x7f5ecc0aec50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:28:52.047 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:52.039+0000 7f5ed2f57640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f5ecc0af190 0x7f5ecc15d070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:28:52.047 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:52.039+0000 7f5ed2f57640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5ecc0b2fc0 con 0x7f5ecc06a880 2023-11-13T11:28:52.047 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:52.039+0000 7f5ed2f57640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5ecc0af600 con 0x7f5ecc0af190 2023-11-13T11:28:52.047 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:52.039+0000 7f5ed2f57640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ecc06d8a0 con 0x7f5ecc06a4a0 2023-11-13T11:28:52.047 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:52.039+0000 7f5ecbfff640 1 --1- >> v1:172.21.15.102:6789/0 conn(0x7f5ecc06a880 0x7f5ecc15c960 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.102:6789/0 says I am v1:172.21.15.102:50482/0 (socket says 172.21.15.102:50482) 2023-11-13T11:28:52.048 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:52.039+0000 7f5ecbfff640 1 -- 172.21.15.102:0/3649508703 learned_addr learned my addr 172.21.15.102:0/3649508703 (peer_addr_for_me v1:172.21.15.102:0/0) 2023-11-13T11:28:52.048 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:52.039+0000 7f5ed14f4640 1 --2- 172.21.15.102:0/3649508703 >> v2:172.21.15.102:3300/0 conn(0x7f5ecc0af190 0x7f5ecc15d070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:28:52.048 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:52.039+0000 7f5ed0cf3640 1 --2- 172.21.15.102:0/3649508703 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5ecc06a4a0 0x7f5ecc0aec50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:28:52.048 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:52.043+0000 7f5ed14f4640 1 -- 172.21.15.102:0/3649508703 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5ecc06a4a0 msgr2=0x7f5ecc0aec50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-13T11:28:52.049 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:52.043+0000 7f5ed14f4640 1 --2- 172.21.15.102:0/3649508703 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5ecc06a4a0 0x7f5ecc0aec50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:28:52.049 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:52.043+0000 7f5ed14f4640 1 -- 172.21.15.102:0/3649508703 >> v1:172.21.15.102:6789/0 conn(0x7f5ecc06a880 legacy=0x7f5ecc15c960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:28:52.049 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:52.043+0000 7f5ed14f4640 1 -- 172.21.15.102:0/3649508703 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ecc15d6f0 con 0x7f5ecc0af190 2023-11-13T11:28:52.049 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:52.043+0000 7f5ecb7fe640 1 -- 172.21.15.102:0/3649508703 <== mon.0 v1:172.21.15.102:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1759428602 0 0) 0x7f5ecc0b2fc0 con 0x7f5ecc06a880 2023-11-13T11:28:52.051 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:52.043+0000 7f5ed14f4640 1 --2- 172.21.15.102:0/3649508703 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5ecc0af190 0x7f5ecc15d070 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f5ec4009d90 tx=0x7f5ec401c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=619f87ea5aabb405 server_cookie=0 in_seq=0 out_seq=0 2023-11-13T11:28:52.051 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:52.043+0000 7f5ecb7fe640 1 -- 172.21.15.102:0/3649508703 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ec40a5870 con 0x7f5ecc0af190 2023-11-13T11:28:52.052 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:52.043+0000 7f5ecb7fe640 1 -- 172.21.15.102:0/3649508703 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ec40a59d0 con 0x7f5ecc0af190 2023-11-13T11:28:52.052 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:52.043+0000 7f5ecb7fe640 1 -- 172.21.15.102:0/3649508703 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ec40a5d60 con 0x7f5ecc0af190 2023-11-13T11:28:52.052 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:52.043+0000 7f5ed2f57640 1 -- 172.21.15.102:0/3649508703 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5ecc0af190 msgr2=0x7f5ecc15d070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:28:52.053 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:52.043+0000 7f5ed2f57640 1 --2- 172.21.15.102:0/3649508703 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5ecc0af190 0x7f5ecc15d070 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f5ec4009d90 tx=0x7f5ec401c8c0 comp rx=0 tx=0).stop 2023-11-13T11:28:52.053 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:52.043+0000 7f5ed2f57640 1 -- 172.21.15.102:0/3649508703 shutdown_connections 2023-11-13T11:28:52.053 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:52.043+0000 7f5ed2f57640 1 --2- 172.21.15.102:0/3649508703 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5ecc0af190 0x7f5ecc15d070 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:28:52.054 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:52.043+0000 7f5ed2f57640 1 --2- 172.21.15.102:0/3649508703 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5ecc06a4a0 0x7f5ecc0aec50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:28:52.054 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:52.043+0000 7f5ed2f57640 1 -- 172.21.15.102:0/3649508703 >> 172.21.15.102:0/3649508703 conn(0x7f5ecc06b350 msgr2=0x7f5ecc06b760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-13T11:28:52.054 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:52.047+0000 7f5ed2f57640 1 -- 172.21.15.102:0/3649508703 shutdown_connections 2023-11-13T11:28:52.055 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:52.047+0000 7f5ed2f57640 1 -- 172.21.15.102:0/3649508703 wait complete. 2023-11-13T11:28:52.057 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:52.047+0000 7f5ed2f57640 1 Processor -- start 2023-11-13T11:28:52.058 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:52.047+0000 7f5ed2f57640 1 -- start start 2023-11-13T11:28:52.058 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:52.047+0000 7f5ed2f57640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5ecc06a4a0 0x7f5ecc149f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:28:52.058 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:52.047+0000 7f5ed2f57640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5ecc06a880 0x7f5ecc15fa20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:28:52.058 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:52.047+0000 7f5ed2f57640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5ecc0af190 0x7f5ecc0af7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:28:52.059 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:52.047+0000 7f5ed2f57640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ecc14a440 con 0x7f5ecc0af190 2023-11-13T11:28:52.059 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:52.047+0000 7f5ed2f57640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ecc14a710 con 0x7f5ecc06a4a0 2023-11-13T11:28:52.059 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:52.047+0000 7f5ed2f57640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ecc14fe20 con 0x7f5ecc06a880 2023-11-13T11:28:52.059 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:52.047+0000 7f5ed14f4640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5ecc0af190 0x7f5ecc0af7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:28:52.060 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:52.047+0000 7f5ed14f4640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5ecc0af190 0x7f5ecc0af7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:49572/0 (socket says 172.21.15.102:49572) 2023-11-13T11:28:52.060 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:52.047+0000 7f5ed14f4640 1 -- 172.21.15.102:0/155121940 learned_addr learned my addr 172.21.15.102:0/155121940 (peer_addr_for_me v2:172.21.15.102:0/0) 2023-11-13T11:28:52.060 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:52.047+0000 7f5ed0cf3640 1 --2- 172.21.15.102:0/155121940 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5ecc06a4a0 0x7f5ecc149f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:28:52.060 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:52.047+0000 7f5ecbfff640 1 --2- 172.21.15.102:0/155121940 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5ecc06a880 0x7f5ecc15fa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:28:52.061 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:52.047+0000 7f5ed14f4640 1 -- 172.21.15.102:0/155121940 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5ecc06a880 msgr2=0x7f5ecc15fa20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:28:52.061 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:52.047+0000 7f5ed14f4640 1 --2- 172.21.15.102:0/155121940 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5ecc06a880 0x7f5ecc15fa20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:28:52.061 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:52.047+0000 7f5ed14f4640 1 -- 172.21.15.102:0/155121940 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5ecc06a4a0 msgr2=0x7f5ecc149f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:28:52.062 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:52.047+0000 7f5ed14f4640 1 --2- 172.21.15.102:0/155121940 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5ecc06a4a0 0x7f5ecc149f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:28:52.062 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:52.047+0000 7f5ed14f4640 1 -- 172.21.15.102:0/155121940 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ec4009a70 con 0x7f5ecc0af190 2023-11-13T11:28:52.063 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:52.047+0000 7f5ecbfff640 1 --2- 172.21.15.102:0/155121940 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5ecc06a880 0x7f5ecc15fa20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-13T11:28:52.063 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:52.047+0000 7f5ed14f4640 1 --2- 172.21.15.102:0/155121940 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5ecc0af190 0x7f5ecc0af7f0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f5ec401af70 tx=0x7f5ec4019660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-13T11:28:52.064 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:52.051+0000 7f5ec97fa640 1 -- 172.21.15.102:0/155121940 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ec40b9650 con 0x7f5ecc0af190 2023-11-13T11:28:52.064 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:52.051+0000 7f5ec97fa640 1 -- 172.21.15.102:0/155121940 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ec40b97b0 con 0x7f5ecc0af190 2023-11-13T11:28:52.064 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:52.051+0000 7f5ec97fa640 1 -- 172.21.15.102:0/155121940 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ec40b9b20 con 0x7f5ecc0af190 2023-11-13T11:28:52.064 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:52.051+0000 7f5ed2f57640 1 -- 172.21.15.102:0/155121940 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5ecc150100 con 0x7f5ecc0af190 2023-11-13T11:28:52.064 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:52.051+0000 7f5ed2f57640 1 -- 172.21.15.102:0/155121940 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5ecc14fa80 con 0x7f5ecc0af190 2023-11-13T11:28:52.065 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:52.051+0000 7f5ed2f57640 1 -- 172.21.15.102:0/155121940 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5ecc067680 con 0x7f5ecc0af190 2023-11-13T11:28:52.065 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:52.051+0000 7f5ec97fa640 1 -- 172.21.15.102:0/155121940 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f5ec40b9c80 con 0x7f5ecc0af190 2023-11-13T11:28:52.065 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:52.051+0000 7f5ec97fa640 1 --2- 172.21.15.102:0/155121940 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f5eb0066470 0x7f5eb0068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:28:52.065 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:52.051+0000 7f5ec97fa640 1 -- 172.21.15.102:0/155121940 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f5ec411eba0 con 0x7f5ecc0af190 2023-11-13T11:28:52.066 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:52.051+0000 7f5ed0cf3640 1 --2- 172.21.15.102:0/155121940 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f5eb0066470 0x7f5eb0068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:28:52.066 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:52.055+0000 7f5ed0cf3640 1 --2- 172.21.15.102:0/155121940 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f5eb0066470 0x7f5eb0068930 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f5ecc14b2c0 tx=0x7f5ec0009190 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-13T11:28:52.067 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:52.055+0000 7f5ec97fa640 1 -- 172.21.15.102:0/155121940 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f5ec40ec400 con 0x7f5ecc0af190 2023-11-13T11:28:52.240 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:52.235+0000 7f5ed2f57640 1 -- 172.21.15.102:0/155121940 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f5ecc068520 con 0x7f5ecc0af190 2023-11-13T11:28:52.241 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:52.235+0000 7f5ec97fa640 1 -- 172.21.15.102:0/155121940 <== mon.0 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 2 v2) v1 ==== 93+0+1327 (secure 0 0 0) 0x7f5ec40efa20 con 0x7f5ecc0af190 2023-11-13T11:28:52.242 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T11:28:52.242 INFO:teuthology.orchestra.run.smithi102.stdout:{"epoch":2,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4270,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.102:6837/1874856825","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6834","nonce":1874856825},{"type":"v1","addr":"172.21.15.102:6837","nonce":1874856825}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2}],"filesystems":[]} 2023-11-13T11:28:52.243 INFO:teuthology.orchestra.run.smithi102.stderr:dumped fsmap epoch 2 2023-11-13T11:28:52.243 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:52.239+0000 7f5ed2f57640 1 -- 172.21.15.102:0/155121940 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f5eb0066470 msgr2=0x7f5eb0068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:28:52.243 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:52.239+0000 7f5ed2f57640 1 --2- 172.21.15.102:0/155121940 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f5eb0066470 0x7f5eb0068930 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f5ecc14b2c0 tx=0x7f5ec0009190 comp rx=0 tx=0).stop 2023-11-13T11:28:52.244 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:52.239+0000 7f5ed2f57640 1 -- 172.21.15.102:0/155121940 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5ecc0af190 msgr2=0x7f5ecc0af7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:28:52.244 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:52.239+0000 7f5ed2f57640 1 --2- 172.21.15.102:0/155121940 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5ecc0af190 0x7f5ecc0af7f0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f5ec401af70 tx=0x7f5ec4019660 comp rx=0 tx=0).stop 2023-11-13T11:28:52.244 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:52.239+0000 7f5ed2f57640 1 -- 172.21.15.102:0/155121940 shutdown_connections 2023-11-13T11:28:52.244 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:52.239+0000 7f5ed2f57640 1 --2- 172.21.15.102:0/155121940 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f5eb0066470 0x7f5eb0068930 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:28:52.244 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:52.239+0000 7f5ed2f57640 1 --2- 172.21.15.102:0/155121940 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5ecc0af190 0x7f5ecc0af7f0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:28:52.245 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:52.239+0000 7f5ed2f57640 1 --2- 172.21.15.102:0/155121940 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5ecc06a880 0x7f5ecc15fa20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:28:52.245 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:52.239+0000 7f5ed2f57640 1 --2- 172.21.15.102:0/155121940 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5ecc06a4a0 0x7f5ecc149f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:28:52.245 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:52.239+0000 7f5ed2f57640 1 -- 172.21.15.102:0/155121940 >> 172.21.15.102:0/155121940 conn(0x7f5ecc06b350 msgr2=0x7f5ecc15ce80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-13T11:28:52.245 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:52.239+0000 7f5ed2f57640 1 -- 172.21.15.102:0/155121940 shutdown_connections 2023-11-13T11:28:52.245 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:52.239+0000 7f5ed2f57640 1 -- 172.21.15.102:0/155121940 wait complete. 2023-11-13T11:28:54.263 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-13T11:28:54.408 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:54.403+0000 7fbe46c17640 1 Processor -- start 2023-11-13T11:28:54.409 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:54.403+0000 7fbe46c17640 1 -- start start 2023-11-13T11:28:54.410 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:54.403+0000 7fbe46c17640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fbe4015da20 0x7fbe4015de00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:28:54.411 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:54.403+0000 7fbe46c17640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7fbe400b2a70 0x7fbe4015e340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:28:54.411 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:54.403+0000 7fbe46c17640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbe400cdc30 con 0x7fbe400719b0 2023-11-13T11:28:54.411 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:54.403+0000 7fbe46c17640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbe400cd300 con 0x7fbe400b2a70 2023-11-13T11:28:54.411 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:54.403+0000 7fbe46c17640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe400cd5e0 con 0x7fbe4015da20 2023-11-13T11:28:54.411 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:54.403+0000 7fbe37fff640 1 --1- >> v1:172.21.15.102:6789/0 conn(0x7fbe400719b0 0x7fbe400b2360 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.102:6789/0 says I am v1:172.21.15.102:50490/0 (socket says 172.21.15.102:50490) 2023-11-13T11:28:54.412 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:54.403+0000 7fbe37fff640 1 -- 172.21.15.102:0/2869502511 learned_addr learned my addr 172.21.15.102:0/2869502511 (peer_addr_for_me v1:172.21.15.102:0/0) 2023-11-13T11:28:54.412 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:54.403+0000 7fbe451b4640 1 --2- 172.21.15.102:0/2869502511 >> v2:172.21.15.102:3300/0 conn(0x7fbe400b2a70 0x7fbe4015e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:28:54.412 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:54.407+0000 7fbe449b3640 1 --2- 172.21.15.102:0/2869502511 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fbe4015da20 0x7fbe4015de00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:28:54.412 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:54.407+0000 7fbe377fe640 1 -- 172.21.15.102:0/2869502511 <== mon.0 v1:172.21.15.102:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1067731403 0 0) 0x7fbe400cdc30 con 0x7fbe400719b0 2023-11-13T11:28:54.412 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:54.407+0000 7fbe451b4640 1 -- 172.21.15.102:0/2869502511 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fbe4015da20 msgr2=0x7fbe4015de00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-13T11:28:54.413 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:54.407+0000 7fbe451b4640 1 --2- 172.21.15.102:0/2869502511 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fbe4015da20 0x7fbe4015de00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:28:54.413 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:54.407+0000 7fbe451b4640 1 -- 172.21.15.102:0/2869502511 >> v1:172.21.15.102:6789/0 conn(0x7fbe400719b0 legacy=0x7fbe400b2360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:28:54.413 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:54.407+0000 7fbe451b4640 1 -- 172.21.15.102:0/2869502511 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe400cd8c0 con 0x7fbe400b2a70 2023-11-13T11:28:54.415 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:54.407+0000 7fbe451b4640 1 --2- 172.21.15.102:0/2869502511 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fbe400b2a70 0x7fbe4015e340 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fbe38009d90 tx=0x7fbe3801c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a51dd6d37f910a32 server_cookie=0 in_seq=0 out_seq=0 2023-11-13T11:28:54.415 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:54.407+0000 7fbe377fe640 1 -- 172.21.15.102:0/2869502511 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe380a5a30 con 0x7fbe400b2a70 2023-11-13T11:28:54.416 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:54.407+0000 7fbe377fe640 1 -- 172.21.15.102:0/2869502511 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe380a5b90 con 0x7fbe400b2a70 2023-11-13T11:28:54.416 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:54.407+0000 7fbe377fe640 1 -- 172.21.15.102:0/2869502511 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe380ad440 con 0x7fbe400b2a70 2023-11-13T11:28:54.416 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:54.407+0000 7fbe46c17640 1 -- 172.21.15.102:0/2869502511 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fbe400b2a70 msgr2=0x7fbe4015e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:28:54.416 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:54.407+0000 7fbe46c17640 1 --2- 172.21.15.102:0/2869502511 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fbe400b2a70 0x7fbe4015e340 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fbe38009d90 tx=0x7fbe3801c950 comp rx=0 tx=0).stop 2023-11-13T11:28:54.416 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:54.411+0000 7fbe46c17640 1 -- 172.21.15.102:0/2869502511 shutdown_connections 2023-11-13T11:28:54.417 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:54.411+0000 7fbe46c17640 1 --2- 172.21.15.102:0/2869502511 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fbe400b2a70 0x7fbe4015e340 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:28:54.417 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:54.411+0000 7fbe46c17640 1 --2- 172.21.15.102:0/2869502511 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fbe4015da20 0x7fbe4015de00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:28:54.417 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:54.411+0000 7fbe46c17640 1 -- 172.21.15.102:0/2869502511 >> 172.21.15.102:0/2869502511 conn(0x7fbe400b0870 msgr2=0x7fbe400b0c80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-13T11:28:54.417 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:54.411+0000 7fbe46c17640 1 -- 172.21.15.102:0/2869502511 shutdown_connections 2023-11-13T11:28:54.417 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:54.411+0000 7fbe46c17640 1 -- 172.21.15.102:0/2869502511 wait complete. 2023-11-13T11:28:54.419 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:54.411+0000 7fbe46c17640 1 Processor -- start 2023-11-13T11:28:54.420 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:54.411+0000 7fbe46c17640 1 -- start start 2023-11-13T11:28:54.420 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:54.411+0000 7fbe46c17640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fbe400719b0 0x7fbe4013e590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:28:54.420 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:54.411+0000 7fbe46c17640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fbe400b2a70 0x7fbe4006d090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:28:54.420 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:54.411+0000 7fbe46c17640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbe4015da20 0x7fbe4006d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:28:54.421 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:54.411+0000 7fbe46c17640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe40159f10 con 0x7fbe400719b0 2023-11-13T11:28:54.421 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:54.411+0000 7fbe46c17640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe4015a750 con 0x7fbe4015da20 2023-11-13T11:28:54.421 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:54.411+0000 7fbe46c17640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe40159c30 con 0x7fbe400b2a70 2023-11-13T11:28:54.421 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:54.411+0000 7fbe449b3640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fbe400719b0 0x7fbe4013e590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:28:54.421 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:54.411+0000 7fbe449b3640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fbe400719b0 0x7fbe4013e590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:49586/0 (socket says 172.21.15.102:49586) 2023-11-13T11:28:54.422 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:54.411+0000 7fbe449b3640 1 -- 172.21.15.102:0/2880184858 learned_addr learned my addr 172.21.15.102:0/2880184858 (peer_addr_for_me v2:172.21.15.102:0/0) 2023-11-13T11:28:54.422 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:54.411+0000 7fbe449b3640 1 -- 172.21.15.102:0/2880184858 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fbe400b2a70 msgr2=0x7fbe4006d090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:28:54.422 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:54.411+0000 7fbe449b3640 1 --2- 172.21.15.102:0/2880184858 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fbe400b2a70 0x7fbe4006d090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:28:54.422 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:54.411+0000 7fbe449b3640 1 -- 172.21.15.102:0/2880184858 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbe4015da20 msgr2=0x7fbe4006d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:28:54.422 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:54.411+0000 7fbe449b3640 1 --2- 172.21.15.102:0/2880184858 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbe4015da20 0x7fbe4006d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:28:54.423 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:54.411+0000 7fbe449b3640 1 -- 172.21.15.102:0/2880184858 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe38009a70 con 0x7fbe400719b0 2023-11-13T11:28:54.423 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:54.411+0000 7fbe449b3640 1 --2- 172.21.15.102:0/2880184858 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fbe400719b0 0x7fbe4013e590 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fbe3c00d5f0 tx=0x7fbe3c00dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-13T11:28:54.423 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:54.411+0000 7fbe357fa640 1 -- 172.21.15.102:0/2880184858 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe3c0125f0 con 0x7fbe400719b0 2023-11-13T11:28:54.423 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:54.415+0000 7fbe357fa640 1 -- 172.21.15.102:0/2880184858 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe3c012750 con 0x7fbe400719b0 2023-11-13T11:28:54.424 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:54.415+0000 7fbe46c17640 1 -- 172.21.15.102:0/2880184858 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbe4013f0b0 con 0x7fbe400719b0 2023-11-13T11:28:54.424 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:54.415+0000 7fbe357fa640 1 -- 172.21.15.102:0/2880184858 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe3c012ae0 con 0x7fbe400719b0 2023-11-13T11:28:54.424 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:54.415+0000 7fbe46c17640 1 -- 172.21.15.102:0/2880184858 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbe4013f670 con 0x7fbe400719b0 2023-11-13T11:28:54.424 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:54.415+0000 7fbe46c17640 1 -- 172.21.15.102:0/2880184858 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbe4013ef10 con 0x7fbe400719b0 2023-11-13T11:28:54.425 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:54.415+0000 7fbe357fa640 1 -- 172.21.15.102:0/2880184858 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fbe3c012c40 con 0x7fbe400719b0 2023-11-13T11:28:54.426 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:54.415+0000 7fbe357fa640 1 --2- 172.21.15.102:0/2880184858 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7fbe2c066470 0x7fbe2c068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:28:54.426 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:54.415+0000 7fbe357fa640 1 -- 172.21.15.102:0/2880184858 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fbe3c0840d0 con 0x7fbe400719b0 2023-11-13T11:28:54.426 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:54.415+0000 7fbe37fff640 1 --2- 172.21.15.102:0/2880184858 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7fbe2c066470 0x7fbe2c068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:28:54.426 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:54.419+0000 7fbe37fff640 1 --2- 172.21.15.102:0/2880184858 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7fbe2c066470 0x7fbe2c068930 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fbe300011f0 tx=0x7fbe30007930 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-13T11:28:54.427 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:54.419+0000 7fbe357fa640 1 -- 172.21.15.102:0/2880184858 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fbe4013ef10 con 0x7fbe400719b0 2023-11-13T11:28:54.603 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:54.599+0000 7fbe46c17640 1 -- 172.21.15.102:0/2880184858 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fbe4013ef10 con 0x7fbe400719b0 2023-11-13T11:28:54.604 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:54.599+0000 7fbe357fa640 1 -- 172.21.15.102:0/2880184858 <== mon.0 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) v1 ==== 93+0+3700 (secure 0 0 0) 0x7fbe4013ef10 con 0x7fbe400719b0 2023-11-13T11:28:54.605 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T11:28:54.605 INFO:teuthology.orchestra.run.smithi102.stdout:{"epoch":3,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4226,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.102:6836/659983176","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6835","nonce":659983176},{"type":"v1","addr":"172.21.15.102:6836","nonce":659983176}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4270,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.102:6837/1874856825","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6834","nonce":1874856825},{"type":"v1","addr":"172.21.15.102:6837","nonce":1874856825}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4276,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6834/532911681","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6832","nonce":532911681},{"type":"v1","addr":"172.21.15.154:6834","nonce":532911681}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4279,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6835/3766337294","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6833","nonce":3766337294},{"type":"v1","addr":"172.21.15.154:6835","nonce":3766337294}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[]} 2023-11-13T11:28:54.606 INFO:teuthology.orchestra.run.smithi102.stderr:dumped fsmap epoch 3 2023-11-13T11:28:54.606 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:54.599+0000 7fbe46c17640 1 -- 172.21.15.102:0/2880184858 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7fbe2c066470 msgr2=0x7fbe2c068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:28:54.607 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:54.599+0000 7fbe46c17640 1 --2- 172.21.15.102:0/2880184858 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7fbe2c066470 0x7fbe2c068930 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fbe300011f0 tx=0x7fbe30007930 comp rx=0 tx=0).stop 2023-11-13T11:28:54.607 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:54.599+0000 7fbe46c17640 1 -- 172.21.15.102:0/2880184858 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fbe400719b0 msgr2=0x7fbe4013e590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:28:54.607 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:54.599+0000 7fbe46c17640 1 --2- 172.21.15.102:0/2880184858 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fbe400719b0 0x7fbe4013e590 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fbe3c00d5f0 tx=0x7fbe3c00dab0 comp rx=0 tx=0).stop 2023-11-13T11:28:54.608 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:54.599+0000 7fbe46c17640 1 -- 172.21.15.102:0/2880184858 shutdown_connections 2023-11-13T11:28:54.608 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:54.599+0000 7fbe46c17640 1 --2- 172.21.15.102:0/2880184858 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbe4015da20 0x7fbe4006d5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:28:54.608 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:54.599+0000 7fbe46c17640 1 --2- 172.21.15.102:0/2880184858 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fbe400b2a70 0x7fbe4006d090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:28:54.609 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:54.599+0000 7fbe46c17640 1 --2- 172.21.15.102:0/2880184858 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7fbe2c066470 0x7fbe2c068930 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:28:54.609 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:54.599+0000 7fbe46c17640 1 --2- 172.21.15.102:0/2880184858 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fbe400719b0 0x7fbe4013e590 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:28:54.609 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:54.599+0000 7fbe46c17640 1 -- 172.21.15.102:0/2880184858 >> 172.21.15.102:0/2880184858 conn(0x7fbe400b0870 msgr2=0x7fbe40157330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-13T11:28:54.610 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:54.599+0000 7fbe46c17640 1 -- 172.21.15.102:0/2880184858 shutdown_connections 2023-11-13T11:28:54.610 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:54.603+0000 7fbe46c17640 1 -- 172.21.15.102:0/2880184858 wait complete. 2023-11-13T11:28:54.626 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-13T11:28:54.763 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:54.759+0000 7fa511b57640 1 Processor -- start 2023-11-13T11:28:54.763 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:54.759+0000 7fa511b57640 1 -- start start 2023-11-13T11:28:54.764 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:54.759+0000 7fa511b57640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7fa50c1606e0 0x7fa50c0c69b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:28:54.764 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:54.759+0000 7fa511b57640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa50c0d1440 con 0x7fa50c0cf490 2023-11-13T11:28:54.764 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:54.759+0000 7fa511b57640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa50c0cdb10 con 0x7fa50c0d0c40 2023-11-13T11:28:54.765 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:54.759+0000 7fa511b57640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa50c0d1690 con 0x7fa50c1606e0 2023-11-13T11:28:54.765 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:54.759+0000 7fa50b7fe640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7fa50c1606e0 0x7fa50c0c69b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:28:54.765 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:54.759+0000 7fa50b7fe640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7fa50c1606e0 0x7fa50c0c69b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:49598/0 (socket says 172.21.15.102:49598) 2023-11-13T11:28:54.765 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:54.759+0000 7fa50b7fe640 1 -- 172.21.15.102:0/20553395 learned_addr learned my addr 172.21.15.102:0/20553395 (peer_addr_for_me v2:172.21.15.102:0/0) 2023-11-13T11:28:54.766 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:54.759+0000 7fa50b7fe640 1 -- 172.21.15.102:0/20553395 >> v1:172.21.15.154:6789/0 conn(0x7fa50c0d0c40 legacy=0x7fa50c0b3e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:28:54.766 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:54.759+0000 7fa50b7fe640 1 -- 172.21.15.102:0/20553395 >> v1:172.21.15.102:6789/0 conn(0x7fa50c0cf490 legacy=0x7fa50c0cdfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:28:54.766 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:54.759+0000 7fa50b7fe640 1 -- 172.21.15.102:0/20553395 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa50c0d1970 con 0x7fa50c1606e0 2023-11-13T11:28:54.767 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:54.763+0000 7fa50b7fe640 1 --2- 172.21.15.102:0/20553395 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa50c1606e0 0x7fa50c0c69b0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fa4fc009870 tx=0x7fa4fc01c4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9385c6a81958165 server_cookie=0 in_seq=0 out_seq=0 2023-11-13T11:28:54.769 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:54.763+0000 7fa50a7fc640 1 -- 172.21.15.102:0/20553395 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4fc0ac600 con 0x7fa50c1606e0 2023-11-13T11:28:54.769 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:54.763+0000 7fa50a7fc640 1 -- 172.21.15.102:0/20553395 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa4fc0a8050 con 0x7fa50c1606e0 2023-11-13T11:28:54.769 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:54.763+0000 7fa50a7fc640 1 -- 172.21.15.102:0/20553395 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4fc0ac980 con 0x7fa50c1606e0 2023-11-13T11:28:54.769 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:54.763+0000 7fa511b57640 1 -- 172.21.15.102:0/20553395 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa50c1606e0 msgr2=0x7fa50c0c69b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:28:54.769 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:54.763+0000 7fa511b57640 1 --2- 172.21.15.102:0/20553395 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa50c1606e0 0x7fa50c0c69b0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fa4fc009870 tx=0x7fa4fc01c4b0 comp rx=0 tx=0).stop 2023-11-13T11:28:54.770 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:54.763+0000 7fa511b57640 1 -- 172.21.15.102:0/20553395 shutdown_connections 2023-11-13T11:28:54.770 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:54.763+0000 7fa511b57640 1 --2- 172.21.15.102:0/20553395 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa50c1606e0 0x7fa50c0c69b0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:28:54.770 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:54.763+0000 7fa511b57640 1 -- 172.21.15.102:0/20553395 >> 172.21.15.102:0/20553395 conn(0x7fa50c09c130 msgr2=0x7fa50c0d2e60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-13T11:28:54.771 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:54.763+0000 7fa511b57640 1 -- 172.21.15.102:0/20553395 shutdown_connections 2023-11-13T11:28:54.771 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:54.763+0000 7fa511b57640 1 -- 172.21.15.102:0/20553395 wait complete. 2023-11-13T11:28:54.773 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:54.767+0000 7fa511b57640 1 Processor -- start 2023-11-13T11:28:54.773 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:54.767+0000 7fa511b57640 1 -- start start 2023-11-13T11:28:54.774 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:54.767+0000 7fa511b57640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa50c0cf490 0x7fa50c15f8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:28:54.774 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:54.767+0000 7fa511b57640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa50c0d0c40 0x7fa50c158900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:28:54.774 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:54.767+0000 7fa511b57640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa50c1606e0 0x7fa50c14a190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:28:54.774 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:54.767+0000 7fa511b57640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa50c0cce50 con 0x7fa50c0d0c40 2023-11-13T11:28:54.774 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:54.767+0000 7fa511b57640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa50c14b0e0 con 0x7fa50c1606e0 2023-11-13T11:28:54.775 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:54.767+0000 7fa511b57640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa50c0cc1d0 con 0x7fa50c0cf490 2023-11-13T11:28:54.775 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:54.767+0000 7fa50affd640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa50c0d0c40 0x7fa50c158900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:28:54.775 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:54.767+0000 7fa50b7fe640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa50c0cf490 0x7fa50c15f8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:28:54.775 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:54.767+0000 7fa50affd640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa50c0d0c40 0x7fa50c158900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:49614/0 (socket says 172.21.15.102:49614) 2023-11-13T11:28:54.775 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:54.767+0000 7fa50affd640 1 -- 172.21.15.102:0/156126946 learned_addr learned my addr 172.21.15.102:0/156126946 (peer_addr_for_me v2:172.21.15.102:0/0) 2023-11-13T11:28:54.776 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:54.767+0000 7fa50bfff640 1 --2- 172.21.15.102:0/156126946 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa50c1606e0 0x7fa50c14a190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:28:54.776 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:54.767+0000 7fa50affd640 1 -- 172.21.15.102:0/156126946 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa50c0cf490 msgr2=0x7fa50c15f8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:28:54.776 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:54.767+0000 7fa50affd640 1 --2- 172.21.15.102:0/156126946 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa50c0cf490 0x7fa50c15f8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:28:54.776 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:54.767+0000 7fa50affd640 1 -- 172.21.15.102:0/156126946 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa50c1606e0 msgr2=0x7fa50c14a190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:28:54.776 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:54.767+0000 7fa50affd640 1 --2- 172.21.15.102:0/156126946 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa50c1606e0 0x7fa50c14a190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:28:54.777 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:54.767+0000 7fa50affd640 1 -- 172.21.15.102:0/156126946 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4fc0094d0 con 0x7fa50c0d0c40 2023-11-13T11:28:54.777 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:54.767+0000 7fa50bfff640 1 --2- 172.21.15.102:0/156126946 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa50c1606e0 0x7fa50c14a190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-13T11:28:54.777 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:54.767+0000 7fa50affd640 1 --2- 172.21.15.102:0/156126946 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa50c0d0c40 0x7fa50c158900 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fa50000c500 tx=0x7fa50000c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-13T11:28:54.777 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:54.767+0000 7fa4f3fff640 1 -- 172.21.15.102:0/156126946 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa500005220 con 0x7fa50c0d0c40 2023-11-13T11:28:54.777 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:54.767+0000 7fa4f3fff640 1 -- 172.21.15.102:0/156126946 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa500005380 con 0x7fa50c0d0c40 2023-11-13T11:28:54.778 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:54.767+0000 7fa4f3fff640 1 -- 172.21.15.102:0/156126946 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa500007270 con 0x7fa50c0d0c40 2023-11-13T11:28:54.778 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:54.767+0000 7fa511b57640 1 -- 172.21.15.102:0/156126946 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa50c0cc4b0 con 0x7fa50c0d0c40 2023-11-13T11:28:54.778 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:54.767+0000 7fa511b57640 1 -- 172.21.15.102:0/156126946 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa50c0cca70 con 0x7fa50c0d0c40 2023-11-13T11:28:54.779 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:54.767+0000 7fa511b57640 1 -- 172.21.15.102:0/156126946 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa50c0b5e00 con 0x7fa50c0d0c40 2023-11-13T11:28:54.779 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:54.771+0000 7fa4f3fff640 1 -- 172.21.15.102:0/156126946 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fa5000073d0 con 0x7fa50c0d0c40 2023-11-13T11:28:54.779 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:54.771+0000 7fa4f3fff640 1 --2- 172.21.15.102:0/156126946 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7fa4f8066470 0x7fa4f8068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:28:54.780 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:54.771+0000 7fa4f3fff640 1 -- 172.21.15.102:0/156126946 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fa500083430 con 0x7fa50c0d0c40 2023-11-13T11:28:54.780 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:54.771+0000 7fa50b7fe640 1 --2- 172.21.15.102:0/156126946 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7fa4f8066470 0x7fa4f8068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:28:54.780 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:54.771+0000 7fa50b7fe640 1 --2- 172.21.15.102:0/156126946 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7fa4f8066470 0x7fa4f8068930 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fa4fc0ae000 tx=0x7fa4fc0a7000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-13T11:28:54.780 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:54.775+0000 7fa4f3fff640 1 -- 172.21.15.102:0/156126946 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fa50c0b5e00 con 0x7fa50c0d0c40 2023-11-13T11:28:54.929 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:54.923+0000 7fa511b57640 1 -- 172.21.15.102:0/156126946 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa50c0b5e00 con 0x7fa50c0d0c40 2023-11-13T11:28:54.932 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:54.927+0000 7fa4f3fff640 1 -- 172.21.15.102:0/156126946 <== mon.0 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v18) v1 ==== 74+0+12886 (secure 0 0 0) 0x7fa50c0b5e00 con 0x7fa50c0d0c40 2023-11-13T11:28:54.932 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T11:28:54.932 INFO:teuthology.orchestra.run.smithi102.stdout:{"epoch":18,"fsid":"97b3eb2b-7ccf-4aae-8d92-bff986c671ea","created":"2023-11-13T11:28:31.836724+0000","modified":"2023-11-13T11:28:47.893877+0000","last_up_change":"2023-11-13T11:28:44.876638+0000","last_in_change":"2023-11-13T11:28:35.312740+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-13T11:28:44.981356+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"bdefaa17-fcca-4c86-aa40-27dc33a789af","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6800","nonce":53303834},{"type":"v1","addr":"172.21.15.102:6801","nonce":53303834}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6802","nonce":53303834},{"type":"v1","addr":"172.21.15.102:6803","nonce":53303834}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6806","nonce":53303834},{"type":"v1","addr":"172.21.15.102:6807","nonce":53303834}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6804","nonce":53303834},{"type":"v1","addr":"172.21.15.102:6805","nonce":53303834}]},"public_addr":"172.21.15.102:6801/53303834","cluster_addr":"172.21.15.102:6803/53303834","heartbeat_back_addr":"172.21.15.102:6807/53303834","heartbeat_front_addr":"172.21.15.102:6805/53303834","state":["exists","up"]},{"osd":1,"uuid":"f0033196-dec9-4ae9-945e-6aeef6dbb47f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6808","nonce":1732708348},{"type":"v1","addr":"172.21.15.102:6809","nonce":1732708348}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6811","nonce":1732708348},{"type":"v1","addr":"172.21.15.102:6813","nonce":1732708348}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6818","nonce":1732708348},{"type":"v1","addr":"172.21.15.102:6820","nonce":1732708348}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6815","nonce":1732708348},{"type":"v1","addr":"172.21.15.102:6817","nonce":1732708348}]},"public_addr":"172.21.15.102:6809/1732708348","cluster_addr":"172.21.15.102:6813/1732708348","heartbeat_back_addr":"172.21.15.102:6820/1732708348","heartbeat_front_addr":"172.21.15.102:6817/1732708348","state":["exists","up"]},{"osd":2,"uuid":"496b0834-351e-4ec2-a714-86ed0c0ff4fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6810","nonce":1825475150},{"type":"v1","addr":"172.21.15.102:6812","nonce":1825475150}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6814","nonce":1825475150},{"type":"v1","addr":"172.21.15.102:6816","nonce":1825475150}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6822","nonce":1825475150},{"type":"v1","addr":"172.21.15.102:6823","nonce":1825475150}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6819","nonce":1825475150},{"type":"v1","addr":"172.21.15.102:6821","nonce":1825475150}]},"public_addr":"172.21.15.102:6812/1825475150","cluster_addr":"172.21.15.102:6816/1825475150","heartbeat_back_addr":"172.21.15.102:6823/1825475150","heartbeat_front_addr":"172.21.15.102:6821/1825475150","state":["exists","up"]},{"osd":3,"uuid":"3ba6cc41-e0a0-4273-86cb-90000c06a55a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6824","nonce":4149355528},{"type":"v1","addr":"172.21.15.102:6825","nonce":4149355528}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6826","nonce":4149355528},{"type":"v1","addr":"172.21.15.102:6827","nonce":4149355528}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6830","nonce":4149355528},{"type":"v1","addr":"172.21.15.102:6831","nonce":4149355528}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6828","nonce":4149355528},{"type":"v1","addr":"172.21.15.102:6829","nonce":4149355528}]},"public_addr":"172.21.15.102:6825/4149355528","cluster_addr":"172.21.15.102:6827/4149355528","heartbeat_back_addr":"172.21.15.102:6831/4149355528","heartbeat_front_addr":"172.21.15.102:6829/4149355528","state":["exists","up"]},{"osd":4,"uuid":"16e797d8-e6e7-4140-95c3-b85283c42a2a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6808","nonce":4028899241},{"type":"v1","addr":"172.21.15.154:6809","nonce":4028899241}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6810","nonce":4028899241},{"type":"v1","addr":"172.21.15.154:6811","nonce":4028899241}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6814","nonce":4028899241},{"type":"v1","addr":"172.21.15.154:6815","nonce":4028899241}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6812","nonce":4028899241},{"type":"v1","addr":"172.21.15.154:6813","nonce":4028899241}]},"public_addr":"172.21.15.154:6809/4028899241","cluster_addr":"172.21.15.154:6811/4028899241","heartbeat_back_addr":"172.21.15.154:6815/4028899241","heartbeat_front_addr":"172.21.15.154:6813/4028899241","state":["exists","up"]},{"osd":5,"uuid":"d6ab225c-1b55-450a-89a9-abe5c3f8d6af","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":3562396827},{"type":"v1","addr":"172.21.15.154:6801","nonce":3562396827}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":3562396827},{"type":"v1","addr":"172.21.15.154:6803","nonce":3562396827}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6806","nonce":3562396827},{"type":"v1","addr":"172.21.15.154:6807","nonce":3562396827}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6804","nonce":3562396827},{"type":"v1","addr":"172.21.15.154:6805","nonce":3562396827}]},"public_addr":"172.21.15.154:6801/3562396827","cluster_addr":"172.21.15.154:6803/3562396827","heartbeat_back_addr":"172.21.15.154:6807/3562396827","heartbeat_front_addr":"172.21.15.154:6805/3562396827","state":["exists","up"]},{"osd":6,"uuid":"96f905ac-491c-4662-8e2b-5bb8e929ab9d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6816","nonce":2933728751},{"type":"v1","addr":"172.21.15.154:6817","nonce":2933728751}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6818","nonce":2933728751},{"type":"v1","addr":"172.21.15.154:6819","nonce":2933728751}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6822","nonce":2933728751},{"type":"v1","addr":"172.21.15.154:6823","nonce":2933728751}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6820","nonce":2933728751},{"type":"v1","addr":"172.21.15.154:6821","nonce":2933728751}]},"public_addr":"172.21.15.154:6817/2933728751","cluster_addr":"172.21.15.154:6819/2933728751","heartbeat_back_addr":"172.21.15.154:6823/2933728751","heartbeat_front_addr":"172.21.15.154:6821/2933728751","state":["exists","up"]},{"osd":7,"uuid":"07012d3b-3ab4-40df-a471-93caed22e2dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6824","nonce":1753500785},{"type":"v1","addr":"172.21.15.154:6825","nonce":1753500785}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6826","nonce":1753500785},{"type":"v1","addr":"172.21.15.154:6827","nonce":1753500785}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6830","nonce":1753500785},{"type":"v1","addr":"172.21.15.154:6831","nonce":1753500785}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6828","nonce":1753500785},{"type":"v1","addr":"172.21.15.154:6829","nonce":1753500785}]},"public_addr":"172.21.15.154:6825/1753500785","cluster_addr":"172.21.15.154:6827/1753500785","heartbeat_back_addr":"172.21.15.154:6831/1753500785","heartbeat_front_addr":"172.21.15.154:6829/1753500785","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-13T11:28:40.978603+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-13T11:28:41.200985+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-13T11:28:41.222815+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-13T11:28:41.202162+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-13T11:28:40.925911+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-13T11:28:41.087725+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-13T11:28:41.072208+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-13T11:28:40.875257+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-13T11:28:54.934 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:54.927+0000 7fa511b57640 1 -- 172.21.15.102:0/156126946 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7fa4f8066470 msgr2=0x7fa4f8068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:28:54.935 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:54.927+0000 7fa511b57640 1 --2- 172.21.15.102:0/156126946 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7fa4f8066470 0x7fa4f8068930 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fa4fc0ae000 tx=0x7fa4fc0a7000 comp rx=0 tx=0).stop 2023-11-13T11:28:54.935 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:54.927+0000 7fa511b57640 1 -- 172.21.15.102:0/156126946 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa50c0d0c40 msgr2=0x7fa50c158900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:28:54.935 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:54.927+0000 7fa511b57640 1 --2- 172.21.15.102:0/156126946 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa50c0d0c40 0x7fa50c158900 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fa50000c500 tx=0x7fa50000c9c0 comp rx=0 tx=0).stop 2023-11-13T11:28:54.935 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:54.927+0000 7fa511b57640 1 -- 172.21.15.102:0/156126946 shutdown_connections 2023-11-13T11:28:54.936 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:54.927+0000 7fa511b57640 1 --2- 172.21.15.102:0/156126946 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa50c1606e0 0x7fa50c14a190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:28:54.936 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:54.931+0000 7fa511b57640 1 --2- 172.21.15.102:0/156126946 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7fa4f8066470 0x7fa4f8068930 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:28:54.936 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:54.931+0000 7fa511b57640 1 --2- 172.21.15.102:0/156126946 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa50c0d0c40 0x7fa50c158900 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:28:54.936 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:54.931+0000 7fa511b57640 1 --2- 172.21.15.102:0/156126946 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa50c0cf490 0x7fa50c15f8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:28:54.936 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:54.931+0000 7fa511b57640 1 -- 172.21.15.102:0/156126946 >> 172.21.15.102:0/156126946 conn(0x7fa50c09c130 msgr2=0x7fa50c0c7ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-13T11:28:54.937 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:54.931+0000 7fa511b57640 1 -- 172.21.15.102:0/156126946 shutdown_connections 2023-11-13T11:28:54.937 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:54.931+0000 7fa511b57640 1 -- 172.21.15.102:0/156126946 wait complete. 2023-11-13T11:28:54.953 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-13T11:28:44.981356+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-13T11:28:54.954 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-13T11:28:55.095 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:55.091+0000 7f952e65a640 1 Processor -- start 2023-11-13T11:28:55.095 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:55.091+0000 7f952e65a640 1 -- start start 2023-11-13T11:28:55.097 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:55.091+0000 7f952e65a640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f95280cf2d0 0x7f952806fc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:28:55.097 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:55.091+0000 7f952e65a640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f95280711c0 0x7f95280b3520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:28:55.097 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:55.091+0000 7f952e65a640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f95280b21f0 con 0x7f9528159b30 2023-11-13T11:28:55.098 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:55.091+0000 7f952e65a640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9528071670 con 0x7f95280cf2d0 2023-11-13T11:28:55.098 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:55.091+0000 7f952e65a640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f95280b2440 con 0x7f95280711c0 2023-11-13T11:28:55.098 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:55.091+0000 7f95277fe640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f95280cf2d0 0x7f952806fc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:28:55.098 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:55.091+0000 7f95277fe640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f95280cf2d0 0x7f952806fc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:49624/0 (socket says 172.21.15.102:49624) 2023-11-13T11:28:55.099 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:55.091+0000 7f9527fff640 1 --1- >> v1:172.21.15.102:6789/0 conn(0x7f9528159b30 0x7f95280cebc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.102:6789/0 says I am v1:172.21.15.102:50508/0 (socket says 172.21.15.102:50508) 2023-11-13T11:28:55.099 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:55.091+0000 7f95277fe640 1 -- 172.21.15.102:0/3377950056 learned_addr learned my addr 172.21.15.102:0/3377950056 (peer_addr_for_me v2:172.21.15.102:0/0) 2023-11-13T11:28:55.099 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:55.091+0000 7f952cbf7640 1 --2- 172.21.15.102:0/3377950056 >> v2:172.21.15.154:3300/0 conn(0x7f95280711c0 0x7f95280b3520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:28:55.099 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:55.091+0000 7f95277fe640 1 -- 172.21.15.102:0/3377950056 >> v2:172.21.15.154:3300/0 conn(0x7f95280711c0 msgr2=0x7f95280b3520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-13T11:28:55.100 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:55.091+0000 7f95277fe640 1 --2- 172.21.15.102:0/3377950056 >> v2:172.21.15.154:3300/0 conn(0x7f95280711c0 0x7f95280b3520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:28:55.100 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:55.091+0000 7f95277fe640 1 -- 172.21.15.102:0/3377950056 >> v1:172.21.15.102:6789/0 conn(0x7f9528159b30 legacy=0x7f95280cebc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:28:55.100 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:55.091+0000 7f95277fe640 1 -- 172.21.15.102:0/3377950056 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95280b2720 con 0x7f95280cf2d0 2023-11-13T11:28:55.102 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:55.095+0000 7f95277fe640 1 --2- 172.21.15.102:0/3377950056 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f95280cf2d0 0x7f952806fc80 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f95280cb410 tx=0x7f951c01c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d26f1a40ae90007c server_cookie=0 in_seq=0 out_seq=0 2023-11-13T11:28:55.102 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:55.095+0000 7f9526ffd640 1 -- 172.21.15.102:0/3377950056 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f951c0aa430 con 0x7f95280cf2d0 2023-11-13T11:28:55.103 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:55.095+0000 7f9526ffd640 1 -- 172.21.15.102:0/3377950056 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f951c0aa590 con 0x7f95280cf2d0 2023-11-13T11:28:55.103 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:55.095+0000 7f9526ffd640 1 -- 172.21.15.102:0/3377950056 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f951c0aa920 con 0x7f95280cf2d0 2023-11-13T11:28:55.103 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:55.095+0000 7f952e65a640 1 -- 172.21.15.102:0/3377950056 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f95280cf2d0 msgr2=0x7f952806fc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:28:55.103 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:55.095+0000 7f952e65a640 1 --2- 172.21.15.102:0/3377950056 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f95280cf2d0 0x7f952806fc80 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f95280cb410 tx=0x7f951c01c4d0 comp rx=0 tx=0).stop 2023-11-13T11:28:55.104 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:55.095+0000 7f952e65a640 1 -- 172.21.15.102:0/3377950056 shutdown_connections 2023-11-13T11:28:55.104 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:55.095+0000 7f952e65a640 1 --2- 172.21.15.102:0/3377950056 >> v2:172.21.15.154:3300/0 conn(0x7f95280711c0 0x7f95280b3520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:28:55.104 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:55.095+0000 7f952e65a640 1 --2- 172.21.15.102:0/3377950056 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f95280cf2d0 0x7f952806fc80 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:28:55.104 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:55.095+0000 7f952e65a640 1 -- 172.21.15.102:0/3377950056 >> 172.21.15.102:0/3377950056 conn(0x7f952806a410 msgr2=0x7f952806a820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-13T11:28:55.105 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:55.095+0000 7f952e65a640 1 -- 172.21.15.102:0/3377950056 shutdown_connections 2023-11-13T11:28:55.105 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:55.095+0000 7f952e65a640 1 -- 172.21.15.102:0/3377950056 wait complete. 2023-11-13T11:28:55.108 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:55.099+0000 7f952e65a640 1 Processor -- start 2023-11-13T11:28:55.108 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:55.099+0000 7f952e65a640 1 -- start start 2023-11-13T11:28:55.108 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:55.099+0000 7f952e65a640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f95280711c0 0x7f952814b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:28:55.109 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:55.099+0000 7f952e65a640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f95280cf2d0 0x7f9528146420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:28:55.109 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:55.099+0000 7f952e65a640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9528159b30 0x7f9528158900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:28:55.109 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:55.099+0000 7f952e65a640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9528150c70 con 0x7f95280cf2d0 2023-11-13T11:28:55.109 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:55.099+0000 7f952e65a640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9528150740 con 0x7f95280711c0 2023-11-13T11:28:55.109 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:55.099+0000 7f952e65a640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f952814ee70 con 0x7f9528159b30 2023-11-13T11:28:55.110 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:55.099+0000 7f95277fe640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f95280cf2d0 0x7f9528146420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:28:55.110 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:55.099+0000 7f95277fe640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f95280cf2d0 0x7f9528146420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:49632/0 (socket says 172.21.15.102:49632) 2023-11-13T11:28:55.110 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:55.099+0000 7f95277fe640 1 -- 172.21.15.102:0/1957216367 learned_addr learned my addr 172.21.15.102:0/1957216367 (peer_addr_for_me v2:172.21.15.102:0/0) 2023-11-13T11:28:55.110 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:55.099+0000 7f9527fff640 1 --2- 172.21.15.102:0/1957216367 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f95280711c0 0x7f952814b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:28:55.111 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:55.099+0000 7f952cbf7640 1 --2- 172.21.15.102:0/1957216367 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9528159b30 0x7f9528158900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:28:55.111 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:55.099+0000 7f95277fe640 1 -- 172.21.15.102:0/1957216367 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9528159b30 msgr2=0x7f9528158900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:28:55.111 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:55.099+0000 7f95277fe640 1 --2- 172.21.15.102:0/1957216367 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9528159b30 0x7f9528158900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:28:55.111 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:55.099+0000 7f95277fe640 1 -- 172.21.15.102:0/1957216367 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f95280711c0 msgr2=0x7f952814b750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:28:55.111 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:55.099+0000 7f95277fe640 1 --2- 172.21.15.102:0/1957216367 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f95280711c0 0x7f952814b750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:28:55.112 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:55.099+0000 7f95277fe640 1 -- 172.21.15.102:0/1957216367 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f951c0094d0 con 0x7f95280cf2d0 2023-11-13T11:28:55.112 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:55.099+0000 7f952cbf7640 1 --2- 172.21.15.102:0/1957216367 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9528159b30 0x7f9528158900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-13T11:28:55.112 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:55.099+0000 7f95277fe640 1 --2- 172.21.15.102:0/1957216367 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f95280cf2d0 0x7f9528146420 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f951c0ac040 tx=0x7f951c01ad10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-13T11:28:55.112 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:55.099+0000 7f9524ff9640 1 -- 172.21.15.102:0/1957216367 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f951c0b3800 con 0x7f95280cf2d0 2023-11-13T11:28:55.112 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:55.099+0000 7f9524ff9640 1 -- 172.21.15.102:0/1957216367 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f951c0b3960 con 0x7f95280cf2d0 2023-11-13T11:28:55.113 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:55.099+0000 7f952e65a640 1 -- 172.21.15.102:0/1957216367 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9528153ca0 con 0x7f95280cf2d0 2023-11-13T11:28:55.113 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:55.099+0000 7f9524ff9640 1 -- 172.21.15.102:0/1957216367 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f951c0b3cf0 con 0x7f95280cf2d0 2023-11-13T11:28:55.113 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:55.099+0000 7f952e65a640 1 -- 172.21.15.102:0/1957216367 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9528150990 con 0x7f95280cf2d0 2023-11-13T11:28:55.113 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:55.099+0000 7f952e65a640 1 -- 172.21.15.102:0/1957216367 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f952814ecd0 con 0x7f95280cf2d0 2023-11-13T11:28:55.114 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:55.103+0000 7f9524ff9640 1 -- 172.21.15.102:0/1957216367 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f951c0c6390 con 0x7f95280cf2d0 2023-11-13T11:28:55.114 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:55.103+0000 7f9524ff9640 1 --2- 172.21.15.102:0/1957216367 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f9514066470 0x7f9514068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:28:55.114 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:55.103+0000 7f9524ff9640 1 -- 172.21.15.102:0/1957216367 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f951c11e4d0 con 0x7f95280cf2d0 2023-11-13T11:28:55.114 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:55.103+0000 7f9527fff640 1 --2- 172.21.15.102:0/1957216367 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f9514066470 0x7f9514068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:28:55.115 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:55.103+0000 7f9527fff640 1 --2- 172.21.15.102:0/1957216367 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f9514066470 0x7f9514068930 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f9518000f70 tx=0x7f9518007c90 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-13T11:28:55.115 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:55.107+0000 7f9524ff9640 1 -- 172.21.15.102:0/1957216367 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f952814ecd0 con 0x7f95280cf2d0 2023-11-13T11:28:55.261 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:55.255+0000 7f952e65a640 1 -- 172.21.15.102:0/1957216367 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f952814ecd0 con 0x7f95280cf2d0 2023-11-13T11:28:55.261 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:55.255+0000 7f9524ff9640 1 -- 172.21.15.102:0/1957216367 <== mon.0 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v18) v1 ==== 93+0+10 (secure 0 0 0) 0x7f952814ecd0 con 0x7f95280cf2d0 2023-11-13T11:28:55.262 INFO:teuthology.orchestra.run.smithi102.stdout:pg_num: 1 2023-11-13T11:28:55.263 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:55.259+0000 7f952e65a640 1 -- 172.21.15.102:0/1957216367 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f9514066470 msgr2=0x7f9514068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:28:55.264 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:55.259+0000 7f952e65a640 1 --2- 172.21.15.102:0/1957216367 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f9514066470 0x7f9514068930 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f9518000f70 tx=0x7f9518007c90 comp rx=0 tx=0).stop 2023-11-13T11:28:55.264 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:55.259+0000 7f952e65a640 1 -- 172.21.15.102:0/1957216367 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f95280cf2d0 msgr2=0x7f9528146420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:28:55.264 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:55.259+0000 7f952e65a640 1 --2- 172.21.15.102:0/1957216367 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f95280cf2d0 0x7f9528146420 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f951c0ac040 tx=0x7f951c01ad10 comp rx=0 tx=0).stop 2023-11-13T11:28:55.264 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:55.259+0000 7f952e65a640 1 -- 172.21.15.102:0/1957216367 shutdown_connections 2023-11-13T11:28:55.265 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:55.259+0000 7f952e65a640 1 --2- 172.21.15.102:0/1957216367 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9528159b30 0x7f9528158900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:28:55.265 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:55.259+0000 7f952e65a640 1 --2- 172.21.15.102:0/1957216367 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f9514066470 0x7f9514068930 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:28:55.265 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:55.259+0000 7f952e65a640 1 --2- 172.21.15.102:0/1957216367 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f95280cf2d0 0x7f9528146420 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:28:55.265 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:55.259+0000 7f952e65a640 1 --2- 172.21.15.102:0/1957216367 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f95280711c0 0x7f952814b750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:28:55.265 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:55.259+0000 7f952e65a640 1 -- 172.21.15.102:0/1957216367 >> 172.21.15.102:0/1957216367 conn(0x7f952806a410 msgr2=0x7f9528154610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-13T11:28:55.265 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:55.259+0000 7f952e65a640 1 -- 172.21.15.102:0/1957216367 shutdown_connections 2023-11-13T11:28:55.266 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:55.259+0000 7f952e65a640 1 -- 172.21.15.102:0/1957216367 wait complete. 2023-11-13T11:28:55.282 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-11-13T11:28:55.419 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:55.415+0000 7fd157c17640 1 Processor -- start 2023-11-13T11:28:55.420 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:55.415+0000 7fd157c17640 1 -- start start 2023-11-13T11:28:55.421 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:55.415+0000 7fd157c17640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd15015cf20 0x7fd1500cf810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:28:55.421 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:55.415+0000 7fd157c17640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7fd15015d300 0x7fd15006b560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:28:55.421 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:55.415+0000 7fd157c17640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd1500b0a80 con 0x7fd15006bbb0 2023-11-13T11:28:55.421 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:55.415+0000 7fd157c17640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd1500cfea0 con 0x7fd15015d300 2023-11-13T11:28:55.421 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:55.415+0000 7fd157c17640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd1500b0430 con 0x7fd15015cf20 2023-11-13T11:28:55.422 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:55.415+0000 7fd1551b2640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7fd15015d300 0x7fd15006b560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:28:55.422 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:55.415+0000 7fd1561b4640 1 --1- >> v1:172.21.15.102:6789/0 conn(0x7fd15006bbb0 0x7fd150160d30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.102:6789/0 says I am v1:172.21.15.102:50512/0 (socket says 172.21.15.102:50512) 2023-11-13T11:28:55.422 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:55.415+0000 7fd1561b4640 1 -- 172.21.15.102:0/3575295544 learned_addr learned my addr 172.21.15.102:0/3575295544 (peer_addr_for_me v1:172.21.15.102:0/0) 2023-11-13T11:28:55.423 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:55.415+0000 7fd1559b3640 1 --2- 172.21.15.102:0/3575295544 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd15015cf20 0x7fd1500cf810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:28:55.423 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:55.415+0000 7fd1551b2640 1 -- 172.21.15.102:0/3575295544 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd15015cf20 msgr2=0x7fd1500cf810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-13T11:28:55.423 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:55.415+0000 7fd1551b2640 1 --2- 172.21.15.102:0/3575295544 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd15015cf20 0x7fd1500cf810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:28:55.423 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:55.415+0000 7fd1551b2640 1 -- 172.21.15.102:0/3575295544 >> v1:172.21.15.102:6789/0 conn(0x7fd15006bbb0 legacy=0x7fd150160d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:28:55.424 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:55.415+0000 7fd1551b2640 1 -- 172.21.15.102:0/3575295544 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1500b0710 con 0x7fd15015d300 2023-11-13T11:28:55.424 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:55.415+0000 7fd1559b3640 1 --2- 172.21.15.102:0/3575295544 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd15015cf20 0x7fd1500cf810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-13T11:28:55.424 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:55.415+0000 7fd1549b1640 1 -- 172.21.15.102:0/3575295544 <== mon.0 v1:172.21.15.102:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3963742466 0 0) 0x7fd1500b0a80 con 0x7fd15006bbb0 2023-11-13T11:28:55.426 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:55.419+0000 7fd1551b2640 1 --2- 172.21.15.102:0/3575295544 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd15015d300 0x7fd15006b560 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fd1400097c0 tx=0x7fd14001c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3417d38a4023be45 server_cookie=0 in_seq=0 out_seq=0 2023-11-13T11:28:55.426 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:55.419+0000 7fd1549b1640 1 -- 172.21.15.102:0/3575295544 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1400a6040 con 0x7fd15015d300 2023-11-13T11:28:55.426 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:55.419+0000 7fd1549b1640 1 -- 172.21.15.102:0/3575295544 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd1400aa600 con 0x7fd15015d300 2023-11-13T11:28:55.426 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:55.419+0000 7fd1549b1640 1 -- 172.21.15.102:0/3575295544 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1400aa990 con 0x7fd15015d300 2023-11-13T11:28:55.426 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:55.419+0000 7fd157c17640 1 -- 172.21.15.102:0/3575295544 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd15015d300 msgr2=0x7fd15006b560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:28:55.427 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:55.419+0000 7fd157c17640 1 --2- 172.21.15.102:0/3575295544 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd15015d300 0x7fd15006b560 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fd1400097c0 tx=0x7fd14001c480 comp rx=0 tx=0).stop 2023-11-13T11:28:55.427 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:55.419+0000 7fd157c17640 1 -- 172.21.15.102:0/3575295544 shutdown_connections 2023-11-13T11:28:55.427 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:55.419+0000 7fd157c17640 1 --2- 172.21.15.102:0/3575295544 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd15015d300 0x7fd15006b560 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:28:55.427 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:55.419+0000 7fd157c17640 1 --2- 172.21.15.102:0/3575295544 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd15015cf20 0x7fd1500cf810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:28:55.427 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:55.419+0000 7fd157c17640 1 -- 172.21.15.102:0/3575295544 >> 172.21.15.102:0/3575295544 conn(0x7fd1500d0b70 msgr2=0x7fd1500d0f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-13T11:28:55.428 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:55.419+0000 7fd157c17640 1 -- 172.21.15.102:0/3575295544 shutdown_connections 2023-11-13T11:28:55.428 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:55.419+0000 7fd157c17640 1 -- 172.21.15.102:0/3575295544 wait complete. 2023-11-13T11:28:55.430 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:55.423+0000 7fd157c17640 1 Processor -- start 2023-11-13T11:28:55.430 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:55.423+0000 7fd157c17640 1 -- start start 2023-11-13T11:28:55.430 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:55.423+0000 7fd157c17640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd15006bbb0 0x7fd150154ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:28:55.431 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:55.423+0000 7fd157c17640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd15015cf20 0x7fd15015ac60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:28:55.431 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:55.423+0000 7fd157c17640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd15015d300 0x7fd15015b1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:28:55.431 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:55.423+0000 7fd157c17640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd15014f8a0 con 0x7fd15015d300 2023-11-13T11:28:55.431 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:55.423+0000 7fd157c17640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd15006f930 con 0x7fd15006bbb0 2023-11-13T11:28:55.431 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:55.423+0000 7fd157c17640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd1500c5490 con 0x7fd15015cf20 2023-11-13T11:28:55.432 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:55.423+0000 7fd1561b4640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd15015d300 0x7fd15015b1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:28:55.432 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:55.423+0000 7fd1561b4640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd15015d300 0x7fd15015b1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:49654/0 (socket says 172.21.15.102:49654) 2023-11-13T11:28:55.432 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:55.423+0000 7fd1561b4640 1 -- 172.21.15.102:0/4199137892 learned_addr learned my addr 172.21.15.102:0/4199137892 (peer_addr_for_me v2:172.21.15.102:0/0) 2023-11-13T11:28:55.432 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:55.423+0000 7fd1559b3640 1 --2- 172.21.15.102:0/4199137892 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd15006bbb0 0x7fd150154ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:28:55.432 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:55.423+0000 7fd1551b2640 1 --2- 172.21.15.102:0/4199137892 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd15015cf20 0x7fd15015ac60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:28:55.433 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:55.423+0000 7fd1561b4640 1 -- 172.21.15.102:0/4199137892 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd15015cf20 msgr2=0x7fd15015ac60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:28:55.433 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:55.423+0000 7fd1561b4640 1 --2- 172.21.15.102:0/4199137892 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd15015cf20 0x7fd15015ac60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:28:55.433 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:55.423+0000 7fd1561b4640 1 -- 172.21.15.102:0/4199137892 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd15006bbb0 msgr2=0x7fd150154ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:28:55.433 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:55.423+0000 7fd1561b4640 1 --2- 172.21.15.102:0/4199137892 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd15006bbb0 0x7fd150154ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:28:55.433 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:55.423+0000 7fd1561b4640 1 -- 172.21.15.102:0/4199137892 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd140009420 con 0x7fd15015d300 2023-11-13T11:28:55.433 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:55.423+0000 7fd1561b4640 1 --2- 172.21.15.102:0/4199137892 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd15015d300 0x7fd15015b1a0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fd14800c780 tx=0x7fd14800cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-13T11:28:55.434 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:55.423+0000 7fd1467fc640 1 -- 172.21.15.102:0/4199137892 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd14800ce90 con 0x7fd15015d300 2023-11-13T11:28:55.434 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:55.423+0000 7fd1467fc640 1 -- 172.21.15.102:0/4199137892 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd14800a640 con 0x7fd15015d300 2023-11-13T11:28:55.434 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:55.423+0000 7fd157c17640 1 -- 172.21.15.102:0/4199137892 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd15006f000 con 0x7fd15015d300 2023-11-13T11:28:55.434 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:55.423+0000 7fd1467fc640 1 -- 172.21.15.102:0/4199137892 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd14800a9d0 con 0x7fd15015d300 2023-11-13T11:28:55.435 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:55.423+0000 7fd157c17640 1 -- 172.21.15.102:0/4199137892 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd15006f5c0 con 0x7fd15015d300 2023-11-13T11:28:55.435 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:55.423+0000 7fd157c17640 1 -- 172.21.15.102:0/4199137892 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd150068520 con 0x7fd15015d300 2023-11-13T11:28:55.436 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:55.427+0000 7fd1467fc640 1 -- 172.21.15.102:0/4199137892 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fd14800ab30 con 0x7fd15015d300 2023-11-13T11:28:55.436 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:55.427+0000 7fd1467fc640 1 --2- 172.21.15.102:0/4199137892 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7fd134066470 0x7fd134068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:28:55.436 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:55.427+0000 7fd1467fc640 1 -- 172.21.15.102:0/4199137892 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fd148083250 con 0x7fd15015d300 2023-11-13T11:28:55.436 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:55.427+0000 7fd1559b3640 1 --2- 172.21.15.102:0/4199137892 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7fd134066470 0x7fd134068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:28:55.436 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:55.427+0000 7fd1559b3640 1 --2- 172.21.15.102:0/4199137892 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7fd134066470 0x7fd134068930 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fd14c00ab60 tx=0x7fd14c008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-13T11:28:55.437 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:55.431+0000 7fd1467fc640 1 -- 172.21.15.102:0/4199137892 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fd148050ad0 con 0x7fd15015d300 2023-11-13T11:28:55.587 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:55.583+0000 7fd157c17640 1 -- 172.21.15.102:0/4199137892 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7fd15006fa70 con 0x7fd15015d300 2023-11-13T11:28:55.588 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:55.583+0000 7fd1467fc640 1 -- 172.21.15.102:0/4199137892 <== mon.0 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v18) v1 ==== 84+0+65 (secure 0 0 0) 0x7fd148018060 con 0x7fd15015d300 2023-11-13T11:28:55.588 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T11:28:55.588 INFO:teuthology.orchestra.run.smithi102.stdout:[ 2023-11-13T11:28:55.589 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-11-13T11:28:55.589 INFO:teuthology.orchestra.run.smithi102.stdout: "poolnum": 1, 2023-11-13T11:28:55.589 INFO:teuthology.orchestra.run.smithi102.stdout: "poolname": ".mgr" 2023-11-13T11:28:55.589 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-11-13T11:28:55.589 INFO:teuthology.orchestra.run.smithi102.stdout:] 2023-11-13T11:28:55.590 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:55.583+0000 7fd157c17640 1 -- 172.21.15.102:0/4199137892 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7fd134066470 msgr2=0x7fd134068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:28:55.591 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:55.583+0000 7fd157c17640 1 --2- 172.21.15.102:0/4199137892 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7fd134066470 0x7fd134068930 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fd14c00ab60 tx=0x7fd14c008040 comp rx=0 tx=0).stop 2023-11-13T11:28:55.591 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:55.583+0000 7fd157c17640 1 -- 172.21.15.102:0/4199137892 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd15015d300 msgr2=0x7fd15015b1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:28:55.591 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:55.583+0000 7fd157c17640 1 --2- 172.21.15.102:0/4199137892 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd15015d300 0x7fd15015b1a0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fd14800c780 tx=0x7fd14800cc40 comp rx=0 tx=0).stop 2023-11-13T11:28:55.591 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:55.583+0000 7fd157c17640 1 -- 172.21.15.102:0/4199137892 shutdown_connections 2023-11-13T11:28:55.592 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:55.583+0000 7fd157c17640 1 --2- 172.21.15.102:0/4199137892 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7fd134066470 0x7fd134068930 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:28:55.592 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:55.583+0000 7fd157c17640 1 --2- 172.21.15.102:0/4199137892 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd15015d300 0x7fd15015b1a0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:28:55.592 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:55.583+0000 7fd157c17640 1 --2- 172.21.15.102:0/4199137892 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd15015cf20 0x7fd15015ac60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:28:55.592 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:55.583+0000 7fd157c17640 1 --2- 172.21.15.102:0/4199137892 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd15006bbb0 0x7fd150154ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:28:55.592 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:55.583+0000 7fd157c17640 1 -- 172.21.15.102:0/4199137892 >> 172.21.15.102:0/4199137892 conn(0x7fd1500d0b70 msgr2=0x7fd15015c200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-13T11:28:55.593 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:55.583+0000 7fd157c17640 1 -- 172.21.15.102:0/4199137892 shutdown_connections 2023-11-13T11:28:55.593 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:55.583+0000 7fd157c17640 1 -- 172.21.15.102:0/4199137892 wait complete. 2023-11-13T11:28:55.608 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-11-13T11:28:55.609 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-11-13T11:28:55.750 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:55.743+0000 7f8b88f8d640 1 Processor -- start 2023-11-13T11:28:55.762 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:55.743+0000 7f8b88f8d640 1 -- start start 2023-11-13T11:28:55.767 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:55.747+0000 7f8b88f8d640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f8b841540c0 0x7f8b8406d600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:28:55.768 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:55.747+0000 7f8b88f8d640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8b8415b340 con 0x7f8b840b2f50 2023-11-13T11:28:55.768 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:55.747+0000 7f8b88f8d640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8b840b3570 con 0x7f8b8406db40 2023-11-13T11:28:55.768 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:55.747+0000 7f8b88f8d640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8b8415a180 con 0x7f8b841540c0 2023-11-13T11:28:55.769 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:55.747+0000 7f8b8259c640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f8b841540c0 0x7f8b8406d600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:28:55.769 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:55.747+0000 7f8b82d9d640 1 --1- >> v1:172.21.15.102:6789/0 conn(0x7f8b840b2f50 0x7f8b8415d770 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.102:6789/0 says I am v1:172.21.15.102:50514/0 (socket says 172.21.15.102:50514) 2023-11-13T11:28:55.769 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:55.747+0000 7f8b82d9d640 1 -- 172.21.15.102:0/3294784798 learned_addr learned my addr 172.21.15.102:0/3294784798 (peer_addr_for_me v1:172.21.15.102:0/0) 2023-11-13T11:28:55.769 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:55.747+0000 7f8b8259c640 1 -- 172.21.15.102:0/3294784798 >> v1:172.21.15.154:6789/0 conn(0x7f8b8406db40 legacy=0x7f8b840b2840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:28:55.770 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:55.747+0000 7f8b8259c640 1 -- 172.21.15.102:0/3294784798 >> v1:172.21.15.102:6789/0 conn(0x7f8b840b2f50 legacy=0x7f8b8415d770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:28:55.770 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:55.747+0000 7f8b8259c640 1 -- 172.21.15.102:0/3294784798 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b8415b130 con 0x7f8b841540c0 2023-11-13T11:28:55.770 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:55.751+0000 7f8b8259c640 1 --2- 172.21.15.102:0/3294784798 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8b841540c0 0x7f8b8406d600 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f8b740097c0 tx=0x7f8b7401c3f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f63d956d314808df server_cookie=0 in_seq=0 out_seq=0 2023-11-13T11:28:55.770 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:55.751+0000 7f8b81d9b640 1 -- 172.21.15.102:0/3294784798 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b740ab600 con 0x7f8b841540c0 2023-11-13T11:28:55.771 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:55.751+0000 7f8b81d9b640 1 -- 172.21.15.102:0/3294784798 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b740a7050 con 0x7f8b841540c0 2023-11-13T11:28:55.771 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:55.751+0000 7f8b81d9b640 1 -- 172.21.15.102:0/3294784798 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b740ab980 con 0x7f8b841540c0 2023-11-13T11:28:55.771 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:55.751+0000 7f8b88f8d640 1 -- 172.21.15.102:0/3294784798 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8b841540c0 msgr2=0x7f8b8406d600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:28:55.772 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:55.751+0000 7f8b88f8d640 1 --2- 172.21.15.102:0/3294784798 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8b841540c0 0x7f8b8406d600 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f8b740097c0 tx=0x7f8b7401c3f0 comp rx=0 tx=0).stop 2023-11-13T11:28:55.772 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:55.751+0000 7f8b88f8d640 1 -- 172.21.15.102:0/3294784798 shutdown_connections 2023-11-13T11:28:55.772 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:55.751+0000 7f8b88f8d640 1 --2- 172.21.15.102:0/3294784798 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8b841540c0 0x7f8b8406d600 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:28:55.772 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:55.751+0000 7f8b88f8d640 1 -- 172.21.15.102:0/3294784798 >> 172.21.15.102:0/3294784798 conn(0x7f8b840b0690 msgr2=0x7f8b840b0aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-13T11:28:55.772 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:55.751+0000 7f8b88f8d640 1 -- 172.21.15.102:0/3294784798 shutdown_connections 2023-11-13T11:28:55.773 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:55.751+0000 7f8b88f8d640 1 -- 172.21.15.102:0/3294784798 wait complete. 2023-11-13T11:28:55.773 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:55.751+0000 7f8b88f8d640 1 Processor -- start 2023-11-13T11:28:55.773 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:55.751+0000 7f8b88f8d640 1 -- start start 2023-11-13T11:28:55.773 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:55.755+0000 7f8b88f8d640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8b8406db40 0x7f8b841f8b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:28:55.774 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:55.755+0000 7f8b88f8d640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8b840b2f50 0x7f8b8414dfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:28:55.774 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:55.755+0000 7f8b88f8d640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8b841540c0 0x7f8b8415b4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:28:55.774 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:55.755+0000 7f8b88f8d640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b841f86e0 con 0x7f8b840b2f50 2023-11-13T11:28:55.774 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:55.755+0000 7f8b88f8d640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b840a9920 con 0x7f8b8406db40 2023-11-13T11:28:55.775 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:55.755+0000 7f8b88f8d640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8b8414e510 con 0x7f8b841540c0 2023-11-13T11:28:55.775 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:55.755+0000 7f8b79d9b640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8b840b2f50 0x7f8b8414dfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:28:55.775 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:55.755+0000 7f8b79d9b640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8b840b2f50 0x7f8b8414dfd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:49682/0 (socket says 172.21.15.102:49682) 2023-11-13T11:28:55.775 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:55.755+0000 7f8b79d9b640 1 -- 172.21.15.102:0/1217301573 learned_addr learned my addr 172.21.15.102:0/1217301573 (peer_addr_for_me v2:172.21.15.102:0/0) 2023-11-13T11:28:55.776 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:55.755+0000 7f8b8259c640 1 --2- 172.21.15.102:0/1217301573 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8b8406db40 0x7f8b841f8b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:28:55.776 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:55.755+0000 7f8b82d9d640 1 --2- 172.21.15.102:0/1217301573 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8b841540c0 0x7f8b8415b4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:28:55.776 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:55.755+0000 7f8b79d9b640 1 -- 172.21.15.102:0/1217301573 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8b841540c0 msgr2=0x7f8b8415b4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:28:55.776 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:55.755+0000 7f8b79d9b640 1 --2- 172.21.15.102:0/1217301573 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8b841540c0 0x7f8b8415b4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:28:55.776 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:55.755+0000 7f8b79d9b640 1 -- 172.21.15.102:0/1217301573 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8b8406db40 msgr2=0x7f8b841f8b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:28:55.777 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:55.755+0000 7f8b79d9b640 1 --2- 172.21.15.102:0/1217301573 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8b8406db40 0x7f8b841f8b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:28:55.777 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:55.755+0000 7f8b79d9b640 1 -- 172.21.15.102:0/1217301573 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b74009420 con 0x7f8b840b2f50 2023-11-13T11:28:55.777 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:55.755+0000 7f8b82d9d640 1 --2- 172.21.15.102:0/1217301573 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8b841540c0 0x7f8b8415b4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-13T11:28:55.777 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:55.755+0000 7f8b79d9b640 1 --2- 172.21.15.102:0/1217301573 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8b840b2f50 0x7f8b8414dfd0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f8b6c00c500 tx=0x7f8b6c00c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-13T11:28:55.777 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:55.755+0000 7f8b7b7fe640 1 -- 172.21.15.102:0/1217301573 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b6c005220 con 0x7f8b840b2f50 2023-11-13T11:28:55.778 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:55.755+0000 7f8b7b7fe640 1 -- 172.21.15.102:0/1217301573 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b6c005380 con 0x7f8b840b2f50 2023-11-13T11:28:55.778 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:55.755+0000 7f8b88f8d640 1 -- 172.21.15.102:0/1217301573 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8b841f7a60 con 0x7f8b840b2f50 2023-11-13T11:28:55.778 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:55.755+0000 7f8b7b7fe640 1 -- 172.21.15.102:0/1217301573 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b6c007270 con 0x7f8b840b2f50 2023-11-13T11:28:55.778 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:55.755+0000 7f8b88f8d640 1 -- 172.21.15.102:0/1217301573 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8b841f8020 con 0x7f8b840b2f50 2023-11-13T11:28:55.778 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:55.755+0000 7f8b88f8d640 1 -- 172.21.15.102:0/1217301573 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8b841f8820 con 0x7f8b840b2f50 2023-11-13T11:28:55.779 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:55.759+0000 7f8b7b7fe640 1 -- 172.21.15.102:0/1217301573 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f8b6c0073d0 con 0x7f8b840b2f50 2023-11-13T11:28:55.779 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:55.759+0000 7f8b7b7fe640 1 --2- 172.21.15.102:0/1217301573 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f8b64066470 0x7f8b64068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:28:55.779 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:55.759+0000 7f8b7b7fe640 1 -- 172.21.15.102:0/1217301573 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f8b6c082cc0 con 0x7f8b840b2f50 2023-11-13T11:28:55.779 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:55.759+0000 7f8b8259c640 1 --2- 172.21.15.102:0/1217301573 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f8b64066470 0x7f8b64068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:28:55.779 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:55.759+0000 7f8b8259c640 1 --2- 172.21.15.102:0/1217301573 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f8b64066470 0x7f8b64068930 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f8b740ad000 tx=0x7f8b740a6000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-13T11:28:55.780 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:55.763+0000 7f8b7b7fe640 1 -- 172.21.15.102:0/1217301573 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f8b841f8820 con 0x7f8b840b2f50 2023-11-13T11:28:55.918 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:55.911+0000 7f8b88f8d640 1 -- 172.21.15.102:0/1217301573 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f8b840b3570 con 0x7f8b840b2f50 2023-11-13T11:28:56.013 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:56.007+0000 7f8b7b7fe640 1 -- 172.21.15.102:0/1217301573 <== mon.0 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v19) v1 ==== 138+0+0 (secure 0 0 0) 0x7f8b840b3570 con 0x7f8b840b2f50 2023-11-13T11:28:56.013 INFO:teuthology.orchestra.run.smithi102.stderr:pool 'cephfs_metadata' created 2023-11-13T11:28:56.015 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:56.011+0000 7f8b88f8d640 1 -- 172.21.15.102:0/1217301573 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f8b64066470 msgr2=0x7f8b64068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:28:56.015 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:56.011+0000 7f8b88f8d640 1 --2- 172.21.15.102:0/1217301573 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f8b64066470 0x7f8b64068930 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f8b740ad000 tx=0x7f8b740a6000 comp rx=0 tx=0).stop 2023-11-13T11:28:56.016 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:56.011+0000 7f8b88f8d640 1 -- 172.21.15.102:0/1217301573 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8b840b2f50 msgr2=0x7f8b8414dfd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:28:56.016 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:56.011+0000 7f8b88f8d640 1 --2- 172.21.15.102:0/1217301573 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8b840b2f50 0x7f8b8414dfd0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f8b6c00c500 tx=0x7f8b6c00c9c0 comp rx=0 tx=0).stop 2023-11-13T11:28:56.016 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:56.011+0000 7f8b88f8d640 1 -- 172.21.15.102:0/1217301573 shutdown_connections 2023-11-13T11:28:56.016 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:56.011+0000 7f8b88f8d640 1 --2- 172.21.15.102:0/1217301573 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8b841540c0 0x7f8b8415b4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:28:56.017 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:56.011+0000 7f8b88f8d640 1 --2- 172.21.15.102:0/1217301573 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f8b64066470 0x7f8b64068930 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:28:56.017 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:56.011+0000 7f8b88f8d640 1 --2- 172.21.15.102:0/1217301573 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8b840b2f50 0x7f8b8414dfd0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:28:56.017 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:56.011+0000 7f8b88f8d640 1 --2- 172.21.15.102:0/1217301573 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8b8406db40 0x7f8b841f8b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:28:56.017 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:56.011+0000 7f8b88f8d640 1 -- 172.21.15.102:0/1217301573 >> 172.21.15.102:0/1217301573 conn(0x7f8b840b0690 msgr2=0x7f8b840ce9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-13T11:28:56.017 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:56.011+0000 7f8b88f8d640 1 -- 172.21.15.102:0/1217301573 shutdown_connections 2023-11-13T11:28:56.018 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:56.011+0000 7f8b88f8d640 1 -- 172.21.15.102:0/1217301573 wait complete. 2023-11-13T11:28:56.040 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-11-13T11:28:56.184 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:56.179+0000 7f88f5980640 1 Processor -- start 2023-11-13T11:28:56.185 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:56.179+0000 7f88f5980640 1 -- start start 2023-11-13T11:28:56.186 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:56.179+0000 7f88f5980640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f88f00b1d50 0x7f88f00b2190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:28:56.186 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:56.179+0000 7f88f5980640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f88f00b26d0 0x7f88f006cb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:28:56.186 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:56.179+0000 7f88f5980640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f88f01597f0 con 0x7f88f0159410 2023-11-13T11:28:56.186 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:56.179+0000 7f88f5980640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f88f00cb4d0 con 0x7f88f00b26d0 2023-11-13T11:28:56.187 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:56.179+0000 7f88f5980640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f88f0070e20 con 0x7f88f00b1d50 2023-11-13T11:28:56.187 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:56.179+0000 7f88eeffd640 1 --1- >> v1:172.21.15.102:6789/0 conn(0x7f88f0159410 0x7f88f0071950 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.102:6789/0 says I am v1:172.21.15.102:50518/0 (socket says 172.21.15.102:50518) 2023-11-13T11:28:56.187 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:56.179+0000 7f88eeffd640 1 -- 172.21.15.102:0/3273499008 learned_addr learned my addr 172.21.15.102:0/3273499008 (peer_addr_for_me v1:172.21.15.102:0/0) 2023-11-13T11:28:56.187 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:56.179+0000 7f88ef7fe640 1 --2- 172.21.15.102:0/3273499008 >> v2:172.21.15.102:3300/0 conn(0x7f88f00b26d0 0x7f88f006cb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:28:56.188 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:56.183+0000 7f88ee7fc640 1 --2- 172.21.15.102:0/3273499008 >> v2:172.21.15.154:3300/0 conn(0x7f88f00b1d50 0x7f88f00b2190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:28:56.188 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:56.183+0000 7f88ef7fe640 1 -- 172.21.15.102:0/3273499008 >> v2:172.21.15.154:3300/0 conn(0x7f88f00b1d50 msgr2=0x7f88f00b2190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-13T11:28:56.188 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:56.183+0000 7f88ef7fe640 1 --2- 172.21.15.102:0/3273499008 >> v2:172.21.15.154:3300/0 conn(0x7f88f00b1d50 0x7f88f00b2190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:28:56.189 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:56.183+0000 7f88ef7fe640 1 -- 172.21.15.102:0/3273499008 >> v1:172.21.15.102:6789/0 conn(0x7f88f0159410 legacy=0x7f88f0071950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:28:56.189 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:56.183+0000 7f88edffb640 1 -- 172.21.15.102:0/3273499008 <== mon.0 v1:172.21.15.102:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 630584171 0 0) 0x7f88f01597f0 con 0x7f88f0159410 2023-11-13T11:28:56.189 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:56.183+0000 7f88ef7fe640 1 -- 172.21.15.102:0/3273499008 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88f00b2b60 con 0x7f88f00b26d0 2023-11-13T11:28:56.190 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:56.183+0000 7f88ef7fe640 1 --2- 172.21.15.102:0/3273499008 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f88f00b26d0 0x7f88f006cb90 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f88f00cdb10 tx=0x7f88e801c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6afff378e79501fa server_cookie=0 in_seq=0 out_seq=0 2023-11-13T11:28:56.190 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:56.183+0000 7f88edffb640 1 -- 172.21.15.102:0/3273499008 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88f006c470 con 0x7f88f00b26d0 2023-11-13T11:28:56.190 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:56.183+0000 7f88edffb640 1 -- 172.21.15.102:0/3273499008 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f88e80a66d0 con 0x7f88f00b26d0 2023-11-13T11:28:56.191 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:56.183+0000 7f88edffb640 1 -- 172.21.15.102:0/3273499008 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88e80a6a60 con 0x7f88f00b26d0 2023-11-13T11:28:56.191 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:56.183+0000 7f88f5980640 1 -- 172.21.15.102:0/3273499008 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f88f00b26d0 msgr2=0x7f88f006cb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:28:56.191 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:56.183+0000 7f88f5980640 1 --2- 172.21.15.102:0/3273499008 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f88f00b26d0 0x7f88f006cb90 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f88f00cdb10 tx=0x7f88e801c910 comp rx=0 tx=0).stop 2023-11-13T11:28:56.191 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:56.183+0000 7f88f5980640 1 -- 172.21.15.102:0/3273499008 shutdown_connections 2023-11-13T11:28:56.191 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:56.183+0000 7f88f5980640 1 --2- 172.21.15.102:0/3273499008 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f88f00b26d0 0x7f88f006cb90 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:28:56.192 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:56.183+0000 7f88f5980640 1 --2- 172.21.15.102:0/3273499008 >> v2:172.21.15.154:3300/0 conn(0x7f88f00b1d50 0x7f88f00b2190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:28:56.192 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:56.183+0000 7f88f5980640 1 -- 172.21.15.102:0/3273499008 >> 172.21.15.102:0/3273499008 conn(0x7f88f00b0690 msgr2=0x7f88f00b0aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-13T11:28:56.192 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:56.187+0000 7f88f5980640 1 -- 172.21.15.102:0/3273499008 shutdown_connections 2023-11-13T11:28:56.192 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:56.187+0000 7f88f5980640 1 -- 172.21.15.102:0/3273499008 wait complete. 2023-11-13T11:28:56.194 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:56.187+0000 7f88f5980640 1 Processor -- start 2023-11-13T11:28:56.194 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:56.187+0000 7f88f5980640 1 -- start start 2023-11-13T11:28:56.194 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:56.187+0000 7f88f5980640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f88f00b1d50 0x7f88f0149c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:28:56.194 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:56.187+0000 7f88f5980640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f88f00b26d0 0x7f88f00cd080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:28:56.195 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:56.187+0000 7f88f5980640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f88f0159410 0x7f88f013cf50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:28:56.195 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:56.187+0000 7f88f5980640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88f00cc150 con 0x7f88f00b1d50 2023-11-13T11:28:56.195 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:56.187+0000 7f88f5980640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88f0141030 con 0x7f88f00b26d0 2023-11-13T11:28:56.195 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:56.187+0000 7f88f5980640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88f00cd780 con 0x7f88f0159410 2023-11-13T11:28:56.195 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:56.187+0000 7f88eeffd640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f88f00b1d50 0x7f88f0149c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:28:56.196 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:56.187+0000 7f88eeffd640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f88f00b1d50 0x7f88f0149c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:49706/0 (socket says 172.21.15.102:49706) 2023-11-13T11:28:56.196 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:56.187+0000 7f88eeffd640 1 -- 172.21.15.102:0/2911395981 learned_addr learned my addr 172.21.15.102:0/2911395981 (peer_addr_for_me v2:172.21.15.102:0/0) 2023-11-13T11:28:56.196 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:56.187+0000 7f88ef7fe640 1 --2- 172.21.15.102:0/2911395981 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f88f0159410 0x7f88f013cf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:28:56.196 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:56.187+0000 7f88ee7fc640 1 --2- 172.21.15.102:0/2911395981 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f88f00b26d0 0x7f88f00cd080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:28:56.196 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:56.187+0000 7f88eeffd640 1 -- 172.21.15.102:0/2911395981 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f88f0159410 msgr2=0x7f88f013cf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:28:56.196 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:56.187+0000 7f88eeffd640 1 --2- 172.21.15.102:0/2911395981 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f88f0159410 0x7f88f013cf50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:28:56.197 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:56.187+0000 7f88eeffd640 1 -- 172.21.15.102:0/2911395981 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f88f00b26d0 msgr2=0x7f88f00cd080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:28:56.197 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:56.187+0000 7f88eeffd640 1 --2- 172.21.15.102:0/2911395981 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f88f00b26d0 0x7f88f00cd080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:28:56.197 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:56.187+0000 7f88eeffd640 1 -- 172.21.15.102:0/2911395981 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88e8009a70 con 0x7f88f00b1d50 2023-11-13T11:28:56.197 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:56.187+0000 7f88ef7fe640 1 --2- 172.21.15.102:0/2911395981 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f88f0159410 0x7f88f013cf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-13T11:28:56.197 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:56.187+0000 7f88eeffd640 1 --2- 172.21.15.102:0/2911395981 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f88f00b1d50 0x7f88f0149c10 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f88e000c480 tx=0x7f88e000c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-13T11:28:56.199 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:56.191+0000 7f88d7fff640 1 -- 172.21.15.102:0/2911395981 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88e00074e0 con 0x7f88f00b1d50 2023-11-13T11:28:56.199 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:56.191+0000 7f88d7fff640 1 -- 172.21.15.102:0/2911395981 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f88e0007660 con 0x7f88f00b1d50 2023-11-13T11:28:56.199 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:56.191+0000 7f88d7fff640 1 -- 172.21.15.102:0/2911395981 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88e0004a30 con 0x7f88f00b1d50 2023-11-13T11:28:56.199 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:56.191+0000 7f88f5980640 1 -- 172.21.15.102:0/2911395981 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f88f00cc570 con 0x7f88f00b1d50 2023-11-13T11:28:56.200 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:56.191+0000 7f88f5980640 1 -- 172.21.15.102:0/2911395981 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f88f00cba90 con 0x7f88f00b1d50 2023-11-13T11:28:56.200 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:56.191+0000 7f88f5980640 1 -- 172.21.15.102:0/2911395981 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f88f0067b50 con 0x7f88f00b1d50 2023-11-13T11:28:56.200 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:56.191+0000 7f88d7fff640 1 -- 172.21.15.102:0/2911395981 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f88e001b360 con 0x7f88f00b1d50 2023-11-13T11:28:56.200 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:56.191+0000 7f88d7fff640 1 --2- 172.21.15.102:0/2911395981 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f88dc0664c0 0x7f88dc068980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:28:56.200 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:56.191+0000 7f88d7fff640 1 -- 172.21.15.102:0/2911395981 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5227+0+0 (secure 0 0 0) 0x7f88e0083690 con 0x7f88f00b1d50 2023-11-13T11:28:56.200 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:56.191+0000 7f88ee7fc640 1 --2- 172.21.15.102:0/2911395981 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f88dc0664c0 0x7f88dc068980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:28:56.201 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:56.195+0000 7f88ee7fc640 1 --2- 172.21.15.102:0/2911395981 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f88dc0664c0 0x7f88dc068980 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f88e4007a60 tx=0x7f88e4008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-13T11:28:56.201 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:56.195+0000 7f88d7fff640 1 -- 172.21.15.102:0/2911395981 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f88e00548a0 con 0x7f88f00b1d50 2023-11-13T11:28:56.353 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:56.347+0000 7f88f5980640 1 -- 172.21.15.102:0/2911395981 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f88f0068590 con 0x7f88f00b1d50 2023-11-13T11:28:57.016 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:57.011+0000 7f88d7fff640 1 -- 172.21.15.102:0/2911395981 <== mon.0 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v20) v1 ==== 170+0+0 (secure 0 0 0) 0x7f88e0018020 con 0x7f88f00b1d50 2023-11-13T11:28:57.016 INFO:teuthology.orchestra.run.smithi102.stderr:pool 'cephfs_data' created 2023-11-13T11:28:57.018 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:57.011+0000 7f88f5980640 1 -- 172.21.15.102:0/2911395981 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f88dc0664c0 msgr2=0x7f88dc068980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:28:57.018 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:57.011+0000 7f88f5980640 1 --2- 172.21.15.102:0/2911395981 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f88dc0664c0 0x7f88dc068980 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f88e4007a60 tx=0x7f88e4008040 comp rx=0 tx=0).stop 2023-11-13T11:28:57.018 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:57.011+0000 7f88f5980640 1 -- 172.21.15.102:0/2911395981 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f88f00b1d50 msgr2=0x7f88f0149c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:28:57.018 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:57.011+0000 7f88f5980640 1 --2- 172.21.15.102:0/2911395981 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f88f00b1d50 0x7f88f0149c10 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f88e000c480 tx=0x7f88e000c940 comp rx=0 tx=0).stop 2023-11-13T11:28:57.019 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:57.015+0000 7f88f5980640 1 -- 172.21.15.102:0/2911395981 shutdown_connections 2023-11-13T11:28:57.019 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:57.015+0000 7f88f5980640 1 --2- 172.21.15.102:0/2911395981 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f88f0159410 0x7f88f013cf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:28:57.020 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:57.015+0000 7f88f5980640 1 --2- 172.21.15.102:0/2911395981 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f88f00b26d0 0x7f88f00cd080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:28:57.020 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:57.015+0000 7f88f5980640 1 --2- 172.21.15.102:0/2911395981 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f88dc0664c0 0x7f88dc068980 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:28:57.020 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:57.015+0000 7f88f5980640 1 --2- 172.21.15.102:0/2911395981 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f88f00b1d50 0x7f88f0149c10 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:28:57.020 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:57.015+0000 7f88f5980640 1 -- 172.21.15.102:0/2911395981 >> 172.21.15.102:0/2911395981 conn(0x7f88f00b0690 msgr2=0x7f88f0071950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-13T11:28:57.020 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:57.015+0000 7f88f5980640 1 -- 172.21.15.102:0/2911395981 shutdown_connections 2023-11-13T11:28:57.021 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:57.015+0000 7f88f5980640 1 -- 172.21.15.102:0/2911395981 wait complete. 2023-11-13T11:28:57.061 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-11-13T11:28:57.202 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:57.199+0000 7fd6fc51c640 1 Processor -- start 2023-11-13T11:28:57.203 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:57.199+0000 7fd6fc51c640 1 -- start start 2023-11-13T11:28:57.204 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:57.199+0000 7fd6fc51c640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd6f415d2c0 0x7fd6f40ce790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:28:57.204 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:57.199+0000 7fd6fc51c640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd6f40cff20 con 0x7fd6f40d03b0 2023-11-13T11:28:57.204 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:57.199+0000 7fd6fc51c640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd6f406fc50 con 0x7fd6f40cf3e0 2023-11-13T11:28:57.204 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:57.199+0000 7fd6fc51c640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd6f406f970 con 0x7fd6f415d2c0 2023-11-13T11:28:57.205 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:57.199+0000 7fd6f9ab7640 1 --1- >> v1:172.21.15.102:6789/0 conn(0x7fd6f40d03b0 0x7fd6f40cecd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.102:6789/0 says I am v1:172.21.15.102:50534/0 (socket says 172.21.15.102:50534) 2023-11-13T11:28:57.206 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:57.199+0000 7fd6f9ab7640 1 -- 172.21.15.102:0/3667557019 learned_addr learned my addr 172.21.15.102:0/3667557019 (peer_addr_for_me v1:172.21.15.102:0/0) 2023-11-13T11:28:57.206 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:57.199+0000 7fd6fa2b8640 1 --2- 172.21.15.102:0/3667557019 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd6f415d2c0 0x7fd6f40ce790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:28:57.206 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:57.199+0000 7fd6f92b6640 1 -- 172.21.15.102:0/3667557019 <== mon.0 v1:172.21.15.102:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2868507264 0 0) 0x7fd6f40cff20 con 0x7fd6f40d03b0 2023-11-13T11:28:57.206 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:57.199+0000 7fd6f92b6640 1 -- 172.21.15.102:0/3667557019 --> v1:172.21.15.102:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd6e0003530 con 0x7fd6f40d03b0 2023-11-13T11:28:57.207 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:57.199+0000 7fd6f92b6640 1 -- 172.21.15.102:0/3667557019 <== mon.1 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1525709540 0 0) 0x7fd6f406fc50 con 0x7fd6f40cf3e0 2023-11-13T11:28:57.207 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:57.199+0000 7fd6fa2b8640 1 -- 172.21.15.102:0/3667557019 >> v1:172.21.15.154:6789/0 conn(0x7fd6f40cf3e0 legacy=0x7fd6f406e4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:28:57.207 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:57.199+0000 7fd6fa2b8640 1 -- 172.21.15.102:0/3667557019 >> v1:172.21.15.102:6789/0 conn(0x7fd6f40d03b0 legacy=0x7fd6f40cecd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:28:57.207 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:57.199+0000 7fd6fa2b8640 1 -- 172.21.15.102:0/3667557019 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6f40cf8d0 con 0x7fd6f415d2c0 2023-11-13T11:28:57.208 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:57.203+0000 7fd6fa2b8640 1 --2- 172.21.15.102:0/3667557019 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd6f415d2c0 0x7fd6f40ce790 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fd6f00097f0 tx=0x7fd6f001c4c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=697fc20c5f3c3193 server_cookie=0 in_seq=0 out_seq=0 2023-11-13T11:28:57.208 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:57.203+0000 7fd6f92b6640 1 -- 172.21.15.102:0/3667557019 <== mon.2 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6f00ac630 con 0x7fd6f415d2c0 2023-11-13T11:28:57.209 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:57.203+0000 7fd6f92b6640 1 -- 172.21.15.102:0/3667557019 <== mon.2 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd6f00ac790 con 0x7fd6f415d2c0 2023-11-13T11:28:57.209 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:57.203+0000 7fd6f92b6640 1 -- 172.21.15.102:0/3667557019 <== mon.2 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6f00acb20 con 0x7fd6f415d2c0 2023-11-13T11:28:57.210 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:57.203+0000 7fd6fc51c640 1 -- 172.21.15.102:0/3667557019 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd6f415d2c0 msgr2=0x7fd6f40ce790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:28:57.210 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:57.203+0000 7fd6fc51c640 1 --2- 172.21.15.102:0/3667557019 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd6f415d2c0 0x7fd6f40ce790 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fd6f00097f0 tx=0x7fd6f001c4c0 comp rx=0 tx=0).stop 2023-11-13T11:28:57.210 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:57.203+0000 7fd6fc51c640 1 -- 172.21.15.102:0/3667557019 shutdown_connections 2023-11-13T11:28:57.210 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:57.203+0000 7fd6fc51c640 1 --2- 172.21.15.102:0/3667557019 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd6f415d2c0 0x7fd6f40ce790 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:28:57.210 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:57.203+0000 7fd6fc51c640 1 -- 172.21.15.102:0/3667557019 >> 172.21.15.102:0/3667557019 conn(0x7fd6f40b27d0 msgr2=0x7fd6f40b2bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-13T11:28:57.211 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:57.203+0000 7fd6fc51c640 1 -- 172.21.15.102:0/3667557019 shutdown_connections 2023-11-13T11:28:57.211 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:57.203+0000 7fd6fc51c640 1 -- 172.21.15.102:0/3667557019 wait complete. 2023-11-13T11:28:57.212 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:57.207+0000 7fd6fc51c640 1 Processor -- start 2023-11-13T11:28:57.212 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:57.207+0000 7fd6fc51c640 1 -- start start 2023-11-13T11:28:57.212 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:57.207+0000 7fd6fc51c640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd6f40cf3e0 0x7fd6f41485c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:28:57.212 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:57.207+0000 7fd6fc51c640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd6f40d03b0 0x7fd6f40cc530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:28:57.213 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:57.207+0000 7fd6fc51c640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd6f415d2c0 0x7fd6f40cba90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:28:57.213 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:57.207+0000 7fd6fc51c640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6f41548e0 con 0x7fd6f40d03b0 2023-11-13T11:28:57.213 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:57.207+0000 7fd6fc51c640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6f40cb670 con 0x7fd6f40cf3e0 2023-11-13T11:28:57.214 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:57.207+0000 7fd6fc51c640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd6f40cca70 con 0x7fd6f415d2c0 2023-11-13T11:28:57.214 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:57.207+0000 7fd6f9ab7640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd6f40d03b0 0x7fd6f40cc530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:28:57.214 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:57.207+0000 7fd6f9ab7640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd6f40d03b0 0x7fd6f40cc530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:49708/0 (socket says 172.21.15.102:49708) 2023-11-13T11:28:57.214 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:57.207+0000 7fd6f9ab7640 1 -- 172.21.15.102:0/1548149624 learned_addr learned my addr 172.21.15.102:0/1548149624 (peer_addr_for_me v2:172.21.15.102:0/0) 2023-11-13T11:28:57.214 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:57.207+0000 7fd6fa2b8640 1 --2- 172.21.15.102:0/1548149624 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd6f40cf3e0 0x7fd6f41485c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:28:57.214 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:57.207+0000 7fd6faab9640 1 --2- 172.21.15.102:0/1548149624 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd6f415d2c0 0x7fd6f40cba90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:28:57.217 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:57.207+0000 7fd6f9ab7640 1 -- 172.21.15.102:0/1548149624 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd6f415d2c0 msgr2=0x7fd6f40cba90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:28:57.217 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:57.207+0000 7fd6f9ab7640 1 --2- 172.21.15.102:0/1548149624 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd6f415d2c0 0x7fd6f40cba90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:28:57.218 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:57.207+0000 7fd6f9ab7640 1 -- 172.21.15.102:0/1548149624 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd6f40cf3e0 msgr2=0x7fd6f41485c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:28:57.218 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:57.207+0000 7fd6f9ab7640 1 --2- 172.21.15.102:0/1548149624 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd6f40cf3e0 0x7fd6f41485c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:28:57.218 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:57.207+0000 7fd6f9ab7640 1 -- 172.21.15.102:0/1548149624 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6f0009420 con 0x7fd6f40d03b0 2023-11-13T11:28:57.218 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:57.207+0000 7fd6fa2b8640 1 --2- 172.21.15.102:0/1548149624 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd6f40cf3e0 0x7fd6f41485c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-13T11:28:57.219 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:57.207+0000 7fd6f9ab7640 1 --2- 172.21.15.102:0/1548149624 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd6f40d03b0 0x7fd6f40cc530 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fd6e400c480 tx=0x7fd6e400c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-13T11:28:57.219 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:57.207+0000 7fd6eaffd640 1 -- 172.21.15.102:0/1548149624 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6e4005cf0 con 0x7fd6f40d03b0 2023-11-13T11:28:57.219 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:57.207+0000 7fd6eaffd640 1 -- 172.21.15.102:0/1548149624 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd6e4005e50 con 0x7fd6f40d03b0 2023-11-13T11:28:57.219 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:57.207+0000 7fd6fc51c640 1 -- 172.21.15.102:0/1548149624 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd6f4155080 con 0x7fd6f40d03b0 2023-11-13T11:28:57.220 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:57.207+0000 7fd6eaffd640 1 -- 172.21.15.102:0/1548149624 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6e4007290 con 0x7fd6f40d03b0 2023-11-13T11:28:57.220 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:57.207+0000 7fd6fc51c640 1 -- 172.21.15.102:0/1548149624 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd6f4154da0 con 0x7fd6f40d03b0 2023-11-13T11:28:57.220 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:57.211+0000 7fd6fc51c640 1 -- 172.21.15.102:0/1548149624 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd6f40cb7b0 con 0x7fd6f40d03b0 2023-11-13T11:28:57.221 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:57.211+0000 7fd6eaffd640 1 -- 172.21.15.102:0/1548149624 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fd6e40073f0 con 0x7fd6f40d03b0 2023-11-13T11:28:57.221 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:57.211+0000 7fd6eaffd640 1 --2- 172.21.15.102:0/1548149624 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7fd6d8066470 0x7fd6d8068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:28:57.221 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:57.211+0000 7fd6eaffd640 1 -- 172.21.15.102:0/1548149624 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5609+0+0 (secure 0 0 0) 0x7fd6e4083400 con 0x7fd6f40d03b0 2023-11-13T11:28:57.221 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:57.211+0000 7fd6fa2b8640 1 --2- 172.21.15.102:0/1548149624 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7fd6d8066470 0x7fd6d8068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:28:57.222 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:57.211+0000 7fd6fa2b8640 1 --2- 172.21.15.102:0/1548149624 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7fd6d8066470 0x7fd6d8068930 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fd6f00ae000 tx=0x7fd6f00a7000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-13T11:28:57.222 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:57.215+0000 7fd6eaffd640 1 -- 172.21.15.102:0/1548149624 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fd6f40cb7b0 con 0x7fd6f40d03b0 2023-11-13T11:28:57.402 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:57.395+0000 7fd6fc51c640 1 -- 172.21.15.102:0/1548149624 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7fd6f40cb7b0 con 0x7fd6f40d03b0 2023-11-13T11:28:58.018 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:58.011+0000 7fd6eaffd640 1 -- 172.21.15.102:0/1548149624 <== mon.0 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 2 and data pool 3 v4) v1 ==== 172+0+0 (secure 0 0 0) 0x7fd6f40cb7b0 con 0x7fd6f40d03b0 2023-11-13T11:28:58.018 INFO:teuthology.orchestra.run.smithi102.stderr:new fs with metadata pool 2 and data pool 3 2023-11-13T11:28:58.020 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:58.015+0000 7fd6fc51c640 1 -- 172.21.15.102:0/1548149624 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7fd6d8066470 msgr2=0x7fd6d8068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:28:58.021 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:58.015+0000 7fd6fc51c640 1 --2- 172.21.15.102:0/1548149624 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7fd6d8066470 0x7fd6d8068930 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fd6f00ae000 tx=0x7fd6f00a7000 comp rx=0 tx=0).stop 2023-11-13T11:28:58.021 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:58.015+0000 7fd6fc51c640 1 -- 172.21.15.102:0/1548149624 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd6f40d03b0 msgr2=0x7fd6f40cc530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:28:58.021 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:58.015+0000 7fd6fc51c640 1 --2- 172.21.15.102:0/1548149624 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd6f40d03b0 0x7fd6f40cc530 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fd6e400c480 tx=0x7fd6e400c940 comp rx=0 tx=0).stop 2023-11-13T11:28:58.021 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:58.015+0000 7fd6fc51c640 1 -- 172.21.15.102:0/1548149624 shutdown_connections 2023-11-13T11:28:58.022 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:58.015+0000 7fd6fc51c640 1 --2- 172.21.15.102:0/1548149624 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd6f415d2c0 0x7fd6f40cba90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:28:58.022 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:58.015+0000 7fd6fc51c640 1 --2- 172.21.15.102:0/1548149624 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7fd6d8066470 0x7fd6d8068930 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:28:58.022 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:58.015+0000 7fd6fc51c640 1 --2- 172.21.15.102:0/1548149624 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd6f40d03b0 0x7fd6f40cc530 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:28:58.022 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:58.015+0000 7fd6fc51c640 1 --2- 172.21.15.102:0/1548149624 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd6f40cf3e0 0x7fd6f41485c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:28:58.023 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:58.015+0000 7fd6fc51c640 1 -- 172.21.15.102:0/1548149624 >> 172.21.15.102:0/1548149624 conn(0x7fd6f40b27d0 msgr2=0x7fd6f4155a50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-13T11:28:58.023 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:58.015+0000 7fd6fc51c640 1 -- 172.21.15.102:0/1548149624 shutdown_connections 2023-11-13T11:28:58.023 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:58.015+0000 7fd6fc51c640 1 -- 172.21.15.102:0/1548149624 wait complete. 2023-11-13T11:28:58.046 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-13T11:28:58.184 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:58.179+0000 7fc3665e7640 1 Processor -- start 2023-11-13T11:28:58.184 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:58.179+0000 7fc3665e7640 1 -- start start 2023-11-13T11:28:58.185 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:58.179+0000 7fc3665e7640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7fc3601606e0 0x7fc3600c69b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:28:58.185 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:58.179+0000 7fc3665e7640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc3600cf490 0x7fc3600cf920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:28:58.185 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:58.179+0000 7fc3665e7640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc3600d1440 con 0x7fc3600d0c40 2023-11-13T11:28:58.186 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:58.179+0000 7fc3665e7640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc3600cfe60 con 0x7fc3601606e0 2023-11-13T11:28:58.186 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:58.179+0000 7fc3665e7640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc3600cdb10 con 0x7fc3600cf490 2023-11-13T11:28:58.186 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:58.179+0000 7fc35ffff640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7fc3601606e0 0x7fc3600c69b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:28:58.186 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:58.179+0000 7fc35ffff640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7fc3601606e0 0x7fc3600c69b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:35988/0 (socket says 172.21.15.102:35988) 2023-11-13T11:28:58.187 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:58.179+0000 7fc35f7fe640 1 --1- >> v1:172.21.15.102:6789/0 conn(0x7fc3600d0c40 0x7fc3600b3e20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.102:6789/0 says I am v1:172.21.15.102:47834/0 (socket says 172.21.15.102:47834) 2023-11-13T11:28:58.187 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:58.179+0000 7fc35ffff640 1 -- 172.21.15.102:0/1824258944 learned_addr learned my addr 172.21.15.102:0/1824258944 (peer_addr_for_me v2:172.21.15.102:0/0) 2023-11-13T11:28:58.187 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:58.179+0000 7fc364b84640 1 --2- 172.21.15.102:0/1824258944 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc3600cf490 0x7fc3600cf920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:28:58.188 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:58.179+0000 7fc35ffff640 1 -- 172.21.15.102:0/1824258944 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc3600cf490 msgr2=0x7fc3600cf920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-13T11:28:58.188 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:58.179+0000 7fc35ffff640 1 --2- 172.21.15.102:0/1824258944 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc3600cf490 0x7fc3600cf920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:28:58.188 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:58.179+0000 7fc35ffff640 1 -- 172.21.15.102:0/1824258944 >> v1:172.21.15.102:6789/0 conn(0x7fc3600d0c40 legacy=0x7fc3600b3e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:28:58.188 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:58.179+0000 7fc35ffff640 1 -- 172.21.15.102:0/1824258944 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3600d1690 con 0x7fc3601606e0 2023-11-13T11:28:58.189 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:58.179+0000 7fc35effd640 1 -- 172.21.15.102:0/1824258944 <== mon.0 v1:172.21.15.102:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4277598523 0 0) 0x7fc3600d1440 con 0x7fc3600d0c40 2023-11-13T11:28:58.190 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:58.183+0000 7fc35ffff640 1 --2- 172.21.15.102:0/1824258944 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc3601606e0 0x7fc3600c69b0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fc350009870 tx=0x7fc35001c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=36a0c4f10f40fbff server_cookie=0 in_seq=0 out_seq=0 2023-11-13T11:28:58.190 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:58.183+0000 7fc35effd640 1 -- 172.21.15.102:0/1824258944 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3500a6040 con 0x7fc3601606e0 2023-11-13T11:28:58.190 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:58.183+0000 7fc35effd640 1 -- 172.21.15.102:0/1824258944 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc3500aa600 con 0x7fc3601606e0 2023-11-13T11:28:58.190 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:58.183+0000 7fc35effd640 1 -- 172.21.15.102:0/1824258944 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3500aa990 con 0x7fc3601606e0 2023-11-13T11:28:58.191 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:58.183+0000 7fc3665e7640 1 -- 172.21.15.102:0/1824258944 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc3601606e0 msgr2=0x7fc3600c69b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:28:58.191 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:58.183+0000 7fc3665e7640 1 --2- 172.21.15.102:0/1824258944 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc3601606e0 0x7fc3600c69b0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fc350009870 tx=0x7fc35001c480 comp rx=0 tx=0).stop 2023-11-13T11:28:58.191 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:58.183+0000 7fc3665e7640 1 -- 172.21.15.102:0/1824258944 shutdown_connections 2023-11-13T11:28:58.191 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:58.183+0000 7fc3665e7640 1 --2- 172.21.15.102:0/1824258944 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc3600cf490 0x7fc3600cf920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:28:58.191 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:58.183+0000 7fc3665e7640 1 --2- 172.21.15.102:0/1824258944 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc3601606e0 0x7fc3600c69b0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:28:58.192 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:58.183+0000 7fc3665e7640 1 -- 172.21.15.102:0/1824258944 >> 172.21.15.102:0/1824258944 conn(0x7fc36009c130 msgr2=0x7fc3600d2e60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-13T11:28:58.192 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:58.183+0000 7fc3665e7640 1 -- 172.21.15.102:0/1824258944 shutdown_connections 2023-11-13T11:28:58.192 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:58.183+0000 7fc3665e7640 1 -- 172.21.15.102:0/1824258944 wait complete. 2023-11-13T11:28:58.194 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:58.187+0000 7fc3665e7640 1 Processor -- start 2023-11-13T11:28:58.194 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:58.187+0000 7fc3665e7640 1 -- start start 2023-11-13T11:28:58.195 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:58.187+0000 7fc3665e7640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc3600cf490 0x7fc36014a2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:28:58.195 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:58.187+0000 7fc3665e7640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc3600d0c40 0x7fc36014e960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:28:58.195 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:58.187+0000 7fc3665e7640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc3601606e0 0x7fc36006b2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:28:58.195 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:58.187+0000 7fc3665e7640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc36014a810 con 0x7fc3600d0c40 2023-11-13T11:28:58.196 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:58.187+0000 7fc3665e7640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc360154070 con 0x7fc3601606e0 2023-11-13T11:28:58.196 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:58.187+0000 7fc3665e7640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc360153180 con 0x7fc3600cf490 2023-11-13T11:28:58.196 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:58.187+0000 7fc35f7fe640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc3600d0c40 0x7fc36014e960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:28:58.196 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:58.187+0000 7fc35f7fe640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc3600d0c40 0x7fc36014e960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:36000/0 (socket says 172.21.15.102:36000) 2023-11-13T11:28:58.196 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:58.187+0000 7fc35f7fe640 1 -- 172.21.15.102:0/989087584 learned_addr learned my addr 172.21.15.102:0/989087584 (peer_addr_for_me v2:172.21.15.102:0/0) 2023-11-13T11:28:58.197 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:58.187+0000 7fc35ffff640 1 --2- 172.21.15.102:0/989087584 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc3600cf490 0x7fc36014a2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:28:58.197 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:58.187+0000 7fc364b84640 1 --2- 172.21.15.102:0/989087584 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc3601606e0 0x7fc36006b2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:28:58.197 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:58.187+0000 7fc35f7fe640 1 -- 172.21.15.102:0/989087584 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc3600cf490 msgr2=0x7fc36014a2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:28:58.197 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:58.187+0000 7fc35f7fe640 1 --2- 172.21.15.102:0/989087584 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc3600cf490 0x7fc36014a2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:28:58.197 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:58.187+0000 7fc35f7fe640 1 -- 172.21.15.102:0/989087584 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc3601606e0 msgr2=0x7fc36006b2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:28:58.198 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:58.187+0000 7fc35f7fe640 1 --2- 172.21.15.102:0/989087584 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc3601606e0 0x7fc36006b2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:28:58.198 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:58.187+0000 7fc35f7fe640 1 -- 172.21.15.102:0/989087584 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3500094d0 con 0x7fc3600d0c40 2023-11-13T11:28:58.198 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:58.187+0000 7fc35f7fe640 1 --2- 172.21.15.102:0/989087584 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc3600d0c40 0x7fc36014e960 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fc35400c520 tx=0x7fc35400c9e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-13T11:28:58.198 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:58.187+0000 7fc35cff9640 1 -- 172.21.15.102:0/989087584 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3540074e0 con 0x7fc3600d0c40 2023-11-13T11:28:58.198 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:58.187+0000 7fc35cff9640 1 -- 172.21.15.102:0/989087584 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc354007640 con 0x7fc3600d0c40 2023-11-13T11:28:58.199 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:58.187+0000 7fc35cff9640 1 -- 172.21.15.102:0/989087584 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3540049f0 con 0x7fc3600d0c40 2023-11-13T11:28:58.199 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:58.187+0000 7fc3665e7640 1 -- 172.21.15.102:0/989087584 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc360153460 con 0x7fc3600d0c40 2023-11-13T11:28:58.199 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:58.191+0000 7fc3665e7640 1 -- 172.21.15.102:0/989087584 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc360153a20 con 0x7fc3600d0c40 2023-11-13T11:28:58.200 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:58.191+0000 7fc3665e7640 1 -- 172.21.15.102:0/989087584 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc360068520 con 0x7fc3600d0c40 2023-11-13T11:28:58.200 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:58.191+0000 7fc35cff9640 1 -- 172.21.15.102:0/989087584 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fc354004b50 con 0x7fc3600d0c40 2023-11-13T11:28:58.200 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:58.191+0000 7fc35cff9640 1 --2- 172.21.15.102:0/989087584 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7fc34c066470 0x7fc34c068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:28:58.200 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:58.191+0000 7fc35cff9640 1 -- 172.21.15.102:0/989087584 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc354083050 con 0x7fc3600d0c40 2023-11-13T11:28:58.201 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:58.191+0000 7fc35ffff640 1 --2- 172.21.15.102:0/989087584 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7fc34c066470 0x7fc34c068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:28:58.201 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:58.191+0000 7fc35ffff640 1 --2- 172.21.15.102:0/989087584 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7fc34c066470 0x7fc34c068930 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fc3500ae000 tx=0x7fc3500b5040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-13T11:28:58.201 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:58.195+0000 7fc35cff9640 1 -- 172.21.15.102:0/989087584 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fc354050580 con 0x7fc3600d0c40 2023-11-13T11:28:58.352 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:58.347+0000 7fc3665e7640 1 -- 172.21.15.102:0/989087584 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc3601541b0 con 0x7fc3600d0c40 2023-11-13T11:28:58.353 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:58.347+0000 7fc35cff9640 1 -- 172.21.15.102:0/989087584 <== mon.0 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+16558 (secure 0 0 0) 0x7fc354018090 con 0x7fc3600d0c40 2023-11-13T11:28:58.354 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T11:28:58.354 INFO:teuthology.orchestra.run.smithi102.stdout:{"epoch":21,"fsid":"97b3eb2b-7ccf-4aae-8d92-bff986c671ea","created":"2023-11-13T11:28:31.836724+0000","modified":"2023-11-13T11:28:57.400596+0000","last_up_change":"2023-11-13T11:28:44.876638+0000","last_in_change":"2023-11-13T11:28:35.312740+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-13T11:28:44.981356+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-13T11:28:55.958525+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-13T11:28:56.394264+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"bdefaa17-fcca-4c86-aa40-27dc33a789af","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6800","nonce":53303834},{"type":"v1","addr":"172.21.15.102:6801","nonce":53303834}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6802","nonce":53303834},{"type":"v1","addr":"172.21.15.102:6803","nonce":53303834}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6806","nonce":53303834},{"type":"v1","addr":"172.21.15.102:6807","nonce":53303834}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6804","nonce":53303834},{"type":"v1","addr":"172.21.15.102:6805","nonce":53303834}]},"public_addr":"172.21.15.102:6801/53303834","cluster_addr":"172.21.15.102:6803/53303834","heartbeat_back_addr":"172.21.15.102:6807/53303834","heartbeat_front_addr":"172.21.15.102:6805/53303834","state":["exists","up"]},{"osd":1,"uuid":"f0033196-dec9-4ae9-945e-6aeef6dbb47f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6808","nonce":1732708348},{"type":"v1","addr":"172.21.15.102:6809","nonce":1732708348}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6811","nonce":1732708348},{"type":"v1","addr":"172.21.15.102:6813","nonce":1732708348}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6818","nonce":1732708348},{"type":"v1","addr":"172.21.15.102:6820","nonce":1732708348}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6815","nonce":1732708348},{"type":"v1","addr":"172.21.15.102:6817","nonce":1732708348}]},"public_addr":"172.21.15.102:6809/1732708348","cluster_addr":"172.21.15.102:6813/1732708348","heartbeat_back_addr":"172.21.15.102:6820/1732708348","heartbeat_front_addr":"172.21.15.102:6817/1732708348","state":["exists","up"]},{"osd":2,"uuid":"496b0834-351e-4ec2-a714-86ed0c0ff4fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6810","nonce":1825475150},{"type":"v1","addr":"172.21.15.102:6812","nonce":1825475150}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6814","nonce":1825475150},{"type":"v1","addr":"172.21.15.102:6816","nonce":1825475150}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6822","nonce":1825475150},{"type":"v1","addr":"172.21.15.102:6823","nonce":1825475150}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6819","nonce":1825475150},{"type":"v1","addr":"172.21.15.102:6821","nonce":1825475150}]},"public_addr":"172.21.15.102:6812/1825475150","cluster_addr":"172.21.15.102:6816/1825475150","heartbeat_back_addr":"172.21.15.102:6823/1825475150","heartbeat_front_addr":"172.21.15.102:6821/1825475150","state":["exists","up"]},{"osd":3,"uuid":"3ba6cc41-e0a0-4273-86cb-90000c06a55a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6824","nonce":4149355528},{"type":"v1","addr":"172.21.15.102:6825","nonce":4149355528}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6826","nonce":4149355528},{"type":"v1","addr":"172.21.15.102:6827","nonce":4149355528}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6830","nonce":4149355528},{"type":"v1","addr":"172.21.15.102:6831","nonce":4149355528}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6828","nonce":4149355528},{"type":"v1","addr":"172.21.15.102:6829","nonce":4149355528}]},"public_addr":"172.21.15.102:6825/4149355528","cluster_addr":"172.21.15.102:6827/4149355528","heartbeat_back_addr":"172.21.15.102:6831/4149355528","heartbeat_front_addr":"172.21.15.102:6829/4149355528","state":["exists","up"]},{"osd":4,"uuid":"16e797d8-e6e7-4140-95c3-b85283c42a2a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6808","nonce":4028899241},{"type":"v1","addr":"172.21.15.154:6809","nonce":4028899241}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6810","nonce":4028899241},{"type":"v1","addr":"172.21.15.154:6811","nonce":4028899241}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6814","nonce":4028899241},{"type":"v1","addr":"172.21.15.154:6815","nonce":4028899241}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6812","nonce":4028899241},{"type":"v1","addr":"172.21.15.154:6813","nonce":4028899241}]},"public_addr":"172.21.15.154:6809/4028899241","cluster_addr":"172.21.15.154:6811/4028899241","heartbeat_back_addr":"172.21.15.154:6815/4028899241","heartbeat_front_addr":"172.21.15.154:6813/4028899241","state":["exists","up"]},{"osd":5,"uuid":"d6ab225c-1b55-450a-89a9-abe5c3f8d6af","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":3562396827},{"type":"v1","addr":"172.21.15.154:6801","nonce":3562396827}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":3562396827},{"type":"v1","addr":"172.21.15.154:6803","nonce":3562396827}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6806","nonce":3562396827},{"type":"v1","addr":"172.21.15.154:6807","nonce":3562396827}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6804","nonce":3562396827},{"type":"v1","addr":"172.21.15.154:6805","nonce":3562396827}]},"public_addr":"172.21.15.154:6801/3562396827","cluster_addr":"172.21.15.154:6803/3562396827","heartbeat_back_addr":"172.21.15.154:6807/3562396827","heartbeat_front_addr":"172.21.15.154:6805/3562396827","state":["exists","up"]},{"osd":6,"uuid":"96f905ac-491c-4662-8e2b-5bb8e929ab9d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6816","nonce":2933728751},{"type":"v1","addr":"172.21.15.154:6817","nonce":2933728751}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6818","nonce":2933728751},{"type":"v1","addr":"172.21.15.154:6819","nonce":2933728751}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6822","nonce":2933728751},{"type":"v1","addr":"172.21.15.154:6823","nonce":2933728751}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6820","nonce":2933728751},{"type":"v1","addr":"172.21.15.154:6821","nonce":2933728751}]},"public_addr":"172.21.15.154:6817/2933728751","cluster_addr":"172.21.15.154:6819/2933728751","heartbeat_back_addr":"172.21.15.154:6823/2933728751","heartbeat_front_addr":"172.21.15.154:6821/2933728751","state":["exists","up"]},{"osd":7,"uuid":"07012d3b-3ab4-40df-a471-93caed22e2dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6824","nonce":1753500785},{"type":"v1","addr":"172.21.15.154:6825","nonce":1753500785}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6826","nonce":1753500785},{"type":"v1","addr":"172.21.15.154:6827","nonce":1753500785}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6830","nonce":1753500785},{"type":"v1","addr":"172.21.15.154:6831","nonce":1753500785}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6828","nonce":1753500785},{"type":"v1","addr":"172.21.15.154:6829","nonce":1753500785}]},"public_addr":"172.21.15.154:6825/1753500785","cluster_addr":"172.21.15.154:6827/1753500785","heartbeat_back_addr":"172.21.15.154:6831/1753500785","heartbeat_front_addr":"172.21.15.154:6829/1753500785","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-13T11:28:40.978603+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-13T11:28:41.200985+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-13T11:28:41.222815+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-13T11:28:41.202162+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-13T11:28:40.925911+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-13T11:28:41.087725+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-13T11:28:41.072208+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-13T11:28:40.875257+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-13T11:28:58.355 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:58.351+0000 7fc3665e7640 1 -- 172.21.15.102:0/989087584 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7fc34c066470 msgr2=0x7fc34c068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:28:58.356 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:58.351+0000 7fc3665e7640 1 --2- 172.21.15.102:0/989087584 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7fc34c066470 0x7fc34c068930 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fc3500ae000 tx=0x7fc3500b5040 comp rx=0 tx=0).stop 2023-11-13T11:28:58.356 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:58.351+0000 7fc3665e7640 1 -- 172.21.15.102:0/989087584 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc3600d0c40 msgr2=0x7fc36014e960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:28:58.356 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:58.351+0000 7fc3665e7640 1 --2- 172.21.15.102:0/989087584 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc3600d0c40 0x7fc36014e960 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fc35400c520 tx=0x7fc35400c9e0 comp rx=0 tx=0).stop 2023-11-13T11:28:58.356 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:58.351+0000 7fc3665e7640 1 -- 172.21.15.102:0/989087584 shutdown_connections 2023-11-13T11:28:58.357 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:58.351+0000 7fc3665e7640 1 --2- 172.21.15.102:0/989087584 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc3601606e0 0x7fc36006b2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:28:58.357 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:58.351+0000 7fc3665e7640 1 --2- 172.21.15.102:0/989087584 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7fc34c066470 0x7fc34c068930 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:28:58.357 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:58.351+0000 7fc3665e7640 1 --2- 172.21.15.102:0/989087584 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc3600d0c40 0x7fc36014e960 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:28:58.357 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:58.351+0000 7fc3665e7640 1 --2- 172.21.15.102:0/989087584 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc3600cf490 0x7fc36014a2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:28:58.357 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:58.351+0000 7fc3665e7640 1 -- 172.21.15.102:0/989087584 >> 172.21.15.102:0/989087584 conn(0x7fc36009c130 msgr2=0x7fc3600c6860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-13T11:28:58.358 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:58.351+0000 7fc3665e7640 1 -- 172.21.15.102:0/989087584 shutdown_connections 2023-11-13T11:28:58.358 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:58.351+0000 7fc3665e7640 1 -- 172.21.15.102:0/989087584 wait complete. 2023-11-13T11:28:58.375 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-13T11:28:58.512 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:58.507+0000 7fbe0ed2a640 1 Processor -- start 2023-11-13T11:28:58.512 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:58.507+0000 7fbe0ed2a640 1 -- start start 2023-11-13T11:28:58.513 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:58.507+0000 7fbe0ed2a640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fbe08140540 0x7fbe0815e3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:28:58.514 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:58.507+0000 7fbe0ed2a640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbe0815e910 con 0x7fbe08071900 2023-11-13T11:28:58.514 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:58.507+0000 7fbe0ed2a640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbe08140920 con 0x7fbe0806caa0 2023-11-13T11:28:58.514 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:58.507+0000 7fbe0ed2a640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbe080ccc50 con 0x7fbe08140540 2023-11-13T11:28:58.514 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:58.507+0000 7fbe0d2c7640 1 --1- >> v1:172.21.15.102:6789/0 conn(0x7fbe08071900 0x7fbe080b1c00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.102:6789/0 says I am v1:172.21.15.102:47840/0 (socket says 172.21.15.102:47840) 2023-11-13T11:28:58.514 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:58.507+0000 7fbe0d2c7640 1 -- 172.21.15.102:0/901421937 learned_addr learned my addr 172.21.15.102:0/901421937 (peer_addr_for_me v1:172.21.15.102:0/0) 2023-11-13T11:28:58.515 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:58.507+0000 7fbe0cac6640 1 --2- 172.21.15.102:0/901421937 >> v2:172.21.15.154:3300/0 conn(0x7fbe08140540 0x7fbe0815e3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:28:58.515 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:58.507+0000 7fbdff7fe640 1 -- 172.21.15.102:0/901421937 <== mon.0 v1:172.21.15.102:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1580931577 0 0) 0x7fbe000014a0 con 0x7fbe08071900 2023-11-13T11:28:58.516 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:58.507+0000 7fbdff7fe640 1 -- 172.21.15.102:0/901421937 --> v1:172.21.15.102:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbdf0003530 con 0x7fbe08071900 2023-11-13T11:28:58.516 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:58.507+0000 7fbe0cac6640 1 -- 172.21.15.102:0/901421937 >> v1:172.21.15.154:6789/0 conn(0x7fbe0806caa0 legacy=0x7fbe080711f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:28:58.516 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:58.511+0000 7fbdff7fe640 1 -- 172.21.15.102:0/901421937 <== mon.1 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1108626429 0 0) 0x7fbe08140920 con 0x7fbe0806caa0 2023-11-13T11:28:58.516 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:58.511+0000 7fbe0cac6640 1 -- 172.21.15.102:0/901421937 >> v1:172.21.15.102:6789/0 conn(0x7fbe08071900 legacy=0x7fbe080b1c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:28:58.517 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:58.511+0000 7fbe0cac6640 1 -- 172.21.15.102:0/901421937 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe0806cfc0 con 0x7fbe08140540 2023-11-13T11:28:58.517 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:58.511+0000 7fbe0cac6640 1 --2- 172.21.15.102:0/901421937 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbe08140540 0x7fbe0815e3d0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fbe040097c0 tx=0x7fbe0401c370 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ab8409da25382423 server_cookie=0 in_seq=0 out_seq=0 2023-11-13T11:28:58.518 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:58.511+0000 7fbdff7fe640 1 -- 172.21.15.102:0/901421937 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe040ab600 con 0x7fbe08140540 2023-11-13T11:28:58.518 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:58.511+0000 7fbdff7fe640 1 -- 172.21.15.102:0/901421937 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe040a7050 con 0x7fbe08140540 2023-11-13T11:28:58.519 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:58.511+0000 7fbdff7fe640 1 -- 172.21.15.102:0/901421937 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe040ab960 con 0x7fbe08140540 2023-11-13T11:28:58.519 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:58.511+0000 7fbe0ed2a640 1 -- 172.21.15.102:0/901421937 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbe08140540 msgr2=0x7fbe0815e3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:28:58.519 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:58.511+0000 7fbe0ed2a640 1 --2- 172.21.15.102:0/901421937 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbe08140540 0x7fbe0815e3d0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fbe040097c0 tx=0x7fbe0401c370 comp rx=0 tx=0).stop 2023-11-13T11:28:58.519 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:58.515+0000 7fbe0ed2a640 1 -- 172.21.15.102:0/901421937 shutdown_connections 2023-11-13T11:28:58.519 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:58.515+0000 7fbe0ed2a640 1 --2- 172.21.15.102:0/901421937 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbe08140540 0x7fbe0815e3d0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:28:58.520 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:58.515+0000 7fbe0ed2a640 1 -- 172.21.15.102:0/901421937 >> 172.21.15.102:0/901421937 conn(0x7fbe080b0870 msgr2=0x7fbe080b0c80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-13T11:28:58.520 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:58.515+0000 7fbe0ed2a640 1 -- 172.21.15.102:0/901421937 shutdown_connections 2023-11-13T11:28:58.520 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:58.515+0000 7fbe0ed2a640 1 -- 172.21.15.102:0/901421937 wait complete. 2023-11-13T11:28:58.520 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:58.515+0000 7fbe0ed2a640 1 Processor -- start 2023-11-13T11:28:58.521 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:58.515+0000 7fbe0ed2a640 1 -- start start 2023-11-13T11:28:58.522 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:58.515+0000 7fbe0ed2a640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fbe0806caa0 0x7fbe0813e370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:28:58.522 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:58.515+0000 7fbe0ed2a640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fbe08071900 0x7fbe080cb590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:28:58.523 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:58.515+0000 7fbe0ed2a640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbe08140540 0x7fbe080cbad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:28:58.523 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:58.515+0000 7fbe0ed2a640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe08155fe0 con 0x7fbe08071900 2023-11-13T11:28:58.523 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:58.515+0000 7fbe0ed2a640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe08150230 con 0x7fbe08140540 2023-11-13T11:28:58.523 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:58.515+0000 7fbe0ed2a640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe0814f890 con 0x7fbe0806caa0 2023-11-13T11:28:58.523 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:58.515+0000 7fbdfffff640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fbe08071900 0x7fbe080cb590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:28:58.524 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:58.515+0000 7fbdfffff640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fbe08071900 0x7fbe080cb590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:36016/0 (socket says 172.21.15.102:36016) 2023-11-13T11:28:58.524 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:58.515+0000 7fbdfffff640 1 -- 172.21.15.102:0/1731894272 learned_addr learned my addr 172.21.15.102:0/1731894272 (peer_addr_for_me v2:172.21.15.102:0/0) 2023-11-13T11:28:58.524 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:58.515+0000 7fbe0cac6640 1 --2- 172.21.15.102:0/1731894272 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fbe0806caa0 0x7fbe0813e370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:28:58.524 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:58.515+0000 7fbe0d2c7640 1 --2- 172.21.15.102:0/1731894272 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbe08140540 0x7fbe080cbad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:28:58.524 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:58.515+0000 7fbdfffff640 1 -- 172.21.15.102:0/1731894272 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fbe0806caa0 msgr2=0x7fbe0813e370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:28:58.525 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:58.515+0000 7fbdfffff640 1 --2- 172.21.15.102:0/1731894272 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fbe0806caa0 0x7fbe0813e370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:28:58.525 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:58.515+0000 7fbdfffff640 1 -- 172.21.15.102:0/1731894272 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbe08140540 msgr2=0x7fbe080cbad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:28:58.525 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:58.515+0000 7fbdfffff640 1 --2- 172.21.15.102:0/1731894272 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbe08140540 0x7fbe080cbad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:28:58.525 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:58.515+0000 7fbdfffff640 1 -- 172.21.15.102:0/1731894272 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe04009420 con 0x7fbe08071900 2023-11-13T11:28:58.525 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:58.519+0000 7fbdfffff640 1 --2- 172.21.15.102:0/1731894272 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fbe08071900 0x7fbe080cb590 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fbdf800c4d0 tx=0x7fbdf800c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-13T11:28:58.527 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:58.519+0000 7fbdfd7fa640 1 -- 172.21.15.102:0/1731894272 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbdf8005480 con 0x7fbe08071900 2023-11-13T11:28:58.527 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:58.519+0000 7fbdfd7fa640 1 -- 172.21.15.102:0/1731894272 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbdf8003600 con 0x7fbe08071900 2023-11-13T11:28:58.527 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:58.519+0000 7fbdfd7fa640 1 -- 172.21.15.102:0/1731894272 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbdf80039b0 con 0x7fbe08071900 2023-11-13T11:28:58.528 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:58.519+0000 7fbe0ed2a640 1 -- 172.21.15.102:0/1731894272 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbe0814fb70 con 0x7fbe08071900 2023-11-13T11:28:58.528 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:58.519+0000 7fbe0ed2a640 1 -- 172.21.15.102:0/1731894272 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbe08155c00 con 0x7fbe08071900 2023-11-13T11:28:58.528 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:58.519+0000 7fbe0ed2a640 1 -- 172.21.15.102:0/1731894272 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbe08150370 con 0x7fbe08071900 2023-11-13T11:28:58.528 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:58.519+0000 7fbdfd7fa640 1 -- 172.21.15.102:0/1731894272 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fbdf8003b10 con 0x7fbe08071900 2023-11-13T11:28:58.528 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:58.519+0000 7fbdfd7fa640 1 --2- 172.21.15.102:0/1731894272 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7fbdf4066470 0x7fbdf4068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:28:58.529 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:58.519+0000 7fbdfd7fa640 1 -- 172.21.15.102:0/1731894272 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fbdf8083450 con 0x7fbe08071900 2023-11-13T11:28:58.529 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:58.519+0000 7fbe0cac6640 1 --2- 172.21.15.102:0/1731894272 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7fbdf4066470 0x7fbdf4068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:28:58.529 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:58.523+0000 7fbe0cac6640 1 --2- 172.21.15.102:0/1731894272 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7fbdf4066470 0x7fbdf4068930 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fbe040ad000 tx=0x7fbe040a6000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-13T11:28:58.529 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:58.523+0000 7fbdfd7fa640 1 -- 172.21.15.102:0/1731894272 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fbe08150370 con 0x7fbe08071900 2023-11-13T11:28:58.684 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:58.679+0000 7fbe0ed2a640 1 -- 172.21.15.102:0/1731894272 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fbe08150370 con 0x7fbe08071900 2023-11-13T11:28:58.685 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:58.679+0000 7fbdfd7fa640 1 -- 172.21.15.102:0/1731894272 <== mon.0 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+16545 (secure 0 0 0) 0x7fbe08150370 con 0x7fbe08071900 2023-11-13T11:28:58.686 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T11:28:58.686 INFO:teuthology.orchestra.run.smithi102.stdout:{"epoch":22,"fsid":"97b3eb2b-7ccf-4aae-8d92-bff986c671ea","created":"2023-11-13T11:28:31.836724+0000","modified":"2023-11-13T11:28:58.608314+0000","last_up_change":"2023-11-13T11:28:44.876638+0000","last_in_change":"2023-11-13T11:28:35.312740+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-13T11:28:44.981356+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-13T11:28:55.958525+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-13T11:28:56.394264+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"bdefaa17-fcca-4c86-aa40-27dc33a789af","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6800","nonce":53303834},{"type":"v1","addr":"172.21.15.102:6801","nonce":53303834}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6802","nonce":53303834},{"type":"v1","addr":"172.21.15.102:6803","nonce":53303834}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6806","nonce":53303834},{"type":"v1","addr":"172.21.15.102:6807","nonce":53303834}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6804","nonce":53303834},{"type":"v1","addr":"172.21.15.102:6805","nonce":53303834}]},"public_addr":"172.21.15.102:6801/53303834","cluster_addr":"172.21.15.102:6803/53303834","heartbeat_back_addr":"172.21.15.102:6807/53303834","heartbeat_front_addr":"172.21.15.102:6805/53303834","state":["exists","up"]},{"osd":1,"uuid":"f0033196-dec9-4ae9-945e-6aeef6dbb47f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6808","nonce":1732708348},{"type":"v1","addr":"172.21.15.102:6809","nonce":1732708348}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6811","nonce":1732708348},{"type":"v1","addr":"172.21.15.102:6813","nonce":1732708348}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6818","nonce":1732708348},{"type":"v1","addr":"172.21.15.102:6820","nonce":1732708348}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6815","nonce":1732708348},{"type":"v1","addr":"172.21.15.102:6817","nonce":1732708348}]},"public_addr":"172.21.15.102:6809/1732708348","cluster_addr":"172.21.15.102:6813/1732708348","heartbeat_back_addr":"172.21.15.102:6820/1732708348","heartbeat_front_addr":"172.21.15.102:6817/1732708348","state":["exists","up"]},{"osd":2,"uuid":"496b0834-351e-4ec2-a714-86ed0c0ff4fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6810","nonce":1825475150},{"type":"v1","addr":"172.21.15.102:6812","nonce":1825475150}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6814","nonce":1825475150},{"type":"v1","addr":"172.21.15.102:6816","nonce":1825475150}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6822","nonce":1825475150},{"type":"v1","addr":"172.21.15.102:6823","nonce":1825475150}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6819","nonce":1825475150},{"type":"v1","addr":"172.21.15.102:6821","nonce":1825475150}]},"public_addr":"172.21.15.102:6812/1825475150","cluster_addr":"172.21.15.102:6816/1825475150","heartbeat_back_addr":"172.21.15.102:6823/1825475150","heartbeat_front_addr":"172.21.15.102:6821/1825475150","state":["exists","up"]},{"osd":3,"uuid":"3ba6cc41-e0a0-4273-86cb-90000c06a55a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6824","nonce":4149355528},{"type":"v1","addr":"172.21.15.102:6825","nonce":4149355528}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6826","nonce":4149355528},{"type":"v1","addr":"172.21.15.102:6827","nonce":4149355528}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6830","nonce":4149355528},{"type":"v1","addr":"172.21.15.102:6831","nonce":4149355528}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6828","nonce":4149355528},{"type":"v1","addr":"172.21.15.102:6829","nonce":4149355528}]},"public_addr":"172.21.15.102:6825/4149355528","cluster_addr":"172.21.15.102:6827/4149355528","heartbeat_back_addr":"172.21.15.102:6831/4149355528","heartbeat_front_addr":"172.21.15.102:6829/4149355528","state":["exists","up"]},{"osd":4,"uuid":"16e797d8-e6e7-4140-95c3-b85283c42a2a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6808","nonce":4028899241},{"type":"v1","addr":"172.21.15.154:6809","nonce":4028899241}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6810","nonce":4028899241},{"type":"v1","addr":"172.21.15.154:6811","nonce":4028899241}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6814","nonce":4028899241},{"type":"v1","addr":"172.21.15.154:6815","nonce":4028899241}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6812","nonce":4028899241},{"type":"v1","addr":"172.21.15.154:6813","nonce":4028899241}]},"public_addr":"172.21.15.154:6809/4028899241","cluster_addr":"172.21.15.154:6811/4028899241","heartbeat_back_addr":"172.21.15.154:6815/4028899241","heartbeat_front_addr":"172.21.15.154:6813/4028899241","state":["exists","up"]},{"osd":5,"uuid":"d6ab225c-1b55-450a-89a9-abe5c3f8d6af","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":3562396827},{"type":"v1","addr":"172.21.15.154:6801","nonce":3562396827}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":3562396827},{"type":"v1","addr":"172.21.15.154:6803","nonce":3562396827}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6806","nonce":3562396827},{"type":"v1","addr":"172.21.15.154:6807","nonce":3562396827}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6804","nonce":3562396827},{"type":"v1","addr":"172.21.15.154:6805","nonce":3562396827}]},"public_addr":"172.21.15.154:6801/3562396827","cluster_addr":"172.21.15.154:6803/3562396827","heartbeat_back_addr":"172.21.15.154:6807/3562396827","heartbeat_front_addr":"172.21.15.154:6805/3562396827","state":["exists","up"]},{"osd":6,"uuid":"96f905ac-491c-4662-8e2b-5bb8e929ab9d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6816","nonce":2933728751},{"type":"v1","addr":"172.21.15.154:6817","nonce":2933728751}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6818","nonce":2933728751},{"type":"v1","addr":"172.21.15.154:6819","nonce":2933728751}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6822","nonce":2933728751},{"type":"v1","addr":"172.21.15.154:6823","nonce":2933728751}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6820","nonce":2933728751},{"type":"v1","addr":"172.21.15.154:6821","nonce":2933728751}]},"public_addr":"172.21.15.154:6817/2933728751","cluster_addr":"172.21.15.154:6819/2933728751","heartbeat_back_addr":"172.21.15.154:6823/2933728751","heartbeat_front_addr":"172.21.15.154:6821/2933728751","state":["exists","up"]},{"osd":7,"uuid":"07012d3b-3ab4-40df-a471-93caed22e2dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6824","nonce":1753500785},{"type":"v1","addr":"172.21.15.154:6825","nonce":1753500785}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6826","nonce":1753500785},{"type":"v1","addr":"172.21.15.154:6827","nonce":1753500785}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6830","nonce":1753500785},{"type":"v1","addr":"172.21.15.154:6831","nonce":1753500785}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6828","nonce":1753500785},{"type":"v1","addr":"172.21.15.154:6829","nonce":1753500785}]},"public_addr":"172.21.15.154:6825/1753500785","cluster_addr":"172.21.15.154:6827/1753500785","heartbeat_back_addr":"172.21.15.154:6831/1753500785","heartbeat_front_addr":"172.21.15.154:6829/1753500785","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-13T11:28:40.978603+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-13T11:28:41.200985+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-13T11:28:41.222815+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-13T11:28:41.202162+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-13T11:28:40.925911+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-13T11:28:41.087725+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-13T11:28:41.072208+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-13T11:28:40.875257+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-13T11:28:58.687 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:58.683+0000 7fbe0ed2a640 1 -- 172.21.15.102:0/1731894272 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7fbdf4066470 msgr2=0x7fbdf4068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:28:58.688 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:58.683+0000 7fbe0ed2a640 1 --2- 172.21.15.102:0/1731894272 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7fbdf4066470 0x7fbdf4068930 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fbe040ad000 tx=0x7fbe040a6000 comp rx=0 tx=0).stop 2023-11-13T11:28:58.688 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:58.683+0000 7fbe0ed2a640 1 -- 172.21.15.102:0/1731894272 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fbe08071900 msgr2=0x7fbe080cb590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:28:58.688 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:58.683+0000 7fbe0ed2a640 1 --2- 172.21.15.102:0/1731894272 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fbe08071900 0x7fbe080cb590 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fbdf800c4d0 tx=0x7fbdf800c990 comp rx=0 tx=0).stop 2023-11-13T11:28:58.688 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:58.683+0000 7fbe0ed2a640 1 -- 172.21.15.102:0/1731894272 shutdown_connections 2023-11-13T11:28:58.689 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:58.683+0000 7fbe0ed2a640 1 --2- 172.21.15.102:0/1731894272 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbe08140540 0x7fbe080cbad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:28:58.689 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:58.683+0000 7fbe0ed2a640 1 --2- 172.21.15.102:0/1731894272 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7fbdf4066470 0x7fbdf4068930 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:28:58.689 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:58.683+0000 7fbe0ed2a640 1 --2- 172.21.15.102:0/1731894272 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fbe08071900 0x7fbe080cb590 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:28:58.689 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:58.683+0000 7fbe0ed2a640 1 --2- 172.21.15.102:0/1731894272 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fbe0806caa0 0x7fbe0813e370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:28:58.689 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:58.683+0000 7fbe0ed2a640 1 -- 172.21.15.102:0/1731894272 >> 172.21.15.102:0/1731894272 conn(0x7fbe080b0870 msgr2=0x7fbe080711f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-13T11:28:58.689 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:58.683+0000 7fbe0ed2a640 1 -- 172.21.15.102:0/1731894272 shutdown_connections 2023-11-13T11:28:58.690 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:58.683+0000 7fbe0ed2a640 1 -- 172.21.15.102:0/1731894272 wait complete. 2023-11-13T11:28:58.707 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-11-13T11:28:58.848 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:58.843+0000 7fc273817640 1 Processor -- start 2023-11-13T11:28:58.849 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:58.843+0000 7fc273817640 1 -- start start 2023-11-13T11:28:58.850 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:58.843+0000 7fc273817640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fc26c159b30 0x7fc26c06fc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:28:58.850 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:58.843+0000 7fc273817640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc26c0b21f0 con 0x7fc26c0cf2d0 2023-11-13T11:28:58.850 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:58.843+0000 7fc273817640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc26c0b2440 con 0x7fc26c0711c0 2023-11-13T11:28:58.850 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:58.843+0000 7fc273817640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc26c071650 con 0x7fc26c159b30 2023-11-13T11:28:58.850 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:58.843+0000 7fc271db4640 1 --1- >> v1:172.21.15.102:6789/0 conn(0x7fc26c0cf2d0 0x7fc26c0cbe90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.102:6789/0 says I am v1:172.21.15.102:47852/0 (socket says 172.21.15.102:47852) 2023-11-13T11:28:58.851 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:58.843+0000 7fc271db4640 1 -- 172.21.15.102:0/1859208680 learned_addr learned my addr 172.21.15.102:0/1859208680 (peer_addr_for_me v1:172.21.15.102:0/0) 2023-11-13T11:28:58.851 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:58.843+0000 7fc2715b3640 1 --2- 172.21.15.102:0/1859208680 >> v2:172.21.15.154:3300/0 conn(0x7fc26c159b30 0x7fc26c06fc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:28:58.852 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:58.847+0000 7fc263fff640 1 -- 172.21.15.102:0/1859208680 <== mon.0 v1:172.21.15.102:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3939425968 0 0) 0x7fc26c0b21f0 con 0x7fc26c0cf2d0 2023-11-13T11:28:58.852 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:58.847+0000 7fc263fff640 1 -- 172.21.15.102:0/1859208680 --> v1:172.21.15.102:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc258003530 con 0x7fc26c0cf2d0 2023-11-13T11:28:58.852 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:58.847+0000 7fc263fff640 1 -- 172.21.15.102:0/1859208680 <== mon.1 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1477339956 0 0) 0x7fc26c0b2440 con 0x7fc26c0711c0 2023-11-13T11:28:58.852 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:58.847+0000 7fc263fff640 1 -- 172.21.15.102:0/1859208680 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc26c0b21f0 con 0x7fc26c0711c0 2023-11-13T11:28:58.852 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:58.847+0000 7fc263fff640 1 -- 172.21.15.102:0/1859208680 <== mon.0 v1:172.21.15.102:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1770103730 0 0) 0x7fc258003530 con 0x7fc26c0cf2d0 2023-11-13T11:28:58.853 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:58.847+0000 7fc2715b3640 1 -- 172.21.15.102:0/1859208680 >> v1:172.21.15.154:6789/0 conn(0x7fc26c0711c0 legacy=0x7fc26c0cebc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:28:58.853 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:58.847+0000 7fc2715b3640 1 -- 172.21.15.102:0/1859208680 >> v1:172.21.15.102:6789/0 conn(0x7fc26c0cf2d0 legacy=0x7fc26c0cbe90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:28:58.853 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:58.847+0000 7fc2715b3640 1 -- 172.21.15.102:0/1859208680 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc26c0b2720 con 0x7fc26c159b30 2023-11-13T11:28:58.854 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:58.847+0000 7fc2715b3640 1 --2- 172.21.15.102:0/1859208680 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc26c159b30 0x7fc26c06fc80 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fc2680097c0 tx=0x7fc26801c370 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7e643cabd407579c server_cookie=0 in_seq=0 out_seq=0 2023-11-13T11:28:58.855 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:58.847+0000 7fc263fff640 1 -- 172.21.15.102:0/1859208680 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc264001a00 con 0x7fc26c159b30 2023-11-13T11:28:58.855 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:58.847+0000 7fc263fff640 1 -- 172.21.15.102:0/1859208680 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc2680a7050 con 0x7fc26c159b30 2023-11-13T11:28:58.855 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:58.847+0000 7fc263fff640 1 -- 172.21.15.102:0/1859208680 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2680ab600 con 0x7fc26c159b30 2023-11-13T11:28:58.855 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:58.851+0000 7fc273817640 1 -- 172.21.15.102:0/1859208680 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc26c159b30 msgr2=0x7fc26c06fc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:28:58.855 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:58.851+0000 7fc273817640 1 --2- 172.21.15.102:0/1859208680 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc26c159b30 0x7fc26c06fc80 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fc2680097c0 tx=0x7fc26801c370 comp rx=0 tx=0).stop 2023-11-13T11:28:58.856 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:58.851+0000 7fc273817640 1 -- 172.21.15.102:0/1859208680 shutdown_connections 2023-11-13T11:28:58.856 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:58.851+0000 7fc273817640 1 --2- 172.21.15.102:0/1859208680 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc26c159b30 0x7fc26c06fc80 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:28:58.856 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:58.851+0000 7fc273817640 1 -- 172.21.15.102:0/1859208680 >> 172.21.15.102:0/1859208680 conn(0x7fc26c06a410 msgr2=0x7fc26c06a820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-13T11:28:58.856 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:58.851+0000 7fc273817640 1 -- 172.21.15.102:0/1859208680 shutdown_connections 2023-11-13T11:28:58.856 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:58.851+0000 7fc273817640 1 -- 172.21.15.102:0/1859208680 wait complete. 2023-11-13T11:28:58.858 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:58.851+0000 7fc273817640 1 Processor -- start 2023-11-13T11:28:58.858 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:58.851+0000 7fc273817640 1 -- start start 2023-11-13T11:28:58.858 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:58.851+0000 7fc273817640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc26c0711c0 0x7fc26c14eed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:28:58.859 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:58.851+0000 7fc273817640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc26c0cf2d0 0x7fc26c158c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:28:58.859 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:58.851+0000 7fc273817640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc26c159b30 0x7fc26c156bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:28:58.859 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:58.851+0000 7fc273817640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc26c157f50 con 0x7fc26c0cf2d0 2023-11-13T11:28:58.859 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:58.851+0000 7fc273817640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc26c150640 con 0x7fc26c159b30 2023-11-13T11:28:58.859 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:58.851+0000 7fc273817640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc26c157990 con 0x7fc26c0711c0 2023-11-13T11:28:58.860 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:58.851+0000 7fc270db2640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc26c0cf2d0 0x7fc26c158c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:28:58.860 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:58.851+0000 7fc270db2640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc26c0cf2d0 0x7fc26c158c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:36028/0 (socket says 172.21.15.102:36028) 2023-11-13T11:28:58.860 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:58.851+0000 7fc270db2640 1 -- 172.21.15.102:0/264460910 learned_addr learned my addr 172.21.15.102:0/264460910 (peer_addr_for_me v2:172.21.15.102:0/0) 2023-11-13T11:28:58.860 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:58.851+0000 7fc271db4640 1 --2- 172.21.15.102:0/264460910 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc26c159b30 0x7fc26c156bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:28:58.860 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:58.851+0000 7fc2715b3640 1 --2- 172.21.15.102:0/264460910 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc26c0711c0 0x7fc26c14eed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:28:58.861 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:58.851+0000 7fc270db2640 1 -- 172.21.15.102:0/264460910 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc26c0711c0 msgr2=0x7fc26c14eed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:28:58.861 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:58.851+0000 7fc270db2640 1 --2- 172.21.15.102:0/264460910 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc26c0711c0 0x7fc26c14eed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:28:58.861 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:58.851+0000 7fc270db2640 1 -- 172.21.15.102:0/264460910 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc26c159b30 msgr2=0x7fc26c156bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:28:58.861 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:58.851+0000 7fc270db2640 1 --2- 172.21.15.102:0/264460910 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc26c159b30 0x7fc26c156bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:28:58.861 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:58.851+0000 7fc270db2640 1 -- 172.21.15.102:0/264460910 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc268009420 con 0x7fc26c0cf2d0 2023-11-13T11:28:58.861 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:58.855+0000 7fc270db2640 1 --2- 172.21.15.102:0/264460910 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc26c0cf2d0 0x7fc26c158c10 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fc25c00c490 tx=0x7fc25c00c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-13T11:28:58.863 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:58.855+0000 7fc261ffb640 1 -- 172.21.15.102:0/264460910 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc25c0052d0 con 0x7fc26c0cf2d0 2023-11-13T11:28:58.863 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:58.855+0000 7fc261ffb640 1 -- 172.21.15.102:0/264460910 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc25c005430 con 0x7fc26c0cf2d0 2023-11-13T11:28:58.863 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:58.855+0000 7fc273817640 1 -- 172.21.15.102:0/264460910 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc26c157c70 con 0x7fc26c0cf2d0 2023-11-13T11:28:58.863 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:58.855+0000 7fc261ffb640 1 -- 172.21.15.102:0/264460910 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc25c012870 con 0x7fc26c0cf2d0 2023-11-13T11:28:58.864 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:58.855+0000 7fc273817640 1 -- 172.21.15.102:0/264460910 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc26c14f410 con 0x7fc26c0cf2d0 2023-11-13T11:28:58.864 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:58.855+0000 7fc273817640 1 -- 172.21.15.102:0/264460910 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc26c1500c0 con 0x7fc26c0cf2d0 2023-11-13T11:28:58.864 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:58.855+0000 7fc261ffb640 1 -- 172.21.15.102:0/264460910 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fc25c0129d0 con 0x7fc26c0cf2d0 2023-11-13T11:28:58.864 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:58.855+0000 7fc261ffb640 1 --2- 172.21.15.102:0/264460910 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7fc250066470 0x7fc250068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:28:58.864 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:58.855+0000 7fc261ffb640 1 -- 172.21.15.102:0/264460910 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc25c083a70 con 0x7fc26c0cf2d0 2023-11-13T11:28:58.865 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:58.855+0000 7fc2715b3640 1 --2- 172.21.15.102:0/264460910 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7fc250066470 0x7fc250068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:28:58.865 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:58.855+0000 7fc2715b3640 1 --2- 172.21.15.102:0/264460910 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7fc250066470 0x7fc250068930 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fc2680ad000 tx=0x7fc268008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-13T11:28:58.865 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:58.859+0000 7fc261ffb640 1 -- 172.21.15.102:0/264460910 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fc26c1500c0 con 0x7fc26c0cf2d0 2023-11-13T11:28:59.048 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:28:59.043+0000 7fc273817640 1 -- 172.21.15.102:0/264460910 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7fc26c150780 con 0x7fc26c0cf2d0 2023-11-13T11:29:00.041 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:00.035+0000 7fc261ffb640 1 -- 172.21.15.102:0/264460910 <== mon.0 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v7) v1 ==== 118+0+0 (secure 0 0 0) 0x7fc26c150780 con 0x7fc26c0cf2d0 2023-11-13T11:29:00.044 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:00.039+0000 7fc273817640 1 -- 172.21.15.102:0/264460910 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7fc250066470 msgr2=0x7fc250068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:00.044 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:00.039+0000 7fc273817640 1 --2- 172.21.15.102:0/264460910 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7fc250066470 0x7fc250068930 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fc2680ad000 tx=0x7fc268008040 comp rx=0 tx=0).stop 2023-11-13T11:29:00.044 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:00.039+0000 7fc273817640 1 -- 172.21.15.102:0/264460910 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc26c0cf2d0 msgr2=0x7fc26c158c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:00.045 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:00.039+0000 7fc273817640 1 --2- 172.21.15.102:0/264460910 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc26c0cf2d0 0x7fc26c158c10 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fc25c00c490 tx=0x7fc25c00c950 comp rx=0 tx=0).stop 2023-11-13T11:29:00.045 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:00.039+0000 7fc273817640 1 -- 172.21.15.102:0/264460910 shutdown_connections 2023-11-13T11:29:00.045 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:00.039+0000 7fc273817640 1 --2- 172.21.15.102:0/264460910 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc26c159b30 0x7fc26c156bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:00.045 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:00.039+0000 7fc273817640 1 --2- 172.21.15.102:0/264460910 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7fc250066470 0x7fc250068930 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:00.046 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:00.039+0000 7fc273817640 1 --2- 172.21.15.102:0/264460910 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc26c0cf2d0 0x7fc26c158c10 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:00.046 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:00.039+0000 7fc273817640 1 --2- 172.21.15.102:0/264460910 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc26c0711c0 0x7fc26c14eed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:00.046 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:00.039+0000 7fc273817640 1 -- 172.21.15.102:0/264460910 >> 172.21.15.102:0/264460910 conn(0x7fc26c06a410 msgr2=0x7fc26c06c320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-13T11:29:00.046 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:00.039+0000 7fc273817640 1 -- 172.21.15.102:0/264460910 shutdown_connections 2023-11-13T11:29:00.046 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:00.039+0000 7fc273817640 1 -- 172.21.15.102:0/264460910 wait complete. 2023-11-13T11:29:00.066 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-11-13T11:29:00.066 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-11-13T11:29:00.209 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:00.203+0000 7f78cef80640 1 Processor -- start 2023-11-13T11:29:00.209 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:00.203+0000 7f78cef80640 1 -- start start 2023-11-13T11:29:00.211 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:00.203+0000 7f78cef80640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f78c81553c0 0x7f78c80cebc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:00.211 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:00.203+0000 7f78cef80640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f78c806c800 0x7f78c80cf100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:00.211 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:00.207+0000 7f78cef80640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f78c815c150 con 0x7f78c815b3b0 2023-11-13T11:29:00.212 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:00.207+0000 7f78cef80640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f78c806c3e0 con 0x7f78c806c800 2023-11-13T11:29:00.212 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:00.207+0000 7f78cef80640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f78c815bf30 con 0x7f78c81553c0 2023-11-13T11:29:00.212 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:00.207+0000 7f78bffff640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f78c806c800 0x7f78c80cf100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:00.212 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:00.207+0000 7f78bffff640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f78c806c800 0x7f78c80cf100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:36040/0 (socket says 172.21.15.102:36040) 2023-11-13T11:29:00.213 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:00.207+0000 7f78bffff640 1 -- 172.21.15.102:0/2260529582 learned_addr learned my addr 172.21.15.102:0/2260529582 (peer_addr_for_me v2:172.21.15.102:0/0) 2023-11-13T11:29:00.213 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:00.207+0000 7f78bffff640 1 -- 172.21.15.102:0/2260529582 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f78c81553c0 msgr2=0x7f78c80cebc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-13T11:29:00.213 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:00.207+0000 7f78bffff640 1 --2- 172.21.15.102:0/2260529582 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f78c81553c0 0x7f78c80cebc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:00.213 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:00.207+0000 7f78bffff640 1 -- 172.21.15.102:0/2260529582 >> v1:172.21.15.154:6789/0 conn(0x7f78c815b3b0 legacy=0x7f78c815b820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-13T11:29:00.213 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:00.207+0000 7f78bffff640 1 -- 172.21.15.102:0/2260529582 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78c806bd20 con 0x7f78c806c800 2023-11-13T11:29:00.215 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:00.207+0000 7f78bffff640 1 --2- 172.21.15.102:0/2260529582 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f78c806c800 0x7f78c80cf100 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f78b80098a0 tx=0x7f78b801c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6a36f747546e84b7 server_cookie=0 in_seq=0 out_seq=0 2023-11-13T11:29:00.215 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:00.207+0000 7f78bf7fe640 1 -- 172.21.15.102:0/2260529582 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78b80ab600 con 0x7f78c806c800 2023-11-13T11:29:00.215 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:00.207+0000 7f78bf7fe640 1 -- 172.21.15.102:0/2260529582 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f78b80a7050 con 0x7f78c806c800 2023-11-13T11:29:00.215 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:00.207+0000 7f78bf7fe640 1 -- 172.21.15.102:0/2260529582 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78b80ab980 con 0x7f78c806c800 2023-11-13T11:29:00.216 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:00.211+0000 7f78cef80640 1 -- 172.21.15.102:0/2260529582 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f78c806c800 msgr2=0x7f78c80cf100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:00.216 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:00.211+0000 7f78cef80640 1 --2- 172.21.15.102:0/2260529582 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f78c806c800 0x7f78c80cf100 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f78b80098a0 tx=0x7f78b801c450 comp rx=0 tx=0).stop 2023-11-13T11:29:00.216 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:00.211+0000 7f78cef80640 1 -- 172.21.15.102:0/2260529582 shutdown_connections 2023-11-13T11:29:00.216 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:00.211+0000 7f78cef80640 1 --2- 172.21.15.102:0/2260529582 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f78c806c800 0x7f78c80cf100 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:00.216 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:00.211+0000 7f78cef80640 1 --2- 172.21.15.102:0/2260529582 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f78c81553c0 0x7f78c80cebc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:00.217 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:00.211+0000 7f78cef80640 1 -- 172.21.15.102:0/2260529582 >> 172.21.15.102:0/2260529582 conn(0x7f78c806a410 msgr2=0x7f78c806a820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-13T11:29:00.217 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:00.211+0000 7f78cef80640 1 -- 172.21.15.102:0/2260529582 shutdown_connections 2023-11-13T11:29:00.217 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:00.211+0000 7f78cef80640 1 -- 172.21.15.102:0/2260529582 wait complete. 2023-11-13T11:29:00.219 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:00.211+0000 7f78cef80640 1 Processor -- start 2023-11-13T11:29:00.219 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:00.211+0000 7f78cef80640 1 -- start start 2023-11-13T11:29:00.219 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:00.211+0000 7f78cef80640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f78c806c800 0x7f78c815a330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:00.219 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:00.211+0000 7f78cef80640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f78c81553c0 0x7f78c814a790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:00.220 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:00.211+0000 7f78cef80640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f78c815b3b0 0x7f78c8135b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:00.220 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:00.211+0000 7f78cef80640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78c8149cf0 con 0x7f78c806c800 2023-11-13T11:29:00.220 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:00.211+0000 7f78cef80640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78c80af6e0 con 0x7f78c815b3b0 2023-11-13T11:29:00.220 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:00.211+0000 7f78cef80640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f78c8149f90 con 0x7f78c81553c0 2023-11-13T11:29:00.221 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:00.211+0000 7f78ccd1c640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f78c806c800 0x7f78c815a330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:00.221 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:00.211+0000 7f78ccd1c640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f78c806c800 0x7f78c815a330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:36046/0 (socket says 172.21.15.102:36046) 2023-11-13T11:29:00.221 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:00.211+0000 7f78ccd1c640 1 -- 172.21.15.102:0/1823807459 learned_addr learned my addr 172.21.15.102:0/1823807459 (peer_addr_for_me v2:172.21.15.102:0/0) 2023-11-13T11:29:00.221 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:00.211+0000 7f78bffff640 1 --2- 172.21.15.102:0/1823807459 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f78c81553c0 0x7f78c814a790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:00.222 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:00.211+0000 7f78cd51d640 1 --2- 172.21.15.102:0/1823807459 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f78c815b3b0 0x7f78c8135b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:00.222 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:00.211+0000 7f78ccd1c640 1 -- 172.21.15.102:0/1823807459 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f78c81553c0 msgr2=0x7f78c814a790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:00.222 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:00.211+0000 7f78ccd1c640 1 --2- 172.21.15.102:0/1823807459 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f78c81553c0 0x7f78c814a790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:00.223 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:00.211+0000 7f78ccd1c640 1 -- 172.21.15.102:0/1823807459 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f78c815b3b0 msgr2=0x7f78c8135b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:00.223 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:00.211+0000 7f78ccd1c640 1 --2- 172.21.15.102:0/1823807459 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f78c815b3b0 0x7f78c8135b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:00.223 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:00.215+0000 7f78ccd1c640 1 -- 172.21.15.102:0/1823807459 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78b80094d0 con 0x7f78c806c800 2023-11-13T11:29:00.223 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:00.215+0000 7f78ccd1c640 1 --2- 172.21.15.102:0/1823807459 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f78c806c800 0x7f78c815a330 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f78c400b410 tx=0x7f78c400b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-13T11:29:00.224 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:00.215+0000 7f78bd7fa640 1 -- 172.21.15.102:0/1823807459 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78c4011830 con 0x7f78c806c800 2023-11-13T11:29:00.224 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:00.215+0000 7f78bd7fa640 1 -- 172.21.15.102:0/1823807459 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f78c4011990 con 0x7f78c806c800 2023-11-13T11:29:00.224 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:00.215+0000 7f78bd7fa640 1 -- 172.21.15.102:0/1823807459 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78c4011d40 con 0x7f78c806c800 2023-11-13T11:29:00.224 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:00.215+0000 7f78cef80640 1 -- 172.21.15.102:0/1823807459 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f78c814a270 con 0x7f78c806c800 2023-11-13T11:29:00.224 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:00.215+0000 7f78cef80640 1 -- 172.21.15.102:0/1823807459 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f78c80af9c0 con 0x7f78c806c800 2023-11-13T11:29:00.225 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:00.215+0000 7f78cef80640 1 -- 172.21.15.102:0/1823807459 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f78c814a4b0 con 0x7f78c806c800 2023-11-13T11:29:00.226 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:00.215+0000 7f78bd7fa640 1 -- 172.21.15.102:0/1823807459 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f78c401a400 con 0x7f78c806c800 2023-11-13T11:29:00.226 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:00.215+0000 7f78bd7fa640 1 --2- 172.21.15.102:0/1823807459 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f78b4066470 0x7f78b4068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:00.226 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:00.215+0000 7f78bd7fa640 1 -- 172.21.15.102:0/1823807459 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f78c4083f90 con 0x7f78c806c800 2023-11-13T11:29:00.226 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:00.215+0000 7f78bffff640 1 --2- 172.21.15.102:0/1823807459 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f78b4066470 0x7f78b4068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:00.226 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:00.219+0000 7f78bffff640 1 --2- 172.21.15.102:0/1823807459 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f78b4066470 0x7f78b4068930 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f78b80ad000 tx=0x7f78b8008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-13T11:29:00.227 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:00.219+0000 7f78bd7fa640 1 -- 172.21.15.102:0/1823807459 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f78c814a4b0 con 0x7f78c806c800 2023-11-13T11:29:00.406 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:00.399+0000 7f78cef80640 1 -- 172.21.15.102:0/1823807459 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f78c814a4b0 con 0x7f78c806c800 2023-11-13T11:29:01.048 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:01.043+0000 7f78bd7fa640 1 -- 172.21.15.102:0/1823807459 <== mon.0 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v8) v1 ==== 122+0+0 (secure 0 0 0) 0x7f78c814a4b0 con 0x7f78c806c800 2023-11-13T11:29:01.050 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:01.043+0000 7f78cef80640 1 -- 172.21.15.102:0/1823807459 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f78b4066470 msgr2=0x7f78b4068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:01.050 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:01.043+0000 7f78cef80640 1 --2- 172.21.15.102:0/1823807459 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f78b4066470 0x7f78b4068930 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f78b80ad000 tx=0x7f78b8008040 comp rx=0 tx=0).stop 2023-11-13T11:29:01.050 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:01.043+0000 7f78cef80640 1 -- 172.21.15.102:0/1823807459 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f78c806c800 msgr2=0x7f78c815a330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:01.051 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:01.043+0000 7f78cef80640 1 --2- 172.21.15.102:0/1823807459 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f78c806c800 0x7f78c815a330 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f78c400b410 tx=0x7f78c400b8d0 comp rx=0 tx=0).stop 2023-11-13T11:29:01.051 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:01.047+0000 7f78cef80640 1 -- 172.21.15.102:0/1823807459 shutdown_connections 2023-11-13T11:29:01.052 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:01.047+0000 7f78cef80640 1 --2- 172.21.15.102:0/1823807459 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f78c815b3b0 0x7f78c8135b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:01.052 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:01.047+0000 7f78cef80640 1 --2- 172.21.15.102:0/1823807459 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f78c81553c0 0x7f78c814a790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:01.052 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:01.047+0000 7f78cef80640 1 --2- 172.21.15.102:0/1823807459 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f78b4066470 0x7f78b4068930 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:01.052 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:01.047+0000 7f78cef80640 1 --2- 172.21.15.102:0/1823807459 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f78c806c800 0x7f78c815a330 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:01.052 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:01.047+0000 7f78cef80640 1 -- 172.21.15.102:0/1823807459 >> 172.21.15.102:0/1823807459 conn(0x7f78c806a410 msgr2=0x7f78c815dc80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-13T11:29:01.053 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:01.047+0000 7f78cef80640 1 -- 172.21.15.102:0/1823807459 shutdown_connections 2023-11-13T11:29:01.053 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:01.047+0000 7f78cef80640 1 -- 172.21.15.102:0/1823807459 wait complete. 2023-11-13T11:29:01.073 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-11-13T11:29:01.074 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-13T11:29:01.213 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:01.207+0000 7f2b0bc9c640 1 Processor -- start 2023-11-13T11:29:01.214 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:01.207+0000 7f2b0bc9c640 1 -- start start 2023-11-13T11:29:01.215 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:01.211+0000 7f2b0bc9c640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2b0406dc70 0x7f2b0406ba90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:01.215 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:01.211+0000 7f2b0bc9c640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f2b0406bfd0 0x7f2b0413f6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:01.215 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:01.211+0000 7f2b0bc9c640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2b0413e530 con 0x7f2b0413df40 2023-11-13T11:29:01.215 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:01.211+0000 7f2b0bc9c640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2b0415f0a0 con 0x7f2b0406bfd0 2023-11-13T11:29:01.216 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:01.211+0000 7f2b0bc9c640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2b0406c460 con 0x7f2b0406dc70 2023-11-13T11:29:01.216 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:01.211+0000 7f2b09a38640 1 --1- >> v1:172.21.15.102:6789/0 conn(0x7f2b0413df40 0x7f2b0415e990 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.102:6789/0 says I am v1:172.21.15.102:47868/0 (socket says 172.21.15.102:47868) 2023-11-13T11:29:01.216 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:01.211+0000 7f2b09a38640 1 -- 172.21.15.102:0/1220959180 learned_addr learned my addr 172.21.15.102:0/1220959180 (peer_addr_for_me v1:172.21.15.102:0/0) 2023-11-13T11:29:01.218 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:01.211+0000 7f2b0a239640 1 --2- 172.21.15.102:0/1220959180 >> v2:172.21.15.154:3300/0 conn(0x7f2b0406bfd0 0x7f2b0413f6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:01.218 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:01.211+0000 7f2b09237640 1 --2- 172.21.15.102:0/1220959180 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2b0406dc70 0x7f2b0406ba90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:01.219 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:01.211+0000 7f2b08a36640 1 -- 172.21.15.102:0/1220959180 <== mon.0 v1:172.21.15.102:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2928200581 0 0) 0x7f2b0413e530 con 0x7f2b0413df40 2023-11-13T11:29:01.219 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:01.211+0000 7f2b08a36640 1 -- 172.21.15.102:0/1220959180 --> v1:172.21.15.102:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2af0003530 con 0x7f2b0413df40 2023-11-13T11:29:01.219 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:01.211+0000 7f2b08a36640 1 -- 172.21.15.102:0/1220959180 <== mon.0 v1:172.21.15.102:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4069817466 0 0) 0x7f2af0003530 con 0x7f2b0413df40 2023-11-13T11:29:01.219 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:01.211+0000 7f2b08a36640 1 -- 172.21.15.102:0/1220959180 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2b0406dc70 msgr2=0x7f2b0406ba90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-13T11:29:01.220 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:01.211+0000 7f2b08a36640 1 --2- 172.21.15.102:0/1220959180 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2b0406dc70 0x7f2b0406ba90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:01.220 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:01.211+0000 7f2b08a36640 1 -- 172.21.15.102:0/1220959180 >> v2:172.21.15.154:3300/0 conn(0x7f2b0406bfd0 msgr2=0x7f2b0413f6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-13T11:29:01.220 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:01.211+0000 7f2b08a36640 1 --2- 172.21.15.102:0/1220959180 >> v2:172.21.15.154:3300/0 conn(0x7f2b0406bfd0 0x7f2b0413f6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:01.220 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:01.211+0000 7f2b08a36640 1 -- 172.21.15.102:0/1220959180 --> v1:172.21.15.102:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b0415f290 con 0x7f2b0413df40 2023-11-13T11:29:01.220 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:01.211+0000 7f2b08a36640 1 -- 172.21.15.102:0/1220959180 <== mon.0 v1:172.21.15.102:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 895381068 0 0) 0x7f2b00001680 con 0x7f2b0413df40 2023-11-13T11:29:01.221 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:01.211+0000 7f2b08a36640 1 -- 172.21.15.102:0/1220959180 >> v1:172.21.15.102:6789/0 conn(0x7f2b0413df40 legacy=0x7f2b0415e990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:01.221 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:01.211+0000 7f2b08a36640 1 --2- 172.21.15.102:0/1220959180 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2af0003980 0x7f2af0003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:01.221 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:01.211+0000 7f2b08a36640 1 --2- 172.21.15.102:0/1220959180 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2b0406dc70 0x7f2af00047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:01.221 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:01.211+0000 7f2b08a36640 1 --2- 172.21.15.102:0/1220959180 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2af0004d10 0x7f2af0005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:01.222 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:01.211+0000 7f2b08a36640 1 -- 172.21.15.102:0/1220959180 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b0406c460 con 0x7f2af0003980 2023-11-13T11:29:01.222 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:01.211+0000 7f2b08a36640 1 -- 172.21.15.102:0/1220959180 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2af000b990 con 0x7f2af0004d10 2023-11-13T11:29:01.222 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:01.211+0000 7f2b08a36640 1 -- 172.21.15.102:0/1220959180 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2af000bad0 con 0x7f2b0406dc70 2023-11-13T11:29:01.222 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:01.211+0000 7f2b09a38640 1 --2- 172.21.15.102:0/1220959180 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2af0003980 0x7f2af0003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:01.222 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:01.211+0000 7f2b0a239640 1 --2- 172.21.15.102:0/1220959180 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2af0004d10 0x7f2af0005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:01.223 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:01.211+0000 7f2b09237640 1 --2- 172.21.15.102:0/1220959180 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2b0406dc70 0x7f2af00047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:01.223 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:01.211+0000 7f2b09a38640 1 -- 172.21.15.102:0/1220959180 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2b0406dc70 msgr2=0x7f2af00047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-13T11:29:01.223 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:01.211+0000 7f2b09a38640 1 --2- 172.21.15.102:0/1220959180 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2b0406dc70 0x7f2af00047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:01.223 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:01.211+0000 7f2b09a38640 1 -- 172.21.15.102:0/1220959180 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2af0004d10 msgr2=0x7f2af0005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-13T11:29:01.223 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:01.211+0000 7f2b09a38640 1 --2- 172.21.15.102:0/1220959180 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2af0004d10 0x7f2af0005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:01.224 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:01.211+0000 7f2b09a38640 1 -- 172.21.15.102:0/1220959180 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2af0003530 con 0x7f2af0003980 2023-11-13T11:29:01.228 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:01.215+0000 7f2b09a38640 1 --2- 172.21.15.102:0/1220959180 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2af0003980 0x7f2af0003da0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f2b0000c240 tx=0x7f2b0001cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e96c2303cf30ab14 server_cookie=0 in_seq=0 out_seq=0 2023-11-13T11:29:01.228 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:01.215+0000 7f2b08a36640 1 -- 172.21.15.102:0/1220959180 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b000058e0 con 0x7f2af0003980 2023-11-13T11:29:01.228 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:01.215+0000 7f2b08a36640 1 -- 172.21.15.102:0/1220959180 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b00005a40 con 0x7f2af0003980 2023-11-13T11:29:01.229 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:01.215+0000 7f2b08a36640 1 -- 172.21.15.102:0/1220959180 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b00005e10 con 0x7f2af0003980 2023-11-13T11:29:01.229 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:01.215+0000 7f2b0bc9c640 1 -- 172.21.15.102:0/1220959180 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2af0003980 msgr2=0x7f2af0003da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:01.229 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:01.215+0000 7f2b0bc9c640 1 --2- 172.21.15.102:0/1220959180 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2af0003980 0x7f2af0003da0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f2b0000c240 tx=0x7f2b0001cc60 comp rx=0 tx=0).stop 2023-11-13T11:29:01.229 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:01.215+0000 7f2b0a239640 1 -- 172.21.15.102:0/1220959180 reap_dead start 2023-11-13T11:29:01.230 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:01.215+0000 7f2b0bc9c640 1 -- 172.21.15.102:0/1220959180 shutdown_connections 2023-11-13T11:29:01.230 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:01.215+0000 7f2b0bc9c640 1 -- 172.21.15.102:0/1220959180 >> 172.21.15.102:0/1220959180 conn(0x7f2b040b0870 msgr2=0x7f2b040b0c80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-13T11:29:01.230 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:01.215+0000 7f2b0bc9c640 1 -- 172.21.15.102:0/1220959180 shutdown_connections 2023-11-13T11:29:01.230 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:01.215+0000 7f2b0bc9c640 1 -- 172.21.15.102:0/1220959180 wait complete. 2023-11-13T11:29:01.231 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:01.215+0000 7f2b0bc9c640 1 Processor -- start 2023-11-13T11:29:01.231 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:01.215+0000 7f2b0bc9c640 1 -- start start 2023-11-13T11:29:01.231 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:01.219+0000 7f2b0bc9c640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2af0003980 0x7f2b040caf10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:01.231 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:01.219+0000 7f2b0bc9c640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2b04138b80 0x7f2b040acb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:01.231 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:01.219+0000 7f2b0bc9c640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2b0413ae60 0x7f2b0413b2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:01.232 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:01.219+0000 7f2b0bc9c640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b04139420 con 0x7f2af0003980 2023-11-13T11:29:01.232 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:01.219+0000 7f2b0bc9c640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b040b2240 con 0x7f2b0413ae60 2023-11-13T11:29:01.232 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:01.219+0000 7f2b0bc9c640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2b04157010 con 0x7f2b04138b80 2023-11-13T11:29:01.232 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:01.219+0000 7f2b09a38640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2af0003980 0x7f2b040caf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:01.233 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:01.219+0000 7f2b09a38640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2af0003980 0x7f2b040caf10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:36066/0 (socket says 172.21.15.102:36066) 2023-11-13T11:29:01.233 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:01.219+0000 7f2b09a38640 1 -- 172.21.15.102:0/3893080683 learned_addr learned my addr 172.21.15.102:0/3893080683 (peer_addr_for_me v2:172.21.15.102:0/0) 2023-11-13T11:29:01.233 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:01.219+0000 7f2b09237640 1 --2- 172.21.15.102:0/3893080683 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2b04138b80 0x7f2b040acb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:01.233 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:01.219+0000 7f2b0a239640 1 --2- 172.21.15.102:0/3893080683 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2b0413ae60 0x7f2b0413b2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:01.234 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:01.219+0000 7f2b09a38640 1 -- 172.21.15.102:0/3893080683 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2b04138b80 msgr2=0x7f2b040acb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:01.234 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:01.219+0000 7f2b09a38640 1 --2- 172.21.15.102:0/3893080683 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2b04138b80 0x7f2b040acb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:01.234 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:01.219+0000 7f2b09a38640 1 -- 172.21.15.102:0/3893080683 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2b0413ae60 msgr2=0x7f2b0413b2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:01.234 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:01.219+0000 7f2b09a38640 1 --2- 172.21.15.102:0/3893080683 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2b0413ae60 0x7f2b0413b2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:01.235 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:01.219+0000 7f2b09a38640 1 -- 172.21.15.102:0/3893080683 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b041572f0 con 0x7f2af0003980 2023-11-13T11:29:01.235 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:01.219+0000 7f2b09237640 1 --2- 172.21.15.102:0/3893080683 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2b04138b80 0x7f2b040acb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-13T11:29:01.235 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:01.219+0000 7f2b0a239640 1 --2- 172.21.15.102:0/3893080683 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2b0413ae60 0x7f2b0413b2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-13T11:29:01.235 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:01.219+0000 7f2b09a38640 1 --2- 172.21.15.102:0/3893080683 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2af0003980 0x7f2b040caf10 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f2b0000c240 tx=0x7f2af0005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-13T11:29:01.236 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:01.219+0000 7f2afa7fc640 1 -- 172.21.15.102:0/3893080683 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b000047f0 con 0x7f2af0003980 2023-11-13T11:29:01.236 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:01.219+0000 7f2afa7fc640 1 -- 172.21.15.102:0/3893080683 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b00004950 con 0x7f2af0003980 2023-11-13T11:29:01.236 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:01.219+0000 7f2afa7fc640 1 -- 172.21.15.102:0/3893080683 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b00004cc0 con 0x7f2af0003980 2023-11-13T11:29:01.236 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:01.219+0000 7f2b0bc9c640 1 -- 172.21.15.102:0/3893080683 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2b041575d0 con 0x7f2af0003980 2023-11-13T11:29:01.236 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:01.219+0000 7f2b0bc9c640 1 -- 172.21.15.102:0/3893080683 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2b040ad040 con 0x7f2af0003980 2023-11-13T11:29:01.237 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:01.219+0000 7f2b0bc9c640 1 -- 172.21.15.102:0/3893080683 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2b04068520 con 0x7f2af0003980 2023-11-13T11:29:01.237 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:01.219+0000 7f2afa7fc640 1 -- 172.21.15.102:0/3893080683 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f2b00007070 con 0x7f2af0003980 2023-11-13T11:29:01.237 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:01.223+0000 7f2afa7fc640 1 --2- 172.21.15.102:0/3893080683 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f2ae8066470 0x7f2ae8068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:01.237 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:01.223+0000 7f2afa7fc640 1 -- 172.21.15.102:0/3893080683 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f2b0011d140 con 0x7f2af0003980 2023-11-13T11:29:01.238 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:01.223+0000 7f2b09237640 1 --2- 172.21.15.102:0/3893080683 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f2ae8066470 0x7f2ae8068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:01.238 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:01.223+0000 7f2b09237640 1 --2- 172.21.15.102:0/3893080683 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f2ae8066470 0x7f2ae8068930 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f2b040ad3f0 tx=0x7f2af4008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-13T11:29:01.238 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:01.227+0000 7f2afa7fc640 1 -- 172.21.15.102:0/3893080683 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f2b000ea520 con 0x7f2af0003980 2023-11-13T11:29:01.412 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:01.407+0000 7f2b0bc9c640 1 -- 172.21.15.102:0/3893080683 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f2b0413ee70 con 0x7f2af0003980 2023-11-13T11:29:01.413 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:01.407+0000 7f2afa7fc640 1 -- 172.21.15.102:0/3893080683 <== mon.0 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4913 (secure 0 0 0) 0x7f2b000edb40 con 0x7f2af0003980 2023-11-13T11:29:01.413 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T11:29:01.414 INFO:teuthology.orchestra.run.smithi102.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4226,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.102:6836/659983176","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6835","nonce":659983176},{"type":"v1","addr":"172.21.15.102:6836","nonce":659983176}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4270,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.102:6837/1874856825","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6834","nonce":1874856825},{"type":"v1","addr":"172.21.15.102:6837","nonce":1874856825}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4276,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6834/532911681","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6832","nonce":532911681},{"type":"v1","addr":"172.21.15.154:6834","nonce":532911681}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-13T11:28:57.401001+0000","modified":"2023-11-13T11:29:00.404631+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4279},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4279":{"gid":4279,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.154:6835/3766337294","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6833","nonce":3766337294},{"type":"v1","addr":"172.21.15.154:6835","nonce":3766337294}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-11-13T11:29:01.415 INFO:teuthology.orchestra.run.smithi102.stderr:dumped fsmap epoch 8 2023-11-13T11:29:01.416 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:01.407+0000 7f2b0bc9c640 1 -- 172.21.15.102:0/3893080683 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f2ae8066470 msgr2=0x7f2ae8068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:01.416 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:01.407+0000 7f2b0bc9c640 1 --2- 172.21.15.102:0/3893080683 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f2ae8066470 0x7f2ae8068930 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f2b040ad3f0 tx=0x7f2af4008040 comp rx=0 tx=0).stop 2023-11-13T11:29:01.416 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:01.407+0000 7f2b0bc9c640 1 -- 172.21.15.102:0/3893080683 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2af0003980 msgr2=0x7f2b040caf10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:01.417 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:01.407+0000 7f2b0bc9c640 1 --2- 172.21.15.102:0/3893080683 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2af0003980 0x7f2b040caf10 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f2b0000c240 tx=0x7f2af0005800 comp rx=0 tx=0).stop 2023-11-13T11:29:01.417 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:01.407+0000 7f2b0bc9c640 1 -- 172.21.15.102:0/3893080683 shutdown_connections 2023-11-13T11:29:01.417 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:01.407+0000 7f2b0bc9c640 1 --2- 172.21.15.102:0/3893080683 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2b0413ae60 0x7f2b0413b2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:01.417 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:01.407+0000 7f2b0bc9c640 1 --2- 172.21.15.102:0/3893080683 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2b04138b80 0x7f2b040acb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:01.418 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:01.407+0000 7f2b0bc9c640 1 --2- 172.21.15.102:0/3893080683 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f2ae8066470 0x7f2ae8068930 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:01.418 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:01.407+0000 7f2b0bc9c640 1 --2- 172.21.15.102:0/3893080683 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2af0003980 0x7f2b040caf10 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:01.418 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:01.407+0000 7f2b0bc9c640 1 -- 172.21.15.102:0/3893080683 >> 172.21.15.102:0/3893080683 conn(0x7f2b040b0870 msgr2=0x7f2b040adac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-13T11:29:01.419 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:01.407+0000 7f2b0bc9c640 1 -- 172.21.15.102:0/3893080683 shutdown_connections 2023-11-13T11:29:01.419 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:01.407+0000 7f2b0bc9c640 1 -- 172.21.15.102:0/3893080683 wait complete. 2023-11-13T11:29:01.434 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-13T11:29:01.571 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:01.567+0000 7f6596f1e640 1 Processor -- start 2023-11-13T11:29:01.572 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:01.567+0000 7f6596f1e640 1 -- start start 2023-11-13T11:29:01.573 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:01.567+0000 7f6596f1e640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f65900d0940 0x7f65900d1270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:01.573 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:01.567+0000 7f6596f1e640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f65900d17b0 0x7f65900b2860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:01.574 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:01.567+0000 7f6596f1e640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f65900cfa50 con 0x7f659015ce00 2023-11-13T11:29:01.574 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:01.567+0000 7f6596f1e640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f65900d1c60 con 0x7f65900d17b0 2023-11-13T11:29:01.574 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:01.567+0000 7f6596f1e640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f65900cfcb0 con 0x7f65900d0940 2023-11-13T11:29:01.574 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:01.567+0000 7f659671d640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f65900d17b0 0x7f65900b2860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:01.574 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:01.567+0000 7f659671d640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f65900d17b0 0x7f65900b2860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:36072/0 (socket says 172.21.15.102:36072) 2023-11-13T11:29:01.575 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:01.567+0000 7f659671d640 1 -- 172.21.15.102:0/153184743 learned_addr learned my addr 172.21.15.102:0/153184743 (peer_addr_for_me v2:172.21.15.102:0/0) 2023-11-13T11:29:01.575 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:01.567+0000 7f659571b640 1 --2- 172.21.15.102:0/153184743 >> v2:172.21.15.154:3300/0 conn(0x7f65900d0940 0x7f65900d1270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:01.575 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:01.567+0000 7f659671d640 1 -- 172.21.15.102:0/153184743 >> v2:172.21.15.154:3300/0 conn(0x7f65900d0940 msgr2=0x7f65900d1270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-13T11:29:01.575 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:01.567+0000 7f659671d640 1 --2- 172.21.15.102:0/153184743 >> v2:172.21.15.154:3300/0 conn(0x7f65900d0940 0x7f65900d1270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:01.575 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:01.567+0000 7f659671d640 1 -- 172.21.15.102:0/153184743 >> v1:172.21.15.154:6789/0 conn(0x7f659015ce00 legacy=0x7f65900cf340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:01.575 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:01.567+0000 7f659671d640 1 -- 172.21.15.102:0/153184743 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65900cff90 con 0x7f65900d17b0 2023-11-13T11:29:01.577 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:01.571+0000 7f659671d640 1 --2- 172.21.15.102:0/153184743 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f65900d17b0 0x7f65900b2860 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f659009c620 tx=0x7f658801c9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b8eb557ae0c7716d server_cookie=0 in_seq=0 out_seq=0 2023-11-13T11:29:01.577 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:01.571+0000 7f6594f1a640 1 -- 172.21.15.102:0/153184743 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65880a5860 con 0x7f65900d17b0 2023-11-13T11:29:01.577 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:01.571+0000 7f6594f1a640 1 -- 172.21.15.102:0/153184743 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f65880a59c0 con 0x7f65900d17b0 2023-11-13T11:29:01.577 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:01.571+0000 7f6594f1a640 1 -- 172.21.15.102:0/153184743 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65880a5d50 con 0x7f65900d17b0 2023-11-13T11:29:01.578 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:01.571+0000 7f6596f1e640 1 -- 172.21.15.102:0/153184743 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f65900d17b0 msgr2=0x7f65900b2860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:01.578 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:01.571+0000 7f6596f1e640 1 --2- 172.21.15.102:0/153184743 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f65900d17b0 0x7f65900b2860 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f659009c620 tx=0x7f658801c9a0 comp rx=0 tx=0).stop 2023-11-13T11:29:01.578 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:01.571+0000 7f6596f1e640 1 -- 172.21.15.102:0/153184743 shutdown_connections 2023-11-13T11:29:01.578 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:01.571+0000 7f6596f1e640 1 --2- 172.21.15.102:0/153184743 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f65900d17b0 0x7f65900b2860 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:01.578 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:01.571+0000 7f6596f1e640 1 --2- 172.21.15.102:0/153184743 >> v2:172.21.15.154:3300/0 conn(0x7f65900d0940 0x7f65900d1270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:01.579 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:01.571+0000 7f6596f1e640 1 -- 172.21.15.102:0/153184743 >> 172.21.15.102:0/153184743 conn(0x7f659009bf60 msgr2=0x7f65900d2c90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-13T11:29:01.579 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:01.571+0000 7f6596f1e640 1 -- 172.21.15.102:0/153184743 shutdown_connections 2023-11-13T11:29:01.579 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:01.571+0000 7f6596f1e640 1 -- 172.21.15.102:0/153184743 wait complete. 2023-11-13T11:29:01.581 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:01.571+0000 7f6596f1e640 1 Processor -- start 2023-11-13T11:29:01.581 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:01.575+0000 7f6596f1e640 1 -- start start 2023-11-13T11:29:01.581 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:01.575+0000 7f6596f1e640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f65900d0940 0x7f65900ca110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:01.581 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:01.575+0000 7f6596f1e640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f65900d17b0 0x7f65900ca790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:01.582 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:01.575+0000 7f6596f1e640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f659015ce00 0x7f65900cc580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:01.582 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:01.575+0000 7f6596f1e640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65901602e0 con 0x7f65900d17b0 2023-11-13T11:29:01.582 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:01.575+0000 7f6596f1e640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6590156b40 con 0x7f659015ce00 2023-11-13T11:29:01.582 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:01.575+0000 7f6596f1e640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f659015d490 con 0x7f65900d0940 2023-11-13T11:29:01.582 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:01.575+0000 7f659571b640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f65900d17b0 0x7f65900ca790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:01.583 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:01.575+0000 7f659571b640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f65900d17b0 0x7f65900ca790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:36088/0 (socket says 172.21.15.102:36088) 2023-11-13T11:29:01.583 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:01.575+0000 7f659571b640 1 -- 172.21.15.102:0/669696546 learned_addr learned my addr 172.21.15.102:0/669696546 (peer_addr_for_me v2:172.21.15.102:0/0) 2023-11-13T11:29:01.583 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:01.575+0000 7f659671d640 1 --2- 172.21.15.102:0/669696546 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f659015ce00 0x7f65900cc580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:01.583 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:01.575+0000 7f6595f1c640 1 --2- 172.21.15.102:0/669696546 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f65900d0940 0x7f65900ca110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:01.583 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:01.575+0000 7f659571b640 1 -- 172.21.15.102:0/669696546 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f65900d0940 msgr2=0x7f65900ca110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:01.584 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:01.575+0000 7f659571b640 1 --2- 172.21.15.102:0/669696546 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f65900d0940 0x7f65900ca110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:01.584 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:01.575+0000 7f659571b640 1 -- 172.21.15.102:0/669696546 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f659015ce00 msgr2=0x7f65900cc580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:01.584 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:01.575+0000 7f659571b640 1 --2- 172.21.15.102:0/669696546 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f659015ce00 0x7f65900cc580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:01.584 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:01.575+0000 7f659571b640 1 -- 172.21.15.102:0/669696546 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6588009b30 con 0x7f65900d17b0 2023-11-13T11:29:01.584 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:01.575+0000 7f6595f1c640 1 --2- 172.21.15.102:0/669696546 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f65900d0940 0x7f65900ca110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-13T11:29:01.585 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:01.575+0000 7f659571b640 1 --2- 172.21.15.102:0/669696546 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f65900d17b0 0x7f65900ca790 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f658000e9e0 tx=0x7f658000eea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-13T11:29:01.585 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:01.575+0000 7f65867fc640 1 -- 172.21.15.102:0/669696546 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65800096b0 con 0x7f65900d17b0 2023-11-13T11:29:01.585 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:01.575+0000 7f65867fc640 1 -- 172.21.15.102:0/669696546 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f658000c9d0 con 0x7f65900d17b0 2023-11-13T11:29:01.585 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:01.575+0000 7f65867fc640 1 -- 172.21.15.102:0/669696546 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f658000cd60 con 0x7f65900d17b0 2023-11-13T11:29:01.585 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:01.575+0000 7f6596f1e640 1 -- 172.21.15.102:0/669696546 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f659015d770 con 0x7f65900d17b0 2023-11-13T11:29:01.586 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:01.575+0000 7f6596f1e640 1 -- 172.21.15.102:0/669696546 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f65900ccac0 con 0x7f65900d17b0 2023-11-13T11:29:01.586 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:01.575+0000 7f6596f1e640 1 -- 172.21.15.102:0/669696546 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6590067680 con 0x7f65900d17b0 2023-11-13T11:29:01.587 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:01.579+0000 7f65867fc640 1 -- 172.21.15.102:0/669696546 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f6580013470 con 0x7f65900d17b0 2023-11-13T11:29:01.587 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:01.579+0000 7f65867fc640 1 --2- 172.21.15.102:0/669696546 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f6574066470 0x7f6574068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:01.588 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:01.579+0000 7f65867fc640 1 -- 172.21.15.102:0/669696546 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f65800840f0 con 0x7f65900d17b0 2023-11-13T11:29:01.588 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:01.579+0000 7f6595f1c640 1 --2- 172.21.15.102:0/669696546 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f6574066470 0x7f6574068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:01.588 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:01.579+0000 7f6595f1c640 1 --2- 172.21.15.102:0/669696546 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f6574066470 0x7f6574068930 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f658c000f70 tx=0x7f658c009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-13T11:29:01.589 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:01.583+0000 7f65867fc640 1 -- 172.21.15.102:0/669696546 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f6580051600 con 0x7f65900d17b0 2023-11-13T11:29:01.738 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:01.731+0000 7f6596f1e640 1 -- 172.21.15.102:0/669696546 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f65900b8b20 con 0x7f65900d17b0 2023-11-13T11:29:01.739 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:01.735+0000 7f65867fc640 1 -- 172.21.15.102:0/669696546 <== mon.0 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+16545 (secure 0 0 0) 0x7f6580054c20 con 0x7f65900d17b0 2023-11-13T11:29:01.740 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T11:29:01.740 INFO:teuthology.orchestra.run.smithi102.stdout:{"epoch":22,"fsid":"97b3eb2b-7ccf-4aae-8d92-bff986c671ea","created":"2023-11-13T11:28:31.836724+0000","modified":"2023-11-13T11:28:58.608314+0000","last_up_change":"2023-11-13T11:28:44.876638+0000","last_in_change":"2023-11-13T11:28:35.312740+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-13T11:28:44.981356+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-13T11:28:55.958525+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-13T11:28:56.394264+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"bdefaa17-fcca-4c86-aa40-27dc33a789af","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6800","nonce":53303834},{"type":"v1","addr":"172.21.15.102:6801","nonce":53303834}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6802","nonce":53303834},{"type":"v1","addr":"172.21.15.102:6803","nonce":53303834}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6806","nonce":53303834},{"type":"v1","addr":"172.21.15.102:6807","nonce":53303834}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6804","nonce":53303834},{"type":"v1","addr":"172.21.15.102:6805","nonce":53303834}]},"public_addr":"172.21.15.102:6801/53303834","cluster_addr":"172.21.15.102:6803/53303834","heartbeat_back_addr":"172.21.15.102:6807/53303834","heartbeat_front_addr":"172.21.15.102:6805/53303834","state":["exists","up"]},{"osd":1,"uuid":"f0033196-dec9-4ae9-945e-6aeef6dbb47f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6808","nonce":1732708348},{"type":"v1","addr":"172.21.15.102:6809","nonce":1732708348}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6811","nonce":1732708348},{"type":"v1","addr":"172.21.15.102:6813","nonce":1732708348}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6818","nonce":1732708348},{"type":"v1","addr":"172.21.15.102:6820","nonce":1732708348}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6815","nonce":1732708348},{"type":"v1","addr":"172.21.15.102:6817","nonce":1732708348}]},"public_addr":"172.21.15.102:6809/1732708348","cluster_addr":"172.21.15.102:6813/1732708348","heartbeat_back_addr":"172.21.15.102:6820/1732708348","heartbeat_front_addr":"172.21.15.102:6817/1732708348","state":["exists","up"]},{"osd":2,"uuid":"496b0834-351e-4ec2-a714-86ed0c0ff4fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6810","nonce":1825475150},{"type":"v1","addr":"172.21.15.102:6812","nonce":1825475150}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6814","nonce":1825475150},{"type":"v1","addr":"172.21.15.102:6816","nonce":1825475150}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6822","nonce":1825475150},{"type":"v1","addr":"172.21.15.102:6823","nonce":1825475150}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6819","nonce":1825475150},{"type":"v1","addr":"172.21.15.102:6821","nonce":1825475150}]},"public_addr":"172.21.15.102:6812/1825475150","cluster_addr":"172.21.15.102:6816/1825475150","heartbeat_back_addr":"172.21.15.102:6823/1825475150","heartbeat_front_addr":"172.21.15.102:6821/1825475150","state":["exists","up"]},{"osd":3,"uuid":"3ba6cc41-e0a0-4273-86cb-90000c06a55a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6824","nonce":4149355528},{"type":"v1","addr":"172.21.15.102:6825","nonce":4149355528}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6826","nonce":4149355528},{"type":"v1","addr":"172.21.15.102:6827","nonce":4149355528}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6830","nonce":4149355528},{"type":"v1","addr":"172.21.15.102:6831","nonce":4149355528}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6828","nonce":4149355528},{"type":"v1","addr":"172.21.15.102:6829","nonce":4149355528}]},"public_addr":"172.21.15.102:6825/4149355528","cluster_addr":"172.21.15.102:6827/4149355528","heartbeat_back_addr":"172.21.15.102:6831/4149355528","heartbeat_front_addr":"172.21.15.102:6829/4149355528","state":["exists","up"]},{"osd":4,"uuid":"16e797d8-e6e7-4140-95c3-b85283c42a2a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6808","nonce":4028899241},{"type":"v1","addr":"172.21.15.154:6809","nonce":4028899241}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6810","nonce":4028899241},{"type":"v1","addr":"172.21.15.154:6811","nonce":4028899241}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6814","nonce":4028899241},{"type":"v1","addr":"172.21.15.154:6815","nonce":4028899241}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6812","nonce":4028899241},{"type":"v1","addr":"172.21.15.154:6813","nonce":4028899241}]},"public_addr":"172.21.15.154:6809/4028899241","cluster_addr":"172.21.15.154:6811/4028899241","heartbeat_back_addr":"172.21.15.154:6815/4028899241","heartbeat_front_addr":"172.21.15.154:6813/4028899241","state":["exists","up"]},{"osd":5,"uuid":"d6ab225c-1b55-450a-89a9-abe5c3f8d6af","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":3562396827},{"type":"v1","addr":"172.21.15.154:6801","nonce":3562396827}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":3562396827},{"type":"v1","addr":"172.21.15.154:6803","nonce":3562396827}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6806","nonce":3562396827},{"type":"v1","addr":"172.21.15.154:6807","nonce":3562396827}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6804","nonce":3562396827},{"type":"v1","addr":"172.21.15.154:6805","nonce":3562396827}]},"public_addr":"172.21.15.154:6801/3562396827","cluster_addr":"172.21.15.154:6803/3562396827","heartbeat_back_addr":"172.21.15.154:6807/3562396827","heartbeat_front_addr":"172.21.15.154:6805/3562396827","state":["exists","up"]},{"osd":6,"uuid":"96f905ac-491c-4662-8e2b-5bb8e929ab9d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6816","nonce":2933728751},{"type":"v1","addr":"172.21.15.154:6817","nonce":2933728751}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6818","nonce":2933728751},{"type":"v1","addr":"172.21.15.154:6819","nonce":2933728751}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6822","nonce":2933728751},{"type":"v1","addr":"172.21.15.154:6823","nonce":2933728751}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6820","nonce":2933728751},{"type":"v1","addr":"172.21.15.154:6821","nonce":2933728751}]},"public_addr":"172.21.15.154:6817/2933728751","cluster_addr":"172.21.15.154:6819/2933728751","heartbeat_back_addr":"172.21.15.154:6823/2933728751","heartbeat_front_addr":"172.21.15.154:6821/2933728751","state":["exists","up"]},{"osd":7,"uuid":"07012d3b-3ab4-40df-a471-93caed22e2dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6824","nonce":1753500785},{"type":"v1","addr":"172.21.15.154:6825","nonce":1753500785}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6826","nonce":1753500785},{"type":"v1","addr":"172.21.15.154:6827","nonce":1753500785}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6830","nonce":1753500785},{"type":"v1","addr":"172.21.15.154:6831","nonce":1753500785}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6828","nonce":1753500785},{"type":"v1","addr":"172.21.15.154:6829","nonce":1753500785}]},"public_addr":"172.21.15.154:6825/1753500785","cluster_addr":"172.21.15.154:6827/1753500785","heartbeat_back_addr":"172.21.15.154:6831/1753500785","heartbeat_front_addr":"172.21.15.154:6829/1753500785","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-13T11:28:40.978603+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-13T11:28:41.200985+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-13T11:28:41.222815+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-13T11:28:41.202162+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-13T11:28:40.925911+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-13T11:28:41.087725+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-13T11:28:41.072208+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-13T11:28:40.875257+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-13T11:29:01.741 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:01.735+0000 7f6596f1e640 1 -- 172.21.15.102:0/669696546 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f6574066470 msgr2=0x7f6574068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:01.742 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:01.735+0000 7f6596f1e640 1 --2- 172.21.15.102:0/669696546 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f6574066470 0x7f6574068930 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f658c000f70 tx=0x7f658c009040 comp rx=0 tx=0).stop 2023-11-13T11:29:01.742 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:01.735+0000 7f6596f1e640 1 -- 172.21.15.102:0/669696546 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f65900d17b0 msgr2=0x7f65900ca790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:01.742 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:01.735+0000 7f6596f1e640 1 --2- 172.21.15.102:0/669696546 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f65900d17b0 0x7f65900ca790 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f658000e9e0 tx=0x7f658000eea0 comp rx=0 tx=0).stop 2023-11-13T11:29:01.742 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:01.735+0000 7f6596f1e640 1 -- 172.21.15.102:0/669696546 shutdown_connections 2023-11-13T11:29:01.743 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:01.735+0000 7f6596f1e640 1 --2- 172.21.15.102:0/669696546 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f659015ce00 0x7f65900cc580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:01.743 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:01.735+0000 7f6596f1e640 1 --2- 172.21.15.102:0/669696546 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f6574066470 0x7f6574068930 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:01.743 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:01.735+0000 7f6596f1e640 1 --2- 172.21.15.102:0/669696546 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f65900d17b0 0x7f65900ca790 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:01.743 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:01.735+0000 7f6596f1e640 1 --2- 172.21.15.102:0/669696546 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f65900d0940 0x7f65900ca110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:01.743 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:01.735+0000 7f6596f1e640 1 -- 172.21.15.102:0/669696546 >> 172.21.15.102:0/669696546 conn(0x7f659009bf60 msgr2=0x7f659015c010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-13T11:29:01.744 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:01.735+0000 7f6596f1e640 1 -- 172.21.15.102:0/669696546 shutdown_connections 2023-11-13T11:29:01.744 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:01.735+0000 7f6596f1e640 1 -- 172.21.15.102:0/669696546 wait complete. 2023-11-13T11:29:01.763 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-11-13T11:29:01.763 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-13T11:29:01.901 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:01.895+0000 7fa889c79640 1 Processor -- start 2023-11-13T11:29:01.902 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:01.895+0000 7fa889c79640 1 -- start start 2023-11-13T11:29:01.903 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:01.899+0000 7fa889c79640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7fa8841606e0 0x7fa8840c69b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:01.904 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:01.899+0000 7fa889c79640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fa8840d0c40 0x7fa8840b3e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:01.904 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:01.899+0000 7fa889c79640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa8840cf490 0x7fa8840cf920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:01.904 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:01.899+0000 7fa889c79640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa8840cfe60 con 0x7fa8841606e0 2023-11-13T11:29:01.904 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:01.899+0000 7fa889c79640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa8840d1440 con 0x7fa8840d0c40 2023-11-13T11:29:01.904 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:01.899+0000 7fa889c79640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8840cdb10 con 0x7fa8840cf490 2023-11-13T11:29:01.905 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:01.899+0000 7fa8837fe640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7fa8841606e0 0x7fa8840c69b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:01.905 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:01.899+0000 7fa8837fe640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7fa8841606e0 0x7fa8840c69b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:36100/0 (socket says 172.21.15.102:36100) 2023-11-13T11:29:01.905 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:01.899+0000 7fa8837fe640 1 -- 172.21.15.102:0/1764621840 learned_addr learned my addr 172.21.15.102:0/1764621840 (peer_addr_for_me v2:172.21.15.102:0/0) 2023-11-13T11:29:01.905 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:01.899+0000 7fa883fff640 1 --2- 172.21.15.102:0/1764621840 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa8840cf490 0x7fa8840cf920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:01.905 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:01.899+0000 7fa882ffd640 1 --2- 172.21.15.102:0/1764621840 >> v2:172.21.15.154:3300/0 conn(0x7fa8840d0c40 0x7fa8840b3e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:01.906 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:01.899+0000 7fa8837fe640 1 -- 172.21.15.102:0/1764621840 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa8840cf490 msgr2=0x7fa8840cf920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-13T11:29:01.906 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:01.899+0000 7fa8837fe640 1 --2- 172.21.15.102:0/1764621840 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa8840cf490 0x7fa8840cf920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:01.906 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:01.899+0000 7fa8837fe640 1 -- 172.21.15.102:0/1764621840 >> v2:172.21.15.154:3300/0 conn(0x7fa8840d0c40 msgr2=0x7fa8840b3e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-13T11:29:01.906 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:01.899+0000 7fa8837fe640 1 --2- 172.21.15.102:0/1764621840 >> v2:172.21.15.154:3300/0 conn(0x7fa8840d0c40 0x7fa8840b3e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:01.906 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:01.899+0000 7fa8837fe640 1 -- 172.21.15.102:0/1764621840 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8840d1690 con 0x7fa8841606e0 2023-11-13T11:29:01.907 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:01.899+0000 7fa882ffd640 1 --2- 172.21.15.102:0/1764621840 >> v2:172.21.15.154:3300/0 conn(0x7fa8840d0c40 0x7fa8840b3e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-13T11:29:01.908 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:01.899+0000 7fa8837fe640 1 --2- 172.21.15.102:0/1764621840 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa8841606e0 0x7fa8840c69b0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fa88408bfd0 tx=0x7fa87401c440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6e576a70a0be0f72 server_cookie=0 in_seq=0 out_seq=0 2023-11-13T11:29:01.908 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:01.899+0000 7fa8827fc640 1 -- 172.21.15.102:0/1764621840 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8740ac620 con 0x7fa8841606e0 2023-11-13T11:29:01.908 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:01.903+0000 7fa8827fc640 1 -- 172.21.15.102:0/1764621840 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa8740ac780 con 0x7fa8841606e0 2023-11-13T11:29:01.908 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:01.903+0000 7fa8827fc640 1 -- 172.21.15.102:0/1764621840 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8740acb10 con 0x7fa8841606e0 2023-11-13T11:29:01.908 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:01.903+0000 7fa889c79640 1 -- 172.21.15.102:0/1764621840 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa8841606e0 msgr2=0x7fa8840c69b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:01.909 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:01.903+0000 7fa889c79640 1 --2- 172.21.15.102:0/1764621840 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa8841606e0 0x7fa8840c69b0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fa88408bfd0 tx=0x7fa87401c440 comp rx=0 tx=0).stop 2023-11-13T11:29:01.909 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:01.903+0000 7fa889c79640 1 -- 172.21.15.102:0/1764621840 shutdown_connections 2023-11-13T11:29:01.909 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:01.903+0000 7fa889c79640 1 --2- 172.21.15.102:0/1764621840 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa8840cf490 0x7fa8840cf920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:01.909 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:01.903+0000 7fa889c79640 1 --2- 172.21.15.102:0/1764621840 >> v2:172.21.15.154:3300/0 conn(0x7fa8840d0c40 0x7fa8840b3e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:01.909 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:01.903+0000 7fa889c79640 1 --2- 172.21.15.102:0/1764621840 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa8841606e0 0x7fa8840c69b0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:01.910 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:01.903+0000 7fa889c79640 1 -- 172.21.15.102:0/1764621840 >> 172.21.15.102:0/1764621840 conn(0x7fa88409c130 msgr2=0x7fa8840d2e60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-13T11:29:01.910 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:01.903+0000 7fa889c79640 1 -- 172.21.15.102:0/1764621840 shutdown_connections 2023-11-13T11:29:01.910 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:01.903+0000 7fa889c79640 1 -- 172.21.15.102:0/1764621840 wait complete. 2023-11-13T11:29:01.912 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:01.903+0000 7fa889c79640 1 Processor -- start 2023-11-13T11:29:01.912 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:01.903+0000 7fa889c79640 1 -- start start 2023-11-13T11:29:01.912 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:01.903+0000 7fa889c79640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa8840cf490 0x7fa8841504f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:01.913 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:01.903+0000 7fa889c79640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa8840d0c40 0x7fa8840c6f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:01.913 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:01.903+0000 7fa889c79640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa8841606e0 0x7fa8840ccdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:01.913 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:01.903+0000 7fa889c79640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa884150b80 con 0x7fa8840d0c40 2023-11-13T11:29:01.913 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:01.903+0000 7fa889c79640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8840c8800 con 0x7fa8841606e0 2023-11-13T11:29:01.913 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:01.903+0000 7fa889c79640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa884151900 con 0x7fa8840cf490 2023-11-13T11:29:01.914 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:01.903+0000 7fa882ffd640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa8840d0c40 0x7fa8840c6f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:01.914 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:01.903+0000 7fa882ffd640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa8840d0c40 0x7fa8840c6f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:36110/0 (socket says 172.21.15.102:36110) 2023-11-13T11:29:01.914 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:01.903+0000 7fa882ffd640 1 -- 172.21.15.102:0/3105919598 learned_addr learned my addr 172.21.15.102:0/3105919598 (peer_addr_for_me v2:172.21.15.102:0/0) 2023-11-13T11:29:01.914 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:01.903+0000 7fa8837fe640 1 --2- 172.21.15.102:0/3105919598 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa8840cf490 0x7fa8841504f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:01.914 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:01.903+0000 7fa883fff640 1 --2- 172.21.15.102:0/3105919598 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa8841606e0 0x7fa8840ccdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:01.915 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:01.907+0000 7fa882ffd640 1 -- 172.21.15.102:0/3105919598 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa8840cf490 msgr2=0x7fa8841504f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:01.915 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:01.907+0000 7fa882ffd640 1 --2- 172.21.15.102:0/3105919598 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa8840cf490 0x7fa8841504f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:01.915 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:01.907+0000 7fa882ffd640 1 -- 172.21.15.102:0/3105919598 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa8841606e0 msgr2=0x7fa8840ccdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:01.915 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:01.907+0000 7fa882ffd640 1 --2- 172.21.15.102:0/3105919598 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa8841606e0 0x7fa8840ccdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:01.915 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:01.907+0000 7fa882ffd640 1 -- 172.21.15.102:0/3105919598 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8740094d0 con 0x7fa8840d0c40 2023-11-13T11:29:01.915 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:01.907+0000 7fa882ffd640 1 --2- 172.21.15.102:0/3105919598 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa8840d0c40 0x7fa8840c6f30 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fa87800c7c0 tx=0x7fa87800cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-13T11:29:01.916 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:01.907+0000 7fa86bfff640 1 -- 172.21.15.102:0/3105919598 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8780079d0 con 0x7fa8840d0c40 2023-11-13T11:29:01.916 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:01.907+0000 7fa86bfff640 1 -- 172.21.15.102:0/3105919598 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa878007b30 con 0x7fa8840d0c40 2023-11-13T11:29:01.916 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:01.907+0000 7fa889c79640 1 -- 172.21.15.102:0/3105919598 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa8840ca6a0 con 0x7fa8840d0c40 2023-11-13T11:29:01.916 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:01.907+0000 7fa86bfff640 1 -- 172.21.15.102:0/3105919598 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa87800ce70 con 0x7fa8840d0c40 2023-11-13T11:29:01.916 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:01.907+0000 7fa889c79640 1 -- 172.21.15.102:0/3105919598 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa884151620 con 0x7fa8840d0c40 2023-11-13T11:29:01.917 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:01.907+0000 7fa889c79640 1 -- 172.21.15.102:0/3105919598 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa884068520 con 0x7fa8840d0c40 2023-11-13T11:29:01.917 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:01.907+0000 7fa86bfff640 1 -- 172.21.15.102:0/3105919598 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fa8780113f0 con 0x7fa8840d0c40 2023-11-13T11:29:01.918 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:01.907+0000 7fa86bfff640 1 --2- 172.21.15.102:0/3105919598 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7fa8700664a0 0x7fa870068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:01.918 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:01.907+0000 7fa86bfff640 1 -- 172.21.15.102:0/3105919598 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa878084130 con 0x7fa8840d0c40 2023-11-13T11:29:01.918 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:01.907+0000 7fa8837fe640 1 --2- 172.21.15.102:0/3105919598 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7fa8700664a0 0x7fa870068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:01.918 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:01.911+0000 7fa8837fe640 1 --2- 172.21.15.102:0/3105919598 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7fa8700664a0 0x7fa870068960 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fa8740ae000 tx=0x7fa874008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-13T11:29:01.919 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:01.911+0000 7fa86bfff640 1 -- 172.21.15.102:0/3105919598 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fa8780516f0 con 0x7fa8840d0c40 2023-11-13T11:29:02.066 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:02.059+0000 7fa889c79640 1 -- 172.21.15.102:0/3105919598 --> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fa88408cb40 con 0x7fa8700664a0 2023-11-13T11:29:02.074 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:02.067+0000 7fa86bfff640 1 -- 172.21.15.102:0/3105919598 <== mgr.4103 v2:172.21.15.102:6832/1009482693 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+264713 (secure 0 0 0) 0x7fa88408cb40 con 0x7fa8700664a0 2023-11-13T11:29:02.075 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T11:29:02.080 INFO:teuthology.orchestra.run.smithi102.stderr:dumped all 2023-11-13T11:29:02.081 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:02.071+0000 7fa889c79640 1 -- 172.21.15.102:0/3105919598 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7fa8700664a0 msgr2=0x7fa870068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:02.082 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:02.071+0000 7fa889c79640 1 --2- 172.21.15.102:0/3105919598 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7fa8700664a0 0x7fa870068960 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fa8740ae000 tx=0x7fa874008040 comp rx=0 tx=0).stop 2023-11-13T11:29:02.082 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:02.071+0000 7fa889c79640 1 -- 172.21.15.102:0/3105919598 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa8840d0c40 msgr2=0x7fa8840c6f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:02.082 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:02.071+0000 7fa889c79640 1 --2- 172.21.15.102:0/3105919598 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa8840d0c40 0x7fa8840c6f30 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fa87800c7c0 tx=0x7fa87800cc80 comp rx=0 tx=0).stop 2023-11-13T11:29:02.082 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:02.075+0000 7fa889c79640 1 -- 172.21.15.102:0/3105919598 shutdown_connections 2023-11-13T11:29:02.083 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:02.075+0000 7fa889c79640 1 --2- 172.21.15.102:0/3105919598 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa8841606e0 0x7fa8840ccdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:02.083 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:02.075+0000 7fa889c79640 1 --2- 172.21.15.102:0/3105919598 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7fa8700664a0 0x7fa870068960 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:02.083 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:02.075+0000 7fa889c79640 1 --2- 172.21.15.102:0/3105919598 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa8840d0c40 0x7fa8840c6f30 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:02.083 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:02.075+0000 7fa889c79640 1 --2- 172.21.15.102:0/3105919598 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa8840cf490 0x7fa8841504f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:02.084 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:02.075+0000 7fa889c79640 1 -- 172.21.15.102:0/3105919598 >> 172.21.15.102:0/3105919598 conn(0x7fa88409c130 msgr2=0x7fa8840b6700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-13T11:29:02.084 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:02.075+0000 7fa889c79640 1 -- 172.21.15.102:0/3105919598 shutdown_connections 2023-11-13T11:29:02.085 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:02.075+0000 7fa889c79640 1 -- 172.21.15.102:0/3105919598 wait complete. 2023-11-13T11:29:02.098 INFO:teuthology.orchestra.run.smithi102.stdout:{"pg_ready":true,"pg_map":{"version":24,"stamp":"2023-11-13T11:29:00.923499+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219116,"kb_used_data":2944,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755604,"statfs":{"total":773094113280,"available":772869738496,"internally_reserved":0,"allocated":3014656,"data_stored":1793634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":41,"apply_latency_ms":41,"commit_latency_ns":41000000,"apply_latency_ns":41000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.911886"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-13T11:28:58.677490+0000","last_change":"2023-11-13T11:28:57.639845+0000","last_active":"2023-11-13T11:28:58.677490+0000","last_peered":"2023-11-13T11:28:58.677490+0000","last_clean":"2023-11-13T11:28:58.677490+0000","last_became_active":"2023-11-13T11:28:57.639218+0000","last_became_peered":"2023-11-13T11:28:57.639218+0000","last_unstale":"2023-11-13T11:28:58.677490+0000","last_undegraded":"2023-11-13T11:28:58.677490+0000","last_fullsized":"2023-11-13T11:28:58.677490+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-13T11:28:57.010879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-13T11:28:57.010879+0000","last_clean_scrub_stamp":"2023-11-13T11:28:57.010879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-14T22:49:31.708378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-13T11:28:58.677700+0000","last_change":"2023-11-13T11:28:57.627422+0000","last_active":"2023-11-13T11:28:58.677700+0000","last_peered":"2023-11-13T11:28:58.677700+0000","last_clean":"2023-11-13T11:28:58.677700+0000","last_became_active":"2023-11-13T11:28:57.627084+0000","last_became_peered":"2023-11-13T11:28:57.627084+0000","last_unstale":"2023-11-13T11:28:58.677700+0000","last_undegraded":"2023-11-13T11:28:58.677700+0000","last_fullsized":"2023-11-13T11:28:58.677700+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-13T11:28:57.010879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-13T11:28:57.010879+0000","last_clean_scrub_stamp":"2023-11-13T11:28:57.010879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-14T13:51:35.559492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-13T11:28:58.677559+0000","last_change":"2023-11-13T11:28:57.624354+0000","last_active":"2023-11-13T11:28:58.677559+0000","last_peered":"2023-11-13T11:28:58.677559+0000","last_clean":"2023-11-13T11:28:58.677559+0000","last_became_active":"2023-11-13T11:28:57.624146+0000","last_became_peered":"2023-11-13T11:28:57.624146+0000","last_unstale":"2023-11-13T11:28:58.677559+0000","last_undegraded":"2023-11-13T11:28:58.677559+0000","last_fullsized":"2023-11-13T11:28:58.677559+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-13T11:28:57.010879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-13T11:28:57.010879+0000","last_clean_scrub_stamp":"2023-11-13T11:28:57.010879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-14T18:39:09.544147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-13T11:28:58.616239+0000","last_change":"2023-11-13T11:28:57.631455+0000","last_active":"2023-11-13T11:28:58.616239+0000","last_peered":"2023-11-13T11:28:58.616239+0000","last_clean":"2023-11-13T11:28:58.616239+0000","last_became_active":"2023-11-13T11:28:57.630777+0000","last_became_peered":"2023-11-13T11:28:57.630777+0000","last_unstale":"2023-11-13T11:28:58.616239+0000","last_undegraded":"2023-11-13T11:28:58.616239+0000","last_fullsized":"2023-11-13T11:28:58.616239+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-13T11:28:57.010879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-13T11:28:57.010879+0000","last_clean_scrub_stamp":"2023-11-13T11:28:57.010879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-14T12:47:29.658403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-13T11:28:58.676950+0000","last_change":"2023-11-13T11:28:57.636281+0000","last_active":"2023-11-13T11:28:58.676950+0000","last_peered":"2023-11-13T11:28:58.676950+0000","last_clean":"2023-11-13T11:28:58.676950+0000","last_became_active":"2023-11-13T11:28:57.635550+0000","last_became_peered":"2023-11-13T11:28:57.635550+0000","last_unstale":"2023-11-13T11:28:58.676950+0000","last_undegraded":"2023-11-13T11:28:58.676950+0000","last_fullsized":"2023-11-13T11:28:58.676950+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-13T11:28:57.010879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-13T11:28:57.010879+0000","last_clean_scrub_stamp":"2023-11-13T11:28:57.010879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-14T22:20:14.170174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-13T11:28:58.616167+0000","last_change":"2023-11-13T11:28:57.638583+0000","last_active":"2023-11-13T11:28:58.616167+0000","last_peered":"2023-11-13T11:28:58.616167+0000","last_clean":"2023-11-13T11:28:58.616167+0000","last_became_active":"2023-11-13T11:28:57.638322+0000","last_became_peered":"2023-11-13T11:28:57.638322+0000","last_unstale":"2023-11-13T11:28:58.616167+0000","last_undegraded":"2023-11-13T11:28:58.616167+0000","last_fullsized":"2023-11-13T11:28:58.616167+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-13T11:28:57.010879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-13T11:28:57.010879+0000","last_clean_scrub_stamp":"2023-11-13T11:28:57.010879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-14T22:20:19.900579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-13T11:28:58.676818+0000","last_change":"2023-11-13T11:28:57.628322+0000","last_active":"2023-11-13T11:28:58.676818+0000","last_peered":"2023-11-13T11:28:58.676818+0000","last_clean":"2023-11-13T11:28:58.676818+0000","last_became_active":"2023-11-13T11:28:57.628022+0000","last_became_peered":"2023-11-13T11:28:57.628022+0000","last_unstale":"2023-11-13T11:28:58.676818+0000","last_undegraded":"2023-11-13T11:28:58.676818+0000","last_fullsized":"2023-11-13T11:28:58.676818+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-13T11:28:57.010879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-13T11:28:57.010879+0000","last_clean_scrub_stamp":"2023-11-13T11:28:57.010879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-14T16:47:11.682554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-13T11:28:58.676863+0000","last_change":"2023-11-13T11:28:57.635006+0000","last_active":"2023-11-13T11:28:58.676863+0000","last_peered":"2023-11-13T11:28:58.676863+0000","last_clean":"2023-11-13T11:28:58.676863+0000","last_became_active":"2023-11-13T11:28:57.634769+0000","last_became_peered":"2023-11-13T11:28:57.634769+0000","last_unstale":"2023-11-13T11:28:58.676863+0000","last_undegraded":"2023-11-13T11:28:58.676863+0000","last_fullsized":"2023-11-13T11:28:58.676863+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-13T11:28:57.010879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-13T11:28:57.010879+0000","last_clean_scrub_stamp":"2023-11-13T11:28:57.010879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-14T21:42:19.412264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-13T11:28:58.613659+0000","last_change":"2023-11-13T11:28:57.623676+0000","last_active":"2023-11-13T11:28:58.613659+0000","last_peered":"2023-11-13T11:28:58.613659+0000","last_clean":"2023-11-13T11:28:58.613659+0000","last_became_active":"2023-11-13T11:28:57.623400+0000","last_became_peered":"2023-11-13T11:28:57.623400+0000","last_unstale":"2023-11-13T11:28:58.613659+0000","last_undegraded":"2023-11-13T11:28:58.613659+0000","last_fullsized":"2023-11-13T11:28:58.613659+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-13T11:28:57.010879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-13T11:28:57.010879+0000","last_clean_scrub_stamp":"2023-11-13T11:28:57.010879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-14T17:58:40.870637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-13T11:28:58.677620+0000","last_change":"2023-11-13T11:28:57.636734+0000","last_active":"2023-11-13T11:28:58.677620+0000","last_peered":"2023-11-13T11:28:58.677620+0000","last_clean":"2023-11-13T11:28:58.677620+0000","last_became_active":"2023-11-13T11:28:57.636461+0000","last_became_peered":"2023-11-13T11:28:57.636461+0000","last_unstale":"2023-11-13T11:28:58.677620+0000","last_undegraded":"2023-11-13T11:28:58.677620+0000","last_fullsized":"2023-11-13T11:28:58.677620+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-13T11:28:57.010879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-13T11:28:57.010879+0000","last_clean_scrub_stamp":"2023-11-13T11:28:57.010879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-14T13:13:26.359918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-13T11:28:58.677026+0000","last_change":"2023-11-13T11:28:57.639520+0000","last_active":"2023-11-13T11:28:58.677026+0000","last_peered":"2023-11-13T11:28:58.677026+0000","last_clean":"2023-11-13T11:28:58.677026+0000","last_became_active":"2023-11-13T11:28:57.639240+0000","last_became_peered":"2023-11-13T11:28:57.639240+0000","last_unstale":"2023-11-13T11:28:58.677026+0000","last_undegraded":"2023-11-13T11:28:58.677026+0000","last_fullsized":"2023-11-13T11:28:58.677026+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-13T11:28:57.010879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-13T11:28:57.010879+0000","last_clean_scrub_stamp":"2023-11-13T11:28:57.010879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-14T18:39:09.544147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-13T11:28:58.677082+0000","last_change":"2023-11-13T11:28:57.634782+0000","last_active":"2023-11-13T11:28:58.677082+0000","last_peered":"2023-11-13T11:28:58.677082+0000","last_clean":"2023-11-13T11:28:58.677082+0000","last_became_active":"2023-11-13T11:28:57.634488+0000","last_became_peered":"2023-11-13T11:28:57.634488+0000","last_unstale":"2023-11-13T11:28:58.677082+0000","last_undegraded":"2023-11-13T11:28:58.677082+0000","last_fullsized":"2023-11-13T11:28:58.677082+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-13T11:28:57.010879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-13T11:28:57.010879+0000","last_clean_scrub_stamp":"2023-11-13T11:28:57.010879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-14T13:24:50.764716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-13T11:28:58.677279+0000","last_change":"2023-11-13T11:28:57.644331+0000","last_active":"2023-11-13T11:28:58.677279+0000","last_peered":"2023-11-13T11:28:58.677279+0000","last_clean":"2023-11-13T11:28:58.677279+0000","last_became_active":"2023-11-13T11:28:57.643877+0000","last_became_peered":"2023-11-13T11:28:57.643877+0000","last_unstale":"2023-11-13T11:28:58.677279+0000","last_undegraded":"2023-11-13T11:28:58.677279+0000","last_fullsized":"2023-11-13T11:28:58.677279+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-13T11:28:57.010879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-13T11:28:57.010879+0000","last_clean_scrub_stamp":"2023-11-13T11:28:57.010879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-14T17:58:40.870637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-13T11:28:58.677454+0000","last_change":"2023-11-13T11:28:57.632228+0000","last_active":"2023-11-13T11:28:58.677454+0000","last_peered":"2023-11-13T11:28:58.677454+0000","last_clean":"2023-11-13T11:28:58.677454+0000","last_became_active":"2023-11-13T11:28:57.631793+0000","last_became_peered":"2023-11-13T11:28:57.631793+0000","last_unstale":"2023-11-13T11:28:58.677454+0000","last_undegraded":"2023-11-13T11:28:58.677454+0000","last_fullsized":"2023-11-13T11:28:58.677454+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-13T11:28:57.010879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-13T11:28:57.010879+0000","last_clean_scrub_stamp":"2023-11-13T11:28:57.010879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-14T11:40:58.842068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-13T11:28:58.677021+0000","last_change":"2023-11-13T11:28:57.643105+0000","last_active":"2023-11-13T11:28:58.677021+0000","last_peered":"2023-11-13T11:28:58.677021+0000","last_clean":"2023-11-13T11:28:58.677021+0000","last_became_active":"2023-11-13T11:28:57.642876+0000","last_became_peered":"2023-11-13T11:28:57.642876+0000","last_unstale":"2023-11-13T11:28:58.677021+0000","last_undegraded":"2023-11-13T11:28:58.677021+0000","last_fullsized":"2023-11-13T11:28:58.677021+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-13T11:28:57.010879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-13T11:28:57.010879+0000","last_clean_scrub_stamp":"2023-11-13T11:28:57.010879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-14T23:10:03.463557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-13T11:28:58.675939+0000","last_change":"2023-11-13T11:28:57.632118+0000","last_active":"2023-11-13T11:28:58.675939+0000","last_peered":"2023-11-13T11:28:58.675939+0000","last_clean":"2023-11-13T11:28:58.675939+0000","last_became_active":"2023-11-13T11:28:57.631823+0000","last_became_peered":"2023-11-13T11:28:57.631823+0000","last_unstale":"2023-11-13T11:28:58.675939+0000","last_undegraded":"2023-11-13T11:28:58.675939+0000","last_fullsized":"2023-11-13T11:28:58.675939+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-13T11:28:57.010879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-13T11:28:57.010879+0000","last_clean_scrub_stamp":"2023-11-13T11:28:57.010879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-14T16:35:00.051619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-13T11:28:58.676578+0000","last_change":"2023-11-13T11:28:57.636613+0000","last_active":"2023-11-13T11:28:58.676578+0000","last_peered":"2023-11-13T11:28:58.676578+0000","last_clean":"2023-11-13T11:28:58.676578+0000","last_became_active":"2023-11-13T11:28:57.636361+0000","last_became_peered":"2023-11-13T11:28:57.636361+0000","last_unstale":"2023-11-13T11:28:58.676578+0000","last_undegraded":"2023-11-13T11:28:58.676578+0000","last_fullsized":"2023-11-13T11:28:58.676578+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-13T11:28:57.010879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-13T11:28:57.010879+0000","last_clean_scrub_stamp":"2023-11-13T11:28:57.010879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-14T22:52:54.214180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-13T11:28:58.677191+0000","last_change":"2023-11-13T11:28:57.642425+0000","last_active":"2023-11-13T11:28:58.677191+0000","last_peered":"2023-11-13T11:28:58.677191+0000","last_clean":"2023-11-13T11:28:58.677191+0000","last_became_active":"2023-11-13T11:28:57.641266+0000","last_became_peered":"2023-11-13T11:28:57.641266+0000","last_unstale":"2023-11-13T11:28:58.677191+0000","last_undegraded":"2023-11-13T11:28:58.677191+0000","last_fullsized":"2023-11-13T11:28:58.677191+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-13T11:28:57.010879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-13T11:28:57.010879+0000","last_clean_scrub_stamp":"2023-11-13T11:28:57.010879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-14T13:10:19.954130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-13T11:28:58.676577+0000","last_change":"2023-11-13T11:28:57.637356+0000","last_active":"2023-11-13T11:28:58.676577+0000","last_peered":"2023-11-13T11:28:58.676577+0000","last_clean":"2023-11-13T11:28:58.676577+0000","last_became_active":"2023-11-13T11:28:57.637069+0000","last_became_peered":"2023-11-13T11:28:57.637069+0000","last_unstale":"2023-11-13T11:28:58.676577+0000","last_undegraded":"2023-11-13T11:28:58.676577+0000","last_fullsized":"2023-11-13T11:28:58.676577+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-13T11:28:57.010879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-13T11:28:57.010879+0000","last_clean_scrub_stamp":"2023-11-13T11:28:57.010879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-14T21:53:05.134410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-13T11:28:58.677142+0000","last_change":"2023-11-13T11:28:57.636634+0000","last_active":"2023-11-13T11:28:58.677142+0000","last_peered":"2023-11-13T11:28:58.677142+0000","last_clean":"2023-11-13T11:28:58.677142+0000","last_became_active":"2023-11-13T11:28:57.636278+0000","last_became_peered":"2023-11-13T11:28:57.636278+0000","last_unstale":"2023-11-13T11:28:58.677142+0000","last_undegraded":"2023-11-13T11:28:58.677142+0000","last_fullsized":"2023-11-13T11:28:58.677142+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-13T11:28:57.010879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-13T11:28:57.010879+0000","last_clean_scrub_stamp":"2023-11-13T11:28:57.010879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-14T13:51:35.559492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-13T11:28:58.617298+0000","last_change":"2023-11-13T11:28:57.633282+0000","last_active":"2023-11-13T11:28:58.617298+0000","last_peered":"2023-11-13T11:28:58.617298+0000","last_clean":"2023-11-13T11:28:58.617298+0000","last_became_active":"2023-11-13T11:28:57.633008+0000","last_became_peered":"2023-11-13T11:28:57.633008+0000","last_unstale":"2023-11-13T11:28:58.617298+0000","last_undegraded":"2023-11-13T11:28:58.617298+0000","last_fullsized":"2023-11-13T11:28:58.617298+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-13T11:28:57.010879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-13T11:28:57.010879+0000","last_clean_scrub_stamp":"2023-11-13T11:28:57.010879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-14T12:34:10.639080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-13T11:28:58.613391+0000","last_change":"2023-11-13T11:28:57.639417+0000","last_active":"2023-11-13T11:28:58.613391+0000","last_peered":"2023-11-13T11:28:58.613391+0000","last_clean":"2023-11-13T11:28:58.613391+0000","last_became_active":"2023-11-13T11:28:57.639132+0000","last_became_peered":"2023-11-13T11:28:57.639132+0000","last_unstale":"2023-11-13T11:28:58.613391+0000","last_undegraded":"2023-11-13T11:28:58.613391+0000","last_fullsized":"2023-11-13T11:28:58.613391+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-13T11:28:57.010879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-13T11:28:57.010879+0000","last_clean_scrub_stamp":"2023-11-13T11:28:57.010879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-14T12:47:29.658403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-13T11:28:58.677488+0000","last_change":"2023-11-13T11:28:57.633636+0000","last_active":"2023-11-13T11:28:58.677488+0000","last_peered":"2023-11-13T11:28:58.677488+0000","last_clean":"2023-11-13T11:28:58.677488+0000","last_became_active":"2023-11-13T11:28:57.632529+0000","last_became_peered":"2023-11-13T11:28:57.632529+0000","last_unstale":"2023-11-13T11:28:58.677488+0000","last_undegraded":"2023-11-13T11:28:58.677488+0000","last_fullsized":"2023-11-13T11:28:58.677488+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-13T11:28:57.010879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-13T11:28:57.010879+0000","last_clean_scrub_stamp":"2023-11-13T11:28:57.010879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-14T22:20:14.170174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-13T11:28:58.675948+0000","last_change":"2023-11-13T11:28:57.630397+0000","last_active":"2023-11-13T11:28:58.675948+0000","last_peered":"2023-11-13T11:28:58.675948+0000","last_clean":"2023-11-13T11:28:58.675948+0000","last_became_active":"2023-11-13T11:28:57.630049+0000","last_became_peered":"2023-11-13T11:28:57.630049+0000","last_unstale":"2023-11-13T11:28:58.675948+0000","last_undegraded":"2023-11-13T11:28:58.675948+0000","last_fullsized":"2023-11-13T11:28:58.675948+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-13T11:28:57.010879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-13T11:28:57.010879+0000","last_clean_scrub_stamp":"2023-11-13T11:28:57.010879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-14T22:49:31.708378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-13T11:28:58.677751+0000","last_change":"2023-11-13T11:28:57.627535+0000","last_active":"2023-11-13T11:28:58.677751+0000","last_peered":"2023-11-13T11:28:58.677751+0000","last_clean":"2023-11-13T11:28:58.677751+0000","last_became_active":"2023-11-13T11:28:57.625057+0000","last_became_peered":"2023-11-13T11:28:57.625057+0000","last_unstale":"2023-11-13T11:28:58.677751+0000","last_undegraded":"2023-11-13T11:28:58.677751+0000","last_fullsized":"2023-11-13T11:28:58.677751+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-13T11:28:57.010879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-13T11:28:57.010879+0000","last_clean_scrub_stamp":"2023-11-13T11:28:57.010879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-14T16:55:58.610937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-13T11:28:58.616465+0000","last_change":"2023-11-13T11:28:57.635961+0000","last_active":"2023-11-13T11:28:58.616465+0000","last_peered":"2023-11-13T11:28:58.616465+0000","last_clean":"2023-11-13T11:28:58.616465+0000","last_became_active":"2023-11-13T11:28:57.635672+0000","last_became_peered":"2023-11-13T11:28:57.635672+0000","last_unstale":"2023-11-13T11:28:58.616465+0000","last_undegraded":"2023-11-13T11:28:58.616465+0000","last_fullsized":"2023-11-13T11:28:58.616465+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-13T11:28:57.010879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-13T11:28:57.010879+0000","last_clean_scrub_stamp":"2023-11-13T11:28:57.010879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-14T17:58:40.870637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-13T11:28:58.678102+0000","last_change":"2023-11-13T11:28:57.632312+0000","last_active":"2023-11-13T11:28:58.678102+0000","last_peered":"2023-11-13T11:28:58.678102+0000","last_clean":"2023-11-13T11:28:58.678102+0000","last_became_active":"2023-11-13T11:28:57.631906+0000","last_became_peered":"2023-11-13T11:28:57.631906+0000","last_unstale":"2023-11-13T11:28:58.678102+0000","last_undegraded":"2023-11-13T11:28:58.678102+0000","last_fullsized":"2023-11-13T11:28:58.678102+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-13T11:28:57.010879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-13T11:28:57.010879+0000","last_clean_scrub_stamp":"2023-11-13T11:28:57.010879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-14T12:45:23.017972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-13T11:28:58.677455+0000","last_change":"2023-11-13T11:28:57.639397+0000","last_active":"2023-11-13T11:28:58.677455+0000","last_peered":"2023-11-13T11:28:58.677455+0000","last_clean":"2023-11-13T11:28:58.677455+0000","last_became_active":"2023-11-13T11:28:57.639114+0000","last_became_peered":"2023-11-13T11:28:57.639114+0000","last_unstale":"2023-11-13T11:28:58.677455+0000","last_undegraded":"2023-11-13T11:28:58.677455+0000","last_fullsized":"2023-11-13T11:28:58.677455+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-13T11:28:57.010879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-13T11:28:57.010879+0000","last_clean_scrub_stamp":"2023-11-13T11:28:57.010879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-14T16:02:43.358281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-13T11:28:58.677535+0000","last_change":"2023-11-13T11:28:57.632030+0000","last_active":"2023-11-13T11:28:58.677535+0000","last_peered":"2023-11-13T11:28:58.677535+0000","last_clean":"2023-11-13T11:28:58.677535+0000","last_became_active":"2023-11-13T11:28:57.631756+0000","last_became_peered":"2023-11-13T11:28:57.631756+0000","last_unstale":"2023-11-13T11:28:58.677535+0000","last_undegraded":"2023-11-13T11:28:58.677535+0000","last_fullsized":"2023-11-13T11:28:58.677535+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-13T11:28:57.010879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-13T11:28:57.010879+0000","last_clean_scrub_stamp":"2023-11-13T11:28:57.010879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-14T14:29:59.365142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-13T11:28:58.676220+0000","last_change":"2023-11-13T11:28:57.634137+0000","last_active":"2023-11-13T11:28:58.676220+0000","last_peered":"2023-11-13T11:28:58.676220+0000","last_clean":"2023-11-13T11:28:58.676220+0000","last_became_active":"2023-11-13T11:28:57.633803+0000","last_became_peered":"2023-11-13T11:28:57.633803+0000","last_unstale":"2023-11-13T11:28:58.676220+0000","last_undegraded":"2023-11-13T11:28:58.676220+0000","last_fullsized":"2023-11-13T11:28:58.676220+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-13T11:28:57.010879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-13T11:28:57.010879+0000","last_clean_scrub_stamp":"2023-11-13T11:28:57.010879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-14T12:18:09.759922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-13T11:28:58.676433+0000","last_change":"2023-11-13T11:28:57.637093+0000","last_active":"2023-11-13T11:28:58.676433+0000","last_peered":"2023-11-13T11:28:58.676433+0000","last_clean":"2023-11-13T11:28:58.676433+0000","last_became_active":"2023-11-13T11:28:57.636765+0000","last_became_peered":"2023-11-13T11:28:57.636765+0000","last_unstale":"2023-11-13T11:28:58.676433+0000","last_undegraded":"2023-11-13T11:28:58.676433+0000","last_fullsized":"2023-11-13T11:28:58.676433+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-13T11:28:57.010879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-13T11:28:57.010879+0000","last_clean_scrub_stamp":"2023-11-13T11:28:57.010879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-14T15:45:30.694781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-13T11:28:58.616081+0000","last_change":"2023-11-13T11:28:57.632897+0000","last_active":"2023-11-13T11:28:58.616081+0000","last_peered":"2023-11-13T11:28:58.616081+0000","last_clean":"2023-11-13T11:28:58.616081+0000","last_became_active":"2023-11-13T11:28:57.632596+0000","last_became_peered":"2023-11-13T11:28:57.632596+0000","last_unstale":"2023-11-13T11:28:58.616081+0000","last_undegraded":"2023-11-13T11:28:58.616081+0000","last_fullsized":"2023-11-13T11:28:58.616081+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-13T11:28:57.010879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-13T11:28:57.010879+0000","last_clean_scrub_stamp":"2023-11-13T11:28:57.010879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-14T18:44:10.551024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-13T11:28:58.613160+0000","last_change":"2023-11-13T11:28:57.625017+0000","last_active":"2023-11-13T11:28:58.613160+0000","last_peered":"2023-11-13T11:28:58.613160+0000","last_clean":"2023-11-13T11:28:58.613160+0000","last_became_active":"2023-11-13T11:28:57.624314+0000","last_became_peered":"2023-11-13T11:28:57.624314+0000","last_unstale":"2023-11-13T11:28:58.613160+0000","last_undegraded":"2023-11-13T11:28:58.613160+0000","last_fullsized":"2023-11-13T11:28:58.613160+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-13T11:28:57.010879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-13T11:28:57.010879+0000","last_clean_scrub_stamp":"2023-11-13T11:28:57.010879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-14T19:51:05.461013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1b","version":"21'1","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-13T11:28:58.677644+0000","last_change":"2023-11-13T11:28:57.043256+0000","last_active":"2023-11-13T11:28:58.677644+0000","last_peered":"2023-11-13T11:28:58.677644+0000","last_clean":"2023-11-13T11:28:58.677644+0000","last_became_active":"2023-11-13T11:28:57.041999+0000","last_became_peered":"2023-11-13T11:28:57.041999+0000","last_unstale":"2023-11-13T11:28:58.677644+0000","last_undegraded":"2023-11-13T11:28:58.677644+0000","last_fullsized":"2023-11-13T11:28:58.677644+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-13T11:28:56.008687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-13T11:28:56.008687+0000","last_clean_scrub_stamp":"2023-11-13T11:28:56.008687+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-14T18:32:13.991035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-13T11:28:58.617421+0000","last_change":"2023-11-13T11:28:57.635747+0000","last_active":"2023-11-13T11:28:58.617421+0000","last_peered":"2023-11-13T11:28:58.617421+0000","last_clean":"2023-11-13T11:28:58.617421+0000","last_became_active":"2023-11-13T11:28:57.635406+0000","last_became_peered":"2023-11-13T11:28:57.635406+0000","last_unstale":"2023-11-13T11:28:58.617421+0000","last_undegraded":"2023-11-13T11:28:58.617421+0000","last_fullsized":"2023-11-13T11:28:58.617421+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-13T11:28:57.010879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-13T11:28:57.010879+0000","last_clean_scrub_stamp":"2023-11-13T11:28:57.010879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-14T22:16:57.888840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1a","version":"21'1","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-13T11:28:58.676434+0000","last_change":"2023-11-13T11:28:57.047326+0000","last_active":"2023-11-13T11:28:58.676434+0000","last_peered":"2023-11-13T11:28:58.676434+0000","last_clean":"2023-11-13T11:28:58.676434+0000","last_became_active":"2023-11-13T11:28:57.047058+0000","last_became_peered":"2023-11-13T11:28:57.047058+0000","last_unstale":"2023-11-13T11:28:58.676434+0000","last_undegraded":"2023-11-13T11:28:58.676434+0000","last_fullsized":"2023-11-13T11:28:58.676434+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-13T11:28:56.008687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-13T11:28:56.008687+0000","last_clean_scrub_stamp":"2023-11-13T11:28:56.008687+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-14T21:42:18.410072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-13T11:28:58.677872+0000","last_change":"2023-11-13T11:28:57.039378+0000","last_active":"2023-11-13T11:28:58.677872+0000","last_peered":"2023-11-13T11:28:58.677872+0000","last_clean":"2023-11-13T11:28:58.677872+0000","last_became_active":"2023-11-13T11:28:57.038955+0000","last_became_peered":"2023-11-13T11:28:57.038955+0000","last_unstale":"2023-11-13T11:28:58.677872+0000","last_undegraded":"2023-11-13T11:28:58.677872+0000","last_fullsized":"2023-11-13T11:28:58.677872+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-13T11:28:56.008687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-13T11:28:56.008687+0000","last_clean_scrub_stamp":"2023-11-13T11:28:56.008687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-14T19:51:04.458821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-13T11:28:58.677161+0000","last_change":"2023-11-13T11:28:57.635612+0000","last_active":"2023-11-13T11:28:58.677161+0000","last_peered":"2023-11-13T11:28:58.677161+0000","last_clean":"2023-11-13T11:28:58.677161+0000","last_became_active":"2023-11-13T11:28:57.633904+0000","last_became_peered":"2023-11-13T11:28:57.633904+0000","last_unstale":"2023-11-13T11:28:58.677161+0000","last_undegraded":"2023-11-13T11:28:58.677161+0000","last_fullsized":"2023-11-13T11:28:58.677161+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-13T11:28:57.010879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-13T11:28:57.010879+0000","last_clean_scrub_stamp":"2023-11-13T11:28:57.010879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-14T16:47:11.682554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-13T11:28:58.676165+0000","last_change":"2023-11-13T11:28:57.050197+0000","last_active":"2023-11-13T11:28:58.676165+0000","last_peered":"2023-11-13T11:28:58.676165+0000","last_clean":"2023-11-13T11:28:58.676165+0000","last_became_active":"2023-11-13T11:28:57.049917+0000","last_became_peered":"2023-11-13T11:28:57.049917+0000","last_unstale":"2023-11-13T11:28:58.676165+0000","last_undegraded":"2023-11-13T11:28:58.676165+0000","last_fullsized":"2023-11-13T11:28:58.676165+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-13T11:28:56.008687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-13T11:28:56.008687+0000","last_clean_scrub_stamp":"2023-11-13T11:28:56.008687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-14T11:40:57.839875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-13T11:28:58.617477+0000","last_change":"2023-11-13T11:28:57.620218+0000","last_active":"2023-11-13T11:28:58.617477+0000","last_peered":"2023-11-13T11:28:58.617477+0000","last_clean":"2023-11-13T11:28:58.617477+0000","last_became_active":"2023-11-13T11:28:57.619919+0000","last_became_peered":"2023-11-13T11:28:57.619919+0000","last_unstale":"2023-11-13T11:28:58.617477+0000","last_undegraded":"2023-11-13T11:28:58.617477+0000","last_fullsized":"2023-11-13T11:28:58.617477+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-13T11:28:57.010879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-13T11:28:57.010879+0000","last_clean_scrub_stamp":"2023-11-13T11:28:57.010879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-14T21:42:19.412264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-13T11:28:58.613639+0000","last_change":"2023-11-13T11:28:57.041825+0000","last_active":"2023-11-13T11:28:58.613639+0000","last_peered":"2023-11-13T11:28:58.613639+0000","last_clean":"2023-11-13T11:28:58.613639+0000","last_became_active":"2023-11-13T11:28:57.041650+0000","last_became_peered":"2023-11-13T11:28:57.041650+0000","last_unstale":"2023-11-13T11:28:58.613639+0000","last_undegraded":"2023-11-13T11:28:58.613639+0000","last_fullsized":"2023-11-13T11:28:58.613639+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-13T11:28:56.008687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-13T11:28:56.008687+0000","last_clean_scrub_stamp":"2023-11-13T11:28:56.008687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-14T12:41:42.933021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-13T11:28:58.616521+0000","last_change":"2023-11-13T11:28:57.632784+0000","last_active":"2023-11-13T11:28:58.616521+0000","last_peered":"2023-11-13T11:28:58.616521+0000","last_clean":"2023-11-13T11:28:58.616521+0000","last_became_active":"2023-11-13T11:28:57.631854+0000","last_became_peered":"2023-11-13T11:28:57.631854+0000","last_unstale":"2023-11-13T11:28:58.616521+0000","last_undegraded":"2023-11-13T11:28:58.616521+0000","last_fullsized":"2023-11-13T11:28:58.616521+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-13T11:28:57.010879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-13T11:28:57.010879+0000","last_clean_scrub_stamp":"2023-11-13T11:28:57.010879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-14T11:40:58.842068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-13T11:28:58.677636+0000","last_change":"2023-11-13T11:28:57.049038+0000","last_active":"2023-11-13T11:28:58.677636+0000","last_peered":"2023-11-13T11:28:58.677636+0000","last_clean":"2023-11-13T11:28:58.677636+0000","last_became_active":"2023-11-13T11:28:57.048768+0000","last_became_peered":"2023-11-13T11:28:57.048768+0000","last_unstale":"2023-11-13T11:28:58.677636+0000","last_undegraded":"2023-11-13T11:28:58.677636+0000","last_fullsized":"2023-11-13T11:28:58.677636+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-13T11:28:56.008687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-13T11:28:56.008687+0000","last_clean_scrub_stamp":"2023-11-13T11:28:56.008687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-14T12:45:22.015780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-13T11:28:58.677861+0000","last_change":"2023-11-13T11:28:57.627287+0000","last_active":"2023-11-13T11:28:58.677861+0000","last_peered":"2023-11-13T11:28:58.677861+0000","last_clean":"2023-11-13T11:28:58.677861+0000","last_became_active":"2023-11-13T11:28:57.623471+0000","last_became_peered":"2023-11-13T11:28:57.623471+0000","last_unstale":"2023-11-13T11:28:58.677861+0000","last_undegraded":"2023-11-13T11:28:58.677861+0000","last_fullsized":"2023-11-13T11:28:58.677861+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-13T11:28:57.010879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-13T11:28:57.010879+0000","last_clean_scrub_stamp":"2023-11-13T11:28:57.010879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-14T22:49:31.708378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.15","version":"21'3","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-13T11:28:58.676868+0000","last_change":"2023-11-13T11:28:57.037793+0000","last_active":"2023-11-13T11:28:58.676868+0000","last_peered":"2023-11-13T11:28:58.676868+0000","last_clean":"2023-11-13T11:28:58.676868+0000","last_became_active":"2023-11-13T11:28:57.037300+0000","last_became_peered":"2023-11-13T11:28:57.037300+0000","last_unstale":"2023-11-13T11:28:58.676868+0000","last_undegraded":"2023-11-13T11:28:58.676868+0000","last_fullsized":"2023-11-13T11:28:58.676868+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-13T11:28:56.008687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-13T11:28:56.008687+0000","last_clean_scrub_stamp":"2023-11-13T11:28:56.008687+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-14T22:52:35.101002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-13T11:28:58.676110+0000","last_change":"2023-11-13T11:28:57.639554+0000","last_active":"2023-11-13T11:28:58.676110+0000","last_peered":"2023-11-13T11:28:58.676110+0000","last_clean":"2023-11-13T11:28:58.676110+0000","last_became_active":"2023-11-13T11:28:57.639192+0000","last_became_peered":"2023-11-13T11:28:57.639192+0000","last_unstale":"2023-11-13T11:28:58.676110+0000","last_undegraded":"2023-11-13T11:28:58.676110+0000","last_fullsized":"2023-11-13T11:28:58.676110+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-13T11:28:57.010879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-13T11:28:57.010879+0000","last_clean_scrub_stamp":"2023-11-13T11:28:57.010879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-14T13:13:26.359918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.14","version":"21'6","reported_seq":18,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-13T11:28:58.616288+0000","last_change":"2023-11-13T11:28:57.026285+0000","last_active":"2023-11-13T11:28:58.616288+0000","last_peered":"2023-11-13T11:28:58.616288+0000","last_clean":"2023-11-13T11:28:58.616288+0000","last_became_active":"2023-11-13T11:28:57.026026+0000","last_became_peered":"2023-11-13T11:28:57.026026+0000","last_unstale":"2023-11-13T11:28:58.616288+0000","last_undegraded":"2023-11-13T11:28:58.616288+0000","last_fullsized":"2023-11-13T11:28:58.616288+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-13T11:28:56.008687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-13T11:28:56.008687+0000","last_clean_scrub_stamp":"2023-11-13T11:28:56.008687+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-14T20:07:21.176638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-13T11:28:58.677361+0000","last_change":"2023-11-13T11:28:57.633747+0000","last_active":"2023-11-13T11:28:58.677361+0000","last_peered":"2023-11-13T11:28:58.677361+0000","last_clean":"2023-11-13T11:28:58.677361+0000","last_became_active":"2023-11-13T11:28:57.633454+0000","last_became_peered":"2023-11-13T11:28:57.633454+0000","last_unstale":"2023-11-13T11:28:58.677361+0000","last_undegraded":"2023-11-13T11:28:58.677361+0000","last_fullsized":"2023-11-13T11:28:58.677361+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-13T11:28:57.010879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-13T11:28:57.010879+0000","last_clean_scrub_stamp":"2023-11-13T11:28:57.010879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-14T16:35:00.051619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"21'2","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-13T11:28:58.676714+0000","last_change":"2023-11-13T11:28:57.039714+0000","last_active":"2023-11-13T11:28:58.676714+0000","last_peered":"2023-11-13T11:28:58.676714+0000","last_clean":"2023-11-13T11:28:58.676714+0000","last_became_active":"2023-11-13T11:28:57.039008+0000","last_became_peered":"2023-11-13T11:28:57.039008+0000","last_unstale":"2023-11-13T11:28:58.676714+0000","last_undegraded":"2023-11-13T11:28:58.676714+0000","last_fullsized":"2023-11-13T11:28:58.676714+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-13T11:28:56.008687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-13T11:28:56.008687+0000","last_clean_scrub_stamp":"2023-11-13T11:28:56.008687+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-14T11:45:58.589019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-13T11:28:58.677597+0000","last_change":"2023-11-13T11:28:57.641476+0000","last_active":"2023-11-13T11:28:58.677597+0000","last_peered":"2023-11-13T11:28:58.677597+0000","last_clean":"2023-11-13T11:28:58.677597+0000","last_became_active":"2023-11-13T11:28:57.640673+0000","last_became_peered":"2023-11-13T11:28:57.640673+0000","last_unstale":"2023-11-13T11:28:58.677597+0000","last_undegraded":"2023-11-13T11:28:58.677597+0000","last_fullsized":"2023-11-13T11:28:58.677597+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-13T11:28:57.010879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-13T11:28:57.010879+0000","last_clean_scrub_stamp":"2023-11-13T11:28:57.010879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-14T18:32:14.993227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-13T11:28:58.676518+0000","last_change":"2023-11-13T11:28:57.038744+0000","last_active":"2023-11-13T11:28:58.676518+0000","last_peered":"2023-11-13T11:28:58.676518+0000","last_clean":"2023-11-13T11:28:58.676518+0000","last_became_active":"2023-11-13T11:28:57.037589+0000","last_became_peered":"2023-11-13T11:28:57.037589+0000","last_unstale":"2023-11-13T11:28:58.676518+0000","last_undegraded":"2023-11-13T11:28:58.676518+0000","last_fullsized":"2023-11-13T11:28:58.676518+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-13T11:28:56.008687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-13T11:28:56.008687+0000","last_clean_scrub_stamp":"2023-11-13T11:28:56.008687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-14T20:31:04.049508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-13T11:28:58.676239+0000","last_change":"2023-11-13T11:28:57.642795+0000","last_active":"2023-11-13T11:28:58.676239+0000","last_peered":"2023-11-13T11:28:58.676239+0000","last_clean":"2023-11-13T11:28:58.676239+0000","last_became_active":"2023-11-13T11:28:57.642532+0000","last_became_peered":"2023-11-13T11:28:57.642532+0000","last_unstale":"2023-11-13T11:28:58.676239+0000","last_undegraded":"2023-11-13T11:28:58.676239+0000","last_fullsized":"2023-11-13T11:28:58.676239+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-13T11:28:57.010879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-13T11:28:57.010879+0000","last_clean_scrub_stamp":"2023-11-13T11:28:57.010879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-14T15:58:48.241029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-13T11:28:58.676905+0000","last_change":"2023-11-13T11:28:57.040384+0000","last_active":"2023-11-13T11:28:58.676905+0000","last_peered":"2023-11-13T11:28:58.676905+0000","last_clean":"2023-11-13T11:28:58.676905+0000","last_became_active":"2023-11-13T11:28:57.040131+0000","last_became_peered":"2023-11-13T11:28:57.040131+0000","last_unstale":"2023-11-13T11:28:58.676905+0000","last_undegraded":"2023-11-13T11:28:58.676905+0000","last_fullsized":"2023-11-13T11:28:58.676905+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-13T11:28:56.008687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-13T11:28:56.008687+0000","last_clean_scrub_stamp":"2023-11-13T11:28:56.008687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-14T20:31:04.049508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-13T11:28:58.613055+0000","last_change":"2023-11-13T11:28:57.624233+0000","last_active":"2023-11-13T11:28:58.613055+0000","last_peered":"2023-11-13T11:28:58.613055+0000","last_clean":"2023-11-13T11:28:58.613055+0000","last_became_active":"2023-11-13T11:28:57.623952+0000","last_became_peered":"2023-11-13T11:28:57.623952+0000","last_unstale":"2023-11-13T11:28:58.613055+0000","last_undegraded":"2023-11-13T11:28:58.613055+0000","last_fullsized":"2023-11-13T11:28:58.613055+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-13T11:28:57.010879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-13T11:28:57.010879+0000","last_clean_scrub_stamp":"2023-11-13T11:28:57.010879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-14T18:44:10.551024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.10","version":"21'8","reported_seq":20,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-13T11:28:58.616974+0000","last_change":"2023-11-13T11:28:57.035054+0000","last_active":"2023-11-13T11:28:58.616974+0000","last_peered":"2023-11-13T11:28:58.616974+0000","last_clean":"2023-11-13T11:28:58.616974+0000","last_became_active":"2023-11-13T11:28:57.034694+0000","last_became_peered":"2023-11-13T11:28:57.034694+0000","last_unstale":"2023-11-13T11:28:58.616974+0000","last_undegraded":"2023-11-13T11:28:58.616974+0000","last_fullsized":"2023-11-13T11:28:58.616974+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-13T11:28:56.008687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-13T11:28:56.008687+0000","last_clean_scrub_stamp":"2023-11-13T11:28:56.008687+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-14T19:51:04.458821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-13T11:28:58.675988+0000","last_change":"2023-11-13T11:28:57.640815+0000","last_active":"2023-11-13T11:28:58.675988+0000","last_peered":"2023-11-13T11:28:58.675988+0000","last_clean":"2023-11-13T11:28:58.675988+0000","last_became_active":"2023-11-13T11:28:57.639158+0000","last_became_peered":"2023-11-13T11:28:57.639158+0000","last_unstale":"2023-11-13T11:28:58.675988+0000","last_undegraded":"2023-11-13T11:28:58.675988+0000","last_fullsized":"2023-11-13T11:28:58.675988+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-13T11:28:57.010879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-13T11:28:57.010879+0000","last_clean_scrub_stamp":"2023-11-13T11:28:57.010879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-14T13:34:23.778868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.f","version":"21'1","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-13T11:28:58.677539+0000","last_change":"2023-11-13T11:28:57.047959+0000","last_active":"2023-11-13T11:28:58.677539+0000","last_peered":"2023-11-13T11:28:58.677539+0000","last_clean":"2023-11-13T11:28:58.677539+0000","last_became_active":"2023-11-13T11:28:57.047614+0000","last_became_peered":"2023-11-13T11:28:57.047614+0000","last_unstale":"2023-11-13T11:28:58.677539+0000","last_undegraded":"2023-11-13T11:28:58.677539+0000","last_fullsized":"2023-11-13T11:28:58.677539+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-13T11:28:56.008687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-13T11:28:56.008687+0000","last_clean_scrub_stamp":"2023-11-13T11:28:56.008687+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-14T18:32:13.991035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-13T11:28:58.616578+0000","last_change":"2023-11-13T11:28:57.644049+0000","last_active":"2023-11-13T11:28:58.616578+0000","last_peered":"2023-11-13T11:28:58.616578+0000","last_clean":"2023-11-13T11:28:58.616578+0000","last_became_active":"2023-11-13T11:28:57.643739+0000","last_became_peered":"2023-11-13T11:28:57.643739+0000","last_unstale":"2023-11-13T11:28:58.616578+0000","last_undegraded":"2023-11-13T11:28:58.616578+0000","last_fullsized":"2023-11-13T11:28:58.616578+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-13T11:28:57.010879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-13T11:28:57.010879+0000","last_clean_scrub_stamp":"2023-11-13T11:28:57.010879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-14T16:02:43.358281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.e","version":"21'2","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-13T11:28:58.617520+0000","last_change":"2023-11-13T11:28:57.037861+0000","last_active":"2023-11-13T11:28:58.617520+0000","last_peered":"2023-11-13T11:28:58.617520+0000","last_clean":"2023-11-13T11:28:58.617520+0000","last_became_active":"2023-11-13T11:28:57.037587+0000","last_became_peered":"2023-11-13T11:28:57.037587+0000","last_unstale":"2023-11-13T11:28:58.617520+0000","last_undegraded":"2023-11-13T11:28:58.617520+0000","last_fullsized":"2023-11-13T11:28:58.617520+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-13T11:28:56.008687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-13T11:28:56.008687+0000","last_clean_scrub_stamp":"2023-11-13T11:28:56.008687+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-14T12:47:28.656211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-13T11:28:58.677509+0000","last_change":"2023-11-13T11:28:57.627412+0000","last_active":"2023-11-13T11:28:58.677509+0000","last_peered":"2023-11-13T11:28:58.677509+0000","last_clean":"2023-11-13T11:28:58.677509+0000","last_became_active":"2023-11-13T11:28:57.627146+0000","last_became_peered":"2023-11-13T11:28:57.627146+0000","last_unstale":"2023-11-13T11:28:58.677509+0000","last_undegraded":"2023-11-13T11:28:58.677509+0000","last_fullsized":"2023-11-13T11:28:58.677509+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-13T11:28:57.010879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-13T11:28:57.010879+0000","last_clean_scrub_stamp":"2023-11-13T11:28:57.010879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-14T13:34:23.778868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"21'1","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-13T11:28:58.677545+0000","last_change":"2023-11-13T11:28:57.043781+0000","last_active":"2023-11-13T11:28:58.677545+0000","last_peered":"2023-11-13T11:28:58.677545+0000","last_clean":"2023-11-13T11:28:58.677545+0000","last_became_active":"2023-11-13T11:28:57.043532+0000","last_became_peered":"2023-11-13T11:28:57.043532+0000","last_unstale":"2023-11-13T11:28:58.677545+0000","last_undegraded":"2023-11-13T11:28:58.677545+0000","last_fullsized":"2023-11-13T11:28:58.677545+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-13T11:28:56.008687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-13T11:28:56.008687+0000","last_clean_scrub_stamp":"2023-11-13T11:28:56.008687+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-14T12:45:22.015780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-13T11:28:58.677199+0000","last_change":"2023-11-13T11:28:57.632085+0000","last_active":"2023-11-13T11:28:58.677199+0000","last_peered":"2023-11-13T11:28:58.677199+0000","last_clean":"2023-11-13T11:28:58.677199+0000","last_became_active":"2023-11-13T11:28:57.631814+0000","last_became_peered":"2023-11-13T11:28:57.631814+0000","last_unstale":"2023-11-13T11:28:58.677199+0000","last_undegraded":"2023-11-13T11:28:58.677199+0000","last_fullsized":"2023-11-13T11:28:58.677199+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-13T11:28:57.010879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-13T11:28:57.010879+0000","last_clean_scrub_stamp":"2023-11-13T11:28:57.010879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-14T16:55:58.610937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-13T11:28:58.677642+0000","last_change":"2023-11-13T11:28:57.039989+0000","last_active":"2023-11-13T11:28:58.677642+0000","last_peered":"2023-11-13T11:28:58.677642+0000","last_clean":"2023-11-13T11:28:58.677642+0000","last_became_active":"2023-11-13T11:28:57.039704+0000","last_became_peered":"2023-11-13T11:28:57.039704+0000","last_unstale":"2023-11-13T11:28:58.677642+0000","last_undegraded":"2023-11-13T11:28:58.677642+0000","last_fullsized":"2023-11-13T11:28:58.677642+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-13T11:28:56.008687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-13T11:28:56.008687+0000","last_clean_scrub_stamp":"2023-11-13T11:28:56.008687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-14T12:47:28.656211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-13T11:28:58.676483+0000","last_change":"2023-11-13T11:28:57.630328+0000","last_active":"2023-11-13T11:28:58.676483+0000","last_peered":"2023-11-13T11:28:58.676483+0000","last_clean":"2023-11-13T11:28:58.676483+0000","last_became_active":"2023-11-13T11:28:57.630018+0000","last_became_peered":"2023-11-13T11:28:57.630018+0000","last_unstale":"2023-11-13T11:28:58.676483+0000","last_undegraded":"2023-11-13T11:28:58.676483+0000","last_fullsized":"2023-11-13T11:28:58.676483+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-13T11:28:57.010879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-13T11:28:57.010879+0000","last_clean_scrub_stamp":"2023-11-13T11:28:57.010879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-14T21:59:24.741766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":165,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-13T11:28:57.612976+0000","last_change":"2023-11-13T11:28:47.002866+0000","last_active":"2023-11-13T11:28:57.612976+0000","last_peered":"2023-11-13T11:28:57.612976+0000","last_clean":"2023-11-13T11:28:57.612976+0000","last_became_active":"2023-11-13T11:28:47.001494+0000","last_became_peered":"2023-11-13T11:28:47.001494+0000","last_unstale":"2023-11-13T11:28:57.612976+0000","last_undegraded":"2023-11-13T11:28:57.612976+0000","last_fullsized":"2023-11-13T11:28:57.612976+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-13T11:28:45.879416+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-13T11:28:45.879416+0000","last_clean_scrub_stamp":"2023-11-13T11:28:45.879416+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-14T14:38:55.166320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-13T11:28:58.676303+0000","last_change":"2023-11-13T11:28:57.040424+0000","last_active":"2023-11-13T11:28:58.676303+0000","last_peered":"2023-11-13T11:28:58.676303+0000","last_clean":"2023-11-13T11:28:58.676303+0000","last_became_active":"2023-11-13T11:28:57.039831+0000","last_became_peered":"2023-11-13T11:28:57.039831+0000","last_unstale":"2023-11-13T11:28:58.676303+0000","last_undegraded":"2023-11-13T11:28:58.676303+0000","last_fullsized":"2023-11-13T11:28:58.676303+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-13T11:28:56.008687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-13T11:28:56.008687+0000","last_clean_scrub_stamp":"2023-11-13T11:28:56.008687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-14T17:58:39.868445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-13T11:28:58.617352+0000","last_change":"2023-11-13T11:28:57.633871+0000","last_active":"2023-11-13T11:28:58.617352+0000","last_peered":"2023-11-13T11:28:58.617352+0000","last_clean":"2023-11-13T11:28:58.617352+0000","last_became_active":"2023-11-13T11:28:57.633554+0000","last_became_peered":"2023-11-13T11:28:57.633554+0000","last_unstale":"2023-11-13T11:28:58.617352+0000","last_undegraded":"2023-11-13T11:28:58.617352+0000","last_fullsized":"2023-11-13T11:28:58.617352+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-13T11:28:57.010879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-13T11:28:57.010879+0000","last_clean_scrub_stamp":"2023-11-13T11:28:57.010879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-14T12:45:23.017972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-13T11:28:58.676054+0000","last_change":"2023-11-13T11:28:57.042629+0000","last_active":"2023-11-13T11:28:58.676054+0000","last_peered":"2023-11-13T11:28:58.676054+0000","last_clean":"2023-11-13T11:28:58.676054+0000","last_became_active":"2023-11-13T11:28:57.042275+0000","last_became_peered":"2023-11-13T11:28:57.042275+0000","last_unstale":"2023-11-13T11:28:58.676054+0000","last_undegraded":"2023-11-13T11:28:58.676054+0000","last_fullsized":"2023-11-13T11:28:58.676054+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-13T11:28:56.008687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-13T11:28:56.008687+0000","last_clean_scrub_stamp":"2023-11-13T11:28:56.008687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-14T18:32:13.991035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-13T11:28:58.677781+0000","last_change":"2023-11-13T11:28:57.636085+0000","last_active":"2023-11-13T11:28:58.677781+0000","last_peered":"2023-11-13T11:28:58.677781+0000","last_clean":"2023-11-13T11:28:58.677781+0000","last_became_active":"2023-11-13T11:28:57.635801+0000","last_became_peered":"2023-11-13T11:28:57.635801+0000","last_unstale":"2023-11-13T11:28:58.677781+0000","last_undegraded":"2023-11-13T11:28:58.677781+0000","last_fullsized":"2023-11-13T11:28:58.677781+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-13T11:28:57.010879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-13T11:28:57.010879+0000","last_clean_scrub_stamp":"2023-11-13T11:28:57.010879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-14T12:34:10.639080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-13T11:28:58.676552+0000","last_change":"2023-11-13T11:28:57.043663+0000","last_active":"2023-11-13T11:28:58.676552+0000","last_peered":"2023-11-13T11:28:58.676552+0000","last_clean":"2023-11-13T11:28:58.676552+0000","last_became_active":"2023-11-13T11:28:57.043395+0000","last_became_peered":"2023-11-13T11:28:57.043395+0000","last_unstale":"2023-11-13T11:28:58.676552+0000","last_undegraded":"2023-11-13T11:28:58.676552+0000","last_fullsized":"2023-11-13T11:28:58.676552+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-13T11:28:56.008687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-13T11:28:56.008687+0000","last_clean_scrub_stamp":"2023-11-13T11:28:56.008687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-14T20:39:57.924545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-13T11:28:58.677021+0000","last_change":"2023-11-13T11:28:57.630182+0000","last_active":"2023-11-13T11:28:58.677021+0000","last_peered":"2023-11-13T11:28:58.677021+0000","last_clean":"2023-11-13T11:28:58.677021+0000","last_became_active":"2023-11-13T11:28:57.629803+0000","last_became_peered":"2023-11-13T11:28:57.629803+0000","last_unstale":"2023-11-13T11:28:58.677021+0000","last_undegraded":"2023-11-13T11:28:58.677021+0000","last_fullsized":"2023-11-13T11:28:58.677021+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-13T11:28:57.010879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-13T11:28:57.010879+0000","last_clean_scrub_stamp":"2023-11-13T11:28:57.010879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-14T20:31:05.051700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-13T11:28:58.676595+0000","last_change":"2023-11-13T11:28:57.044421+0000","last_active":"2023-11-13T11:28:58.676595+0000","last_peered":"2023-11-13T11:28:58.676595+0000","last_clean":"2023-11-13T11:28:58.676595+0000","last_became_active":"2023-11-13T11:28:57.044057+0000","last_became_peered":"2023-11-13T11:28:57.044057+0000","last_unstale":"2023-11-13T11:28:58.676595+0000","last_undegraded":"2023-11-13T11:28:58.676595+0000","last_fullsized":"2023-11-13T11:28:58.676595+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-13T11:28:56.008687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-13T11:28:56.008687+0000","last_clean_scrub_stamp":"2023-11-13T11:28:56.008687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-14T16:47:10.680362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-13T11:28:58.676967+0000","last_change":"2023-11-13T11:28:57.636497+0000","last_active":"2023-11-13T11:28:58.676967+0000","last_peered":"2023-11-13T11:28:58.676967+0000","last_clean":"2023-11-13T11:28:58.676967+0000","last_became_active":"2023-11-13T11:28:57.635945+0000","last_became_peered":"2023-11-13T11:28:57.635945+0000","last_unstale":"2023-11-13T11:28:58.676967+0000","last_undegraded":"2023-11-13T11:28:58.676967+0000","last_fullsized":"2023-11-13T11:28:58.676967+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-13T11:28:57.010879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-13T11:28:57.010879+0000","last_clean_scrub_stamp":"2023-11-13T11:28:57.010879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-14T14:29:59.365142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-13T11:28:58.677456+0000","last_change":"2023-11-13T11:28:57.039925+0000","last_active":"2023-11-13T11:28:58.677456+0000","last_peered":"2023-11-13T11:28:58.677456+0000","last_clean":"2023-11-13T11:28:58.677456+0000","last_became_active":"2023-11-13T11:28:57.039611+0000","last_became_peered":"2023-11-13T11:28:57.039611+0000","last_unstale":"2023-11-13T11:28:58.677456+0000","last_undegraded":"2023-11-13T11:28:58.677456+0000","last_fullsized":"2023-11-13T11:28:58.677456+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-13T11:28:56.008687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-13T11:28:56.008687+0000","last_clean_scrub_stamp":"2023-11-13T11:28:56.008687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-14T12:34:09.636888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-13T11:28:58.616113+0000","last_change":"2023-11-13T11:28:57.640311+0000","last_active":"2023-11-13T11:28:58.616113+0000","last_peered":"2023-11-13T11:28:58.616113+0000","last_clean":"2023-11-13T11:28:58.616113+0000","last_became_active":"2023-11-13T11:28:57.638311+0000","last_became_peered":"2023-11-13T11:28:57.638311+0000","last_unstale":"2023-11-13T11:28:58.616113+0000","last_undegraded":"2023-11-13T11:28:58.616113+0000","last_fullsized":"2023-11-13T11:28:58.616113+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-13T11:28:57.010879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-13T11:28:57.010879+0000","last_clean_scrub_stamp":"2023-11-13T11:28:57.010879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-14T19:51:05.461013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-13T11:28:58.676570+0000","last_change":"2023-11-13T11:28:57.045910+0000","last_active":"2023-11-13T11:28:58.676570+0000","last_peered":"2023-11-13T11:28:58.676570+0000","last_clean":"2023-11-13T11:28:58.676570+0000","last_became_active":"2023-11-13T11:28:57.045640+0000","last_became_peered":"2023-11-13T11:28:57.045640+0000","last_unstale":"2023-11-13T11:28:58.676570+0000","last_undegraded":"2023-11-13T11:28:58.676570+0000","last_fullsized":"2023-11-13T11:28:58.676570+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-13T11:28:56.008687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-13T11:28:56.008687+0000","last_clean_scrub_stamp":"2023-11-13T11:28:56.008687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-14T18:39:08.541955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-13T11:28:58.678192+0000","last_change":"2023-11-13T11:28:57.627422+0000","last_active":"2023-11-13T11:28:58.678192+0000","last_peered":"2023-11-13T11:28:58.678192+0000","last_clean":"2023-11-13T11:28:58.678192+0000","last_became_active":"2023-11-13T11:28:57.627122+0000","last_became_peered":"2023-11-13T11:28:57.627122+0000","last_unstale":"2023-11-13T11:28:58.678192+0000","last_undegraded":"2023-11-13T11:28:58.678192+0000","last_fullsized":"2023-11-13T11:28:58.678192+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-13T11:28:57.010879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-13T11:28:57.010879+0000","last_clean_scrub_stamp":"2023-11-13T11:28:57.010879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-14T22:16:57.888840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-13T11:28:58.617682+0000","last_change":"2023-11-13T11:28:57.026473+0000","last_active":"2023-11-13T11:28:58.617682+0000","last_peered":"2023-11-13T11:28:58.617682+0000","last_clean":"2023-11-13T11:28:58.617682+0000","last_became_active":"2023-11-13T11:28:57.025877+0000","last_became_peered":"2023-11-13T11:28:57.025877+0000","last_unstale":"2023-11-13T11:28:58.617682+0000","last_undegraded":"2023-11-13T11:28:58.617682+0000","last_fullsized":"2023-11-13T11:28:58.617682+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-13T11:28:56.008687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-13T11:28:56.008687+0000","last_clean_scrub_stamp":"2023-11-13T11:28:56.008687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-14T11:40:57.839875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-13T11:28:58.617778+0000","last_change":"2023-11-13T11:28:57.632649+0000","last_active":"2023-11-13T11:28:58.617778+0000","last_peered":"2023-11-13T11:28:58.617778+0000","last_clean":"2023-11-13T11:28:58.617778+0000","last_became_active":"2023-11-13T11:28:57.632091+0000","last_became_peered":"2023-11-13T11:28:57.632091+0000","last_unstale":"2023-11-13T11:28:58.617778+0000","last_undegraded":"2023-11-13T11:28:58.617778+0000","last_fullsized":"2023-11-13T11:28:58.617778+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-13T11:28:57.010879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-13T11:28:57.010879+0000","last_clean_scrub_stamp":"2023-11-13T11:28:57.010879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-14T23:10:03.463557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"21'2","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-13T11:28:58.676636+0000","last_change":"2023-11-13T11:28:57.049041+0000","last_active":"2023-11-13T11:28:58.676636+0000","last_peered":"2023-11-13T11:28:58.676636+0000","last_clean":"2023-11-13T11:28:58.676636+0000","last_became_active":"2023-11-13T11:28:57.048609+0000","last_became_peered":"2023-11-13T11:28:57.048609+0000","last_unstale":"2023-11-13T11:28:58.676636+0000","last_undegraded":"2023-11-13T11:28:58.676636+0000","last_fullsized":"2023-11-13T11:28:58.676636+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-13T11:28:56.008687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-13T11:28:56.008687+0000","last_clean_scrub_stamp":"2023-11-13T11:28:56.008687+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-14T14:29:58.362950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-13T11:28:58.617616+0000","last_change":"2023-11-13T11:28:57.634721+0000","last_active":"2023-11-13T11:28:58.617616+0000","last_peered":"2023-11-13T11:28:58.617616+0000","last_clean":"2023-11-13T11:28:58.617616+0000","last_became_active":"2023-11-13T11:28:57.632021+0000","last_became_peered":"2023-11-13T11:28:57.632021+0000","last_unstale":"2023-11-13T11:28:58.617616+0000","last_undegraded":"2023-11-13T11:28:58.617616+0000","last_fullsized":"2023-11-13T11:28:58.617616+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-13T11:28:57.010879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-13T11:28:57.010879+0000","last_clean_scrub_stamp":"2023-11-13T11:28:57.010879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-14T20:31:05.051700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-13T11:28:58.676371+0000","last_change":"2023-11-13T11:28:57.034985+0000","last_active":"2023-11-13T11:28:58.676371+0000","last_peered":"2023-11-13T11:28:58.676371+0000","last_clean":"2023-11-13T11:28:58.676371+0000","last_became_active":"2023-11-13T11:28:57.033457+0000","last_became_peered":"2023-11-13T11:28:57.033457+0000","last_unstale":"2023-11-13T11:28:58.676371+0000","last_undegraded":"2023-11-13T11:28:58.676371+0000","last_fullsized":"2023-11-13T11:28:58.676371+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-13T11:28:56.008687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-13T11:28:56.008687+0000","last_clean_scrub_stamp":"2023-11-13T11:28:56.008687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-14T22:20:18.898387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-13T11:28:58.676138+0000","last_change":"2023-11-13T11:28:57.626943+0000","last_active":"2023-11-13T11:28:58.676138+0000","last_peered":"2023-11-13T11:28:58.676138+0000","last_clean":"2023-11-13T11:28:58.676138+0000","last_became_active":"2023-11-13T11:28:57.626766+0000","last_became_peered":"2023-11-13T11:28:57.626766+0000","last_unstale":"2023-11-13T11:28:58.676138+0000","last_undegraded":"2023-11-13T11:28:58.676138+0000","last_fullsized":"2023-11-13T11:28:58.676138+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-13T11:28:57.010879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-13T11:28:57.010879+0000","last_clean_scrub_stamp":"2023-11-13T11:28:57.010879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-14T22:55:42.143143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-13T11:28:58.617155+0000","last_change":"2023-11-13T11:28:57.034882+0000","last_active":"2023-11-13T11:28:58.617155+0000","last_peered":"2023-11-13T11:28:58.617155+0000","last_clean":"2023-11-13T11:28:58.617155+0000","last_became_active":"2023-11-13T11:28:57.032076+0000","last_became_peered":"2023-11-13T11:28:57.032076+0000","last_unstale":"2023-11-13T11:28:58.617155+0000","last_undegraded":"2023-11-13T11:28:58.617155+0000","last_fullsized":"2023-11-13T11:28:58.617155+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-13T11:28:56.008687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-13T11:28:56.008687+0000","last_clean_scrub_stamp":"2023-11-13T11:28:56.008687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-14T18:44:09.548832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-13T11:28:58.617060+0000","last_change":"2023-11-13T11:28:57.635615+0000","last_active":"2023-11-13T11:28:58.617060+0000","last_peered":"2023-11-13T11:28:58.617060+0000","last_clean":"2023-11-13T11:28:58.617060+0000","last_became_active":"2023-11-13T11:28:57.635320+0000","last_became_peered":"2023-11-13T11:28:57.635320+0000","last_unstale":"2023-11-13T11:28:58.617060+0000","last_undegraded":"2023-11-13T11:28:58.617060+0000","last_fullsized":"2023-11-13T11:28:58.617060+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-13T11:28:57.010879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-13T11:28:57.010879+0000","last_clean_scrub_stamp":"2023-11-13T11:28:57.010879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-14T18:32:14.993227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-13T11:28:58.677673+0000","last_change":"2023-11-13T11:28:57.043470+0000","last_active":"2023-11-13T11:28:58.677673+0000","last_peered":"2023-11-13T11:28:58.677673+0000","last_clean":"2023-11-13T11:28:58.677673+0000","last_became_active":"2023-11-13T11:28:57.043103+0000","last_became_peered":"2023-11-13T11:28:57.043103+0000","last_unstale":"2023-11-13T11:28:58.677673+0000","last_undegraded":"2023-11-13T11:28:58.677673+0000","last_fullsized":"2023-11-13T11:28:58.677673+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-13T11:28:56.008687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-13T11:28:56.008687+0000","last_clean_scrub_stamp":"2023-11-13T11:28:56.008687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-14T22:20:18.898387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-13T11:28:58.676669+0000","last_change":"2023-11-13T11:28:57.642841+0000","last_active":"2023-11-13T11:28:58.676669+0000","last_peered":"2023-11-13T11:28:58.676669+0000","last_clean":"2023-11-13T11:28:58.676669+0000","last_became_active":"2023-11-13T11:28:57.642544+0000","last_became_peered":"2023-11-13T11:28:57.642544+0000","last_unstale":"2023-11-13T11:28:58.676669+0000","last_undegraded":"2023-11-13T11:28:58.676669+0000","last_fullsized":"2023-11-13T11:28:58.676669+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-13T11:28:57.010879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-13T11:28:57.010879+0000","last_clean_scrub_stamp":"2023-11-13T11:28:57.010879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-14T13:40:46.543740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"21'2","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-13T11:28:58.676211+0000","last_change":"2023-11-13T11:28:57.040625+0000","last_active":"2023-11-13T11:28:58.676211+0000","last_peered":"2023-11-13T11:28:58.676211+0000","last_clean":"2023-11-13T11:28:58.676211+0000","last_became_active":"2023-11-13T11:28:57.040126+0000","last_became_peered":"2023-11-13T11:28:57.040126+0000","last_unstale":"2023-11-13T11:28:58.676211+0000","last_undegraded":"2023-11-13T11:28:58.676211+0000","last_fullsized":"2023-11-13T11:28:58.676211+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-13T11:28:56.008687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-13T11:28:56.008687+0000","last_clean_scrub_stamp":"2023-11-13T11:28:56.008687+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-14T12:47:28.656211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-13T11:28:58.676350+0000","last_change":"2023-11-13T11:28:57.627475+0000","last_active":"2023-11-13T11:28:58.676350+0000","last_peered":"2023-11-13T11:28:58.676350+0000","last_clean":"2023-11-13T11:28:58.676350+0000","last_became_active":"2023-11-13T11:28:57.627157+0000","last_became_peered":"2023-11-13T11:28:57.627157+0000","last_unstale":"2023-11-13T11:28:58.676350+0000","last_undegraded":"2023-11-13T11:28:58.676350+0000","last_fullsized":"2023-11-13T11:28:58.676350+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-13T11:28:57.010879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-13T11:28:57.010879+0000","last_clean_scrub_stamp":"2023-11-13T11:28:57.010879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-14T15:37:40.674035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-13T11:28:58.676431+0000","last_change":"2023-11-13T11:28:57.642899+0000","last_active":"2023-11-13T11:28:58.676431+0000","last_peered":"2023-11-13T11:28:58.676431+0000","last_clean":"2023-11-13T11:28:58.676431+0000","last_became_active":"2023-11-13T11:28:57.642602+0000","last_became_peered":"2023-11-13T11:28:57.642602+0000","last_unstale":"2023-11-13T11:28:58.676431+0000","last_undegraded":"2023-11-13T11:28:58.676431+0000","last_fullsized":"2023-11-13T11:28:58.676431+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-13T11:28:57.010879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-13T11:28:57.010879+0000","last_clean_scrub_stamp":"2023-11-13T11:28:57.010879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-14T13:30:56.684256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1c","version":"21'2","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-13T11:28:58.677239+0000","last_change":"2023-11-13T11:28:57.049062+0000","last_active":"2023-11-13T11:28:58.677239+0000","last_peered":"2023-11-13T11:28:58.677239+0000","last_clean":"2023-11-13T11:28:58.677239+0000","last_became_active":"2023-11-13T11:28:57.048825+0000","last_became_peered":"2023-11-13T11:28:57.048825+0000","last_unstale":"2023-11-13T11:28:58.677239+0000","last_undegraded":"2023-11-13T11:28:58.677239+0000","last_fullsized":"2023-11-13T11:28:58.677239+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-13T11:28:56.008687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-13T11:28:56.008687+0000","last_clean_scrub_stamp":"2023-11-13T11:28:56.008687+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-14T22:16:56.886648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-13T11:28:58.613304+0000","last_change":"2023-11-13T11:28:57.636491+0000","last_active":"2023-11-13T11:28:58.613304+0000","last_peered":"2023-11-13T11:28:58.613304+0000","last_clean":"2023-11-13T11:28:58.613304+0000","last_became_active":"2023-11-13T11:28:57.636231+0000","last_became_peered":"2023-11-13T11:28:57.636231+0000","last_unstale":"2023-11-13T11:28:58.613304+0000","last_undegraded":"2023-11-13T11:28:58.613304+0000","last_fullsized":"2023-11-13T11:28:58.613304+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-13T11:28:57.010879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-13T11:28:57.010879+0000","last_clean_scrub_stamp":"2023-11-13T11:28:57.010879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-14T22:20:19.900579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"21'2","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-13T11:28:58.677362+0000","last_change":"2023-11-13T11:28:57.045391+0000","last_active":"2023-11-13T11:28:58.677362+0000","last_peered":"2023-11-13T11:28:58.677362+0000","last_clean":"2023-11-13T11:28:58.677362+0000","last_became_active":"2023-11-13T11:28:57.045092+0000","last_became_peered":"2023-11-13T11:28:57.045092+0000","last_unstale":"2023-11-13T11:28:58.677362+0000","last_undegraded":"2023-11-13T11:28:58.677362+0000","last_fullsized":"2023-11-13T11:28:58.677362+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-13T11:28:56.008687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-13T11:28:56.008687+0000","last_clean_scrub_stamp":"2023-11-13T11:28:56.008687+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-14T17:58:39.868445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-13T11:28:58.677800+0000","last_change":"2023-11-13T11:28:57.625394+0000","last_active":"2023-11-13T11:28:58.677800+0000","last_peered":"2023-11-13T11:28:58.677800+0000","last_clean":"2023-11-13T11:28:58.677800+0000","last_became_active":"2023-11-13T11:28:57.624669+0000","last_became_peered":"2023-11-13T11:28:57.624669+0000","last_unstale":"2023-11-13T11:28:58.677800+0000","last_undegraded":"2023-11-13T11:28:58.677800+0000","last_fullsized":"2023-11-13T11:28:58.677800+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-13T11:28:57.010879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-13T11:28:57.010879+0000","last_clean_scrub_stamp":"2023-11-13T11:28:57.010879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-14T16:35:00.051619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1e","version":"21'1","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-13T11:28:58.677808+0000","last_change":"2023-11-13T11:28:57.042653+0000","last_active":"2023-11-13T11:28:58.677808+0000","last_peered":"2023-11-13T11:28:58.677808+0000","last_clean":"2023-11-13T11:28:58.677808+0000","last_became_active":"2023-11-13T11:28:57.042473+0000","last_became_peered":"2023-11-13T11:28:57.042473+0000","last_unstale":"2023-11-13T11:28:58.677808+0000","last_undegraded":"2023-11-13T11:28:58.677808+0000","last_fullsized":"2023-11-13T11:28:58.677808+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-13T11:28:56.008687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-13T11:28:56.008687+0000","last_clean_scrub_stamp":"2023-11-13T11:28:56.008687+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-14T22:16:56.886648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-13T11:28:58.677689+0000","last_change":"2023-11-13T11:28:57.636379+0000","last_active":"2023-11-13T11:28:58.677689+0000","last_peered":"2023-11-13T11:28:58.677689+0000","last_clean":"2023-11-13T11:28:58.677689+0000","last_became_active":"2023-11-13T11:28:57.636105+0000","last_became_peered":"2023-11-13T11:28:57.636105+0000","last_unstale":"2023-11-13T11:28:58.677689+0000","last_undegraded":"2023-11-13T11:28:58.677689+0000","last_fullsized":"2023-11-13T11:28:58.677689+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-13T11:28:57.010879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-13T11:28:57.010879+0000","last_clean_scrub_stamp":"2023-11-13T11:28:57.010879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-14T13:24:50.764716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1f","version":"21'4","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-13T11:28:58.617784+0000","last_change":"2023-11-13T11:28:57.046686+0000","last_active":"2023-11-13T11:28:58.617784+0000","last_peered":"2023-11-13T11:28:58.617784+0000","last_clean":"2023-11-13T11:28:58.617784+0000","last_became_active":"2023-11-13T11:28:57.046334+0000","last_became_peered":"2023-11-13T11:28:57.046334+0000","last_unstale":"2023-11-13T11:28:58.617784+0000","last_undegraded":"2023-11-13T11:28:58.617784+0000","last_fullsized":"2023-11-13T11:28:58.617784+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-13T11:28:56.008687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-13T11:28:56.008687+0000","last_clean_scrub_stamp":"2023-11-13T11:28:56.008687+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-14T16:02:42.356089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":15,"seq":64424509445,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":221184,"data_stored":76252,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83999999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77600000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80600000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95699999999999996}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94099999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92300000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.028}]}]},{"osd":5,"up_from":15,"seq":64424509445,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27820,"kb_used_data":800,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344020,"statfs":{"total":96636764160,"available":96608276480,"internally_reserved":0,"allocated":819200,"data_stored":665743,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54500000000000004}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58999999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63200000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72899999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.499}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71099999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78600000000000003}]}]},{"osd":4,"up_from":15,"seq":64424509444,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27256,"kb_used_data":236,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344584,"statfs":{"total":96636764160,"available":96608854016,"internally_reserved":0,"allocated":241664,"data_stored":78536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56699999999999995}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75900000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71799999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80700000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84999999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78400000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73499999999999999}]}]},{"osd":3,"up_from":15,"seq":64424509445,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27240,"kb_used_data":220,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344600,"statfs":{"total":96636764160,"available":96608870400,"internally_reserved":0,"allocated":225280,"data_stored":76834,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33500000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48199999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57599999999999996}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77200000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68000000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67200000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65600000000000003}]}]},{"osd":2,"up_from":15,"seq":64424509445,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27248,"kb_used_data":228,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344592,"statfs":{"total":96636764160,"available":96608862208,"internally_reserved":0,"allocated":233472,"data_stored":77864,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40100000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51100000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42699999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92100000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88600000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90400000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97899999999999998}]}]},{"osd":1,"up_from":15,"seq":64424509446,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27824,"kb_used_data":800,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344016,"statfs":{"total":96636764160,"available":96608272384,"internally_reserved":0,"allocated":819200,"data_stored":666690,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32600000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.372}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40000000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61199999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56399999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58299999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65500000000000003}]}]},{"osd":0,"up_from":15,"seq":64424509446,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27240,"kb_used_data":220,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344600,"statfs":{"total":96636764160,"available":96608870400,"internally_reserved":0,"allocated":225280,"data_stored":75339,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34799999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51800000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.497}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85199999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70599999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90800000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78900000000000003}]}]},{"osd":7,"up_from":14,"seq":60129542149,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27252,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344588,"statfs":{"total":96636764160,"available":96608858112,"internally_reserved":0,"allocated":229376,"data_stored":76376,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.439}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66900000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48599999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63300000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41399999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61399999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59499999999999997}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-13T11:29:02.104 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-13T11:29:02.274 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:02.271+0000 7f85ff432640 1 Processor -- start 2023-11-13T11:29:02.275 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:02.271+0000 7f85ff432640 1 -- start start 2023-11-13T11:29:02.277 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:02.271+0000 7f85ff432640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f85f80d3810 0x7f85f80d10a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:02.277 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:02.271+0000 7f85ff432640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f85f80d15e0 0x7f85f80b2cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:02.277 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:02.271+0000 7f85ff432640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f85f80b27f0 con 0x7f85f815d060 2023-11-13T11:29:02.278 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:02.271+0000 7f85ff432640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f85f80d1a70 con 0x7f85f80d15e0 2023-11-13T11:29:02.278 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:02.271+0000 7f85ff432640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f85f80cebe0 con 0x7f85f80d3810 2023-11-13T11:29:02.278 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:02.271+0000 7f85fec31640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f85f80d15e0 0x7f85f80b2cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:02.278 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:02.271+0000 7f85fec31640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f85f80d15e0 0x7f85f80b2cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:36116/0 (socket says 172.21.15.102:36116) 2023-11-13T11:29:02.279 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:02.271+0000 7f85fec31640 1 -- 172.21.15.102:0/1392698860 learned_addr learned my addr 172.21.15.102:0/1392698860 (peer_addr_for_me v2:172.21.15.102:0/0) 2023-11-13T11:29:02.279 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:02.271+0000 7f85fdc2f640 1 --2- 172.21.15.102:0/1392698860 >> v2:172.21.15.154:3300/0 conn(0x7f85f80d3810 0x7f85f80d10a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:02.279 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:02.271+0000 7f85fec31640 1 -- 172.21.15.102:0/1392698860 >> v2:172.21.15.154:3300/0 conn(0x7f85f80d3810 msgr2=0x7f85f80d10a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-13T11:29:02.279 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:02.271+0000 7f85fec31640 1 --2- 172.21.15.102:0/1392698860 >> v2:172.21.15.154:3300/0 conn(0x7f85f80d3810 0x7f85f80d10a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:02.279 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:02.271+0000 7f85fec31640 1 -- 172.21.15.102:0/1392698860 >> v1:172.21.15.154:6789/0 conn(0x7f85f815d060 legacy=0x7f85f80d08c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-13T11:29:02.280 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:02.271+0000 7f85fec31640 1 -- 172.21.15.102:0/1392698860 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85f80ce340 con 0x7f85f80d15e0 2023-11-13T11:29:02.281 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:02.275+0000 7f85fec31640 1 --2- 172.21.15.102:0/1392698860 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f85f80d15e0 0x7f85f80b2cd0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f85f808b4f0 tx=0x7f85f001c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8c5477e049c4a23c server_cookie=0 in_seq=0 out_seq=0 2023-11-13T11:29:02.281 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:02.275+0000 7f85fd42e640 1 -- 172.21.15.102:0/1392698860 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85f00a5850 con 0x7f85f80d15e0 2023-11-13T11:29:02.281 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:02.275+0000 7f85fd42e640 1 -- 172.21.15.102:0/1392698860 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f85f00a59b0 con 0x7f85f80d15e0 2023-11-13T11:29:02.281 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:02.275+0000 7f85fd42e640 1 -- 172.21.15.102:0/1392698860 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85f00a5d40 con 0x7f85f80d15e0 2023-11-13T11:29:02.282 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:02.275+0000 7f85ff432640 1 -- 172.21.15.102:0/1392698860 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f85f80d15e0 msgr2=0x7f85f80b2cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:02.282 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:02.275+0000 7f85ff432640 1 --2- 172.21.15.102:0/1392698860 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f85f80d15e0 0x7f85f80b2cd0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f85f808b4f0 tx=0x7f85f001c990 comp rx=0 tx=0).stop 2023-11-13T11:29:02.282 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:02.275+0000 7f85ff432640 1 -- 172.21.15.102:0/1392698860 shutdown_connections 2023-11-13T11:29:02.282 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:02.275+0000 7f85ff432640 1 --2- 172.21.15.102:0/1392698860 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f85f80d15e0 0x7f85f80b2cd0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:02.283 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:02.275+0000 7f85ff432640 1 --2- 172.21.15.102:0/1392698860 >> v2:172.21.15.154:3300/0 conn(0x7f85f80d3810 0x7f85f80d10a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:02.283 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:02.275+0000 7f85ff432640 1 -- 172.21.15.102:0/1392698860 >> 172.21.15.102:0/1392698860 conn(0x7f85f80d2cf0 msgr2=0x7f85f80d3100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-13T11:29:02.283 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:02.275+0000 7f85ff432640 1 -- 172.21.15.102:0/1392698860 shutdown_connections 2023-11-13T11:29:02.283 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:02.275+0000 7f85ff432640 1 -- 172.21.15.102:0/1392698860 wait complete. 2023-11-13T11:29:02.285 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:02.275+0000 7f85ff432640 1 Processor -- start 2023-11-13T11:29:02.286 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:02.279+0000 7f85ff432640 1 -- start start 2023-11-13T11:29:02.286 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:02.279+0000 7f85ff432640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f85f80d15e0 0x7f85f81531f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:02.286 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:02.279+0000 7f85ff432640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f85f80d3810 0x7f85f806b2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:02.286 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:02.279+0000 7f85ff432640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f85f815d060 0x7f85f806b830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:02.287 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:02.279+0000 7f85ff432640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85f80b72b0 con 0x7f85f815d060 2023-11-13T11:29:02.287 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:02.279+0000 7f85ff432640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85f80b7440 con 0x7f85f80d15e0 2023-11-13T11:29:02.287 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:02.279+0000 7f85ff432640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f85f8153730 con 0x7f85f80d3810 2023-11-13T11:29:02.287 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:02.279+0000 7f85fec31640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f85f815d060 0x7f85f806b830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:02.287 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:02.279+0000 7f85fec31640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f85f815d060 0x7f85f806b830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:36128/0 (socket says 172.21.15.102:36128) 2023-11-13T11:29:02.288 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:02.279+0000 7f85fec31640 1 -- 172.21.15.102:0/2834130441 learned_addr learned my addr 172.21.15.102:0/2834130441 (peer_addr_for_me v2:172.21.15.102:0/0) 2023-11-13T11:29:02.288 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:02.279+0000 7f85fec31640 1 -- 172.21.15.102:0/2834130441 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f85f80d3810 msgr2=0x7f85f806b2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:02.288 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:02.279+0000 7f85fec31640 1 --2- 172.21.15.102:0/2834130441 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f85f80d3810 0x7f85f806b2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:02.288 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:02.279+0000 7f85fec31640 1 -- 172.21.15.102:0/2834130441 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f85f80d15e0 msgr2=0x7f85f81531f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:02.288 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:02.279+0000 7f85fe430640 1 --2- 172.21.15.102:0/2834130441 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f85f80d15e0 0x7f85f81531f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:02.289 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:02.279+0000 7f85fec31640 1 --2- 172.21.15.102:0/2834130441 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f85f80d15e0 0x7f85f81531f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:02.289 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:02.279+0000 7f85fec31640 1 -- 172.21.15.102:0/2834130441 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85f0009b30 con 0x7f85f815d060 2023-11-13T11:29:02.289 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:02.279+0000 7f85fe430640 1 --2- 172.21.15.102:0/2834130441 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f85f80d15e0 0x7f85f81531f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-13T11:29:02.289 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:02.279+0000 7f85fec31640 1 --2- 172.21.15.102:0/2834130441 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f85f815d060 0x7f85f806b830 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f85f0009e50 tx=0x7f85f0019730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-13T11:29:02.289 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:02.279+0000 7f85eeffd640 1 -- 172.21.15.102:0/2834130441 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85f00b8670 con 0x7f85f815d060 2023-11-13T11:29:02.289 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:02.279+0000 7f85eeffd640 1 -- 172.21.15.102:0/2834130441 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f85f00b87f0 con 0x7f85f815d060 2023-11-13T11:29:02.290 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:02.279+0000 7f85eeffd640 1 -- 172.21.15.102:0/2834130441 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85f00b8ba0 con 0x7f85f815d060 2023-11-13T11:29:02.290 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:02.279+0000 7f85ff432640 1 -- 172.21.15.102:0/2834130441 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f85f80cc840 con 0x7f85f815d060 2023-11-13T11:29:02.290 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:02.279+0000 7f85ff432640 1 -- 172.21.15.102:0/2834130441 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f85f80ccae0 con 0x7f85f815d060 2023-11-13T11:29:02.290 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:02.279+0000 7f85ff432640 1 -- 172.21.15.102:0/2834130441 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f85f80b75d0 con 0x7f85f815d060 2023-11-13T11:29:02.291 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:02.283+0000 7f85eeffd640 1 -- 172.21.15.102:0/2834130441 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f85f00b8d00 con 0x7f85f815d060 2023-11-13T11:29:02.292 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:02.283+0000 7f85eeffd640 1 --2- 172.21.15.102:0/2834130441 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f85dc066470 0x7f85dc068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:02.292 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:02.283+0000 7f85eeffd640 1 -- 172.21.15.102:0/2834130441 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f85f011f300 con 0x7f85f815d060 2023-11-13T11:29:02.292 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:02.283+0000 7f85fe430640 1 --2- 172.21.15.102:0/2834130441 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f85dc066470 0x7f85dc068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:02.292 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:02.283+0000 7f85fe430640 1 --2- 172.21.15.102:0/2834130441 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f85dc066470 0x7f85dc068930 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f85f80b16c0 tx=0x7f85f4009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-13T11:29:02.292 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:02.287+0000 7f85eeffd640 1 -- 172.21.15.102:0/2834130441 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f85f00ec820 con 0x7f85f815d060 2023-11-13T11:29:02.362 INFO:tasks.ceph.mds.d.smithi154.stderr:2023-11-13T11:29:02.359+0000 7fec4274d640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-11-13T11:29:02.441 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:02.435+0000 7f85ff432640 1 -- 172.21.15.102:0/2834130441 --> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f85f8068520 con 0x7f85dc066470 2023-11-13T11:29:02.448 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:02.443+0000 7f85eeffd640 1 -- 172.21.15.102:0/2834130441 <== mgr.4103 v2:172.21.15.102:6832/1009482693 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+264713 (secure 0 0 0) 0x7f85f8068520 con 0x7f85dc066470 2023-11-13T11:29:02.452 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T11:29:02.453 INFO:teuthology.orchestra.run.smithi102.stderr:dumped all 2023-11-13T11:29:02.454 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:02.447+0000 7f85ff432640 1 -- 172.21.15.102:0/2834130441 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f85dc066470 msgr2=0x7f85dc068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:02.455 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:02.447+0000 7f85ff432640 1 --2- 172.21.15.102:0/2834130441 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f85dc066470 0x7f85dc068930 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f85f80b16c0 tx=0x7f85f4009040 comp rx=0 tx=0).stop 2023-11-13T11:29:02.455 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:02.447+0000 7f85ff432640 1 -- 172.21.15.102:0/2834130441 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f85f815d060 msgr2=0x7f85f806b830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:02.455 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:02.447+0000 7f85ff432640 1 --2- 172.21.15.102:0/2834130441 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f85f815d060 0x7f85f806b830 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f85f0009e50 tx=0x7f85f0019730 comp rx=0 tx=0).stop 2023-11-13T11:29:02.455 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:02.447+0000 7f85ff432640 1 -- 172.21.15.102:0/2834130441 shutdown_connections 2023-11-13T11:29:02.456 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:02.447+0000 7f85ff432640 1 --2- 172.21.15.102:0/2834130441 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f85dc066470 0x7f85dc068930 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:02.456 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:02.447+0000 7f85ff432640 1 --2- 172.21.15.102:0/2834130441 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f85f815d060 0x7f85f806b830 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:02.456 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:02.447+0000 7f85ff432640 1 --2- 172.21.15.102:0/2834130441 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f85f80d3810 0x7f85f806b2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:02.457 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:02.447+0000 7f85ff432640 1 --2- 172.21.15.102:0/2834130441 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f85f80d15e0 0x7f85f81531f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:02.457 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:02.447+0000 7f85ff432640 1 -- 172.21.15.102:0/2834130441 >> 172.21.15.102:0/2834130441 conn(0x7f85f80d2cf0 msgr2=0x7f85f80d30d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-13T11:29:02.457 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:02.447+0000 7f85ff432640 1 -- 172.21.15.102:0/2834130441 shutdown_connections 2023-11-13T11:29:02.457 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:02.447+0000 7f85ff432640 1 -- 172.21.15.102:0/2834130441 wait complete. 2023-11-13T11:29:02.471 INFO:teuthology.orchestra.run.smithi102.stdout:{"pg_ready":true,"pg_map":{"version":24,"stamp":"2023-11-13T11:29:00.923499+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219116,"kb_used_data":2944,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755604,"statfs":{"total":773094113280,"available":772869738496,"internally_reserved":0,"allocated":3014656,"data_stored":1793634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":41,"apply_latency_ms":41,"commit_latency_ns":41000000,"apply_latency_ns":41000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.911886"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-13T11:28:58.677490+0000","last_change":"2023-11-13T11:28:57.639845+0000","last_active":"2023-11-13T11:28:58.677490+0000","last_peered":"2023-11-13T11:28:58.677490+0000","last_clean":"2023-11-13T11:28:58.677490+0000","last_became_active":"2023-11-13T11:28:57.639218+0000","last_became_peered":"2023-11-13T11:28:57.639218+0000","last_unstale":"2023-11-13T11:28:58.677490+0000","last_undegraded":"2023-11-13T11:28:58.677490+0000","last_fullsized":"2023-11-13T11:28:58.677490+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-13T11:28:57.010879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-13T11:28:57.010879+0000","last_clean_scrub_stamp":"2023-11-13T11:28:57.010879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-14T22:49:31.708378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-13T11:28:58.677700+0000","last_change":"2023-11-13T11:28:57.627422+0000","last_active":"2023-11-13T11:28:58.677700+0000","last_peered":"2023-11-13T11:28:58.677700+0000","last_clean":"2023-11-13T11:28:58.677700+0000","last_became_active":"2023-11-13T11:28:57.627084+0000","last_became_peered":"2023-11-13T11:28:57.627084+0000","last_unstale":"2023-11-13T11:28:58.677700+0000","last_undegraded":"2023-11-13T11:28:58.677700+0000","last_fullsized":"2023-11-13T11:28:58.677700+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-13T11:28:57.010879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-13T11:28:57.010879+0000","last_clean_scrub_stamp":"2023-11-13T11:28:57.010879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-14T13:51:35.559492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-13T11:28:58.677559+0000","last_change":"2023-11-13T11:28:57.624354+0000","last_active":"2023-11-13T11:28:58.677559+0000","last_peered":"2023-11-13T11:28:58.677559+0000","last_clean":"2023-11-13T11:28:58.677559+0000","last_became_active":"2023-11-13T11:28:57.624146+0000","last_became_peered":"2023-11-13T11:28:57.624146+0000","last_unstale":"2023-11-13T11:28:58.677559+0000","last_undegraded":"2023-11-13T11:28:58.677559+0000","last_fullsized":"2023-11-13T11:28:58.677559+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-13T11:28:57.010879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-13T11:28:57.010879+0000","last_clean_scrub_stamp":"2023-11-13T11:28:57.010879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-14T18:39:09.544147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-13T11:28:58.616239+0000","last_change":"2023-11-13T11:28:57.631455+0000","last_active":"2023-11-13T11:28:58.616239+0000","last_peered":"2023-11-13T11:28:58.616239+0000","last_clean":"2023-11-13T11:28:58.616239+0000","last_became_active":"2023-11-13T11:28:57.630777+0000","last_became_peered":"2023-11-13T11:28:57.630777+0000","last_unstale":"2023-11-13T11:28:58.616239+0000","last_undegraded":"2023-11-13T11:28:58.616239+0000","last_fullsized":"2023-11-13T11:28:58.616239+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-13T11:28:57.010879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-13T11:28:57.010879+0000","last_clean_scrub_stamp":"2023-11-13T11:28:57.010879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-14T12:47:29.658403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-13T11:28:58.676950+0000","last_change":"2023-11-13T11:28:57.636281+0000","last_active":"2023-11-13T11:28:58.676950+0000","last_peered":"2023-11-13T11:28:58.676950+0000","last_clean":"2023-11-13T11:28:58.676950+0000","last_became_active":"2023-11-13T11:28:57.635550+0000","last_became_peered":"2023-11-13T11:28:57.635550+0000","last_unstale":"2023-11-13T11:28:58.676950+0000","last_undegraded":"2023-11-13T11:28:58.676950+0000","last_fullsized":"2023-11-13T11:28:58.676950+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-13T11:28:57.010879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-13T11:28:57.010879+0000","last_clean_scrub_stamp":"2023-11-13T11:28:57.010879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-14T22:20:14.170174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-13T11:28:58.616167+0000","last_change":"2023-11-13T11:28:57.638583+0000","last_active":"2023-11-13T11:28:58.616167+0000","last_peered":"2023-11-13T11:28:58.616167+0000","last_clean":"2023-11-13T11:28:58.616167+0000","last_became_active":"2023-11-13T11:28:57.638322+0000","last_became_peered":"2023-11-13T11:28:57.638322+0000","last_unstale":"2023-11-13T11:28:58.616167+0000","last_undegraded":"2023-11-13T11:28:58.616167+0000","last_fullsized":"2023-11-13T11:28:58.616167+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-13T11:28:57.010879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-13T11:28:57.010879+0000","last_clean_scrub_stamp":"2023-11-13T11:28:57.010879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-14T22:20:19.900579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-13T11:28:58.676818+0000","last_change":"2023-11-13T11:28:57.628322+0000","last_active":"2023-11-13T11:28:58.676818+0000","last_peered":"2023-11-13T11:28:58.676818+0000","last_clean":"2023-11-13T11:28:58.676818+0000","last_became_active":"2023-11-13T11:28:57.628022+0000","last_became_peered":"2023-11-13T11:28:57.628022+0000","last_unstale":"2023-11-13T11:28:58.676818+0000","last_undegraded":"2023-11-13T11:28:58.676818+0000","last_fullsized":"2023-11-13T11:28:58.676818+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-13T11:28:57.010879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-13T11:28:57.010879+0000","last_clean_scrub_stamp":"2023-11-13T11:28:57.010879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-14T16:47:11.682554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-13T11:28:58.676863+0000","last_change":"2023-11-13T11:28:57.635006+0000","last_active":"2023-11-13T11:28:58.676863+0000","last_peered":"2023-11-13T11:28:58.676863+0000","last_clean":"2023-11-13T11:28:58.676863+0000","last_became_active":"2023-11-13T11:28:57.634769+0000","last_became_peered":"2023-11-13T11:28:57.634769+0000","last_unstale":"2023-11-13T11:28:58.676863+0000","last_undegraded":"2023-11-13T11:28:58.676863+0000","last_fullsized":"2023-11-13T11:28:58.676863+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-13T11:28:57.010879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-13T11:28:57.010879+0000","last_clean_scrub_stamp":"2023-11-13T11:28:57.010879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-14T21:42:19.412264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-13T11:28:58.613659+0000","last_change":"2023-11-13T11:28:57.623676+0000","last_active":"2023-11-13T11:28:58.613659+0000","last_peered":"2023-11-13T11:28:58.613659+0000","last_clean":"2023-11-13T11:28:58.613659+0000","last_became_active":"2023-11-13T11:28:57.623400+0000","last_became_peered":"2023-11-13T11:28:57.623400+0000","last_unstale":"2023-11-13T11:28:58.613659+0000","last_undegraded":"2023-11-13T11:28:58.613659+0000","last_fullsized":"2023-11-13T11:28:58.613659+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-13T11:28:57.010879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-13T11:28:57.010879+0000","last_clean_scrub_stamp":"2023-11-13T11:28:57.010879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-14T17:58:40.870637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-13T11:28:58.677620+0000","last_change":"2023-11-13T11:28:57.636734+0000","last_active":"2023-11-13T11:28:58.677620+0000","last_peered":"2023-11-13T11:28:58.677620+0000","last_clean":"2023-11-13T11:28:58.677620+0000","last_became_active":"2023-11-13T11:28:57.636461+0000","last_became_peered":"2023-11-13T11:28:57.636461+0000","last_unstale":"2023-11-13T11:28:58.677620+0000","last_undegraded":"2023-11-13T11:28:58.677620+0000","last_fullsized":"2023-11-13T11:28:58.677620+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-13T11:28:57.010879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-13T11:28:57.010879+0000","last_clean_scrub_stamp":"2023-11-13T11:28:57.010879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-14T13:13:26.359918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-13T11:28:58.677026+0000","last_change":"2023-11-13T11:28:57.639520+0000","last_active":"2023-11-13T11:28:58.677026+0000","last_peered":"2023-11-13T11:28:58.677026+0000","last_clean":"2023-11-13T11:28:58.677026+0000","last_became_active":"2023-11-13T11:28:57.639240+0000","last_became_peered":"2023-11-13T11:28:57.639240+0000","last_unstale":"2023-11-13T11:28:58.677026+0000","last_undegraded":"2023-11-13T11:28:58.677026+0000","last_fullsized":"2023-11-13T11:28:58.677026+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-13T11:28:57.010879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-13T11:28:57.010879+0000","last_clean_scrub_stamp":"2023-11-13T11:28:57.010879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-14T18:39:09.544147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-13T11:28:58.677082+0000","last_change":"2023-11-13T11:28:57.634782+0000","last_active":"2023-11-13T11:28:58.677082+0000","last_peered":"2023-11-13T11:28:58.677082+0000","last_clean":"2023-11-13T11:28:58.677082+0000","last_became_active":"2023-11-13T11:28:57.634488+0000","last_became_peered":"2023-11-13T11:28:57.634488+0000","last_unstale":"2023-11-13T11:28:58.677082+0000","last_undegraded":"2023-11-13T11:28:58.677082+0000","last_fullsized":"2023-11-13T11:28:58.677082+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-13T11:28:57.010879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-13T11:28:57.010879+0000","last_clean_scrub_stamp":"2023-11-13T11:28:57.010879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-14T13:24:50.764716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-13T11:28:58.677279+0000","last_change":"2023-11-13T11:28:57.644331+0000","last_active":"2023-11-13T11:28:58.677279+0000","last_peered":"2023-11-13T11:28:58.677279+0000","last_clean":"2023-11-13T11:28:58.677279+0000","last_became_active":"2023-11-13T11:28:57.643877+0000","last_became_peered":"2023-11-13T11:28:57.643877+0000","last_unstale":"2023-11-13T11:28:58.677279+0000","last_undegraded":"2023-11-13T11:28:58.677279+0000","last_fullsized":"2023-11-13T11:28:58.677279+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-13T11:28:57.010879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-13T11:28:57.010879+0000","last_clean_scrub_stamp":"2023-11-13T11:28:57.010879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-14T17:58:40.870637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-13T11:28:58.677454+0000","last_change":"2023-11-13T11:28:57.632228+0000","last_active":"2023-11-13T11:28:58.677454+0000","last_peered":"2023-11-13T11:28:58.677454+0000","last_clean":"2023-11-13T11:28:58.677454+0000","last_became_active":"2023-11-13T11:28:57.631793+0000","last_became_peered":"2023-11-13T11:28:57.631793+0000","last_unstale":"2023-11-13T11:28:58.677454+0000","last_undegraded":"2023-11-13T11:28:58.677454+0000","last_fullsized":"2023-11-13T11:28:58.677454+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-13T11:28:57.010879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-13T11:28:57.010879+0000","last_clean_scrub_stamp":"2023-11-13T11:28:57.010879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-14T11:40:58.842068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-13T11:28:58.677021+0000","last_change":"2023-11-13T11:28:57.643105+0000","last_active":"2023-11-13T11:28:58.677021+0000","last_peered":"2023-11-13T11:28:58.677021+0000","last_clean":"2023-11-13T11:28:58.677021+0000","last_became_active":"2023-11-13T11:28:57.642876+0000","last_became_peered":"2023-11-13T11:28:57.642876+0000","last_unstale":"2023-11-13T11:28:58.677021+0000","last_undegraded":"2023-11-13T11:28:58.677021+0000","last_fullsized":"2023-11-13T11:28:58.677021+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-13T11:28:57.010879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-13T11:28:57.010879+0000","last_clean_scrub_stamp":"2023-11-13T11:28:57.010879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-14T23:10:03.463557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-13T11:28:58.675939+0000","last_change":"2023-11-13T11:28:57.632118+0000","last_active":"2023-11-13T11:28:58.675939+0000","last_peered":"2023-11-13T11:28:58.675939+0000","last_clean":"2023-11-13T11:28:58.675939+0000","last_became_active":"2023-11-13T11:28:57.631823+0000","last_became_peered":"2023-11-13T11:28:57.631823+0000","last_unstale":"2023-11-13T11:28:58.675939+0000","last_undegraded":"2023-11-13T11:28:58.675939+0000","last_fullsized":"2023-11-13T11:28:58.675939+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-13T11:28:57.010879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-13T11:28:57.010879+0000","last_clean_scrub_stamp":"2023-11-13T11:28:57.010879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-14T16:35:00.051619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-13T11:28:58.676578+0000","last_change":"2023-11-13T11:28:57.636613+0000","last_active":"2023-11-13T11:28:58.676578+0000","last_peered":"2023-11-13T11:28:58.676578+0000","last_clean":"2023-11-13T11:28:58.676578+0000","last_became_active":"2023-11-13T11:28:57.636361+0000","last_became_peered":"2023-11-13T11:28:57.636361+0000","last_unstale":"2023-11-13T11:28:58.676578+0000","last_undegraded":"2023-11-13T11:28:58.676578+0000","last_fullsized":"2023-11-13T11:28:58.676578+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-13T11:28:57.010879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-13T11:28:57.010879+0000","last_clean_scrub_stamp":"2023-11-13T11:28:57.010879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-14T22:52:54.214180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-13T11:28:58.677191+0000","last_change":"2023-11-13T11:28:57.642425+0000","last_active":"2023-11-13T11:28:58.677191+0000","last_peered":"2023-11-13T11:28:58.677191+0000","last_clean":"2023-11-13T11:28:58.677191+0000","last_became_active":"2023-11-13T11:28:57.641266+0000","last_became_peered":"2023-11-13T11:28:57.641266+0000","last_unstale":"2023-11-13T11:28:58.677191+0000","last_undegraded":"2023-11-13T11:28:58.677191+0000","last_fullsized":"2023-11-13T11:28:58.677191+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-13T11:28:57.010879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-13T11:28:57.010879+0000","last_clean_scrub_stamp":"2023-11-13T11:28:57.010879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-14T13:10:19.954130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-13T11:28:58.676577+0000","last_change":"2023-11-13T11:28:57.637356+0000","last_active":"2023-11-13T11:28:58.676577+0000","last_peered":"2023-11-13T11:28:58.676577+0000","last_clean":"2023-11-13T11:28:58.676577+0000","last_became_active":"2023-11-13T11:28:57.637069+0000","last_became_peered":"2023-11-13T11:28:57.637069+0000","last_unstale":"2023-11-13T11:28:58.676577+0000","last_undegraded":"2023-11-13T11:28:58.676577+0000","last_fullsized":"2023-11-13T11:28:58.676577+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-13T11:28:57.010879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-13T11:28:57.010879+0000","last_clean_scrub_stamp":"2023-11-13T11:28:57.010879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-14T21:53:05.134410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-13T11:28:58.677142+0000","last_change":"2023-11-13T11:28:57.636634+0000","last_active":"2023-11-13T11:28:58.677142+0000","last_peered":"2023-11-13T11:28:58.677142+0000","last_clean":"2023-11-13T11:28:58.677142+0000","last_became_active":"2023-11-13T11:28:57.636278+0000","last_became_peered":"2023-11-13T11:28:57.636278+0000","last_unstale":"2023-11-13T11:28:58.677142+0000","last_undegraded":"2023-11-13T11:28:58.677142+0000","last_fullsized":"2023-11-13T11:28:58.677142+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-13T11:28:57.010879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-13T11:28:57.010879+0000","last_clean_scrub_stamp":"2023-11-13T11:28:57.010879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-14T13:51:35.559492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-13T11:28:58.617298+0000","last_change":"2023-11-13T11:28:57.633282+0000","last_active":"2023-11-13T11:28:58.617298+0000","last_peered":"2023-11-13T11:28:58.617298+0000","last_clean":"2023-11-13T11:28:58.617298+0000","last_became_active":"2023-11-13T11:28:57.633008+0000","last_became_peered":"2023-11-13T11:28:57.633008+0000","last_unstale":"2023-11-13T11:28:58.617298+0000","last_undegraded":"2023-11-13T11:28:58.617298+0000","last_fullsized":"2023-11-13T11:28:58.617298+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-13T11:28:57.010879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-13T11:28:57.010879+0000","last_clean_scrub_stamp":"2023-11-13T11:28:57.010879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-14T12:34:10.639080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-13T11:28:58.613391+0000","last_change":"2023-11-13T11:28:57.639417+0000","last_active":"2023-11-13T11:28:58.613391+0000","last_peered":"2023-11-13T11:28:58.613391+0000","last_clean":"2023-11-13T11:28:58.613391+0000","last_became_active":"2023-11-13T11:28:57.639132+0000","last_became_peered":"2023-11-13T11:28:57.639132+0000","last_unstale":"2023-11-13T11:28:58.613391+0000","last_undegraded":"2023-11-13T11:28:58.613391+0000","last_fullsized":"2023-11-13T11:28:58.613391+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-13T11:28:57.010879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-13T11:28:57.010879+0000","last_clean_scrub_stamp":"2023-11-13T11:28:57.010879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-14T12:47:29.658403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-13T11:28:58.677488+0000","last_change":"2023-11-13T11:28:57.633636+0000","last_active":"2023-11-13T11:28:58.677488+0000","last_peered":"2023-11-13T11:28:58.677488+0000","last_clean":"2023-11-13T11:28:58.677488+0000","last_became_active":"2023-11-13T11:28:57.632529+0000","last_became_peered":"2023-11-13T11:28:57.632529+0000","last_unstale":"2023-11-13T11:28:58.677488+0000","last_undegraded":"2023-11-13T11:28:58.677488+0000","last_fullsized":"2023-11-13T11:28:58.677488+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-13T11:28:57.010879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-13T11:28:57.010879+0000","last_clean_scrub_stamp":"2023-11-13T11:28:57.010879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-14T22:20:14.170174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-13T11:28:58.675948+0000","last_change":"2023-11-13T11:28:57.630397+0000","last_active":"2023-11-13T11:28:58.675948+0000","last_peered":"2023-11-13T11:28:58.675948+0000","last_clean":"2023-11-13T11:28:58.675948+0000","last_became_active":"2023-11-13T11:28:57.630049+0000","last_became_peered":"2023-11-13T11:28:57.630049+0000","last_unstale":"2023-11-13T11:28:58.675948+0000","last_undegraded":"2023-11-13T11:28:58.675948+0000","last_fullsized":"2023-11-13T11:28:58.675948+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-13T11:28:57.010879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-13T11:28:57.010879+0000","last_clean_scrub_stamp":"2023-11-13T11:28:57.010879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-14T22:49:31.708378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-13T11:28:58.677751+0000","last_change":"2023-11-13T11:28:57.627535+0000","last_active":"2023-11-13T11:28:58.677751+0000","last_peered":"2023-11-13T11:28:58.677751+0000","last_clean":"2023-11-13T11:28:58.677751+0000","last_became_active":"2023-11-13T11:28:57.625057+0000","last_became_peered":"2023-11-13T11:28:57.625057+0000","last_unstale":"2023-11-13T11:28:58.677751+0000","last_undegraded":"2023-11-13T11:28:58.677751+0000","last_fullsized":"2023-11-13T11:28:58.677751+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-13T11:28:57.010879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-13T11:28:57.010879+0000","last_clean_scrub_stamp":"2023-11-13T11:28:57.010879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-14T16:55:58.610937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-13T11:28:58.616465+0000","last_change":"2023-11-13T11:28:57.635961+0000","last_active":"2023-11-13T11:28:58.616465+0000","last_peered":"2023-11-13T11:28:58.616465+0000","last_clean":"2023-11-13T11:28:58.616465+0000","last_became_active":"2023-11-13T11:28:57.635672+0000","last_became_peered":"2023-11-13T11:28:57.635672+0000","last_unstale":"2023-11-13T11:28:58.616465+0000","last_undegraded":"2023-11-13T11:28:58.616465+0000","last_fullsized":"2023-11-13T11:28:58.616465+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-13T11:28:57.010879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-13T11:28:57.010879+0000","last_clean_scrub_stamp":"2023-11-13T11:28:57.010879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-14T17:58:40.870637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-13T11:28:58.678102+0000","last_change":"2023-11-13T11:28:57.632312+0000","last_active":"2023-11-13T11:28:58.678102+0000","last_peered":"2023-11-13T11:28:58.678102+0000","last_clean":"2023-11-13T11:28:58.678102+0000","last_became_active":"2023-11-13T11:28:57.631906+0000","last_became_peered":"2023-11-13T11:28:57.631906+0000","last_unstale":"2023-11-13T11:28:58.678102+0000","last_undegraded":"2023-11-13T11:28:58.678102+0000","last_fullsized":"2023-11-13T11:28:58.678102+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-13T11:28:57.010879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-13T11:28:57.010879+0000","last_clean_scrub_stamp":"2023-11-13T11:28:57.010879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-14T12:45:23.017972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-13T11:28:58.677455+0000","last_change":"2023-11-13T11:28:57.639397+0000","last_active":"2023-11-13T11:28:58.677455+0000","last_peered":"2023-11-13T11:28:58.677455+0000","last_clean":"2023-11-13T11:28:58.677455+0000","last_became_active":"2023-11-13T11:28:57.639114+0000","last_became_peered":"2023-11-13T11:28:57.639114+0000","last_unstale":"2023-11-13T11:28:58.677455+0000","last_undegraded":"2023-11-13T11:28:58.677455+0000","last_fullsized":"2023-11-13T11:28:58.677455+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-13T11:28:57.010879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-13T11:28:57.010879+0000","last_clean_scrub_stamp":"2023-11-13T11:28:57.010879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-14T16:02:43.358281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-13T11:28:58.677535+0000","last_change":"2023-11-13T11:28:57.632030+0000","last_active":"2023-11-13T11:28:58.677535+0000","last_peered":"2023-11-13T11:28:58.677535+0000","last_clean":"2023-11-13T11:28:58.677535+0000","last_became_active":"2023-11-13T11:28:57.631756+0000","last_became_peered":"2023-11-13T11:28:57.631756+0000","last_unstale":"2023-11-13T11:28:58.677535+0000","last_undegraded":"2023-11-13T11:28:58.677535+0000","last_fullsized":"2023-11-13T11:28:58.677535+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-13T11:28:57.010879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-13T11:28:57.010879+0000","last_clean_scrub_stamp":"2023-11-13T11:28:57.010879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-14T14:29:59.365142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-13T11:28:58.676220+0000","last_change":"2023-11-13T11:28:57.634137+0000","last_active":"2023-11-13T11:28:58.676220+0000","last_peered":"2023-11-13T11:28:58.676220+0000","last_clean":"2023-11-13T11:28:58.676220+0000","last_became_active":"2023-11-13T11:28:57.633803+0000","last_became_peered":"2023-11-13T11:28:57.633803+0000","last_unstale":"2023-11-13T11:28:58.676220+0000","last_undegraded":"2023-11-13T11:28:58.676220+0000","last_fullsized":"2023-11-13T11:28:58.676220+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-13T11:28:57.010879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-13T11:28:57.010879+0000","last_clean_scrub_stamp":"2023-11-13T11:28:57.010879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-14T12:18:09.759922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-13T11:28:58.676433+0000","last_change":"2023-11-13T11:28:57.637093+0000","last_active":"2023-11-13T11:28:58.676433+0000","last_peered":"2023-11-13T11:28:58.676433+0000","last_clean":"2023-11-13T11:28:58.676433+0000","last_became_active":"2023-11-13T11:28:57.636765+0000","last_became_peered":"2023-11-13T11:28:57.636765+0000","last_unstale":"2023-11-13T11:28:58.676433+0000","last_undegraded":"2023-11-13T11:28:58.676433+0000","last_fullsized":"2023-11-13T11:28:58.676433+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-13T11:28:57.010879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-13T11:28:57.010879+0000","last_clean_scrub_stamp":"2023-11-13T11:28:57.010879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-14T15:45:30.694781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-13T11:28:58.616081+0000","last_change":"2023-11-13T11:28:57.632897+0000","last_active":"2023-11-13T11:28:58.616081+0000","last_peered":"2023-11-13T11:28:58.616081+0000","last_clean":"2023-11-13T11:28:58.616081+0000","last_became_active":"2023-11-13T11:28:57.632596+0000","last_became_peered":"2023-11-13T11:28:57.632596+0000","last_unstale":"2023-11-13T11:28:58.616081+0000","last_undegraded":"2023-11-13T11:28:58.616081+0000","last_fullsized":"2023-11-13T11:28:58.616081+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-13T11:28:57.010879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-13T11:28:57.010879+0000","last_clean_scrub_stamp":"2023-11-13T11:28:57.010879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-14T18:44:10.551024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-13T11:28:58.613160+0000","last_change":"2023-11-13T11:28:57.625017+0000","last_active":"2023-11-13T11:28:58.613160+0000","last_peered":"2023-11-13T11:28:58.613160+0000","last_clean":"2023-11-13T11:28:58.613160+0000","last_became_active":"2023-11-13T11:28:57.624314+0000","last_became_peered":"2023-11-13T11:28:57.624314+0000","last_unstale":"2023-11-13T11:28:58.613160+0000","last_undegraded":"2023-11-13T11:28:58.613160+0000","last_fullsized":"2023-11-13T11:28:58.613160+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-13T11:28:57.010879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-13T11:28:57.010879+0000","last_clean_scrub_stamp":"2023-11-13T11:28:57.010879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-14T19:51:05.461013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1b","version":"21'1","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-13T11:28:58.677644+0000","last_change":"2023-11-13T11:28:57.043256+0000","last_active":"2023-11-13T11:28:58.677644+0000","last_peered":"2023-11-13T11:28:58.677644+0000","last_clean":"2023-11-13T11:28:58.677644+0000","last_became_active":"2023-11-13T11:28:57.041999+0000","last_became_peered":"2023-11-13T11:28:57.041999+0000","last_unstale":"2023-11-13T11:28:58.677644+0000","last_undegraded":"2023-11-13T11:28:58.677644+0000","last_fullsized":"2023-11-13T11:28:58.677644+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-13T11:28:56.008687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-13T11:28:56.008687+0000","last_clean_scrub_stamp":"2023-11-13T11:28:56.008687+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-14T18:32:13.991035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-13T11:28:58.617421+0000","last_change":"2023-11-13T11:28:57.635747+0000","last_active":"2023-11-13T11:28:58.617421+0000","last_peered":"2023-11-13T11:28:58.617421+0000","last_clean":"2023-11-13T11:28:58.617421+0000","last_became_active":"2023-11-13T11:28:57.635406+0000","last_became_peered":"2023-11-13T11:28:57.635406+0000","last_unstale":"2023-11-13T11:28:58.617421+0000","last_undegraded":"2023-11-13T11:28:58.617421+0000","last_fullsized":"2023-11-13T11:28:58.617421+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-13T11:28:57.010879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-13T11:28:57.010879+0000","last_clean_scrub_stamp":"2023-11-13T11:28:57.010879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-14T22:16:57.888840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1a","version":"21'1","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-13T11:28:58.676434+0000","last_change":"2023-11-13T11:28:57.047326+0000","last_active":"2023-11-13T11:28:58.676434+0000","last_peered":"2023-11-13T11:28:58.676434+0000","last_clean":"2023-11-13T11:28:58.676434+0000","last_became_active":"2023-11-13T11:28:57.047058+0000","last_became_peered":"2023-11-13T11:28:57.047058+0000","last_unstale":"2023-11-13T11:28:58.676434+0000","last_undegraded":"2023-11-13T11:28:58.676434+0000","last_fullsized":"2023-11-13T11:28:58.676434+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-13T11:28:56.008687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-13T11:28:56.008687+0000","last_clean_scrub_stamp":"2023-11-13T11:28:56.008687+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-14T21:42:18.410072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-13T11:28:58.677872+0000","last_change":"2023-11-13T11:28:57.039378+0000","last_active":"2023-11-13T11:28:58.677872+0000","last_peered":"2023-11-13T11:28:58.677872+0000","last_clean":"2023-11-13T11:28:58.677872+0000","last_became_active":"2023-11-13T11:28:57.038955+0000","last_became_peered":"2023-11-13T11:28:57.038955+0000","last_unstale":"2023-11-13T11:28:58.677872+0000","last_undegraded":"2023-11-13T11:28:58.677872+0000","last_fullsized":"2023-11-13T11:28:58.677872+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-13T11:28:56.008687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-13T11:28:56.008687+0000","last_clean_scrub_stamp":"2023-11-13T11:28:56.008687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-14T19:51:04.458821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-13T11:28:58.677161+0000","last_change":"2023-11-13T11:28:57.635612+0000","last_active":"2023-11-13T11:28:58.677161+0000","last_peered":"2023-11-13T11:28:58.677161+0000","last_clean":"2023-11-13T11:28:58.677161+0000","last_became_active":"2023-11-13T11:28:57.633904+0000","last_became_peered":"2023-11-13T11:28:57.633904+0000","last_unstale":"2023-11-13T11:28:58.677161+0000","last_undegraded":"2023-11-13T11:28:58.677161+0000","last_fullsized":"2023-11-13T11:28:58.677161+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-13T11:28:57.010879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-13T11:28:57.010879+0000","last_clean_scrub_stamp":"2023-11-13T11:28:57.010879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-14T16:47:11.682554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-13T11:28:58.676165+0000","last_change":"2023-11-13T11:28:57.050197+0000","last_active":"2023-11-13T11:28:58.676165+0000","last_peered":"2023-11-13T11:28:58.676165+0000","last_clean":"2023-11-13T11:28:58.676165+0000","last_became_active":"2023-11-13T11:28:57.049917+0000","last_became_peered":"2023-11-13T11:28:57.049917+0000","last_unstale":"2023-11-13T11:28:58.676165+0000","last_undegraded":"2023-11-13T11:28:58.676165+0000","last_fullsized":"2023-11-13T11:28:58.676165+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-13T11:28:56.008687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-13T11:28:56.008687+0000","last_clean_scrub_stamp":"2023-11-13T11:28:56.008687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-14T11:40:57.839875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-13T11:28:58.617477+0000","last_change":"2023-11-13T11:28:57.620218+0000","last_active":"2023-11-13T11:28:58.617477+0000","last_peered":"2023-11-13T11:28:58.617477+0000","last_clean":"2023-11-13T11:28:58.617477+0000","last_became_active":"2023-11-13T11:28:57.619919+0000","last_became_peered":"2023-11-13T11:28:57.619919+0000","last_unstale":"2023-11-13T11:28:58.617477+0000","last_undegraded":"2023-11-13T11:28:58.617477+0000","last_fullsized":"2023-11-13T11:28:58.617477+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-13T11:28:57.010879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-13T11:28:57.010879+0000","last_clean_scrub_stamp":"2023-11-13T11:28:57.010879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-14T21:42:19.412264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-13T11:28:58.613639+0000","last_change":"2023-11-13T11:28:57.041825+0000","last_active":"2023-11-13T11:28:58.613639+0000","last_peered":"2023-11-13T11:28:58.613639+0000","last_clean":"2023-11-13T11:28:58.613639+0000","last_became_active":"2023-11-13T11:28:57.041650+0000","last_became_peered":"2023-11-13T11:28:57.041650+0000","last_unstale":"2023-11-13T11:28:58.613639+0000","last_undegraded":"2023-11-13T11:28:58.613639+0000","last_fullsized":"2023-11-13T11:28:58.613639+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-13T11:28:56.008687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-13T11:28:56.008687+0000","last_clean_scrub_stamp":"2023-11-13T11:28:56.008687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-14T12:41:42.933021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-13T11:28:58.616521+0000","last_change":"2023-11-13T11:28:57.632784+0000","last_active":"2023-11-13T11:28:58.616521+0000","last_peered":"2023-11-13T11:28:58.616521+0000","last_clean":"2023-11-13T11:28:58.616521+0000","last_became_active":"2023-11-13T11:28:57.631854+0000","last_became_peered":"2023-11-13T11:28:57.631854+0000","last_unstale":"2023-11-13T11:28:58.616521+0000","last_undegraded":"2023-11-13T11:28:58.616521+0000","last_fullsized":"2023-11-13T11:28:58.616521+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-13T11:28:57.010879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-13T11:28:57.010879+0000","last_clean_scrub_stamp":"2023-11-13T11:28:57.010879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-14T11:40:58.842068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-13T11:28:58.677636+0000","last_change":"2023-11-13T11:28:57.049038+0000","last_active":"2023-11-13T11:28:58.677636+0000","last_peered":"2023-11-13T11:28:58.677636+0000","last_clean":"2023-11-13T11:28:58.677636+0000","last_became_active":"2023-11-13T11:28:57.048768+0000","last_became_peered":"2023-11-13T11:28:57.048768+0000","last_unstale":"2023-11-13T11:28:58.677636+0000","last_undegraded":"2023-11-13T11:28:58.677636+0000","last_fullsized":"2023-11-13T11:28:58.677636+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-13T11:28:56.008687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-13T11:28:56.008687+0000","last_clean_scrub_stamp":"2023-11-13T11:28:56.008687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-14T12:45:22.015780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-13T11:28:58.677861+0000","last_change":"2023-11-13T11:28:57.627287+0000","last_active":"2023-11-13T11:28:58.677861+0000","last_peered":"2023-11-13T11:28:58.677861+0000","last_clean":"2023-11-13T11:28:58.677861+0000","last_became_active":"2023-11-13T11:28:57.623471+0000","last_became_peered":"2023-11-13T11:28:57.623471+0000","last_unstale":"2023-11-13T11:28:58.677861+0000","last_undegraded":"2023-11-13T11:28:58.677861+0000","last_fullsized":"2023-11-13T11:28:58.677861+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-13T11:28:57.010879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-13T11:28:57.010879+0000","last_clean_scrub_stamp":"2023-11-13T11:28:57.010879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-14T22:49:31.708378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.15","version":"21'3","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-13T11:28:58.676868+0000","last_change":"2023-11-13T11:28:57.037793+0000","last_active":"2023-11-13T11:28:58.676868+0000","last_peered":"2023-11-13T11:28:58.676868+0000","last_clean":"2023-11-13T11:28:58.676868+0000","last_became_active":"2023-11-13T11:28:57.037300+0000","last_became_peered":"2023-11-13T11:28:57.037300+0000","last_unstale":"2023-11-13T11:28:58.676868+0000","last_undegraded":"2023-11-13T11:28:58.676868+0000","last_fullsized":"2023-11-13T11:28:58.676868+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-13T11:28:56.008687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-13T11:28:56.008687+0000","last_clean_scrub_stamp":"2023-11-13T11:28:56.008687+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-14T22:52:35.101002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-13T11:28:58.676110+0000","last_change":"2023-11-13T11:28:57.639554+0000","last_active":"2023-11-13T11:28:58.676110+0000","last_peered":"2023-11-13T11:28:58.676110+0000","last_clean":"2023-11-13T11:28:58.676110+0000","last_became_active":"2023-11-13T11:28:57.639192+0000","last_became_peered":"2023-11-13T11:28:57.639192+0000","last_unstale":"2023-11-13T11:28:58.676110+0000","last_undegraded":"2023-11-13T11:28:58.676110+0000","last_fullsized":"2023-11-13T11:28:58.676110+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-13T11:28:57.010879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-13T11:28:57.010879+0000","last_clean_scrub_stamp":"2023-11-13T11:28:57.010879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-14T13:13:26.359918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.14","version":"21'6","reported_seq":18,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-13T11:28:58.616288+0000","last_change":"2023-11-13T11:28:57.026285+0000","last_active":"2023-11-13T11:28:58.616288+0000","last_peered":"2023-11-13T11:28:58.616288+0000","last_clean":"2023-11-13T11:28:58.616288+0000","last_became_active":"2023-11-13T11:28:57.026026+0000","last_became_peered":"2023-11-13T11:28:57.026026+0000","last_unstale":"2023-11-13T11:28:58.616288+0000","last_undegraded":"2023-11-13T11:28:58.616288+0000","last_fullsized":"2023-11-13T11:28:58.616288+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-13T11:28:56.008687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-13T11:28:56.008687+0000","last_clean_scrub_stamp":"2023-11-13T11:28:56.008687+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-14T20:07:21.176638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-13T11:28:58.677361+0000","last_change":"2023-11-13T11:28:57.633747+0000","last_active":"2023-11-13T11:28:58.677361+0000","last_peered":"2023-11-13T11:28:58.677361+0000","last_clean":"2023-11-13T11:28:58.677361+0000","last_became_active":"2023-11-13T11:28:57.633454+0000","last_became_peered":"2023-11-13T11:28:57.633454+0000","last_unstale":"2023-11-13T11:28:58.677361+0000","last_undegraded":"2023-11-13T11:28:58.677361+0000","last_fullsized":"2023-11-13T11:28:58.677361+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-13T11:28:57.010879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-13T11:28:57.010879+0000","last_clean_scrub_stamp":"2023-11-13T11:28:57.010879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-14T16:35:00.051619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"21'2","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-13T11:28:58.676714+0000","last_change":"2023-11-13T11:28:57.039714+0000","last_active":"2023-11-13T11:28:58.676714+0000","last_peered":"2023-11-13T11:28:58.676714+0000","last_clean":"2023-11-13T11:28:58.676714+0000","last_became_active":"2023-11-13T11:28:57.039008+0000","last_became_peered":"2023-11-13T11:28:57.039008+0000","last_unstale":"2023-11-13T11:28:58.676714+0000","last_undegraded":"2023-11-13T11:28:58.676714+0000","last_fullsized":"2023-11-13T11:28:58.676714+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-13T11:28:56.008687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-13T11:28:56.008687+0000","last_clean_scrub_stamp":"2023-11-13T11:28:56.008687+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-14T11:45:58.589019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-13T11:28:58.677597+0000","last_change":"2023-11-13T11:28:57.641476+0000","last_active":"2023-11-13T11:28:58.677597+0000","last_peered":"2023-11-13T11:28:58.677597+0000","last_clean":"2023-11-13T11:28:58.677597+0000","last_became_active":"2023-11-13T11:28:57.640673+0000","last_became_peered":"2023-11-13T11:28:57.640673+0000","last_unstale":"2023-11-13T11:28:58.677597+0000","last_undegraded":"2023-11-13T11:28:58.677597+0000","last_fullsized":"2023-11-13T11:28:58.677597+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-13T11:28:57.010879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-13T11:28:57.010879+0000","last_clean_scrub_stamp":"2023-11-13T11:28:57.010879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-14T18:32:14.993227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-13T11:28:58.676518+0000","last_change":"2023-11-13T11:28:57.038744+0000","last_active":"2023-11-13T11:28:58.676518+0000","last_peered":"2023-11-13T11:28:58.676518+0000","last_clean":"2023-11-13T11:28:58.676518+0000","last_became_active":"2023-11-13T11:28:57.037589+0000","last_became_peered":"2023-11-13T11:28:57.037589+0000","last_unstale":"2023-11-13T11:28:58.676518+0000","last_undegraded":"2023-11-13T11:28:58.676518+0000","last_fullsized":"2023-11-13T11:28:58.676518+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-13T11:28:56.008687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-13T11:28:56.008687+0000","last_clean_scrub_stamp":"2023-11-13T11:28:56.008687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-14T20:31:04.049508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-13T11:28:58.676239+0000","last_change":"2023-11-13T11:28:57.642795+0000","last_active":"2023-11-13T11:28:58.676239+0000","last_peered":"2023-11-13T11:28:58.676239+0000","last_clean":"2023-11-13T11:28:58.676239+0000","last_became_active":"2023-11-13T11:28:57.642532+0000","last_became_peered":"2023-11-13T11:28:57.642532+0000","last_unstale":"2023-11-13T11:28:58.676239+0000","last_undegraded":"2023-11-13T11:28:58.676239+0000","last_fullsized":"2023-11-13T11:28:58.676239+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-13T11:28:57.010879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-13T11:28:57.010879+0000","last_clean_scrub_stamp":"2023-11-13T11:28:57.010879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-14T15:58:48.241029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-13T11:28:58.676905+0000","last_change":"2023-11-13T11:28:57.040384+0000","last_active":"2023-11-13T11:28:58.676905+0000","last_peered":"2023-11-13T11:28:58.676905+0000","last_clean":"2023-11-13T11:28:58.676905+0000","last_became_active":"2023-11-13T11:28:57.040131+0000","last_became_peered":"2023-11-13T11:28:57.040131+0000","last_unstale":"2023-11-13T11:28:58.676905+0000","last_undegraded":"2023-11-13T11:28:58.676905+0000","last_fullsized":"2023-11-13T11:28:58.676905+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-13T11:28:56.008687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-13T11:28:56.008687+0000","last_clean_scrub_stamp":"2023-11-13T11:28:56.008687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-14T20:31:04.049508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-13T11:28:58.613055+0000","last_change":"2023-11-13T11:28:57.624233+0000","last_active":"2023-11-13T11:28:58.613055+0000","last_peered":"2023-11-13T11:28:58.613055+0000","last_clean":"2023-11-13T11:28:58.613055+0000","last_became_active":"2023-11-13T11:28:57.623952+0000","last_became_peered":"2023-11-13T11:28:57.623952+0000","last_unstale":"2023-11-13T11:28:58.613055+0000","last_undegraded":"2023-11-13T11:28:58.613055+0000","last_fullsized":"2023-11-13T11:28:58.613055+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-13T11:28:57.010879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-13T11:28:57.010879+0000","last_clean_scrub_stamp":"2023-11-13T11:28:57.010879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-14T18:44:10.551024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.10","version":"21'8","reported_seq":20,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-13T11:28:58.616974+0000","last_change":"2023-11-13T11:28:57.035054+0000","last_active":"2023-11-13T11:28:58.616974+0000","last_peered":"2023-11-13T11:28:58.616974+0000","last_clean":"2023-11-13T11:28:58.616974+0000","last_became_active":"2023-11-13T11:28:57.034694+0000","last_became_peered":"2023-11-13T11:28:57.034694+0000","last_unstale":"2023-11-13T11:28:58.616974+0000","last_undegraded":"2023-11-13T11:28:58.616974+0000","last_fullsized":"2023-11-13T11:28:58.616974+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-13T11:28:56.008687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-13T11:28:56.008687+0000","last_clean_scrub_stamp":"2023-11-13T11:28:56.008687+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-14T19:51:04.458821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-13T11:28:58.675988+0000","last_change":"2023-11-13T11:28:57.640815+0000","last_active":"2023-11-13T11:28:58.675988+0000","last_peered":"2023-11-13T11:28:58.675988+0000","last_clean":"2023-11-13T11:28:58.675988+0000","last_became_active":"2023-11-13T11:28:57.639158+0000","last_became_peered":"2023-11-13T11:28:57.639158+0000","last_unstale":"2023-11-13T11:28:58.675988+0000","last_undegraded":"2023-11-13T11:28:58.675988+0000","last_fullsized":"2023-11-13T11:28:58.675988+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-13T11:28:57.010879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-13T11:28:57.010879+0000","last_clean_scrub_stamp":"2023-11-13T11:28:57.010879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-14T13:34:23.778868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.f","version":"21'1","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-13T11:28:58.677539+0000","last_change":"2023-11-13T11:28:57.047959+0000","last_active":"2023-11-13T11:28:58.677539+0000","last_peered":"2023-11-13T11:28:58.677539+0000","last_clean":"2023-11-13T11:28:58.677539+0000","last_became_active":"2023-11-13T11:28:57.047614+0000","last_became_peered":"2023-11-13T11:28:57.047614+0000","last_unstale":"2023-11-13T11:28:58.677539+0000","last_undegraded":"2023-11-13T11:28:58.677539+0000","last_fullsized":"2023-11-13T11:28:58.677539+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-13T11:28:56.008687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-13T11:28:56.008687+0000","last_clean_scrub_stamp":"2023-11-13T11:28:56.008687+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-14T18:32:13.991035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-13T11:28:58.616578+0000","last_change":"2023-11-13T11:28:57.644049+0000","last_active":"2023-11-13T11:28:58.616578+0000","last_peered":"2023-11-13T11:28:58.616578+0000","last_clean":"2023-11-13T11:28:58.616578+0000","last_became_active":"2023-11-13T11:28:57.643739+0000","last_became_peered":"2023-11-13T11:28:57.643739+0000","last_unstale":"2023-11-13T11:28:58.616578+0000","last_undegraded":"2023-11-13T11:28:58.616578+0000","last_fullsized":"2023-11-13T11:28:58.616578+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-13T11:28:57.010879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-13T11:28:57.010879+0000","last_clean_scrub_stamp":"2023-11-13T11:28:57.010879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-14T16:02:43.358281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.e","version":"21'2","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-13T11:28:58.617520+0000","last_change":"2023-11-13T11:28:57.037861+0000","last_active":"2023-11-13T11:28:58.617520+0000","last_peered":"2023-11-13T11:28:58.617520+0000","last_clean":"2023-11-13T11:28:58.617520+0000","last_became_active":"2023-11-13T11:28:57.037587+0000","last_became_peered":"2023-11-13T11:28:57.037587+0000","last_unstale":"2023-11-13T11:28:58.617520+0000","last_undegraded":"2023-11-13T11:28:58.617520+0000","last_fullsized":"2023-11-13T11:28:58.617520+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-13T11:28:56.008687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-13T11:28:56.008687+0000","last_clean_scrub_stamp":"2023-11-13T11:28:56.008687+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-14T12:47:28.656211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-13T11:28:58.677509+0000","last_change":"2023-11-13T11:28:57.627412+0000","last_active":"2023-11-13T11:28:58.677509+0000","last_peered":"2023-11-13T11:28:58.677509+0000","last_clean":"2023-11-13T11:28:58.677509+0000","last_became_active":"2023-11-13T11:28:57.627146+0000","last_became_peered":"2023-11-13T11:28:57.627146+0000","last_unstale":"2023-11-13T11:28:58.677509+0000","last_undegraded":"2023-11-13T11:28:58.677509+0000","last_fullsized":"2023-11-13T11:28:58.677509+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-13T11:28:57.010879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-13T11:28:57.010879+0000","last_clean_scrub_stamp":"2023-11-13T11:28:57.010879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-14T13:34:23.778868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"21'1","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-13T11:28:58.677545+0000","last_change":"2023-11-13T11:28:57.043781+0000","last_active":"2023-11-13T11:28:58.677545+0000","last_peered":"2023-11-13T11:28:58.677545+0000","last_clean":"2023-11-13T11:28:58.677545+0000","last_became_active":"2023-11-13T11:28:57.043532+0000","last_became_peered":"2023-11-13T11:28:57.043532+0000","last_unstale":"2023-11-13T11:28:58.677545+0000","last_undegraded":"2023-11-13T11:28:58.677545+0000","last_fullsized":"2023-11-13T11:28:58.677545+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-13T11:28:56.008687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-13T11:28:56.008687+0000","last_clean_scrub_stamp":"2023-11-13T11:28:56.008687+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-14T12:45:22.015780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-13T11:28:58.677199+0000","last_change":"2023-11-13T11:28:57.632085+0000","last_active":"2023-11-13T11:28:58.677199+0000","last_peered":"2023-11-13T11:28:58.677199+0000","last_clean":"2023-11-13T11:28:58.677199+0000","last_became_active":"2023-11-13T11:28:57.631814+0000","last_became_peered":"2023-11-13T11:28:57.631814+0000","last_unstale":"2023-11-13T11:28:58.677199+0000","last_undegraded":"2023-11-13T11:28:58.677199+0000","last_fullsized":"2023-11-13T11:28:58.677199+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-13T11:28:57.010879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-13T11:28:57.010879+0000","last_clean_scrub_stamp":"2023-11-13T11:28:57.010879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-14T16:55:58.610937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-13T11:28:58.677642+0000","last_change":"2023-11-13T11:28:57.039989+0000","last_active":"2023-11-13T11:28:58.677642+0000","last_peered":"2023-11-13T11:28:58.677642+0000","last_clean":"2023-11-13T11:28:58.677642+0000","last_became_active":"2023-11-13T11:28:57.039704+0000","last_became_peered":"2023-11-13T11:28:57.039704+0000","last_unstale":"2023-11-13T11:28:58.677642+0000","last_undegraded":"2023-11-13T11:28:58.677642+0000","last_fullsized":"2023-11-13T11:28:58.677642+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-13T11:28:56.008687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-13T11:28:56.008687+0000","last_clean_scrub_stamp":"2023-11-13T11:28:56.008687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-14T12:47:28.656211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-13T11:28:58.676483+0000","last_change":"2023-11-13T11:28:57.630328+0000","last_active":"2023-11-13T11:28:58.676483+0000","last_peered":"2023-11-13T11:28:58.676483+0000","last_clean":"2023-11-13T11:28:58.676483+0000","last_became_active":"2023-11-13T11:28:57.630018+0000","last_became_peered":"2023-11-13T11:28:57.630018+0000","last_unstale":"2023-11-13T11:28:58.676483+0000","last_undegraded":"2023-11-13T11:28:58.676483+0000","last_fullsized":"2023-11-13T11:28:58.676483+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-13T11:28:57.010879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-13T11:28:57.010879+0000","last_clean_scrub_stamp":"2023-11-13T11:28:57.010879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-14T21:59:24.741766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":165,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-13T11:28:57.612976+0000","last_change":"2023-11-13T11:28:47.002866+0000","last_active":"2023-11-13T11:28:57.612976+0000","last_peered":"2023-11-13T11:28:57.612976+0000","last_clean":"2023-11-13T11:28:57.612976+0000","last_became_active":"2023-11-13T11:28:47.001494+0000","last_became_peered":"2023-11-13T11:28:47.001494+0000","last_unstale":"2023-11-13T11:28:57.612976+0000","last_undegraded":"2023-11-13T11:28:57.612976+0000","last_fullsized":"2023-11-13T11:28:57.612976+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-13T11:28:45.879416+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-13T11:28:45.879416+0000","last_clean_scrub_stamp":"2023-11-13T11:28:45.879416+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-14T14:38:55.166320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-13T11:28:58.676303+0000","last_change":"2023-11-13T11:28:57.040424+0000","last_active":"2023-11-13T11:28:58.676303+0000","last_peered":"2023-11-13T11:28:58.676303+0000","last_clean":"2023-11-13T11:28:58.676303+0000","last_became_active":"2023-11-13T11:28:57.039831+0000","last_became_peered":"2023-11-13T11:28:57.039831+0000","last_unstale":"2023-11-13T11:28:58.676303+0000","last_undegraded":"2023-11-13T11:28:58.676303+0000","last_fullsized":"2023-11-13T11:28:58.676303+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-13T11:28:56.008687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-13T11:28:56.008687+0000","last_clean_scrub_stamp":"2023-11-13T11:28:56.008687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-14T17:58:39.868445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-13T11:28:58.617352+0000","last_change":"2023-11-13T11:28:57.633871+0000","last_active":"2023-11-13T11:28:58.617352+0000","last_peered":"2023-11-13T11:28:58.617352+0000","last_clean":"2023-11-13T11:28:58.617352+0000","last_became_active":"2023-11-13T11:28:57.633554+0000","last_became_peered":"2023-11-13T11:28:57.633554+0000","last_unstale":"2023-11-13T11:28:58.617352+0000","last_undegraded":"2023-11-13T11:28:58.617352+0000","last_fullsized":"2023-11-13T11:28:58.617352+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-13T11:28:57.010879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-13T11:28:57.010879+0000","last_clean_scrub_stamp":"2023-11-13T11:28:57.010879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-14T12:45:23.017972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-13T11:28:58.676054+0000","last_change":"2023-11-13T11:28:57.042629+0000","last_active":"2023-11-13T11:28:58.676054+0000","last_peered":"2023-11-13T11:28:58.676054+0000","last_clean":"2023-11-13T11:28:58.676054+0000","last_became_active":"2023-11-13T11:28:57.042275+0000","last_became_peered":"2023-11-13T11:28:57.042275+0000","last_unstale":"2023-11-13T11:28:58.676054+0000","last_undegraded":"2023-11-13T11:28:58.676054+0000","last_fullsized":"2023-11-13T11:28:58.676054+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-13T11:28:56.008687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-13T11:28:56.008687+0000","last_clean_scrub_stamp":"2023-11-13T11:28:56.008687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-14T18:32:13.991035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-13T11:28:58.677781+0000","last_change":"2023-11-13T11:28:57.636085+0000","last_active":"2023-11-13T11:28:58.677781+0000","last_peered":"2023-11-13T11:28:58.677781+0000","last_clean":"2023-11-13T11:28:58.677781+0000","last_became_active":"2023-11-13T11:28:57.635801+0000","last_became_peered":"2023-11-13T11:28:57.635801+0000","last_unstale":"2023-11-13T11:28:58.677781+0000","last_undegraded":"2023-11-13T11:28:58.677781+0000","last_fullsized":"2023-11-13T11:28:58.677781+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-13T11:28:57.010879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-13T11:28:57.010879+0000","last_clean_scrub_stamp":"2023-11-13T11:28:57.010879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-14T12:34:10.639080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-13T11:28:58.676552+0000","last_change":"2023-11-13T11:28:57.043663+0000","last_active":"2023-11-13T11:28:58.676552+0000","last_peered":"2023-11-13T11:28:58.676552+0000","last_clean":"2023-11-13T11:28:58.676552+0000","last_became_active":"2023-11-13T11:28:57.043395+0000","last_became_peered":"2023-11-13T11:28:57.043395+0000","last_unstale":"2023-11-13T11:28:58.676552+0000","last_undegraded":"2023-11-13T11:28:58.676552+0000","last_fullsized":"2023-11-13T11:28:58.676552+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-13T11:28:56.008687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-13T11:28:56.008687+0000","last_clean_scrub_stamp":"2023-11-13T11:28:56.008687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-14T20:39:57.924545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-13T11:28:58.677021+0000","last_change":"2023-11-13T11:28:57.630182+0000","last_active":"2023-11-13T11:28:58.677021+0000","last_peered":"2023-11-13T11:28:58.677021+0000","last_clean":"2023-11-13T11:28:58.677021+0000","last_became_active":"2023-11-13T11:28:57.629803+0000","last_became_peered":"2023-11-13T11:28:57.629803+0000","last_unstale":"2023-11-13T11:28:58.677021+0000","last_undegraded":"2023-11-13T11:28:58.677021+0000","last_fullsized":"2023-11-13T11:28:58.677021+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-13T11:28:57.010879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-13T11:28:57.010879+0000","last_clean_scrub_stamp":"2023-11-13T11:28:57.010879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-14T20:31:05.051700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-13T11:28:58.676595+0000","last_change":"2023-11-13T11:28:57.044421+0000","last_active":"2023-11-13T11:28:58.676595+0000","last_peered":"2023-11-13T11:28:58.676595+0000","last_clean":"2023-11-13T11:28:58.676595+0000","last_became_active":"2023-11-13T11:28:57.044057+0000","last_became_peered":"2023-11-13T11:28:57.044057+0000","last_unstale":"2023-11-13T11:28:58.676595+0000","last_undegraded":"2023-11-13T11:28:58.676595+0000","last_fullsized":"2023-11-13T11:28:58.676595+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-13T11:28:56.008687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-13T11:28:56.008687+0000","last_clean_scrub_stamp":"2023-11-13T11:28:56.008687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-14T16:47:10.680362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-13T11:28:58.676967+0000","last_change":"2023-11-13T11:28:57.636497+0000","last_active":"2023-11-13T11:28:58.676967+0000","last_peered":"2023-11-13T11:28:58.676967+0000","last_clean":"2023-11-13T11:28:58.676967+0000","last_became_active":"2023-11-13T11:28:57.635945+0000","last_became_peered":"2023-11-13T11:28:57.635945+0000","last_unstale":"2023-11-13T11:28:58.676967+0000","last_undegraded":"2023-11-13T11:28:58.676967+0000","last_fullsized":"2023-11-13T11:28:58.676967+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-13T11:28:57.010879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-13T11:28:57.010879+0000","last_clean_scrub_stamp":"2023-11-13T11:28:57.010879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-14T14:29:59.365142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-13T11:28:58.677456+0000","last_change":"2023-11-13T11:28:57.039925+0000","last_active":"2023-11-13T11:28:58.677456+0000","last_peered":"2023-11-13T11:28:58.677456+0000","last_clean":"2023-11-13T11:28:58.677456+0000","last_became_active":"2023-11-13T11:28:57.039611+0000","last_became_peered":"2023-11-13T11:28:57.039611+0000","last_unstale":"2023-11-13T11:28:58.677456+0000","last_undegraded":"2023-11-13T11:28:58.677456+0000","last_fullsized":"2023-11-13T11:28:58.677456+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-13T11:28:56.008687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-13T11:28:56.008687+0000","last_clean_scrub_stamp":"2023-11-13T11:28:56.008687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-14T12:34:09.636888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-13T11:28:58.616113+0000","last_change":"2023-11-13T11:28:57.640311+0000","last_active":"2023-11-13T11:28:58.616113+0000","last_peered":"2023-11-13T11:28:58.616113+0000","last_clean":"2023-11-13T11:28:58.616113+0000","last_became_active":"2023-11-13T11:28:57.638311+0000","last_became_peered":"2023-11-13T11:28:57.638311+0000","last_unstale":"2023-11-13T11:28:58.616113+0000","last_undegraded":"2023-11-13T11:28:58.616113+0000","last_fullsized":"2023-11-13T11:28:58.616113+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-13T11:28:57.010879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-13T11:28:57.010879+0000","last_clean_scrub_stamp":"2023-11-13T11:28:57.010879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-14T19:51:05.461013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-13T11:28:58.676570+0000","last_change":"2023-11-13T11:28:57.045910+0000","last_active":"2023-11-13T11:28:58.676570+0000","last_peered":"2023-11-13T11:28:58.676570+0000","last_clean":"2023-11-13T11:28:58.676570+0000","last_became_active":"2023-11-13T11:28:57.045640+0000","last_became_peered":"2023-11-13T11:28:57.045640+0000","last_unstale":"2023-11-13T11:28:58.676570+0000","last_undegraded":"2023-11-13T11:28:58.676570+0000","last_fullsized":"2023-11-13T11:28:58.676570+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-13T11:28:56.008687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-13T11:28:56.008687+0000","last_clean_scrub_stamp":"2023-11-13T11:28:56.008687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-14T18:39:08.541955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-13T11:28:58.678192+0000","last_change":"2023-11-13T11:28:57.627422+0000","last_active":"2023-11-13T11:28:58.678192+0000","last_peered":"2023-11-13T11:28:58.678192+0000","last_clean":"2023-11-13T11:28:58.678192+0000","last_became_active":"2023-11-13T11:28:57.627122+0000","last_became_peered":"2023-11-13T11:28:57.627122+0000","last_unstale":"2023-11-13T11:28:58.678192+0000","last_undegraded":"2023-11-13T11:28:58.678192+0000","last_fullsized":"2023-11-13T11:28:58.678192+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-13T11:28:57.010879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-13T11:28:57.010879+0000","last_clean_scrub_stamp":"2023-11-13T11:28:57.010879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-14T22:16:57.888840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-13T11:28:58.617682+0000","last_change":"2023-11-13T11:28:57.026473+0000","last_active":"2023-11-13T11:28:58.617682+0000","last_peered":"2023-11-13T11:28:58.617682+0000","last_clean":"2023-11-13T11:28:58.617682+0000","last_became_active":"2023-11-13T11:28:57.025877+0000","last_became_peered":"2023-11-13T11:28:57.025877+0000","last_unstale":"2023-11-13T11:28:58.617682+0000","last_undegraded":"2023-11-13T11:28:58.617682+0000","last_fullsized":"2023-11-13T11:28:58.617682+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-13T11:28:56.008687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-13T11:28:56.008687+0000","last_clean_scrub_stamp":"2023-11-13T11:28:56.008687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-14T11:40:57.839875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-13T11:28:58.617778+0000","last_change":"2023-11-13T11:28:57.632649+0000","last_active":"2023-11-13T11:28:58.617778+0000","last_peered":"2023-11-13T11:28:58.617778+0000","last_clean":"2023-11-13T11:28:58.617778+0000","last_became_active":"2023-11-13T11:28:57.632091+0000","last_became_peered":"2023-11-13T11:28:57.632091+0000","last_unstale":"2023-11-13T11:28:58.617778+0000","last_undegraded":"2023-11-13T11:28:58.617778+0000","last_fullsized":"2023-11-13T11:28:58.617778+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-13T11:28:57.010879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-13T11:28:57.010879+0000","last_clean_scrub_stamp":"2023-11-13T11:28:57.010879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-14T23:10:03.463557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"21'2","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-13T11:28:58.676636+0000","last_change":"2023-11-13T11:28:57.049041+0000","last_active":"2023-11-13T11:28:58.676636+0000","last_peered":"2023-11-13T11:28:58.676636+0000","last_clean":"2023-11-13T11:28:58.676636+0000","last_became_active":"2023-11-13T11:28:57.048609+0000","last_became_peered":"2023-11-13T11:28:57.048609+0000","last_unstale":"2023-11-13T11:28:58.676636+0000","last_undegraded":"2023-11-13T11:28:58.676636+0000","last_fullsized":"2023-11-13T11:28:58.676636+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-13T11:28:56.008687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-13T11:28:56.008687+0000","last_clean_scrub_stamp":"2023-11-13T11:28:56.008687+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-14T14:29:58.362950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-13T11:28:58.617616+0000","last_change":"2023-11-13T11:28:57.634721+0000","last_active":"2023-11-13T11:28:58.617616+0000","last_peered":"2023-11-13T11:28:58.617616+0000","last_clean":"2023-11-13T11:28:58.617616+0000","last_became_active":"2023-11-13T11:28:57.632021+0000","last_became_peered":"2023-11-13T11:28:57.632021+0000","last_unstale":"2023-11-13T11:28:58.617616+0000","last_undegraded":"2023-11-13T11:28:58.617616+0000","last_fullsized":"2023-11-13T11:28:58.617616+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-13T11:28:57.010879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-13T11:28:57.010879+0000","last_clean_scrub_stamp":"2023-11-13T11:28:57.010879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-14T20:31:05.051700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-13T11:28:58.676371+0000","last_change":"2023-11-13T11:28:57.034985+0000","last_active":"2023-11-13T11:28:58.676371+0000","last_peered":"2023-11-13T11:28:58.676371+0000","last_clean":"2023-11-13T11:28:58.676371+0000","last_became_active":"2023-11-13T11:28:57.033457+0000","last_became_peered":"2023-11-13T11:28:57.033457+0000","last_unstale":"2023-11-13T11:28:58.676371+0000","last_undegraded":"2023-11-13T11:28:58.676371+0000","last_fullsized":"2023-11-13T11:28:58.676371+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-13T11:28:56.008687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-13T11:28:56.008687+0000","last_clean_scrub_stamp":"2023-11-13T11:28:56.008687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-14T22:20:18.898387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-13T11:28:58.676138+0000","last_change":"2023-11-13T11:28:57.626943+0000","last_active":"2023-11-13T11:28:58.676138+0000","last_peered":"2023-11-13T11:28:58.676138+0000","last_clean":"2023-11-13T11:28:58.676138+0000","last_became_active":"2023-11-13T11:28:57.626766+0000","last_became_peered":"2023-11-13T11:28:57.626766+0000","last_unstale":"2023-11-13T11:28:58.676138+0000","last_undegraded":"2023-11-13T11:28:58.676138+0000","last_fullsized":"2023-11-13T11:28:58.676138+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-13T11:28:57.010879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-13T11:28:57.010879+0000","last_clean_scrub_stamp":"2023-11-13T11:28:57.010879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-14T22:55:42.143143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-13T11:28:58.617155+0000","last_change":"2023-11-13T11:28:57.034882+0000","last_active":"2023-11-13T11:28:58.617155+0000","last_peered":"2023-11-13T11:28:58.617155+0000","last_clean":"2023-11-13T11:28:58.617155+0000","last_became_active":"2023-11-13T11:28:57.032076+0000","last_became_peered":"2023-11-13T11:28:57.032076+0000","last_unstale":"2023-11-13T11:28:58.617155+0000","last_undegraded":"2023-11-13T11:28:58.617155+0000","last_fullsized":"2023-11-13T11:28:58.617155+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-13T11:28:56.008687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-13T11:28:56.008687+0000","last_clean_scrub_stamp":"2023-11-13T11:28:56.008687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-14T18:44:09.548832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-13T11:28:58.617060+0000","last_change":"2023-11-13T11:28:57.635615+0000","last_active":"2023-11-13T11:28:58.617060+0000","last_peered":"2023-11-13T11:28:58.617060+0000","last_clean":"2023-11-13T11:28:58.617060+0000","last_became_active":"2023-11-13T11:28:57.635320+0000","last_became_peered":"2023-11-13T11:28:57.635320+0000","last_unstale":"2023-11-13T11:28:58.617060+0000","last_undegraded":"2023-11-13T11:28:58.617060+0000","last_fullsized":"2023-11-13T11:28:58.617060+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-13T11:28:57.010879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-13T11:28:57.010879+0000","last_clean_scrub_stamp":"2023-11-13T11:28:57.010879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-14T18:32:14.993227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-13T11:28:58.677673+0000","last_change":"2023-11-13T11:28:57.043470+0000","last_active":"2023-11-13T11:28:58.677673+0000","last_peered":"2023-11-13T11:28:58.677673+0000","last_clean":"2023-11-13T11:28:58.677673+0000","last_became_active":"2023-11-13T11:28:57.043103+0000","last_became_peered":"2023-11-13T11:28:57.043103+0000","last_unstale":"2023-11-13T11:28:58.677673+0000","last_undegraded":"2023-11-13T11:28:58.677673+0000","last_fullsized":"2023-11-13T11:28:58.677673+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-13T11:28:56.008687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-13T11:28:56.008687+0000","last_clean_scrub_stamp":"2023-11-13T11:28:56.008687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-14T22:20:18.898387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-13T11:28:58.676669+0000","last_change":"2023-11-13T11:28:57.642841+0000","last_active":"2023-11-13T11:28:58.676669+0000","last_peered":"2023-11-13T11:28:58.676669+0000","last_clean":"2023-11-13T11:28:58.676669+0000","last_became_active":"2023-11-13T11:28:57.642544+0000","last_became_peered":"2023-11-13T11:28:57.642544+0000","last_unstale":"2023-11-13T11:28:58.676669+0000","last_undegraded":"2023-11-13T11:28:58.676669+0000","last_fullsized":"2023-11-13T11:28:58.676669+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-13T11:28:57.010879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-13T11:28:57.010879+0000","last_clean_scrub_stamp":"2023-11-13T11:28:57.010879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-14T13:40:46.543740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"21'2","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-13T11:28:58.676211+0000","last_change":"2023-11-13T11:28:57.040625+0000","last_active":"2023-11-13T11:28:58.676211+0000","last_peered":"2023-11-13T11:28:58.676211+0000","last_clean":"2023-11-13T11:28:58.676211+0000","last_became_active":"2023-11-13T11:28:57.040126+0000","last_became_peered":"2023-11-13T11:28:57.040126+0000","last_unstale":"2023-11-13T11:28:58.676211+0000","last_undegraded":"2023-11-13T11:28:58.676211+0000","last_fullsized":"2023-11-13T11:28:58.676211+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-13T11:28:56.008687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-13T11:28:56.008687+0000","last_clean_scrub_stamp":"2023-11-13T11:28:56.008687+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-14T12:47:28.656211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-13T11:28:58.676350+0000","last_change":"2023-11-13T11:28:57.627475+0000","last_active":"2023-11-13T11:28:58.676350+0000","last_peered":"2023-11-13T11:28:58.676350+0000","last_clean":"2023-11-13T11:28:58.676350+0000","last_became_active":"2023-11-13T11:28:57.627157+0000","last_became_peered":"2023-11-13T11:28:57.627157+0000","last_unstale":"2023-11-13T11:28:58.676350+0000","last_undegraded":"2023-11-13T11:28:58.676350+0000","last_fullsized":"2023-11-13T11:28:58.676350+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-13T11:28:57.010879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-13T11:28:57.010879+0000","last_clean_scrub_stamp":"2023-11-13T11:28:57.010879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-14T15:37:40.674035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-13T11:28:58.676431+0000","last_change":"2023-11-13T11:28:57.642899+0000","last_active":"2023-11-13T11:28:58.676431+0000","last_peered":"2023-11-13T11:28:58.676431+0000","last_clean":"2023-11-13T11:28:58.676431+0000","last_became_active":"2023-11-13T11:28:57.642602+0000","last_became_peered":"2023-11-13T11:28:57.642602+0000","last_unstale":"2023-11-13T11:28:58.676431+0000","last_undegraded":"2023-11-13T11:28:58.676431+0000","last_fullsized":"2023-11-13T11:28:58.676431+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-13T11:28:57.010879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-13T11:28:57.010879+0000","last_clean_scrub_stamp":"2023-11-13T11:28:57.010879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-14T13:30:56.684256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1c","version":"21'2","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-13T11:28:58.677239+0000","last_change":"2023-11-13T11:28:57.049062+0000","last_active":"2023-11-13T11:28:58.677239+0000","last_peered":"2023-11-13T11:28:58.677239+0000","last_clean":"2023-11-13T11:28:58.677239+0000","last_became_active":"2023-11-13T11:28:57.048825+0000","last_became_peered":"2023-11-13T11:28:57.048825+0000","last_unstale":"2023-11-13T11:28:58.677239+0000","last_undegraded":"2023-11-13T11:28:58.677239+0000","last_fullsized":"2023-11-13T11:28:58.677239+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-13T11:28:56.008687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-13T11:28:56.008687+0000","last_clean_scrub_stamp":"2023-11-13T11:28:56.008687+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-14T22:16:56.886648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-13T11:28:58.613304+0000","last_change":"2023-11-13T11:28:57.636491+0000","last_active":"2023-11-13T11:28:58.613304+0000","last_peered":"2023-11-13T11:28:58.613304+0000","last_clean":"2023-11-13T11:28:58.613304+0000","last_became_active":"2023-11-13T11:28:57.636231+0000","last_became_peered":"2023-11-13T11:28:57.636231+0000","last_unstale":"2023-11-13T11:28:58.613304+0000","last_undegraded":"2023-11-13T11:28:58.613304+0000","last_fullsized":"2023-11-13T11:28:58.613304+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-13T11:28:57.010879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-13T11:28:57.010879+0000","last_clean_scrub_stamp":"2023-11-13T11:28:57.010879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-14T22:20:19.900579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"21'2","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-13T11:28:58.677362+0000","last_change":"2023-11-13T11:28:57.045391+0000","last_active":"2023-11-13T11:28:58.677362+0000","last_peered":"2023-11-13T11:28:58.677362+0000","last_clean":"2023-11-13T11:28:58.677362+0000","last_became_active":"2023-11-13T11:28:57.045092+0000","last_became_peered":"2023-11-13T11:28:57.045092+0000","last_unstale":"2023-11-13T11:28:58.677362+0000","last_undegraded":"2023-11-13T11:28:58.677362+0000","last_fullsized":"2023-11-13T11:28:58.677362+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-13T11:28:56.008687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-13T11:28:56.008687+0000","last_clean_scrub_stamp":"2023-11-13T11:28:56.008687+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-14T17:58:39.868445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-13T11:28:58.677800+0000","last_change":"2023-11-13T11:28:57.625394+0000","last_active":"2023-11-13T11:28:58.677800+0000","last_peered":"2023-11-13T11:28:58.677800+0000","last_clean":"2023-11-13T11:28:58.677800+0000","last_became_active":"2023-11-13T11:28:57.624669+0000","last_became_peered":"2023-11-13T11:28:57.624669+0000","last_unstale":"2023-11-13T11:28:58.677800+0000","last_undegraded":"2023-11-13T11:28:58.677800+0000","last_fullsized":"2023-11-13T11:28:58.677800+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-13T11:28:57.010879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-13T11:28:57.010879+0000","last_clean_scrub_stamp":"2023-11-13T11:28:57.010879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-14T16:35:00.051619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1e","version":"21'1","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-13T11:28:58.677808+0000","last_change":"2023-11-13T11:28:57.042653+0000","last_active":"2023-11-13T11:28:58.677808+0000","last_peered":"2023-11-13T11:28:58.677808+0000","last_clean":"2023-11-13T11:28:58.677808+0000","last_became_active":"2023-11-13T11:28:57.042473+0000","last_became_peered":"2023-11-13T11:28:57.042473+0000","last_unstale":"2023-11-13T11:28:58.677808+0000","last_undegraded":"2023-11-13T11:28:58.677808+0000","last_fullsized":"2023-11-13T11:28:58.677808+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-13T11:28:56.008687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-13T11:28:56.008687+0000","last_clean_scrub_stamp":"2023-11-13T11:28:56.008687+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-14T22:16:56.886648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-13T11:28:58.677689+0000","last_change":"2023-11-13T11:28:57.636379+0000","last_active":"2023-11-13T11:28:58.677689+0000","last_peered":"2023-11-13T11:28:58.677689+0000","last_clean":"2023-11-13T11:28:58.677689+0000","last_became_active":"2023-11-13T11:28:57.636105+0000","last_became_peered":"2023-11-13T11:28:57.636105+0000","last_unstale":"2023-11-13T11:28:58.677689+0000","last_undegraded":"2023-11-13T11:28:58.677689+0000","last_fullsized":"2023-11-13T11:28:58.677689+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-13T11:28:57.010879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-13T11:28:57.010879+0000","last_clean_scrub_stamp":"2023-11-13T11:28:57.010879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-14T13:24:50.764716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1f","version":"21'4","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-13T11:28:58.617784+0000","last_change":"2023-11-13T11:28:57.046686+0000","last_active":"2023-11-13T11:28:58.617784+0000","last_peered":"2023-11-13T11:28:58.617784+0000","last_clean":"2023-11-13T11:28:58.617784+0000","last_became_active":"2023-11-13T11:28:57.046334+0000","last_became_peered":"2023-11-13T11:28:57.046334+0000","last_unstale":"2023-11-13T11:28:58.617784+0000","last_undegraded":"2023-11-13T11:28:58.617784+0000","last_fullsized":"2023-11-13T11:28:58.617784+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-13T11:28:56.008687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-13T11:28:56.008687+0000","last_clean_scrub_stamp":"2023-11-13T11:28:56.008687+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-14T16:02:42.356089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":15,"seq":64424509445,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":221184,"data_stored":76252,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83999999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77600000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80600000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95699999999999996}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94099999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92300000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.028}]}]},{"osd":5,"up_from":15,"seq":64424509445,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27820,"kb_used_data":800,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344020,"statfs":{"total":96636764160,"available":96608276480,"internally_reserved":0,"allocated":819200,"data_stored":665743,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54500000000000004}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58999999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63200000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72899999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.499}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71099999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78600000000000003}]}]},{"osd":4,"up_from":15,"seq":64424509444,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27256,"kb_used_data":236,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344584,"statfs":{"total":96636764160,"available":96608854016,"internally_reserved":0,"allocated":241664,"data_stored":78536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56699999999999995}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75900000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71799999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80700000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84999999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78400000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73499999999999999}]}]},{"osd":3,"up_from":15,"seq":64424509445,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27240,"kb_used_data":220,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344600,"statfs":{"total":96636764160,"available":96608870400,"internally_reserved":0,"allocated":225280,"data_stored":76834,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33500000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48199999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57599999999999996}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77200000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68000000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67200000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65600000000000003}]}]},{"osd":2,"up_from":15,"seq":64424509445,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27248,"kb_used_data":228,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344592,"statfs":{"total":96636764160,"available":96608862208,"internally_reserved":0,"allocated":233472,"data_stored":77864,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40100000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51100000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42699999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92100000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88600000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90400000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97899999999999998}]}]},{"osd":1,"up_from":15,"seq":64424509446,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27824,"kb_used_data":800,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344016,"statfs":{"total":96636764160,"available":96608272384,"internally_reserved":0,"allocated":819200,"data_stored":666690,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32600000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.372}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40000000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61199999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56399999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58299999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65500000000000003}]}]},{"osd":0,"up_from":15,"seq":64424509446,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27240,"kb_used_data":220,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344600,"statfs":{"total":96636764160,"available":96608870400,"internally_reserved":0,"allocated":225280,"data_stored":75339,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34799999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51800000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.497}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85199999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70599999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90800000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78900000000000003}]}]},{"osd":7,"up_from":14,"seq":60129542149,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27252,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344588,"statfs":{"total":96636764160,"available":96608858112,"internally_reserved":0,"allocated":229376,"data_stored":76376,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.439}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66900000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48599999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63300000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41399999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61399999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59499999999999997}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-13T11:29:02.477 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-11-13T11:29:02.477 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2023-11-13T11:29:02.478 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2023-11-13T11:29:02.478 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2023-11-13T11:29:02.479 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2023-11-13T11:29:02.652 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:02.647+0000 7ff8317df640 1 Processor -- start 2023-11-13T11:29:02.652 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:02.647+0000 7ff8317df640 1 -- start start 2023-11-13T11:29:02.655 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:02.647+0000 7ff8317df640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7ff82c140540 0x7ff82c15e3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:02.655 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:02.647+0000 7ff8317df640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7ff82c06caa0 0x7ff82c0711f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:02.656 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:02.647+0000 7ff8317df640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff82c15e910 con 0x7ff82c071730 2023-11-13T11:29:02.656 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:02.647+0000 7ff8317df640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff82c071be0 con 0x7ff82c06caa0 2023-11-13T11:29:02.656 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:02.647+0000 7ff8317df640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff82c140920 con 0x7ff82c140540 2023-11-13T11:29:02.657 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:02.647+0000 7ff8227fc640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7ff82c06caa0 0x7ff82c0711f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:02.657 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:02.647+0000 7ff8227fc640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7ff82c06caa0 0x7ff82c0711f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:36140/0 (socket says 172.21.15.102:36140) 2023-11-13T11:29:02.657 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:02.647+0000 7ff8227fc640 1 -- 172.21.15.102:0/1752499393 learned_addr learned my addr 172.21.15.102:0/1752499393 (peer_addr_for_me v2:172.21.15.102:0/0) 2023-11-13T11:29:02.658 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:02.647+0000 7ff82affd640 1 --2- 172.21.15.102:0/1752499393 >> v2:172.21.15.154:3300/0 conn(0x7ff82c140540 0x7ff82c15e3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:02.658 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:02.647+0000 7ff8227fc640 1 -- 172.21.15.102:0/1752499393 >> v2:172.21.15.154:3300/0 conn(0x7ff82c140540 msgr2=0x7ff82c15e3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-13T11:29:02.658 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:02.647+0000 7ff8227fc640 1 --2- 172.21.15.102:0/1752499393 >> v2:172.21.15.154:3300/0 conn(0x7ff82c140540 0x7ff82c15e3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:02.659 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:02.647+0000 7ff8227fc640 1 -- 172.21.15.102:0/1752499393 >> v1:172.21.15.102:6789/0 conn(0x7ff82c071730 legacy=0x7ff82c06fd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:02.659 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:02.647+0000 7ff82a7fc640 1 -- 172.21.15.102:0/1752499393 <== mon.0 v1:172.21.15.102:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1868290161 0 0) 0x7ff824001120 con 0x7ff82c071730 2023-11-13T11:29:02.659 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:02.647+0000 7ff8227fc640 1 -- 172.21.15.102:0/1752499393 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff82c0ccc50 con 0x7ff82c06caa0 2023-11-13T11:29:02.660 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:02.647+0000 7ff82affd640 1 --2- 172.21.15.102:0/1752499393 >> v2:172.21.15.154:3300/0 conn(0x7ff82c140540 0x7ff82c15e3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-13T11:29:02.663 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:02.651+0000 7ff8227fc640 1 --2- 172.21.15.102:0/1752499393 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff82c06caa0 0x7ff82c0711f0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7ff82c067e10 tx=0x7ff81401c9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2c9215cca362a3a1 server_cookie=0 in_seq=0 out_seq=0 2023-11-13T11:29:02.663 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:02.651+0000 7ff82a7fc640 1 -- 172.21.15.102:0/1752499393 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8140a5860 con 0x7ff82c06caa0 2023-11-13T11:29:02.664 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:02.651+0000 7ff82a7fc640 1 -- 172.21.15.102:0/1752499393 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff8140a59c0 con 0x7ff82c06caa0 2023-11-13T11:29:02.664 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:02.651+0000 7ff82a7fc640 1 -- 172.21.15.102:0/1752499393 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8140a5d50 con 0x7ff82c06caa0 2023-11-13T11:29:02.664 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:02.651+0000 7ff8317df640 1 -- 172.21.15.102:0/1752499393 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff82c06caa0 msgr2=0x7ff82c0711f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:02.664 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:02.651+0000 7ff8317df640 1 --2- 172.21.15.102:0/1752499393 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff82c06caa0 0x7ff82c0711f0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7ff82c067e10 tx=0x7ff81401c9a0 comp rx=0 tx=0).stop 2023-11-13T11:29:02.664 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:02.651+0000 7ff8317df640 1 -- 172.21.15.102:0/1752499393 shutdown_connections 2023-11-13T11:29:02.665 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:02.651+0000 7ff8317df640 1 --2- 172.21.15.102:0/1752499393 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff82c06caa0 0x7ff82c0711f0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:02.665 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:02.651+0000 7ff8317df640 1 --2- 172.21.15.102:0/1752499393 >> v2:172.21.15.154:3300/0 conn(0x7ff82c140540 0x7ff82c15e3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:02.665 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:02.651+0000 7ff8317df640 1 -- 172.21.15.102:0/1752499393 >> 172.21.15.102:0/1752499393 conn(0x7ff82c0b0870 msgr2=0x7ff82c0b0c80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-13T11:29:02.665 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:02.651+0000 7ff8317df640 1 -- 172.21.15.102:0/1752499393 shutdown_connections 2023-11-13T11:29:02.665 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:02.651+0000 7ff8317df640 1 -- 172.21.15.102:0/1752499393 wait complete. 2023-11-13T11:29:02.666 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:02.655+0000 7ff8317df640 1 Processor -- start 2023-11-13T11:29:02.666 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:02.655+0000 7ff8317df640 1 -- start start 2023-11-13T11:29:02.666 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:02.655+0000 7ff8317df640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff82c06caa0 0x7ff82c14efc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:02.666 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:02.655+0000 7ff8317df640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff82c071730 0x7ff82c14f5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:02.666 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:02.655+0000 7ff8317df640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff82c140540 0x7ff82c14fae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:02.667 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:02.655+0000 7ff8317df640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff82c151d00 con 0x7ff82c06caa0 2023-11-13T11:29:02.667 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:02.655+0000 7ff8317df640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff82c151a20 con 0x7ff82c071730 2023-11-13T11:29:02.667 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:02.655+0000 7ff8317df640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff82c162c30 con 0x7ff82c140540 2023-11-13T11:29:02.667 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:02.655+0000 7ff82affd640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff82c06caa0 0x7ff82c14efc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:02.667 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:02.655+0000 7ff82affd640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff82c06caa0 0x7ff82c14efc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:36142/0 (socket says 172.21.15.102:36142) 2023-11-13T11:29:02.668 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:02.655+0000 7ff82affd640 1 -- 172.21.15.102:0/2111308252 learned_addr learned my addr 172.21.15.102:0/2111308252 (peer_addr_for_me v2:172.21.15.102:0/0) 2023-11-13T11:29:02.668 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:02.655+0000 7ff8227fc640 1 --2- 172.21.15.102:0/2111308252 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff82c071730 0x7ff82c14f5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:02.668 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:02.655+0000 7ff82b7fe640 1 --2- 172.21.15.102:0/2111308252 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff82c140540 0x7ff82c14fae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:02.669 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:02.655+0000 7ff82affd640 1 -- 172.21.15.102:0/2111308252 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff82c140540 msgr2=0x7ff82c14fae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:02.669 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:02.655+0000 7ff82affd640 1 --2- 172.21.15.102:0/2111308252 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff82c140540 0x7ff82c14fae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:02.669 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:02.655+0000 7ff82affd640 1 -- 172.21.15.102:0/2111308252 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff82c071730 msgr2=0x7ff82c14f5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:02.670 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:02.655+0000 7ff82affd640 1 --2- 172.21.15.102:0/2111308252 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff82c071730 0x7ff82c14f5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:02.670 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:02.655+0000 7ff82affd640 1 -- 172.21.15.102:0/2111308252 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff814009b30 con 0x7ff82c06caa0 2023-11-13T11:29:02.671 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:02.655+0000 7ff82b7fe640 1 --2- 172.21.15.102:0/2111308252 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff82c140540 0x7ff82c14fae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-13T11:29:02.671 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:02.655+0000 7ff82affd640 1 --2- 172.21.15.102:0/2111308252 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff82c06caa0 0x7ff82c14efc0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7ff81c00c7f0 tx=0x7ff81c00ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-13T11:29:02.671 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:02.655+0000 7ff823fff640 1 -- 172.21.15.102:0/2111308252 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff81c007820 con 0x7ff82c06caa0 2023-11-13T11:29:02.672 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:02.655+0000 7ff823fff640 1 -- 172.21.15.102:0/2111308252 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff81c007980 con 0x7ff82c06caa0 2023-11-13T11:29:02.672 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:02.655+0000 7ff823fff640 1 -- 172.21.15.102:0/2111308252 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff81c007d30 con 0x7ff82c06caa0 2023-11-13T11:29:02.672 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:02.655+0000 7ff8317df640 1 -- 172.21.15.102:0/2111308252 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff82c162f10 con 0x7ff82c06caa0 2023-11-13T11:29:02.673 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:02.655+0000 7ff8317df640 1 -- 172.21.15.102:0/2111308252 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff82c151f70 con 0x7ff82c06caa0 2023-11-13T11:29:02.673 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:02.659+0000 7ff8317df640 1 -- 172.21.15.102:0/2111308252 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff82c068520 con 0x7ff82c06caa0 2023-11-13T11:29:02.673 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:02.659+0000 7ff823fff640 1 -- 172.21.15.102:0/2111308252 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7ff81c0113f0 con 0x7ff82c06caa0 2023-11-13T11:29:02.675 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:02.659+0000 7ff823fff640 1 --2- 172.21.15.102:0/2111308252 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7ff80c066470 0x7ff80c068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:02.675 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:02.659+0000 7ff823fff640 1 -- 172.21.15.102:0/2111308252 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff81c084280 con 0x7ff82c06caa0 2023-11-13T11:29:02.675 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:02.659+0000 7ff8227fc640 1 --2- 172.21.15.102:0/2111308252 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7ff80c066470 0x7ff80c068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:02.676 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:02.659+0000 7ff8227fc640 1 --2- 172.21.15.102:0/2111308252 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7ff80c066470 0x7ff80c068930 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7ff8140ae000 tx=0x7ff8140a7070 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-13T11:29:02.676 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:02.663+0000 7ff823fff640 1 -- 172.21.15.102:0/2111308252 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7ff81c051660 con 0x7ff82c06caa0 2023-11-13T11:29:02.850 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:02.847+0000 7ff8317df640 1 -- 172.21.15.102:0/2111308252 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7ff82c157ee0 con 0x7ff82c06caa0 2023-11-13T11:29:02.853 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:02.847+0000 7ff823fff640 1 -- 172.21.15.102:0/2111308252 <== mon.0 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) v1 ==== 74+0+164438 (secure 0 0 0) 0x7ff81c054c80 con 0x7ff82c06caa0 2023-11-13T11:29:02.856 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T11:29:02.857 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:02.851+0000 7ff8317df640 1 -- 172.21.15.102:0/2111308252 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7ff80c066470 msgr2=0x7ff80c068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:02.858 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:02.851+0000 7ff8317df640 1 --2- 172.21.15.102:0/2111308252 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7ff80c066470 0x7ff80c068930 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7ff8140ae000 tx=0x7ff8140a7070 comp rx=0 tx=0).stop 2023-11-13T11:29:02.858 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:02.851+0000 7ff8317df640 1 -- 172.21.15.102:0/2111308252 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff82c06caa0 msgr2=0x7ff82c14efc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:02.858 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:02.851+0000 7ff8317df640 1 --2- 172.21.15.102:0/2111308252 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff82c06caa0 0x7ff82c14efc0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7ff81c00c7f0 tx=0x7ff81c00ccb0 comp rx=0 tx=0).stop 2023-11-13T11:29:02.858 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:02.851+0000 7ff8317df640 1 -- 172.21.15.102:0/2111308252 shutdown_connections 2023-11-13T11:29:02.859 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:02.851+0000 7ff8317df640 1 --2- 172.21.15.102:0/2111308252 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff82c140540 0x7ff82c14fae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:02.859 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:02.851+0000 7ff8317df640 1 --2- 172.21.15.102:0/2111308252 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff82c071730 0x7ff82c14f5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:02.859 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:02.851+0000 7ff8317df640 1 --2- 172.21.15.102:0/2111308252 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7ff80c066470 0x7ff80c068930 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:02.859 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:02.851+0000 7ff8317df640 1 --2- 172.21.15.102:0/2111308252 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff82c06caa0 0x7ff82c14efc0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:02.860 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:02.851+0000 7ff8317df640 1 -- 172.21.15.102:0/2111308252 >> 172.21.15.102:0/2111308252 conn(0x7ff82c0b0870 msgr2=0x7ff82c161660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-13T11:29:02.860 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:02.851+0000 7ff8317df640 1 -- 172.21.15.102:0/2111308252 shutdown_connections 2023-11-13T11:29:02.860 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:02.851+0000 7ff8317df640 1 -- 172.21.15.102:0/2111308252 wait complete. 2023-11-13T11:29:02.875 INFO:teuthology.orchestra.run.smithi102.stdout:{"epoch":5,"active_gid":4103,"active_name":"y","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6832","nonce":1009482693},{"type":"v1","addr":"172.21.15.102:6833","nonce":1009482693}]},"active_addr":"172.21.15.102:6833/1009482693","active_change":"2023-11-13T11:28:36.909456+0000","active_mgr_features":4540138322906710015,"available":true,"standbys":[{"gid":4100,"name":"x","mgr_features":4540138322906710015,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:v0.0.5","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:v0.0.5","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.102:0","nonce":2905534406}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.102:0","nonce":216760020}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.102:0","nonce":4137785328}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.102:0","nonce":2866466863}]}]} 2023-11-13T11:29:02.880 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2023-11-13T11:29:02.880 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2023-11-13T11:29:02.881 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-13T11:29:03.019 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.015+0000 7f4e677c4640 1 Processor -- start 2023-11-13T11:29:03.020 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.015+0000 7f4e677c4640 1 -- start start 2023-11-13T11:29:03.021 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.015+0000 7f4e677c4640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f4e600d0c40 0x7f4e600c69b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:03.021 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.015+0000 7f4e677c4640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4e600d1440 con 0x7f4e601606e0 2023-11-13T11:29:03.021 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.015+0000 7f4e677c4640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4e600cdb10 con 0x7f4e600cf490 2023-11-13T11:29:03.021 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.015+0000 7f4e677c4640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4e600d1690 con 0x7f4e600d0c40 2023-11-13T11:29:03.022 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.015+0000 7f4e64d5f640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f4e600d0c40 0x7f4e600c69b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:03.022 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.015+0000 7f4e64d5f640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f4e600d0c40 0x7f4e600c69b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:36152/0 (socket says 172.21.15.102:36152) 2023-11-13T11:29:03.022 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.015+0000 7f4e64d5f640 1 -- 172.21.15.102:0/2632344586 learned_addr learned my addr 172.21.15.102:0/2632344586 (peer_addr_for_me v2:172.21.15.102:0/0) 2023-11-13T11:29:03.022 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.015+0000 7f4e65560640 1 --1- 172.21.15.102:0/2632344586 >> v1:172.21.15.102:6789/0 conn(0x7f4e601606e0 0x7f4e600b3e20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.102:6789/0 says I am v1:172.21.15.102:47872/0 (socket says 172.21.15.102:47872) 2023-11-13T11:29:03.023 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.015+0000 7f4e64d5f640 1 -- 172.21.15.102:0/2632344586 >> v1:172.21.15.154:6789/0 conn(0x7f4e600cf490 legacy=0x7f4e600cdfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:03.023 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.015+0000 7f4e64d5f640 1 -- 172.21.15.102:0/2632344586 >> v1:172.21.15.102:6789/0 conn(0x7f4e601606e0 legacy=0x7f4e600b3e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:03.023 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.015+0000 7f4e64d5f640 1 -- 172.21.15.102:0/2632344586 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e600d1970 con 0x7f4e600d0c40 2023-11-13T11:29:03.024 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.019+0000 7f4e64d5f640 1 --2- 172.21.15.102:0/2632344586 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4e600d0c40 0x7f4e600c69b0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f4e50009870 tx=0x7f4e5001c4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=14512d1c698cf63b server_cookie=0 in_seq=0 out_seq=0 2023-11-13T11:29:03.024 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.019+0000 7f4e57fff640 1 -- 172.21.15.102:0/2632344586 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e500ac600 con 0x7f4e600d0c40 2023-11-13T11:29:03.025 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.019+0000 7f4e57fff640 1 -- 172.21.15.102:0/2632344586 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e500a8050 con 0x7f4e600d0c40 2023-11-13T11:29:03.025 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.019+0000 7f4e57fff640 1 -- 172.21.15.102:0/2632344586 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e500ac980 con 0x7f4e600d0c40 2023-11-13T11:29:03.026 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.019+0000 7f4e677c4640 1 -- 172.21.15.102:0/2632344586 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4e600d0c40 msgr2=0x7f4e600c69b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:03.026 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.019+0000 7f4e677c4640 1 --2- 172.21.15.102:0/2632344586 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4e600d0c40 0x7f4e600c69b0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f4e50009870 tx=0x7f4e5001c4b0 comp rx=0 tx=0).stop 2023-11-13T11:29:03.026 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.019+0000 7f4e677c4640 1 -- 172.21.15.102:0/2632344586 shutdown_connections 2023-11-13T11:29:03.026 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.019+0000 7f4e677c4640 1 --2- 172.21.15.102:0/2632344586 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4e600d0c40 0x7f4e600c69b0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:03.027 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.019+0000 7f4e677c4640 1 -- 172.21.15.102:0/2632344586 >> 172.21.15.102:0/2632344586 conn(0x7f4e6009c130 msgr2=0x7f4e600d2e60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-13T11:29:03.027 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.019+0000 7f4e677c4640 1 -- 172.21.15.102:0/2632344586 shutdown_connections 2023-11-13T11:29:03.027 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.019+0000 7f4e677c4640 1 -- 172.21.15.102:0/2632344586 wait complete. 2023-11-13T11:29:03.029 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.023+0000 7f4e677c4640 1 Processor -- start 2023-11-13T11:29:03.029 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.023+0000 7f4e677c4640 1 -- start start 2023-11-13T11:29:03.029 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.023+0000 7f4e677c4640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4e600cf490 0x7f4e600c5ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:03.030 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.023+0000 7f4e677c4640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4e600d0c40 0x7f4e6014ddf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:03.030 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.023+0000 7f4e677c4640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4e601606e0 0x7f4e6014f2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:03.030 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.023+0000 7f4e677c4640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e60152050 con 0x7f4e601606e0 2023-11-13T11:29:03.030 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.023+0000 7f4e677c4640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e600b7a00 con 0x7f4e600d0c40 2023-11-13T11:29:03.030 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.023+0000 7f4e677c4640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4e600b7ce0 con 0x7f4e600cf490 2023-11-13T11:29:03.031 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.023+0000 7f4e65d61640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4e601606e0 0x7f4e6014f2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:03.031 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.023+0000 7f4e65d61640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4e601606e0 0x7f4e6014f2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:36154/0 (socket says 172.21.15.102:36154) 2023-11-13T11:29:03.031 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.023+0000 7f4e65d61640 1 -- 172.21.15.102:0/2169946464 learned_addr learned my addr 172.21.15.102:0/2169946464 (peer_addr_for_me v2:172.21.15.102:0/0) 2023-11-13T11:29:03.031 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.023+0000 7f4e64d5f640 1 --2- 172.21.15.102:0/2169946464 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4e600d0c40 0x7f4e6014ddf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:03.031 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.023+0000 7f4e65560640 1 --2- 172.21.15.102:0/2169946464 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4e600cf490 0x7f4e600c5ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:03.032 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.023+0000 7f4e65d61640 1 -- 172.21.15.102:0/2169946464 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4e600cf490 msgr2=0x7f4e600c5ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:03.032 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.023+0000 7f4e65d61640 1 --2- 172.21.15.102:0/2169946464 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4e600cf490 0x7f4e600c5ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:03.032 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.023+0000 7f4e65d61640 1 -- 172.21.15.102:0/2169946464 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4e600d0c40 msgr2=0x7f4e6014ddf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:03.032 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.023+0000 7f4e65d61640 1 --2- 172.21.15.102:0/2169946464 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4e600d0c40 0x7f4e6014ddf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:03.032 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.023+0000 7f4e65d61640 1 -- 172.21.15.102:0/2169946464 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e500094d0 con 0x7f4e601606e0 2023-11-13T11:29:03.033 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.023+0000 7f4e65560640 1 --2- 172.21.15.102:0/2169946464 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4e600cf490 0x7f4e600c5ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-13T11:29:03.033 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.023+0000 7f4e65d61640 1 --2- 172.21.15.102:0/2169946464 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4e601606e0 0x7f4e6014f2f0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f4e5800c730 tx=0x7f4e5800cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-13T11:29:03.033 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.023+0000 7f4e55ffb640 1 -- 172.21.15.102:0/2169946464 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e58003b80 con 0x7f4e601606e0 2023-11-13T11:29:03.033 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.023+0000 7f4e55ffb640 1 -- 172.21.15.102:0/2169946464 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e58003ce0 con 0x7f4e601606e0 2023-11-13T11:29:03.033 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.023+0000 7f4e677c4640 1 -- 172.21.15.102:0/2169946464 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4e600b7fc0 con 0x7f4e601606e0 2023-11-13T11:29:03.034 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.023+0000 7f4e55ffb640 1 -- 172.21.15.102:0/2169946464 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e5800aa30 con 0x7f4e601606e0 2023-11-13T11:29:03.035 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.023+0000 7f4e677c4640 1 -- 172.21.15.102:0/2169946464 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4e600b8580 con 0x7f4e601606e0 2023-11-13T11:29:03.035 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.027+0000 7f4e677c4640 1 -- 172.21.15.102:0/2169946464 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4e60068520 con 0x7f4e601606e0 2023-11-13T11:29:03.035 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.027+0000 7f4e55ffb640 1 -- 172.21.15.102:0/2169946464 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f4e5800ab90 con 0x7f4e601606e0 2023-11-13T11:29:03.035 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.027+0000 7f4e55ffb640 1 --2- 172.21.15.102:0/2169946464 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f4e44066470 0x7f4e44068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:03.036 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.027+0000 7f4e55ffb640 1 -- 172.21.15.102:0/2169946464 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f4e58083b10 con 0x7f4e601606e0 2023-11-13T11:29:03.036 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.027+0000 7f4e65560640 1 --2- 172.21.15.102:0/2169946464 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f4e44066470 0x7f4e44068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:03.036 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.027+0000 7f4e65560640 1 --2- 172.21.15.102:0/2169946464 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f4e44066470 0x7f4e44068930 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f4e5c000f70 tx=0x7f4e5c007d70 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-13T11:29:03.036 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.031+0000 7f4e55ffb640 1 -- 172.21.15.102:0/2169946464 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f4e58051020 con 0x7f4e601606e0 2023-11-13T11:29:03.187 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.183+0000 7f4e677c4640 1 -- 172.21.15.102:0/2169946464 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f4e600d0410 con 0x7f4e601606e0 2023-11-13T11:29:03.188 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.183+0000 7f4e55ffb640 1 -- 172.21.15.102:0/2169946464 <== mon.0 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+16545 (secure 0 0 0) 0x7f4e58054640 con 0x7f4e601606e0 2023-11-13T11:29:03.189 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T11:29:03.189 INFO:teuthology.orchestra.run.smithi102.stdout:{"epoch":22,"fsid":"97b3eb2b-7ccf-4aae-8d92-bff986c671ea","created":"2023-11-13T11:28:31.836724+0000","modified":"2023-11-13T11:28:58.608314+0000","last_up_change":"2023-11-13T11:28:44.876638+0000","last_in_change":"2023-11-13T11:28:35.312740+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-13T11:28:44.981356+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-13T11:28:55.958525+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-13T11:28:56.394264+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"bdefaa17-fcca-4c86-aa40-27dc33a789af","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6800","nonce":53303834},{"type":"v1","addr":"172.21.15.102:6801","nonce":53303834}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6802","nonce":53303834},{"type":"v1","addr":"172.21.15.102:6803","nonce":53303834}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6806","nonce":53303834},{"type":"v1","addr":"172.21.15.102:6807","nonce":53303834}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6804","nonce":53303834},{"type":"v1","addr":"172.21.15.102:6805","nonce":53303834}]},"public_addr":"172.21.15.102:6801/53303834","cluster_addr":"172.21.15.102:6803/53303834","heartbeat_back_addr":"172.21.15.102:6807/53303834","heartbeat_front_addr":"172.21.15.102:6805/53303834","state":["exists","up"]},{"osd":1,"uuid":"f0033196-dec9-4ae9-945e-6aeef6dbb47f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6808","nonce":1732708348},{"type":"v1","addr":"172.21.15.102:6809","nonce":1732708348}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6811","nonce":1732708348},{"type":"v1","addr":"172.21.15.102:6813","nonce":1732708348}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6818","nonce":1732708348},{"type":"v1","addr":"172.21.15.102:6820","nonce":1732708348}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6815","nonce":1732708348},{"type":"v1","addr":"172.21.15.102:6817","nonce":1732708348}]},"public_addr":"172.21.15.102:6809/1732708348","cluster_addr":"172.21.15.102:6813/1732708348","heartbeat_back_addr":"172.21.15.102:6820/1732708348","heartbeat_front_addr":"172.21.15.102:6817/1732708348","state":["exists","up"]},{"osd":2,"uuid":"496b0834-351e-4ec2-a714-86ed0c0ff4fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6810","nonce":1825475150},{"type":"v1","addr":"172.21.15.102:6812","nonce":1825475150}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6814","nonce":1825475150},{"type":"v1","addr":"172.21.15.102:6816","nonce":1825475150}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6822","nonce":1825475150},{"type":"v1","addr":"172.21.15.102:6823","nonce":1825475150}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6819","nonce":1825475150},{"type":"v1","addr":"172.21.15.102:6821","nonce":1825475150}]},"public_addr":"172.21.15.102:6812/1825475150","cluster_addr":"172.21.15.102:6816/1825475150","heartbeat_back_addr":"172.21.15.102:6823/1825475150","heartbeat_front_addr":"172.21.15.102:6821/1825475150","state":["exists","up"]},{"osd":3,"uuid":"3ba6cc41-e0a0-4273-86cb-90000c06a55a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6824","nonce":4149355528},{"type":"v1","addr":"172.21.15.102:6825","nonce":4149355528}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6826","nonce":4149355528},{"type":"v1","addr":"172.21.15.102:6827","nonce":4149355528}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6830","nonce":4149355528},{"type":"v1","addr":"172.21.15.102:6831","nonce":4149355528}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6828","nonce":4149355528},{"type":"v1","addr":"172.21.15.102:6829","nonce":4149355528}]},"public_addr":"172.21.15.102:6825/4149355528","cluster_addr":"172.21.15.102:6827/4149355528","heartbeat_back_addr":"172.21.15.102:6831/4149355528","heartbeat_front_addr":"172.21.15.102:6829/4149355528","state":["exists","up"]},{"osd":4,"uuid":"16e797d8-e6e7-4140-95c3-b85283c42a2a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6808","nonce":4028899241},{"type":"v1","addr":"172.21.15.154:6809","nonce":4028899241}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6810","nonce":4028899241},{"type":"v1","addr":"172.21.15.154:6811","nonce":4028899241}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6814","nonce":4028899241},{"type":"v1","addr":"172.21.15.154:6815","nonce":4028899241}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6812","nonce":4028899241},{"type":"v1","addr":"172.21.15.154:6813","nonce":4028899241}]},"public_addr":"172.21.15.154:6809/4028899241","cluster_addr":"172.21.15.154:6811/4028899241","heartbeat_back_addr":"172.21.15.154:6815/4028899241","heartbeat_front_addr":"172.21.15.154:6813/4028899241","state":["exists","up"]},{"osd":5,"uuid":"d6ab225c-1b55-450a-89a9-abe5c3f8d6af","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":3562396827},{"type":"v1","addr":"172.21.15.154:6801","nonce":3562396827}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":3562396827},{"type":"v1","addr":"172.21.15.154:6803","nonce":3562396827}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6806","nonce":3562396827},{"type":"v1","addr":"172.21.15.154:6807","nonce":3562396827}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6804","nonce":3562396827},{"type":"v1","addr":"172.21.15.154:6805","nonce":3562396827}]},"public_addr":"172.21.15.154:6801/3562396827","cluster_addr":"172.21.15.154:6803/3562396827","heartbeat_back_addr":"172.21.15.154:6807/3562396827","heartbeat_front_addr":"172.21.15.154:6805/3562396827","state":["exists","up"]},{"osd":6,"uuid":"96f905ac-491c-4662-8e2b-5bb8e929ab9d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6816","nonce":2933728751},{"type":"v1","addr":"172.21.15.154:6817","nonce":2933728751}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6818","nonce":2933728751},{"type":"v1","addr":"172.21.15.154:6819","nonce":2933728751}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6822","nonce":2933728751},{"type":"v1","addr":"172.21.15.154:6823","nonce":2933728751}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6820","nonce":2933728751},{"type":"v1","addr":"172.21.15.154:6821","nonce":2933728751}]},"public_addr":"172.21.15.154:6817/2933728751","cluster_addr":"172.21.15.154:6819/2933728751","heartbeat_back_addr":"172.21.15.154:6823/2933728751","heartbeat_front_addr":"172.21.15.154:6821/2933728751","state":["exists","up"]},{"osd":7,"uuid":"07012d3b-3ab4-40df-a471-93caed22e2dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6824","nonce":1753500785},{"type":"v1","addr":"172.21.15.154:6825","nonce":1753500785}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6826","nonce":1753500785},{"type":"v1","addr":"172.21.15.154:6827","nonce":1753500785}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6830","nonce":1753500785},{"type":"v1","addr":"172.21.15.154:6831","nonce":1753500785}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6828","nonce":1753500785},{"type":"v1","addr":"172.21.15.154:6829","nonce":1753500785}]},"public_addr":"172.21.15.154:6825/1753500785","cluster_addr":"172.21.15.154:6827/1753500785","heartbeat_back_addr":"172.21.15.154:6831/1753500785","heartbeat_front_addr":"172.21.15.154:6829/1753500785","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-13T11:28:40.978603+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-13T11:28:41.200985+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-13T11:28:41.222815+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-13T11:28:41.202162+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-13T11:28:40.925911+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-13T11:28:41.087725+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-13T11:28:41.072208+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-13T11:28:40.875257+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-13T11:29:03.190 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.183+0000 7f4e677c4640 1 -- 172.21.15.102:0/2169946464 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f4e44066470 msgr2=0x7f4e44068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:03.190 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.183+0000 7f4e677c4640 1 --2- 172.21.15.102:0/2169946464 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f4e44066470 0x7f4e44068930 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f4e5c000f70 tx=0x7f4e5c007d70 comp rx=0 tx=0).stop 2023-11-13T11:29:03.191 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.183+0000 7f4e677c4640 1 -- 172.21.15.102:0/2169946464 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4e601606e0 msgr2=0x7f4e6014f2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:03.191 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.183+0000 7f4e677c4640 1 --2- 172.21.15.102:0/2169946464 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4e601606e0 0x7f4e6014f2f0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f4e5800c730 tx=0x7f4e5800cbf0 comp rx=0 tx=0).stop 2023-11-13T11:29:03.191 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.183+0000 7f4e677c4640 1 -- 172.21.15.102:0/2169946464 shutdown_connections 2023-11-13T11:29:03.191 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.183+0000 7f4e677c4640 1 --2- 172.21.15.102:0/2169946464 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f4e44066470 0x7f4e44068930 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:03.191 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.183+0000 7f4e677c4640 1 --2- 172.21.15.102:0/2169946464 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4e601606e0 0x7f4e6014f2f0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:03.192 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.183+0000 7f4e677c4640 1 --2- 172.21.15.102:0/2169946464 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4e600d0c40 0x7f4e6014ddf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:03.192 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.183+0000 7f4e677c4640 1 --2- 172.21.15.102:0/2169946464 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4e600cf490 0x7f4e600c5ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:03.192 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.183+0000 7f4e677c4640 1 -- 172.21.15.102:0/2169946464 >> 172.21.15.102:0/2169946464 conn(0x7f4e6009c130 msgr2=0x7f4e6015def0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-13T11:29:03.192 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.183+0000 7f4e677c4640 1 -- 172.21.15.102:0/2169946464 shutdown_connections 2023-11-13T11:29:03.192 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.187+0000 7f4e677c4640 1 -- 172.21.15.102:0/2169946464 wait complete. 2023-11-13T11:29:03.209 INFO:tasks.ceph.ceph_manager.ceph:all up! 2023-11-13T11:29:03.209 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-13T11:29:03.346 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.343+0000 7f094f59e640 1 Processor -- start 2023-11-13T11:29:03.347 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.343+0000 7f094f59e640 1 -- start start 2023-11-13T11:29:03.349 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.343+0000 7f094f59e640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f095015ce00 0x7f09500cf340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:03.349 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.343+0000 7f094f59e640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f09500d0940 0x7f09500d1270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:03.349 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.343+0000 7f094f59e640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f09500cfcb0 con 0x7f09500d17b0 2023-11-13T11:29:03.349 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.343+0000 7f094f59e640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f09500d1c60 con 0x7f09500d0940 2023-11-13T11:29:03.350 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.343+0000 7f094f59e640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f09500cff90 con 0x7f095015ce00 2023-11-13T11:29:03.350 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.343+0000 7f094dd9b640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f09500d0940 0x7f09500d1270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:03.350 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.343+0000 7f094ed9d640 1 --1- >> v1:172.21.15.102:6789/0 conn(0x7f09500d17b0 0x7f09500cd7a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.102:6789/0 says I am v1:172.21.15.102:47884/0 (socket says 172.21.15.102:47884) 2023-11-13T11:29:03.350 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.343+0000 7f094ed9d640 1 -- 172.21.15.102:0/612080038 learned_addr learned my addr 172.21.15.102:0/612080038 (peer_addr_for_me v1:172.21.15.102:0/0) 2023-11-13T11:29:03.351 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.343+0000 7f094e59c640 1 --2- 172.21.15.102:0/612080038 >> v2:172.21.15.154:3300/0 conn(0x7f095015ce00 0x7f09500cf340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:03.351 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.343+0000 7f094dd9b640 1 -- 172.21.15.102:0/612080038 >> v2:172.21.15.154:3300/0 conn(0x7f095015ce00 msgr2=0x7f09500cf340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-13T11:29:03.351 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.343+0000 7f094dd9b640 1 --2- 172.21.15.102:0/612080038 >> v2:172.21.15.154:3300/0 conn(0x7f095015ce00 0x7f09500cf340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:03.351 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.343+0000 7f094dd9b640 1 -- 172.21.15.102:0/612080038 >> v1:172.21.15.102:6789/0 conn(0x7f09500d17b0 legacy=0x7f09500cd7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:03.351 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.343+0000 7f094dd9b640 1 -- 172.21.15.102:0/612080038 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09500d0270 con 0x7f09500d0940 2023-11-13T11:29:03.352 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.343+0000 7f094e59c640 1 --2- 172.21.15.102:0/612080038 >> v2:172.21.15.154:3300/0 conn(0x7f095015ce00 0x7f09500cf340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-13T11:29:03.353 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.347+0000 7f094dd9b640 1 --2- 172.21.15.102:0/612080038 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f09500d0940 0x7f09500d1270 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f095008b8d0 tx=0x7f094401c430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=23a5b6441a2c2385 server_cookie=0 in_seq=0 out_seq=0 2023-11-13T11:29:03.353 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.347+0000 7f094d59a640 1 -- 172.21.15.102:0/612080038 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09440a7070 con 0x7f09500d0940 2023-11-13T11:29:03.353 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.347+0000 7f094d59a640 1 -- 172.21.15.102:0/612080038 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f09440ab430 con 0x7f09500d0940 2023-11-13T11:29:03.354 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.347+0000 7f094d59a640 1 -- 172.21.15.102:0/612080038 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09440ab7c0 con 0x7f09500d0940 2023-11-13T11:29:03.354 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.347+0000 7f094f59e640 1 -- 172.21.15.102:0/612080038 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f09500d0940 msgr2=0x7f09500d1270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:03.354 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.347+0000 7f094f59e640 1 --2- 172.21.15.102:0/612080038 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f09500d0940 0x7f09500d1270 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f095008b8d0 tx=0x7f094401c430 comp rx=0 tx=0).stop 2023-11-13T11:29:03.354 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.347+0000 7f094f59e640 1 -- 172.21.15.102:0/612080038 shutdown_connections 2023-11-13T11:29:03.354 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.347+0000 7f094f59e640 1 --2- 172.21.15.102:0/612080038 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f09500d0940 0x7f09500d1270 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:03.355 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.347+0000 7f094f59e640 1 --2- 172.21.15.102:0/612080038 >> v2:172.21.15.154:3300/0 conn(0x7f095015ce00 0x7f09500cf340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:03.355 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.347+0000 7f094f59e640 1 -- 172.21.15.102:0/612080038 >> 172.21.15.102:0/612080038 conn(0x7f095009bf60 msgr2=0x7f09500d2c90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-13T11:29:03.355 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.347+0000 7f094f59e640 1 -- 172.21.15.102:0/612080038 shutdown_connections 2023-11-13T11:29:03.355 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.347+0000 7f094f59e640 1 -- 172.21.15.102:0/612080038 wait complete. 2023-11-13T11:29:03.357 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.347+0000 7f094f59e640 1 Processor -- start 2023-11-13T11:29:03.358 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.351+0000 7f094f59e640 1 -- start start 2023-11-13T11:29:03.358 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.351+0000 7f094f59e640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f09500d0940 0x7f095014e1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:03.358 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.351+0000 7f094f59e640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f09500d17b0 0x7f095015c0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:03.358 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.351+0000 7f094f59e640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f095015ce00 0x7f0950151f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:03.359 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.351+0000 7f094f59e640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f095015f5c0 con 0x7f09500d0940 2023-11-13T11:29:03.359 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.351+0000 7f094f59e640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0950153b80 con 0x7f09500d17b0 2023-11-13T11:29:03.359 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.351+0000 7f094f59e640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f095015f000 con 0x7f095015ce00 2023-11-13T11:29:03.359 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.351+0000 7f094e59c640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f09500d0940 0x7f095014e1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:03.359 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.351+0000 7f094e59c640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f09500d0940 0x7f095014e1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:36172/0 (socket says 172.21.15.102:36172) 2023-11-13T11:29:03.360 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.351+0000 7f094e59c640 1 -- 172.21.15.102:0/3888937279 learned_addr learned my addr 172.21.15.102:0/3888937279 (peer_addr_for_me v2:172.21.15.102:0/0) 2023-11-13T11:29:03.360 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.351+0000 7f094dd9b640 1 --2- 172.21.15.102:0/3888937279 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f09500d17b0 0x7f095015c0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:03.360 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.351+0000 7f094ed9d640 1 --2- 172.21.15.102:0/3888937279 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f095015ce00 0x7f0950151f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:03.360 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.351+0000 7f094e59c640 1 -- 172.21.15.102:0/3888937279 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f095015ce00 msgr2=0x7f0950151f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:03.361 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.351+0000 7f094e59c640 1 --2- 172.21.15.102:0/3888937279 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f095015ce00 0x7f0950151f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:03.361 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.351+0000 7f094e59c640 1 -- 172.21.15.102:0/3888937279 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f09500d17b0 msgr2=0x7f095015c0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:03.361 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.351+0000 7f094e59c640 1 --2- 172.21.15.102:0/3888937279 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f09500d17b0 0x7f095015c0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:03.361 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.351+0000 7f094e59c640 1 -- 172.21.15.102:0/3888937279 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0944009420 con 0x7f09500d0940 2023-11-13T11:29:03.361 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.351+0000 7f094e59c640 1 --2- 172.21.15.102:0/3888937279 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f09500d0940 0x7f095014e1b0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f094000d800 tx=0x7f094000dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-13T11:29:03.362 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.351+0000 7f093effd640 1 -- 172.21.15.102:0/3888937279 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f094000b6c0 con 0x7f09500d0940 2023-11-13T11:29:03.362 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.351+0000 7f093effd640 1 -- 172.21.15.102:0/3888937279 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f094000b820 con 0x7f09500d0940 2023-11-13T11:29:03.362 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.351+0000 7f093effd640 1 -- 172.21.15.102:0/3888937279 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f094000bbd0 con 0x7f09500d0940 2023-11-13T11:29:03.362 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.351+0000 7f094f59e640 1 -- 172.21.15.102:0/3888937279 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f095015f2e0 con 0x7f09500d0940 2023-11-13T11:29:03.362 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.351+0000 7f094f59e640 1 -- 172.21.15.102:0/3888937279 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f095014e6f0 con 0x7f09500d0940 2023-11-13T11:29:03.363 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.351+0000 7f094f59e640 1 -- 172.21.15.102:0/3888937279 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0950067680 con 0x7f09500d0940 2023-11-13T11:29:03.364 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.355+0000 7f093effd640 1 -- 172.21.15.102:0/3888937279 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f094000bd30 con 0x7f09500d0940 2023-11-13T11:29:03.364 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.355+0000 7f093effd640 1 --2- 172.21.15.102:0/3888937279 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f0930066470 0x7f0930068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:03.364 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.355+0000 7f093effd640 1 -- 172.21.15.102:0/3888937279 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f0940084400 con 0x7f09500d0940 2023-11-13T11:29:03.364 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.355+0000 7f094dd9b640 1 --2- 172.21.15.102:0/3888937279 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f0930066470 0x7f0930068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:03.364 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.355+0000 7f094dd9b640 1 --2- 172.21.15.102:0/3888937279 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f0930066470 0x7f0930068930 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f09440af000 tx=0x7f09440a7000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-13T11:29:03.365 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.359+0000 7f093effd640 1 -- 172.21.15.102:0/3888937279 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f0940051800 con 0x7f09500d0940 2023-11-13T11:29:03.514 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.507+0000 7f094f59e640 1 -- 172.21.15.102:0/3888937279 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f09501539e0 con 0x7f09500d0940 2023-11-13T11:29:03.515 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.511+0000 7f093effd640 1 -- 172.21.15.102:0/3888937279 <== mon.0 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+16545 (secure 0 0 0) 0x7f09501539e0 con 0x7f09500d0940 2023-11-13T11:29:03.516 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T11:29:03.516 INFO:teuthology.orchestra.run.smithi102.stdout:{"epoch":22,"fsid":"97b3eb2b-7ccf-4aae-8d92-bff986c671ea","created":"2023-11-13T11:28:31.836724+0000","modified":"2023-11-13T11:28:58.608314+0000","last_up_change":"2023-11-13T11:28:44.876638+0000","last_in_change":"2023-11-13T11:28:35.312740+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-13T11:28:44.981356+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-13T11:28:55.958525+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-13T11:28:56.394264+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"bdefaa17-fcca-4c86-aa40-27dc33a789af","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6800","nonce":53303834},{"type":"v1","addr":"172.21.15.102:6801","nonce":53303834}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6802","nonce":53303834},{"type":"v1","addr":"172.21.15.102:6803","nonce":53303834}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6806","nonce":53303834},{"type":"v1","addr":"172.21.15.102:6807","nonce":53303834}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6804","nonce":53303834},{"type":"v1","addr":"172.21.15.102:6805","nonce":53303834}]},"public_addr":"172.21.15.102:6801/53303834","cluster_addr":"172.21.15.102:6803/53303834","heartbeat_back_addr":"172.21.15.102:6807/53303834","heartbeat_front_addr":"172.21.15.102:6805/53303834","state":["exists","up"]},{"osd":1,"uuid":"f0033196-dec9-4ae9-945e-6aeef6dbb47f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6808","nonce":1732708348},{"type":"v1","addr":"172.21.15.102:6809","nonce":1732708348}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6811","nonce":1732708348},{"type":"v1","addr":"172.21.15.102:6813","nonce":1732708348}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6818","nonce":1732708348},{"type":"v1","addr":"172.21.15.102:6820","nonce":1732708348}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6815","nonce":1732708348},{"type":"v1","addr":"172.21.15.102:6817","nonce":1732708348}]},"public_addr":"172.21.15.102:6809/1732708348","cluster_addr":"172.21.15.102:6813/1732708348","heartbeat_back_addr":"172.21.15.102:6820/1732708348","heartbeat_front_addr":"172.21.15.102:6817/1732708348","state":["exists","up"]},{"osd":2,"uuid":"496b0834-351e-4ec2-a714-86ed0c0ff4fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6810","nonce":1825475150},{"type":"v1","addr":"172.21.15.102:6812","nonce":1825475150}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6814","nonce":1825475150},{"type":"v1","addr":"172.21.15.102:6816","nonce":1825475150}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6822","nonce":1825475150},{"type":"v1","addr":"172.21.15.102:6823","nonce":1825475150}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6819","nonce":1825475150},{"type":"v1","addr":"172.21.15.102:6821","nonce":1825475150}]},"public_addr":"172.21.15.102:6812/1825475150","cluster_addr":"172.21.15.102:6816/1825475150","heartbeat_back_addr":"172.21.15.102:6823/1825475150","heartbeat_front_addr":"172.21.15.102:6821/1825475150","state":["exists","up"]},{"osd":3,"uuid":"3ba6cc41-e0a0-4273-86cb-90000c06a55a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6824","nonce":4149355528},{"type":"v1","addr":"172.21.15.102:6825","nonce":4149355528}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6826","nonce":4149355528},{"type":"v1","addr":"172.21.15.102:6827","nonce":4149355528}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6830","nonce":4149355528},{"type":"v1","addr":"172.21.15.102:6831","nonce":4149355528}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6828","nonce":4149355528},{"type":"v1","addr":"172.21.15.102:6829","nonce":4149355528}]},"public_addr":"172.21.15.102:6825/4149355528","cluster_addr":"172.21.15.102:6827/4149355528","heartbeat_back_addr":"172.21.15.102:6831/4149355528","heartbeat_front_addr":"172.21.15.102:6829/4149355528","state":["exists","up"]},{"osd":4,"uuid":"16e797d8-e6e7-4140-95c3-b85283c42a2a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6808","nonce":4028899241},{"type":"v1","addr":"172.21.15.154:6809","nonce":4028899241}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6810","nonce":4028899241},{"type":"v1","addr":"172.21.15.154:6811","nonce":4028899241}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6814","nonce":4028899241},{"type":"v1","addr":"172.21.15.154:6815","nonce":4028899241}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6812","nonce":4028899241},{"type":"v1","addr":"172.21.15.154:6813","nonce":4028899241}]},"public_addr":"172.21.15.154:6809/4028899241","cluster_addr":"172.21.15.154:6811/4028899241","heartbeat_back_addr":"172.21.15.154:6815/4028899241","heartbeat_front_addr":"172.21.15.154:6813/4028899241","state":["exists","up"]},{"osd":5,"uuid":"d6ab225c-1b55-450a-89a9-abe5c3f8d6af","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":3562396827},{"type":"v1","addr":"172.21.15.154:6801","nonce":3562396827}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":3562396827},{"type":"v1","addr":"172.21.15.154:6803","nonce":3562396827}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6806","nonce":3562396827},{"type":"v1","addr":"172.21.15.154:6807","nonce":3562396827}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6804","nonce":3562396827},{"type":"v1","addr":"172.21.15.154:6805","nonce":3562396827}]},"public_addr":"172.21.15.154:6801/3562396827","cluster_addr":"172.21.15.154:6803/3562396827","heartbeat_back_addr":"172.21.15.154:6807/3562396827","heartbeat_front_addr":"172.21.15.154:6805/3562396827","state":["exists","up"]},{"osd":6,"uuid":"96f905ac-491c-4662-8e2b-5bb8e929ab9d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6816","nonce":2933728751},{"type":"v1","addr":"172.21.15.154:6817","nonce":2933728751}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6818","nonce":2933728751},{"type":"v1","addr":"172.21.15.154:6819","nonce":2933728751}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6822","nonce":2933728751},{"type":"v1","addr":"172.21.15.154:6823","nonce":2933728751}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6820","nonce":2933728751},{"type":"v1","addr":"172.21.15.154:6821","nonce":2933728751}]},"public_addr":"172.21.15.154:6817/2933728751","cluster_addr":"172.21.15.154:6819/2933728751","heartbeat_back_addr":"172.21.15.154:6823/2933728751","heartbeat_front_addr":"172.21.15.154:6821/2933728751","state":["exists","up"]},{"osd":7,"uuid":"07012d3b-3ab4-40df-a471-93caed22e2dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6824","nonce":1753500785},{"type":"v1","addr":"172.21.15.154:6825","nonce":1753500785}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6826","nonce":1753500785},{"type":"v1","addr":"172.21.15.154:6827","nonce":1753500785}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6830","nonce":1753500785},{"type":"v1","addr":"172.21.15.154:6831","nonce":1753500785}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6828","nonce":1753500785},{"type":"v1","addr":"172.21.15.154:6829","nonce":1753500785}]},"public_addr":"172.21.15.154:6825/1753500785","cluster_addr":"172.21.15.154:6827/1753500785","heartbeat_back_addr":"172.21.15.154:6831/1753500785","heartbeat_front_addr":"172.21.15.154:6829/1753500785","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-13T11:28:40.978603+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-13T11:28:41.200985+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-13T11:28:41.222815+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-13T11:28:41.202162+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-13T11:28:40.925911+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-13T11:28:41.087725+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-13T11:28:41.072208+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-13T11:28:40.875257+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-13T11:29:03.517 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.511+0000 7f094f59e640 1 -- 172.21.15.102:0/3888937279 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f0930066470 msgr2=0x7f0930068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:03.517 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.511+0000 7f094f59e640 1 --2- 172.21.15.102:0/3888937279 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f0930066470 0x7f0930068930 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f09440af000 tx=0x7f09440a7000 comp rx=0 tx=0).stop 2023-11-13T11:29:03.518 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.511+0000 7f094f59e640 1 -- 172.21.15.102:0/3888937279 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f09500d0940 msgr2=0x7f095014e1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:03.518 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.511+0000 7f094f59e640 1 --2- 172.21.15.102:0/3888937279 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f09500d0940 0x7f095014e1b0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f094000d800 tx=0x7f094000dcc0 comp rx=0 tx=0).stop 2023-11-13T11:29:03.518 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.511+0000 7f094f59e640 1 -- 172.21.15.102:0/3888937279 shutdown_connections 2023-11-13T11:29:03.518 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.511+0000 7f094f59e640 1 --2- 172.21.15.102:0/3888937279 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f095015ce00 0x7f0950151f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:03.518 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.511+0000 7f094f59e640 1 --2- 172.21.15.102:0/3888937279 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f09500d17b0 0x7f095015c0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:03.519 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.511+0000 7f094f59e640 1 --2- 172.21.15.102:0/3888937279 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f0930066470 0x7f0930068930 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:03.519 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.511+0000 7f094f59e640 1 --2- 172.21.15.102:0/3888937279 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f09500d0940 0x7f095014e1b0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:03.519 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.511+0000 7f094f59e640 1 -- 172.21.15.102:0/3888937279 >> 172.21.15.102:0/3888937279 conn(0x7f095009bf60 msgr2=0x7f0950156630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-13T11:29:03.519 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.511+0000 7f094f59e640 1 -- 172.21.15.102:0/3888937279 shutdown_connections 2023-11-13T11:29:03.519 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.511+0000 7f094f59e640 1 -- 172.21.15.102:0/3888937279 wait complete. 2023-11-13T11:29:03.537 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2023-11-13T11:29:03.537 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2023-11-13T11:29:03.538 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2023-11-13T11:29:03.538 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2023-11-13T11:29:03.539 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2023-11-13T11:29:03.539 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2023-11-13T11:29:03.540 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2023-11-13T11:29:03.541 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2023-11-13T11:29:03.782 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.775+0000 7f0f367a1640 1 Processor -- start 2023-11-13T11:29:03.783 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.779+0000 7f0f367a1640 1 -- start start 2023-11-13T11:29:03.784 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.779+0000 7f0f367a1640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f0f28053bf0 0x7f0f28054080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:03.785 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.779+0000 7f0f367a1640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0f280067d0 0x7f0f28006c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:03.785 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.779+0000 7f0f367a1640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0f2803bfa0 con 0x7f0f280e32b0 2023-11-13T11:29:03.785 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.779+0000 7f0f367a1640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0f28058660 con 0x7f0f28053bf0 2023-11-13T11:29:03.786 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.779+0000 7f0f367a1640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0f280545c0 con 0x7f0f280067d0 2023-11-13T11:29:03.786 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.779+0000 7f0f2ffff640 1 --1- >> v1:172.21.15.102:6789/0 conn(0x7f0f280e32b0 0x7f0f2803e820 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.102:6789/0 says I am v1:172.21.15.102:47900/0 (socket says 172.21.15.102:47900) 2023-11-13T11:29:03.786 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.779+0000 7f0f2ffff640 1 -- 172.21.15.102:0/599417672 learned_addr learned my addr 172.21.15.102:0/599417672 (peer_addr_for_me v1:172.21.15.102:0/0) 2023-11-13T11:29:03.787 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.779+0000 7f0f2f7fe640 1 --2- 172.21.15.102:0/599417672 >> v2:172.21.15.154:3300/0 conn(0x7f0f28053bf0 0x7f0f28054080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:03.787 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.779+0000 7f0f34d3e640 1 --2- 172.21.15.102:0/599417672 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0f280067d0 0x7f0f28006c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:03.787 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.779+0000 7fa38ebf2640 1 Processor -- start 2023-11-13T11:29:03.788 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.779+0000 7f0f34d3e640 1 -- 172.21.15.102:0/599417672 >> v2:172.21.15.154:3300/0 conn(0x7f0f28053bf0 msgr2=0x7f0f28054080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-13T11:29:03.788 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.779+0000 7f0f34d3e640 1 --2- 172.21.15.102:0/599417672 >> v2:172.21.15.154:3300/0 conn(0x7f0f28053bf0 0x7f0f28054080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:03.789 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.779+0000 7f0f34d3e640 1 -- 172.21.15.102:0/599417672 >> v1:172.21.15.102:6789/0 conn(0x7f0f280e32b0 legacy=0x7f0f2803e820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-13T11:29:03.789 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.779+0000 7f0f34d3e640 1 -- 172.21.15.102:0/599417672 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f2803ef30 con 0x7f0f280067d0 2023-11-13T11:29:03.789 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.779+0000 7fa38ebf2640 1 -- start start 2023-11-13T11:29:03.790 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.783+0000 7f003c279640 1 Processor -- start 2023-11-13T11:29:03.790 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.783+0000 7f003c279640 1 -- start start 2023-11-13T11:29:03.790 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.783+0000 7fa38ebf2640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa38815d060 0x7fa3880d08c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:03.791 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.783+0000 7fa38ebf2640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7fa3880d3810 0x7fa3880d10a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:03.791 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.783+0000 7fa38ebf2640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa3880b27f0 con 0x7fa3880d15e0 2023-11-13T11:29:03.791 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.783+0000 7fa38ebf2640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa3880d1a70 con 0x7fa3880d3810 2023-11-13T11:29:03.791 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.783+0000 7fa38ebf2640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa3880cebe0 con 0x7fa38815d060 2023-11-13T11:29:03.792 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.783+0000 7fa38dbf0640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa38815d060 0x7fa3880d08c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:03.792 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.783+0000 7fa38dbf0640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa38815d060 0x7fa3880d08c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.102:33712/0 (socket says 172.21.15.102:33712) 2023-11-13T11:29:03.792 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.783+0000 7fa38dbf0640 1 -- 172.21.15.102:0/895251462 learned_addr learned my addr 172.21.15.102:0/895251462 (peer_addr_for_me v2:172.21.15.102:0/0) 2023-11-13T11:29:03.792 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.783+0000 7fa38d3ef640 1 --2- 172.21.15.102:0/895251462 >> v2:172.21.15.102:3300/0 conn(0x7fa3880d3810 0x7fa3880d10a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:03.793 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.783+0000 7f003c279640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f003414ad70 0x7f003406beb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:03.793 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.783+0000 7f003c279640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f00340cd9d0 0x7f00340cde60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:03.793 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.783+0000 7f003c279640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f003406d380 con 0x7f00340cc0e0 2023-11-13T11:29:03.793 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.783+0000 7f003c279640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f00340b2280 con 0x7f00340cd9d0 2023-11-13T11:29:03.794 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.783+0000 7f003c279640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00340ce3a0 con 0x7f003414ad70 2023-11-13T11:29:03.794 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.783+0000 7fa38dbf0640 1 -- 172.21.15.102:0/895251462 >> v2:172.21.15.102:3300/0 conn(0x7fa3880d3810 msgr2=0x7fa3880d10a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-13T11:29:03.794 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.783+0000 7fa38dbf0640 1 --2- 172.21.15.102:0/895251462 >> v2:172.21.15.102:3300/0 conn(0x7fa3880d3810 0x7fa3880d10a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:03.795 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.783+0000 7fa38dbf0640 1 -- 172.21.15.102:0/895251462 >> v1:172.21.15.102:6789/0 conn(0x7fa3880d15e0 legacy=0x7fa3880cf700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:03.795 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.783+0000 7fa38dbf0640 1 -- 172.21.15.102:0/895251462 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3880ce340 con 0x7fa38815d060 2023-11-13T11:29:03.795 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.783+0000 7f003a015640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f003414ad70 0x7f003406beb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:03.796 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.783+0000 7f003a816640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f00340cd9d0 0x7f00340cde60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:03.796 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.787+0000 7f003a816640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f00340cd9d0 0x7f00340cde60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:36192/0 (socket says 172.21.15.102:36192) 2023-11-13T11:29:03.796 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.787+0000 7f003a816640 1 -- 172.21.15.102:0/3034244969 learned_addr learned my addr 172.21.15.102:0/3034244969 (peer_addr_for_me v2:172.21.15.102:0/0) 2023-11-13T11:29:03.797 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.787+0000 7f0f34d3e640 1 --2- 172.21.15.102:0/599417672 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0f280067d0 0x7f0f28006c60 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f0f240097c0 tx=0x7f0f2401c390 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a4096561b99ae822 server_cookie=0 in_seq=0 out_seq=0 2023-11-13T11:29:03.797 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.787+0000 7f003a816640 1 -- 172.21.15.102:0/3034244969 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f003414ad70 msgr2=0x7f003406beb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-13T11:29:03.798 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.787+0000 7f0f2effd640 1 -- 172.21.15.102:0/599417672 <== mon.2 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f240ad640 con 0x7f0f280067d0 2023-11-13T11:29:03.798 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.787+0000 7f0f2effd640 1 -- 172.21.15.102:0/599417672 <== mon.2 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f240ad7a0 con 0x7f0f280067d0 2023-11-13T11:29:03.798 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.787+0000 7f0f2effd640 1 -- 172.21.15.102:0/599417672 <== mon.2 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f240adb30 con 0x7f0f280067d0 2023-11-13T11:29:03.799 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.787+0000 7f0f367a1640 1 -- 172.21.15.102:0/599417672 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0f280067d0 msgr2=0x7f0f28006c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:03.799 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.787+0000 7f0f367a1640 1 --2- 172.21.15.102:0/599417672 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0f280067d0 0x7f0f28006c60 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f0f240097c0 tx=0x7f0f2401c390 comp rx=0 tx=0).stop 2023-11-13T11:29:03.799 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.787+0000 7f003a816640 1 --2- 172.21.15.102:0/3034244969 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f003414ad70 0x7f003406beb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:03.799 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.787+0000 7f003a816640 1 -- 172.21.15.102:0/3034244969 >> v1:172.21.15.102:6789/0 conn(0x7f00340cc0e0 legacy=0x7f00340b1b70 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-13T11:29:03.800 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.787+0000 7f003a816640 1 -- 172.21.15.102:0/3034244969 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f003414b150 con 0x7f00340cd9d0 2023-11-13T11:29:03.800 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.787+0000 7f003a015640 1 --2- 172.21.15.102:0/3034244969 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f003414ad70 0x7f003406beb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-13T11:29:03.801 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.787+0000 7f0f367a1640 1 -- 172.21.15.102:0/599417672 shutdown_connections 2023-11-13T11:29:03.801 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.787+0000 7f0f367a1640 1 --2- 172.21.15.102:0/599417672 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0f280067d0 0x7f0f28006c60 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:03.801 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.787+0000 7f0f367a1640 1 --2- 172.21.15.102:0/599417672 >> v2:172.21.15.154:3300/0 conn(0x7f0f28053bf0 0x7f0f28054080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:03.801 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.787+0000 7f0f367a1640 1 -- 172.21.15.102:0/599417672 >> 172.21.15.102:0/599417672 conn(0x7f0f280559c0 msgr2=0x7f0f28055dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-13T11:29:03.801 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.787+0000 7f0f367a1640 1 -- 172.21.15.102:0/599417672 shutdown_connections 2023-11-13T11:29:03.802 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.787+0000 7f0f367a1640 1 -- 172.21.15.102:0/599417672 wait complete. 2023-11-13T11:29:03.802 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.787+0000 7efd77365640 1 Processor -- start 2023-11-13T11:29:03.802 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.787+0000 7efd77365640 1 -- start start 2023-11-13T11:29:03.803 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.791+0000 7fa38dbf0640 1 --2- 172.21.15.102:0/895251462 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa38815d060 0x7fa3880d08c0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fa384009870 tx=0x7fa38401c560 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3dcc6b69780ecbaf server_cookie=0 in_seq=0 out_seq=0 2023-11-13T11:29:03.803 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.791+0000 7fa38cbee640 1 -- 172.21.15.102:0/895251462 <== mon.2 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3840a9400 con 0x7fa38815d060 2023-11-13T11:29:03.803 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.791+0000 7fa38cbee640 1 -- 172.21.15.102:0/895251462 <== mon.2 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa3840a9560 con 0x7fa38815d060 2023-11-13T11:29:03.804 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.791+0000 7fa38cbee640 1 -- 172.21.15.102:0/895251462 <== mon.2 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3840a98f0 con 0x7fa38815d060 2023-11-13T11:29:03.804 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.791+0000 7f0f367a1640 1 Processor -- start 2023-11-13T11:29:03.805 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.791+0000 7efd77365640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7efd7006c1a0 0x7efd701406e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:03.805 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.791+0000 7efd77365640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efd7013e530 con 0x7efd7013df40 2023-11-13T11:29:03.805 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.791+0000 7efd77365640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efd7015f290 con 0x7efd7006dc70 2023-11-13T11:29:03.805 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.791+0000 7efd77365640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efd7015f0a0 con 0x7efd7006c1a0 2023-11-13T11:29:03.806 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.791+0000 7fa38ebf2640 1 -- 172.21.15.102:0/895251462 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa38815d060 msgr2=0x7fa3880d08c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:03.806 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.791+0000 7fa38ebf2640 1 --2- 172.21.15.102:0/895251462 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa38815d060 0x7fa3880d08c0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fa384009870 tx=0x7fa38401c560 comp rx=0 tx=0).stop 2023-11-13T11:29:03.806 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.791+0000 7ff7c1ebb640 1 Processor -- start 2023-11-13T11:29:03.807 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.791+0000 7f003a816640 1 --2- 172.21.15.102:0/3034244969 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f00340cd9d0 0x7f00340cde60 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f0024009870 tx=0x7f002401c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f20d7ea6dfb9dbb2 server_cookie=0 in_seq=0 out_seq=0 2023-11-13T11:29:03.807 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.791+0000 7efd75101640 1 --1- >> v1:172.21.15.102:6789/0 conn(0x7efd7013df40 0x7efd7015e990 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.102:6789/0 says I am v1:172.21.15.102:47908/0 (socket says 172.21.15.102:47908) 2023-11-13T11:29:03.807 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.791+0000 7efd75101640 1 -- 172.21.15.102:0/796148774 learned_addr learned my addr 172.21.15.102:0/796148774 (peer_addr_for_me v1:172.21.15.102:0/0) 2023-11-13T11:29:03.808 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.791+0000 7fa38ebf2640 1 -- 172.21.15.102:0/895251462 shutdown_connections 2023-11-13T11:29:03.808 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.791+0000 7ff7c1ebb640 1 -- start start 2023-11-13T11:29:03.809 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.791+0000 7f0039013640 1 -- 172.21.15.102:0/3034244969 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00240aa5f0 con 0x7f00340cd9d0 2023-11-13T11:29:03.809 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.791+0000 7f0039013640 1 -- 172.21.15.102:0/3034244969 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f00240aa750 con 0x7f00340cd9d0 2023-11-13T11:29:03.809 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.791+0000 7f0039013640 1 -- 172.21.15.102:0/3034244969 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00240aaae0 con 0x7f00340cd9d0 2023-11-13T11:29:03.810 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.791+0000 7fa38ebf2640 1 --2- 172.21.15.102:0/895251462 >> v2:172.21.15.102:3300/0 conn(0x7fa3880d3810 0x7fa3880d10a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:03.810 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.791+0000 7fa38ebf2640 1 --2- 172.21.15.102:0/895251462 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa38815d060 0x7fa3880d08c0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:03.810 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.791+0000 7fa38ebf2640 1 -- 172.21.15.102:0/895251462 >> 172.21.15.102:0/895251462 conn(0x7fa3880d2cf0 msgr2=0x7fa3880d3100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-13T11:29:03.811 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.791+0000 7efd67fff640 1 -- 172.21.15.102:0/796148774 <== mon.1 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2557592088 0 0) 0x7efd7015f290 con 0x7efd7006dc70 2023-11-13T11:29:03.811 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.791+0000 7efd67fff640 1 -- 172.21.15.102:0/796148774 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efd5c003530 con 0x7efd7006dc70 2023-11-13T11:29:03.811 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.791+0000 7efd67fff640 1 -- 172.21.15.102:0/796148774 <== mon.0 v1:172.21.15.102:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3767254969 0 0) 0x7efd7013e530 con 0x7efd7013df40 2023-11-13T11:29:03.811 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.791+0000 7efd67fff640 1 -- 172.21.15.102:0/796148774 --> v1:172.21.15.102:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efd7015f290 con 0x7efd7013df40 2023-11-13T11:29:03.812 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.791+0000 7fa38ebf2640 1 -- 172.21.15.102:0/895251462 shutdown_connections 2023-11-13T11:29:03.812 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.791+0000 7f0f367a1640 1 -- start start 2023-11-13T11:29:03.813 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.791+0000 7f0f367a1640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0f280067d0 0x7f0f28052700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:03.813 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.791+0000 7f0f367a1640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0f28053bf0 0x7f0f280d26f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:03.813 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.791+0000 7f0f367a1640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0f280dacc0 0x7f0f280db150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:03.813 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.791+0000 7f0f367a1640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f280d2c30 con 0x7f0f28053bf0 2023-11-13T11:29:03.813 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.791+0000 7f0f367a1640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f280db690 con 0x7f0f280067d0 2023-11-13T11:29:03.814 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.791+0000 7f0f367a1640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0f280e2a90 con 0x7f0f280dacc0 2023-11-13T11:29:03.814 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.795+0000 7f0f2ffff640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0f280067d0 0x7f0f28052700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:03.814 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.795+0000 7f0f2f7fe640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0f28053bf0 0x7f0f280d26f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:03.814 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.795+0000 7f0f2ffff640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0f280067d0 0x7f0f28052700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.102:56196/0 (socket says 172.21.15.102:56196) 2023-11-13T11:29:03.814 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.795+0000 7f0f2ffff640 1 -- 172.21.15.102:0/2964620185 learned_addr learned my addr 172.21.15.102:0/2964620185 (peer_addr_for_me v2:172.21.15.102:0/0) 2023-11-13T11:29:03.815 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.795+0000 7f0f34d3e640 1 --2- 172.21.15.102:0/2964620185 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0f280dacc0 0x7f0f280db150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:03.815 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.791+0000 7efd67fff640 1 -- 172.21.15.102:0/796148774 <== mon.1 v1:172.21.15.154:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1858869114 0 0) 0x7efd5c003530 con 0x7efd7006dc70 2023-11-13T11:29:03.815 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.791+0000 7efd67fff640 1 -- 172.21.15.102:0/796148774 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7efd7006c1a0 msgr2=0x7efd701406e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-13T11:29:03.816 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.791+0000 7efd67fff640 1 --2- 172.21.15.102:0/796148774 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7efd7006c1a0 0x7efd701406e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:03.816 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.791+0000 7efd67fff640 1 -- 172.21.15.102:0/796148774 >> v1:172.21.15.102:6789/0 conn(0x7efd7013df40 legacy=0x7efd7015e990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:03.816 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.791+0000 7efd67fff640 1 -- 172.21.15.102:0/796148774 --> v1:172.21.15.154:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd7015f570 con 0x7efd7006dc70 2023-11-13T11:29:03.816 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.791+0000 7efd67fff640 1 -- 172.21.15.102:0/796148774 <== mon.1 v1:172.21.15.154:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 895381068 0 0) 0x7efd60001680 con 0x7efd7006dc70 2023-11-13T11:29:03.817 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.791+0000 7efd67fff640 1 -- 172.21.15.102:0/796148774 >> v1:172.21.15.154:6789/0 conn(0x7efd7006dc70 legacy=0x7efd7006ba90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:03.817 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.795+0000 7f27253a7640 1 Processor -- start 2023-11-13T11:29:03.818 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.791+0000 7efd67fff640 1 --2- 172.21.15.102:0/796148774 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7efd5c003b40 0x7efd5c003f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:03.818 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.795+0000 7efd67fff640 1 --2- 172.21.15.102:0/796148774 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efd5c0047d0 0x7efd5c004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:03.818 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.795+0000 7efd67fff640 1 --2- 172.21.15.102:0/796148774 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7efd7006c1a0 0x7efd5c005220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:03.818 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.795+0000 7efd67fff640 1 -- 172.21.15.102:0/796148774 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd6c001240 con 0x7efd5c003b40 2023-11-13T11:29:03.819 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.795+0000 7efd67fff640 1 -- 172.21.15.102:0/796148774 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd5c014360 con 0x7efd5c0047d0 2023-11-13T11:29:03.819 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.795+0000 7efd67fff640 1 -- 172.21.15.102:0/796148774 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efd5c014520 con 0x7efd7006c1a0 2023-11-13T11:29:03.819 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.791+0000 7fa38ebf2640 1 -- 172.21.15.102:0/895251462 wait complete. 2023-11-13T11:29:03.820 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.791+0000 7f003c279640 1 -- 172.21.15.102:0/3034244969 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f00340cd9d0 msgr2=0x7f00340cde60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:03.820 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.791+0000 7f003c279640 1 --2- 172.21.15.102:0/3034244969 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f00340cd9d0 0x7f00340cde60 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f0024009870 tx=0x7f002401c4d0 comp rx=0 tx=0).stop 2023-11-13T11:29:03.820 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.795+0000 7f003c279640 1 -- 172.21.15.102:0/3034244969 shutdown_connections 2023-11-13T11:29:03.820 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.795+0000 7f003c279640 1 --2- 172.21.15.102:0/3034244969 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f00340cd9d0 0x7f00340cde60 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:03.821 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.795+0000 7f003c279640 1 --2- 172.21.15.102:0/3034244969 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f003414ad70 0x7f003406beb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:03.821 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.795+0000 7f003c279640 1 -- 172.21.15.102:0/3034244969 >> 172.21.15.102:0/3034244969 conn(0x7f00340cb5c0 msgr2=0x7f00340cb9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-13T11:29:03.821 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.795+0000 7efd74900640 1 --2- 172.21.15.102:0/796148774 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efd5c0047d0 0x7efd5c004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:03.821 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.795+0000 7efd75902640 1 --2- 172.21.15.102:0/796148774 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7efd7006c1a0 0x7efd5c005220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:03.822 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.795+0000 7f0f2ffff640 1 -- 172.21.15.102:0/2964620185 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0f280dacc0 msgr2=0x7f0f280db150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:03.822 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.795+0000 7f0f2ffff640 1 --2- 172.21.15.102:0/2964620185 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0f280dacc0 0x7f0f280db150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:03.822 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.795+0000 7f0f2ffff640 1 -- 172.21.15.102:0/2964620185 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0f28053bf0 msgr2=0x7f0f280d26f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:03.823 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.795+0000 7f0f2ffff640 1 --2- 172.21.15.102:0/2964620185 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0f28053bf0 0x7f0f280d26f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:03.823 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.795+0000 7f0f2ffff640 1 -- 172.21.15.102:0/2964620185 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f24009420 con 0x7f0f280067d0 2023-11-13T11:29:03.823 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.795+0000 7f003c279640 1 -- 172.21.15.102:0/3034244969 shutdown_connections 2023-11-13T11:29:03.824 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.795+0000 7ff7c1ebb640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7ff7bc1591f0 0x7ff7bc0b3510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:03.824 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.795+0000 7ff7c1ebb640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7ff7bc0ce0e0 0x7ff7bc0b1b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:03.824 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.795+0000 7efd75101640 1 --2- 172.21.15.102:0/796148774 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7efd5c003b40 0x7efd5c003f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:03.825 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.795+0000 7f27253a7640 1 -- start start 2023-11-13T11:29:03.825 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.795+0000 7f0f2ffff640 1 --2- 172.21.15.102:0/2964620185 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0f280067d0 0x7f0f28052700 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f0f1c00c3d0 tx=0x7f0f1c00c890 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-13T11:29:03.826 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.795+0000 7f003c279640 1 -- 172.21.15.102:0/3034244969 wait complete. 2023-11-13T11:29:03.826 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.795+0000 7ff7c1ebb640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff7bc070940 con 0x7ff7bc06fd10 2023-11-13T11:29:03.827 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.795+0000 7ff7c1ebb640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff7bc070560 con 0x7ff7bc0ce0e0 2023-11-13T11:29:03.827 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.795+0000 7ff7c1ebb640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff7bc070b90 con 0x7ff7bc1591f0 2023-11-13T11:29:03.827 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.795+0000 7ff7bb7fe640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7ff7bc1591f0 0x7ff7bc0b3510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:03.827 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.795+0000 7ff7bb7fe640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7ff7bc1591f0 0x7ff7bc0b3510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.102:56206/0 (socket says 172.21.15.102:56206) 2023-11-13T11:29:03.827 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.795+0000 7ff7bb7fe640 1 -- 172.21.15.102:0/1919088715 learned_addr learned my addr 172.21.15.102:0/1919088715 (peer_addr_for_me v2:172.21.15.102:0/0) 2023-11-13T11:29:03.828 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.795+0000 7efd74900640 1 -- 172.21.15.102:0/796148774 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7efd7006c1a0 msgr2=0x7efd5c005220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-13T11:29:03.828 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.795+0000 7efd74900640 1 --2- 172.21.15.102:0/796148774 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7efd7006c1a0 0x7efd5c005220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:03.828 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.795+0000 7efd74900640 1 -- 172.21.15.102:0/796148774 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7efd5c003b40 msgr2=0x7efd5c003f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-13T11:29:03.829 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.795+0000 7efd74900640 1 --2- 172.21.15.102:0/796148774 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7efd5c003b40 0x7efd5c003f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:03.829 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.795+0000 7efd74900640 1 -- 172.21.15.102:0/796148774 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd7015f570 con 0x7efd5c0047d0 2023-11-13T11:29:03.829 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.795+0000 7efd75101640 1 --2- 172.21.15.102:0/796148774 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7efd5c003b40 0x7efd5c003f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-13T11:29:03.829 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.795+0000 7fa38ebf2640 1 Processor -- start 2023-11-13T11:29:03.830 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.795+0000 7ff7bb7fe640 1 -- 172.21.15.102:0/1919088715 >> v2:172.21.15.102:3300/0 conn(0x7ff7bc0ce0e0 msgr2=0x7ff7bc0b1b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-13T11:29:03.830 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.795+0000 7ff7bb7fe640 1 --2- 172.21.15.102:0/1919088715 >> v2:172.21.15.102:3300/0 conn(0x7ff7bc0ce0e0 0x7ff7bc0b1b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:03.830 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.795+0000 7ff7bb7fe640 1 -- 172.21.15.102:0/1919088715 >> v1:172.21.15.154:6789/0 conn(0x7ff7bc06fd10 legacy=0x7ff7bc0cd9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:03.831 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.799+0000 7f0f2cff9640 1 -- 172.21.15.102:0/2964620185 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f1c005cf0 con 0x7f0f280067d0 2023-11-13T11:29:03.831 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.799+0000 7f0f2cff9640 1 -- 172.21.15.102:0/2964620185 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f1c005e50 con 0x7f0f280067d0 2023-11-13T11:29:03.831 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.799+0000 7f0f2cff9640 1 -- 172.21.15.102:0/2964620185 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f1c0072f0 con 0x7f0f280067d0 2023-11-13T11:29:03.832 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.799+0000 7f003c279640 1 Processor -- start 2023-11-13T11:29:03.832 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.795+0000 7fa38ebf2640 1 -- start start 2023-11-13T11:29:03.833 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.795+0000 7ff7bb7fe640 1 -- 172.21.15.102:0/1919088715 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7bc070e70 con 0x7ff7bc1591f0 2023-11-13T11:29:03.833 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.795+0000 7f91c4832640 1 Processor -- start 2023-11-13T11:29:03.833 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.799+0000 7f91c4832640 1 -- start start 2023-11-13T11:29:03.834 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.795+0000 7f27253a7640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f27200d3730 0x7f272015fa00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:03.834 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.795+0000 7f27253a7640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f27200d07e0 con 0x7f272015ff40 2023-11-13T11:29:03.834 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.795+0000 7f27253a7640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f27200ce460 con 0x7f2720160d80 2023-11-13T11:29:03.834 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.795+0000 7f27253a7640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f27200ce740 con 0x7f27200d3730 2023-11-13T11:29:03.835 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.799+0000 7f2717fff640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f27200d3730 0x7f272015fa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:03.835 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.799+0000 7f2717fff640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f27200d3730 0x7f272015fa00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.102:56216/0 (socket says 172.21.15.102:56216) 2023-11-13T11:29:03.835 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.799+0000 7f2717fff640 1 -- 172.21.15.102:0/1146946898 learned_addr learned my addr 172.21.15.102:0/1146946898 (peer_addr_for_me v2:172.21.15.102:0/0) 2023-11-13T11:29:03.835 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.799+0000 7f2717fff640 1 -- 172.21.15.102:0/1146946898 >> v1:172.21.15.154:6789/0 conn(0x7f2720160d80 legacy=0x7f2720161160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-13T11:29:03.836 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.799+0000 7f003c279640 1 -- start start 2023-11-13T11:29:03.837 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.799+0000 7fa38ebf2640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa3880d15e0 0x7fa3880c7660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:03.838 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.799+0000 7fa38ebf2640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa3880d3810 0x7fa38815c390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:03.838 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.799+0000 7fa38ebf2640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa38815d060 0x7fa3880c69b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:03.838 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.799+0000 7fa38ebf2640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa38814f200 con 0x7fa3880d3810 2023-11-13T11:29:03.838 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.799+0000 7fa38ebf2640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa38814f000 con 0x7fa38815d060 2023-11-13T11:29:03.839 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.799+0000 7fa38ebf2640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa38814f9d0 con 0x7fa3880d15e0 2023-11-13T11:29:03.839 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.799+0000 7fa38e3f1640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa38815d060 0x7fa3880c69b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:03.839 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.799+0000 7fa38e3f1640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa38815d060 0x7fa3880c69b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.102:56228/0 (socket says 172.21.15.102:56228) 2023-11-13T11:29:03.839 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.799+0000 7fa38e3f1640 1 -- 172.21.15.102:0/3986701631 learned_addr learned my addr 172.21.15.102:0/3986701631 (peer_addr_for_me v2:172.21.15.102:0/0) 2023-11-13T11:29:03.839 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.799+0000 7fa38d3ef640 1 --2- 172.21.15.102:0/3986701631 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa3880d3810 0x7fa38815c390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:03.840 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.799+0000 7fa38e3f1640 1 -- 172.21.15.102:0/3986701631 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa3880d15e0 msgr2=0x7fa3880c7660 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-11-13T11:29:03.840 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.799+0000 7fa38e3f1640 1 --2- 172.21.15.102:0/3986701631 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa3880d15e0 0x7fa3880c7660 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:03.840 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.799+0000 7fa38e3f1640 1 -- 172.21.15.102:0/3986701631 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa3880d3810 msgr2=0x7fa38815c390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:03.840 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.799+0000 7fa38e3f1640 1 --2- 172.21.15.102:0/3986701631 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa3880d3810 0x7fa38815c390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:03.840 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.799+0000 7fa38e3f1640 1 -- 172.21.15.102:0/3986701631 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3840094d0 con 0x7fa38815d060 2023-11-13T11:29:03.841 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.799+0000 7fa38d3ef640 1 --2- 172.21.15.102:0/3986701631 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa3880d3810 0x7fa38815c390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-13T11:29:03.841 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.799+0000 7fa38e3f1640 1 --2- 172.21.15.102:0/3986701631 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa38815d060 0x7fa3880c69b0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fa38000c730 tx=0x7fa38000cbf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-13T11:29:03.841 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.799+0000 7f0f367a1640 1 -- 172.21.15.102:0/2964620185 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0f280d2f40 con 0x7f0f280067d0 2023-11-13T11:29:03.842 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.799+0000 7f0f367a1640 1 -- 172.21.15.102:0/2964620185 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0f2804eee0 con 0x7f0f280067d0 2023-11-13T11:29:03.842 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.799+0000 7fa37e7fc640 1 -- 172.21.15.102:0/3986701631 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa380003b80 con 0x7fa38815d060 2023-11-13T11:29:03.842 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.799+0000 7fa37e7fc640 1 -- 172.21.15.102:0/3986701631 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa380003ce0 con 0x7fa38815d060 2023-11-13T11:29:03.842 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.799+0000 7fa38ebf2640 1 -- 172.21.15.102:0/3986701631 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa3880c94b0 con 0x7fa38815d060 2023-11-13T11:29:03.843 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.799+0000 7fa37e7fc640 1 -- 172.21.15.102:0/3986701631 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa38000aa30 con 0x7fa38815d060 2023-11-13T11:29:03.843 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.799+0000 7fa38ebf2640 1 -- 172.21.15.102:0/3986701631 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa38814f6f0 con 0x7fa38815d060 2023-11-13T11:29:03.843 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.799+0000 7efd74900640 1 --2- 172.21.15.102:0/796148774 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efd5c0047d0 0x7efd5c004c50 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7efd6000c160 tx=0x7efd6001cb20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4457701cffa68c15 server_cookie=0 in_seq=0 out_seq=0 2023-11-13T11:29:03.843 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.799+0000 7efd67fff640 1 -- 172.21.15.102:0/796148774 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd600a56f0 con 0x7efd5c0047d0 2023-11-13T11:29:03.844 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.803+0000 7efd67fff640 1 -- 172.21.15.102:0/796148774 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd600a5870 con 0x7efd5c0047d0 2023-11-13T11:29:03.844 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.803+0000 7efd67fff640 1 -- 172.21.15.102:0/796148774 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd600a5c60 con 0x7efd5c0047d0 2023-11-13T11:29:03.844 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.799+0000 7f91c4832640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f91c006c7e0 0x7f91c006d890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:03.844 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.799+0000 7f91c4832640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f91c0072050 con 0x7f91c006c400 2023-11-13T11:29:03.845 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.799+0000 7f91c4832640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f91c006d400 con 0x7f91c006de00 2023-11-13T11:29:03.845 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.799+0000 7f91c4832640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f91c0071d70 con 0x7f91c006c7e0 2023-11-13T11:29:03.845 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.799+0000 7f91be59c640 1 --1- >> v1:172.21.15.102:6789/0 conn(0x7f91c006c400 0x7f91c015d6a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.102:6789/0 says I am v1:172.21.15.102:47922/0 (socket says 172.21.15.102:47922) 2023-11-13T11:29:03.845 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.803+0000 7f91be59c640 1 -- 172.21.15.102:0/2507950505 learned_addr learned my addr 172.21.15.102:0/2507950505 (peer_addr_for_me v1:172.21.15.102:0/0) 2023-11-13T11:29:03.846 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.799+0000 7f2717fff640 1 -- 172.21.15.102:0/1146946898 >> v1:172.21.15.102:6789/0 conn(0x7f272015ff40 legacy=0x7f27200d0c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:03.846 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.799+0000 7f2717fff640 1 -- 172.21.15.102:0/1146946898 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27200cea20 con 0x7f27200d3730 2023-11-13T11:29:03.846 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.803+0000 7f0f367a1640 1 -- 172.21.15.102:0/2964620185 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f0f280062b0 con 0x7f0f280067d0 2023-11-13T11:29:03.847 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.803+0000 7f91bed9d640 1 --2- 172.21.15.102:0/2507950505 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f91c006c7e0 0x7f91c006d890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:03.847 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.803+0000 7fa38ebf2640 1 -- 172.21.15.102:0/3986701631 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fa388068520 con 0x7fa38815d060 2023-11-13T11:29:03.848 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.803+0000 7ffa38572640 1 Processor -- start 2023-11-13T11:29:03.848 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.803+0000 7ff7bb7fe640 1 --2- 172.21.15.102:0/1919088715 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff7bc1591f0 0x7ff7bc0b3510 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7ff7bc074680 tx=0x7ff7b401e9d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=365c1fdc5aefc64c server_cookie=0 in_seq=0 out_seq=0 2023-11-13T11:29:03.849 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.803+0000 7f91bd59a640 1 -- 172.21.15.102:0/2507950505 <== mon.1 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3057476003 0 0) 0x7f91c006d400 con 0x7f91c006de00 2023-11-13T11:29:03.849 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.803+0000 7f91bd59a640 1 -- 172.21.15.102:0/2507950505 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f91ac003530 con 0x7f91c006de00 2023-11-13T11:29:03.850 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.803+0000 7f91bd59a640 1 -- 172.21.15.102:0/2507950505 <== mon.0 v1:172.21.15.102:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 655474383 0 0) 0x7f91a8001120 con 0x7f91c006c400 2023-11-13T11:29:03.850 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.803+0000 7f91bd59a640 1 -- 172.21.15.102:0/2507950505 --> v1:172.21.15.102:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f91c006d400 con 0x7f91c006c400 2023-11-13T11:29:03.850 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.803+0000 7ff7ba7fc640 1 -- 172.21.15.102:0/1919088715 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7b40a79b0 con 0x7ff7bc1591f0 2023-11-13T11:29:03.851 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.803+0000 7efd77365640 1 -- 172.21.15.102:0/796148774 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efd5c0047d0 msgr2=0x7efd5c004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:03.851 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.803+0000 7f91bed9d640 1 -- 172.21.15.102:0/2507950505 >> v1:172.21.15.154:6789/0 conn(0x7f91c006de00 legacy=0x7f91c0161e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:03.851 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.803+0000 7f91bed9d640 1 -- 172.21.15.102:0/2507950505 >> v1:172.21.15.102:6789/0 conn(0x7f91c006c400 legacy=0x7f91c015d6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:03.851 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.803+0000 7f91bed9d640 1 -- 172.21.15.102:0/2507950505 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91c00b2690 con 0x7f91c006c7e0 2023-11-13T11:29:03.852 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.803+0000 7f003c279640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f00340cc0e0 0x7f003415d6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:03.852 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.803+0000 7f003c279640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f00340cd9d0 0x7f003415cd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:03.852 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.803+0000 7f003c279640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f003414ad70 0x7f003415ed20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:03.853 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.803+0000 7ff7ba7fc640 1 -- 172.21.15.102:0/1919088715 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff7b40ab070 con 0x7ff7bc1591f0 2023-11-13T11:29:03.853 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.803+0000 7efd77365640 1 --2- 172.21.15.102:0/796148774 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efd5c0047d0 0x7efd5c004c50 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7efd6000c160 tx=0x7efd6001cb20 comp rx=0 tx=0).stop 2023-11-13T11:29:03.853 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.803+0000 7efd75902640 1 -- 172.21.15.102:0/796148774 reap_dead start 2023-11-13T11:29:03.854 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.803+0000 7ff7ba7fc640 1 -- 172.21.15.102:0/1919088715 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7b40a7d30 con 0x7ff7bc1591f0 2023-11-13T11:29:03.854 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.803+0000 7ff7c1ebb640 1 -- 172.21.15.102:0/1919088715 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff7bc1591f0 msgr2=0x7ff7bc0b3510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:03.854 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.803+0000 7ff7c1ebb640 1 --2- 172.21.15.102:0/1919088715 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff7bc1591f0 0x7ff7bc0b3510 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7ff7bc074680 tx=0x7ff7b401e9d0 comp rx=0 tx=0).stop 2023-11-13T11:29:03.855 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.803+0000 7efd77365640 1 -- 172.21.15.102:0/796148774 shutdown_connections 2023-11-13T11:29:03.855 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.803+0000 7efd77365640 1 -- 172.21.15.102:0/796148774 >> 172.21.15.102:0/796148774 conn(0x7efd700b0870 msgr2=0x7efd700b0c80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-13T11:29:03.856 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.803+0000 7ff7c1ebb640 1 -- 172.21.15.102:0/1919088715 shutdown_connections 2023-11-13T11:29:03.856 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.803+0000 7ff7c1ebb640 1 --2- 172.21.15.102:0/1919088715 >> v2:172.21.15.102:3300/0 conn(0x7ff7bc0ce0e0 0x7ff7bc0b1b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:03.856 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.803+0000 7ff7c1ebb640 1 --2- 172.21.15.102:0/1919088715 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff7bc1591f0 0x7ff7bc0b3510 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:03.856 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.803+0000 7ff7c1ebb640 1 -- 172.21.15.102:0/1919088715 >> 172.21.15.102:0/1919088715 conn(0x7ff7bc0cb5c0 msgr2=0x7ff7bc0cb9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-13T11:29:03.857 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.803+0000 7f0f2cff9640 1 -- 172.21.15.102:0/2964620185 <== mon.1 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f0f1c007450 con 0x7f0f280067d0 2023-11-13T11:29:03.857 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.803+0000 7f003a015640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f00340cc0e0 0x7f003415d6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:03.857 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.803+0000 7f003a015640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f00340cc0e0 0x7f003415d6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.102:56230/0 (socket says 172.21.15.102:56230) 2023-11-13T11:29:03.857 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.803+0000 7f0039814640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f00340cd9d0 0x7f003415cd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:03.858 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.803+0000 7f0039814640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f00340cd9d0 0x7f003415cd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.102:33748/0 (socket says 172.21.15.102:33748) 2023-11-13T11:29:03.858 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.803+0000 7ff7c1ebb640 1 -- 172.21.15.102:0/1919088715 shutdown_connections 2023-11-13T11:29:03.858 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.803+0000 7ff7c1ebb640 1 -- 172.21.15.102:0/1919088715 wait complete. 2023-11-13T11:29:03.859 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.803+0000 7ffa38572640 1 -- start start 2023-11-13T11:29:03.859 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.803+0000 7ffa38572640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7ffa301606e0 0x7ffa300c69b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:03.860 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.803+0000 7f003c279640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f003415d250 con 0x7f003414ad70 2023-11-13T11:29:03.860 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.803+0000 7f003c279640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f003415dc80 con 0x7f00340cc0e0 2023-11-13T11:29:03.860 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.803+0000 7f003c279640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f003415df60 con 0x7f00340cd9d0 2023-11-13T11:29:03.860 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.803+0000 7f003a015640 1 -- 172.21.15.102:0/4098886927 learned_addr learned my addr 172.21.15.102:0/4098886927 (peer_addr_for_me v2:172.21.15.102:0/0) 2023-11-13T11:29:03.861 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.803+0000 7fa37e7fc640 1 -- 172.21.15.102:0/3986701631 <== mon.1 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fa38000ab90 con 0x7fa38815d060 2023-11-13T11:29:03.861 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.803+0000 7ffa3630e640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7ffa301606e0 0x7ffa300c69b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:03.861 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.803+0000 7ffa3630e640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7ffa301606e0 0x7ffa300c69b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.102:56232/0 (socket says 172.21.15.102:56232) 2023-11-13T11:29:03.862 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.803+0000 7f003a816640 1 --2- 172.21.15.102:0/4098886927 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f003414ad70 0x7f003415ed20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:03.862 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.807+0000 7f003a816640 1 -- 172.21.15.102:0/4098886927 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f00340cd9d0 msgr2=0x7f003415cd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:03.862 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.807+0000 7f003a816640 1 --2- 172.21.15.102:0/4098886927 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f00340cd9d0 0x7f003415cd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:03.863 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.807+0000 7f003a816640 1 -- 172.21.15.102:0/4098886927 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f00340cc0e0 msgr2=0x7f003415d6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:03.863 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.807+0000 7efd77365640 1 -- 172.21.15.102:0/796148774 shutdown_connections 2023-11-13T11:29:03.863 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.807+0000 7ffa35b0d640 1 --1- >> v1:172.21.15.102:6789/0 conn(0x7ffa300d0c40 0x7ffa300b3e20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.102:6789/0 says I am v1:172.21.15.102:47932/0 (socket says 172.21.15.102:47932) 2023-11-13T11:29:03.864 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.807+0000 7f0f2cff9640 1 --2- 172.21.15.102:0/2964620185 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f0f140664c0 0x7f0f14068980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:03.864 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.807+0000 7fa37e7fc640 1 --2- 172.21.15.102:0/3986701631 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7fa36c066470 0x7fa36c068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:03.865 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.807+0000 7f2717fff640 1 --2- 172.21.15.102:0/1146946898 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f27200d3730 0x7f272015fa00 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f2708009870 tx=0x7f270801c490 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d62dc1ef537b09ea server_cookie=0 in_seq=0 out_seq=0 2023-11-13T11:29:03.865 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.807+0000 7f0f2cff9640 1 -- 172.21.15.102:0/2964620185 <== mon.1 v2:172.21.15.154:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f0f1c083380 con 0x7f0f280067d0 2023-11-13T11:29:03.866 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.807+0000 7fa37e7fc640 1 -- 172.21.15.102:0/3986701631 <== mon.1 v2:172.21.15.154:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa380083d00 con 0x7fa38815d060 2023-11-13T11:29:03.866 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.807+0000 7efd77365640 1 -- 172.21.15.102:0/796148774 wait complete. 2023-11-13T11:29:03.867 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.807+0000 7f271f7fe640 1 -- 172.21.15.102:0/1146946898 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27080ab650 con 0x7f27200d3730 2023-11-13T11:29:03.867 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.807+0000 7fa37e7fc640 1 --2- 172.21.15.102:0/3986701631 >> [v2:172.21.15.102:6810/1825475150,v1:172.21.15.102:6812/1825475150] conn(0x7fa36c06e690 0x7fa36c070ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:03.867 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.807+0000 7fa37e7fc640 1 -- 172.21.15.102:0/3986701631 --> [v2:172.21.15.102:6810/1825475150,v1:172.21.15.102:6812/1825475150] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fa36c071160 con 0x7fa36c06e690 2023-11-13T11:29:03.867 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.807+0000 7fa37e7fc640 1 -- 172.21.15.102:0/3986701631 <== mon.1 v2:172.21.15.154:3300/0 6 ==== mon_get_version_reply(handle=1 version=22) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa380086320 con 0x7fa38815d060 2023-11-13T11:29:03.868 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.807+0000 7ffa38572640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7ffa300cf490 0x7ffa300cf920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:03.868 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.807+0000 7f0f2cff9640 1 --2- 172.21.15.102:0/2964620185 >> [v2:172.21.15.102:6800/53303834,v1:172.21.15.102:6801/53303834] conn(0x7f0f1406e6e0 0x7f0f14070b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:03.868 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.807+0000 7f0f2cff9640 1 -- 172.21.15.102:0/2964620185 --> [v2:172.21.15.102:6800/53303834,v1:172.21.15.102:6801/53303834] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f0f140711b0 con 0x7f0f1406e6e0 2023-11-13T11:29:03.869 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.807+0000 7f0f2cff9640 1 -- 172.21.15.102:0/2964620185 <== mon.1 v2:172.21.15.154:3300/0 6 ==== mon_get_version_reply(handle=1 version=22) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0f1c085960 con 0x7f0f280067d0 2023-11-13T11:29:03.869 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.807+0000 7fa38d3ef640 1 --2- 172.21.15.102:0/3986701631 >> [v2:172.21.15.102:6810/1825475150,v1:172.21.15.102:6812/1825475150] conn(0x7fa36c06e690 0x7fa36c070ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:03.870 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.807+0000 7ff7c1ebb640 1 Processor -- start 2023-11-13T11:29:03.870 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.807+0000 7f271f7fe640 1 -- 172.21.15.102:0/1146946898 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f27080ab7b0 con 0x7f27200d3730 2023-11-13T11:29:03.870 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.807+0000 7f271f7fe640 1 -- 172.21.15.102:0/1146946898 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27080abb40 con 0x7f27200d3730 2023-11-13T11:29:03.871 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.807+0000 7f0f34d3e640 1 --2- 172.21.15.102:0/2964620185 >> [v2:172.21.15.102:6800/53303834,v1:172.21.15.102:6801/53303834] conn(0x7f0f1406e6e0 0x7f0f14070b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:03.871 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.807+0000 7f0f2f7fe640 1 --2- 172.21.15.102:0/2964620185 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f0f140664c0 0x7f0f14068980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:03.871 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.807+0000 7f003a816640 1 --2- 172.21.15.102:0/4098886927 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f00340cc0e0 0x7f003415d6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:03.872 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.807+0000 7f003a816640 1 -- 172.21.15.102:0/4098886927 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f002c009a70 con 0x7f003414ad70 2023-11-13T11:29:03.872 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.807+0000 7f003a816640 1 --2- 172.21.15.102:0/4098886927 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f003414ad70 0x7f003415ed20 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f00240ab000 tx=0x7f002401ad10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-13T11:29:03.872 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.807+0000 7ff7c1ebb640 1 -- start start 2023-11-13T11:29:03.873 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.807+0000 7f91bed9d640 1 --2- 172.21.15.102:0/2507950505 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f91c006c7e0 0x7f91c006d890 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f91b8009dc0 tx=0x7f91b801c8b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bf6c7409d4bd7a6f server_cookie=0 in_seq=0 out_seq=0 2023-11-13T11:29:03.873 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.807+0000 7f27253a7640 1 -- 172.21.15.102:0/1146946898 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f27200d3730 msgr2=0x7f272015fa00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:03.873 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.807+0000 7f27253a7640 1 --2- 172.21.15.102:0/1146946898 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f27200d3730 0x7f272015fa00 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f2708009870 tx=0x7f270801c490 comp rx=0 tx=0).stop 2023-11-13T11:29:03.873 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.807+0000 7f27253a7640 1 -- 172.21.15.102:0/1146946898 shutdown_connections 2023-11-13T11:29:03.874 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.807+0000 7f27253a7640 1 --2- 172.21.15.102:0/1146946898 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f27200d3730 0x7f272015fa00 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:03.874 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.807+0000 7f27253a7640 1 -- 172.21.15.102:0/1146946898 >> 172.21.15.102:0/1146946898 conn(0x7f27200d2c10 msgr2=0x7f27200d3020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-13T11:29:03.874 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.807+0000 7fa38d3ef640 1 --2- 172.21.15.102:0/3986701631 >> [v2:172.21.15.102:6810/1825475150,v1:172.21.15.102:6812/1825475150] conn(0x7fa36c06e690 0x7fa36c070ab0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-13T11:29:03.875 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.807+0000 7f91bd59a640 1 -- 172.21.15.102:0/2507950505 <== mon.2 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91b80a5990 con 0x7f91c006c7e0 2023-11-13T11:29:03.875 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.807+0000 7f91bd59a640 1 -- 172.21.15.102:0/2507950505 <== mon.2 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f91b80a5af0 con 0x7f91c006c7e0 2023-11-13T11:29:03.876 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.807+0000 7f27253a7640 1 -- 172.21.15.102:0/1146946898 shutdown_connections 2023-11-13T11:29:03.876 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.807+0000 7f27253a7640 1 -- 172.21.15.102:0/1146946898 wait complete. 2023-11-13T11:29:03.876 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.807+0000 7f0f2f7fe640 1 --2- 172.21.15.102:0/2964620185 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f0f140664c0 0x7f0f14068980 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f0f3002cd30 tx=0x7f0f3008d040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-13T11:29:03.877 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.807+0000 7f0f34d3e640 1 --2- 172.21.15.102:0/2964620185 >> [v2:172.21.15.102:6800/53303834,v1:172.21.15.102:6801/53303834] conn(0x7f0f1406e6e0 0x7f0f14070b00 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-13T11:29:03.877 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.807+0000 7f003a015640 1 --2- 172.21.15.102:0/4098886927 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f00340cc0e0 0x7f003415d6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-13T11:29:03.877 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.807+0000 7f002affd640 1 -- 172.21.15.102:0/4098886927 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00240bd5f0 con 0x7f003414ad70 2023-11-13T11:29:03.877 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.807+0000 7f002affd640 1 -- 172.21.15.102:0/4098886927 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f00240bd750 con 0x7f003414ad70 2023-11-13T11:29:03.878 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.807+0000 7f002affd640 1 -- 172.21.15.102:0/4098886927 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00240bdb00 con 0x7f003414ad70 2023-11-13T11:29:03.878 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.811+0000 7f003c279640 1 -- 172.21.15.102:0/4098886927 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f00240094d0 con 0x7f003414ad70 2023-11-13T11:29:03.878 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.811+0000 7fa37e7fc640 1 -- 172.21.15.102:0/3986701631 <== osd.2 v2:172.21.15.102:6810/1825475150 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26745 (crc 0 0 0) 0x7fa36c071160 con 0x7fa36c06e690 2023-11-13T11:29:03.879 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.807+0000 7ff7c1ebb640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff7bc06fd10 0x7ff7bc147760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:03.879 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.807+0000 7ff7c1ebb640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff7bc0ce0e0 0x7ff7bc1fa960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:03.879 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.807+0000 7ff7c1ebb640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff7bc1591f0 0x7ff7bc14b700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:03.879 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.807+0000 7ff7c1ebb640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7bc168da0 con 0x7ff7bc0ce0e0 2023-11-13T11:29:03.880 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.807+0000 7ff7c1ebb640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7bc14ccc0 con 0x7ff7bc06fd10 2023-11-13T11:29:03.880 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.807+0000 7ff7c1ebb640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff7bc14af90 con 0x7ff7bc1591f0 2023-11-13T11:29:03.880 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.811+0000 7ff7baffd640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff7bc0ce0e0 0x7ff7bc1fa960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:03.880 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.811+0000 7ff7bb7fe640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff7bc06fd10 0x7ff7bc147760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:03.881 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.807+0000 7efd77365640 1 Processor -- start 2023-11-13T11:29:03.881 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.807+0000 7f91bd59a640 1 -- 172.21.15.102:0/2507950505 <== mon.2 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91b80a5990 con 0x7f91c006c7e0 2023-11-13T11:29:03.881 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.807+0000 7f91c4832640 1 -- 172.21.15.102:0/2507950505 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f91c006c7e0 msgr2=0x7f91c006d890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:03.881 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.807+0000 7f91c4832640 1 --2- 172.21.15.102:0/2507950505 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f91c006c7e0 0x7f91c006d890 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f91b8009dc0 tx=0x7f91b801c8b0 comp rx=0 tx=0).stop 2023-11-13T11:29:03.882 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.807+0000 7ffa35b0d640 1 -- 172.21.15.102:0/3764824612 learned_addr learned my addr 172.21.15.102:0/3764824612 (peer_addr_for_me v1:172.21.15.102:0/0) 2023-11-13T11:29:03.882 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.807+0000 7ffa36b0f640 1 --2- 172.21.15.102:0/3764824612 >> v2:172.21.15.102:3300/0 conn(0x7ffa300cf490 0x7ffa300cf920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:03.882 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.807+0000 7ffa38572640 1 -- 172.21.15.102:0/3764824612 --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffa300d1440 con 0x7ffa300d0c40 2023-11-13T11:29:03.883 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.811+0000 7f91c4832640 1 -- 172.21.15.102:0/2507950505 shutdown_connections 2023-11-13T11:29:03.883 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.811+0000 7f91c4832640 1 --2- 172.21.15.102:0/2507950505 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f91c006c7e0 0x7f91c006d890 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:03.883 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.811+0000 7f91c4832640 1 -- 172.21.15.102:0/2507950505 >> 172.21.15.102:0/2507950505 conn(0x7f91c00b0870 msgr2=0x7f91c00b0c80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-13T11:29:03.884 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.811+0000 7efd77365640 1 -- start start 2023-11-13T11:29:03.884 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.811+0000 7fa38dbf0640 1 --2- 172.21.15.102:0/3986701631 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7fa36c066470 0x7fa36c068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:03.884 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.811+0000 7ffa38572640 1 -- 172.21.15.102:0/3764824612 --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffa300cfe60 con 0x7ffa300cf490 2023-11-13T11:29:03.885 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.811+0000 7ff7baffd640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff7bc0ce0e0 0x7ff7bc1fa960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:36232/0 (socket says 172.21.15.102:36232) 2023-11-13T11:29:03.885 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.811+0000 7ff7baffd640 1 -- 172.21.15.102:0/1184576310 learned_addr learned my addr 172.21.15.102:0/1184576310 (peer_addr_for_me v2:172.21.15.102:0/0) 2023-11-13T11:29:03.885 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.811+0000 7ff7bbfff640 1 --2- 172.21.15.102:0/1184576310 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff7bc1591f0 0x7ff7bc14b700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:03.886 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.811+0000 7f91c4832640 1 -- 172.21.15.102:0/2507950505 shutdown_connections 2023-11-13T11:29:03.886 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.811+0000 7f27253a7640 1 Processor -- start 2023-11-13T11:29:03.887 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.811+0000 7ffa38572640 1 -- 172.21.15.102:0/3764824612 --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffa300cdb10 con 0x7ffa301606e0 2023-11-13T11:29:03.887 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.811+0000 7f27253a7640 1 -- start start 2023-11-13T11:29:03.887 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.811+0000 7f003c279640 1 -- 172.21.15.102:0/4098886927 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f003415e520 con 0x7f003414ad70 2023-11-13T11:29:03.888 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.811+0000 7f91c4832640 1 -- 172.21.15.102:0/2507950505 wait complete. 2023-11-13T11:29:03.888 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.811+0000 7ff7bb7fe640 1 -- 172.21.15.102:0/1184576310 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff7bc1591f0 msgr2=0x7ff7bc14b700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:03.888 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.811+0000 7ff7bb7fe640 1 --2- 172.21.15.102:0/1184576310 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff7bc1591f0 0x7ff7bc14b700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:03.889 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.811+0000 7ff7bb7fe640 1 -- 172.21.15.102:0/1184576310 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff7bc0ce0e0 msgr2=0x7ff7bc1fa960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:03.889 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.811+0000 7ff7bb7fe640 1 --2- 172.21.15.102:0/1184576310 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff7bc0ce0e0 0x7ff7bc1fa960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:03.889 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.811+0000 7ff7bb7fe640 1 -- 172.21.15.102:0/1184576310 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7b4008550 con 0x7ff7bc06fd10 2023-11-13T11:29:03.889 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.811+0000 7ff7bb7fe640 1 --2- 172.21.15.102:0/1184576310 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff7bc06fd10 0x7ff7bc147760 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7ff7b40af000 tx=0x7ff7b401d210 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-13T11:29:03.890 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.811+0000 7ffa3630e640 1 -- 172.21.15.102:0/3764824612 >> v2:172.21.15.102:3300/0 conn(0x7ffa300cf490 msgr2=0x7ffa300cf920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-13T11:29:03.890 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.811+0000 7ffa3530c640 1 -- 172.21.15.102:0/3764824612 <== mon.0 v1:172.21.15.102:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 23822691 0 0) 0x7ffa300d1440 con 0x7ffa300d0c40 2023-11-13T11:29:03.890 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.811+0000 7ffa3630e640 1 --2- 172.21.15.102:0/3764824612 >> v2:172.21.15.102:3300/0 conn(0x7ffa300cf490 0x7ffa300cf920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:03.891 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.811+0000 7f27253a7640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f27200d3730 0x7f27200b6f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:03.891 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.811+0000 7f27253a7640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f272015ff40 0x7f27200cc960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:03.891 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.811+0000 7f27253a7640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2720160d80 0x7f27200c8f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:03.892 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.811+0000 7f27253a7640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f272015d2a0 con 0x7f2720160d80 2023-11-13T11:29:03.892 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.811+0000 7f27253a7640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27200c6f20 con 0x7f272015ff40 2023-11-13T11:29:03.892 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.811+0000 7f27253a7640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f27200c7200 con 0x7f27200d3730 2023-11-13T11:29:03.892 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.811+0000 7f271ffff640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f27200d3730 0x7f27200b6f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:03.892 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.811+0000 7f2717fff640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f272015ff40 0x7f27200cc960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:03.893 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.811+0000 7f271ffff640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f27200d3730 0x7f27200b6f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.102:33770/0 (socket says 172.21.15.102:33770) 2023-11-13T11:29:03.893 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.811+0000 7f271ffff640 1 -- 172.21.15.102:0/149903117 learned_addr learned my addr 172.21.15.102:0/149903117 (peer_addr_for_me v2:172.21.15.102:0/0) 2023-11-13T11:29:03.893 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.811+0000 7f2724ba6640 1 --2- 172.21.15.102:0/149903117 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2720160d80 0x7f27200c8f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:03.893 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.811+0000 7f0f2cff9640 1 -- 172.21.15.102:0/2964620185 <== osd.0 v2:172.21.15.102:6800/53303834 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26745 (crc 0 0 0) 0x7f0f140711b0 con 0x7f0f1406e6e0 2023-11-13T11:29:03.894 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.811+0000 7f271ffff640 1 -- 172.21.15.102:0/149903117 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f272015ff40 msgr2=0x7f27200cc960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:03.894 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.811+0000 7f271ffff640 1 --2- 172.21.15.102:0/149903117 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f272015ff40 0x7f27200cc960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:03.894 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.811+0000 7f271ffff640 1 -- 172.21.15.102:0/149903117 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2720160d80 msgr2=0x7f27200c8f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:03.895 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.811+0000 7f271ffff640 1 --2- 172.21.15.102:0/149903117 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2720160d80 0x7f27200c8f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:03.895 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.811+0000 7f271ffff640 1 -- 172.21.15.102:0/149903117 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27080094d0 con 0x7f27200d3730 2023-11-13T11:29:03.895 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.811+0000 7ffa3630e640 1 -- 172.21.15.102:0/3764824612 >> v1:172.21.15.102:6789/0 conn(0x7ffa300d0c40 legacy=0x7ffa300b3e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:03.896 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.811+0000 7f271ffff640 1 --2- 172.21.15.102:0/149903117 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f27200d3730 0x7f27200b6f10 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f271000b3e0 tx=0x7f271000b8a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-13T11:29:03.896 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.815+0000 7f271d7fa640 1 -- 172.21.15.102:0/149903117 <== mon.2 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2710011830 con 0x7f27200d3730 2023-11-13T11:29:03.896 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.815+0000 7f271d7fa640 1 -- 172.21.15.102:0/149903117 <== mon.2 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f27100119b0 con 0x7f27200d3730 2023-11-13T11:29:03.896 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.815+0000 7f271d7fa640 1 -- 172.21.15.102:0/149903117 <== mon.2 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2710011d60 con 0x7f27200d3730 2023-11-13T11:29:03.897 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.815+0000 7f27253a7640 1 -- 172.21.15.102:0/149903117 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f27200c74e0 con 0x7f27200d3730 2023-11-13T11:29:03.897 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.815+0000 7efd77365640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efd5c0047d0 0x7efd701f1c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:03.897 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.815+0000 7efd77365640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7efd700ad5d0 0x7efd7015d960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:03.898 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.815+0000 7efd77365640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7efd70139b80 0x7efd7015a070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:03.898 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.815+0000 7efd77365640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd700ada50 con 0x7efd70139b80 2023-11-13T11:29:03.898 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.815+0000 7efd77365640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd7015e1d0 con 0x7efd5c0047d0 2023-11-13T11:29:03.898 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.815+0000 7efd77365640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efd7015e4b0 con 0x7efd700ad5d0 2023-11-13T11:29:03.899 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.815+0000 7fa38dbf0640 1 --2- 172.21.15.102:0/3986701631 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7fa36c066470 0x7fa36c068930 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fa384009870 tx=0x7fa3840a7000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-13T11:29:03.899 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.815+0000 7f003c279640 1 -- 172.21.15.102:0/4098886927 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f0034162600 con 0x7f003414ad70 2023-11-13T11:29:03.899 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.815+0000 7f002affd640 1 -- 172.21.15.102:0/4098886927 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f00240b33f0 con 0x7f003414ad70 2023-11-13T11:29:03.899 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.815+0000 7f002affd640 1 --2- 172.21.15.102:0/4098886927 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f0018066540 0x7f0018068a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:03.900 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.815+0000 7f002affd640 1 -- 172.21.15.102:0/4098886927 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f00240a7070 con 0x7f003414ad70 2023-11-13T11:29:03.900 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.815+0000 7f002affd640 1 --2- 172.21.15.102:0/4098886927 >> [v2:172.21.15.102:6808/1732708348,v1:172.21.15.102:6809/1732708348] conn(0x7f001806e6e0 0x7f0018070b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:03.900 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.815+0000 7f002affd640 1 -- 172.21.15.102:0/4098886927 --> [v2:172.21.15.102:6808/1732708348,v1:172.21.15.102:6809/1732708348] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f00180711b0 con 0x7f001806e6e0 2023-11-13T11:29:03.900 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.811+0000 7ff7b3fff640 1 -- 172.21.15.102:0/1184576310 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7b40a8b90 con 0x7ff7bc06fd10 2023-11-13T11:29:03.901 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.811+0000 7ff7b3fff640 1 -- 172.21.15.102:0/1184576310 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff7b40a8d10 con 0x7ff7bc06fd10 2023-11-13T11:29:03.901 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.811+0000 7ff7b3fff640 1 -- 172.21.15.102:0/1184576310 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7b400b390 con 0x7ff7bc06fd10 2023-11-13T11:29:03.901 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.811+0000 7ff7c1ebb640 1 -- 172.21.15.102:0/1184576310 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff7bc14b270 con 0x7ff7bc06fd10 2023-11-13T11:29:03.901 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.811+0000 7ff7c1ebb640 1 -- 172.21.15.102:0/1184576310 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff7bc14d1b0 con 0x7ff7bc06fd10 2023-11-13T11:29:03.902 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.815+0000 7ff7b1ffb640 1 -- 172.21.15.102:0/1184576310 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7ff7bc068520 con 0x7ff7bc06fd10 2023-11-13T11:29:03.902 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.815+0000 7efd75902640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7efd70139b80 0x7efd7015a070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:03.902 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.815+0000 7efd75902640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7efd70139b80 0x7efd7015a070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:36244/0 (socket says 172.21.15.102:36244) 2023-11-13T11:29:03.903 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.815+0000 7efd75902640 1 -- 172.21.15.102:0/3445022137 learned_addr learned my addr 172.21.15.102:0/3445022137 (peer_addr_for_me v2:172.21.15.102:0/0) 2023-11-13T11:29:03.903 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.815+0000 7efd75101640 1 --2- 172.21.15.102:0/3445022137 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efd5c0047d0 0x7efd701f1c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:03.903 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.815+0000 7efd74900640 1 --2- 172.21.15.102:0/3445022137 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7efd700ad5d0 0x7efd7015d960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:03.903 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.815+0000 7efd75902640 1 -- 172.21.15.102:0/3445022137 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7efd700ad5d0 msgr2=0x7efd7015d960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:03.903 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.815+0000 7efd75902640 1 --2- 172.21.15.102:0/3445022137 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7efd700ad5d0 0x7efd7015d960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:03.904 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.815+0000 7efd75902640 1 -- 172.21.15.102:0/3445022137 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efd5c0047d0 msgr2=0x7efd701f1c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:03.904 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.815+0000 7efd75902640 1 --2- 172.21.15.102:0/3445022137 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efd5c0047d0 0x7efd701f1c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:03.904 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.815+0000 7efd75902640 1 -- 172.21.15.102:0/3445022137 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd701f1490 con 0x7efd70139b80 2023-11-13T11:29:03.904 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.815+0000 7efd75902640 1 --2- 172.21.15.102:0/3445022137 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7efd70139b80 0x7efd7015a070 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7efd7004eda0 tx=0x7efd6800ed80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-13T11:29:03.904 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.815+0000 7efd65ffb640 1 -- 172.21.15.102:0/3445022137 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd68003b90 con 0x7efd70139b80 2023-11-13T11:29:03.904 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.815+0000 7efd65ffb640 1 -- 172.21.15.102:0/3445022137 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd68003cf0 con 0x7efd70139b80 2023-11-13T11:29:03.905 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.815+0000 7efd65ffb640 1 -- 172.21.15.102:0/3445022137 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd6800cb10 con 0x7efd70139b80 2023-11-13T11:29:03.905 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.815+0000 7efd77365640 1 -- 172.21.15.102:0/3445022137 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efd701f1770 con 0x7efd70139b80 2023-11-13T11:29:03.905 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.815+0000 7efd77365640 1 -- 172.21.15.102:0/3445022137 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efd7015dea0 con 0x7efd70139b80 2023-11-13T11:29:03.905 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.815+0000 7f91c4832640 1 Processor -- start 2023-11-13T11:29:03.906 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.815+0000 7f91c4832640 1 -- start start 2023-11-13T11:29:03.906 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.815+0000 7f91c4832640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f91c006c400 0x7f91c0157550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:03.906 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.815+0000 7f91c4832640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f91c006c7e0 0x7f91c00aaee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:03.906 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.815+0000 7f91c4832640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f91c006de00 0x7f91c00ab420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:03.907 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.815+0000 7f91c4832640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91c00ace40 con 0x7f91c006de00 2023-11-13T11:29:03.907 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.815+0000 7f91c4832640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91c00ad0e0 con 0x7f91c006c7e0 2023-11-13T11:29:03.907 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.815+0000 7f91c4832640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f91c00ad380 con 0x7f91c006c400 2023-11-13T11:29:03.907 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.815+0000 7f91bdd9b640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f91c006c7e0 0x7f91c00aaee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:03.907 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.815+0000 7f91bdd9b640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f91c006c7e0 0x7f91c00aaee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.102:56260/0 (socket says 172.21.15.102:56260) 2023-11-13T11:29:03.908 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.815+0000 7f91bdd9b640 1 -- 172.21.15.102:0/1720664367 learned_addr learned my addr 172.21.15.102:0/1720664367 (peer_addr_for_me v2:172.21.15.102:0/0) 2023-11-13T11:29:03.908 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.815+0000 7f91be59c640 1 --2- 172.21.15.102:0/1720664367 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f91c006c400 0x7f91c0157550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:03.908 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.815+0000 7f91bed9d640 1 --2- 172.21.15.102:0/1720664367 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f91c006de00 0x7f91c00ab420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:03.908 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.815+0000 7f27253a7640 1 -- 172.21.15.102:0/149903117 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f27200c6b60 con 0x7f27200d3730 2023-11-13T11:29:03.909 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.815+0000 7f271d7fa640 1 -- 172.21.15.102:0/149903117 <== mon.2 v2:172.21.15.154:3301/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f271001a400 con 0x7f27200d3730 2023-11-13T11:29:03.909 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.815+0000 7ffa3630e640 1 -- 172.21.15.102:0/3764824612 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa300d1690 con 0x7ffa301606e0 2023-11-13T11:29:03.909 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.819+0000 7f271d7fa640 1 --2- 172.21.15.102:0/149903117 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f2700066540 0x7f2700068a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:03.910 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.819+0000 7f271d7fa640 1 -- 172.21.15.102:0/149903117 <== mon.2 v2:172.21.15.154:3301/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f2710083ef0 con 0x7f27200d3730 2023-11-13T11:29:03.910 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.819+0000 7f91be59c640 1 -- 172.21.15.102:0/1720664367 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f91c006c7e0 msgr2=0x7f91c00aaee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:03.911 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.819+0000 7f91be59c640 1 --2- 172.21.15.102:0/1720664367 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f91c006c7e0 0x7f91c00aaee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:03.911 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.819+0000 7f91be59c640 1 -- 172.21.15.102:0/1720664367 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f91c006de00 msgr2=0x7f91c00ab420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:03.911 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.819+0000 7f91be59c640 1 --2- 172.21.15.102:0/1720664367 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f91c006de00 0x7f91c00ab420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:03.911 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.819+0000 7f91be59c640 1 -- 172.21.15.102:0/1720664367 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91b8009a70 con 0x7f91c006c400 2023-11-13T11:29:03.912 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.819+0000 7f91be59c640 1 --2- 172.21.15.102:0/1720664367 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f91c006c400 0x7f91c0157550 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f91a800c700 tx=0x7f91a800cbc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-13T11:29:03.912 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.819+0000 7f27253a7640 1 --2- 172.21.15.102:0/149903117 >> [v2:172.21.15.154:6816/2933728751,v1:172.21.15.154:6817/2933728751] conn(0x7f27200ccea0 0x7f27200b5ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:03.912 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.819+0000 7f27253a7640 1 -- 172.21.15.102:0/149903117 --> [v2:172.21.15.154:6816/2933728751,v1:172.21.15.154:6817/2933728751] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f2720068520 con 0x7f27200ccea0 2023-11-13T11:29:03.913 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.819+0000 7f0039814640 1 --2- 172.21.15.102:0/4098886927 >> [v2:172.21.15.102:6808/1732708348,v1:172.21.15.102:6809/1732708348] conn(0x7f001806e6e0 0x7f0018070b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:03.913 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.819+0000 7f2724ba6640 1 --2- 172.21.15.102:0/149903117 >> [v2:172.21.15.154:6816/2933728751,v1:172.21.15.154:6817/2933728751] conn(0x7f27200ccea0 0x7f27200b5ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:03.913 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.819+0000 7f91b6ffd640 1 -- 172.21.15.102:0/1720664367 <== mon.2 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91a80058c0 con 0x7f91c006c400 2023-11-13T11:29:03.914 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.819+0000 7ff7b3fff640 1 -- 172.21.15.102:0/1184576310 <== mon.1 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7ff7b400b4f0 con 0x7ff7bc06fd10 2023-11-13T11:29:03.914 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.819+0000 7f91b6ffd640 1 -- 172.21.15.102:0/1720664367 <== mon.2 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f91a8005a20 con 0x7f91c006c400 2023-11-13T11:29:03.915 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.819+0000 7f91b6ffd640 1 -- 172.21.15.102:0/1720664367 <== mon.2 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91a8005df0 con 0x7f91c006c400 2023-11-13T11:29:03.915 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.819+0000 7f91c4832640 1 -- 172.21.15.102:0/1720664367 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f91c00ad660 con 0x7f91c006c400 2023-11-13T11:29:03.915 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.819+0000 7f2717fff640 1 --2- 172.21.15.102:0/149903117 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f2700066540 0x7f2700068a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:03.916 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.819+0000 7f91c4832640 1 -- 172.21.15.102:0/1720664367 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f91c00adc20 con 0x7f91c006c400 2023-11-13T11:29:03.916 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.819+0000 7f2724ba6640 1 --2- 172.21.15.102:0/149903117 >> [v2:172.21.15.154:6816/2933728751,v1:172.21.15.154:6817/2933728751] conn(0x7f27200ccea0 0x7f27200b5ee0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-13T11:29:03.916 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.819+0000 7efd65ffb640 1 -- 172.21.15.102:0/3445022137 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7efd6800cc70 con 0x7efd70139b80 2023-11-13T11:29:03.917 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.819+0000 7f91c4832640 1 -- 172.21.15.102:0/1720664367 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f91a4000fd0 con 0x7f91c006c400 2023-11-13T11:29:03.917 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.819+0000 7f002affd640 1 -- 172.21.15.102:0/4098886927 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_get_version_reply(handle=1 version=22) v2 ==== 24+0+0 (secure 0 0 0) 0x7f00240ec420 con 0x7f003414ad70 2023-11-13T11:29:03.918 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.819+0000 7f003a015640 1 --2- 172.21.15.102:0/4098886927 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f0018066540 0x7f0018068a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:03.918 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.819+0000 7ffa3630e640 1 --2- 172.21.15.102:0/3764824612 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ffa301606e0 0x7ffa300c69b0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7ffa3008c0a0 tx=0x7ffa2c01c3a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5c7a40e54a8d984c server_cookie=0 in_seq=0 out_seq=0 2023-11-13T11:29:03.918 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.819+0000 7ffa3530c640 1 -- 172.21.15.102:0/3764824612 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa2c0ac620 con 0x7ffa301606e0 2023-11-13T11:29:03.919 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.823+0000 7f271d7fa640 1 -- 172.21.15.102:0/149903117 <== osd.6 v2:172.21.15.154:6816/2933728751 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26745 (crc 0 0 0) 0x7f2720068520 con 0x7f27200ccea0 2023-11-13T11:29:03.919 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.823+0000 7ffa3530c640 1 -- 172.21.15.102:0/3764824612 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa2c0ac780 con 0x7ffa301606e0 2023-11-13T11:29:03.920 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.819+0000 7efd65ffb640 1 --2- 172.21.15.102:0/3445022137 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7efd540664f0 0x7efd540689b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:03.920 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.819+0000 7efd65ffb640 1 -- 172.21.15.102:0/3445022137 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7efd68008070 con 0x7efd70139b80 2023-11-13T11:29:03.921 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.819+0000 7ff7b3fff640 1 --2- 172.21.15.102:0/1184576310 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7ff79c0664f0 0x7ff79c0689b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:03.921 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.819+0000 7ff7b3fff640 1 -- 172.21.15.102:0/1184576310 <== mon.1 v2:172.21.15.154:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff7b411d8d0 con 0x7ff7bc06fd10 2023-11-13T11:29:03.921 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.819+0000 7ff7b3fff640 1 --2- 172.21.15.102:0/1184576310 >> [v2:172.21.15.102:6824/4149355528,v1:172.21.15.102:6825/4149355528] conn(0x7ff79c06e710 0x7ff79c070b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:03.921 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.819+0000 7ff7b3fff640 1 -- 172.21.15.102:0/1184576310 --> [v2:172.21.15.102:6824/4149355528,v1:172.21.15.102:6825/4149355528] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7ff79c0711e0 con 0x7ff79c06e710 2023-11-13T11:29:03.922 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.819+0000 7ff7b3fff640 1 -- 172.21.15.102:0/1184576310 <== mon.1 v2:172.21.15.154:3300/0 6 ==== mon_get_version_reply(handle=1 version=22) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff7b41222c0 con 0x7ff7bc06fd10 2023-11-13T11:29:03.922 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.819+0000 7ff7baffd640 1 --2- 172.21.15.102:0/1184576310 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7ff79c0664f0 0x7ff79c0689b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:03.922 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.823+0000 7ff7bbfff640 1 --2- 172.21.15.102:0/1184576310 >> [v2:172.21.15.102:6824/4149355528,v1:172.21.15.102:6825/4149355528] conn(0x7ff79c06e710 0x7ff79c070b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:03.923 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.823+0000 7ffa38572640 1 -- 172.21.15.102:0/3764824612 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ffa301606e0 msgr2=0x7ffa300c69b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:03.923 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.823+0000 7f91b6ffd640 1 -- 172.21.15.102:0/1720664367 <== mon.2 v2:172.21.15.154:3301/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f91a8007070 con 0x7f91c006c400 2023-11-13T11:29:03.923 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.823+0000 7ffa3530c640 1 -- 172.21.15.102:0/3764824612 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa2c0ac620 con 0x7ffa301606e0 2023-11-13T11:29:03.924 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.823+0000 7ffa38572640 1 --2- 172.21.15.102:0/3764824612 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ffa301606e0 0x7ffa300c69b0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7ffa3008c0a0 tx=0x7ffa2c01c3a0 comp rx=0 tx=0).stop 2023-11-13T11:29:03.924 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.823+0000 7ff7bbfff640 1 --2- 172.21.15.102:0/1184576310 >> [v2:172.21.15.102:6824/4149355528,v1:172.21.15.102:6825/4149355528] conn(0x7ff79c06e710 0x7ff79c070b30 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-13T11:29:03.924 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.823+0000 7f2717fff640 1 --2- 172.21.15.102:0/149903117 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f2700066540 0x7f2700068a00 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f27080af000 tx=0x7f27080b6040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-13T11:29:03.925 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.823+0000 7ffa38572640 1 -- 172.21.15.102:0/3764824612 shutdown_connections 2023-11-13T11:29:03.925 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.823+0000 7ffa38572640 1 --2- 172.21.15.102:0/3764824612 >> v2:172.21.15.102:3300/0 conn(0x7ffa300cf490 0x7ffa300cf920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:03.926 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.823+0000 7ff7b3fff640 1 -- 172.21.15.102:0/1184576310 <== osd.3 v2:172.21.15.102:6824/4149355528 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26745 (crc 0 0 0) 0x7ff79c0711e0 con 0x7ff79c06e710 2023-11-13T11:29:03.926 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.823+0000 7ffa38572640 1 --2- 172.21.15.102:0/3764824612 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ffa301606e0 0x7ffa300c69b0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:03.926 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.823+0000 7ffa38572640 1 -- 172.21.15.102:0/3764824612 >> 172.21.15.102:0/3764824612 conn(0x7ffa3009c130 msgr2=0x7ffa300d2e60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-13T11:29:03.927 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.823+0000 7efd75101640 1 --2- 172.21.15.102:0/3445022137 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7efd540664f0 0x7efd540689b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:03.927 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.823+0000 7f91b6ffd640 1 --2- 172.21.15.102:0/1720664367 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f91a0066540 0x7f91a0068a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:03.928 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.823+0000 7ffa38572640 1 -- 172.21.15.102:0/3764824612 shutdown_connections 2023-11-13T11:29:03.928 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.823+0000 7ffa38572640 1 -- 172.21.15.102:0/3764824612 wait complete. 2023-11-13T11:29:03.928 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.823+0000 7f0039814640 1 --2- 172.21.15.102:0/4098886927 >> [v2:172.21.15.102:6808/1732708348,v1:172.21.15.102:6809/1732708348] conn(0x7f001806e6e0 0x7f0018070b00 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-13T11:29:03.929 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.823+0000 7f003a015640 1 --2- 172.21.15.102:0/4098886927 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f0018066540 0x7f0018068a00 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f002c007660 tx=0x7f002c00b040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-13T11:29:03.929 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.823+0000 7efd77365640 1 --2- 172.21.15.102:0/3445022137 >> [v2:172.21.15.154:6808/4028899241,v1:172.21.15.154:6809/4028899241] conn(0x7efd500015f0 0x7efd50003ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:03.929 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.823+0000 7efd77365640 1 -- 172.21.15.102:0/3445022137 --> [v2:172.21.15.154:6808/4028899241,v1:172.21.15.154:6809/4028899241] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7efd50006b50 con 0x7efd500015f0 2023-11-13T11:29:03.930 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.827+0000 7efd74900640 1 --2- 172.21.15.102:0/3445022137 >> [v2:172.21.15.154:6808/4028899241,v1:172.21.15.154:6809/4028899241] conn(0x7efd500015f0 0x7efd50003ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:03.930 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.823+0000 7f91b6ffd640 1 -- 172.21.15.102:0/1720664367 <== mon.2 v2:172.21.15.154:3301/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f91a80836c0 con 0x7f91c006c400 2023-11-13T11:29:03.930 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.823+0000 7f91b6ffd640 1 --2- 172.21.15.102:0/1720664367 >> [v2:172.21.15.154:6800/3562396827,v1:172.21.15.154:6801/3562396827] conn(0x7f91a006e760 0x7f91a0070b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:03.930 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.823+0000 7f91b6ffd640 1 -- 172.21.15.102:0/1720664367 --> [v2:172.21.15.154:6800/3562396827,v1:172.21.15.154:6801/3562396827] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f91a0071230 con 0x7f91a006e760 2023-11-13T11:29:03.931 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.823+0000 7f91b6ffd640 1 -- 172.21.15.102:0/1720664367 <== mon.2 v2:172.21.15.154:3301/0 6 ==== mon_get_version_reply(handle=1 version=22) v2 ==== 24+0+0 (secure 0 0 0) 0x7f91a8083a70 con 0x7f91c006c400 2023-11-13T11:29:03.931 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.827+0000 7f91bdd9b640 1 --2- 172.21.15.102:0/1720664367 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f91a0066540 0x7f91a0068a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:03.931 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.827+0000 7efd75101640 1 --2- 172.21.15.102:0/3445022137 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7efd540664f0 0x7efd540689b0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7efd6c000fe0 tx=0x7efd6c009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-13T11:29:03.932 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.827+0000 7ff7baffd640 1 --2- 172.21.15.102:0/1184576310 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7ff79c0664f0 0x7ff79c0689b0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7ff7bc06d8a0 tx=0x7ff7ac009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-13T11:29:03.932 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.827+0000 7f91bed9d640 1 --2- 172.21.15.102:0/1720664367 >> [v2:172.21.15.154:6800/3562396827,v1:172.21.15.154:6801/3562396827] conn(0x7f91a006e760 0x7f91a0070b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:03.932 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.827+0000 7efd74900640 1 --2- 172.21.15.102:0/3445022137 >> [v2:172.21.15.154:6808/4028899241,v1:172.21.15.154:6809/4028899241] conn(0x7efd500015f0 0x7efd50003ab0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-13T11:29:03.933 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.827+0000 7f002affd640 1 -- 172.21.15.102:0/4098886927 <== osd.1 v2:172.21.15.102:6808/1732708348 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26745 (crc 0 0 0) 0x7f00180711b0 con 0x7f001806e6e0 2023-11-13T11:29:03.933 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.827+0000 7efd65ffb640 1 -- 172.21.15.102:0/3445022137 <== osd.4 v2:172.21.15.154:6808/4028899241 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26745 (crc 0 0 0) 0x7efd50006b50 con 0x7efd500015f0 2023-11-13T11:29:03.934 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.827+0000 7f91bdd9b640 1 --2- 172.21.15.102:0/1720664367 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f91a0066540 0x7f91a0068a00 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f91b0007fd0 tx=0x7f91b0009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-13T11:29:03.935 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.827+0000 7ffa38572640 1 Processor -- start 2023-11-13T11:29:03.935 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.827+0000 7ffa38572640 1 -- start start 2023-11-13T11:29:03.935 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.831+0000 7ffa38572640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ffa300cf490 0x7ffa300ccd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:03.936 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.831+0000 7ffa38572640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ffa300d0c40 0x7ffa300b7910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:03.936 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.831+0000 7ffa38572640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ffa301606e0 0x7ffa300afa20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:03.936 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.831+0000 7ffa38572640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa300cad10 con 0x7ffa300d0c40 2023-11-13T11:29:03.936 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.831+0000 7ffa38572640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa300b8190 con 0x7ffa300cf490 2023-11-13T11:29:03.936 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.831+0000 7ffa38572640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa300b8470 con 0x7ffa301606e0 2023-11-13T11:29:03.937 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.831+0000 7ffa3630e640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ffa300cf490 0x7ffa300ccd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:03.937 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.831+0000 7ffa3630e640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ffa300cf490 0x7ffa300ccd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.102:56276/0 (socket says 172.21.15.102:56276) 2023-11-13T11:29:03.937 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.831+0000 7ffa3630e640 1 -- 172.21.15.102:0/959582275 learned_addr learned my addr 172.21.15.102:0/959582275 (peer_addr_for_me v2:172.21.15.102:0/0) 2023-11-13T11:29:03.937 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.831+0000 7ffa36b0f640 1 --2- 172.21.15.102:0/959582275 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ffa301606e0 0x7ffa300afa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:03.937 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.831+0000 7ffa3630e640 1 -- 172.21.15.102:0/959582275 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ffa301606e0 msgr2=0x7ffa300afa20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:03.938 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.831+0000 7ffa3630e640 1 --2- 172.21.15.102:0/959582275 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ffa301606e0 0x7ffa300afa20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:03.938 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.831+0000 7ffa3630e640 1 -- 172.21.15.102:0/959582275 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ffa300d0c40 msgr2=0x7ffa300b7910 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-11-13T11:29:03.938 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.831+0000 7ffa3630e640 1 --2- 172.21.15.102:0/959582275 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ffa300d0c40 0x7ffa300b7910 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:03.938 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.831+0000 7ffa3630e640 1 -- 172.21.15.102:0/959582275 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa2c009420 con 0x7ffa300cf490 2023-11-13T11:29:03.938 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.831+0000 7ffa36b0f640 1 --2- 172.21.15.102:0/959582275 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ffa301606e0 0x7ffa300afa20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-13T11:29:03.939 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.827+0000 7f91bed9d640 1 --2- 172.21.15.102:0/1720664367 >> [v2:172.21.15.154:6800/3562396827,v1:172.21.15.154:6801/3562396827] conn(0x7f91a006e760 0x7f91a0070b80 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-13T11:29:03.939 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.831+0000 7f91b6ffd640 1 -- 172.21.15.102:0/1720664367 <== osd.5 v2:172.21.15.154:6800/3562396827 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26745 (crc 0 0 0) 0x7f91a0071230 con 0x7f91a006e760 2023-11-13T11:29:03.940 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.831+0000 7ffa3630e640 1 --2- 172.21.15.102:0/959582275 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ffa300cf490 0x7ffa300ccd50 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7ffa2c0af040 tx=0x7ffa2c01abe0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-13T11:29:03.940 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.831+0000 7ffa26ffd640 1 -- 172.21.15.102:0/959582275 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa2c0acaf0 con 0x7ffa300cf490 2023-11-13T11:29:03.940 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.831+0000 7ffa26ffd640 1 -- 172.21.15.102:0/959582275 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa2c0acc50 con 0x7ffa300cf490 2023-11-13T11:29:03.940 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.831+0000 7ffa26ffd640 1 -- 172.21.15.102:0/959582275 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa2c003620 con 0x7ffa300cf490 2023-11-13T11:29:03.941 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.835+0000 7ffa38572640 1 -- 172.21.15.102:0/959582275 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffa300b8750 con 0x7ffa300cf490 2023-11-13T11:29:03.941 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.835+0000 7ffa38572640 1 -- 172.21.15.102:0/959582275 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffa300b3000 con 0x7ffa300cf490 2023-11-13T11:29:03.941 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.835+0000 7fa38ebf2640 1 -- 172.21.15.102:0/3986701631 --> [v2:172.21.15.102:6810/1825475150,v1:172.21.15.102:6812/1825475150] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fa388169ab0 con 0x7fa36c06e690 2023-11-13T11:29:03.942 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.839+0000 7fa37e7fc640 1 -- 172.21.15.102:0/3986701631 <== osd.2 v2:172.21.15.102:6810/1825475150 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fa388169ab0 con 0x7fa36c06e690 2023-11-13T11:29:03.942 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.839+0000 7fa38ebf2640 1 -- 172.21.15.102:0/3986701631 >> [v2:172.21.15.102:6810/1825475150,v1:172.21.15.102:6812/1825475150] conn(0x7fa36c06e690 msgr2=0x7fa36c070ab0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:03.942 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.839+0000 7fa38ebf2640 1 --2- 172.21.15.102:0/3986701631 >> [v2:172.21.15.102:6810/1825475150,v1:172.21.15.102:6812/1825475150] conn(0x7fa36c06e690 0x7fa36c070ab0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:03.942 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.839+0000 7fa38ebf2640 1 -- 172.21.15.102:0/3986701631 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7fa36c066470 msgr2=0x7fa36c068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:03.943 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.839+0000 7fa38ebf2640 1 --2- 172.21.15.102:0/3986701631 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7fa36c066470 0x7fa36c068930 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fa384009870 tx=0x7fa3840a7000 comp rx=0 tx=0).stop 2023-11-13T11:29:03.943 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.839+0000 7fa38ebf2640 1 -- 172.21.15.102:0/3986701631 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa38815d060 msgr2=0x7fa3880c69b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:03.943 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.839+0000 7fa38ebf2640 1 --2- 172.21.15.102:0/3986701631 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa38815d060 0x7fa3880c69b0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fa38000c730 tx=0x7fa38000cbf0 comp rx=0 tx=0).stop 2023-11-13T11:29:03.943 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.839+0000 7fa38e3f1640 1 -- 172.21.15.102:0/3986701631 reap_dead start 2023-11-13T11:29:03.944 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.835+0000 7ffa38572640 1 -- 172.21.15.102:0/959582275 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7ffa30160cd0 con 0x7ffa300cf490 2023-11-13T11:29:03.944 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.835+0000 7ffa26ffd640 1 -- 172.21.15.102:0/959582275 <== mon.1 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7ffa2c0aa070 con 0x7ffa300cf490 2023-11-13T11:29:03.944 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.839+0000 7ffa26ffd640 1 --2- 172.21.15.102:0/959582275 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7ffa14066540 0x7ffa14068a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:03.945 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.839+0000 7ffa26ffd640 1 -- 172.21.15.102:0/959582275 <== mon.1 v2:172.21.15.154:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ffa2c11e250 con 0x7ffa300cf490 2023-11-13T11:29:03.945 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.839+0000 7ffa26ffd640 1 --2- 172.21.15.102:0/959582275 >> [v2:172.21.15.154:6824/1753500785,v1:172.21.15.154:6825/1753500785] conn(0x7ffa1406e6e0 0x7ffa14070b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:03.945 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.839+0000 7ffa26ffd640 1 -- 172.21.15.102:0/959582275 --> [v2:172.21.15.154:6824/1753500785,v1:172.21.15.154:6825/1753500785] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7ffa140711b0 con 0x7ffa1406e6e0 2023-11-13T11:29:03.945 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.839+0000 7ffa35b0d640 1 --2- 172.21.15.102:0/959582275 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7ffa14066540 0x7ffa14068a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:03.945 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.839+0000 7ffa26ffd640 1 -- 172.21.15.102:0/959582275 <== mon.1 v2:172.21.15.154:3300/0 6 ==== mon_get_version_reply(handle=1 version=22) v2 ==== 24+0+0 (secure 0 0 0) 0x7ffa2c0eb6b0 con 0x7ffa300cf490 2023-11-13T11:29:03.946 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.839+0000 7ffa36b0f640 1 --2- 172.21.15.102:0/959582275 >> [v2:172.21.15.154:6824/1753500785,v1:172.21.15.154:6825/1753500785] conn(0x7ffa1406e6e0 0x7ffa14070b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:03.946 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.839+0000 7ffa36b0f640 1 --2- 172.21.15.102:0/959582275 >> [v2:172.21.15.154:6824/1753500785,v1:172.21.15.154:6825/1753500785] conn(0x7ffa1406e6e0 0x7ffa14070b00 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-13T11:29:03.946 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.843+0000 7fa38ebf2640 1 -- 172.21.15.102:0/3986701631 shutdown_connections 2023-11-13T11:29:03.946 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.843+0000 7fa38ebf2640 1 -- 172.21.15.102:0/3986701631 >> 172.21.15.102:0/3986701631 conn(0x7fa3880d2cf0 msgr2=0x7fa3880afc80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-13T11:29:03.947 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.843+0000 7ffa26ffd640 1 -- 172.21.15.102:0/959582275 <== osd.7 v2:172.21.15.154:6824/1753500785 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26745 (crc 0 0 0) 0x7ffa140711b0 con 0x7ffa1406e6e0 2023-11-13T11:29:03.947 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.843+0000 7fa38ebf2640 1 -- 172.21.15.102:0/3986701631 shutdown_connections 2023-11-13T11:29:03.948 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.843+0000 7fa38ebf2640 1 -- 172.21.15.102:0/3986701631 wait complete. 2023-11-13T11:29:03.948 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.843+0000 7f27253a7640 1 -- 172.21.15.102:0/149903117 --> [v2:172.21.15.154:6816/2933728751,v1:172.21.15.154:6817/2933728751] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f272008c730 con 0x7f27200ccea0 2023-11-13T11:29:03.948 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.843+0000 7ffa35b0d640 1 --2- 172.21.15.102:0/959582275 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7ffa14066540 0x7ffa14068a00 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7ffa20007fd0 tx=0x7ffa200078c0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-13T11:29:03.949 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.843+0000 7f271d7fa640 1 -- 172.21.15.102:0/149903117 <== osd.6 v2:172.21.15.154:6816/2933728751 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f272008c730 con 0x7f27200ccea0 2023-11-13T11:29:03.950 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.843+0000 7f27253a7640 1 -- 172.21.15.102:0/149903117 >> [v2:172.21.15.154:6816/2933728751,v1:172.21.15.154:6817/2933728751] conn(0x7f27200ccea0 msgr2=0x7f27200b5ee0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:03.950 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.843+0000 7f27253a7640 1 --2- 172.21.15.102:0/149903117 >> [v2:172.21.15.154:6816/2933728751,v1:172.21.15.154:6817/2933728751] conn(0x7f27200ccea0 0x7f27200b5ee0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:03.950 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.843+0000 7f27253a7640 1 -- 172.21.15.102:0/149903117 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f2700066540 msgr2=0x7f2700068a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:03.950 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.843+0000 7f27253a7640 1 --2- 172.21.15.102:0/149903117 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f2700066540 0x7f2700068a00 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f27080af000 tx=0x7f27080b6040 comp rx=0 tx=0).stop 2023-11-13T11:29:03.951 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.843+0000 7f27253a7640 1 -- 172.21.15.102:0/149903117 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f27200d3730 msgr2=0x7f27200b6f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:03.951 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.843+0000 7f27253a7640 1 --2- 172.21.15.102:0/149903117 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f27200d3730 0x7f27200b6f10 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f271000b3e0 tx=0x7f271000b8a0 comp rx=0 tx=0).stop 2023-11-13T11:29:03.951 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.843+0000 7f2724ba6640 1 -- 172.21.15.102:0/149903117 reap_dead start 2023-11-13T11:29:03.951 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.843+0000 7f27253a7640 1 -- 172.21.15.102:0/149903117 shutdown_connections 2023-11-13T11:29:03.951 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.843+0000 7f27253a7640 1 -- 172.21.15.102:0/149903117 >> 172.21.15.102:0/149903117 conn(0x7f27200d2c10 msgr2=0x7f27200b4b10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-13T11:29:03.952 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.843+0000 7f27253a7640 1 -- 172.21.15.102:0/149903117 shutdown_connections 2023-11-13T11:29:03.952 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.843+0000 7f27253a7640 1 -- 172.21.15.102:0/149903117 wait complete. 2023-11-13T11:29:03.952 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.851+0000 7f0f367a1640 1 -- 172.21.15.102:0/2964620185 --> [v2:172.21.15.102:6800/53303834,v1:172.21.15.102:6801/53303834] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f0f280057c0 con 0x7f0f1406e6e0 2023-11-13T11:29:03.953 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.855+0000 7f0f2cff9640 1 -- 172.21.15.102:0/2964620185 <== osd.0 v2:172.21.15.102:6800/53303834 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f0f280057c0 con 0x7f0f1406e6e0 2023-11-13T11:29:03.953 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.855+0000 7f003c279640 1 -- 172.21.15.102:0/4098886927 --> [v2:172.21.15.102:6808/1732708348,v1:172.21.15.102:6809/1732708348] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f0034071c20 con 0x7f001806e6e0 2023-11-13T11:29:03.953 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.855+0000 7ff7b1ffb640 1 -- 172.21.15.102:0/1184576310 --> [v2:172.21.15.102:6824/4149355528,v1:172.21.15.102:6825/4149355528] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7ff7bc0ce590 con 0x7ff79c06e710 2023-11-13T11:29:03.954 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.859+0000 7ff7b3fff640 1 -- 172.21.15.102:0/1184576310 <== osd.3 v2:172.21.15.102:6824/4149355528 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7ff7bc0ce590 con 0x7ff79c06e710 2023-11-13T11:29:03.954 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.859+0000 7f002affd640 1 -- 172.21.15.102:0/4098886927 <== osd.1 v2:172.21.15.102:6808/1732708348 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f0034071c20 con 0x7f001806e6e0 2023-11-13T11:29:03.955 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.859+0000 7f0f367a1640 1 -- 172.21.15.102:0/2964620185 >> [v2:172.21.15.102:6800/53303834,v1:172.21.15.102:6801/53303834] conn(0x7f0f1406e6e0 msgr2=0x7f0f14070b00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:03.955 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.859+0000 7f0f367a1640 1 --2- 172.21.15.102:0/2964620185 >> [v2:172.21.15.102:6800/53303834,v1:172.21.15.102:6801/53303834] conn(0x7f0f1406e6e0 0x7f0f14070b00 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:03.956 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.859+0000 7f91c4832640 1 -- 172.21.15.102:0/1720664367 --> [v2:172.21.15.154:6800/3562396827,v1:172.21.15.154:6801/3562396827] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f91a4002cc0 con 0x7f91a006e760 2023-11-13T11:29:03.956 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.859+0000 7f0f367a1640 1 -- 172.21.15.102:0/2964620185 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f0f140664c0 msgr2=0x7f0f14068980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:03.956 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.859+0000 7f0f367a1640 1 --2- 172.21.15.102:0/2964620185 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f0f140664c0 0x7f0f14068980 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f0f3002cd30 tx=0x7f0f3008d040 comp rx=0 tx=0).stop 2023-11-13T11:29:03.957 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.859+0000 7f0f367a1640 1 -- 172.21.15.102:0/2964620185 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0f280067d0 msgr2=0x7f0f28052700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:03.957 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.859+0000 7f0f367a1640 1 --2- 172.21.15.102:0/2964620185 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0f280067d0 0x7f0f28052700 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f0f1c00c3d0 tx=0x7f0f1c00c890 comp rx=0 tx=0).stop 2023-11-13T11:29:03.957 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.859+0000 7f0f34d3e640 1 -- 172.21.15.102:0/2964620185 reap_dead start 2023-11-13T11:29:03.957 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.859+0000 7f0f367a1640 1 -- 172.21.15.102:0/2964620185 shutdown_connections 2023-11-13T11:29:03.957 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.859+0000 7f0f367a1640 1 -- 172.21.15.102:0/2964620185 >> 172.21.15.102:0/2964620185 conn(0x7f0f280559c0 msgr2=0x7f0f28055da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-13T11:29:03.958 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.859+0000 7f003c279640 1 -- 172.21.15.102:0/4098886927 >> [v2:172.21.15.102:6808/1732708348,v1:172.21.15.102:6809/1732708348] conn(0x7f001806e6e0 msgr2=0x7f0018070b00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:03.958 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.859+0000 7f003c279640 1 --2- 172.21.15.102:0/4098886927 >> [v2:172.21.15.102:6808/1732708348,v1:172.21.15.102:6809/1732708348] conn(0x7f001806e6e0 0x7f0018070b00 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:03.959 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.859+0000 7ff7b1ffb640 1 -- 172.21.15.102:0/1184576310 >> [v2:172.21.15.102:6824/4149355528,v1:172.21.15.102:6825/4149355528] conn(0x7ff79c06e710 msgr2=0x7ff79c070b30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:03.959 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.859+0000 7ff7b1ffb640 1 --2- 172.21.15.102:0/1184576310 >> [v2:172.21.15.102:6824/4149355528,v1:172.21.15.102:6825/4149355528] conn(0x7ff79c06e710 0x7ff79c070b30 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:03.959 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.859+0000 7f0f367a1640 1 -- 172.21.15.102:0/2964620185 shutdown_connections 2023-11-13T11:29:03.959 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.859+0000 7f0f367a1640 1 -- 172.21.15.102:0/2964620185 wait complete. 2023-11-13T11:29:03.960 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.859+0000 7f003c279640 1 -- 172.21.15.102:0/4098886927 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f0018066540 msgr2=0x7f0018068a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:03.960 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.859+0000 7f003c279640 1 --2- 172.21.15.102:0/4098886927 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f0018066540 0x7f0018068a00 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f002c007660 tx=0x7f002c00b040 comp rx=0 tx=0).stop 2023-11-13T11:29:03.960 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.859+0000 7f003c279640 1 -- 172.21.15.102:0/4098886927 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f003414ad70 msgr2=0x7f003415ed20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:03.960 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.859+0000 7f003c279640 1 --2- 172.21.15.102:0/4098886927 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f003414ad70 0x7f003415ed20 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f00240ab000 tx=0x7f002401ad10 comp rx=0 tx=0).stop 2023-11-13T11:29:03.961 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.859+0000 7ff7b1ffb640 1 -- 172.21.15.102:0/1184576310 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7ff79c0664f0 msgr2=0x7ff79c0689b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:03.961 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.859+0000 7ff7b1ffb640 1 --2- 172.21.15.102:0/1184576310 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7ff79c0664f0 0x7ff79c0689b0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7ff7bc06d8a0 tx=0x7ff7ac009040 comp rx=0 tx=0).stop 2023-11-13T11:29:03.961 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.859+0000 7ff7b1ffb640 1 -- 172.21.15.102:0/1184576310 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff7bc06fd10 msgr2=0x7ff7bc147760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:03.961 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.859+0000 7ff7b1ffb640 1 --2- 172.21.15.102:0/1184576310 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff7bc06fd10 0x7ff7bc147760 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7ff7b40af000 tx=0x7ff7b401d210 comp rx=0 tx=0).stop 2023-11-13T11:29:03.962 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.859+0000 7ff7bbfff640 1 -- 172.21.15.102:0/1184576310 reap_dead start 2023-11-13T11:29:03.962 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.859+0000 7ff7b1ffb640 1 -- 172.21.15.102:0/1184576310 shutdown_connections 2023-11-13T11:29:03.962 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.859+0000 7ff7b1ffb640 1 -- 172.21.15.102:0/1184576310 >> 172.21.15.102:0/1184576310 conn(0x7ff7bc0cb5c0 msgr2=0x7ff7bc0af240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-13T11:29:03.962 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.859+0000 7f91b6ffd640 1 -- 172.21.15.102:0/1720664367 <== osd.5 v2:172.21.15.154:6800/3562396827 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f91a4002cc0 con 0x7f91a006e760 2023-11-13T11:29:03.963 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.859+0000 7f003a816640 1 -- 172.21.15.102:0/4098886927 reap_dead start 2023-11-13T11:29:03.963 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.859+0000 7f003c279640 1 -- 172.21.15.102:0/4098886927 shutdown_connections 2023-11-13T11:29:03.963 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.859+0000 7f003c279640 1 -- 172.21.15.102:0/4098886927 >> 172.21.15.102:0/4098886927 conn(0x7f00340cb5c0 msgr2=0x7f0034164130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-13T11:29:03.964 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.859+0000 7ff7b1ffb640 1 -- 172.21.15.102:0/1184576310 shutdown_connections 2023-11-13T11:29:03.964 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.859+0000 7ff7b1ffb640 1 -- 172.21.15.102:0/1184576310 wait complete. 2023-11-13T11:29:03.965 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.859+0000 7f91c4832640 1 -- 172.21.15.102:0/1720664367 >> [v2:172.21.15.154:6800/3562396827,v1:172.21.15.154:6801/3562396827] conn(0x7f91a006e760 msgr2=0x7f91a0070b80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:03.965 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.859+0000 7f91c4832640 1 --2- 172.21.15.102:0/1720664367 >> [v2:172.21.15.154:6800/3562396827,v1:172.21.15.154:6801/3562396827] conn(0x7f91a006e760 0x7f91a0070b80 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:03.965 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.859+0000 7f003c279640 1 -- 172.21.15.102:0/4098886927 shutdown_connections 2023-11-13T11:29:03.966 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.859+0000 7f003c279640 1 -- 172.21.15.102:0/4098886927 wait complete. 2023-11-13T11:29:03.966 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.859+0000 7f91c4832640 1 -- 172.21.15.102:0/1720664367 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f91a0066540 msgr2=0x7f91a0068a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:03.967 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.859+0000 7f91c4832640 1 --2- 172.21.15.102:0/1720664367 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f91a0066540 0x7f91a0068a00 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f91b0007fd0 tx=0x7f91b0009040 comp rx=0 tx=0).stop 2023-11-13T11:29:03.967 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.859+0000 7f91c4832640 1 -- 172.21.15.102:0/1720664367 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f91c006c400 msgr2=0x7f91c0157550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:03.967 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.859+0000 7f91c4832640 1 --2- 172.21.15.102:0/1720664367 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f91c006c400 0x7f91c0157550 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f91a800c700 tx=0x7f91a800cbc0 comp rx=0 tx=0).stop 2023-11-13T11:29:03.967 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.859+0000 7f91bed9d640 1 -- 172.21.15.102:0/1720664367 reap_dead start 2023-11-13T11:29:03.967 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.859+0000 7f91c4832640 1 -- 172.21.15.102:0/1720664367 shutdown_connections 2023-11-13T11:29:03.968 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.859+0000 7f91c4832640 1 -- 172.21.15.102:0/1720664367 >> 172.21.15.102:0/1720664367 conn(0x7f91c00b0870 msgr2=0x7f91c01593e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-13T11:29:03.968 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.863+0000 7f91c4832640 1 -- 172.21.15.102:0/1720664367 shutdown_connections 2023-11-13T11:29:03.968 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.863+0000 7f91c4832640 1 -- 172.21.15.102:0/1720664367 wait complete. 2023-11-13T11:29:03.968 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.863+0000 7efd77365640 1 -- 172.21.15.102:0/3445022137 --> [v2:172.21.15.154:6808/4028899241,v1:172.21.15.154:6809/4028899241] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7efd50005bd0 con 0x7efd500015f0 2023-11-13T11:29:03.969 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.871+0000 7efd65ffb640 1 -- 172.21.15.102:0/3445022137 <== osd.4 v2:172.21.15.154:6808/4028899241 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7efd50005bd0 con 0x7efd500015f0 2023-11-13T11:29:03.969 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.871+0000 7ffa38572640 1 -- 172.21.15.102:0/959582275 --> [v2:172.21.15.154:6824/1753500785,v1:172.21.15.154:6825/1753500785] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7ffa300cd2c0 con 0x7ffa1406e6e0 2023-11-13T11:29:03.970 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.871+0000 7ffa26ffd640 1 -- 172.21.15.102:0/959582275 <== osd.7 v2:172.21.15.154:6824/1753500785 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7ffa28007450 con 0x7ffa1406e6e0 2023-11-13T11:29:03.970 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.875+0000 7ffa38572640 1 -- 172.21.15.102:0/959582275 >> [v2:172.21.15.154:6824/1753500785,v1:172.21.15.154:6825/1753500785] conn(0x7ffa1406e6e0 msgr2=0x7ffa14070b00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:03.970 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.875+0000 7ffa38572640 1 --2- 172.21.15.102:0/959582275 >> [v2:172.21.15.154:6824/1753500785,v1:172.21.15.154:6825/1753500785] conn(0x7ffa1406e6e0 0x7ffa14070b00 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:03.971 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.875+0000 7efd77365640 1 -- 172.21.15.102:0/3445022137 >> [v2:172.21.15.154:6808/4028899241,v1:172.21.15.154:6809/4028899241] conn(0x7efd500015f0 msgr2=0x7efd50003ab0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:03.971 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.875+0000 7ffa38572640 1 -- 172.21.15.102:0/959582275 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7ffa14066540 msgr2=0x7ffa14068a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:03.971 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.875+0000 7ffa38572640 1 --2- 172.21.15.102:0/959582275 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7ffa14066540 0x7ffa14068a00 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7ffa20007fd0 tx=0x7ffa200078c0 comp rx=0 tx=0).stop 2023-11-13T11:29:03.971 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.875+0000 7ffa38572640 1 -- 172.21.15.102:0/959582275 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ffa300cf490 msgr2=0x7ffa300ccd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:03.972 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.875+0000 7ffa38572640 1 --2- 172.21.15.102:0/959582275 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ffa300cf490 0x7ffa300ccd50 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7ffa2c0af040 tx=0x7ffa2c01abe0 comp rx=0 tx=0).stop 2023-11-13T11:29:03.972 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.875+0000 7efd77365640 1 --2- 172.21.15.102:0/3445022137 >> [v2:172.21.15.154:6808/4028899241,v1:172.21.15.154:6809/4028899241] conn(0x7efd500015f0 0x7efd50003ab0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:03.973 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.875+0000 7ffa36b0f640 1 -- 172.21.15.102:0/959582275 reap_dead start 2023-11-13T11:29:03.973 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.875+0000 7ffa38572640 1 -- 172.21.15.102:0/959582275 shutdown_connections 2023-11-13T11:29:03.973 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.875+0000 7ffa38572640 1 -- 172.21.15.102:0/959582275 >> 172.21.15.102:0/959582275 conn(0x7ffa3009c130 msgr2=0x7ffa300d1fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-13T11:29:03.974 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.875+0000 7efd77365640 1 -- 172.21.15.102:0/3445022137 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7efd540664f0 msgr2=0x7efd540689b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:03.974 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.875+0000 7efd77365640 1 --2- 172.21.15.102:0/3445022137 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7efd540664f0 0x7efd540689b0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7efd6c000fe0 tx=0x7efd6c009040 comp rx=0 tx=0).stop 2023-11-13T11:29:03.974 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.875+0000 7efd77365640 1 -- 172.21.15.102:0/3445022137 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7efd70139b80 msgr2=0x7efd7015a070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:03.975 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.875+0000 7efd77365640 1 --2- 172.21.15.102:0/3445022137 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7efd70139b80 0x7efd7015a070 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7efd7004eda0 tx=0x7efd6800ed80 comp rx=0 tx=0).stop 2023-11-13T11:29:03.975 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.875+0000 7ffa38572640 1 -- 172.21.15.102:0/959582275 shutdown_connections 2023-11-13T11:29:03.975 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.875+0000 7ffa38572640 1 -- 172.21.15.102:0/959582275 wait complete. 2023-11-13T11:29:03.976 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.875+0000 7efd75902640 1 -- 172.21.15.102:0/3445022137 reap_dead start 2023-11-13T11:29:03.976 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.875+0000 7efd77365640 1 -- 172.21.15.102:0/3445022137 shutdown_connections 2023-11-13T11:29:03.976 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.875+0000 7efd77365640 1 -- 172.21.15.102:0/3445022137 >> 172.21.15.102:0/3445022137 conn(0x7efd700b0870 msgr2=0x7efd7013e430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-13T11:29:03.977 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.875+0000 7efd77365640 1 -- 172.21.15.102:0/3445022137 shutdown_connections 2023-11-13T11:29:03.977 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:03.875+0000 7efd77365640 1 -- 172.21.15.102:0/3445022137 wait complete. 2023-11-13T11:29:03.978 INFO:teuthology.orchestra.run.smithi102.stdout:64424509446 2023-11-13T11:29:03.978 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-11-13T11:29:03.979 INFO:teuthology.orchestra.run.smithi102.stdout:64424509446 2023-11-13T11:29:03.980 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2023-11-13T11:29:03.980 INFO:teuthology.orchestra.run.smithi102.stdout:64424509447 2023-11-13T11:29:03.981 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-11-13T11:29:03.982 INFO:teuthology.orchestra.run.smithi102.stdout:64424509446 2023-11-13T11:29:03.982 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-11-13T11:29:03.983 INFO:teuthology.orchestra.run.smithi102.stdout:64424509447 2023-11-13T11:29:03.984 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-11-13T11:29:03.984 INFO:teuthology.orchestra.run.smithi102.stdout:64424509446 2023-11-13T11:29:03.985 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2023-11-13T11:29:03.986 INFO:teuthology.orchestra.run.smithi102.stdout:60129542150 2023-11-13T11:29:03.986 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2023-11-13T11:29:03.987 INFO:teuthology.orchestra.run.smithi102.stdout:64424509445 2023-11-13T11:29:03.988 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2023-11-13T11:29:04.261 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:04.255+0000 7f716ef10640 1 Processor -- start 2023-11-13T11:29:04.262 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:04.255+0000 7f716ef10640 1 -- start start 2023-11-13T11:29:04.263 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:04.259+0000 7f716ef10640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f716000aab0 0x7f71600df280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:04.263 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:04.259+0000 7f716ef10640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7160007520 0x7f71600e33f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:04.263 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:04.259+0000 7f716ef10640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f71600540f0 con 0x7f7160033cd0 2023-11-13T11:29:04.263 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:04.259+0000 7f716ef10640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7160038060 con 0x7f716000aab0 2023-11-13T11:29:04.263 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:04.259+0000 7f716ef10640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71600543d0 con 0x7f7160007520 2023-11-13T11:29:04.264 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:04.259+0000 7f716d70d640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f7160033cd0 0x7f71600e2ce0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.102:52424/0 (socket says 172.21.15.102:52424) 2023-11-13T11:29:04.264 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:04.259+0000 7f716d70d640 1 -- 172.21.15.102:0/712272486 learned_addr learned my addr 172.21.15.102:0/712272486 (peer_addr_for_me v1:172.21.15.102:0/0) 2023-11-13T11:29:04.265 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:04.259+0000 7f716cf0c640 1 -- 172.21.15.102:0/712272486 <== mon.1 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 43275851 0 0) 0x7f71600540f0 con 0x7f7160033cd0 2023-11-13T11:29:04.266 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:04.259+0000 7f716cf0c640 1 -- 172.21.15.102:0/712272486 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7154003530 con 0x7f7160033cd0 2023-11-13T11:29:04.266 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:04.263+0000 7f716df0e640 1 --2- 172.21.15.102:0/712272486 >> v2:172.21.15.154:3300/0 conn(0x7f716000aab0 0x7f71600df280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:04.267 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:04.263+0000 7f716e70f640 1 --2- 172.21.15.102:0/712272486 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7160007520 0x7f71600e33f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:04.267 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:04.263+0000 7f716e70f640 1 -- 172.21.15.102:0/712272486 >> v2:172.21.15.154:3300/0 conn(0x7f716000aab0 msgr2=0x7f71600df280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-13T11:29:04.267 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:04.263+0000 7f716e70f640 1 --2- 172.21.15.102:0/712272486 >> v2:172.21.15.154:3300/0 conn(0x7f716000aab0 0x7f71600df280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:04.268 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:04.263+0000 7f716e70f640 1 -- 172.21.15.102:0/712272486 >> v1:172.21.15.154:6789/0 conn(0x7f7160033cd0 legacy=0x7f71600e2ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:04.268 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:04.263+0000 7f716e70f640 1 -- 172.21.15.102:0/712272486 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71600546b0 con 0x7f7160007520 2023-11-13T11:29:04.269 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:04.263+0000 7fae622c8640 1 Processor -- start 2023-11-13T11:29:04.271 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:04.263+0000 7fae622c8640 1 -- start start 2023-11-13T11:29:04.271 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:04.267+0000 7f923da94640 1 Processor -- start 2023-11-13T11:29:04.271 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:04.267+0000 7fae622c8640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fae5c1647c0 0x7fae5c06cbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:04.272 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:04.267+0000 7fae622c8640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7fae5c071990 0x7fae5c06d130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:04.272 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:04.267+0000 7fae622c8640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fae5c070b00 con 0x7fae5c070590 2023-11-13T11:29:04.272 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:04.267+0000 7fae622c8640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fae5c1658b0 con 0x7fae5c071990 2023-11-13T11:29:04.273 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:04.267+0000 7fae622c8640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fae5c165d40 con 0x7fae5c1647c0 2023-11-13T11:29:04.273 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:04.267+0000 7f923da94640 1 -- start start 2023-11-13T11:29:04.273 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:04.267+0000 7f716e70f640 1 --2- 172.21.15.102:0/712272486 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7160007520 0x7f71600e33f0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f7168068260 tx=0x7f71680969f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b820e51b8ec21682 server_cookie=0 in_seq=0 out_seq=0 2023-11-13T11:29:04.274 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:04.267+0000 7fae612c6640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fae5c1647c0 0x7fae5c06cbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:04.274 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:04.267+0000 7fae60ac5640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7fae5c070590 0x7fae5c0b2450 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.102:52436/0 (socket says 172.21.15.102:52436) 2023-11-13T11:29:04.274 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:04.267+0000 7fae60ac5640 1 -- 172.21.15.102:0/3349175872 learned_addr learned my addr 172.21.15.102:0/3349175872 (peer_addr_for_me v1:172.21.15.102:0/0) 2023-11-13T11:29:04.276 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:04.267+0000 7f716cf0c640 1 -- 172.21.15.102:0/712272486 <== mon.2 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f716811f870 con 0x7f7160007520 2023-11-13T11:29:04.276 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:04.267+0000 7f716cf0c640 1 -- 172.21.15.102:0/712272486 <== mon.2 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f716811fa50 con 0x7f7160007520 2023-11-13T11:29:04.276 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:04.267+0000 7f716cf0c640 1 -- 172.21.15.102:0/712272486 <== mon.2 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f716811fe80 con 0x7f7160007520 2023-11-13T11:29:04.276 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:04.267+0000 7f716ef10640 1 -- 172.21.15.102:0/712272486 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7160007520 msgr2=0x7f71600e33f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:04.277 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:04.267+0000 7f716ef10640 1 --2- 172.21.15.102:0/712272486 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7160007520 0x7f71600e33f0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f7168068260 tx=0x7f71680969f0 comp rx=0 tx=0).stop 2023-11-13T11:29:04.277 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:04.267+0000 7fae61ac7640 1 --2- 172.21.15.102:0/3349175872 >> v2:172.21.15.102:3300/0 conn(0x7fae5c071990 0x7fae5c06d130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:04.278 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:04.267+0000 7f923da94640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f92380b2380 0x7f92380cd3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:04.278 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:04.267+0000 7f923da94640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f92380cddb0 con 0x7f92380cd910 2023-11-13T11:29:04.278 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:04.267+0000 7f923da94640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f92380ce090 con 0x7f92380b3770 2023-11-13T11:29:04.278 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:04.267+0000 7f923da94640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f92380ce370 con 0x7f92380b2380 2023-11-13T11:29:04.279 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:04.267+0000 7f9237fff640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f92380b3770 0x7f923806c9a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.102:52452/0 (socket says 172.21.15.102:52452) 2023-11-13T11:29:04.279 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:04.267+0000 7f9237fff640 1 -- 172.21.15.102:0/156219587 learned_addr learned my addr 172.21.15.102:0/156219587 (peer_addr_for_me v1:172.21.15.102:0/0) 2023-11-13T11:29:04.279 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:04.267+0000 7fae612c6640 1 -- 172.21.15.102:0/3349175872 >> v2:172.21.15.102:3300/0 conn(0x7fae5c071990 msgr2=0x7fae5c06d130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-13T11:29:04.279 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:04.267+0000 7fae612c6640 1 --2- 172.21.15.102:0/3349175872 >> v2:172.21.15.102:3300/0 conn(0x7fae5c071990 0x7fae5c06d130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:04.280 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:04.267+0000 7fae612c6640 1 -- 172.21.15.102:0/3349175872 >> v1:172.21.15.154:6789/0 conn(0x7fae5c070590 legacy=0x7fae5c0b2450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:04.280 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:04.267+0000 7fae612c6640 1 -- 172.21.15.102:0/3349175872 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae5c164ba0 con 0x7fae5c1647c0 2023-11-13T11:29:04.280 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:04.267+0000 7f92377fe640 1 --2- 172.21.15.102:0/156219587 >> v2:172.21.15.154:3300/0 conn(0x7f92380b2380 0x7f92380cd3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:04.281 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:04.271+0000 7f22bad3e640 1 Processor -- start 2023-11-13T11:29:04.281 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:04.267+0000 7fc79bb57640 1 Processor -- start 2023-11-13T11:29:04.281 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:04.271+0000 7f716ef10640 1 -- 172.21.15.102:0/712272486 shutdown_connections 2023-11-13T11:29:04.282 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:04.271+0000 7f716ef10640 1 --2- 172.21.15.102:0/712272486 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7160007520 0x7f71600e33f0 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:04.282 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:04.271+0000 7f716ef10640 1 --2- 172.21.15.102:0/712272486 >> v2:172.21.15.154:3300/0 conn(0x7f716000aab0 0x7f71600df280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:04.282 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:04.271+0000 7f716ef10640 1 -- 172.21.15.102:0/712272486 >> 172.21.15.102:0/712272486 conn(0x7f7160009f90 msgr2=0x7f716000a3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-13T11:29:04.283 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:04.271+0000 7fc79bb57640 1 -- start start 2023-11-13T11:29:04.283 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:04.271+0000 7f716ef10640 1 -- 172.21.15.102:0/712272486 shutdown_connections 2023-11-13T11:29:04.284 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:04.271+0000 7f92367fc640 1 -- 172.21.15.102:0/156219587 <== mon.0 v1:172.21.15.102:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 543156284 0 0) 0x7f92380cddb0 con 0x7f92380cd910 2023-11-13T11:29:04.284 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:04.271+0000 7f92367fc640 1 -- 172.21.15.102:0/156219587 --> v1:172.21.15.102:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9220003530 con 0x7f92380cd910 2023-11-13T11:29:04.284 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:04.271+0000 7f92367fc640 1 -- 172.21.15.102:0/156219587 <== mon.1 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 274043355 0 0) 0x7f92380ce090 con 0x7f92380b3770 2023-11-13T11:29:04.285 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:04.271+0000 7f92367fc640 1 -- 172.21.15.102:0/156219587 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f92380cddb0 con 0x7f92380b3770 2023-11-13T11:29:04.285 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:04.271+0000 7f92367fc640 1 -- 172.21.15.102:0/156219587 <== mon.0 v1:172.21.15.102:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1356146374 0 0) 0x7f9220003530 con 0x7f92380cd910 2023-11-13T11:29:04.285 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:04.271+0000 7f92367fc640 1 -- 172.21.15.102:0/156219587 >> v2:172.21.15.154:3300/0 conn(0x7f92380b2380 msgr2=0x7f92380cd3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-13T11:29:04.285 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:04.271+0000 7f92367fc640 1 --2- 172.21.15.102:0/156219587 >> v2:172.21.15.154:3300/0 conn(0x7f92380b2380 0x7f92380cd3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:04.285 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:04.271+0000 7f92367fc640 1 -- 172.21.15.102:0/156219587 >> v1:172.21.15.154:6789/0 conn(0x7f92380b3770 legacy=0x7f923806c9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:04.286 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:04.271+0000 7f92367fc640 1 -- 172.21.15.102:0/156219587 --> v1:172.21.15.102:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f923806ba90 con 0x7f92380cd910 2023-11-13T11:29:04.286 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:04.271+0000 7f92367fc640 1 -- 172.21.15.102:0/156219587 <== mon.0 v1:172.21.15.102:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 895381068 0 0) 0x7f922c001680 con 0x7f92380cd910 2023-11-13T11:29:04.286 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:04.271+0000 7f92367fc640 1 -- 172.21.15.102:0/156219587 >> v1:172.21.15.102:6789/0 conn(0x7f92380cd910 legacy=0x7f923806c290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:04.287 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:04.271+0000 7f92367fc640 1 --2- 172.21.15.102:0/156219587 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9220003b10 0x7f9220003f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:04.287 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:04.271+0000 7f92367fc640 1 --2- 172.21.15.102:0/156219587 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f92200047d0 0x7f9220004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:04.289 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:04.271+0000 7f92367fc640 1 --2- 172.21.15.102:0/156219587 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9220005190 0x7f922000b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:04.289 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:04.271+0000 7f92367fc640 1 -- 172.21.15.102:0/156219587 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92380ce370 con 0x7f9220003b10 2023-11-13T11:29:04.290 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:04.271+0000 7f92367fc640 1 -- 172.21.15.102:0/156219587 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f922000bf80 con 0x7f9220005190 2023-11-13T11:29:04.290 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:04.271+0000 7f92367fc640 1 -- 172.21.15.102:0/156219587 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f922000c140 con 0x7f92200047d0 2023-11-13T11:29:04.290 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:04.271+0000 7fc79bb57640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc7940b3510 0x7fc79406fd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:04.291 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:04.271+0000 7fc79bb57640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc794070940 con 0x7fc7940cd9d0 2023-11-13T11:29:04.291 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:04.271+0000 7fc79bb57640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc794070b90 con 0x7fc7940cc0e0 2023-11-13T11:29:04.291 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:04.271+0000 7fc79bb57640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc7940b3950 con 0x7fc7940b3510 2023-11-13T11:29:04.291 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:04.271+0000 7f22bad3e640 1 -- start start 2023-11-13T11:29:04.292 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:04.271+0000 7f22bad3e640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f22b415d100 0x7f22b40d35a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:04.292 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:04.271+0000 7f22bad3e640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f22b40ce770 con 0x7f22b40cfe70 2023-11-13T11:29:04.292 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:04.271+0000 7f22bad3e640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f22b40cea50 con 0x7f22b40d3ae0 2023-11-13T11:29:04.292 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:04.271+0000 7f22bad3e640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f22b40ced30 con 0x7f22b415d100 2023-11-13T11:29:04.293 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:04.271+0000 7f716ef10640 1 -- 172.21.15.102:0/712272486 wait complete. 2023-11-13T11:29:04.293 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:04.271+0000 7f9236ffd640 1 --2- 172.21.15.102:0/156219587 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f92200047d0 0x7f9220004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:04.293 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:04.271+0000 7f9237fff640 1 --2- 172.21.15.102:0/156219587 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9220005190 0x7f922000b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:04.294 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:04.271+0000 7f716ef10640 1 Processor -- start 2023-11-13T11:29:04.294 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:04.271+0000 7efce9d1d640 1 Processor -- start 2023-11-13T11:29:04.295 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:04.271+0000 7f716ef10640 1 -- start start 2023-11-13T11:29:04.295 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:04.271+0000 7f22b8ada640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f22b415d100 0x7f22b40d35a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:04.295 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:04.271+0000 7f22b8ada640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f22b415d100 0x7f22b40d35a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.102:33824/0 (socket says 172.21.15.102:33824) 2023-11-13T11:29:04.296 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:04.271+0000 7f22b8ada640 1 -- 172.21.15.102:0/3106667204 learned_addr learned my addr 172.21.15.102:0/3106667204 (peer_addr_for_me v2:172.21.15.102:0/0) 2023-11-13T11:29:04.296 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:04.271+0000 7f9237fff640 1 -- 172.21.15.102:0/156219587 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f92200047d0 msgr2=0x7f9220004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-13T11:29:04.297 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:04.271+0000 7efce9d1d640 1 -- start start 2023-11-13T11:29:04.297 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:04.275+0000 7f22b8ada640 1 -- 172.21.15.102:0/3106667204 >> v1:172.21.15.154:6789/0 conn(0x7f22b40d3ae0 legacy=0x7f22b40cf760 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-11-13T11:29:04.299 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:04.275+0000 7f22b8ada640 1 -- 172.21.15.102:0/3106667204 >> v1:172.21.15.102:6789/0 conn(0x7f22b40cfe70 legacy=0x7f22b40b2d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-13T11:29:04.299 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:04.275+0000 7f22b8ada640 1 -- 172.21.15.102:0/3106667204 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22b40b2800 con 0x7f22b415d100 2023-11-13T11:29:04.299 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:04.275+0000 7f9237fff640 1 --2- 172.21.15.102:0/156219587 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f92200047d0 0x7f9220004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:04.299 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:04.275+0000 7f9237fff640 1 -- 172.21.15.102:0/156219587 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9220003b10 msgr2=0x7f9220003f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-13T11:29:04.300 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:04.275+0000 7f9237fff640 1 --2- 172.21.15.102:0/156219587 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9220003b10 0x7f9220003f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:04.300 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:04.275+0000 7f9237fff640 1 -- 172.21.15.102:0/156219587 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f923806ba90 con 0x7f9220005190 2023-11-13T11:29:04.300 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:04.275+0000 7fae612c6640 1 --2- 172.21.15.102:0/3349175872 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fae5c1647c0 0x7fae5c06cbf0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fae5c0b4080 tx=0x7fae4c01c6e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=dad74fedf02755c3 server_cookie=0 in_seq=0 out_seq=0 2023-11-13T11:29:04.301 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:04.271+0000 7fc7990f2640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc7940b3510 0x7fc79406fd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:04.301 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:04.271+0000 7fc7990f2640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc7940b3510 0x7fc79406fd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.102:33812/0 (socket says 172.21.15.102:33812) 2023-11-13T11:29:04.301 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:04.271+0000 7fc7990f2640 1 -- 172.21.15.102:0/3199691366 learned_addr learned my addr 172.21.15.102:0/3199691366 (peer_addr_for_me v2:172.21.15.102:0/0) 2023-11-13T11:29:04.301 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:04.275+0000 7fc7990f2640 1 -- 172.21.15.102:0/3199691366 >> v1:172.21.15.154:6789/0 conn(0x7fc7940cc0e0 legacy=0x7fc794158f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:04.302 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:04.275+0000 7fc7990f2640 1 -- 172.21.15.102:0/3199691366 >> v1:172.21.15.102:6789/0 conn(0x7fc7940cd9d0 legacy=0x7fc7940b1b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:04.302 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:04.275+0000 7fc7990f2640 1 -- 172.21.15.102:0/3199691366 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc79415ff00 con 0x7fc7940b3510 2023-11-13T11:29:04.302 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:04.275+0000 7f716ef10640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7160007520 0x7f7160188750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:04.303 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:04.275+0000 7fae5bfff640 1 -- 172.21.15.102:0/3349175872 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae4c0a6650 con 0x7fae5c1647c0 2023-11-13T11:29:04.303 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:04.275+0000 7fae5bfff640 1 -- 172.21.15.102:0/3349175872 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae4c0a67b0 con 0x7fae5c1647c0 2023-11-13T11:29:04.303 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:04.275+0000 7fae5bfff640 1 -- 172.21.15.102:0/3349175872 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae4c0a6b40 con 0x7fae5c1647c0 2023-11-13T11:29:04.304 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:04.275+0000 7efce9d1d640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7efce41591f0 0x7efce40b3510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:04.304 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:04.275+0000 7f716ef10640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f716000aab0 0x7f71600dc0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:04.305 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:04.275+0000 7efce37fe640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7efce41591f0 0x7efce40b3510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:04.305 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:04.275+0000 7efce37fe640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7efce41591f0 0x7efce40b3510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.102:33834/0 (socket says 172.21.15.102:33834) 2023-11-13T11:29:04.305 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:04.275+0000 7f716ef10640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7160033cd0 0x7f71600ed180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:04.306 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:04.275+0000 7f716d70d640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f716000aab0 0x7f71600dc0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:04.306 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:04.275+0000 7f716d70d640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f716000aab0 0x7f71600dc0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.102:56332/0 (socket says 172.21.15.102:56332) 2023-11-13T11:29:04.307 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:04.275+0000 7efce9d1d640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efce4070940 con 0x7efce40ce0e0 2023-11-13T11:29:04.307 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:04.275+0000 7efce9d1d640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efce4070560 con 0x7efce406fd10 2023-11-13T11:29:04.307 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:04.275+0000 7efce9d1d640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efce4070b90 con 0x7efce41591f0 2023-11-13T11:29:04.308 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:04.275+0000 7f716d70d640 1 -- 172.21.15.102:0/3690738579 learned_addr learned my addr 172.21.15.102:0/3690738579 (peer_addr_for_me v2:172.21.15.102:0/0) 2023-11-13T11:29:04.308 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:04.275+0000 7f716e70f640 1 --2- 172.21.15.102:0/3690738579 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7160033cd0 0x7f71600ed180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:04.308 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:04.275+0000 7f716ef10640 1 -- 172.21.15.102:0/3690738579 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71600d8d10 con 0x7f7160007520 2023-11-13T11:29:04.309 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:04.275+0000 7f716ef10640 1 -- 172.21.15.102:0/3690738579 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71600d7e40 con 0x7f716000aab0 2023-11-13T11:29:04.309 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:04.275+0000 7f716ef10640 1 -- 172.21.15.102:0/3690738579 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71600dc610 con 0x7f7160033cd0 2023-11-13T11:29:04.309 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:04.275+0000 7efce37fe640 1 -- 172.21.15.102:0/3466418571 learned_addr learned my addr 172.21.15.102:0/3466418571 (peer_addr_for_me v2:172.21.15.102:0/0) 2023-11-13T11:29:04.310 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:04.275+0000 7efce37fe640 1 -- 172.21.15.102:0/3466418571 >> v1:172.21.15.154:6789/0 conn(0x7efce406fd10 legacy=0x7efce40cd9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-13T11:29:04.310 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:04.275+0000 7efce37fe640 1 -- 172.21.15.102:0/3466418571 >> v1:172.21.15.102:6789/0 conn(0x7efce40ce0e0 legacy=0x7efce40b1b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-13T11:29:04.310 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:04.275+0000 7efce37fe640 1 -- 172.21.15.102:0/3466418571 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efce4070e70 con 0x7efce41591f0 2023-11-13T11:29:04.310 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:04.279+0000 7f716e70f640 1 -- 172.21.15.102:0/3690738579 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f716000aab0 msgr2=0x7f71600dc0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:04.311 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:04.279+0000 7fae622c8640 1 -- 172.21.15.102:0/3349175872 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fae5c1647c0 msgr2=0x7fae5c06cbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:04.311 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:04.279+0000 7fae622c8640 1 --2- 172.21.15.102:0/3349175872 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fae5c1647c0 0x7fae5c06cbf0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fae5c0b4080 tx=0x7fae4c01c6e0 comp rx=0 tx=0).stop 2023-11-13T11:29:04.312 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:04.279+0000 7f9237fff640 1 -- 172.21.15.102:0/156219587 reap_dead start 2023-11-13T11:29:04.312 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:04.279+0000 7f716e70f640 1 --2- 172.21.15.102:0/3690738579 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f716000aab0 0x7f71600dc0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:04.312 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:04.279+0000 7f716e70f640 1 -- 172.21.15.102:0/3690738579 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7160007520 msgr2=0x7f7160188750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:04.312 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:04.279+0000 7f716df0e640 1 --2- 172.21.15.102:0/3690738579 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7160007520 0x7f7160188750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:04.313 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:04.279+0000 7f716e70f640 1 --2- 172.21.15.102:0/3690738579 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7160007520 0x7f7160188750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:04.313 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:04.279+0000 7f716e70f640 1 -- 172.21.15.102:0/3690738579 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f716804f470 con 0x7f7160033cd0 2023-11-13T11:29:04.313 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:04.279+0000 7fae622c8640 1 -- 172.21.15.102:0/3349175872 shutdown_connections 2023-11-13T11:29:04.314 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:04.279+0000 7fae622c8640 1 --2- 172.21.15.102:0/3349175872 >> v2:172.21.15.102:3300/0 conn(0x7fae5c071990 0x7fae5c06d130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:04.314 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:04.279+0000 7fae622c8640 1 --2- 172.21.15.102:0/3349175872 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fae5c1647c0 0x7fae5c06cbf0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:04.314 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:04.279+0000 7fae622c8640 1 -- 172.21.15.102:0/3349175872 >> 172.21.15.102:0/3349175872 conn(0x7fae5c0b0690 msgr2=0x7fae5c0b0aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-13T11:29:04.314 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:04.279+0000 7f716d70d640 1 --2- 172.21.15.102:0/3690738579 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f716000aab0 0x7f71600dc0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-13T11:29:04.315 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:04.279+0000 7f9237fff640 1 --2- 172.21.15.102:0/156219587 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9220005190 0x7f922000b990 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f923000c320 tx=0x7f923001f470 comp rx=0 tx=0).ready entity=mon.1 client_cookie=897a79c0e9b74d5a server_cookie=0 in_seq=0 out_seq=0 2023-11-13T11:29:04.316 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:04.279+0000 7f22b8ada640 1 --2- 172.21.15.102:0/3106667204 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f22b415d100 0x7f22b40d35a0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f229c0098a0 tx=0x7f229c01c4e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bcf077b6aac80ee5 server_cookie=0 in_seq=0 out_seq=0 2023-11-13T11:29:04.316 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:04.279+0000 7fae622c8640 1 -- 172.21.15.102:0/3349175872 shutdown_connections 2023-11-13T11:29:04.317 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:04.279+0000 7f716df0e640 1 --2- 172.21.15.102:0/3690738579 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7160007520 0x7f7160188750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-13T11:29:04.318 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:04.279+0000 7fae622c8640 1 -- 172.21.15.102:0/3349175872 wait complete. 2023-11-13T11:29:04.318 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:04.279+0000 7f22b3fff640 1 -- 172.21.15.102:0/3106667204 <== mon.2 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f229c0ab600 con 0x7f22b415d100 2023-11-13T11:29:04.318 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:04.279+0000 7f22b3fff640 1 -- 172.21.15.102:0/3106667204 <== mon.2 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f229c0a7050 con 0x7f22b415d100 2023-11-13T11:29:04.319 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:04.279+0000 7f22b3fff640 1 -- 172.21.15.102:0/3106667204 <== mon.2 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f229c0ab980 con 0x7f22b415d100 2023-11-13T11:29:04.319 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:04.279+0000 7f92367fc640 1 -- 172.21.15.102:0/156219587 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92300af620 con 0x7f9220005190 2023-11-13T11:29:04.319 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:04.279+0000 7f92367fc640 1 -- 172.21.15.102:0/156219587 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f92300ab070 con 0x7f9220005190 2023-11-13T11:29:04.320 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:04.279+0000 7f92367fc640 1 -- 172.21.15.102:0/156219587 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92300af9a0 con 0x7f9220005190 2023-11-13T11:29:04.320 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:04.279+0000 7fc7990f2640 1 --2- 172.21.15.102:0/3199691366 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc7940b3510 0x7fc79406fd10 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fc7840098a0 tx=0x7fc784027560 comp rx=0 tx=0).ready entity=mon.2 client_cookie=86d017427410168d server_cookie=0 in_seq=0 out_seq=0 2023-11-13T11:29:04.320 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:04.279+0000 7f22bad3e640 1 -- 172.21.15.102:0/3106667204 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f22b415d100 msgr2=0x7f22b40d35a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:04.321 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:04.279+0000 7f22bad3e640 1 --2- 172.21.15.102:0/3106667204 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f22b415d100 0x7f22b40d35a0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f229c0098a0 tx=0x7f229c01c4e0 comp rx=0 tx=0).stop 2023-11-13T11:29:04.321 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:04.279+0000 7f716e70f640 1 --2- 172.21.15.102:0/3690738579 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7160033cd0 0x7f71600ed180 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f7168000b70 tx=0x7f7168093830 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-13T11:29:04.321 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:04.279+0000 7f923da94640 1 -- 172.21.15.102:0/156219587 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9220005190 msgr2=0x7f922000b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:04.322 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:04.279+0000 7f923da94640 1 --2- 172.21.15.102:0/156219587 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9220005190 0x7f922000b990 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f923000c320 tx=0x7f923001f470 comp rx=0 tx=0).stop 2023-11-13T11:29:04.322 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:04.279+0000 7fc7988f1640 1 -- 172.21.15.102:0/3199691366 <== mon.2 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7840b7600 con 0x7fc7940b3510 2023-11-13T11:29:04.322 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:04.279+0000 7fc7988f1640 1 -- 172.21.15.102:0/3199691366 <== mon.2 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc7840b3050 con 0x7fc7940b3510 2023-11-13T11:29:04.323 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:04.279+0000 7fc7988f1640 1 -- 172.21.15.102:0/3199691366 <== mon.2 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7840b7980 con 0x7fc7940b3510 2023-11-13T11:29:04.323 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:04.279+0000 7f923da94640 1 -- 172.21.15.102:0/156219587 shutdown_connections 2023-11-13T11:29:04.323 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:04.279+0000 7f923da94640 1 --2- 172.21.15.102:0/156219587 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9220005190 0x7f922000b990 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:04.323 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:04.279+0000 7f923da94640 1 -- 172.21.15.102:0/156219587 >> 172.21.15.102:0/156219587 conn(0x7f92380b0870 msgr2=0x7f92380b0c80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-13T11:29:04.324 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:04.279+0000 7f22bad3e640 1 -- 172.21.15.102:0/3106667204 shutdown_connections 2023-11-13T11:29:04.324 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:04.279+0000 7f22bad3e640 1 --2- 172.21.15.102:0/3106667204 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f22b415d100 0x7f22b40d35a0 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:04.324 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:04.279+0000 7f22bad3e640 1 -- 172.21.15.102:0/3106667204 >> 172.21.15.102:0/3106667204 conn(0x7f22b409c140 msgr2=0x7f22b40d2e90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-13T11:29:04.325 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:04.279+0000 7f923da94640 1 -- 172.21.15.102:0/156219587 shutdown_connections 2023-11-13T11:29:04.325 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:04.279+0000 7f715e7fc640 1 -- 172.21.15.102:0/3690738579 <== mon.2 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7168131890 con 0x7f7160033cd0 2023-11-13T11:29:04.326 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:04.279+0000 7f715e7fc640 1 -- 172.21.15.102:0/3690738579 <== mon.2 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f71681319f0 con 0x7f7160033cd0 2023-11-13T11:29:04.326 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:04.279+0000 7f715e7fc640 1 -- 172.21.15.102:0/3690738579 <== mon.2 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7168131de0 con 0x7f7160033cd0 2023-11-13T11:29:04.326 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:04.279+0000 7f716ef10640 1 -- 172.21.15.102:0/3690738579 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f71600d8090 con 0x7f7160033cd0 2023-11-13T11:29:04.326 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:04.279+0000 7f716ef10640 1 -- 172.21.15.102:0/3690738579 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f71600d8650 con 0x7f7160033cd0 2023-11-13T11:29:04.327 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:04.279+0000 7f923da94640 1 -- 172.21.15.102:0/156219587 wait complete. 2023-11-13T11:29:04.327 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:04.283+0000 7fae622c8640 1 Processor -- start 2023-11-13T11:29:04.328 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:04.283+0000 7fc79bb57640 1 -- 172.21.15.102:0/3199691366 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc7940b3510 msgr2=0x7fc79406fd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:04.328 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:04.283+0000 7fc79bb57640 1 --2- 172.21.15.102:0/3199691366 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc7940b3510 0x7fc79406fd10 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fc7840098a0 tx=0x7fc784027560 comp rx=0 tx=0).stop 2023-11-13T11:29:04.329 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:04.283+0000 7fae622c8640 1 -- start start 2023-11-13T11:29:04.329 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:04.283+0000 7f716ef10640 1 -- 172.21.15.102:0/3690738579 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f71600d8e50 con 0x7f7160033cd0 2023-11-13T11:29:04.330 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:04.283+0000 7fae622c8640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fae5c070590 0x7fae5c14d940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:04.330 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:04.283+0000 7fae622c8640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fae5c071990 0x7fae5c14e730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:04.330 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:04.283+0000 7fae622c8640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fae5c1647c0 0x7fae5c1632f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:04.331 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:04.283+0000 7fc79bb57640 1 -- 172.21.15.102:0/3199691366 shutdown_connections 2023-11-13T11:29:04.331 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:04.283+0000 7fc79bb57640 1 --2- 172.21.15.102:0/3199691366 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc7940b3510 0x7fc79406fd10 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:04.331 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:04.283+0000 7fc79bb57640 1 -- 172.21.15.102:0/3199691366 >> 172.21.15.102:0/3199691366 conn(0x7fc7940cb5c0 msgr2=0x7fc7940cb9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-13T11:29:04.332 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:04.283+0000 7fae622c8640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae5c14f1d0 con 0x7fae5c1647c0 2023-11-13T11:29:04.332 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:04.283+0000 7fae612c6640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fae5c070590 0x7fae5c14d940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:04.332 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:04.283+0000 7fae622c8640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae5c14fbb0 con 0x7fae5c071990 2023-11-13T11:29:04.333 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:04.283+0000 7fae622c8640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae5c14ec70 con 0x7fae5c070590 2023-11-13T11:29:04.333 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:04.283+0000 7fae612c6640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fae5c070590 0x7fae5c14d940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.102:33854/0 (socket says 172.21.15.102:33854) 2023-11-13T11:29:04.333 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:04.283+0000 7fae612c6640 1 -- 172.21.15.102:0/583936995 learned_addr learned my addr 172.21.15.102:0/583936995 (peer_addr_for_me v2:172.21.15.102:0/0) 2023-11-13T11:29:04.333 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:04.283+0000 7fae60ac5640 1 --2- 172.21.15.102:0/583936995 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fae5c071990 0x7fae5c14e730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:04.334 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:04.283+0000 7f22bad3e640 1 -- 172.21.15.102:0/3106667204 shutdown_connections 2023-11-13T11:29:04.334 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:04.283+0000 7f22bad3e640 1 -- 172.21.15.102:0/3106667204 wait complete. 2023-11-13T11:29:04.334 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:04.283+0000 7fae61ac7640 1 --2- 172.21.15.102:0/583936995 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fae5c1647c0 0x7fae5c1632f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:04.335 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:04.283+0000 7f715e7fc640 1 -- 172.21.15.102:0/3690738579 <== mon.2 v2:172.21.15.154:3301/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f7168127440 con 0x7f7160033cd0 2023-11-13T11:29:04.335 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:04.283+0000 7f22bad3e640 1 Processor -- start 2023-11-13T11:29:04.335 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:04.283+0000 7efce37fe640 1 --2- 172.21.15.102:0/3466418571 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7efce41591f0 0x7efce40b3510 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7efccc0098a0 tx=0x7efccc01c520 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a638008eb47bcc61 server_cookie=0 in_seq=0 out_seq=0 2023-11-13T11:29:04.336 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:04.283+0000 7fae60ac5640 1 -- 172.21.15.102:0/583936995 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fae5c070590 msgr2=0x7fae5c14d940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:04.336 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:04.283+0000 7fae60ac5640 1 --2- 172.21.15.102:0/583936995 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fae5c070590 0x7fae5c14d940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:04.336 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:04.283+0000 7fae60ac5640 1 -- 172.21.15.102:0/583936995 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fae5c1647c0 msgr2=0x7fae5c1632f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:04.337 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:04.283+0000 7fae60ac5640 1 --2- 172.21.15.102:0/583936995 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fae5c1647c0 0x7fae5c1632f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:04.337 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:04.283+0000 7fae60ac5640 1 -- 172.21.15.102:0/583936995 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae4c009a70 con 0x7fae5c071990 2023-11-13T11:29:04.337 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:04.283+0000 7f923da94640 1 Processor -- start 2023-11-13T11:29:04.338 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:04.283+0000 7fae60ac5640 1 --2- 172.21.15.102:0/583936995 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fae5c071990 0x7fae5c14e730 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fae5000c560 tx=0x7fae5000c960 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-13T11:29:04.339 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:04.287+0000 7fc79bb57640 1 -- 172.21.15.102:0/3199691366 shutdown_connections 2023-11-13T11:29:04.339 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:04.287+0000 7f715e7fc640 1 --2- 172.21.15.102:0/3690738579 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f714c0664c0 0x7f714c068980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:04.339 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:04.287+0000 7fae59ffb640 1 -- 172.21.15.102:0/583936995 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae500074e0 con 0x7fae5c071990 2023-11-13T11:29:04.340 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:04.287+0000 7f715e7fc640 1 -- 172.21.15.102:0/3690738579 <== mon.2 v2:172.21.15.154:3301/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f7168198900 con 0x7f7160033cd0 2023-11-13T11:29:04.340 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:04.287+0000 7f22bad3e640 1 -- start start 2023-11-13T11:29:04.341 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:04.287+0000 7fae622c8640 1 -- 172.21.15.102:0/583936995 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fae5c14f5a0 con 0x7fae5c071990 2023-11-13T11:29:04.341 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:04.287+0000 7fae59ffb640 1 -- 172.21.15.102:0/583936995 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae50007640 con 0x7fae5c071990 2023-11-13T11:29:04.341 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:04.287+0000 7fae622c8640 1 -- 172.21.15.102:0/583936995 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fae5c14f840 con 0x7fae5c071990 2023-11-13T11:29:04.342 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:04.287+0000 7fae59ffb640 1 -- 172.21.15.102:0/583936995 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae500049f0 con 0x7fae5c071990 2023-11-13T11:29:04.342 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:04.287+0000 7f716df0e640 1 --2- 172.21.15.102:0/3690738579 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f714c0664c0 0x7f714c068980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:04.342 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:04.287+0000 7fe70bc94640 1 Processor -- start 2023-11-13T11:29:04.343 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:04.287+0000 7f22bad3e640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f22b40cfe70 0x7f22b414e4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:04.344 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:04.287+0000 7f22bad3e640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f22b40d3ae0 0x7f22b415ed40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:04.344 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:04.287+0000 7f22bad3e640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f22b415d100 0x7f22b40cc300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:04.344 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:04.287+0000 7f22bad3e640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22b415f280 con 0x7f22b40cfe70 2023-11-13T11:29:04.344 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:04.287+0000 7f22bad3e640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22b40c9f60 con 0x7f22b415d100 2023-11-13T11:29:04.344 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:04.287+0000 7f22bad3e640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f22b41f93f0 con 0x7f22b40d3ae0 2023-11-13T11:29:04.345 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:04.287+0000 7f22b8ada640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f22b40cfe70 0x7f22b414e4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:04.345 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:04.287+0000 7fc79bb57640 1 -- 172.21.15.102:0/3199691366 wait complete. 2023-11-13T11:29:04.346 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:04.287+0000 7f22abfff640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f22b40d3ae0 0x7f22b415ed40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:04.346 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:04.287+0000 7f22b8ada640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f22b40cfe70 0x7f22b414e4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:36310/0 (socket says 172.21.15.102:36310) 2023-11-13T11:29:04.346 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:04.287+0000 7f22b8ada640 1 -- 172.21.15.102:0/2785464933 learned_addr learned my addr 172.21.15.102:0/2785464933 (peer_addr_for_me v2:172.21.15.102:0/0) 2023-11-13T11:29:04.347 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:04.287+0000 7fc79bb57640 1 Processor -- start 2023-11-13T11:29:04.347 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:04.287+0000 7fae622c8640 1 -- 172.21.15.102:0/583936995 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fae3c005260 con 0x7fae5c071990 2023-11-13T11:29:04.348 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:04.287+0000 7fe70bc94640 1 -- start start 2023-11-13T11:29:04.349 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:04.287+0000 7f22b92db640 1 --2- 172.21.15.102:0/2785464933 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f22b415d100 0x7f22b40cc300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:04.349 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:04.287+0000 7f22abfff640 1 -- 172.21.15.102:0/2785464933 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f22b415d100 msgr2=0x7f22b40cc300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:04.349 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:04.287+0000 7f22abfff640 1 --2- 172.21.15.102:0/2785464933 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f22b415d100 0x7f22b40cc300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:04.349 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:04.287+0000 7f22abfff640 1 -- 172.21.15.102:0/2785464933 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f22b40cfe70 msgr2=0x7f22b414e4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:04.350 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:04.287+0000 7f22abfff640 1 --2- 172.21.15.102:0/2785464933 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f22b40cfe70 0x7f22b414e4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:04.350 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:04.287+0000 7f22abfff640 1 -- 172.21.15.102:0/2785464933 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f229c0094d0 con 0x7f22b40d3ae0 2023-11-13T11:29:04.350 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:04.287+0000 7f22abfff640 1 --2- 172.21.15.102:0/2785464933 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f22b40d3ae0 0x7f22b415ed40 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f22a400b3c0 tx=0x7f22a400b880 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-13T11:29:04.351 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:04.291+0000 7fbfda3f5640 1 Processor -- start 2023-11-13T11:29:04.351 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:04.291+0000 7fbfda3f5640 1 -- start start 2023-11-13T11:29:04.351 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:04.291+0000 7fe70bc94640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7fe70406d2a0 0x7fe7040b2760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:04.351 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:04.291+0000 7fe70bc94640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe7040b2ca0 0x7fe7040b3120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:04.352 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:04.291+0000 7fe70bc94640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe7040cdae0 con 0x7fe7040b2380 2023-11-13T11:29:04.352 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:04.291+0000 7fe70bc94640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe7040cddb0 con 0x7fe70406d2a0 2023-11-13T11:29:04.352 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:04.291+0000 7fe70bc94640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe7040ce090 con 0x7fe7040b2ca0 2023-11-13T11:29:04.352 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:04.287+0000 7fc79bb57640 1 -- start start 2023-11-13T11:29:04.353 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:04.287+0000 7f923da94640 1 -- start start 2023-11-13T11:29:04.354 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:04.291+0000 7f716df0e640 1 --2- 172.21.15.102:0/3690738579 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f714c0664c0 0x7f714c068980 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f7164009840 tx=0x7f7164008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-13T11:29:04.354 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:04.291+0000 7fe70a231640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe7040b2ca0 0x7fe7040b3120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:04.354 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:04.291+0000 7f923da94640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9220005190 0x7f9238146d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:04.355 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:04.291+0000 7fe70a231640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe7040b2ca0 0x7fe7040b3120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.102:33874/0 (socket says 172.21.15.102:33874) 2023-11-13T11:29:04.355 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:04.291+0000 7fe70a231640 1 -- 172.21.15.102:0/3679318587 learned_addr learned my addr 172.21.15.102:0/3679318587 (peer_addr_for_me v2:172.21.15.102:0/0) 2023-11-13T11:29:04.355 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:04.291+0000 7fe709a30640 1 --1- 172.21.15.102:0/3679318587 >> v1:172.21.15.154:6789/0 conn(0x7fe7040b2380 0x7fe7040cd3d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.102:52474/0 (socket says 172.21.15.102:52474) 2023-11-13T11:29:04.356 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:04.291+0000 7f923da94640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f92381ebd10 0x7f92381f7710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:04.357 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:04.291+0000 7f923da94640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9238148cc0 0x7f9238149140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:04.357 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:04.291+0000 7f923da94640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9238149680 con 0x7f92381ebd10 2023-11-13T11:29:04.357 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:04.291+0000 7f923da94640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92381ec560 con 0x7f9238148cc0 2023-11-13T11:29:04.357 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:04.291+0000 7f923da94640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f92381f8820 con 0x7f9220005190 2023-11-13T11:29:04.358 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:04.291+0000 7fae59ffb640 1 -- 172.21.15.102:0/583936995 <== mon.1 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fae50004b50 con 0x7fae5c071990 2023-11-13T11:29:04.358 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:04.291+0000 7f92377fe640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9220005190 0x7f9238146d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:04.359 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:04.291+0000 7f92377fe640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9220005190 0x7f9238146d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.102:33884/0 (socket says 172.21.15.102:33884) 2023-11-13T11:29:04.359 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:04.291+0000 7f92377fe640 1 -- 172.21.15.102:0/1744308205 learned_addr learned my addr 172.21.15.102:0/1744308205 (peer_addr_for_me v2:172.21.15.102:0/0) 2023-11-13T11:29:04.359 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:04.291+0000 7f9236ffd640 1 --2- 172.21.15.102:0/1744308205 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f92381ebd10 0x7f92381f7710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:04.359 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:04.291+0000 7f22b1ffb640 1 -- 172.21.15.102:0/2785464933 <== mon.2 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22a4011830 con 0x7f22b40d3ae0 2023-11-13T11:29:04.360 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:04.291+0000 7fe70922f640 1 --2- 172.21.15.102:0/3679318587 >> v2:172.21.15.102:3300/0 conn(0x7fe70406d2a0 0x7fe7040b2760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:04.360 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:04.291+0000 7f22b1ffb640 1 -- 172.21.15.102:0/2785464933 <== mon.2 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f22a40119b0 con 0x7f22b40d3ae0 2023-11-13T11:29:04.361 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:04.291+0000 7f22b1ffb640 1 -- 172.21.15.102:0/2785464933 <== mon.2 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22a4011d60 con 0x7f22b40d3ae0 2023-11-13T11:29:04.361 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:04.291+0000 7efce2ffd640 1 -- 172.21.15.102:0/3466418571 <== mon.2 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efccc0a7070 con 0x7efce41591f0 2023-11-13T11:29:04.361 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:04.291+0000 7f92377fe640 1 -- 172.21.15.102:0/1744308205 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9238148cc0 msgr2=0x7f9238149140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:04.362 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:04.291+0000 7f92377fe640 1 --2- 172.21.15.102:0/1744308205 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9238148cc0 0x7f9238149140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:04.362 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:04.291+0000 7f92377fe640 1 -- 172.21.15.102:0/1744308205 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f92381ebd10 msgr2=0x7f92381f7710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:04.362 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:04.291+0000 7f92377fe640 1 --2- 172.21.15.102:0/1744308205 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f92381ebd10 0x7f92381f7710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:04.362 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:04.291+0000 7f92377fe640 1 -- 172.21.15.102:0/1744308205 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9238147270 con 0x7f9220005190 2023-11-13T11:29:04.363 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:04.291+0000 7efce2ffd640 1 -- 172.21.15.102:0/3466418571 <== mon.2 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efccc0ab430 con 0x7efce41591f0 2023-11-13T11:29:04.363 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:04.291+0000 7efce2ffd640 1 -- 172.21.15.102:0/3466418571 <== mon.2 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efccc0ab7c0 con 0x7efce41591f0 2023-11-13T11:29:04.363 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:04.291+0000 7fae59ffb640 1 --2- 172.21.15.102:0/583936995 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7fae48066540 0x7fae48068a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:04.363 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:04.291+0000 7fae59ffb640 1 -- 172.21.15.102:0/583936995 <== mon.1 v2:172.21.15.154:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fae500832f0 con 0x7fae5c071990 2023-11-13T11:29:04.364 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:04.291+0000 7fae612c6640 1 --2- 172.21.15.102:0/583936995 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7fae48066540 0x7fae48068a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:04.364 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:04.291+0000 7f92377fe640 1 --2- 172.21.15.102:0/1744308205 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9220005190 0x7f9238146d30 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f922800e820 tx=0x7f922800ece0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-13T11:29:04.365 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:04.291+0000 7f921ffff640 1 -- 172.21.15.102:0/1744308205 <== mon.2 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f922800c730 con 0x7f9220005190 2023-11-13T11:29:04.365 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:04.291+0000 7f921ffff640 1 -- 172.21.15.102:0/1744308205 <== mon.2 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f922800c890 con 0x7f9220005190 2023-11-13T11:29:04.365 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:04.291+0000 7f921ffff640 1 -- 172.21.15.102:0/1744308205 <== mon.2 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f922800cc40 con 0x7f9220005190 2023-11-13T11:29:04.366 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:04.291+0000 7fc79bb57640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc7940b3510 0x7fc7941524a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:04.366 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:04.291+0000 7fc79bb57640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc7940cc0e0 0x7fc79415ef80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:04.366 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:04.291+0000 7fc79bb57640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc7940cd9d0 0x7fc794149d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:04.366 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:04.291+0000 7fc79bb57640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc794153270 con 0x7fc7940cc0e0 2023-11-13T11:29:04.366 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:04.291+0000 7fc79bb57640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc794153550 con 0x7fc7940b3510 2023-11-13T11:29:04.367 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:04.291+0000 7fc79bb57640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc79414fcf0 con 0x7fc7940cd9d0 2023-11-13T11:29:04.367 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:04.291+0000 7fc7990f2640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc7940cc0e0 0x7fc79415ef80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:04.367 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:04.291+0000 7efce9d1d640 1 -- 172.21.15.102:0/3466418571 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7efce41591f0 msgr2=0x7efce40b3510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:04.368 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:04.291+0000 7fe70a231640 1 -- 172.21.15.102:0/3679318587 >> v2:172.21.15.102:3300/0 conn(0x7fe70406d2a0 msgr2=0x7fe7040b2760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-13T11:29:04.368 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:04.291+0000 7fe70a231640 1 --2- 172.21.15.102:0/3679318587 >> v2:172.21.15.102:3300/0 conn(0x7fe70406d2a0 0x7fe7040b2760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:04.368 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:04.291+0000 7fe70a231640 1 -- 172.21.15.102:0/3679318587 >> v1:172.21.15.154:6789/0 conn(0x7fe7040b2380 legacy=0x7fe7040cd3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:04.369 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:04.291+0000 7fe70a231640 1 -- 172.21.15.102:0/3679318587 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7040ce370 con 0x7fe7040b2ca0 2023-11-13T11:29:04.370 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:04.291+0000 7f22bad3e640 1 -- 172.21.15.102:0/2785464933 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f22b41f96d0 con 0x7f22b40d3ae0 2023-11-13T11:29:04.370 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:04.291+0000 7f22bad3e640 1 -- 172.21.15.102:0/2785464933 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f22b41f9c90 con 0x7f22b40d3ae0 2023-11-13T11:29:04.371 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:04.291+0000 7efce9d1d640 1 --2- 172.21.15.102:0/3466418571 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7efce41591f0 0x7efce40b3510 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7efccc0098a0 tx=0x7efccc01c520 comp rx=0 tx=0).stop 2023-11-13T11:29:04.371 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:04.291+0000 7f923da94640 1 -- 172.21.15.102:0/1744308205 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f92381f8210 con 0x7f9220005190 2023-11-13T11:29:04.371 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:04.291+0000 7f923da94640 1 -- 172.21.15.102:0/1744308205 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f92381f84b0 con 0x7f9220005190 2023-11-13T11:29:04.372 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:04.291+0000 7fc7990f2640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc7940cc0e0 0x7fc79415ef80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:36340/0 (socket says 172.21.15.102:36340) 2023-11-13T11:29:04.372 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:04.291+0000 7fc7990f2640 1 -- 172.21.15.102:0/996071900 learned_addr learned my addr 172.21.15.102:0/996071900 (peer_addr_for_me v2:172.21.15.102:0/0) 2023-11-13T11:29:04.372 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:04.291+0000 7fc79a0f4640 1 --2- 172.21.15.102:0/996071900 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc7940cd9d0 0x7fc794149d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:04.372 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:04.291+0000 7fc7990f2640 1 -- 172.21.15.102:0/996071900 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc7940cd9d0 msgr2=0x7fc794149d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:04.373 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:04.291+0000 7fc7990f2640 1 --2- 172.21.15.102:0/996071900 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc7940cd9d0 0x7fc794149d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:04.373 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:04.291+0000 7fc7990f2640 1 -- 172.21.15.102:0/996071900 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc7940b3510 msgr2=0x7fc7941524a0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-11-13T11:29:04.373 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:04.291+0000 7efce9d1d640 1 -- 172.21.15.102:0/3466418571 shutdown_connections 2023-11-13T11:29:04.373 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:04.291+0000 7efce9d1d640 1 --2- 172.21.15.102:0/3466418571 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7efce41591f0 0x7efce40b3510 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:04.374 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:04.291+0000 7efce9d1d640 1 -- 172.21.15.102:0/3466418571 >> 172.21.15.102:0/3466418571 conn(0x7efce40cb5c0 msgr2=0x7efce40cb9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-13T11:29:04.374 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:04.291+0000 7fbfda3f5640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7fbfd415d100 0x7fbfd40d35a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:04.374 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:04.291+0000 7fbfda3f5640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbfd40ce770 con 0x7fbfd40d3ae0 2023-11-13T11:29:04.374 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:04.295+0000 7fbfda3f5640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbfd40cea50 con 0x7fbfd40cfe70 2023-11-13T11:29:04.375 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:04.295+0000 7fbfda3f5640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbfd40ced30 con 0x7fbfd415d100 2023-11-13T11:29:04.375 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:04.295+0000 7f715e7fc640 1 -- 172.21.15.102:0/3690738579 <== mon.2 v2:172.21.15.154:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f71600d8e50 con 0x7f7160033cd0 2023-11-13T11:29:04.375 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:04.291+0000 7fc7990f2640 1 --2- 172.21.15.102:0/996071900 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc7940b3510 0x7fc7941524a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:04.376 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:04.291+0000 7fc7990f2640 1 -- 172.21.15.102:0/996071900 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7840094d0 con 0x7fc7940cc0e0 2023-11-13T11:29:04.376 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:04.295+0000 7efce9d1d640 1 -- 172.21.15.102:0/3466418571 shutdown_connections 2023-11-13T11:29:04.376 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:04.295+0000 7fbfd3fff640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7fbfd415d100 0x7fbfd40d35a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:04.377 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:04.295+0000 7fbfd3fff640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7fbfd415d100 0x7fbfd40d35a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:36346/0 (socket says 172.21.15.102:36346) 2023-11-13T11:29:04.377 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:04.295+0000 7fbfd3fff640 1 -- 172.21.15.102:0/4292210439 learned_addr learned my addr 172.21.15.102:0/4292210439 (peer_addr_for_me v2:172.21.15.102:0/0) 2023-11-13T11:29:04.377 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:04.295+0000 7f22bad3e640 1 -- 172.21.15.102:0/2785464933 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f22b4068520 con 0x7f22b40d3ae0 2023-11-13T11:29:04.378 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:04.295+0000 7efce9d1d640 1 -- 172.21.15.102:0/3466418571 wait complete. 2023-11-13T11:29:04.378 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:04.295+0000 7fae612c6640 1 --2- 172.21.15.102:0/583936995 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7fae48066540 0x7fae48068a00 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fae4c01c720 tx=0x7fae4c0a7000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-13T11:29:04.378 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:04.295+0000 7f923da94640 1 -- 172.21.15.102:0/1744308205 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f92381f8070 con 0x7f9220005190 2023-11-13T11:29:04.379 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:04.295+0000 7f22b1ffb640 1 -- 172.21.15.102:0/2785464933 <== mon.2 v2:172.21.15.154:3301/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f22a401b460 con 0x7f22b40d3ae0 2023-11-13T11:29:04.379 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:04.295+0000 7fe70a231640 1 --2- 172.21.15.102:0/3679318587 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe7040b2ca0 0x7fe7040b3120 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fe6fc009e50 tx=0x7fe6fc01f210 comp rx=0 tx=0).ready entity=mon.2 client_cookie=72d7781d74c18f2 server_cookie=0 in_seq=0 out_seq=0 2023-11-13T11:29:04.380 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:04.295+0000 7fbfd3fff640 1 -- 172.21.15.102:0/4292210439 >> v1:172.21.15.154:6789/0 conn(0x7fbfd40cfe70 legacy=0x7fbfd40b2d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:04.380 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:04.295+0000 7fbfd3fff640 1 -- 172.21.15.102:0/4292210439 >> v1:172.21.15.102:6789/0 conn(0x7fbfd40d3ae0 legacy=0x7fbfd40cf760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-13T11:29:04.380 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:04.295+0000 7fbfd3fff640 1 -- 172.21.15.102:0/4292210439 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbfd40b2800 con 0x7fbfd415d100 2023-11-13T11:29:04.381 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:04.295+0000 7efce9d1d640 1 Processor -- start 2023-11-13T11:29:04.381 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:04.295+0000 7efce9d1d640 1 -- start start 2023-11-13T11:29:04.382 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:04.295+0000 7fc7990f2640 1 --2- 172.21.15.102:0/996071900 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc7940cc0e0 0x7fc79415ef80 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fc784024170 tx=0x7fc784024300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-13T11:29:04.382 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:04.295+0000 7fc78a7fc640 1 -- 172.21.15.102:0/996071900 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7840c0420 con 0x7fc7940cc0e0 2023-11-13T11:29:04.382 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:04.295+0000 7fc78a7fc640 1 -- 172.21.15.102:0/996071900 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc7840c0580 con 0x7fc7940cc0e0 2023-11-13T11:29:04.383 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:04.295+0000 7fc78a7fc640 1 -- 172.21.15.102:0/996071900 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7840c0930 con 0x7fc7940cc0e0 2023-11-13T11:29:04.383 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:04.299+0000 7fc79bb57640 1 -- 172.21.15.102:0/996071900 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc79414ffd0 con 0x7fc7940cc0e0 2023-11-13T11:29:04.383 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:04.299+0000 7fc79bb57640 1 -- 172.21.15.102:0/996071900 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc7941529e0 con 0x7fc7940cc0e0 2023-11-13T11:29:04.383 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:04.295+0000 7f22b1ffb640 1 --2- 172.21.15.102:0/2785464933 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f22940664a0 0x7f2294068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:04.384 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:04.299+0000 7f22b1ffb640 1 -- 172.21.15.102:0/2785464933 <== mon.2 v2:172.21.15.154:3301/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f22a4083b30 con 0x7f22b40d3ae0 2023-11-13T11:29:04.384 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:04.299+0000 7f22b8ada640 1 --2- 172.21.15.102:0/2785464933 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f22940664a0 0x7f2294068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:04.384 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:04.295+0000 7f921ffff640 1 -- 172.21.15.102:0/1744308205 <== mon.2 v2:172.21.15.154:3301/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f9228013470 con 0x7f9220005190 2023-11-13T11:29:04.385 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:04.299+0000 7f22b8ada640 1 --2- 172.21.15.102:0/2785464933 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f22940664a0 0x7f2294068960 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f229c01cd80 tx=0x7f229c0a6000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-13T11:29:04.385 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:04.299+0000 7f921ffff640 1 --2- 172.21.15.102:0/1744308205 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f92240664f0 0x7f92240689b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:04.385 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:04.299+0000 7f921ffff640 1 -- 172.21.15.102:0/1744308205 <== mon.2 v2:172.21.15.154:3301/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f9228084130 con 0x7f9220005190 2023-11-13T11:29:04.386 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:04.299+0000 7fae59ffb640 1 -- 172.21.15.102:0/583936995 <== mon.1 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fae50050890 con 0x7fae5c071990 2023-11-13T11:29:04.386 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:04.299+0000 7fc79bb57640 1 -- 172.21.15.102:0/996071900 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc794068520 con 0x7fc7940cc0e0 2023-11-13T11:29:04.387 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:04.299+0000 7efce9d1d640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7efce406fd10 0x7efce41467c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:04.387 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:04.299+0000 7efce9d1d640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7efce40ce0e0 0x7efce414e930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:04.387 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:04.299+0000 7fbfd3fff640 1 --2- 172.21.15.102:0/4292210439 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fbfd415d100 0x7fbfd40d35a0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fbfc4009e50 tx=0x7fbfc401c9d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bbd55800f7b6c126 server_cookie=0 in_seq=0 out_seq=0 2023-11-13T11:29:04.388 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:04.299+0000 7f9236ffd640 1 --2- 172.21.15.102:0/1744308205 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f92240664f0 0x7f92240689b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:04.388 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:04.299+0000 7efce9d1d640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efce41591f0 0x7efce415b1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:04.389 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:04.299+0000 7efce9d1d640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efce414b620 con 0x7efce406fd10 2023-11-13T11:29:04.389 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:04.299+0000 7efce9d1d640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efce414b890 con 0x7efce41591f0 2023-11-13T11:29:04.389 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:04.299+0000 7efcdaffd640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7efce40ce0e0 0x7efce414e930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:04.389 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:04.299+0000 7efce37fe640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7efce406fd10 0x7efce41467c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:04.389 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:04.299+0000 7efce37fe640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7efce406fd10 0x7efce41467c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:36362/0 (socket says 172.21.15.102:36362) 2023-11-13T11:29:04.390 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:04.299+0000 7efce3fff640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efce41591f0 0x7efce415b1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:04.390 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:04.299+0000 7efce37fe640 1 -- 172.21.15.102:0/388437651 learned_addr learned my addr 172.21.15.102:0/388437651 (peer_addr_for_me v2:172.21.15.102:0/0) 2023-11-13T11:29:04.390 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:04.299+0000 7efce9d1d640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efce4146d00 con 0x7efce40ce0e0 2023-11-13T11:29:04.391 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:04.299+0000 7f9236ffd640 1 --2- 172.21.15.102:0/1744308205 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f92240664f0 0x7f92240689b0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f922c001000 tx=0x7f922c009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-13T11:29:04.391 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:04.299+0000 7fe708a2e640 1 -- 172.21.15.102:0/3679318587 <== mon.2 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6fc0af400 con 0x7fe7040b2ca0 2023-11-13T11:29:04.392 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:04.303+0000 7efce3fff640 1 -- 172.21.15.102:0/388437651 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7efce40ce0e0 msgr2=0x7efce414e930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:04.392 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:04.303+0000 7efce3fff640 1 --2- 172.21.15.102:0/388437651 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7efce40ce0e0 0x7efce414e930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:04.392 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:04.303+0000 7efce3fff640 1 -- 172.21.15.102:0/388437651 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7efce406fd10 msgr2=0x7efce41467c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:04.392 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:04.303+0000 7efce3fff640 1 --2- 172.21.15.102:0/388437651 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7efce406fd10 0x7efce41467c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:04.392 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:04.303+0000 7efce3fff640 1 -- 172.21.15.102:0/388437651 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efccc0094d0 con 0x7efce41591f0 2023-11-13T11:29:04.393 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:04.303+0000 7efce37fe640 1 --2- 172.21.15.102:0/388437651 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7efce406fd10 0x7efce41467c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-13T11:29:04.393 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:04.303+0000 7f22b1ffb640 1 -- 172.21.15.102:0/2785464933 <== mon.2 v2:172.21.15.154:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f22a4050fa0 con 0x7f22b40d3ae0 2023-11-13T11:29:04.393 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:04.303+0000 7fc78a7fc640 1 -- 172.21.15.102:0/996071900 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fc7840be070 con 0x7fc7940cc0e0 2023-11-13T11:29:04.394 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:04.303+0000 7efce3fff640 1 --2- 172.21.15.102:0/388437651 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efce41591f0 0x7efce415b1c0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7efcdc00c780 tx=0x7efcdc00cc40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-13T11:29:04.394 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:04.303+0000 7efce0ff9640 1 -- 172.21.15.102:0/388437651 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efcdc003d90 con 0x7efce41591f0 2023-11-13T11:29:04.394 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:04.303+0000 7efce0ff9640 1 -- 172.21.15.102:0/388437651 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efcdc00ce30 con 0x7efce41591f0 2023-11-13T11:29:04.395 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:04.303+0000 7efce0ff9640 1 -- 172.21.15.102:0/388437651 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efcdc005290 con 0x7efce41591f0 2023-11-13T11:29:04.395 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:04.303+0000 7efce9d1d640 1 -- 172.21.15.102:0/388437651 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efce414f330 con 0x7efce41591f0 2023-11-13T11:29:04.395 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:04.303+0000 7fc78a7fc640 1 --2- 172.21.15.102:0/996071900 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7fc7780664c0 0x7fc778068980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:04.395 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:04.303+0000 7fc78a7fc640 1 -- 172.21.15.102:0/996071900 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc784129650 con 0x7fc7940cc0e0 2023-11-13T11:29:04.396 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:04.303+0000 7efce9d1d640 1 -- 172.21.15.102:0/388437651 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efce414f8f0 con 0x7efce41591f0 2023-11-13T11:29:04.396 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:04.303+0000 7fc7998f3640 1 --2- 172.21.15.102:0/996071900 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7fc7780664c0 0x7fc778068980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:04.397 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:04.303+0000 7efce9d1d640 1 -- 172.21.15.102:0/388437651 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efcc8005260 con 0x7efce41591f0 2023-11-13T11:29:04.397 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:04.303+0000 7fc7998f3640 1 --2- 172.21.15.102:0/996071900 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7fc7780664c0 0x7fc778068980 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fc78c007fd0 tx=0x7fc78c007d40 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-13T11:29:04.397 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:04.307+0000 7fe708a2e640 1 -- 172.21.15.102:0/3679318587 <== mon.2 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe6fc0ab050 con 0x7fe7040b2ca0 2023-11-13T11:29:04.398 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:04.307+0000 7fe708a2e640 1 -- 172.21.15.102:0/3679318587 <== mon.2 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6fc0af780 con 0x7fe7040b2ca0 2023-11-13T11:29:04.398 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:04.307+0000 7f921ffff640 1 -- 172.21.15.102:0/1744308205 <== mon.2 v2:172.21.15.154:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f92381f8070 con 0x7f9220005190 2023-11-13T11:29:04.399 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:04.307+0000 7efce0ff9640 1 -- 172.21.15.102:0/388437651 <== mon.1 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7efcdc0053f0 con 0x7efce41591f0 2023-11-13T11:29:04.399 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:04.307+0000 7fe70bc94640 1 -- 172.21.15.102:0/3679318587 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe7040b2ca0 msgr2=0x7fe7040b3120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:04.399 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:04.307+0000 7fe70bc94640 1 --2- 172.21.15.102:0/3679318587 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe7040b2ca0 0x7fe7040b3120 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fe6fc009e50 tx=0x7fe6fc01f210 comp rx=0 tx=0).stop 2023-11-13T11:29:04.400 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:04.307+0000 7fe70bc94640 1 -- 172.21.15.102:0/3679318587 shutdown_connections 2023-11-13T11:29:04.400 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:04.307+0000 7fe70bc94640 1 --2- 172.21.15.102:0/3679318587 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe7040b2ca0 0x7fe7040b3120 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:04.400 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:04.307+0000 7fe70bc94640 1 --2- 172.21.15.102:0/3679318587 >> v2:172.21.15.102:3300/0 conn(0x7fe70406d2a0 0x7fe7040b2760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:04.400 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:04.307+0000 7fe70bc94640 1 -- 172.21.15.102:0/3679318587 >> 172.21.15.102:0/3679318587 conn(0x7fe7040b0870 msgr2=0x7fe7040b0c80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-13T11:29:04.401 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:04.307+0000 7fe70bc94640 1 -- 172.21.15.102:0/3679318587 shutdown_connections 2023-11-13T11:29:04.401 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:04.307+0000 7efce0ff9640 1 --2- 172.21.15.102:0/388437651 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7efcc4066540 0x7efcc4068a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:04.402 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:04.307+0000 7fbfd2ffd640 1 -- 172.21.15.102:0/4292210439 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfc40a5720 con 0x7fbfd415d100 2023-11-13T11:29:04.402 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:04.307+0000 7fbfd2ffd640 1 -- 172.21.15.102:0/4292210439 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbfc40a5880 con 0x7fbfd415d100 2023-11-13T11:29:04.403 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:04.307+0000 7efce37fe640 1 --2- 172.21.15.102:0/388437651 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7efcc4066540 0x7efcc4068a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:04.403 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:04.307+0000 7efce0ff9640 1 -- 172.21.15.102:0/388437651 <== mon.1 v2:172.21.15.154:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7efcdc083a90 con 0x7efce41591f0 2023-11-13T11:29:04.403 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:04.311+0000 7efce37fe640 1 --2- 172.21.15.102:0/388437651 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7efcc4066540 0x7efcc4068a00 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7efccc0098a0 tx=0x7efccc008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-13T11:29:04.403 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:04.311+0000 7efce0ff9640 1 -- 172.21.15.102:0/388437651 <== mon.1 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7efcdc050fa0 con 0x7efce41591f0 2023-11-13T11:29:04.404 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:04.307+0000 7fbfd2ffd640 1 -- 172.21.15.102:0/4292210439 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfc40a5720 con 0x7fbfd415d100 2023-11-13T11:29:04.404 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:04.307+0000 7fe70bc94640 1 -- 172.21.15.102:0/3679318587 wait complete. 2023-11-13T11:29:04.404 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:04.311+0000 7fe70bc94640 1 Processor -- start 2023-11-13T11:29:04.405 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:04.311+0000 7fc78a7fc640 1 -- 172.21.15.102:0/996071900 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fc7840f6bf0 con 0x7fc7940cc0e0 2023-11-13T11:29:04.405 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:04.311+0000 7fe70bc94640 1 -- start start 2023-11-13T11:29:04.406 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:04.311+0000 7fbfda3f5640 1 -- 172.21.15.102:0/4292210439 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fbfd415d100 msgr2=0x7fbfd40d35a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:04.406 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:04.311+0000 7fbfda3f5640 1 --2- 172.21.15.102:0/4292210439 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fbfd415d100 0x7fbfd40d35a0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fbfc4009e50 tx=0x7fbfc401c9d0 comp rx=0 tx=0).stop 2023-11-13T11:29:04.406 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:04.311+0000 7fbfda3f5640 1 -- 172.21.15.102:0/4292210439 shutdown_connections 2023-11-13T11:29:04.407 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:04.311+0000 7fbfda3f5640 1 --2- 172.21.15.102:0/4292210439 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fbfd415d100 0x7fbfd40d35a0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:04.407 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:04.311+0000 7fbfda3f5640 1 -- 172.21.15.102:0/4292210439 >> 172.21.15.102:0/4292210439 conn(0x7fbfd409c140 msgr2=0x7fbfd40d2e90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-13T11:29:04.407 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:04.311+0000 7fbfda3f5640 1 -- 172.21.15.102:0/4292210439 shutdown_connections 2023-11-13T11:29:04.408 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:04.311+0000 7fe70bc94640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe70406d2a0 0x7fe7040a89e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:04.408 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:04.311+0000 7fe70bc94640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe7040b2380 0x7fe7041e3e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:04.408 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:04.311+0000 7fe70bc94640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe7040b2ca0 0x7fe7041fa3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:04.409 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:04.311+0000 7fe70bc94640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe704139400 con 0x7fe7040b2380 2023-11-13T11:29:04.409 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:04.311+0000 7fe70bc94640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7041e4730 con 0x7fe7040b2ca0 2023-11-13T11:29:04.409 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:04.311+0000 7fe70bc94640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe7041e4a10 con 0x7fe70406d2a0 2023-11-13T11:29:04.409 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:04.315+0000 7fe70922f640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe7040b2380 0x7fe7041e3e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:04.409 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:04.315+0000 7fe70a231640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe7040b2ca0 0x7fe7041fa3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:04.410 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:04.315+0000 7fe70922f640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe7040b2380 0x7fe7041e3e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:36366/0 (socket says 172.21.15.102:36366) 2023-11-13T11:29:04.410 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:04.315+0000 7fe70922f640 1 -- 172.21.15.102:0/2312090096 learned_addr learned my addr 172.21.15.102:0/2312090096 (peer_addr_for_me v2:172.21.15.102:0/0) 2023-11-13T11:29:04.410 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:04.315+0000 7fe70922f640 1 -- 172.21.15.102:0/2312090096 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe70406d2a0 msgr2=0x7fe7040a89e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:04.410 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:04.315+0000 7fe70922f640 1 --2- 172.21.15.102:0/2312090096 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe70406d2a0 0x7fe7040a89e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:04.410 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:04.315+0000 7fe70922f640 1 -- 172.21.15.102:0/2312090096 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe7040b2ca0 msgr2=0x7fe7041fa3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:04.411 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:04.315+0000 7fe70922f640 1 --2- 172.21.15.102:0/2312090096 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe7040b2ca0 0x7fe7041fa3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:04.411 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:04.315+0000 7fe70922f640 1 -- 172.21.15.102:0/2312090096 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6fc009b30 con 0x7fe7040b2380 2023-11-13T11:29:04.411 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:04.315+0000 7fe70922f640 1 --2- 172.21.15.102:0/2312090096 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe7040b2380 0x7fe7041e3e70 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fe70000d7d0 tx=0x7fe70000dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-13T11:29:04.411 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:04.315+0000 7fbfda3f5640 1 -- 172.21.15.102:0/4292210439 wait complete. 2023-11-13T11:29:04.412 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:04.315+0000 7fe6fa7fc640 1 -- 172.21.15.102:0/2312090096 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe700018070 con 0x7fe7040b2380 2023-11-13T11:29:04.412 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:04.315+0000 7fe70bc94640 1 -- 172.21.15.102:0/2312090096 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe7041e4cf0 con 0x7fe7040b2380 2023-11-13T11:29:04.412 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:04.315+0000 7fe70bc94640 1 -- 172.21.15.102:0/2312090096 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe7041e52b0 con 0x7fe7040b2380 2023-11-13T11:29:04.413 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:04.319+0000 7fe6fa7fc640 1 -- 172.21.15.102:0/2312090096 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe700004020 con 0x7fe7040b2380 2023-11-13T11:29:04.413 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:04.319+0000 7fe6fa7fc640 1 -- 172.21.15.102:0/2312090096 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe700004190 con 0x7fe7040b2380 2023-11-13T11:29:04.413 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:04.319+0000 7fbfda3f5640 1 Processor -- start 2023-11-13T11:29:04.414 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:04.319+0000 7fbfda3f5640 1 -- start start 2023-11-13T11:29:04.414 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:04.319+0000 7fbfda3f5640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbfd40cfe70 0x7fbfd4202140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:04.414 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:04.319+0000 7fbfda3f5640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fbfd40d3ae0 0x7fbfd40b5bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:04.414 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:04.319+0000 7fbfda3f5640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fbfd415d100 0x7fbfd40cbf70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:04.415 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:04.319+0000 7fbfda3f5640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbfd4202680 con 0x7fbfd415d100 2023-11-13T11:29:04.415 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:04.319+0000 7fbfda3f5640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbfd415dd00 con 0x7fbfd40cfe70 2023-11-13T11:29:04.415 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:04.319+0000 7fbfda3f5640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbfd415dfe0 con 0x7fbfd40d3ae0 2023-11-13T11:29:04.415 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:04.323+0000 7fe70bc94640 1 -- 172.21.15.102:0/2312090096 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe6ec005260 con 0x7fe7040b2380 2023-11-13T11:29:04.416 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:04.323+0000 7fe6fa7fc640 1 -- 172.21.15.102:0/2312090096 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fe7000042f0 con 0x7fe7040b2380 2023-11-13T11:29:04.416 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:04.323+0000 7fbfd8992640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fbfd415d100 0x7fbfd40cbf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:04.417 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:04.323+0000 7fbfd8992640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fbfd415d100 0x7fbfd40cbf70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:36374/0 (socket says 172.21.15.102:36374) 2023-11-13T11:29:04.417 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:04.323+0000 7fbfd8992640 1 -- 172.21.15.102:0/3402681894 learned_addr learned my addr 172.21.15.102:0/3402681894 (peer_addr_for_me v2:172.21.15.102:0/0) 2023-11-13T11:29:04.417 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:04.323+0000 7fe6fa7fc640 1 --2- 172.21.15.102:0/2312090096 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7fe6e8066470 0x7fe6e8068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:04.418 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:04.323+0000 7fbfd8992640 1 -- 172.21.15.102:0/3402681894 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fbfd40d3ae0 msgr2=0x7fbfd40b5bd0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-11-13T11:29:04.418 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:04.323+0000 7fbfd8992640 1 --2- 172.21.15.102:0/3402681894 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fbfd40d3ae0 0x7fbfd40b5bd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:04.418 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:04.323+0000 7fbfd8992640 1 -- 172.21.15.102:0/3402681894 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbfd40cfe70 msgr2=0x7fbfd4202140 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-11-13T11:29:04.419 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:04.323+0000 7fbfd8992640 1 --2- 172.21.15.102:0/3402681894 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbfd40cfe70 0x7fbfd4202140 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:04.419 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:04.323+0000 7fbfd8992640 1 -- 172.21.15.102:0/3402681894 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbfc4009b30 con 0x7fbfd415d100 2023-11-13T11:29:04.419 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:04.327+0000 7fbfd8992640 1 --2- 172.21.15.102:0/3402681894 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fbfd415d100 0x7fbfd40cbf70 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fbfcc00c430 tx=0x7fbfcc00c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-13T11:29:04.420 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:04.327+0000 7fe6fa7fc640 1 -- 172.21.15.102:0/2312090096 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe700083e60 con 0x7fe7040b2380 2023-11-13T11:29:04.420 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:04.327+0000 7fe709a30640 1 --2- 172.21.15.102:0/2312090096 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7fe6e8066470 0x7fe6e8068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:04.420 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:04.327+0000 7fe709a30640 1 --2- 172.21.15.102:0/2312090096 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7fe6e8066470 0x7fe6e8068930 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fe6f40015f0 tx=0x7fe6f40079d0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-13T11:29:04.421 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:04.335+0000 7fbfd0ff9640 1 -- 172.21.15.102:0/3402681894 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfcc0052d0 con 0x7fbfd415d100 2023-11-13T11:29:04.421 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:04.335+0000 7fbfd0ff9640 1 -- 172.21.15.102:0/3402681894 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbfcc005430 con 0x7fbfd415d100 2023-11-13T11:29:04.421 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:04.335+0000 7fbfd0ff9640 1 -- 172.21.15.102:0/3402681894 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfcc0052d0 con 0x7fbfd415d100 2023-11-13T11:29:04.421 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:04.335+0000 7fe6fa7fc640 1 -- 172.21.15.102:0/2312090096 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fe700051240 con 0x7fe7040b2380 2023-11-13T11:29:04.422 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:04.335+0000 7fbfda3f5640 1 -- 172.21.15.102:0/3402681894 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbfd415e2c0 con 0x7fbfd415d100 2023-11-13T11:29:04.423 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:04.335+0000 7fbfda3f5640 1 -- 172.21.15.102:0/3402681894 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbfd40b6110 con 0x7fbfd415d100 2023-11-13T11:29:04.423 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:04.335+0000 7fbfda3f5640 1 -- 172.21.15.102:0/3402681894 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbfd4068520 con 0x7fbfd415d100 2023-11-13T11:29:04.423 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:04.339+0000 7fbfd0ff9640 1 -- 172.21.15.102:0/3402681894 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fbfcc003600 con 0x7fbfd415d100 2023-11-13T11:29:04.423 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:04.339+0000 7fbfd0ff9640 1 --2- 172.21.15.102:0/3402681894 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7fbfc00664d0 0x7fbfc0068990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:04.424 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:04.339+0000 7fbfd0ff9640 1 -- 172.21.15.102:0/3402681894 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fbfcc083060 con 0x7fbfd415d100 2023-11-13T11:29:04.424 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:04.339+0000 7fbfd3fff640 1 --2- 172.21.15.102:0/3402681894 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7fbfc00664d0 0x7fbfc0068990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:04.424 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:04.343+0000 7fbfd3fff640 1 --2- 172.21.15.102:0/3402681894 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7fbfc00664d0 0x7fbfc0068990 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fbfc40ae000 tx=0x7fbfc40a7070 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-13T11:29:04.424 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:04.347+0000 7fbfd0ff9640 1 -- 172.21.15.102:0/3402681894 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fbfcc0b4280 con 0x7fbfd415d100 2023-11-13T11:29:04.622 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:04.615+0000 7fae622c8640 1 -- 172.21.15.102:0/583936995 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fae3c005510 con 0x7fae5c071990 2023-11-13T11:29:04.623 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:04.619+0000 7fae59ffb640 1 -- 172.21.15.102:0/583936995 <== mon.1 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fae50018090 con 0x7fae5c071990 2023-11-13T11:29:04.623 INFO:teuthology.orchestra.run.smithi102.stdout:64424509446 2023-11-13T11:29:04.624 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:04.619+0000 7f716ef10640 1 -- 172.21.15.102:0/3690738579 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f71600d8e50 con 0x7f7160033cd0 2023-11-13T11:29:04.624 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:04.619+0000 7f715e7fc640 1 -- 172.21.15.102:0/3690738579 <== mon.2 v2:172.21.15.154:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f71600d8e50 con 0x7f7160033cd0 2023-11-13T11:29:04.625 INFO:teuthology.orchestra.run.smithi102.stdout:64424509445 2023-11-13T11:29:04.628 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:04.623+0000 7f716ef10640 1 -- 172.21.15.102:0/3690738579 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f714c0664c0 msgr2=0x7f714c068980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:04.628 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:04.623+0000 7fae622c8640 1 -- 172.21.15.102:0/583936995 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7fae48066540 msgr2=0x7fae48068a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:04.628 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:04.623+0000 7fae622c8640 1 --2- 172.21.15.102:0/583936995 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7fae48066540 0x7fae48068a00 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fae4c01c720 tx=0x7fae4c0a7000 comp rx=0 tx=0).stop 2023-11-13T11:29:04.629 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:04.623+0000 7fae622c8640 1 -- 172.21.15.102:0/583936995 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fae5c071990 msgr2=0x7fae5c14e730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:04.629 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:04.623+0000 7fae622c8640 1 --2- 172.21.15.102:0/583936995 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fae5c071990 0x7fae5c14e730 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fae5000c560 tx=0x7fae5000c960 comp rx=0 tx=0).stop 2023-11-13T11:29:04.630 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:04.623+0000 7f716ef10640 1 --2- 172.21.15.102:0/3690738579 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f714c0664c0 0x7f714c068980 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f7164009840 tx=0x7f7164008040 comp rx=0 tx=0).stop 2023-11-13T11:29:04.630 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:04.623+0000 7f716ef10640 1 -- 172.21.15.102:0/3690738579 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7160033cd0 msgr2=0x7f71600ed180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:04.630 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:04.623+0000 7f716ef10640 1 --2- 172.21.15.102:0/3690738579 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7160033cd0 0x7f71600ed180 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f7168000b70 tx=0x7f7168093830 comp rx=0 tx=0).stop 2023-11-13T11:29:04.630 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:04.623+0000 7f716ef10640 1 -- 172.21.15.102:0/3690738579 shutdown_connections 2023-11-13T11:29:04.631 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:04.623+0000 7f716ef10640 1 --2- 172.21.15.102:0/3690738579 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7160033cd0 0x7f71600ed180 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:04.631 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:04.623+0000 7f716ef10640 1 --2- 172.21.15.102:0/3690738579 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f716000aab0 0x7f71600dc0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:04.631 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:04.623+0000 7f716ef10640 1 --2- 172.21.15.102:0/3690738579 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f714c0664c0 0x7f714c068980 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:04.631 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:04.623+0000 7f716ef10640 1 --2- 172.21.15.102:0/3690738579 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7160007520 0x7f7160188750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:04.631 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:04.623+0000 7f716ef10640 1 -- 172.21.15.102:0/3690738579 >> 172.21.15.102:0/3690738579 conn(0x7f7160009f90 msgr2=0x7f71600399f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-13T11:29:04.632 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:04.623+0000 7f716ef10640 1 -- 172.21.15.102:0/3690738579 shutdown_connections 2023-11-13T11:29:04.632 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:04.623+0000 7f716ef10640 1 -- 172.21.15.102:0/3690738579 wait complete. 2023-11-13T11:29:04.632 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:04.623+0000 7fae622c8640 1 -- 172.21.15.102:0/583936995 shutdown_connections 2023-11-13T11:29:04.633 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:04.623+0000 7fae622c8640 1 --2- 172.21.15.102:0/583936995 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7fae48066540 0x7fae48068a00 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:04.633 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:04.623+0000 7fae622c8640 1 --2- 172.21.15.102:0/583936995 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fae5c1647c0 0x7fae5c1632f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:04.633 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:04.623+0000 7fae622c8640 1 --2- 172.21.15.102:0/583936995 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fae5c071990 0x7fae5c14e730 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:04.633 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:04.623+0000 7fae622c8640 1 --2- 172.21.15.102:0/583936995 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fae5c070590 0x7fae5c14d940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:04.634 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:04.623+0000 7fae622c8640 1 -- 172.21.15.102:0/583936995 >> 172.21.15.102:0/583936995 conn(0x7fae5c0b0690 msgr2=0x7fae5c161a50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-13T11:29:04.634 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:04.623+0000 7fae622c8640 1 -- 172.21.15.102:0/583936995 shutdown_connections 2023-11-13T11:29:04.634 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:04.623+0000 7fae622c8640 1 -- 172.21.15.102:0/583936995 wait complete. 2023-11-13T11:29:04.635 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:04.631+0000 7f22bad3e640 1 -- 172.21.15.102:0/2785464933 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7f22b415c930 con 0x7f22b40d3ae0 2023-11-13T11:29:04.635 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:04.631+0000 7f22b1ffb640 1 -- 172.21.15.102:0/2785464933 <== mon.2 v2:172.21.15.154:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f22a40545c0 con 0x7f22b40d3ae0 2023-11-13T11:29:04.637 INFO:teuthology.orchestra.run.smithi102.stdout:64424509445 2023-11-13T11:29:04.638 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:04.631+0000 7f923da94640 1 -- 172.21.15.102:0/1744308205 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f92381f8070 con 0x7f9220005190 2023-11-13T11:29:04.638 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:04.631+0000 7f921ffff640 1 -- 172.21.15.102:0/1744308205 <== mon.2 v2:172.21.15.154:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f92381f8070 con 0x7f9220005190 2023-11-13T11:29:04.639 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:04.635+0000 7fc79bb57640 1 -- 172.21.15.102:0/996071900 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fc79406dee0 con 0x7fc7940cc0e0 2023-11-13T11:29:04.639 INFO:teuthology.orchestra.run.smithi102.stdout:64424509445 2023-11-13T11:29:04.640 INFO:teuthology.orchestra.run.smithi102.stdout:64424509446 2023-11-13T11:29:04.640 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:04.635+0000 7fc78a7fc640 1 -- 172.21.15.102:0/996071900 <== mon.0 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fc7840c6020 con 0x7fc7940cc0e0 2023-11-13T11:29:04.641 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:04.635+0000 7f22bad3e640 1 -- 172.21.15.102:0/2785464933 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f22940664a0 msgr2=0x7f2294068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:04.641 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:04.635+0000 7f22bad3e640 1 --2- 172.21.15.102:0/2785464933 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f22940664a0 0x7f2294068960 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f229c01cd80 tx=0x7f229c0a6000 comp rx=0 tx=0).stop 2023-11-13T11:29:04.641 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:04.635+0000 7f22bad3e640 1 -- 172.21.15.102:0/2785464933 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f22b40d3ae0 msgr2=0x7f22b415ed40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:04.641 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:04.635+0000 7f22bad3e640 1 --2- 172.21.15.102:0/2785464933 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f22b40d3ae0 0x7f22b415ed40 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f22a400b3c0 tx=0x7f22a400b880 comp rx=0 tx=0).stop 2023-11-13T11:29:04.642 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:04.635+0000 7f22bad3e640 1 -- 172.21.15.102:0/2785464933 shutdown_connections 2023-11-13T11:29:04.642 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:04.635+0000 7f22bad3e640 1 --2- 172.21.15.102:0/2785464933 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f22b415d100 0x7f22b40cc300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:04.643 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:04.635+0000 7f22bad3e640 1 --2- 172.21.15.102:0/2785464933 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f22b40d3ae0 0x7f22b415ed40 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:04.643 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:04.635+0000 7f22bad3e640 1 --2- 172.21.15.102:0/2785464933 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f22940664a0 0x7f2294068960 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:04.643 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:04.635+0000 7f22bad3e640 1 --2- 172.21.15.102:0/2785464933 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f22b40cfe70 0x7f22b414e4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:04.643 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:04.635+0000 7f22bad3e640 1 -- 172.21.15.102:0/2785464933 >> 172.21.15.102:0/2785464933 conn(0x7f22b409c140 msgr2=0x7f22b40afb80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-13T11:29:04.644 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:04.635+0000 7f22bad3e640 1 -- 172.21.15.102:0/2785464933 shutdown_connections 2023-11-13T11:29:04.644 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:04.635+0000 7f22bad3e640 1 -- 172.21.15.102:0/2785464933 wait complete. 2023-11-13T11:29:04.644 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:04.639+0000 7f923da94640 1 -- 172.21.15.102:0/1744308205 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f92240664f0 msgr2=0x7f92240689b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:04.645 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:04.639+0000 7f923da94640 1 --2- 172.21.15.102:0/1744308205 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f92240664f0 0x7f92240689b0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f922c001000 tx=0x7f922c009040 comp rx=0 tx=0).stop 2023-11-13T11:29:04.645 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:04.639+0000 7f923da94640 1 -- 172.21.15.102:0/1744308205 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9220005190 msgr2=0x7f9238146d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:04.645 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:04.639+0000 7f923da94640 1 --2- 172.21.15.102:0/1744308205 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9220005190 0x7f9238146d30 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f922800e820 tx=0x7f922800ece0 comp rx=0 tx=0).stop 2023-11-13T11:29:04.645 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:04.639+0000 7f923da94640 1 -- 172.21.15.102:0/1744308205 shutdown_connections 2023-11-13T11:29:04.646 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:04.639+0000 7fc79bb57640 1 -- 172.21.15.102:0/996071900 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7fc7780664c0 msgr2=0x7fc778068980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:04.646 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:04.639+0000 7fc79bb57640 1 --2- 172.21.15.102:0/996071900 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7fc7780664c0 0x7fc778068980 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fc78c007fd0 tx=0x7fc78c007d40 comp rx=0 tx=0).stop 2023-11-13T11:29:04.646 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:04.639+0000 7fc79bb57640 1 -- 172.21.15.102:0/996071900 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc7940cc0e0 msgr2=0x7fc79415ef80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:04.646 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:04.639+0000 7fc79bb57640 1 --2- 172.21.15.102:0/996071900 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc7940cc0e0 0x7fc79415ef80 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fc784024170 tx=0x7fc784024300 comp rx=0 tx=0).stop 2023-11-13T11:29:04.647 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:04.639+0000 7f923da94640 1 --2- 172.21.15.102:0/1744308205 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9238148cc0 0x7f9238149140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:04.647 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:04.639+0000 7f923da94640 1 --2- 172.21.15.102:0/1744308205 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f92240664f0 0x7f92240689b0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:04.647 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:04.639+0000 7f923da94640 1 --2- 172.21.15.102:0/1744308205 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f92381ebd10 0x7f92381f7710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:04.647 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:04.639+0000 7f923da94640 1 --2- 172.21.15.102:0/1744308205 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9220005190 0x7f9238146d30 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:04.648 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:04.639+0000 7f923da94640 1 -- 172.21.15.102:0/1744308205 >> 172.21.15.102:0/1744308205 conn(0x7f92380b0870 msgr2=0x7f92380b2760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-13T11:29:04.648 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:04.639+0000 7fc79bb57640 1 -- 172.21.15.102:0/996071900 shutdown_connections 2023-11-13T11:29:04.648 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:04.639+0000 7fc79bb57640 1 --2- 172.21.15.102:0/996071900 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc7940cd9d0 0x7fc794149d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:04.649 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:04.639+0000 7fc79bb57640 1 --2- 172.21.15.102:0/996071900 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7fc7780664c0 0x7fc778068980 secure :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fc78c007fd0 tx=0x7fc78c007d40 comp rx=0 tx=0).stop 2023-11-13T11:29:04.649 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:04.639+0000 7fc79bb57640 1 --2- 172.21.15.102:0/996071900 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc7940cc0e0 0x7fc79415ef80 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:04.649 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:04.639+0000 7fc79bb57640 1 --2- 172.21.15.102:0/996071900 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc7940b3510 0x7fc7941524a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:04.649 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:04.639+0000 7fc79bb57640 1 -- 172.21.15.102:0/996071900 >> 172.21.15.102:0/996071900 conn(0x7fc7940cb5c0 msgr2=0x7fc7940ae7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-13T11:29:04.650 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:04.639+0000 7f923da94640 1 -- 172.21.15.102:0/1744308205 shutdown_connections 2023-11-13T11:29:04.650 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:04.639+0000 7f923da94640 1 -- 172.21.15.102:0/1744308205 wait complete. 2023-11-13T11:29:04.650 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:04.639+0000 7fc79bb57640 1 -- 172.21.15.102:0/996071900 shutdown_connections 2023-11-13T11:29:04.652 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:04.639+0000 7fc79bb57640 1 -- 172.21.15.102:0/996071900 wait complete. 2023-11-13T11:29:04.653 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:04.643+0000 7efce9d1d640 1 -- 172.21.15.102:0/388437651 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7efcc80057e0 con 0x7efce41591f0 2023-11-13T11:29:04.653 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:04.643+0000 7efce0ff9640 1 -- 172.21.15.102:0/388437651 <== mon.1 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7efcdc017020 con 0x7efce41591f0 2023-11-13T11:29:04.653 INFO:teuthology.orchestra.run.smithi102.stdout:64424509445 2023-11-13T11:29:04.655 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:04.651+0000 7efce9d1d640 1 -- 172.21.15.102:0/388437651 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7efcc4066540 msgr2=0x7efcc4068a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:04.655 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:04.651+0000 7efce9d1d640 1 --2- 172.21.15.102:0/388437651 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7efcc4066540 0x7efcc4068a00 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7efccc0098a0 tx=0x7efccc008040 comp rx=0 tx=0).stop 2023-11-13T11:29:04.655 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:04.651+0000 7efce9d1d640 1 -- 172.21.15.102:0/388437651 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efce41591f0 msgr2=0x7efce415b1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:04.656 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:04.651+0000 7efce9d1d640 1 --2- 172.21.15.102:0/388437651 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efce41591f0 0x7efce415b1c0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7efcdc00c780 tx=0x7efcdc00cc40 comp rx=0 tx=0).stop 2023-11-13T11:29:04.657 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:04.651+0000 7efce9d1d640 1 -- 172.21.15.102:0/388437651 shutdown_connections 2023-11-13T11:29:04.657 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:04.651+0000 7efce9d1d640 1 --2- 172.21.15.102:0/388437651 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efce41591f0 0x7efce415b1c0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:04.657 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:04.651+0000 7efce9d1d640 1 --2- 172.21.15.102:0/388437651 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7efce40ce0e0 0x7efce414e930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:04.657 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:04.651+0000 7efce9d1d640 1 --2- 172.21.15.102:0/388437651 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7efcc4066540 0x7efcc4068a00 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:04.658 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:04.651+0000 7efce9d1d640 1 --2- 172.21.15.102:0/388437651 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7efce406fd10 0x7efce41467c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:04.658 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:04.651+0000 7efce9d1d640 1 -- 172.21.15.102:0/388437651 >> 172.21.15.102:0/388437651 conn(0x7efce40cb5c0 msgr2=0x7efce40cc9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-13T11:29:04.658 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:04.651+0000 7efce9d1d640 1 -- 172.21.15.102:0/388437651 shutdown_connections 2023-11-13T11:29:04.658 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:04.651+0000 7efce9d1d640 1 -- 172.21.15.102:0/388437651 wait complete. 2023-11-13T11:29:04.663 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509446 got 64424509445 for osd.2 2023-11-13T11:29:04.665 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:04.659+0000 7fe70bc94640 1 -- 172.21.15.102:0/2312090096 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7fe6ec005510 con 0x7fe7040b2380 2023-11-13T11:29:04.666 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:04.659+0000 7fe6fa7fc640 1 -- 172.21.15.102:0/2312090096 <== mon.0 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fe700054860 con 0x7fe7040b2380 2023-11-13T11:29:04.669 INFO:teuthology.orchestra.run.smithi102.stdout:64424509444 2023-11-13T11:29:04.670 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:04.663+0000 7fe70bc94640 1 -- 172.21.15.102:0/2312090096 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7fe6e8066470 msgr2=0x7fe6e8068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:04.671 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:04.663+0000 7fe70bc94640 1 --2- 172.21.15.102:0/2312090096 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7fe6e8066470 0x7fe6e8068930 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fe6f40015f0 tx=0x7fe6f40079d0 comp rx=0 tx=0).stop 2023-11-13T11:29:04.671 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:04.667+0000 7fe70bc94640 1 -- 172.21.15.102:0/2312090096 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe7040b2380 msgr2=0x7fe7041e3e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:04.671 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:04.667+0000 7fbfda3f5640 1 -- 172.21.15.102:0/3402681894 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7fbfd415e770 con 0x7fbfd415d100 2023-11-13T11:29:04.672 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:04.667+0000 7fe70bc94640 1 --2- 172.21.15.102:0/2312090096 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe7040b2380 0x7fe7041e3e70 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fe70000d7d0 tx=0x7fe70000dc90 comp rx=0 tx=0).stop 2023-11-13T11:29:04.673 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:04.667+0000 7fe70bc94640 1 -- 172.21.15.102:0/2312090096 shutdown_connections 2023-11-13T11:29:04.673 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:04.667+0000 7fe70bc94640 1 --2- 172.21.15.102:0/2312090096 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe7040b2ca0 0x7fe7041fa3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:04.673 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:04.667+0000 7fe70bc94640 1 --2- 172.21.15.102:0/2312090096 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7fe6e8066470 0x7fe6e8068930 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:04.673 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:04.667+0000 7fe70bc94640 1 --2- 172.21.15.102:0/2312090096 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe7040b2380 0x7fe7041e3e70 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:04.674 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:04.667+0000 7fe70bc94640 1 --2- 172.21.15.102:0/2312090096 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe70406d2a0 0x7fe7040a89e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:04.674 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:04.667+0000 7fe70bc94640 1 -- 172.21.15.102:0/2312090096 >> 172.21.15.102:0/2312090096 conn(0x7fe7040b0870 msgr2=0x7fe7040afe50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-13T11:29:04.674 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:04.667+0000 7fe70bc94640 1 -- 172.21.15.102:0/2312090096 shutdown_connections 2023-11-13T11:29:04.674 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:04.667+0000 7fe70bc94640 1 -- 172.21.15.102:0/2312090096 wait complete. 2023-11-13T11:29:04.675 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:04.667+0000 7fbfd0ff9640 1 -- 172.21.15.102:0/3402681894 <== mon.0 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fbfcc050470 con 0x7fbfd415d100 2023-11-13T11:29:04.675 INFO:teuthology.orchestra.run.smithi102.stdout:60129542149 2023-11-13T11:29:04.676 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:04.671+0000 7fbfda3f5640 1 -- 172.21.15.102:0/3402681894 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7fbfc00664d0 msgr2=0x7fbfc0068990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:04.676 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:04.671+0000 7fbfda3f5640 1 --2- 172.21.15.102:0/3402681894 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7fbfc00664d0 0x7fbfc0068990 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fbfc40ae000 tx=0x7fbfc40a7070 comp rx=0 tx=0).stop 2023-11-13T11:29:04.676 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:04.671+0000 7fbfda3f5640 1 -- 172.21.15.102:0/3402681894 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fbfd415d100 msgr2=0x7fbfd40cbf70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:04.676 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:04.671+0000 7fbfda3f5640 1 --2- 172.21.15.102:0/3402681894 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fbfd415d100 0x7fbfd40cbf70 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fbfcc00c430 tx=0x7fbfcc00c8f0 comp rx=0 tx=0).stop 2023-11-13T11:29:04.677 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:04.671+0000 7fbfda3f5640 1 -- 172.21.15.102:0/3402681894 shutdown_connections 2023-11-13T11:29:04.677 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:04.671+0000 7fbfda3f5640 1 --2- 172.21.15.102:0/3402681894 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7fbfc00664d0 0x7fbfc0068990 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:04.677 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:04.671+0000 7fbfda3f5640 1 --2- 172.21.15.102:0/3402681894 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fbfd415d100 0x7fbfd40cbf70 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:04.677 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:04.671+0000 7fbfda3f5640 1 --2- 172.21.15.102:0/3402681894 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fbfd40d3ae0 0x7fbfd40b5bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:04.678 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:04.671+0000 7fbfda3f5640 1 --2- 172.21.15.102:0/3402681894 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbfd40cfe70 0x7fbfd4202140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:04.678 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:04.671+0000 7fbfda3f5640 1 -- 172.21.15.102:0/3402681894 >> 172.21.15.102:0/3402681894 conn(0x7fbfd409c140 msgr2=0x7fbfd40afd10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-13T11:29:04.678 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:04.671+0000 7fbfda3f5640 1 -- 172.21.15.102:0/3402681894 shutdown_connections 2023-11-13T11:29:04.678 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:04.671+0000 7fbfda3f5640 1 -- 172.21.15.102:0/3402681894 wait complete. 2023-11-13T11:29:04.679 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509447 got 64424509446 for osd.0 2023-11-13T11:29:04.683 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509446 got 64424509445 for osd.3 2023-11-13T11:29:04.684 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509447 got 64424509446 for osd.1 2023-11-13T11:29:04.686 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509446 got 64424509445 for osd.6 2023-11-13T11:29:04.693 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509446 got 64424509445 for osd.5 2023-11-13T11:29:04.703 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509445 got 64424509444 for osd.4 2023-11-13T11:29:04.704 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542150 got 60129542149 for osd.7 2023-11-13T11:29:05.664 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-11-13T11:29:05.680 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-11-13T11:29:05.684 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-11-13T11:29:05.684 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-11-13T11:29:05.686 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2023-11-13T11:29:05.694 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2023-11-13T11:29:05.704 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2023-11-13T11:29:05.705 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2023-11-13T11:29:05.875 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:05.871+0000 7fd91359e640 1 Processor -- start 2023-11-13T11:29:05.875 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:05.871+0000 7fd91359e640 1 -- start start 2023-11-13T11:29:05.877 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:05.871+0000 7fd91359e640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7fd9140ce440 0x7fd9140cc140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:05.885 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:05.871+0000 7fd91259c640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7fd9140ce440 0x7fd9140cc140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:05.885 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:05.871+0000 7fd91259c640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7fd9140ce440 0x7fd9140cc140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:36390/0 (socket says 172.21.15.102:36390) 2023-11-13T11:29:05.885 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:05.871+0000 7fd91259c640 1 -- 172.21.15.102:0/3798999979 learned_addr learned my addr 172.21.15.102:0/3798999979 (peer_addr_for_me v2:172.21.15.102:0/0) 2023-11-13T11:29:05.886 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:05.875+0000 7fd91359e640 1 -- 172.21.15.102:0/3798999979 --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd91406d550 con 0x7fd9140b26f0 2023-11-13T11:29:05.886 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:05.875+0000 7fd91359e640 1 -- 172.21.15.102:0/3798999979 --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd91406fbe0 con 0x7fd9140b2fc0 2023-11-13T11:29:05.886 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:05.875+0000 7fd91359e640 1 -- 172.21.15.102:0/3798999979 --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd91406fec0 con 0x7fd9140ce440 2023-11-13T11:29:05.886 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:05.875+0000 7fd911d9b640 1 -- 172.21.15.102:0/3798999979 <== mon.0 v1:172.21.15.102:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1730576063 0 0) 0x7fd91406d550 con 0x7fd9140b26f0 2023-11-13T11:29:05.886 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:05.875+0000 7fd911d9b640 1 -- 172.21.15.102:0/3798999979 --> v1:172.21.15.102:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd8f4003530 con 0x7fd9140b26f0 2023-11-13T11:29:05.887 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:05.875+0000 7fd91259c640 1 -- 172.21.15.102:0/3798999979 >> v1:172.21.15.154:6789/0 conn(0x7fd9140b2fc0 legacy=0x7fd914070c80 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-11-13T11:29:05.887 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:05.875+0000 7fd91259c640 1 -- 172.21.15.102:0/3798999979 >> v1:172.21.15.102:6789/0 conn(0x7fd9140b26f0 legacy=0x7fd91406ce40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:05.887 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:05.875+0000 7fd91259c640 1 -- 172.21.15.102:0/3798999979 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9140701a0 con 0x7fd9140ce440 2023-11-13T11:29:05.888 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:05.879+0000 7fd91259c640 1 --2- 172.21.15.102:0/3798999979 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd9140ce440 0x7fd9140cc140 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fd8fc009e50 tx=0x7fd8fc01d240 comp rx=0 tx=0).ready entity=mon.0 client_cookie=399cd23566e6e25c server_cookie=0 in_seq=0 out_seq=0 2023-11-13T11:29:05.889 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:05.879+0000 7fd911d9b640 1 -- 172.21.15.102:0/3798999979 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8fc0ac400 con 0x7fd9140ce440 2023-11-13T11:29:05.889 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:05.879+0000 7fd911d9b640 1 -- 172.21.15.102:0/3798999979 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd8fc0a8050 con 0x7fd9140ce440 2023-11-13T11:29:05.889 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:05.879+0000 7fd911d9b640 1 -- 172.21.15.102:0/3798999979 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8fc0ac7c0 con 0x7fd9140ce440 2023-11-13T11:29:05.889 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:05.883+0000 7fd91359e640 1 -- 172.21.15.102:0/3798999979 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd9140ce440 msgr2=0x7fd9140cc140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:05.889 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:05.883+0000 7fd91359e640 1 --2- 172.21.15.102:0/3798999979 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd9140ce440 0x7fd9140cc140 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fd8fc009e50 tx=0x7fd8fc01d240 comp rx=0 tx=0).stop 2023-11-13T11:29:05.890 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:05.883+0000 7fd91359e640 1 -- 172.21.15.102:0/3798999979 shutdown_connections 2023-11-13T11:29:05.890 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:05.883+0000 7fd91359e640 1 --2- 172.21.15.102:0/3798999979 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd9140ce440 0x7fd9140cc140 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:05.890 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:05.883+0000 7fd91359e640 1 -- 172.21.15.102:0/3798999979 >> 172.21.15.102:0/3798999979 conn(0x7fd91406a240 msgr2=0x7fd91406a650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-13T11:29:05.890 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:05.883+0000 7fd91359e640 1 -- 172.21.15.102:0/3798999979 shutdown_connections 2023-11-13T11:29:05.890 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:05.883+0000 7fd91359e640 1 -- 172.21.15.102:0/3798999979 wait complete. 2023-11-13T11:29:05.891 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:05.887+0000 7fd91359e640 1 Processor -- start 2023-11-13T11:29:05.892 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:05.887+0000 7fd91359e640 1 -- start start 2023-11-13T11:29:05.894 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:05.887+0000 7fd91359e640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd9140b26f0 0x7fd914137560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:05.894 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:05.887+0000 7fd91359e640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd9140b2fc0 0x7fd91414e6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:05.896 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:05.891+0000 7fd91359e640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd9140ce440 0x7fd91414cbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:05.896 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:05.891+0000 7fd909d9b640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd9140b2fc0 0x7fd91414e6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:05.896 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:05.891+0000 7fd909d9b640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd9140b2fc0 0x7fd91414e6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.102:56422/0 (socket says 172.21.15.102:56422) 2023-11-13T11:29:05.897 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:05.891+0000 7fd909d9b640 1 -- 172.21.15.102:0/1278109778 learned_addr learned my addr 172.21.15.102:0/1278109778 (peer_addr_for_me v2:172.21.15.102:0/0) 2023-11-13T11:29:05.897 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:05.891+0000 7fd91359e640 1 -- 172.21.15.102:0/1278109778 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd91414ebe0 con 0x7fd9140ce440 2023-11-13T11:29:05.897 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:05.891+0000 7fd91359e640 1 -- 172.21.15.102:0/1278109778 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd91414d600 con 0x7fd9140b2fc0 2023-11-13T11:29:05.897 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:05.891+0000 7fd91359e640 1 -- 172.21.15.102:0/1278109778 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd91414d8e0 con 0x7fd9140b26f0 2023-11-13T11:29:05.897 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:05.891+0000 7fd912d9d640 1 --2- 172.21.15.102:0/1278109778 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd9140ce440 0x7fd91414cbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:05.898 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:05.891+0000 7fd912d9d640 1 -- 172.21.15.102:0/1278109778 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd9140b26f0 msgr2=0x7fd914137560 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-11-13T11:29:05.899 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:05.891+0000 7fd912d9d640 1 --2- 172.21.15.102:0/1278109778 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd9140b26f0 0x7fd914137560 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:05.899 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:05.891+0000 7fd912d9d640 1 -- 172.21.15.102:0/1278109778 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd9140b2fc0 msgr2=0x7fd91414e6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:05.899 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:05.891+0000 7fd912d9d640 1 --2- 172.21.15.102:0/1278109778 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd9140b2fc0 0x7fd91414e6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:05.899 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:05.891+0000 7fd912d9d640 1 -- 172.21.15.102:0/1278109778 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8fc009b30 con 0x7fd9140ce440 2023-11-13T11:29:05.899 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:05.891+0000 7fd912d9d640 1 --2- 172.21.15.102:0/1278109778 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd9140ce440 0x7fd91414cbb0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fd90c00b410 tx=0x7fd90c00b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-13T11:29:05.900 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:05.895+0000 7fd90b7fe640 1 -- 172.21.15.102:0/1278109778 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd90c011830 con 0x7fd9140ce440 2023-11-13T11:29:05.900 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:05.895+0000 7fd90b7fe640 1 -- 172.21.15.102:0/1278109778 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd90c011990 con 0x7fd9140ce440 2023-11-13T11:29:05.900 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:05.895+0000 7fd90b7fe640 1 -- 172.21.15.102:0/1278109778 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd90c011d40 con 0x7fd9140ce440 2023-11-13T11:29:05.900 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:05.895+0000 7fd909d9b640 1 --2- 172.21.15.102:0/1278109778 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd9140b2fc0 0x7fd91414e6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-13T11:29:05.901 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:05.895+0000 7fd91359e640 1 -- 172.21.15.102:0/1278109778 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd91414dbc0 con 0x7fd9140ce440 2023-11-13T11:29:05.901 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:05.895+0000 7fd91359e640 1 -- 172.21.15.102:0/1278109778 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd91414e180 con 0x7fd9140ce440 2023-11-13T11:29:05.902 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:05.899+0000 7fd91359e640 1 -- 172.21.15.102:0/1278109778 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd914067370 con 0x7fd9140ce440 2023-11-13T11:29:05.906 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:05.899+0000 7fd90b7fe640 1 -- 172.21.15.102:0/1278109778 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fd90c01a400 con 0x7fd9140ce440 2023-11-13T11:29:05.907 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:05.899+0000 7fd90b7fe640 1 --2- 172.21.15.102:0/1278109778 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7fd8f8066470 0x7fd8f8068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:05.908 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:05.903+0000 7fd90b7fe640 1 -- 172.21.15.102:0/1278109778 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd90c0557e0 con 0x7fd9140ce440 2023-11-13T11:29:05.911 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:05.907+0000 7fd91259c640 1 --2- 172.21.15.102:0/1278109778 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7fd8f8066470 0x7fd8f8068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:05.912 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:05.907+0000 7fd91259c640 1 --2- 172.21.15.102:0/1278109778 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7fd8f8066470 0x7fd8f8068930 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fd9140724b0 tx=0x7fd8fc0a7000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-13T11:29:05.916 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:05.911+0000 7fd90b7fe640 1 -- 172.21.15.102:0/1278109778 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fd90c051bb0 con 0x7fd9140ce440 2023-11-13T11:29:05.955 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:05.951+0000 7f99311f8640 1 Processor -- start 2023-11-13T11:29:05.955 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:05.951+0000 7f99311f8640 1 -- start start 2023-11-13T11:29:05.958 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:05.951+0000 7f99311f8640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f992c15d060 0x7f992c06cec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:05.959 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:05.951+0000 7f99311f8640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f992c06dfe0 con 0x7f992c070e10 2023-11-13T11:29:05.959 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:05.951+0000 7f99311f8640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f992c06d5c0 con 0x7f992c06fb60 2023-11-13T11:29:05.959 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:05.951+0000 7f99311f8640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f992c06d8a0 con 0x7f992c15d060 2023-11-13T11:29:05.959 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:05.951+0000 7f992ad9d640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f992c15d060 0x7f992c06cec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:05.960 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:05.951+0000 7f992a59c640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f992c06fb60 0x7f992c070700 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.102:52496/0 (socket says 172.21.15.102:52496) 2023-11-13T11:29:05.960 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:05.951+0000 7f992a59c640 1 -- 172.21.15.102:0/1586711247 learned_addr learned my addr 172.21.15.102:0/1586711247 (peer_addr_for_me v1:172.21.15.102:0/0) 2023-11-13T11:29:05.960 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:05.951+0000 7f9929d9b640 1 -- 172.21.15.102:0/1586711247 <== mon.1 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1697819884 0 0) 0x7f992c06d5c0 con 0x7f992c06fb60 2023-11-13T11:29:05.960 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:05.951+0000 7f9929d9b640 1 -- 172.21.15.102:0/1586711247 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9918003530 con 0x7f992c06fb60 2023-11-13T11:29:05.960 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:05.951+0000 7f992ad9d640 1 -- 172.21.15.102:0/1586711247 >> v1:172.21.15.154:6789/0 conn(0x7f992c06fb60 legacy=0x7f992c070700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:05.961 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:05.951+0000 7f992ad9d640 1 -- 172.21.15.102:0/1586711247 >> v1:172.21.15.102:6789/0 conn(0x7f992c070e10 legacy=0x7f992c0b2b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:05.961 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:05.955+0000 7f992ad9d640 1 -- 172.21.15.102:0/1586711247 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f992c0b2070 con 0x7f992c15d060 2023-11-13T11:29:05.961 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:05.955+0000 7f32378c9640 1 Processor -- start 2023-11-13T11:29:05.962 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:05.955+0000 7f32378c9640 1 -- start start 2023-11-13T11:29:05.962 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:05.955+0000 7f44c2df5640 1 Processor -- start 2023-11-13T11:29:05.963 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:05.955+0000 7f32378c9640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f323015d1a0 0x7f323006dfe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:05.963 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:05.955+0000 7f32378c9640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3230071cf0 con 0x7f32300718a0 2023-11-13T11:29:05.963 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:05.955+0000 7f32378c9640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f32300ad2b0 con 0x7f32300cd9d0 2023-11-13T11:29:05.963 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:05.955+0000 7f32378c9640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f32300ade30 con 0x7f323015d1a0 2023-11-13T11:29:05.964 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:05.959+0000 7f44c2df5640 1 -- start start 2023-11-13T11:29:05.964 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:05.959+0000 7f3234e64640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f32300cd9d0 0x7f32300b1c50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.102:52506/0 (socket says 172.21.15.102:52506) 2023-11-13T11:29:05.965 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:05.959+0000 7f3234e64640 1 -- 172.21.15.102:0/3120409127 learned_addr learned my addr 172.21.15.102:0/3120409127 (peer_addr_for_me v1:172.21.15.102:0/0) 2023-11-13T11:29:05.965 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:05.959+0000 7f3235665640 1 --2- 172.21.15.102:0/3120409127 >> v2:172.21.15.102:3300/0 conn(0x7f323015d1a0 0x7f323006dfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:05.965 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:05.959+0000 7f322ffff640 1 -- 172.21.15.102:0/3120409127 <== mon.1 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1488635493 0 0) 0x7f32300ad2b0 con 0x7f32300cd9d0 2023-11-13T11:29:05.965 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:05.959+0000 7f322ffff640 1 -- 172.21.15.102:0/3120409127 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3218003530 con 0x7f32300cd9d0 2023-11-13T11:29:05.966 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:05.959+0000 7f5be9232640 1 Processor -- start 2023-11-13T11:29:05.966 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:05.959+0000 7f3235665640 1 -- 172.21.15.102:0/3120409127 >> v1:172.21.15.154:6789/0 conn(0x7f32300cd9d0 legacy=0x7f32300b1c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:05.967 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:05.959+0000 7f3235665640 1 -- 172.21.15.102:0/3120409127 >> v1:172.21.15.102:6789/0 conn(0x7f32300718a0 legacy=0x7f32300b2360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-13T11:29:05.968 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:05.959+0000 7f992ad9d640 1 --2- 172.21.15.102:0/1586711247 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f992c15d060 0x7f992c06cec0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f99240097f0 tx=0x7f9924024c60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5ece14145bd9b345 server_cookie=0 in_seq=0 out_seq=0 2023-11-13T11:29:05.968 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:05.959+0000 7f5be9232640 1 -- start start 2023-11-13T11:29:05.968 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:05.959+0000 7f9929d9b640 1 -- 172.21.15.102:0/1586711247 <== mon.2 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99240adc00 con 0x7f992c15d060 2023-11-13T11:29:05.969 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:05.959+0000 7f9929d9b640 1 -- 172.21.15.102:0/1586711247 <== mon.2 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f99240add60 con 0x7f992c15d060 2023-11-13T11:29:05.969 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:05.959+0000 7f9929d9b640 1 -- 172.21.15.102:0/1586711247 <== mon.2 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99240b5660 con 0x7f992c15d060 2023-11-13T11:29:05.970 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:05.959+0000 7f44c2df5640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f44bc0b3a30 0x7f44bc070d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:05.970 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:05.959+0000 7f44c2df5640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f44bc0cd9d0 0x7f44bc0cde80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:05.970 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:05.959+0000 7f44c2df5640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f44bc0708e0 con 0x7f44bc1404d0 2023-11-13T11:29:05.971 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:05.959+0000 7f99311f8640 1 -- 172.21.15.102:0/1586711247 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f992c15d060 msgr2=0x7f992c06cec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:05.971 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:05.959+0000 7f99311f8640 1 --2- 172.21.15.102:0/1586711247 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f992c15d060 0x7f992c06cec0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f99240097f0 tx=0x7f9924024c60 comp rx=0 tx=0).stop 2023-11-13T11:29:05.971 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:05.959+0000 7f44c1392640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f44bc0cd9d0 0x7f44bc0cde80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:05.972 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:05.963+0000 7f44c2df5640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f44bc0ce3c0 con 0x7f44bc0cd9d0 2023-11-13T11:29:05.972 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:05.963+0000 7f3235665640 1 -- 172.21.15.102:0/3120409127 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32300ad500 con 0x7f323015d1a0 2023-11-13T11:29:05.973 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:05.963+0000 7f44c1392640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f44bc0cd9d0 0x7f44bc0cde80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:36424/0 (socket says 172.21.15.102:36424) 2023-11-13T11:29:05.973 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:05.963+0000 7f44c1392640 1 -- 172.21.15.102:0/980408798 learned_addr learned my addr 172.21.15.102:0/980408798 (peer_addr_for_me v2:172.21.15.102:0/0) 2023-11-13T11:29:05.973 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:05.963+0000 7f44c2df5640 1 -- 172.21.15.102:0/980408798 --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f44bc071f70 con 0x7f44bc0b3a30 2023-11-13T11:29:05.973 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:05.963+0000 7f44c0b91640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f44bc1404d0 0x7f44bc071860 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.102:52514/0 (socket says 172.21.15.102:52514) 2023-11-13T11:29:05.974 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:05.963+0000 7f99311f8640 1 -- 172.21.15.102:0/1586711247 shutdown_connections 2023-11-13T11:29:05.974 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:05.963+0000 7f99311f8640 1 --2- 172.21.15.102:0/1586711247 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f992c15d060 0x7f992c06cec0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:05.974 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:05.963+0000 7f99311f8640 1 -- 172.21.15.102:0/1586711247 >> 172.21.15.102:0/1586711247 conn(0x7f992c0b05b0 msgr2=0x7f992c0b09c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-13T11:29:05.975 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:05.963+0000 7f44bbfff640 1 --2- 172.21.15.102:0/980408798 >> v2:172.21.15.154:3300/0 conn(0x7f44bc0b3a30 0x7f44bc070d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:05.975 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:05.963+0000 7f99311f8640 1 -- 172.21.15.102:0/1586711247 shutdown_connections 2023-11-13T11:29:05.975 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:05.963+0000 7f99311f8640 1 -- 172.21.15.102:0/1586711247 wait complete. 2023-11-13T11:29:05.976 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:05.963+0000 7f5be9232640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5be415d1a0 0x7f5be406dfe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:05.976 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:05.963+0000 7f5be9232640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f5be40cd9d0 0x7f5be40cde30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:05.976 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:05.963+0000 7f5be9232640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f5be40b1c50 0x7f5be40b20e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:05.977 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:05.963+0000 7f5be9232640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5be40ce370 con 0x7f5be40b1c50 2023-11-13T11:29:05.977 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:05.963+0000 7f5be9232640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5be40ad2b0 con 0x7f5be40cd9d0 2023-11-13T11:29:05.977 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:05.963+0000 7f5be9232640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5be40ade30 con 0x7f5be415d1a0 2023-11-13T11:29:05.978 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:05.963+0000 7f69f65f8640 1 Processor -- start 2023-11-13T11:29:05.978 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:05.963+0000 7f69f65f8640 1 -- start start 2023-11-13T11:29:05.979 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:05.963+0000 7f3235665640 1 --2- 172.21.15.102:0/3120409127 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f323015d1a0 0x7f323006dfe0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f3220009d90 tx=0x7f322001c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2532253ae98c5bdc server_cookie=0 in_seq=0 out_seq=0 2023-11-13T11:29:05.979 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:05.963+0000 7f5be359e640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f5be40b1c50 0x7f5be40b20e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:05.979 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:05.963+0000 7f99311f8640 1 Processor -- start 2023-11-13T11:29:05.980 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:05.963+0000 7f44c1392640 1 -- 172.21.15.102:0/980408798 >> v2:172.21.15.154:3300/0 conn(0x7f44bc0b3a30 msgr2=0x7f44bc070d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-13T11:29:05.980 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:05.963+0000 7f44c1392640 1 --2- 172.21.15.102:0/980408798 >> v2:172.21.15.154:3300/0 conn(0x7f44bc0b3a30 0x7f44bc070d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:05.980 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:05.963+0000 7f44c1392640 1 -- 172.21.15.102:0/980408798 >> v1:172.21.15.154:6789/0 conn(0x7f44bc1404d0 legacy=0x7f44bc071860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:05.981 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:05.963+0000 7f44bb7fe640 1 -- 172.21.15.102:0/980408798 <== mon.1 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3490890099 0 0) 0x7f44bc0708e0 con 0x7f44bc1404d0 2023-11-13T11:29:05.981 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:05.963+0000 7f44c1392640 1 -- 172.21.15.102:0/980408798 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44bc06fd10 con 0x7f44bc0cd9d0 2023-11-13T11:29:05.982 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:05.963+0000 7f5be359e640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f5be40b1c50 0x7f5be40b20e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:36434/0 (socket says 172.21.15.102:36434) 2023-11-13T11:29:05.982 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:05.963+0000 7f5be359e640 1 -- 172.21.15.102:0/415074932 learned_addr learned my addr 172.21.15.102:0/415074932 (peer_addr_for_me v2:172.21.15.102:0/0) 2023-11-13T11:29:05.982 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:05.963+0000 7f5be2d9d640 1 --2- 172.21.15.102:0/415074932 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5be415d1a0 0x7f5be406dfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:05.982 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:05.967+0000 7f5be259c640 1 --2- 172.21.15.102:0/415074932 >> v2:172.21.15.154:3300/0 conn(0x7f5be40cd9d0 0x7f5be40cde30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:05.983 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:05.967+0000 7f99311f8640 1 -- start start 2023-11-13T11:29:05.983 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:05.967+0000 7f99311f8640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f992c06fb60 0x7f992c0cda00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:05.983 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:05.967+0000 7f99311f8640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f992c070e10 0x7f992c2025e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:05.984 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:05.967+0000 7f99311f8640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f992c15d060 0x7f992c1434e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:05.984 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:05.967+0000 7f99311f8640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f992c143a20 con 0x7f992c06fb60 2023-11-13T11:29:05.984 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:05.967+0000 7f99311f8640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f992c143cc0 con 0x7f992c070e10 2023-11-13T11:29:05.984 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:05.967+0000 7f99311f8640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f992c143fa0 con 0x7f992c15d060 2023-11-13T11:29:05.984 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:05.967+0000 7f992ad9d640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f992c06fb60 0x7f992c0cda00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:05.985 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:05.967+0000 7f322ffff640 1 -- 172.21.15.102:0/3120409127 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32200a59a0 con 0x7f323015d1a0 2023-11-13T11:29:05.985 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:05.967+0000 7f322ffff640 1 -- 172.21.15.102:0/3120409127 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f32200a5b00 con 0x7f323015d1a0 2023-11-13T11:29:05.985 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:05.967+0000 7f322ffff640 1 -- 172.21.15.102:0/3120409127 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32200a5e90 con 0x7f323015d1a0 2023-11-13T11:29:05.986 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:05.967+0000 7f32378c9640 1 -- 172.21.15.102:0/3120409127 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f323015d1a0 msgr2=0x7f323006dfe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:05.986 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:05.967+0000 7f32378c9640 1 --2- 172.21.15.102:0/3120409127 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f323015d1a0 0x7f323006dfe0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f3220009d90 tx=0x7f322001c8e0 comp rx=0 tx=0).stop 2023-11-13T11:29:05.986 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:05.967+0000 7f32378c9640 1 -- 172.21.15.102:0/3120409127 shutdown_connections 2023-11-13T11:29:05.986 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:05.967+0000 7f32378c9640 1 --2- 172.21.15.102:0/3120409127 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f323015d1a0 0x7f323006dfe0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:05.987 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:05.967+0000 7f32378c9640 1 -- 172.21.15.102:0/3120409127 >> 172.21.15.102:0/3120409127 conn(0x7f32300cb5c0 msgr2=0x7f32300cb9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-13T11:29:05.987 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:05.967+0000 7f32378c9640 1 -- 172.21.15.102:0/3120409127 shutdown_connections 2023-11-13T11:29:05.987 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:05.967+0000 7f32378c9640 1 -- 172.21.15.102:0/3120409127 wait complete. 2023-11-13T11:29:05.987 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:05.967+0000 7f69f65f8640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f69f00cfe80 0x7f69f00b4770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:05.988 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:05.967+0000 7f69f55f6640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f69f006ae50 0x7f69f006b230 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.102:52524/0 (socket says 172.21.15.102:52524) 2023-11-13T11:29:05.988 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:05.967+0000 7f69f55f6640 1 -- 172.21.15.102:0/1135332844 learned_addr learned my addr 172.21.15.102:0/1135332844 (peer_addr_for_me v1:172.21.15.102:0/0) 2023-11-13T11:29:05.988 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:05.967+0000 7f69f65f8640 1 --2- 172.21.15.102:0/1135332844 >> v2:172.21.15.102:3300/0 conn(0x7f69f00b4cb0 0x7f69f00b60b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:05.988 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:05.967+0000 7f69f4df5640 1 --2- 172.21.15.102:0/1135332844 >> v2:172.21.15.154:3300/0 conn(0x7f69f00cfe80 0x7f69f00b4770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:05.989 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:05.967+0000 7f69f65f8640 1 -- 172.21.15.102:0/1135332844 --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f69f009abb0 con 0x7f69f006ae50 2023-11-13T11:29:05.989 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:05.967+0000 7f69f65f8640 1 -- 172.21.15.102:0/1135332844 --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f69f006b940 con 0x7f69f00b4cb0 2023-11-13T11:29:05.989 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:05.967+0000 7f69f65f8640 1 -- 172.21.15.102:0/1135332844 --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f69f00b0890 con 0x7f69f00cfe80 2023-11-13T11:29:05.989 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:05.967+0000 7f69f5df7640 1 --2- 172.21.15.102:0/1135332844 >> v2:172.21.15.102:3300/0 conn(0x7f69f00b4cb0 0x7f69f00b60b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:05.990 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:05.967+0000 7f5be359e640 1 -- 172.21.15.102:0/415074932 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5be415d1a0 msgr2=0x7f5be406dfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-13T11:29:05.990 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:05.967+0000 7f5be359e640 1 --2- 172.21.15.102:0/415074932 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5be415d1a0 0x7f5be406dfe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:05.990 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:05.967+0000 7f5be359e640 1 -- 172.21.15.102:0/415074932 >> v2:172.21.15.154:3300/0 conn(0x7f5be40cd9d0 msgr2=0x7f5be40cde30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-13T11:29:05.990 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:05.967+0000 7f5be359e640 1 --2- 172.21.15.102:0/415074932 >> v2:172.21.15.154:3300/0 conn(0x7f5be40cd9d0 0x7f5be40cde30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:05.991 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:05.967+0000 7f5be359e640 1 -- 172.21.15.102:0/415074932 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5be40ad500 con 0x7f5be40b1c50 2023-11-13T11:29:05.991 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:05.967+0000 7f5be2d9d640 1 --2- 172.21.15.102:0/415074932 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5be415d1a0 0x7f5be406dfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-13T11:29:05.991 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:05.967+0000 7f992a59c640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f992c070e10 0x7f992c2025e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:05.992 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:05.967+0000 7f992a59c640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f992c070e10 0x7f992c2025e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.102:56454/0 (socket says 172.21.15.102:56454) 2023-11-13T11:29:05.992 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:05.967+0000 7f992a59c640 1 -- 172.21.15.102:0/2618792003 learned_addr learned my addr 172.21.15.102:0/2618792003 (peer_addr_for_me v2:172.21.15.102:0/0) 2023-11-13T11:29:05.992 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:05.967+0000 7f992b59e640 1 --2- 172.21.15.102:0/2618792003 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f992c15d060 0x7f992c1434e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:05.992 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:05.967+0000 7f69e7fff640 1 -- 172.21.15.102:0/1135332844 <== mon.1 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1731798579 0 0) 0x7f69f009abb0 con 0x7f69f006ae50 2023-11-13T11:29:05.993 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:05.967+0000 7f992a59c640 1 -- 172.21.15.102:0/2618792003 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f992c15d060 msgr2=0x7f992c1434e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:05.993 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:05.967+0000 7f992a59c640 1 --2- 172.21.15.102:0/2618792003 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f992c15d060 0x7f992c1434e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:05.993 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:05.967+0000 7f992a59c640 1 -- 172.21.15.102:0/2618792003 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f992c06fb60 msgr2=0x7f992c0cda00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:05.994 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:05.967+0000 7f992a59c640 1 --2- 172.21.15.102:0/2618792003 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f992c06fb60 0x7f992c0cda00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:05.994 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:05.967+0000 7f992a59c640 1 -- 172.21.15.102:0/2618792003 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9924009420 con 0x7f992c070e10 2023-11-13T11:29:05.994 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:05.967+0000 7f44c1392640 1 --2- 172.21.15.102:0/980408798 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f44bc0cd9d0 0x7f44bc0cde80 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f44bc143d30 tx=0x7f44ac01c4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cb255755547f6015 server_cookie=0 in_seq=0 out_seq=0 2023-11-13T11:29:05.995 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:05.967+0000 7f69e7fff640 1 -- 172.21.15.102:0/1135332844 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f69dc003530 con 0x7f69f006ae50 2023-11-13T11:29:05.995 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:05.967+0000 7f69f4df5640 1 -- 172.21.15.102:0/1135332844 >> v2:172.21.15.102:3300/0 conn(0x7f69f00b4cb0 msgr2=0x7f69f00b60b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-13T11:29:05.995 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:05.967+0000 7f69f4df5640 1 --2- 172.21.15.102:0/1135332844 >> v2:172.21.15.102:3300/0 conn(0x7f69f00b4cb0 0x7f69f00b60b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:05.996 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:05.967+0000 7f69f4df5640 1 -- 172.21.15.102:0/1135332844 >> v1:172.21.15.154:6789/0 conn(0x7f69f006ae50 legacy=0x7f69f006b230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:05.996 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:05.967+0000 7f69f4df5640 1 -- 172.21.15.102:0/1135332844 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69f00b50c0 con 0x7f69f00cfe80 2023-11-13T11:29:05.996 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:05.967+0000 7f992a59c640 1 --2- 172.21.15.102:0/2618792003 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f992c070e10 0x7f992c2025e0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f991c00c4d0 tx=0x7f991c00c990 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-13T11:29:05.997 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:05.967+0000 7f44bb7fe640 1 -- 172.21.15.102:0/980408798 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44ac0ad660 con 0x7f44bc0cd9d0 2023-11-13T11:29:05.997 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:05.967+0000 7f44bb7fe640 1 -- 172.21.15.102:0/980408798 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f44ac0ad7c0 con 0x7f44bc0cd9d0 2023-11-13T11:29:05.997 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:05.967+0000 7f44bb7fe640 1 -- 172.21.15.102:0/980408798 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44ac0adb50 con 0x7f44bc0cd9d0 2023-11-13T11:29:05.998 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:05.967+0000 7f99237fe640 1 -- 172.21.15.102:0/2618792003 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f991c005cf0 con 0x7f992c070e10 2023-11-13T11:29:05.998 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:05.971+0000 7f99237fe640 1 -- 172.21.15.102:0/2618792003 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f991c005e50 con 0x7f992c070e10 2023-11-13T11:29:05.998 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:05.971+0000 7f99237fe640 1 -- 172.21.15.102:0/2618792003 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f991c007270 con 0x7f992c070e10 2023-11-13T11:29:05.999 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:05.971+0000 7f99311f8640 1 -- 172.21.15.102:0/2618792003 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f992c144280 con 0x7f992c070e10 2023-11-13T11:29:05.999 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:05.971+0000 7f99311f8640 1 -- 172.21.15.102:0/2618792003 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f992c144840 con 0x7f992c070e10 2023-11-13T11:29:05.999 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:05.971+0000 7fce963c1640 1 Processor -- start 2023-11-13T11:29:06.000 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:05.971+0000 7f32378c9640 1 Processor -- start 2023-11-13T11:29:06.000 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:05.971+0000 7f44c2df5640 1 -- 172.21.15.102:0/980408798 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f44bc0cd9d0 msgr2=0x7f44bc0cde80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:06.000 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:05.971+0000 7f44c2df5640 1 --2- 172.21.15.102:0/980408798 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f44bc0cd9d0 0x7f44bc0cde80 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f44bc143d30 tx=0x7f44ac01c4b0 comp rx=0 tx=0).stop 2023-11-13T11:29:06.001 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:05.971+0000 7f44c2df5640 1 -- 172.21.15.102:0/980408798 shutdown_connections 2023-11-13T11:29:06.001 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:05.971+0000 7f44c2df5640 1 --2- 172.21.15.102:0/980408798 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f44bc0cd9d0 0x7f44bc0cde80 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:06.001 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:05.971+0000 7f44c2df5640 1 --2- 172.21.15.102:0/980408798 >> v2:172.21.15.154:3300/0 conn(0x7f44bc0b3a30 0x7f44bc070d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:06.002 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:05.971+0000 7fce963c1640 1 -- start start 2023-11-13T11:29:06.002 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:05.971+0000 7f44c2df5640 1 -- 172.21.15.102:0/980408798 >> 172.21.15.102:0/980408798 conn(0x7f44bc0cb5c0 msgr2=0x7f44bc0cb9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-13T11:29:06.002 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:05.971+0000 7f32378c9640 1 -- start start 2023-11-13T11:29:06.003 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:05.971+0000 7f44c2df5640 1 -- 172.21.15.102:0/980408798 shutdown_connections 2023-11-13T11:29:06.003 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:05.971+0000 7f69f5df7640 1 --2- 172.21.15.102:0/1135332844 >> v2:172.21.15.102:3300/0 conn(0x7f69f00b4cb0 0x7f69f00b60b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-13T11:29:06.004 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:05.971+0000 7f99311f8640 1 -- 172.21.15.102:0/2618792003 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9910005260 con 0x7f992c070e10 2023-11-13T11:29:06.004 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:05.971+0000 7f44c2df5640 1 -- 172.21.15.102:0/980408798 wait complete. 2023-11-13T11:29:06.005 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:05.971+0000 7fce963c1640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7fce901591f0 0x7fce900b3510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:06.005 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:05.971+0000 7fce963c1640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fce900cd9d0 0x7fce900cde60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:06.006 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:05.971+0000 7fce963c1640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fce90070940 con 0x7fce900cc0e0 2023-11-13T11:29:06.006 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:05.971+0000 7fce963c1640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fce900ce3a0 con 0x7fce901591f0 2023-11-13T11:29:06.006 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:05.971+0000 7fce963c1640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fce90070560 con 0x7fce900cd9d0 2023-11-13T11:29:06.006 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:05.971+0000 7fce9495e640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fce900cd9d0 0x7fce900cde60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:06.007 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:05.971+0000 7fce9495e640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fce900cd9d0 0x7fce900cde60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.102:33960/0 (socket says 172.21.15.102:33960) 2023-11-13T11:29:06.007 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:05.971+0000 7fce9495e640 1 -- 172.21.15.102:0/3124015771 learned_addr learned my addr 172.21.15.102:0/3124015771 (peer_addr_for_me v2:172.21.15.102:0/0) 2023-11-13T11:29:06.007 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:05.971+0000 7fce8ffff640 1 --1- 172.21.15.102:0/3124015771 >> v1:172.21.15.154:6789/0 conn(0x7fce900cc0e0 0x7fce9006fd10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.102:52534/0 (socket says 172.21.15.102:52534) 2023-11-13T11:29:06.007 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:05.971+0000 7f5be359e640 1 --2- 172.21.15.102:0/415074932 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5be40b1c50 0x7f5be40b20e0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f5be4073bf0 tx=0x7f5bdc01c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ec5872db145b08df server_cookie=0 in_seq=0 out_seq=0 2023-11-13T11:29:06.008 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:05.975+0000 7fce9495e640 1 -- 172.21.15.102:0/3124015771 >> v2:172.21.15.102:3300/0 conn(0x7fce901591f0 msgr2=0x7fce900b3510 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-13T11:29:06.008 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:05.975+0000 7f32378c9640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f32300718a0 0x7f323015a8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:06.009 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:05.975+0000 7fce9495e640 1 --2- 172.21.15.102:0/3124015771 >> v2:172.21.15.102:3300/0 conn(0x7fce901591f0 0x7fce900b3510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:06.009 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:05.975+0000 7fce9495e640 1 -- 172.21.15.102:0/3124015771 >> v1:172.21.15.154:6789/0 conn(0x7fce900cc0e0 legacy=0x7fce9006fd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:06.010 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:05.975+0000 7f32378c9640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f32300cd9d0 0x7f3230152bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:06.010 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:05.975+0000 7f32378c9640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f323015d1a0 0x7f3230160f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:06.010 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:05.975+0000 7f32378c9640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3230157f00 con 0x7f32300718a0 2023-11-13T11:29:06.011 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:05.975+0000 7fce9495e640 1 -- 172.21.15.102:0/3124015771 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce90070b90 con 0x7fce900cd9d0 2023-11-13T11:29:06.011 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:05.975+0000 7f4e2ddb8640 1 Processor -- start 2023-11-13T11:29:06.012 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:05.975+0000 7f3235665640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f32300718a0 0x7f323015a8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:06.012 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:05.975+0000 7f3235665640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f32300718a0 0x7f323015a8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:36482/0 (socket says 172.21.15.102:36482) 2023-11-13T11:29:06.012 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:05.975+0000 7f3235665640 1 -- 172.21.15.102:0/496292351 learned_addr learned my addr 172.21.15.102:0/496292351 (peer_addr_for_me v2:172.21.15.102:0/0) 2023-11-13T11:29:06.013 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:05.971+0000 7f99237fe640 1 -- 172.21.15.102:0/2618792003 <== mon.1 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f991c0073d0 con 0x7f992c070e10 2023-11-13T11:29:06.013 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:05.975+0000 7f99237fe640 1 --2- 172.21.15.102:0/2618792003 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f990c0664c0 0x7f990c068980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:06.013 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:05.975+0000 7f992ad9d640 1 --2- 172.21.15.102:0/2618792003 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f990c0664c0 0x7f990c068980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:06.014 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:05.975+0000 7f3234e64640 1 --2- 172.21.15.102:0/496292351 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f32300cd9d0 0x7f3230152bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:06.014 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:05.975+0000 7f3235e66640 1 --2- 172.21.15.102:0/496292351 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f323015d1a0 0x7f3230160f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:06.014 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:05.975+0000 7f32378c9640 1 -- 172.21.15.102:0/496292351 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f323015adf0 con 0x7f323015d1a0 2023-11-13T11:29:06.014 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:05.975+0000 7f32378c9640 1 -- 172.21.15.102:0/496292351 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f32301530f0 con 0x7f32300cd9d0 2023-11-13T11:29:06.015 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:05.975+0000 7f44c2df5640 1 Processor -- start 2023-11-13T11:29:06.015 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:05.975+0000 7f69f4df5640 1 --2- 172.21.15.102:0/1135332844 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f69f00cfe80 0x7f69f00b4770 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f69f00b5630 tx=0x7f69ec01c480 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5c98130e15b75345 server_cookie=0 in_seq=0 out_seq=0 2023-11-13T11:29:06.015 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:05.975+0000 7f5be1d9b640 1 -- 172.21.15.102:0/415074932 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bdc0a5820 con 0x7f5be40b1c50 2023-11-13T11:29:06.016 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:05.975+0000 7f5be1d9b640 1 -- 172.21.15.102:0/415074932 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5bdc0a5980 con 0x7f5be40b1c50 2023-11-13T11:29:06.016 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:05.975+0000 7f5be1d9b640 1 -- 172.21.15.102:0/415074932 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bdc0a5d10 con 0x7f5be40b1c50 2023-11-13T11:29:06.016 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:05.975+0000 7f4e2ddb8640 1 -- start start 2023-11-13T11:29:06.017 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:05.975+0000 7f99237fe640 1 -- 172.21.15.102:0/2618792003 <== mon.1 v2:172.21.15.154:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f991c0832a0 con 0x7f992c070e10 2023-11-13T11:29:06.018 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:05.975+0000 7f3235e66640 1 -- 172.21.15.102:0/496292351 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f32300cd9d0 msgr2=0x7f3230152bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:06.018 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:05.975+0000 7f3235e66640 1 --2- 172.21.15.102:0/496292351 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f32300cd9d0 0x7f3230152bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:06.018 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:05.975+0000 7f3235e66640 1 -- 172.21.15.102:0/496292351 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f32300718a0 msgr2=0x7f323015a8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:06.018 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:05.975+0000 7f3235e66640 1 --2- 172.21.15.102:0/496292351 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f32300718a0 0x7f323015a8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:06.018 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:05.975+0000 7f3235e66640 1 -- 172.21.15.102:0/496292351 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3220009a70 con 0x7f323015d1a0 2023-11-13T11:29:06.019 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:05.975+0000 7f3235665640 1 --2- 172.21.15.102:0/496292351 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f32300718a0 0x7f323015a8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-13T11:29:06.019 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:05.975+0000 7f5be9232640 1 -- 172.21.15.102:0/415074932 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5be40b1c50 msgr2=0x7f5be40b20e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:06.019 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:05.975+0000 7f5be9232640 1 --2- 172.21.15.102:0/415074932 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5be40b1c50 0x7f5be40b20e0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f5be4073bf0 tx=0x7f5bdc01c9c0 comp rx=0 tx=0).stop 2023-11-13T11:29:06.020 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:05.975+0000 7f44c2df5640 1 -- start start 2023-11-13T11:29:06.020 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:05.975+0000 7f3235e66640 1 --2- 172.21.15.102:0/496292351 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f323015d1a0 0x7f3230160f30 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f322800c410 tx=0x7f322800c8d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-13T11:29:06.020 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:05.975+0000 7f4e2ddb8640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f4e2816a0a0 0x7f4e2816c490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:06.021 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:05.975+0000 7f992ad9d640 1 --2- 172.21.15.102:0/2618792003 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f990c0664c0 0x7f990c068980 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f99240b7000 tx=0x7f99240af070 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-13T11:29:06.021 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:05.975+0000 7f4e2ddb8640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4e280cdae0 con 0x7f4e2806d2a0 2023-11-13T11:29:06.022 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:05.975+0000 7f4e2ddb8640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4e280cddb0 con 0x7f4e280b2380 2023-11-13T11:29:06.022 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:05.975+0000 7f4e2ddb8640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4e280ce090 con 0x7f4e2816a0a0 2023-11-13T11:29:06.022 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:05.975+0000 7f5be9232640 1 -- 172.21.15.102:0/415074932 shutdown_connections 2023-11-13T11:29:06.022 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:05.975+0000 7f5be9232640 1 --2- 172.21.15.102:0/415074932 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5be40b1c50 0x7f5be40b20e0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:06.023 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:05.975+0000 7f5be9232640 1 --2- 172.21.15.102:0/415074932 >> v2:172.21.15.154:3300/0 conn(0x7f5be40cd9d0 0x7f5be40cde30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:06.023 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:05.975+0000 7f5be9232640 1 --2- 172.21.15.102:0/415074932 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5be415d1a0 0x7f5be406dfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:06.023 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:05.975+0000 7f5be9232640 1 -- 172.21.15.102:0/415074932 >> 172.21.15.102:0/415074932 conn(0x7f5be40cb5c0 msgr2=0x7f5be40cb9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-13T11:29:06.024 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:05.975+0000 7f4e277fe640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f4e280b2380 0x7f4e280cd3d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.102:52536/0 (socket says 172.21.15.102:52536) 2023-11-13T11:29:06.024 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:05.975+0000 7f4e277fe640 1 -- 172.21.15.102:0/3268378668 learned_addr learned my addr 172.21.15.102:0/3268378668 (peer_addr_for_me v1:172.21.15.102:0/0) 2023-11-13T11:29:06.024 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:05.979+0000 7f5be9232640 1 -- 172.21.15.102:0/415074932 shutdown_connections 2023-11-13T11:29:06.025 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:05.979+0000 7f5be9232640 1 -- 172.21.15.102:0/415074932 wait complete. 2023-11-13T11:29:06.025 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:05.979+0000 7f4e27fff640 1 --2- 172.21.15.102:0/3268378668 >> v2:172.21.15.102:3300/0 conn(0x7f4e2816a0a0 0x7f4e2816c490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:06.025 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:05.979+0000 7f44c2df5640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f44bc0b3a30 0x7f44bc1562f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:06.026 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:05.979+0000 7f44c2df5640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f44bc0cd9d0 0x7f44bc156830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:06.026 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:05.979+0000 7f4e267fc640 1 -- 172.21.15.102:0/3268378668 <== mon.0 v1:172.21.15.102:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3074154055 0 0) 0x7f4e280cdae0 con 0x7f4e2806d2a0 2023-11-13T11:29:06.027 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:05.979+0000 7f4e267fc640 1 -- 172.21.15.102:0/3268378668 --> v1:172.21.15.102:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4e10003530 con 0x7f4e2806d2a0 2023-11-13T11:29:06.027 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:05.979+0000 7f4e267fc640 1 -- 172.21.15.102:0/3268378668 <== mon.0 v1:172.21.15.102:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2939398782 0 0) 0x7f4e10003530 con 0x7f4e2806d2a0 2023-11-13T11:29:06.027 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:05.979+0000 7f4e267fc640 1 -- 172.21.15.102:0/3268378668 >> v2:172.21.15.102:3300/0 conn(0x7f4e2816a0a0 msgr2=0x7f4e2816c490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-13T11:29:06.027 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:05.979+0000 7f4e267fc640 1 --2- 172.21.15.102:0/3268378668 >> v2:172.21.15.102:3300/0 conn(0x7f4e2816a0a0 0x7f4e2816c490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:06.027 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:05.979+0000 7f4e267fc640 1 -- 172.21.15.102:0/3268378668 >> v1:172.21.15.154:6789/0 conn(0x7f4e280b2380 legacy=0x7f4e280cd3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:06.028 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:05.979+0000 7f4e267fc640 1 -- 172.21.15.102:0/3268378668 --> v1:172.21.15.102:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e280ce370 con 0x7f4e2806d2a0 2023-11-13T11:29:06.028 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:05.979+0000 7f4e267fc640 1 -- 172.21.15.102:0/3268378668 <== mon.0 v1:172.21.15.102:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 895381068 0 0) 0x7f4e18001660 con 0x7f4e2806d2a0 2023-11-13T11:29:06.028 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:05.979+0000 7f4e267fc640 1 -- 172.21.15.102:0/3268378668 >> v1:172.21.15.102:6789/0 conn(0x7f4e2806d2a0 legacy=0x7f4e280b2760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:06.028 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:05.979+0000 7f44c2df5640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f44bc1404d0 0x7f44bc137970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:06.029 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:05.979+0000 7f322dffb640 1 -- 172.21.15.102:0/496292351 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3228005230 con 0x7f323015d1a0 2023-11-13T11:29:06.029 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:05.979+0000 7f44c2df5640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44bc158400 con 0x7f44bc0b3a30 2023-11-13T11:29:06.030 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:05.979+0000 7f4e267fc640 1 --2- 172.21.15.102:0/3268378668 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4e100039a0 0x7f4e10003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:06.030 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:05.979+0000 7f4e267fc640 1 --2- 172.21.15.102:0/3268378668 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4e100047d0 0x7f4e10004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:06.030 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:05.979+0000 7f4e267fc640 1 --2- 172.21.15.102:0/3268378668 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4e10005270 0x7f4e1000b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:06.030 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:05.979+0000 7f4e267fc640 1 -- 172.21.15.102:0/3268378668 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e280ce090 con 0x7f4e100047d0 2023-11-13T11:29:06.030 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:05.979+0000 7f4e267fc640 1 -- 172.21.15.102:0/3268378668 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e1000c1a0 con 0x7f4e100039a0 2023-11-13T11:29:06.031 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:05.979+0000 7f44c2df5640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44bc1508f0 con 0x7f44bc1404d0 2023-11-13T11:29:06.031 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:05.979+0000 7f4e267fc640 1 -- 172.21.15.102:0/3268378668 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4e1000c360 con 0x7f4e10005270 2023-11-13T11:29:06.032 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:05.979+0000 7f44c1392640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f44bc1404d0 0x7f44bc137970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:06.032 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:05.979+0000 7f44c1392640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f44bc1404d0 0x7f44bc137970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.102:56478/0 (socket says 172.21.15.102:56478) 2023-11-13T11:29:06.032 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:05.979+0000 7f44c1392640 1 -- 172.21.15.102:0/3020216701 learned_addr learned my addr 172.21.15.102:0/3020216701 (peer_addr_for_me v2:172.21.15.102:0/0) 2023-11-13T11:29:06.033 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:05.979+0000 7f44c2df5640 1 -- 172.21.15.102:0/3020216701 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f44bc150bd0 con 0x7f44bc0cd9d0 2023-11-13T11:29:06.033 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:05.979+0000 7f44bbfff640 1 --2- 172.21.15.102:0/3020216701 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f44bc0cd9d0 0x7f44bc156830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:06.033 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:05.979+0000 7f4e27fff640 1 --2- 172.21.15.102:0/3268378668 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4e10005270 0x7f4e1000b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:06.034 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:05.979+0000 7f99237fe640 1 -- 172.21.15.102:0/2618792003 <== mon.1 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f991c0508b0 con 0x7f992c070e10 2023-11-13T11:29:06.034 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:05.979+0000 7f32378c9640 1 -- 172.21.15.102:0/496292351 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f32300ce370 con 0x7f323015d1a0 2023-11-13T11:29:06.034 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:05.979+0000 7f32378c9640 1 -- 172.21.15.102:0/496292351 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f32301604b0 con 0x7f323015d1a0 2023-11-13T11:29:06.035 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:05.979+0000 7fce9495e640 1 --2- 172.21.15.102:0/3124015771 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fce900cd9d0 0x7fce900cde60 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fce88009e50 tx=0x7fce8801c9e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=30517edfab7f98c server_cookie=0 in_seq=0 out_seq=0 2023-11-13T11:29:06.035 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:05.979+0000 7f322dffb640 1 -- 172.21.15.102:0/496292351 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3228005390 con 0x7f323015d1a0 2023-11-13T11:29:06.035 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:05.979+0000 7f322dffb640 1 -- 172.21.15.102:0/496292351 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32280047d0 con 0x7f323015d1a0 2023-11-13T11:29:06.036 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:05.979+0000 7f69e7fff640 1 -- 172.21.15.102:0/1135332844 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69ec0ab600 con 0x7f69f00cfe80 2023-11-13T11:29:06.036 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:05.979+0000 7f69e7fff640 1 -- 172.21.15.102:0/1135332844 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f69ec0a7050 con 0x7f69f00cfe80 2023-11-13T11:29:06.036 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:05.979+0000 7f69e7fff640 1 -- 172.21.15.102:0/1135332844 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69ec0ab980 con 0x7f69f00cfe80 2023-11-13T11:29:06.037 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:05.979+0000 7fce8effd640 1 -- 172.21.15.102:0/3124015771 <== mon.2 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce880a56c0 con 0x7fce900cd9d0 2023-11-13T11:29:06.037 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:05.979+0000 7fce8effd640 1 -- 172.21.15.102:0/3124015771 <== mon.2 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce880a5820 con 0x7fce900cd9d0 2023-11-13T11:29:06.037 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:05.979+0000 7fce8effd640 1 -- 172.21.15.102:0/3124015771 <== mon.2 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce880a5bb0 con 0x7fce900cd9d0 2023-11-13T11:29:06.038 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:05.979+0000 7f44c0b91640 1 --2- 172.21.15.102:0/3020216701 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f44bc0b3a30 0x7f44bc1562f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:06.038 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:05.979+0000 7f32378c9640 1 -- 172.21.15.102:0/496292351 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3210005260 con 0x7f323015d1a0 2023-11-13T11:29:06.039 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:05.979+0000 7f44c1392640 1 -- 172.21.15.102:0/3020216701 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f44bc0cd9d0 msgr2=0x7f44bc156830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:06.039 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:05.979+0000 7f44c1392640 1 --2- 172.21.15.102:0/3020216701 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f44bc0cd9d0 0x7f44bc156830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:06.039 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:05.979+0000 7f44c1392640 1 -- 172.21.15.102:0/3020216701 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f44bc0b3a30 msgr2=0x7f44bc1562f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:06.039 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:05.979+0000 7f44c1392640 1 --2- 172.21.15.102:0/3020216701 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f44bc0b3a30 0x7f44bc1562f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:06.040 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:05.983+0000 7f44c1392640 1 -- 172.21.15.102:0/3020216701 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44ac0094d0 con 0x7f44bc1404d0 2023-11-13T11:29:06.040 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:05.983+0000 7f44bbfff640 1 --2- 172.21.15.102:0/3020216701 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f44bc0cd9d0 0x7f44bc156830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-13T11:29:06.040 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:05.979+0000 7f69f65f8640 1 -- 172.21.15.102:0/1135332844 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f69f00cfe80 msgr2=0x7f69f00b4770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:06.040 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:05.979+0000 7f69f65f8640 1 --2- 172.21.15.102:0/1135332844 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f69f00cfe80 0x7f69f00b4770 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f69f00b5630 tx=0x7f69ec01c480 comp rx=0 tx=0).stop 2023-11-13T11:29:06.041 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:05.983+0000 7f69f65f8640 1 -- 172.21.15.102:0/1135332844 shutdown_connections 2023-11-13T11:29:06.041 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:05.983+0000 7f69f65f8640 1 --2- 172.21.15.102:0/1135332844 >> v2:172.21.15.102:3300/0 conn(0x7f69f00b4cb0 0x7f69f00b60b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:06.041 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:05.983+0000 7f69f65f8640 1 --2- 172.21.15.102:0/1135332844 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f69f00cfe80 0x7f69f00b4770 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:06.041 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:05.983+0000 7f69f65f8640 1 -- 172.21.15.102:0/1135332844 >> 172.21.15.102:0/1135332844 conn(0x7f69f00b83f0 msgr2=0x7f69f00cf770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-13T11:29:06.042 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:05.983+0000 7fce963c1640 1 -- 172.21.15.102:0/3124015771 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fce900cd9d0 msgr2=0x7fce900cde60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:06.042 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:05.983+0000 7fce963c1640 1 --2- 172.21.15.102:0/3124015771 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fce900cd9d0 0x7fce900cde60 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fce88009e50 tx=0x7fce8801c9e0 comp rx=0 tx=0).stop 2023-11-13T11:29:06.042 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:05.983+0000 7fce963c1640 1 -- 172.21.15.102:0/3124015771 shutdown_connections 2023-11-13T11:29:06.042 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:05.983+0000 7fce963c1640 1 --2- 172.21.15.102:0/3124015771 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fce900cd9d0 0x7fce900cde60 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:06.042 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:05.983+0000 7fce963c1640 1 --2- 172.21.15.102:0/3124015771 >> v2:172.21.15.102:3300/0 conn(0x7fce901591f0 0x7fce900b3510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:06.043 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:05.983+0000 7fce963c1640 1 -- 172.21.15.102:0/3124015771 >> 172.21.15.102:0/3124015771 conn(0x7fce900cb5c0 msgr2=0x7fce900cb9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-13T11:29:06.043 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:05.979+0000 7f4e26ffd640 1 --2- 172.21.15.102:0/3268378668 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4e100047d0 0x7f4e10004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:06.043 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:05.979+0000 7f4e277fe640 1 --2- 172.21.15.102:0/3268378668 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4e100039a0 0x7f4e10003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:06.043 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:05.979+0000 7f4e27fff640 1 -- 172.21.15.102:0/3268378668 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4e100039a0 msgr2=0x7f4e10003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-13T11:29:06.044 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:05.979+0000 7f4e27fff640 1 --2- 172.21.15.102:0/3268378668 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4e100039a0 0x7f4e10003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:06.044 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:05.979+0000 7f4e27fff640 1 -- 172.21.15.102:0/3268378668 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4e100047d0 msgr2=0x7f4e10004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-13T11:29:06.044 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:05.979+0000 7f4e27fff640 1 --2- 172.21.15.102:0/3268378668 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4e100047d0 0x7f4e10004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:06.044 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:05.979+0000 7f4e27fff640 1 -- 172.21.15.102:0/3268378668 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e280ce370 con 0x7f4e10005270 2023-11-13T11:29:06.045 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:05.983+0000 7fce963c1640 1 -- 172.21.15.102:0/3124015771 shutdown_connections 2023-11-13T11:29:06.045 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:05.983+0000 7fce963c1640 1 -- 172.21.15.102:0/3124015771 wait complete. 2023-11-13T11:29:06.045 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:05.983+0000 7f44c1392640 1 --2- 172.21.15.102:0/3020216701 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f44bc1404d0 0x7f44bc137970 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f44ac0b0040 tx=0x7f44ac019250 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-13T11:29:06.046 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:05.983+0000 7f5be9232640 1 Processor -- start 2023-11-13T11:29:06.046 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:05.983+0000 7f44b97fa640 1 -- 172.21.15.102:0/3020216701 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44ac0ba070 con 0x7f44bc1404d0 2023-11-13T11:29:06.047 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:05.983+0000 7f44b97fa640 1 -- 172.21.15.102:0/3020216701 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f44ac0b6460 con 0x7f44bc1404d0 2023-11-13T11:29:06.047 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:05.983+0000 7f44b97fa640 1 -- 172.21.15.102:0/3020216701 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44ac0b6830 con 0x7f44bc1404d0 2023-11-13T11:29:06.047 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:05.983+0000 7f322dffb640 1 -- 172.21.15.102:0/496292351 <== mon.1 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f3228004930 con 0x7f323015d1a0 2023-11-13T11:29:06.047 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:05.983+0000 7f322dffb640 1 --2- 172.21.15.102:0/496292351 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f321c066470 0x7f321c068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:06.048 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:05.983+0000 7f44c2df5640 1 -- 172.21.15.102:0/3020216701 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f44bc150eb0 con 0x7f44bc1404d0 2023-11-13T11:29:06.048 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:05.983+0000 7f322dffb640 1 -- 172.21.15.102:0/496292351 <== mon.1 v2:172.21.15.154:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f32280544a0 con 0x7f323015d1a0 2023-11-13T11:29:06.049 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:05.983+0000 7f44c2df5640 1 -- 172.21.15.102:0/3020216701 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f44bc151930 con 0x7f44bc1404d0 2023-11-13T11:29:06.049 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:05.983+0000 7f3235665640 1 --2- 172.21.15.102:0/496292351 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f321c066470 0x7f321c068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:06.050 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:05.983+0000 7f69f65f8640 1 -- 172.21.15.102:0/1135332844 shutdown_connections 2023-11-13T11:29:06.050 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:05.983+0000 7f69f65f8640 1 -- 172.21.15.102:0/1135332844 wait complete. 2023-11-13T11:29:06.050 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:05.983+0000 7f5be9232640 1 -- start start 2023-11-13T11:29:06.051 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:05.987+0000 7fce963c1640 1 Processor -- start 2023-11-13T11:29:06.051 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:05.987+0000 7f69f65f8640 1 Processor -- start 2023-11-13T11:29:06.051 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:05.987+0000 7f69f65f8640 1 -- start start 2023-11-13T11:29:06.052 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:05.987+0000 7f44c2df5640 1 -- 172.21.15.102:0/3020216701 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f44bc158160 con 0x7f44bc1404d0 2023-11-13T11:29:06.052 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:05.987+0000 7f69f65f8640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f69f006ae50 0x7f69f0154810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:06.052 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:05.987+0000 7f69f65f8640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f69f00b4cb0 0x7f69f01602b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:06.053 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:05.987+0000 7f69f65f8640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f69f00cfe80 0x7f69f015dbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:06.053 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:05.987+0000 7f69f55f6640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f69f006ae50 0x7f69f0154810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:06.053 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:05.987+0000 7f5be9232640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5be40b1c50 0x7f5be4154a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:06.054 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:05.987+0000 7f5be9232640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5be40cd9d0 0x7f5be4156de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:06.054 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:05.987+0000 7f5be2d9d640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5be40b1c50 0x7f5be4154a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:06.054 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:05.987+0000 7f5be2d9d640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5be40b1c50 0x7f5be4154a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.102:56494/0 (socket says 172.21.15.102:56494) 2023-11-13T11:29:06.055 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:05.987+0000 7fce963c1640 1 -- start start 2023-11-13T11:29:06.055 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:05.987+0000 7fce963c1640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fce900cc0e0 0x7fce901f9af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:06.055 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:05.987+0000 7fce963c1640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fce900cd9d0 0x7fce90148ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:06.056 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:05.987+0000 7f5be9232640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5be415d1a0 0x7f5be4157320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:06.056 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:05.987+0000 7fce963c1640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fce901591f0 0x7fce90157b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:06.056 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:05.987+0000 7fce963c1640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce9014a5f0 con 0x7fce900cc0e0 2023-11-13T11:29:06.057 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:05.987+0000 7fce963c1640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce9014a890 con 0x7fce901591f0 2023-11-13T11:29:06.057 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:05.987+0000 7fce963c1640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fce9014ab70 con 0x7fce900cd9d0 2023-11-13T11:29:06.057 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:05.987+0000 7f3235665640 1 --2- 172.21.15.102:0/496292351 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f321c066470 0x7f321c068930 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f322001a510 tx=0x7f32200a7070 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-13T11:29:06.058 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:05.987+0000 7f69f55f6640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f69f006ae50 0x7f69f0154810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:36524/0 (socket says 172.21.15.102:36524) 2023-11-13T11:29:06.058 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:05.987+0000 7f69f4df5640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f69f00b4cb0 0x7f69f01602b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:06.058 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:05.987+0000 7f69f4df5640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f69f00b4cb0 0x7f69f01602b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.102:56496/0 (socket says 172.21.15.102:56496) 2023-11-13T11:29:06.058 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:05.987+0000 7f69f55f6640 1 -- 172.21.15.102:0/3888553637 learned_addr learned my addr 172.21.15.102:0/3888553637 (peer_addr_for_me v2:172.21.15.102:0/0) 2023-11-13T11:29:06.059 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:05.987+0000 7f5be9232640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5be4155f70 con 0x7f5be40cd9d0 2023-11-13T11:29:06.059 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:05.987+0000 7f5be9232640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5be41552f0 con 0x7f5be40b1c50 2023-11-13T11:29:06.059 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:05.987+0000 7f5be9232640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5be41555d0 con 0x7f5be415d1a0 2023-11-13T11:29:06.060 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:05.987+0000 7f5be2d9d640 1 -- 172.21.15.102:0/1578529510 learned_addr learned my addr 172.21.15.102:0/1578529510 (peer_addr_for_me v2:172.21.15.102:0/0) 2023-11-13T11:29:06.060 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:05.987+0000 7f5be359e640 1 --2- 172.21.15.102:0/1578529510 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5be415d1a0 0x7f5be4157320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:06.060 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:05.987+0000 7f4e27fff640 1 -- 172.21.15.102:0/3268378668 reap_dead start 2023-11-13T11:29:06.061 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:05.987+0000 7fce9495e640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fce901591f0 0x7fce90157b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:06.061 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:05.987+0000 7fce9495e640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fce901591f0 0x7fce90157b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.102:56506/0 (socket says 172.21.15.102:56506) 2023-11-13T11:29:06.061 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:05.987+0000 7f44b97fa640 1 -- 172.21.15.102:0/3020216701 <== mon.1 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f44ac0b4070 con 0x7f44bc1404d0 2023-11-13T11:29:06.062 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:05.987+0000 7fce9495e640 1 -- 172.21.15.102:0/3980496509 learned_addr learned my addr 172.21.15.102:0/3980496509 (peer_addr_for_me v2:172.21.15.102:0/0) 2023-11-13T11:29:06.062 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:05.987+0000 7f4e27fff640 1 --2- 172.21.15.102:0/3268378668 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4e10005270 0x7f4e1000b990 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f4e20007330 tx=0x7f4e2001ce60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=86536dcc054f764c server_cookie=0 in_seq=0 out_seq=0 2023-11-13T11:29:06.062 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:05.987+0000 7f69f65f8640 1 -- 172.21.15.102:0/3888553637 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69f015e100 con 0x7f69f006ae50 2023-11-13T11:29:06.063 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:05.987+0000 7f69f65f8640 1 -- 172.21.15.102:0/3888553637 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69f0155010 con 0x7f69f00b4cb0 2023-11-13T11:29:06.063 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:05.987+0000 7f69f65f8640 1 -- 172.21.15.102:0/3888553637 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f69f015fe20 con 0x7f69f00cfe80 2023-11-13T11:29:06.063 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:05.987+0000 7f5be2d9d640 1 -- 172.21.15.102:0/1578529510 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5be415d1a0 msgr2=0x7f5be4157320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:06.064 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:05.987+0000 7f5be2d9d640 1 --2- 172.21.15.102:0/1578529510 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5be415d1a0 0x7f5be4157320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:06.064 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:05.987+0000 7f69f5df7640 1 --2- 172.21.15.102:0/3888553637 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f69f00cfe80 0x7f69f015dbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:06.064 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:05.987+0000 7f5be2d9d640 1 -- 172.21.15.102:0/1578529510 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5be40cd9d0 msgr2=0x7f5be4156de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:06.065 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:05.987+0000 7f5be2d9d640 1 --2- 172.21.15.102:0/1578529510 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5be40cd9d0 0x7f5be4156de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:06.065 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:05.987+0000 7f44b97fa640 1 --2- 172.21.15.102:0/3020216701 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f44a80664a0 0x7f44a8068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:06.066 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:05.987+0000 7f4e267fc640 1 -- 172.21.15.102:0/3268378668 <== mon.2 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e200a5d40 con 0x7f4e10005270 2023-11-13T11:29:06.066 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:05.987+0000 7f5be2d9d640 1 -- 172.21.15.102:0/1578529510 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5bd4009420 con 0x7f5be40b1c50 2023-11-13T11:29:06.066 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:05.987+0000 7f4e267fc640 1 -- 172.21.15.102:0/3268378668 <== mon.2 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e200039a0 con 0x7f4e10005270 2023-11-13T11:29:06.067 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:05.987+0000 7f4e267fc640 1 -- 172.21.15.102:0/3268378668 <== mon.2 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e200a5ea0 con 0x7f4e10005270 2023-11-13T11:29:06.067 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:05.987+0000 7fce9495e640 1 -- 172.21.15.102:0/3980496509 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fce900cd9d0 msgr2=0x7fce90148ce0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-11-13T11:29:06.067 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:05.987+0000 7fce9495e640 1 --2- 172.21.15.102:0/3980496509 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fce900cd9d0 0x7fce90148ce0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:06.068 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:05.987+0000 7fce9495e640 1 -- 172.21.15.102:0/3980496509 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fce900cc0e0 msgr2=0x7fce901f9af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:06.068 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:05.987+0000 7fce9495e640 1 --2- 172.21.15.102:0/3980496509 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fce900cc0e0 0x7fce901f9af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:06.068 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:05.987+0000 7fce9495e640 1 -- 172.21.15.102:0/3980496509 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce88009b30 con 0x7fce901591f0 2023-11-13T11:29:06.068 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:05.991+0000 7f44c0b91640 1 --2- 172.21.15.102:0/3020216701 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f44a80664a0 0x7f44a8068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:06.069 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:05.987+0000 7f69f5df7640 1 -- 172.21.15.102:0/3888553637 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f69f00b4cb0 msgr2=0x7f69f01602b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:06.069 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:05.991+0000 7f69f5df7640 1 --2- 172.21.15.102:0/3888553637 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f69f00b4cb0 0x7f69f01602b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:06.069 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:05.991+0000 7f69f5df7640 1 -- 172.21.15.102:0/3888553637 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f69f006ae50 msgr2=0x7f69f0154810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:06.070 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:05.991+0000 7f69f5df7640 1 --2- 172.21.15.102:0/3888553637 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f69f006ae50 0x7f69f0154810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:06.070 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:05.991+0000 7f69f5df7640 1 -- 172.21.15.102:0/3888553637 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69e8009a70 con 0x7f69f00cfe80 2023-11-13T11:29:06.070 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:05.991+0000 7f5be2d9d640 1 --2- 172.21.15.102:0/1578529510 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5be40b1c50 0x7f5be4154a10 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f5bd400e980 tx=0x7f5bd400ee40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-13T11:29:06.071 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:05.991+0000 7fce9495e640 1 --2- 172.21.15.102:0/3980496509 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fce901591f0 0x7fce90157b70 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fce880af040 tx=0x7fce88019780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-13T11:29:06.071 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:05.991+0000 7f69f5df7640 1 --2- 172.21.15.102:0/3888553637 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f69f00cfe80 0x7f69f015dbc0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f69e800efc0 tx=0x7f69e800c490 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-13T11:29:06.071 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:05.991+0000 7f44b97fa640 1 -- 172.21.15.102:0/3020216701 <== mon.1 v2:172.21.15.154:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f44ac0eef50 con 0x7f44bc1404d0 2023-11-13T11:29:06.072 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:05.991+0000 7f4e2ddb8640 1 -- 172.21.15.102:0/3268378668 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4e10005270 msgr2=0x7f4e1000b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:06.072 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:05.991+0000 7f4e2ddb8640 1 --2- 172.21.15.102:0/3268378668 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4e10005270 0x7f4e1000b990 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f4e20007330 tx=0x7f4e2001ce60 comp rx=0 tx=0).stop 2023-11-13T11:29:06.072 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:05.991+0000 7f4e2ddb8640 1 -- 172.21.15.102:0/3268378668 shutdown_connections 2023-11-13T11:29:06.072 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:05.991+0000 7f4e2ddb8640 1 --2- 172.21.15.102:0/3268378668 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4e10005270 0x7f4e1000b990 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:06.073 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:05.991+0000 7f4e2ddb8640 1 -- 172.21.15.102:0/3268378668 >> 172.21.15.102:0/3268378668 conn(0x7f4e280b0870 msgr2=0x7f4e280b0c80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-13T11:29:06.073 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:05.991+0000 7f322dffb640 1 -- 172.21.15.102:0/496292351 <== mon.1 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f3228050f70 con 0x7f323015d1a0 2023-11-13T11:29:06.074 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:05.991+0000 7f4e2ddb8640 1 -- 172.21.15.102:0/3268378668 shutdown_connections 2023-11-13T11:29:06.074 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:05.991+0000 7f4e2ddb8640 1 -- 172.21.15.102:0/3268378668 wait complete. 2023-11-13T11:29:06.074 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:05.991+0000 7f69e5ffb640 1 -- 172.21.15.102:0/3888553637 <== mon.2 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69e800ccd0 con 0x7f69f00cfe80 2023-11-13T11:29:06.075 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:05.991+0000 7f69e5ffb640 1 -- 172.21.15.102:0/3888553637 <== mon.2 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f69e800f040 con 0x7f69f00cfe80 2023-11-13T11:29:06.075 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:05.991+0000 7f69e5ffb640 1 -- 172.21.15.102:0/3888553637 <== mon.2 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69e8003be0 con 0x7f69f00cfe80 2023-11-13T11:29:06.075 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:05.991+0000 7f69f65f8640 1 -- 172.21.15.102:0/3888553637 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f69ec009420 con 0x7f69f00cfe80 2023-11-13T11:29:06.076 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:05.991+0000 7f44c0b91640 1 --2- 172.21.15.102:0/3020216701 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f44a80664a0 0x7f44a8068960 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f44b40012f0 tx=0x7f44b4005ec0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-13T11:29:06.076 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:05.991+0000 7f69f65f8640 1 -- 172.21.15.102:0/3888553637 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f69f015a690 con 0x7f69f00cfe80 2023-11-13T11:29:06.076 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:05.991+0000 7f69f65f8640 1 -- 172.21.15.102:0/3888553637 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f69f00b7190 con 0x7f69f00cfe80 2023-11-13T11:29:06.077 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:05.991+0000 7f4e2ddb8640 1 Processor -- start 2023-11-13T11:29:06.077 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:05.991+0000 7f4e2ddb8640 1 -- start start 2023-11-13T11:29:06.078 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:05.995+0000 7f4e2ddb8640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4e10005270 0x7f4e280aea40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:06.078 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:05.995+0000 7f4e2ddb8640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4e28165000 0x7f4e28160f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:06.078 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:05.995+0000 7f4e2ddb8640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4e281614c0 0x7f4e28147800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:06.078 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:05.995+0000 7f4e2ddb8640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e28165490 con 0x7f4e28165000 2023-11-13T11:29:06.079 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:05.995+0000 7f4e2ddb8640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e28165770 con 0x7f4e281614c0 2023-11-13T11:29:06.079 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:05.995+0000 7f4e2ddb8640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4e28165a50 con 0x7f4e10005270 2023-11-13T11:29:06.079 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:05.995+0000 7f69e5ffb640 1 -- 172.21.15.102:0/3888553637 <== mon.2 v2:172.21.15.154:3301/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f69e8014480 con 0x7f69f00cfe80 2023-11-13T11:29:06.080 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:05.995+0000 7f4e277fe640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4e10005270 0x7f4e280aea40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:06.080 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:05.995+0000 7f4e26ffd640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4e28165000 0x7f4e28160f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:06.080 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:05.995+0000 7f4e277fe640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4e10005270 0x7f4e280aea40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.102:34020/0 (socket says 172.21.15.102:34020) 2023-11-13T11:29:06.081 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:05.995+0000 7f4e277fe640 1 -- 172.21.15.102:0/1506869798 learned_addr learned my addr 172.21.15.102:0/1506869798 (peer_addr_for_me v2:172.21.15.102:0/0) 2023-11-13T11:29:06.081 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:05.995+0000 7f4e277fe640 1 -- 172.21.15.102:0/1506869798 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4e281614c0 msgr2=0x7f4e28147800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:06.081 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:05.995+0000 7f4e277fe640 1 --2- 172.21.15.102:0/1506869798 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4e281614c0 0x7f4e28147800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:06.081 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:05.995+0000 7f4e277fe640 1 -- 172.21.15.102:0/1506869798 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4e28165000 msgr2=0x7f4e28160f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:06.082 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:05.995+0000 7f4e277fe640 1 --2- 172.21.15.102:0/1506869798 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4e28165000 0x7f4e28160f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:06.082 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:05.995+0000 7f4e277fe640 1 -- 172.21.15.102:0/1506869798 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e28165d30 con 0x7f4e10005270 2023-11-13T11:29:06.082 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:05.995+0000 7f4e277fe640 1 --2- 172.21.15.102:0/1506869798 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4e10005270 0x7f4e280aea40 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f4e1c005fa0 tx=0x7f4e1c001700 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-13T11:29:06.082 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:05.995+0000 7f69e5ffb640 1 --2- 172.21.15.102:0/3888553637 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f69d40664c0 0x7f69d4068980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:06.083 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:05.995+0000 7f69e5ffb640 1 -- 172.21.15.102:0/3888553637 <== mon.2 v2:172.21.15.154:3301/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f69e80857e0 con 0x7f69f00cfe80 2023-11-13T11:29:06.083 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:05.995+0000 7f5bcb7fe640 1 -- 172.21.15.102:0/1578529510 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bd400ca00 con 0x7f5be40b1c50 2023-11-13T11:29:06.084 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:05.995+0000 7fce8cff9640 1 -- 172.21.15.102:0/3980496509 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce880b8670 con 0x7fce901591f0 2023-11-13T11:29:06.084 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:05.995+0000 7f5bcb7fe640 1 -- 172.21.15.102:0/1578529510 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5bd400cb60 con 0x7f5be40b1c50 2023-11-13T11:29:06.084 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:05.995+0000 7f5be9232640 1 -- 172.21.15.102:0/1578529510 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5bdc009b30 con 0x7f5be40b1c50 2023-11-13T11:29:06.085 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:05.995+0000 7fce963c1640 1 -- 172.21.15.102:0/3980496509 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fce9014ae50 con 0x7fce901591f0 2023-11-13T11:29:06.085 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:05.995+0000 7fce963c1640 1 -- 172.21.15.102:0/3980496509 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fce901fa030 con 0x7fce901591f0 2023-11-13T11:29:06.085 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:05.999+0000 7f44b97fa640 1 -- 172.21.15.102:0/3020216701 <== mon.1 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f44bc158160 con 0x7f44bc1404d0 2023-11-13T11:29:06.086 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:05.995+0000 7f69f55f6640 1 --2- 172.21.15.102:0/3888553637 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f69d40664c0 0x7f69d4068980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:06.086 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:05.995+0000 7fce8cff9640 1 -- 172.21.15.102:0/3980496509 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce880b87f0 con 0x7fce901591f0 2023-11-13T11:29:06.086 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:05.995+0000 7fce8cff9640 1 -- 172.21.15.102:0/3980496509 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce880b8ba0 con 0x7fce901591f0 2023-11-13T11:29:06.087 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:05.995+0000 7f5bcb7fe640 1 -- 172.21.15.102:0/1578529510 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bd4013470 con 0x7f5be40b1c50 2023-11-13T11:29:06.087 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:05.995+0000 7f5be9232640 1 -- 172.21.15.102:0/1578529510 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5be4155b90 con 0x7f5be40b1c50 2023-11-13T11:29:06.087 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:05.999+0000 7f69f55f6640 1 --2- 172.21.15.102:0/3888553637 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f69d40664c0 0x7f69d4068980 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f69e00011f0 tx=0x7f69e0009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-13T11:29:06.088 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:05.999+0000 7f5be9232640 1 -- 172.21.15.102:0/1578529510 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5bc4005260 con 0x7f5be40b1c50 2023-11-13T11:29:06.088 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:05.999+0000 7f5bcb7fe640 1 -- 172.21.15.102:0/1578529510 <== mon.1 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f5bd40135d0 con 0x7f5be40b1c50 2023-11-13T11:29:06.088 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:05.999+0000 7f69e5ffb640 1 -- 172.21.15.102:0/3888553637 <== mon.2 v2:172.21.15.154:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f69e8052c40 con 0x7f69f00cfe80 2023-11-13T11:29:06.089 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:06.003+0000 7f5bcb7fe640 1 --2- 172.21.15.102:0/1578529510 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f5bd0066540 0x7f5bd0068a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:06.089 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:05.999+0000 7fce767fc640 1 -- 172.21.15.102:0/3980496509 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fce9014acb0 con 0x7fce901591f0 2023-11-13T11:29:06.090 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:05.999+0000 7fce8cff9640 1 -- 172.21.15.102:0/3980496509 <== mon.1 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fce880b8d00 con 0x7fce901591f0 2023-11-13T11:29:06.090 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:05.999+0000 7f4e0ffff640 1 -- 172.21.15.102:0/1506869798 <== mon.2 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e1c010510 con 0x7f4e10005270 2023-11-13T11:29:06.090 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:05.999+0000 7f4e0ffff640 1 -- 172.21.15.102:0/1506869798 <== mon.2 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e1c010670 con 0x7f4e10005270 2023-11-13T11:29:06.090 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:05.999+0000 7f4e0ffff640 1 -- 172.21.15.102:0/1506869798 <== mon.2 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e1c0109e0 con 0x7f4e10005270 2023-11-13T11:29:06.091 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:06.003+0000 7f4e2ddb8640 1 -- 172.21.15.102:0/1506869798 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4e28166010 con 0x7f4e10005270 2023-11-13T11:29:06.091 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:06.003+0000 7f4e2ddb8640 1 -- 172.21.15.102:0/1506869798 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4e280af150 con 0x7f4e10005270 2023-11-13T11:29:06.091 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:06.003+0000 7fce8cff9640 1 --2- 172.21.15.102:0/3980496509 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7fce7c0664d0 0x7fce7c068990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:06.092 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:06.003+0000 7f5bcb7fe640 1 -- 172.21.15.102:0/1578529510 <== mon.1 v2:172.21.15.154:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f5bd4083ef0 con 0x7f5be40b1c50 2023-11-13T11:29:06.092 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:06.003+0000 7f5be259c640 1 --2- 172.21.15.102:0/1578529510 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f5bd0066540 0x7f5bd0068a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:06.092 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:06.003+0000 7f4e2ddb8640 1 -- 172.21.15.102:0/1506869798 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4e28068520 con 0x7f4e10005270 2023-11-13T11:29:06.093 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:06.003+0000 7fce8ffff640 1 --2- 172.21.15.102:0/3980496509 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7fce7c0664d0 0x7fce7c068990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:06.093 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:06.003+0000 7f4e0ffff640 1 -- 172.21.15.102:0/1506869798 <== mon.2 v2:172.21.15.154:3301/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f4e1c010b40 con 0x7f4e10005270 2023-11-13T11:29:06.094 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:06.003+0000 7fce8cff9640 1 -- 172.21.15.102:0/3980496509 <== mon.1 v2:172.21.15.154:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fce8811f5f0 con 0x7fce901591f0 2023-11-13T11:29:06.094 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:06.003+0000 7fce8ffff640 1 --2- 172.21.15.102:0/3980496509 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7fce7c0664d0 0x7fce7c068990 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fce900b3e10 tx=0x7fce800079d0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-13T11:29:06.094 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:06.007+0000 7f5be259c640 1 --2- 172.21.15.102:0/1578529510 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f5bd0066540 0x7f5bd0068a00 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f5be40ac820 tx=0x7f5bd8008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-13T11:29:06.095 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:06.007+0000 7f5bcb7fe640 1 -- 172.21.15.102:0/1578529510 <== mon.1 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f5bd4051490 con 0x7f5be40b1c50 2023-11-13T11:29:06.096 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:06.007+0000 7f4e0ffff640 1 --2- 172.21.15.102:0/1506869798 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f4e140664c0 0x7f4e14068980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:06.096 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:06.007+0000 7f4e0ffff640 1 -- 172.21.15.102:0/1506869798 <== mon.2 v2:172.21.15.154:3301/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f4e1c083680 con 0x7f4e10005270 2023-11-13T11:29:06.096 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:06.007+0000 7f4e26ffd640 1 --2- 172.21.15.102:0/1506869798 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f4e140664c0 0x7f4e14068980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:06.096 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:06.011+0000 7f4e26ffd640 1 --2- 172.21.15.102:0/1506869798 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f4e140664c0 0x7f4e14068980 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f4e18000fc0 tx=0x7f4e18009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-13T11:29:06.096 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:06.015+0000 7f4e0ffff640 1 -- 172.21.15.102:0/1506869798 <== mon.2 v2:172.21.15.154:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f4e1c050c20 con 0x7f4e10005270 2023-11-13T11:29:06.097 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:06.015+0000 7fce8cff9640 1 -- 172.21.15.102:0/3980496509 <== mon.1 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fce9014acb0 con 0x7fce901591f0 2023-11-13T11:29:06.238 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:06.235+0000 7fd91359e640 1 -- 172.21.15.102:0/1278109778 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fd91414e3a0 con 0x7fd9140ce440 2023-11-13T11:29:06.239 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:06.235+0000 7fd90b7fe640 1 -- 172.21.15.102:0/1278109778 <== mon.0 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fd90c015030 con 0x7fd9140ce440 2023-11-13T11:29:06.243 INFO:teuthology.orchestra.run.smithi102.stdout:64424509446 2023-11-13T11:29:06.246 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:06.239+0000 7fd91359e640 1 -- 172.21.15.102:0/1278109778 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7fd8f8066470 msgr2=0x7fd8f8068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:06.246 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:06.239+0000 7fd91359e640 1 --2- 172.21.15.102:0/1278109778 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7fd8f8066470 0x7fd8f8068930 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fd9140724b0 tx=0x7fd8fc0a7000 comp rx=0 tx=0).stop 2023-11-13T11:29:06.247 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:06.239+0000 7fd91359e640 1 -- 172.21.15.102:0/1278109778 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd9140ce440 msgr2=0x7fd91414cbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:06.247 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:06.239+0000 7fd91359e640 1 --2- 172.21.15.102:0/1278109778 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd9140ce440 0x7fd91414cbb0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fd90c00b410 tx=0x7fd90c00b8d0 comp rx=0 tx=0).stop 2023-11-13T11:29:06.248 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:06.243+0000 7fd91359e640 1 -- 172.21.15.102:0/1278109778 shutdown_connections 2023-11-13T11:29:06.248 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:06.243+0000 7fd91359e640 1 --2- 172.21.15.102:0/1278109778 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7fd8f8066470 0x7fd8f8068930 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:06.248 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:06.243+0000 7fd91359e640 1 --2- 172.21.15.102:0/1278109778 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd9140ce440 0x7fd91414cbb0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:06.248 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:06.243+0000 7fd91359e640 1 --2- 172.21.15.102:0/1278109778 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd9140b2fc0 0x7fd91414e6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:06.248 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:06.243+0000 7fd91359e640 1 --2- 172.21.15.102:0/1278109778 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd9140b26f0 0x7fd914137560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:06.249 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:06.243+0000 7fd91359e640 1 -- 172.21.15.102:0/1278109778 >> 172.21.15.102:0/1278109778 conn(0x7fd91406a240 msgr2=0x7fd9140aede0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-13T11:29:06.249 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:06.243+0000 7fd91359e640 1 -- 172.21.15.102:0/1278109778 shutdown_connections 2023-11-13T11:29:06.249 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:06.243+0000 7fd91359e640 1 -- 172.21.15.102:0/1278109778 wait complete. 2023-11-13T11:29:06.279 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509446 got 64424509446 for osd.2 2023-11-13T11:29:06.280 DEBUG:teuthology.parallel:result is None 2023-11-13T11:29:06.300 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:06.295+0000 7f69f65f8640 1 -- 172.21.15.102:0/3888553637 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7f69f0068520 con 0x7f69f00cfe80 2023-11-13T11:29:06.302 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:06.299+0000 7f69e5ffb640 1 -- 172.21.15.102:0/3888553637 <== mon.2 v2:172.21.15.154:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f69e8018020 con 0x7f69f00cfe80 2023-11-13T11:29:06.303 INFO:teuthology.orchestra.run.smithi102.stdout:64424509446 2023-11-13T11:29:06.304 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:06.299+0000 7f69f65f8640 1 -- 172.21.15.102:0/3888553637 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f69d40664c0 msgr2=0x7f69d4068980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:06.305 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:06.299+0000 7f69f65f8640 1 --2- 172.21.15.102:0/3888553637 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f69d40664c0 0x7f69d4068980 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f69e00011f0 tx=0x7f69e0009040 comp rx=0 tx=0).stop 2023-11-13T11:29:06.305 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:06.299+0000 7f69f65f8640 1 -- 172.21.15.102:0/3888553637 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f69f00cfe80 msgr2=0x7f69f015dbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:06.305 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:06.299+0000 7f69f65f8640 1 --2- 172.21.15.102:0/3888553637 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f69f00cfe80 0x7f69f015dbc0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f69e800efc0 tx=0x7f69e800c490 comp rx=0 tx=0).stop 2023-11-13T11:29:06.306 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:06.299+0000 7f69f65f8640 1 -- 172.21.15.102:0/3888553637 shutdown_connections 2023-11-13T11:29:06.306 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:06.299+0000 7f69f65f8640 1 --2- 172.21.15.102:0/3888553637 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f69f00cfe80 0x7f69f015dbc0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:06.306 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:06.299+0000 7f69f65f8640 1 --2- 172.21.15.102:0/3888553637 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f69f00b4cb0 0x7f69f01602b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:06.306 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:06.299+0000 7f69f65f8640 1 --2- 172.21.15.102:0/3888553637 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f69d40664c0 0x7f69d4068980 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:06.307 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:06.299+0000 7f69f65f8640 1 --2- 172.21.15.102:0/3888553637 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f69f006ae50 0x7f69f0154810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:06.307 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:06.299+0000 7f69f65f8640 1 -- 172.21.15.102:0/3888553637 >> 172.21.15.102:0/3888553637 conn(0x7f69f00b83f0 msgr2=0x7f69f00cd7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-13T11:29:06.307 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:06.299+0000 7f69f65f8640 1 -- 172.21.15.102:0/3888553637 shutdown_connections 2023-11-13T11:29:06.307 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:06.299+0000 7f69f65f8640 1 -- 172.21.15.102:0/3888553637 wait complete. 2023-11-13T11:29:06.312 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:06.307+0000 7f99311f8640 1 -- 172.21.15.102:0/2618792003 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f99100057e0 con 0x7f992c070e10 2023-11-13T11:29:06.313 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:06.307+0000 7f99237fe640 1 -- 172.21.15.102:0/2618792003 <== mon.1 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f991c053ed0 con 0x7f992c070e10 2023-11-13T11:29:06.315 INFO:teuthology.orchestra.run.smithi102.stdout:64424509447 2023-11-13T11:29:06.317 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:06.311+0000 7f99311f8640 1 -- 172.21.15.102:0/2618792003 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f990c0664c0 msgr2=0x7f990c068980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:06.317 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:06.311+0000 7f99311f8640 1 --2- 172.21.15.102:0/2618792003 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f990c0664c0 0x7f990c068980 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f99240b7000 tx=0x7f99240af070 comp rx=0 tx=0).stop 2023-11-13T11:29:06.317 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:06.311+0000 7f99311f8640 1 -- 172.21.15.102:0/2618792003 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f992c070e10 msgr2=0x7f992c2025e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:06.318 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:06.311+0000 7f99311f8640 1 --2- 172.21.15.102:0/2618792003 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f992c070e10 0x7f992c2025e0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f991c00c4d0 tx=0x7f991c00c990 comp rx=0 tx=0).stop 2023-11-13T11:29:06.318 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:06.311+0000 7f99311f8640 1 -- 172.21.15.102:0/2618792003 shutdown_connections 2023-11-13T11:29:06.318 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:06.311+0000 7f99311f8640 1 --2- 172.21.15.102:0/2618792003 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f992c15d060 0x7f992c1434e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:06.318 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:06.311+0000 7f99311f8640 1 --2- 172.21.15.102:0/2618792003 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f992c070e10 0x7f992c2025e0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:06.319 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:06.311+0000 7f99311f8640 1 --2- 172.21.15.102:0/2618792003 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f990c0664c0 0x7f990c068980 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:06.319 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:06.311+0000 7f99311f8640 1 --2- 172.21.15.102:0/2618792003 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f992c06fb60 0x7f992c0cda00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:06.319 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:06.311+0000 7f99311f8640 1 -- 172.21.15.102:0/2618792003 >> 172.21.15.102:0/2618792003 conn(0x7f992c0b05b0 msgr2=0x7f992c0af060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-13T11:29:06.320 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:06.311+0000 7f99311f8640 1 -- 172.21.15.102:0/2618792003 shutdown_connections 2023-11-13T11:29:06.320 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:06.311+0000 7f99311f8640 1 -- 172.21.15.102:0/2618792003 wait complete. 2023-11-13T11:29:06.321 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:06.311+0000 7f44c2df5640 1 -- 172.21.15.102:0/3020216701 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f44bc158160 con 0x7f44bc1404d0 2023-11-13T11:29:06.321 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:06.311+0000 7f44b97fa640 1 -- 172.21.15.102:0/3020216701 <== mon.1 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f44bc158160 con 0x7f44bc1404d0 2023-11-13T11:29:06.321 INFO:teuthology.orchestra.run.smithi102.stdout:64424509447 2023-11-13T11:29:06.322 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:06.315+0000 7f32378c9640 1 -- 172.21.15.102:0/496292351 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f32100057e0 con 0x7f323015d1a0 2023-11-13T11:29:06.323 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:06.315+0000 7f44c2df5640 1 -- 172.21.15.102:0/3020216701 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f44a80664a0 msgr2=0x7f44a8068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:06.323 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:06.315+0000 7f44c2df5640 1 --2- 172.21.15.102:0/3020216701 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f44a80664a0 0x7f44a8068960 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f44b40012f0 tx=0x7f44b4005ec0 comp rx=0 tx=0).stop 2023-11-13T11:29:06.323 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:06.315+0000 7f44c2df5640 1 -- 172.21.15.102:0/3020216701 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f44bc1404d0 msgr2=0x7f44bc137970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:06.323 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:06.315+0000 7f44c2df5640 1 --2- 172.21.15.102:0/3020216701 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f44bc1404d0 0x7f44bc137970 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f44ac0b0040 tx=0x7f44ac019250 comp rx=0 tx=0).stop 2023-11-13T11:29:06.324 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:06.315+0000 7f322dffb640 1 -- 172.21.15.102:0/496292351 <== mon.1 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f3228017030 con 0x7f323015d1a0 2023-11-13T11:29:06.325 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:06.315+0000 7f44c2df5640 1 -- 172.21.15.102:0/3020216701 shutdown_connections 2023-11-13T11:29:06.325 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:06.315+0000 7f44c2df5640 1 --2- 172.21.15.102:0/3020216701 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f44bc1404d0 0x7f44bc137970 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:06.325 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:06.315+0000 7f44c2df5640 1 --2- 172.21.15.102:0/3020216701 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f44bc0cd9d0 0x7f44bc156830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:06.325 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:06.315+0000 7f44c2df5640 1 --2- 172.21.15.102:0/3020216701 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f44a80664a0 0x7f44a8068960 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:06.326 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:06.315+0000 7f44c2df5640 1 --2- 172.21.15.102:0/3020216701 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f44bc0b3a30 0x7f44bc1562f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:06.326 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:06.315+0000 7f44c2df5640 1 -- 172.21.15.102:0/3020216701 >> 172.21.15.102:0/3020216701 conn(0x7f44bc0cb5c0 msgr2=0x7f44bc155930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-13T11:29:06.326 INFO:teuthology.orchestra.run.smithi102.stdout:64424509446 2023-11-13T11:29:06.327 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:06.315+0000 7f44c2df5640 1 -- 172.21.15.102:0/3020216701 shutdown_connections 2023-11-13T11:29:06.327 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:06.315+0000 7f44c2df5640 1 -- 172.21.15.102:0/3020216701 wait complete. 2023-11-13T11:29:06.328 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:06.319+0000 7f32378c9640 1 -- 172.21.15.102:0/496292351 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f321c066470 msgr2=0x7f321c068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:06.328 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:06.319+0000 7f32378c9640 1 --2- 172.21.15.102:0/496292351 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f321c066470 0x7f321c068930 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f322001a510 tx=0x7f32200a7070 comp rx=0 tx=0).stop 2023-11-13T11:29:06.328 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:06.319+0000 7f32378c9640 1 -- 172.21.15.102:0/496292351 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f323015d1a0 msgr2=0x7f3230160f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:06.328 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:06.319+0000 7f32378c9640 1 --2- 172.21.15.102:0/496292351 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f323015d1a0 0x7f3230160f30 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f322800c410 tx=0x7f322800c8d0 comp rx=0 tx=0).stop 2023-11-13T11:29:06.329 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:06.319+0000 7f32378c9640 1 -- 172.21.15.102:0/496292351 shutdown_connections 2023-11-13T11:29:06.329 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:06.319+0000 7f32378c9640 1 --2- 172.21.15.102:0/496292351 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f323015d1a0 0x7f3230160f30 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:06.329 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:06.319+0000 7f32378c9640 1 --2- 172.21.15.102:0/496292351 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f32300cd9d0 0x7f3230152bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:06.330 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:06.319+0000 7f32378c9640 1 --2- 172.21.15.102:0/496292351 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f321c066470 0x7f321c068930 secure :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f322001a510 tx=0x7f32200a7070 comp rx=0 tx=0).stop 2023-11-13T11:29:06.330 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:06.319+0000 7f32378c9640 1 --2- 172.21.15.102:0/496292351 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f32300718a0 0x7f323015a8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:06.330 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:06.319+0000 7f32378c9640 1 -- 172.21.15.102:0/496292351 >> 172.21.15.102:0/496292351 conn(0x7f32300cb5c0 msgr2=0x7f323016c3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-13T11:29:06.331 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:06.323+0000 7f32378c9640 1 -- 172.21.15.102:0/496292351 shutdown_connections 2023-11-13T11:29:06.331 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:06.323+0000 7f32378c9640 1 -- 172.21.15.102:0/496292351 wait complete. 2023-11-13T11:29:06.332 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509446 got 64424509446 for osd.6 2023-11-13T11:29:06.332 DEBUG:teuthology.parallel:result is None 2023-11-13T11:29:06.336 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:06.331+0000 7f4e2ddb8640 1 -- 172.21.15.102:0/1506869798 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7f4e28165b90 con 0x7f4e10005270 2023-11-13T11:29:06.337 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:06.331+0000 7f4e0ffff640 1 -- 172.21.15.102:0/1506869798 <== mon.2 v2:172.21.15.154:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f4e28165b90 con 0x7f4e10005270 2023-11-13T11:29:06.337 INFO:teuthology.orchestra.run.smithi102.stdout:60129542151 2023-11-13T11:29:06.342 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:06.335+0000 7f4e2ddb8640 1 -- 172.21.15.102:0/1506869798 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f4e140664c0 msgr2=0x7f4e14068980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:06.342 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:06.335+0000 7f4e2ddb8640 1 --2- 172.21.15.102:0/1506869798 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f4e140664c0 0x7f4e14068980 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f4e18000fc0 tx=0x7f4e18009040 comp rx=0 tx=0).stop 2023-11-13T11:29:06.342 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:06.335+0000 7f4e2ddb8640 1 -- 172.21.15.102:0/1506869798 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4e10005270 msgr2=0x7f4e280aea40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:06.342 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:06.335+0000 7f4e2ddb8640 1 --2- 172.21.15.102:0/1506869798 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4e10005270 0x7f4e280aea40 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f4e1c005fa0 tx=0x7f4e1c001700 comp rx=0 tx=0).stop 2023-11-13T11:29:06.343 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:06.335+0000 7f4e2ddb8640 1 -- 172.21.15.102:0/1506869798 shutdown_connections 2023-11-13T11:29:06.343 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:06.335+0000 7f4e2ddb8640 1 --2- 172.21.15.102:0/1506869798 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4e281614c0 0x7f4e28147800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:06.343 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:06.335+0000 7f4e2ddb8640 1 --2- 172.21.15.102:0/1506869798 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f4e140664c0 0x7f4e14068980 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:06.343 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:06.335+0000 7f4e2ddb8640 1 --2- 172.21.15.102:0/1506869798 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4e28165000 0x7f4e28160f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:06.343 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:06.335+0000 7f4e2ddb8640 1 --2- 172.21.15.102:0/1506869798 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4e10005270 0x7f4e280aea40 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:06.344 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:06.335+0000 7f4e2ddb8640 1 -- 172.21.15.102:0/1506869798 >> 172.21.15.102:0/1506869798 conn(0x7f4e280b0870 msgr2=0x7f4e280afd40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-13T11:29:06.344 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:06.335+0000 7f4e2ddb8640 1 -- 172.21.15.102:0/1506869798 shutdown_connections 2023-11-13T11:29:06.344 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:06.335+0000 7f4e2ddb8640 1 -- 172.21.15.102:0/1506869798 wait complete. 2023-11-13T11:29:06.346 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509447 got 64424509447 for osd.0 2023-11-13T11:29:06.346 DEBUG:teuthology.parallel:result is None 2023-11-13T11:29:06.347 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:06.339+0000 7fce767fc640 1 -- 172.21.15.102:0/3980496509 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7fce9014b720 con 0x7fce901591f0 2023-11-13T11:29:06.347 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:06.343+0000 7fce8cff9640 1 -- 172.21.15.102:0/3980496509 <== mon.1 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fce9014b720 con 0x7fce901591f0 2023-11-13T11:29:06.347 INFO:teuthology.orchestra.run.smithi102.stdout:64424509445 2023-11-13T11:29:06.348 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:06.343+0000 7f5be9232640 1 -- 172.21.15.102:0/1578529510 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7f5bc4005510 con 0x7f5be40b1c50 2023-11-13T11:29:06.349 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:06.343+0000 7f5bcb7fe640 1 -- 172.21.15.102:0/1578529510 <== mon.1 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f5bd4054ab0 con 0x7f5be40b1c50 2023-11-13T11:29:06.349 INFO:teuthology.orchestra.run.smithi102.stdout:64424509446 2023-11-13T11:29:06.350 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:06.343+0000 7fce767fc640 1 -- 172.21.15.102:0/3980496509 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7fce7c0664d0 msgr2=0x7fce7c068990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:06.350 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:06.343+0000 7fce767fc640 1 --2- 172.21.15.102:0/3980496509 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7fce7c0664d0 0x7fce7c068990 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fce900b3e10 tx=0x7fce800079d0 comp rx=0 tx=0).stop 2023-11-13T11:29:06.351 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:06.343+0000 7fce767fc640 1 -- 172.21.15.102:0/3980496509 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fce901591f0 msgr2=0x7fce90157b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:06.351 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:06.343+0000 7fce767fc640 1 --2- 172.21.15.102:0/3980496509 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fce901591f0 0x7fce90157b70 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fce880af040 tx=0x7fce88019780 comp rx=0 tx=0).stop 2023-11-13T11:29:06.351 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:06.343+0000 7fce767fc640 1 -- 172.21.15.102:0/3980496509 shutdown_connections 2023-11-13T11:29:06.351 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:06.343+0000 7fce767fc640 1 --2- 172.21.15.102:0/3980496509 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fce901591f0 0x7fce90157b70 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:06.351 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:06.343+0000 7fce767fc640 1 --2- 172.21.15.102:0/3980496509 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fce900cd9d0 0x7fce90148ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:06.352 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:06.343+0000 7fce767fc640 1 --2- 172.21.15.102:0/3980496509 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7fce7c0664d0 0x7fce7c068990 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:06.352 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:06.343+0000 7fce767fc640 1 --2- 172.21.15.102:0/3980496509 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fce900cc0e0 0x7fce901f9af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:06.352 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:06.343+0000 7fce767fc640 1 -- 172.21.15.102:0/3980496509 >> 172.21.15.102:0/3980496509 conn(0x7fce900cb5c0 msgr2=0x7fce900cb9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-13T11:29:06.352 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:06.343+0000 7fce767fc640 1 -- 172.21.15.102:0/3980496509 shutdown_connections 2023-11-13T11:29:06.352 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:06.343+0000 7fce767fc640 1 -- 172.21.15.102:0/3980496509 wait complete. 2023-11-13T11:29:06.353 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509447 got 64424509447 for osd.1 2023-11-13T11:29:06.354 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:06.347+0000 7f5be9232640 1 -- 172.21.15.102:0/1578529510 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f5bd0066540 msgr2=0x7f5bd0068a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:06.354 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:06.347+0000 7f5be9232640 1 --2- 172.21.15.102:0/1578529510 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f5bd0066540 0x7f5bd0068a00 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f5be40ac820 tx=0x7f5bd8008040 comp rx=0 tx=0).stop 2023-11-13T11:29:06.354 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:06.347+0000 7f5be9232640 1 -- 172.21.15.102:0/1578529510 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5be40b1c50 msgr2=0x7f5be4154a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:06.355 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:06.347+0000 7f5be9232640 1 --2- 172.21.15.102:0/1578529510 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5be40b1c50 0x7f5be4154a10 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f5bd400e980 tx=0x7f5bd400ee40 comp rx=0 tx=0).stop 2023-11-13T11:29:06.355 DEBUG:teuthology.parallel:result is None 2023-11-13T11:29:06.356 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:06.351+0000 7f5be9232640 1 -- 172.21.15.102:0/1578529510 shutdown_connections 2023-11-13T11:29:06.356 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:06.351+0000 7f5be9232640 1 --2- 172.21.15.102:0/1578529510 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5be415d1a0 0x7f5be4157320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:06.356 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:06.351+0000 7f5be9232640 1 --2- 172.21.15.102:0/1578529510 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f5bd0066540 0x7f5bd0068a00 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:06.357 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:06.351+0000 7f5be9232640 1 --2- 172.21.15.102:0/1578529510 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5be40cd9d0 0x7f5be4156de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:06.357 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:06.351+0000 7f5be9232640 1 --2- 172.21.15.102:0/1578529510 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5be40b1c50 0x7f5be4154a10 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:06.357 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:06.351+0000 7f5be9232640 1 -- 172.21.15.102:0/1578529510 >> 172.21.15.102:0/1578529510 conn(0x7f5be40cb5c0 msgr2=0x7f5be415ae90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-13T11:29:06.357 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:06.351+0000 7f5be9232640 1 -- 172.21.15.102:0/1578529510 shutdown_connections 2023-11-13T11:29:06.357 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:06.351+0000 7f5be9232640 1 -- 172.21.15.102:0/1578529510 wait complete. 2023-11-13T11:29:06.364 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509446 got 64424509446 for osd.3 2023-11-13T11:29:06.364 DEBUG:teuthology.parallel:result is None 2023-11-13T11:29:06.372 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542150 got 60129542151 for osd.7 2023-11-13T11:29:06.373 DEBUG:teuthology.parallel:result is None 2023-11-13T11:29:06.382 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509445 got 64424509445 for osd.4 2023-11-13T11:29:06.382 DEBUG:teuthology.parallel:result is None 2023-11-13T11:29:06.384 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509446 got 64424509446 for osd.5 2023-11-13T11:29:06.384 DEBUG:teuthology.parallel:result is None 2023-11-13T11:29:06.385 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2023-11-13T11:29:06.385 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-13T11:29:06.562 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:06.555+0000 7f0e74972640 1 Processor -- start 2023-11-13T11:29:06.562 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:06.555+0000 7f0e74972640 1 -- start start 2023-11-13T11:29:06.563 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:06.559+0000 7f0e74972640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f0e70140540 0x7f0e7015e3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:06.563 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:06.559+0000 7f0e74972640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0e7015e910 con 0x7f0e70071900 2023-11-13T11:29:06.564 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:06.559+0000 7f0e74972640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0e70140920 con 0x7f0e7006caa0 2023-11-13T11:29:06.564 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:06.559+0000 7f0e74972640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0e700ccc50 con 0x7f0e70140540 2023-11-13T11:29:06.564 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:06.559+0000 7f0e6ed9d640 1 --1- >> v1:172.21.15.102:6789/0 conn(0x7f0e70071900 0x7f0e700b1c00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.102:6789/0 says I am v1:172.21.15.102:48018/0 (socket says 172.21.15.102:48018) 2023-11-13T11:29:06.564 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:06.559+0000 7f0e6ed9d640 1 -- 172.21.15.102:0/1277951490 learned_addr learned my addr 172.21.15.102:0/1277951490 (peer_addr_for_me v1:172.21.15.102:0/0) 2023-11-13T11:29:06.565 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:06.559+0000 7f0e6e59c640 1 --2- 172.21.15.102:0/1277951490 >> v2:172.21.15.154:3300/0 conn(0x7f0e70140540 0x7f0e7015e3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:06.565 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:06.559+0000 7f0e6dd9b640 1 -- 172.21.15.102:0/1277951490 <== mon.0 v1:172.21.15.102:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1917441028 0 0) 0x7f0e680014a0 con 0x7f0e70071900 2023-11-13T11:29:06.566 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:06.559+0000 7f0e6dd9b640 1 -- 172.21.15.102:0/1277951490 --> v1:172.21.15.102:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0e5c005740 con 0x7f0e70071900 2023-11-13T11:29:06.566 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:06.559+0000 7f0e6e59c640 1 -- 172.21.15.102:0/1277951490 >> v1:172.21.15.154:6789/0 conn(0x7f0e7006caa0 legacy=0x7f0e700711f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:06.566 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:06.559+0000 7f0e6e59c640 1 -- 172.21.15.102:0/1277951490 >> v1:172.21.15.102:6789/0 conn(0x7f0e70071900 legacy=0x7f0e700b1c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:06.566 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:06.559+0000 7f0e6e59c640 1 -- 172.21.15.102:0/1277951490 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e7006cfc0 con 0x7f0e70140540 2023-11-13T11:29:06.567 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:06.563+0000 7f0e6e59c640 1 --2- 172.21.15.102:0/1277951490 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0e70140540 0x7f0e7015e3d0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f0e600097c0 tx=0x7f0e6001c450 comp rx=0 tx=0).ready entity=mon.1 client_cookie=55c043752c19ff06 server_cookie=0 in_seq=0 out_seq=0 2023-11-13T11:29:06.567 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:06.563+0000 7f0e6dd9b640 1 -- 172.21.15.102:0/1277951490 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e600ab650 con 0x7f0e70140540 2023-11-13T11:29:06.568 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:06.563+0000 7f0e6dd9b640 1 -- 172.21.15.102:0/1277951490 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e600ab7b0 con 0x7f0e70140540 2023-11-13T11:29:06.568 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:06.563+0000 7f0e6dd9b640 1 -- 172.21.15.102:0/1277951490 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e600abb40 con 0x7f0e70140540 2023-11-13T11:29:06.569 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:06.563+0000 7f0e74972640 1 -- 172.21.15.102:0/1277951490 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0e70140540 msgr2=0x7f0e7015e3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:06.569 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:06.563+0000 7f0e74972640 1 --2- 172.21.15.102:0/1277951490 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0e70140540 0x7f0e7015e3d0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f0e600097c0 tx=0x7f0e6001c450 comp rx=0 tx=0).stop 2023-11-13T11:29:06.570 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:06.563+0000 7f0e74972640 1 -- 172.21.15.102:0/1277951490 shutdown_connections 2023-11-13T11:29:06.570 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:06.563+0000 7f0e74972640 1 --2- 172.21.15.102:0/1277951490 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0e70140540 0x7f0e7015e3d0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:06.570 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:06.563+0000 7f0e74972640 1 -- 172.21.15.102:0/1277951490 >> 172.21.15.102:0/1277951490 conn(0x7f0e700b0870 msgr2=0x7f0e700b0c80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-13T11:29:06.570 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:06.563+0000 7f0e74972640 1 -- 172.21.15.102:0/1277951490 shutdown_connections 2023-11-13T11:29:06.571 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:06.563+0000 7f0e74972640 1 -- 172.21.15.102:0/1277951490 wait complete. 2023-11-13T11:29:06.573 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:06.563+0000 7f0e74972640 1 Processor -- start 2023-11-13T11:29:06.573 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:06.563+0000 7f0e74972640 1 -- start start 2023-11-13T11:29:06.573 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:06.567+0000 7f0e74972640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0e7006caa0 0x7f0e70160120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:06.573 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:06.567+0000 7f0e74972640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0e70071900 0x7f0e70156ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:06.574 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:06.567+0000 7f0e74972640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0e70140540 0x7f0e70157220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:06.574 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:06.567+0000 7f0e74972640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e70161180 con 0x7f0e7006caa0 2023-11-13T11:29:06.574 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:06.567+0000 7f0e74972640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e70160660 con 0x7f0e70140540 2023-11-13T11:29:06.574 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:06.567+0000 7f0e74972640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e701608e0 con 0x7f0e70071900 2023-11-13T11:29:06.575 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:06.567+0000 7f0e6e59c640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0e7006caa0 0x7f0e70160120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:06.575 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:06.567+0000 7f0e6e59c640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0e7006caa0 0x7f0e70160120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:36566/0 (socket says 172.21.15.102:36566) 2023-11-13T11:29:06.575 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:06.567+0000 7f0e6e59c640 1 -- 172.21.15.102:0/1182457935 learned_addr learned my addr 172.21.15.102:0/1182457935 (peer_addr_for_me v2:172.21.15.102:0/0) 2023-11-13T11:29:06.575 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:06.567+0000 7f0e6ed9d640 1 --2- 172.21.15.102:0/1182457935 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0e70140540 0x7f0e70157220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:06.575 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:06.567+0000 7f0e65d9b640 1 --2- 172.21.15.102:0/1182457935 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0e70071900 0x7f0e70156ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:06.576 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:06.567+0000 7f0e6e59c640 1 -- 172.21.15.102:0/1182457935 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0e70071900 msgr2=0x7f0e70156ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:06.576 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:06.567+0000 7f0e6e59c640 1 --2- 172.21.15.102:0/1182457935 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0e70071900 0x7f0e70156ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:06.576 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:06.567+0000 7f0e6e59c640 1 -- 172.21.15.102:0/1182457935 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0e70140540 msgr2=0x7f0e70157220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:06.576 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:06.567+0000 7f0e6e59c640 1 --2- 172.21.15.102:0/1182457935 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0e70140540 0x7f0e70157220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:06.576 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:06.567+0000 7f0e6e59c640 1 -- 172.21.15.102:0/1182457935 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e60009420 con 0x7f0e7006caa0 2023-11-13T11:29:06.577 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:06.567+0000 7f0e65d9b640 1 --2- 172.21.15.102:0/1182457935 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0e70071900 0x7f0e70156ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-13T11:29:06.577 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:06.567+0000 7f0e6e59c640 1 --2- 172.21.15.102:0/1182457935 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0e7006caa0 0x7f0e70160120 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f0e600ad040 tx=0x7f0e6001ac90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-13T11:29:06.577 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:06.567+0000 7f0e677fe640 1 -- 172.21.15.102:0/1182457935 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e600bf610 con 0x7f0e7006caa0 2023-11-13T11:29:06.577 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:06.567+0000 7f0e677fe640 1 -- 172.21.15.102:0/1182457935 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e600bf770 con 0x7f0e7006caa0 2023-11-13T11:29:06.577 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:06.567+0000 7f0e677fe640 1 -- 172.21.15.102:0/1182457935 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e600bfb20 con 0x7f0e7006caa0 2023-11-13T11:29:06.578 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:06.567+0000 7f0e74972640 1 -- 172.21.15.102:0/1182457935 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0e70160bc0 con 0x7f0e7006caa0 2023-11-13T11:29:06.578 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:06.567+0000 7f0e74972640 1 -- 172.21.15.102:0/1182457935 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0e7012c460 con 0x7f0e7006caa0 2023-11-13T11:29:06.579 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:06.567+0000 7f0e74972640 1 -- 172.21.15.102:0/1182457935 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0e70151e10 con 0x7f0e7006caa0 2023-11-13T11:29:06.579 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:06.571+0000 7f0e677fe640 1 -- 172.21.15.102:0/1182457935 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f0e600bfc80 con 0x7f0e7006caa0 2023-11-13T11:29:06.579 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:06.571+0000 7f0e677fe640 1 --2- 172.21.15.102:0/1182457935 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f0e50066470 0x7f0e50068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:06.579 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:06.571+0000 7f0e677fe640 1 -- 172.21.15.102:0/1182457935 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f0e6011e950 con 0x7f0e7006caa0 2023-11-13T11:29:06.580 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:06.571+0000 7f0e65d9b640 1 --2- 172.21.15.102:0/1182457935 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f0e50066470 0x7f0e50068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:06.580 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:06.571+0000 7f0e65d9b640 1 --2- 172.21.15.102:0/1182457935 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f0e50066470 0x7f0e50068930 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f0e701646b0 tx=0x7f0e58009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-13T11:29:06.580 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:06.575+0000 7f0e677fe640 1 -- 172.21.15.102:0/1182457935 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f0e600ebe70 con 0x7f0e7006caa0 2023-11-13T11:29:06.728 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:06.723+0000 7f0e74972640 1 -- 172.21.15.102:0/1182457935 --> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f0e7006db40 con 0x7f0e50066470 2023-11-13T11:29:06.734 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:06.727+0000 7f0e677fe640 1 -- 172.21.15.102:0/1182457935 <== mgr.4103 v2:172.21.15.102:6832/1009482693 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+264598 (secure 0 0 0) 0x7f0e580013f0 con 0x7f0e50066470 2023-11-13T11:29:06.737 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T11:29:06.740 INFO:teuthology.orchestra.run.smithi102.stderr:dumped all 2023-11-13T11:29:06.741 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:06.731+0000 7f0e74972640 1 -- 172.21.15.102:0/1182457935 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f0e50066470 msgr2=0x7f0e50068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:06.741 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:06.731+0000 7f0e74972640 1 --2- 172.21.15.102:0/1182457935 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f0e50066470 0x7f0e50068930 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f0e701646b0 tx=0x7f0e58009040 comp rx=0 tx=0).stop 2023-11-13T11:29:06.741 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:06.731+0000 7f0e74972640 1 -- 172.21.15.102:0/1182457935 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0e7006caa0 msgr2=0x7f0e70160120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:06.741 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:06.731+0000 7f0e74972640 1 --2- 172.21.15.102:0/1182457935 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0e7006caa0 0x7f0e70160120 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f0e600ad040 tx=0x7f0e6001ac90 comp rx=0 tx=0).stop 2023-11-13T11:29:06.742 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:06.731+0000 7f0e74972640 1 -- 172.21.15.102:0/1182457935 shutdown_connections 2023-11-13T11:29:06.742 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:06.731+0000 7f0e74972640 1 --2- 172.21.15.102:0/1182457935 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0e70140540 0x7f0e70157220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:06.742 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:06.731+0000 7f0e74972640 1 --2- 172.21.15.102:0/1182457935 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0e70071900 0x7f0e70156ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:06.742 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:06.731+0000 7f0e74972640 1 --2- 172.21.15.102:0/1182457935 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f0e50066470 0x7f0e50068930 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:06.742 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:06.731+0000 7f0e74972640 1 --2- 172.21.15.102:0/1182457935 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0e7006caa0 0x7f0e70160120 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:06.743 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:06.731+0000 7f0e74972640 1 -- 172.21.15.102:0/1182457935 >> 172.21.15.102:0/1182457935 conn(0x7f0e700b0870 msgr2=0x7f0e700b0c50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-13T11:29:06.743 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:06.731+0000 7f0e74972640 1 -- 172.21.15.102:0/1182457935 shutdown_connections 2023-11-13T11:29:06.743 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:06.731+0000 7f0e74972640 1 -- 172.21.15.102:0/1182457935 wait complete. 2023-11-13T11:29:06.757 INFO:teuthology.orchestra.run.smithi102.stdout:{"pg_ready":true,"pg_map":{"version":26,"stamp":"2023-11-13T11:29:04.924356+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219116,"kb_used_data":2944,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755604,"statfs":{"total":773094113280,"available":772869738496,"internally_reserved":0,"allocated":3014656,"data_stored":1793634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"7.907290"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-13T11:28:58.677490+0000","last_change":"2023-11-13T11:28:57.639845+0000","last_active":"2023-11-13T11:28:58.677490+0000","last_peered":"2023-11-13T11:28:58.677490+0000","last_clean":"2023-11-13T11:28:58.677490+0000","last_became_active":"2023-11-13T11:28:57.639218+0000","last_became_peered":"2023-11-13T11:28:57.639218+0000","last_unstale":"2023-11-13T11:28:58.677490+0000","last_undegraded":"2023-11-13T11:28:58.677490+0000","last_fullsized":"2023-11-13T11:28:58.677490+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-13T11:28:57.010879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-13T11:28:57.010879+0000","last_clean_scrub_stamp":"2023-11-13T11:28:57.010879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-14T22:49:31.708378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-13T11:28:58.677700+0000","last_change":"2023-11-13T11:28:57.627422+0000","last_active":"2023-11-13T11:28:58.677700+0000","last_peered":"2023-11-13T11:28:58.677700+0000","last_clean":"2023-11-13T11:28:58.677700+0000","last_became_active":"2023-11-13T11:28:57.627084+0000","last_became_peered":"2023-11-13T11:28:57.627084+0000","last_unstale":"2023-11-13T11:28:58.677700+0000","last_undegraded":"2023-11-13T11:28:58.677700+0000","last_fullsized":"2023-11-13T11:28:58.677700+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-13T11:28:57.010879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-13T11:28:57.010879+0000","last_clean_scrub_stamp":"2023-11-13T11:28:57.010879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-14T13:51:35.559492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-13T11:28:58.677559+0000","last_change":"2023-11-13T11:28:57.624354+0000","last_active":"2023-11-13T11:28:58.677559+0000","last_peered":"2023-11-13T11:28:58.677559+0000","last_clean":"2023-11-13T11:28:58.677559+0000","last_became_active":"2023-11-13T11:28:57.624146+0000","last_became_peered":"2023-11-13T11:28:57.624146+0000","last_unstale":"2023-11-13T11:28:58.677559+0000","last_undegraded":"2023-11-13T11:28:58.677559+0000","last_fullsized":"2023-11-13T11:28:58.677559+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-13T11:28:57.010879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-13T11:28:57.010879+0000","last_clean_scrub_stamp":"2023-11-13T11:28:57.010879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-14T18:39:09.544147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-13T11:28:58.616239+0000","last_change":"2023-11-13T11:28:57.631455+0000","last_active":"2023-11-13T11:28:58.616239+0000","last_peered":"2023-11-13T11:28:58.616239+0000","last_clean":"2023-11-13T11:28:58.616239+0000","last_became_active":"2023-11-13T11:28:57.630777+0000","last_became_peered":"2023-11-13T11:28:57.630777+0000","last_unstale":"2023-11-13T11:28:58.616239+0000","last_undegraded":"2023-11-13T11:28:58.616239+0000","last_fullsized":"2023-11-13T11:28:58.616239+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-13T11:28:57.010879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-13T11:28:57.010879+0000","last_clean_scrub_stamp":"2023-11-13T11:28:57.010879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-14T12:47:29.658403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-13T11:28:58.676950+0000","last_change":"2023-11-13T11:28:57.636281+0000","last_active":"2023-11-13T11:28:58.676950+0000","last_peered":"2023-11-13T11:28:58.676950+0000","last_clean":"2023-11-13T11:28:58.676950+0000","last_became_active":"2023-11-13T11:28:57.635550+0000","last_became_peered":"2023-11-13T11:28:57.635550+0000","last_unstale":"2023-11-13T11:28:58.676950+0000","last_undegraded":"2023-11-13T11:28:58.676950+0000","last_fullsized":"2023-11-13T11:28:58.676950+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-13T11:28:57.010879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-13T11:28:57.010879+0000","last_clean_scrub_stamp":"2023-11-13T11:28:57.010879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-14T22:20:14.170174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-13T11:28:58.616167+0000","last_change":"2023-11-13T11:28:57.638583+0000","last_active":"2023-11-13T11:28:58.616167+0000","last_peered":"2023-11-13T11:28:58.616167+0000","last_clean":"2023-11-13T11:28:58.616167+0000","last_became_active":"2023-11-13T11:28:57.638322+0000","last_became_peered":"2023-11-13T11:28:57.638322+0000","last_unstale":"2023-11-13T11:28:58.616167+0000","last_undegraded":"2023-11-13T11:28:58.616167+0000","last_fullsized":"2023-11-13T11:28:58.616167+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-13T11:28:57.010879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-13T11:28:57.010879+0000","last_clean_scrub_stamp":"2023-11-13T11:28:57.010879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-14T22:20:19.900579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-13T11:28:58.676818+0000","last_change":"2023-11-13T11:28:57.628322+0000","last_active":"2023-11-13T11:28:58.676818+0000","last_peered":"2023-11-13T11:28:58.676818+0000","last_clean":"2023-11-13T11:28:58.676818+0000","last_became_active":"2023-11-13T11:28:57.628022+0000","last_became_peered":"2023-11-13T11:28:57.628022+0000","last_unstale":"2023-11-13T11:28:58.676818+0000","last_undegraded":"2023-11-13T11:28:58.676818+0000","last_fullsized":"2023-11-13T11:28:58.676818+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-13T11:28:57.010879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-13T11:28:57.010879+0000","last_clean_scrub_stamp":"2023-11-13T11:28:57.010879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-14T16:47:11.682554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-13T11:28:58.676863+0000","last_change":"2023-11-13T11:28:57.635006+0000","last_active":"2023-11-13T11:28:58.676863+0000","last_peered":"2023-11-13T11:28:58.676863+0000","last_clean":"2023-11-13T11:28:58.676863+0000","last_became_active":"2023-11-13T11:28:57.634769+0000","last_became_peered":"2023-11-13T11:28:57.634769+0000","last_unstale":"2023-11-13T11:28:58.676863+0000","last_undegraded":"2023-11-13T11:28:58.676863+0000","last_fullsized":"2023-11-13T11:28:58.676863+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-13T11:28:57.010879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-13T11:28:57.010879+0000","last_clean_scrub_stamp":"2023-11-13T11:28:57.010879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-14T21:42:19.412264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-13T11:28:58.613659+0000","last_change":"2023-11-13T11:28:57.623676+0000","last_active":"2023-11-13T11:28:58.613659+0000","last_peered":"2023-11-13T11:28:58.613659+0000","last_clean":"2023-11-13T11:28:58.613659+0000","last_became_active":"2023-11-13T11:28:57.623400+0000","last_became_peered":"2023-11-13T11:28:57.623400+0000","last_unstale":"2023-11-13T11:28:58.613659+0000","last_undegraded":"2023-11-13T11:28:58.613659+0000","last_fullsized":"2023-11-13T11:28:58.613659+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-13T11:28:57.010879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-13T11:28:57.010879+0000","last_clean_scrub_stamp":"2023-11-13T11:28:57.010879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-14T17:58:40.870637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-13T11:28:58.677620+0000","last_change":"2023-11-13T11:28:57.636734+0000","last_active":"2023-11-13T11:28:58.677620+0000","last_peered":"2023-11-13T11:28:58.677620+0000","last_clean":"2023-11-13T11:28:58.677620+0000","last_became_active":"2023-11-13T11:28:57.636461+0000","last_became_peered":"2023-11-13T11:28:57.636461+0000","last_unstale":"2023-11-13T11:28:58.677620+0000","last_undegraded":"2023-11-13T11:28:58.677620+0000","last_fullsized":"2023-11-13T11:28:58.677620+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-13T11:28:57.010879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-13T11:28:57.010879+0000","last_clean_scrub_stamp":"2023-11-13T11:28:57.010879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-14T13:13:26.359918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-13T11:28:58.677026+0000","last_change":"2023-11-13T11:28:57.639520+0000","last_active":"2023-11-13T11:28:58.677026+0000","last_peered":"2023-11-13T11:28:58.677026+0000","last_clean":"2023-11-13T11:28:58.677026+0000","last_became_active":"2023-11-13T11:28:57.639240+0000","last_became_peered":"2023-11-13T11:28:57.639240+0000","last_unstale":"2023-11-13T11:28:58.677026+0000","last_undegraded":"2023-11-13T11:28:58.677026+0000","last_fullsized":"2023-11-13T11:28:58.677026+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-13T11:28:57.010879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-13T11:28:57.010879+0000","last_clean_scrub_stamp":"2023-11-13T11:28:57.010879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-14T18:39:09.544147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-13T11:28:58.677082+0000","last_change":"2023-11-13T11:28:57.634782+0000","last_active":"2023-11-13T11:28:58.677082+0000","last_peered":"2023-11-13T11:28:58.677082+0000","last_clean":"2023-11-13T11:28:58.677082+0000","last_became_active":"2023-11-13T11:28:57.634488+0000","last_became_peered":"2023-11-13T11:28:57.634488+0000","last_unstale":"2023-11-13T11:28:58.677082+0000","last_undegraded":"2023-11-13T11:28:58.677082+0000","last_fullsized":"2023-11-13T11:28:58.677082+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-13T11:28:57.010879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-13T11:28:57.010879+0000","last_clean_scrub_stamp":"2023-11-13T11:28:57.010879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-14T13:24:50.764716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-13T11:28:58.677279+0000","last_change":"2023-11-13T11:28:57.644331+0000","last_active":"2023-11-13T11:28:58.677279+0000","last_peered":"2023-11-13T11:28:58.677279+0000","last_clean":"2023-11-13T11:28:58.677279+0000","last_became_active":"2023-11-13T11:28:57.643877+0000","last_became_peered":"2023-11-13T11:28:57.643877+0000","last_unstale":"2023-11-13T11:28:58.677279+0000","last_undegraded":"2023-11-13T11:28:58.677279+0000","last_fullsized":"2023-11-13T11:28:58.677279+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-13T11:28:57.010879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-13T11:28:57.010879+0000","last_clean_scrub_stamp":"2023-11-13T11:28:57.010879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-14T17:58:40.870637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-13T11:28:58.677454+0000","last_change":"2023-11-13T11:28:57.632228+0000","last_active":"2023-11-13T11:28:58.677454+0000","last_peered":"2023-11-13T11:28:58.677454+0000","last_clean":"2023-11-13T11:28:58.677454+0000","last_became_active":"2023-11-13T11:28:57.631793+0000","last_became_peered":"2023-11-13T11:28:57.631793+0000","last_unstale":"2023-11-13T11:28:58.677454+0000","last_undegraded":"2023-11-13T11:28:58.677454+0000","last_fullsized":"2023-11-13T11:28:58.677454+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-13T11:28:57.010879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-13T11:28:57.010879+0000","last_clean_scrub_stamp":"2023-11-13T11:28:57.010879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-14T11:40:58.842068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-13T11:28:58.677021+0000","last_change":"2023-11-13T11:28:57.643105+0000","last_active":"2023-11-13T11:28:58.677021+0000","last_peered":"2023-11-13T11:28:58.677021+0000","last_clean":"2023-11-13T11:28:58.677021+0000","last_became_active":"2023-11-13T11:28:57.642876+0000","last_became_peered":"2023-11-13T11:28:57.642876+0000","last_unstale":"2023-11-13T11:28:58.677021+0000","last_undegraded":"2023-11-13T11:28:58.677021+0000","last_fullsized":"2023-11-13T11:28:58.677021+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-13T11:28:57.010879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-13T11:28:57.010879+0000","last_clean_scrub_stamp":"2023-11-13T11:28:57.010879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-14T23:10:03.463557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-13T11:28:58.675939+0000","last_change":"2023-11-13T11:28:57.632118+0000","last_active":"2023-11-13T11:28:58.675939+0000","last_peered":"2023-11-13T11:28:58.675939+0000","last_clean":"2023-11-13T11:28:58.675939+0000","last_became_active":"2023-11-13T11:28:57.631823+0000","last_became_peered":"2023-11-13T11:28:57.631823+0000","last_unstale":"2023-11-13T11:28:58.675939+0000","last_undegraded":"2023-11-13T11:28:58.675939+0000","last_fullsized":"2023-11-13T11:28:58.675939+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-13T11:28:57.010879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-13T11:28:57.010879+0000","last_clean_scrub_stamp":"2023-11-13T11:28:57.010879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-14T16:35:00.051619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-13T11:28:58.676578+0000","last_change":"2023-11-13T11:28:57.636613+0000","last_active":"2023-11-13T11:28:58.676578+0000","last_peered":"2023-11-13T11:28:58.676578+0000","last_clean":"2023-11-13T11:28:58.676578+0000","last_became_active":"2023-11-13T11:28:57.636361+0000","last_became_peered":"2023-11-13T11:28:57.636361+0000","last_unstale":"2023-11-13T11:28:58.676578+0000","last_undegraded":"2023-11-13T11:28:58.676578+0000","last_fullsized":"2023-11-13T11:28:58.676578+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-13T11:28:57.010879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-13T11:28:57.010879+0000","last_clean_scrub_stamp":"2023-11-13T11:28:57.010879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-14T22:52:54.214180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-13T11:28:58.677191+0000","last_change":"2023-11-13T11:28:57.642425+0000","last_active":"2023-11-13T11:28:58.677191+0000","last_peered":"2023-11-13T11:28:58.677191+0000","last_clean":"2023-11-13T11:28:58.677191+0000","last_became_active":"2023-11-13T11:28:57.641266+0000","last_became_peered":"2023-11-13T11:28:57.641266+0000","last_unstale":"2023-11-13T11:28:58.677191+0000","last_undegraded":"2023-11-13T11:28:58.677191+0000","last_fullsized":"2023-11-13T11:28:58.677191+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-13T11:28:57.010879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-13T11:28:57.010879+0000","last_clean_scrub_stamp":"2023-11-13T11:28:57.010879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-14T13:10:19.954130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-13T11:28:58.676577+0000","last_change":"2023-11-13T11:28:57.637356+0000","last_active":"2023-11-13T11:28:58.676577+0000","last_peered":"2023-11-13T11:28:58.676577+0000","last_clean":"2023-11-13T11:28:58.676577+0000","last_became_active":"2023-11-13T11:28:57.637069+0000","last_became_peered":"2023-11-13T11:28:57.637069+0000","last_unstale":"2023-11-13T11:28:58.676577+0000","last_undegraded":"2023-11-13T11:28:58.676577+0000","last_fullsized":"2023-11-13T11:28:58.676577+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-13T11:28:57.010879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-13T11:28:57.010879+0000","last_clean_scrub_stamp":"2023-11-13T11:28:57.010879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-14T21:53:05.134410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-13T11:28:58.677142+0000","last_change":"2023-11-13T11:28:57.636634+0000","last_active":"2023-11-13T11:28:58.677142+0000","last_peered":"2023-11-13T11:28:58.677142+0000","last_clean":"2023-11-13T11:28:58.677142+0000","last_became_active":"2023-11-13T11:28:57.636278+0000","last_became_peered":"2023-11-13T11:28:57.636278+0000","last_unstale":"2023-11-13T11:28:58.677142+0000","last_undegraded":"2023-11-13T11:28:58.677142+0000","last_fullsized":"2023-11-13T11:28:58.677142+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-13T11:28:57.010879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-13T11:28:57.010879+0000","last_clean_scrub_stamp":"2023-11-13T11:28:57.010879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-14T13:51:35.559492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-13T11:28:58.617298+0000","last_change":"2023-11-13T11:28:57.633282+0000","last_active":"2023-11-13T11:28:58.617298+0000","last_peered":"2023-11-13T11:28:58.617298+0000","last_clean":"2023-11-13T11:28:58.617298+0000","last_became_active":"2023-11-13T11:28:57.633008+0000","last_became_peered":"2023-11-13T11:28:57.633008+0000","last_unstale":"2023-11-13T11:28:58.617298+0000","last_undegraded":"2023-11-13T11:28:58.617298+0000","last_fullsized":"2023-11-13T11:28:58.617298+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-13T11:28:57.010879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-13T11:28:57.010879+0000","last_clean_scrub_stamp":"2023-11-13T11:28:57.010879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-14T12:34:10.639080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-13T11:28:58.613391+0000","last_change":"2023-11-13T11:28:57.639417+0000","last_active":"2023-11-13T11:28:58.613391+0000","last_peered":"2023-11-13T11:28:58.613391+0000","last_clean":"2023-11-13T11:28:58.613391+0000","last_became_active":"2023-11-13T11:28:57.639132+0000","last_became_peered":"2023-11-13T11:28:57.639132+0000","last_unstale":"2023-11-13T11:28:58.613391+0000","last_undegraded":"2023-11-13T11:28:58.613391+0000","last_fullsized":"2023-11-13T11:28:58.613391+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-13T11:28:57.010879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-13T11:28:57.010879+0000","last_clean_scrub_stamp":"2023-11-13T11:28:57.010879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-14T12:47:29.658403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-13T11:28:58.677488+0000","last_change":"2023-11-13T11:28:57.633636+0000","last_active":"2023-11-13T11:28:58.677488+0000","last_peered":"2023-11-13T11:28:58.677488+0000","last_clean":"2023-11-13T11:28:58.677488+0000","last_became_active":"2023-11-13T11:28:57.632529+0000","last_became_peered":"2023-11-13T11:28:57.632529+0000","last_unstale":"2023-11-13T11:28:58.677488+0000","last_undegraded":"2023-11-13T11:28:58.677488+0000","last_fullsized":"2023-11-13T11:28:58.677488+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-13T11:28:57.010879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-13T11:28:57.010879+0000","last_clean_scrub_stamp":"2023-11-13T11:28:57.010879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-14T22:20:14.170174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-13T11:28:58.675948+0000","last_change":"2023-11-13T11:28:57.630397+0000","last_active":"2023-11-13T11:28:58.675948+0000","last_peered":"2023-11-13T11:28:58.675948+0000","last_clean":"2023-11-13T11:28:58.675948+0000","last_became_active":"2023-11-13T11:28:57.630049+0000","last_became_peered":"2023-11-13T11:28:57.630049+0000","last_unstale":"2023-11-13T11:28:58.675948+0000","last_undegraded":"2023-11-13T11:28:58.675948+0000","last_fullsized":"2023-11-13T11:28:58.675948+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-13T11:28:57.010879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-13T11:28:57.010879+0000","last_clean_scrub_stamp":"2023-11-13T11:28:57.010879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-14T22:49:31.708378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-13T11:28:58.677751+0000","last_change":"2023-11-13T11:28:57.627535+0000","last_active":"2023-11-13T11:28:58.677751+0000","last_peered":"2023-11-13T11:28:58.677751+0000","last_clean":"2023-11-13T11:28:58.677751+0000","last_became_active":"2023-11-13T11:28:57.625057+0000","last_became_peered":"2023-11-13T11:28:57.625057+0000","last_unstale":"2023-11-13T11:28:58.677751+0000","last_undegraded":"2023-11-13T11:28:58.677751+0000","last_fullsized":"2023-11-13T11:28:58.677751+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-13T11:28:57.010879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-13T11:28:57.010879+0000","last_clean_scrub_stamp":"2023-11-13T11:28:57.010879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-14T16:55:58.610937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-13T11:28:58.616465+0000","last_change":"2023-11-13T11:28:57.635961+0000","last_active":"2023-11-13T11:28:58.616465+0000","last_peered":"2023-11-13T11:28:58.616465+0000","last_clean":"2023-11-13T11:28:58.616465+0000","last_became_active":"2023-11-13T11:28:57.635672+0000","last_became_peered":"2023-11-13T11:28:57.635672+0000","last_unstale":"2023-11-13T11:28:58.616465+0000","last_undegraded":"2023-11-13T11:28:58.616465+0000","last_fullsized":"2023-11-13T11:28:58.616465+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-13T11:28:57.010879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-13T11:28:57.010879+0000","last_clean_scrub_stamp":"2023-11-13T11:28:57.010879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-14T17:58:40.870637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-13T11:28:58.678102+0000","last_change":"2023-11-13T11:28:57.632312+0000","last_active":"2023-11-13T11:28:58.678102+0000","last_peered":"2023-11-13T11:28:58.678102+0000","last_clean":"2023-11-13T11:28:58.678102+0000","last_became_active":"2023-11-13T11:28:57.631906+0000","last_became_peered":"2023-11-13T11:28:57.631906+0000","last_unstale":"2023-11-13T11:28:58.678102+0000","last_undegraded":"2023-11-13T11:28:58.678102+0000","last_fullsized":"2023-11-13T11:28:58.678102+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-13T11:28:57.010879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-13T11:28:57.010879+0000","last_clean_scrub_stamp":"2023-11-13T11:28:57.010879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-14T12:45:23.017972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-13T11:28:58.677455+0000","last_change":"2023-11-13T11:28:57.639397+0000","last_active":"2023-11-13T11:28:58.677455+0000","last_peered":"2023-11-13T11:28:58.677455+0000","last_clean":"2023-11-13T11:28:58.677455+0000","last_became_active":"2023-11-13T11:28:57.639114+0000","last_became_peered":"2023-11-13T11:28:57.639114+0000","last_unstale":"2023-11-13T11:28:58.677455+0000","last_undegraded":"2023-11-13T11:28:58.677455+0000","last_fullsized":"2023-11-13T11:28:58.677455+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-13T11:28:57.010879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-13T11:28:57.010879+0000","last_clean_scrub_stamp":"2023-11-13T11:28:57.010879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-14T16:02:43.358281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-13T11:28:58.677535+0000","last_change":"2023-11-13T11:28:57.632030+0000","last_active":"2023-11-13T11:28:58.677535+0000","last_peered":"2023-11-13T11:28:58.677535+0000","last_clean":"2023-11-13T11:28:58.677535+0000","last_became_active":"2023-11-13T11:28:57.631756+0000","last_became_peered":"2023-11-13T11:28:57.631756+0000","last_unstale":"2023-11-13T11:28:58.677535+0000","last_undegraded":"2023-11-13T11:28:58.677535+0000","last_fullsized":"2023-11-13T11:28:58.677535+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-13T11:28:57.010879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-13T11:28:57.010879+0000","last_clean_scrub_stamp":"2023-11-13T11:28:57.010879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-14T14:29:59.365142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-13T11:28:58.676220+0000","last_change":"2023-11-13T11:28:57.634137+0000","last_active":"2023-11-13T11:28:58.676220+0000","last_peered":"2023-11-13T11:28:58.676220+0000","last_clean":"2023-11-13T11:28:58.676220+0000","last_became_active":"2023-11-13T11:28:57.633803+0000","last_became_peered":"2023-11-13T11:28:57.633803+0000","last_unstale":"2023-11-13T11:28:58.676220+0000","last_undegraded":"2023-11-13T11:28:58.676220+0000","last_fullsized":"2023-11-13T11:28:58.676220+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-13T11:28:57.010879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-13T11:28:57.010879+0000","last_clean_scrub_stamp":"2023-11-13T11:28:57.010879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-14T12:18:09.759922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-13T11:28:58.676433+0000","last_change":"2023-11-13T11:28:57.637093+0000","last_active":"2023-11-13T11:28:58.676433+0000","last_peered":"2023-11-13T11:28:58.676433+0000","last_clean":"2023-11-13T11:28:58.676433+0000","last_became_active":"2023-11-13T11:28:57.636765+0000","last_became_peered":"2023-11-13T11:28:57.636765+0000","last_unstale":"2023-11-13T11:28:58.676433+0000","last_undegraded":"2023-11-13T11:28:58.676433+0000","last_fullsized":"2023-11-13T11:28:58.676433+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-13T11:28:57.010879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-13T11:28:57.010879+0000","last_clean_scrub_stamp":"2023-11-13T11:28:57.010879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-14T15:45:30.694781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-13T11:28:58.616081+0000","last_change":"2023-11-13T11:28:57.632897+0000","last_active":"2023-11-13T11:28:58.616081+0000","last_peered":"2023-11-13T11:28:58.616081+0000","last_clean":"2023-11-13T11:28:58.616081+0000","last_became_active":"2023-11-13T11:28:57.632596+0000","last_became_peered":"2023-11-13T11:28:57.632596+0000","last_unstale":"2023-11-13T11:28:58.616081+0000","last_undegraded":"2023-11-13T11:28:58.616081+0000","last_fullsized":"2023-11-13T11:28:58.616081+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-13T11:28:57.010879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-13T11:28:57.010879+0000","last_clean_scrub_stamp":"2023-11-13T11:28:57.010879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-14T18:44:10.551024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-13T11:28:58.613160+0000","last_change":"2023-11-13T11:28:57.625017+0000","last_active":"2023-11-13T11:28:58.613160+0000","last_peered":"2023-11-13T11:28:58.613160+0000","last_clean":"2023-11-13T11:28:58.613160+0000","last_became_active":"2023-11-13T11:28:57.624314+0000","last_became_peered":"2023-11-13T11:28:57.624314+0000","last_unstale":"2023-11-13T11:28:58.613160+0000","last_undegraded":"2023-11-13T11:28:58.613160+0000","last_fullsized":"2023-11-13T11:28:58.613160+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-13T11:28:57.010879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-13T11:28:57.010879+0000","last_clean_scrub_stamp":"2023-11-13T11:28:57.010879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-14T19:51:05.461013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1b","version":"21'1","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-13T11:28:58.677644+0000","last_change":"2023-11-13T11:28:57.043256+0000","last_active":"2023-11-13T11:28:58.677644+0000","last_peered":"2023-11-13T11:28:58.677644+0000","last_clean":"2023-11-13T11:28:58.677644+0000","last_became_active":"2023-11-13T11:28:57.041999+0000","last_became_peered":"2023-11-13T11:28:57.041999+0000","last_unstale":"2023-11-13T11:28:58.677644+0000","last_undegraded":"2023-11-13T11:28:58.677644+0000","last_fullsized":"2023-11-13T11:28:58.677644+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-13T11:28:56.008687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-13T11:28:56.008687+0000","last_clean_scrub_stamp":"2023-11-13T11:28:56.008687+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-14T18:32:13.991035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-13T11:28:58.617421+0000","last_change":"2023-11-13T11:28:57.635747+0000","last_active":"2023-11-13T11:28:58.617421+0000","last_peered":"2023-11-13T11:28:58.617421+0000","last_clean":"2023-11-13T11:28:58.617421+0000","last_became_active":"2023-11-13T11:28:57.635406+0000","last_became_peered":"2023-11-13T11:28:57.635406+0000","last_unstale":"2023-11-13T11:28:58.617421+0000","last_undegraded":"2023-11-13T11:28:58.617421+0000","last_fullsized":"2023-11-13T11:28:58.617421+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-13T11:28:57.010879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-13T11:28:57.010879+0000","last_clean_scrub_stamp":"2023-11-13T11:28:57.010879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-14T22:16:57.888840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1a","version":"21'1","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-13T11:28:58.676434+0000","last_change":"2023-11-13T11:28:57.047326+0000","last_active":"2023-11-13T11:28:58.676434+0000","last_peered":"2023-11-13T11:28:58.676434+0000","last_clean":"2023-11-13T11:28:58.676434+0000","last_became_active":"2023-11-13T11:28:57.047058+0000","last_became_peered":"2023-11-13T11:28:57.047058+0000","last_unstale":"2023-11-13T11:28:58.676434+0000","last_undegraded":"2023-11-13T11:28:58.676434+0000","last_fullsized":"2023-11-13T11:28:58.676434+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-13T11:28:56.008687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-13T11:28:56.008687+0000","last_clean_scrub_stamp":"2023-11-13T11:28:56.008687+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-14T21:42:18.410072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-13T11:28:58.677872+0000","last_change":"2023-11-13T11:28:57.039378+0000","last_active":"2023-11-13T11:28:58.677872+0000","last_peered":"2023-11-13T11:28:58.677872+0000","last_clean":"2023-11-13T11:28:58.677872+0000","last_became_active":"2023-11-13T11:28:57.038955+0000","last_became_peered":"2023-11-13T11:28:57.038955+0000","last_unstale":"2023-11-13T11:28:58.677872+0000","last_undegraded":"2023-11-13T11:28:58.677872+0000","last_fullsized":"2023-11-13T11:28:58.677872+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-13T11:28:56.008687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-13T11:28:56.008687+0000","last_clean_scrub_stamp":"2023-11-13T11:28:56.008687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-14T19:51:04.458821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-13T11:28:58.677161+0000","last_change":"2023-11-13T11:28:57.635612+0000","last_active":"2023-11-13T11:28:58.677161+0000","last_peered":"2023-11-13T11:28:58.677161+0000","last_clean":"2023-11-13T11:28:58.677161+0000","last_became_active":"2023-11-13T11:28:57.633904+0000","last_became_peered":"2023-11-13T11:28:57.633904+0000","last_unstale":"2023-11-13T11:28:58.677161+0000","last_undegraded":"2023-11-13T11:28:58.677161+0000","last_fullsized":"2023-11-13T11:28:58.677161+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-13T11:28:57.010879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-13T11:28:57.010879+0000","last_clean_scrub_stamp":"2023-11-13T11:28:57.010879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-14T16:47:11.682554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-13T11:28:58.676165+0000","last_change":"2023-11-13T11:28:57.050197+0000","last_active":"2023-11-13T11:28:58.676165+0000","last_peered":"2023-11-13T11:28:58.676165+0000","last_clean":"2023-11-13T11:28:58.676165+0000","last_became_active":"2023-11-13T11:28:57.049917+0000","last_became_peered":"2023-11-13T11:28:57.049917+0000","last_unstale":"2023-11-13T11:28:58.676165+0000","last_undegraded":"2023-11-13T11:28:58.676165+0000","last_fullsized":"2023-11-13T11:28:58.676165+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-13T11:28:56.008687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-13T11:28:56.008687+0000","last_clean_scrub_stamp":"2023-11-13T11:28:56.008687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-14T11:40:57.839875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-13T11:28:58.617477+0000","last_change":"2023-11-13T11:28:57.620218+0000","last_active":"2023-11-13T11:28:58.617477+0000","last_peered":"2023-11-13T11:28:58.617477+0000","last_clean":"2023-11-13T11:28:58.617477+0000","last_became_active":"2023-11-13T11:28:57.619919+0000","last_became_peered":"2023-11-13T11:28:57.619919+0000","last_unstale":"2023-11-13T11:28:58.617477+0000","last_undegraded":"2023-11-13T11:28:58.617477+0000","last_fullsized":"2023-11-13T11:28:58.617477+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-13T11:28:57.010879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-13T11:28:57.010879+0000","last_clean_scrub_stamp":"2023-11-13T11:28:57.010879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-14T21:42:19.412264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-13T11:28:58.613639+0000","last_change":"2023-11-13T11:28:57.041825+0000","last_active":"2023-11-13T11:28:58.613639+0000","last_peered":"2023-11-13T11:28:58.613639+0000","last_clean":"2023-11-13T11:28:58.613639+0000","last_became_active":"2023-11-13T11:28:57.041650+0000","last_became_peered":"2023-11-13T11:28:57.041650+0000","last_unstale":"2023-11-13T11:28:58.613639+0000","last_undegraded":"2023-11-13T11:28:58.613639+0000","last_fullsized":"2023-11-13T11:28:58.613639+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-13T11:28:56.008687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-13T11:28:56.008687+0000","last_clean_scrub_stamp":"2023-11-13T11:28:56.008687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-14T12:41:42.933021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-13T11:28:58.616521+0000","last_change":"2023-11-13T11:28:57.632784+0000","last_active":"2023-11-13T11:28:58.616521+0000","last_peered":"2023-11-13T11:28:58.616521+0000","last_clean":"2023-11-13T11:28:58.616521+0000","last_became_active":"2023-11-13T11:28:57.631854+0000","last_became_peered":"2023-11-13T11:28:57.631854+0000","last_unstale":"2023-11-13T11:28:58.616521+0000","last_undegraded":"2023-11-13T11:28:58.616521+0000","last_fullsized":"2023-11-13T11:28:58.616521+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-13T11:28:57.010879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-13T11:28:57.010879+0000","last_clean_scrub_stamp":"2023-11-13T11:28:57.010879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-14T11:40:58.842068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-13T11:28:58.677636+0000","last_change":"2023-11-13T11:28:57.049038+0000","last_active":"2023-11-13T11:28:58.677636+0000","last_peered":"2023-11-13T11:28:58.677636+0000","last_clean":"2023-11-13T11:28:58.677636+0000","last_became_active":"2023-11-13T11:28:57.048768+0000","last_became_peered":"2023-11-13T11:28:57.048768+0000","last_unstale":"2023-11-13T11:28:58.677636+0000","last_undegraded":"2023-11-13T11:28:58.677636+0000","last_fullsized":"2023-11-13T11:28:58.677636+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-13T11:28:56.008687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-13T11:28:56.008687+0000","last_clean_scrub_stamp":"2023-11-13T11:28:56.008687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-14T12:45:22.015780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-13T11:28:58.677861+0000","last_change":"2023-11-13T11:28:57.627287+0000","last_active":"2023-11-13T11:28:58.677861+0000","last_peered":"2023-11-13T11:28:58.677861+0000","last_clean":"2023-11-13T11:28:58.677861+0000","last_became_active":"2023-11-13T11:28:57.623471+0000","last_became_peered":"2023-11-13T11:28:57.623471+0000","last_unstale":"2023-11-13T11:28:58.677861+0000","last_undegraded":"2023-11-13T11:28:58.677861+0000","last_fullsized":"2023-11-13T11:28:58.677861+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-13T11:28:57.010879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-13T11:28:57.010879+0000","last_clean_scrub_stamp":"2023-11-13T11:28:57.010879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-14T22:49:31.708378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.15","version":"21'3","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-13T11:28:58.676868+0000","last_change":"2023-11-13T11:28:57.037793+0000","last_active":"2023-11-13T11:28:58.676868+0000","last_peered":"2023-11-13T11:28:58.676868+0000","last_clean":"2023-11-13T11:28:58.676868+0000","last_became_active":"2023-11-13T11:28:57.037300+0000","last_became_peered":"2023-11-13T11:28:57.037300+0000","last_unstale":"2023-11-13T11:28:58.676868+0000","last_undegraded":"2023-11-13T11:28:58.676868+0000","last_fullsized":"2023-11-13T11:28:58.676868+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-13T11:28:56.008687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-13T11:28:56.008687+0000","last_clean_scrub_stamp":"2023-11-13T11:28:56.008687+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-14T22:52:35.101002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-13T11:28:58.676110+0000","last_change":"2023-11-13T11:28:57.639554+0000","last_active":"2023-11-13T11:28:58.676110+0000","last_peered":"2023-11-13T11:28:58.676110+0000","last_clean":"2023-11-13T11:28:58.676110+0000","last_became_active":"2023-11-13T11:28:57.639192+0000","last_became_peered":"2023-11-13T11:28:57.639192+0000","last_unstale":"2023-11-13T11:28:58.676110+0000","last_undegraded":"2023-11-13T11:28:58.676110+0000","last_fullsized":"2023-11-13T11:28:58.676110+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-13T11:28:57.010879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-13T11:28:57.010879+0000","last_clean_scrub_stamp":"2023-11-13T11:28:57.010879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-14T13:13:26.359918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.14","version":"21'6","reported_seq":18,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-13T11:28:58.616288+0000","last_change":"2023-11-13T11:28:57.026285+0000","last_active":"2023-11-13T11:28:58.616288+0000","last_peered":"2023-11-13T11:28:58.616288+0000","last_clean":"2023-11-13T11:28:58.616288+0000","last_became_active":"2023-11-13T11:28:57.026026+0000","last_became_peered":"2023-11-13T11:28:57.026026+0000","last_unstale":"2023-11-13T11:28:58.616288+0000","last_undegraded":"2023-11-13T11:28:58.616288+0000","last_fullsized":"2023-11-13T11:28:58.616288+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-13T11:28:56.008687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-13T11:28:56.008687+0000","last_clean_scrub_stamp":"2023-11-13T11:28:56.008687+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-14T20:07:21.176638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-13T11:28:58.677361+0000","last_change":"2023-11-13T11:28:57.633747+0000","last_active":"2023-11-13T11:28:58.677361+0000","last_peered":"2023-11-13T11:28:58.677361+0000","last_clean":"2023-11-13T11:28:58.677361+0000","last_became_active":"2023-11-13T11:28:57.633454+0000","last_became_peered":"2023-11-13T11:28:57.633454+0000","last_unstale":"2023-11-13T11:28:58.677361+0000","last_undegraded":"2023-11-13T11:28:58.677361+0000","last_fullsized":"2023-11-13T11:28:58.677361+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-13T11:28:57.010879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-13T11:28:57.010879+0000","last_clean_scrub_stamp":"2023-11-13T11:28:57.010879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-14T16:35:00.051619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"21'2","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-13T11:28:58.676714+0000","last_change":"2023-11-13T11:28:57.039714+0000","last_active":"2023-11-13T11:28:58.676714+0000","last_peered":"2023-11-13T11:28:58.676714+0000","last_clean":"2023-11-13T11:28:58.676714+0000","last_became_active":"2023-11-13T11:28:57.039008+0000","last_became_peered":"2023-11-13T11:28:57.039008+0000","last_unstale":"2023-11-13T11:28:58.676714+0000","last_undegraded":"2023-11-13T11:28:58.676714+0000","last_fullsized":"2023-11-13T11:28:58.676714+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-13T11:28:56.008687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-13T11:28:56.008687+0000","last_clean_scrub_stamp":"2023-11-13T11:28:56.008687+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-14T11:45:58.589019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-13T11:28:58.677597+0000","last_change":"2023-11-13T11:28:57.641476+0000","last_active":"2023-11-13T11:28:58.677597+0000","last_peered":"2023-11-13T11:28:58.677597+0000","last_clean":"2023-11-13T11:28:58.677597+0000","last_became_active":"2023-11-13T11:28:57.640673+0000","last_became_peered":"2023-11-13T11:28:57.640673+0000","last_unstale":"2023-11-13T11:28:58.677597+0000","last_undegraded":"2023-11-13T11:28:58.677597+0000","last_fullsized":"2023-11-13T11:28:58.677597+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-13T11:28:57.010879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-13T11:28:57.010879+0000","last_clean_scrub_stamp":"2023-11-13T11:28:57.010879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-14T18:32:14.993227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-13T11:28:58.676518+0000","last_change":"2023-11-13T11:28:57.038744+0000","last_active":"2023-11-13T11:28:58.676518+0000","last_peered":"2023-11-13T11:28:58.676518+0000","last_clean":"2023-11-13T11:28:58.676518+0000","last_became_active":"2023-11-13T11:28:57.037589+0000","last_became_peered":"2023-11-13T11:28:57.037589+0000","last_unstale":"2023-11-13T11:28:58.676518+0000","last_undegraded":"2023-11-13T11:28:58.676518+0000","last_fullsized":"2023-11-13T11:28:58.676518+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-13T11:28:56.008687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-13T11:28:56.008687+0000","last_clean_scrub_stamp":"2023-11-13T11:28:56.008687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-14T20:31:04.049508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-13T11:28:58.676239+0000","last_change":"2023-11-13T11:28:57.642795+0000","last_active":"2023-11-13T11:28:58.676239+0000","last_peered":"2023-11-13T11:28:58.676239+0000","last_clean":"2023-11-13T11:28:58.676239+0000","last_became_active":"2023-11-13T11:28:57.642532+0000","last_became_peered":"2023-11-13T11:28:57.642532+0000","last_unstale":"2023-11-13T11:28:58.676239+0000","last_undegraded":"2023-11-13T11:28:58.676239+0000","last_fullsized":"2023-11-13T11:28:58.676239+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-13T11:28:57.010879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-13T11:28:57.010879+0000","last_clean_scrub_stamp":"2023-11-13T11:28:57.010879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-14T15:58:48.241029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-13T11:28:58.676905+0000","last_change":"2023-11-13T11:28:57.040384+0000","last_active":"2023-11-13T11:28:58.676905+0000","last_peered":"2023-11-13T11:28:58.676905+0000","last_clean":"2023-11-13T11:28:58.676905+0000","last_became_active":"2023-11-13T11:28:57.040131+0000","last_became_peered":"2023-11-13T11:28:57.040131+0000","last_unstale":"2023-11-13T11:28:58.676905+0000","last_undegraded":"2023-11-13T11:28:58.676905+0000","last_fullsized":"2023-11-13T11:28:58.676905+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-13T11:28:56.008687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-13T11:28:56.008687+0000","last_clean_scrub_stamp":"2023-11-13T11:28:56.008687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-14T20:31:04.049508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-13T11:28:58.613055+0000","last_change":"2023-11-13T11:28:57.624233+0000","last_active":"2023-11-13T11:28:58.613055+0000","last_peered":"2023-11-13T11:28:58.613055+0000","last_clean":"2023-11-13T11:28:58.613055+0000","last_became_active":"2023-11-13T11:28:57.623952+0000","last_became_peered":"2023-11-13T11:28:57.623952+0000","last_unstale":"2023-11-13T11:28:58.613055+0000","last_undegraded":"2023-11-13T11:28:58.613055+0000","last_fullsized":"2023-11-13T11:28:58.613055+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-13T11:28:57.010879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-13T11:28:57.010879+0000","last_clean_scrub_stamp":"2023-11-13T11:28:57.010879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-14T18:44:10.551024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.10","version":"21'8","reported_seq":20,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-13T11:28:58.616974+0000","last_change":"2023-11-13T11:28:57.035054+0000","last_active":"2023-11-13T11:28:58.616974+0000","last_peered":"2023-11-13T11:28:58.616974+0000","last_clean":"2023-11-13T11:28:58.616974+0000","last_became_active":"2023-11-13T11:28:57.034694+0000","last_became_peered":"2023-11-13T11:28:57.034694+0000","last_unstale":"2023-11-13T11:28:58.616974+0000","last_undegraded":"2023-11-13T11:28:58.616974+0000","last_fullsized":"2023-11-13T11:28:58.616974+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-13T11:28:56.008687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-13T11:28:56.008687+0000","last_clean_scrub_stamp":"2023-11-13T11:28:56.008687+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-14T19:51:04.458821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-13T11:28:58.675988+0000","last_change":"2023-11-13T11:28:57.640815+0000","last_active":"2023-11-13T11:28:58.675988+0000","last_peered":"2023-11-13T11:28:58.675988+0000","last_clean":"2023-11-13T11:28:58.675988+0000","last_became_active":"2023-11-13T11:28:57.639158+0000","last_became_peered":"2023-11-13T11:28:57.639158+0000","last_unstale":"2023-11-13T11:28:58.675988+0000","last_undegraded":"2023-11-13T11:28:58.675988+0000","last_fullsized":"2023-11-13T11:28:58.675988+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-13T11:28:57.010879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-13T11:28:57.010879+0000","last_clean_scrub_stamp":"2023-11-13T11:28:57.010879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-14T13:34:23.778868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.f","version":"21'1","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-13T11:28:58.677539+0000","last_change":"2023-11-13T11:28:57.047959+0000","last_active":"2023-11-13T11:28:58.677539+0000","last_peered":"2023-11-13T11:28:58.677539+0000","last_clean":"2023-11-13T11:28:58.677539+0000","last_became_active":"2023-11-13T11:28:57.047614+0000","last_became_peered":"2023-11-13T11:28:57.047614+0000","last_unstale":"2023-11-13T11:28:58.677539+0000","last_undegraded":"2023-11-13T11:28:58.677539+0000","last_fullsized":"2023-11-13T11:28:58.677539+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-13T11:28:56.008687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-13T11:28:56.008687+0000","last_clean_scrub_stamp":"2023-11-13T11:28:56.008687+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-14T18:32:13.991035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-13T11:28:58.616578+0000","last_change":"2023-11-13T11:28:57.644049+0000","last_active":"2023-11-13T11:28:58.616578+0000","last_peered":"2023-11-13T11:28:58.616578+0000","last_clean":"2023-11-13T11:28:58.616578+0000","last_became_active":"2023-11-13T11:28:57.643739+0000","last_became_peered":"2023-11-13T11:28:57.643739+0000","last_unstale":"2023-11-13T11:28:58.616578+0000","last_undegraded":"2023-11-13T11:28:58.616578+0000","last_fullsized":"2023-11-13T11:28:58.616578+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-13T11:28:57.010879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-13T11:28:57.010879+0000","last_clean_scrub_stamp":"2023-11-13T11:28:57.010879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-14T16:02:43.358281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.e","version":"21'2","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-13T11:28:58.617520+0000","last_change":"2023-11-13T11:28:57.037861+0000","last_active":"2023-11-13T11:28:58.617520+0000","last_peered":"2023-11-13T11:28:58.617520+0000","last_clean":"2023-11-13T11:28:58.617520+0000","last_became_active":"2023-11-13T11:28:57.037587+0000","last_became_peered":"2023-11-13T11:28:57.037587+0000","last_unstale":"2023-11-13T11:28:58.617520+0000","last_undegraded":"2023-11-13T11:28:58.617520+0000","last_fullsized":"2023-11-13T11:28:58.617520+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-13T11:28:56.008687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-13T11:28:56.008687+0000","last_clean_scrub_stamp":"2023-11-13T11:28:56.008687+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-14T12:47:28.656211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-13T11:28:58.677509+0000","last_change":"2023-11-13T11:28:57.627412+0000","last_active":"2023-11-13T11:28:58.677509+0000","last_peered":"2023-11-13T11:28:58.677509+0000","last_clean":"2023-11-13T11:28:58.677509+0000","last_became_active":"2023-11-13T11:28:57.627146+0000","last_became_peered":"2023-11-13T11:28:57.627146+0000","last_unstale":"2023-11-13T11:28:58.677509+0000","last_undegraded":"2023-11-13T11:28:58.677509+0000","last_fullsized":"2023-11-13T11:28:58.677509+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-13T11:28:57.010879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-13T11:28:57.010879+0000","last_clean_scrub_stamp":"2023-11-13T11:28:57.010879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-14T13:34:23.778868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"21'1","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-13T11:28:58.677545+0000","last_change":"2023-11-13T11:28:57.043781+0000","last_active":"2023-11-13T11:28:58.677545+0000","last_peered":"2023-11-13T11:28:58.677545+0000","last_clean":"2023-11-13T11:28:58.677545+0000","last_became_active":"2023-11-13T11:28:57.043532+0000","last_became_peered":"2023-11-13T11:28:57.043532+0000","last_unstale":"2023-11-13T11:28:58.677545+0000","last_undegraded":"2023-11-13T11:28:58.677545+0000","last_fullsized":"2023-11-13T11:28:58.677545+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-13T11:28:56.008687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-13T11:28:56.008687+0000","last_clean_scrub_stamp":"2023-11-13T11:28:56.008687+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-14T12:45:22.015780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-13T11:28:58.677199+0000","last_change":"2023-11-13T11:28:57.632085+0000","last_active":"2023-11-13T11:28:58.677199+0000","last_peered":"2023-11-13T11:28:58.677199+0000","last_clean":"2023-11-13T11:28:58.677199+0000","last_became_active":"2023-11-13T11:28:57.631814+0000","last_became_peered":"2023-11-13T11:28:57.631814+0000","last_unstale":"2023-11-13T11:28:58.677199+0000","last_undegraded":"2023-11-13T11:28:58.677199+0000","last_fullsized":"2023-11-13T11:28:58.677199+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-13T11:28:57.010879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-13T11:28:57.010879+0000","last_clean_scrub_stamp":"2023-11-13T11:28:57.010879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-14T16:55:58.610937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-13T11:28:58.677642+0000","last_change":"2023-11-13T11:28:57.039989+0000","last_active":"2023-11-13T11:28:58.677642+0000","last_peered":"2023-11-13T11:28:58.677642+0000","last_clean":"2023-11-13T11:28:58.677642+0000","last_became_active":"2023-11-13T11:28:57.039704+0000","last_became_peered":"2023-11-13T11:28:57.039704+0000","last_unstale":"2023-11-13T11:28:58.677642+0000","last_undegraded":"2023-11-13T11:28:58.677642+0000","last_fullsized":"2023-11-13T11:28:58.677642+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-13T11:28:56.008687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-13T11:28:56.008687+0000","last_clean_scrub_stamp":"2023-11-13T11:28:56.008687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-14T12:47:28.656211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-13T11:28:58.676483+0000","last_change":"2023-11-13T11:28:57.630328+0000","last_active":"2023-11-13T11:28:58.676483+0000","last_peered":"2023-11-13T11:28:58.676483+0000","last_clean":"2023-11-13T11:28:58.676483+0000","last_became_active":"2023-11-13T11:28:57.630018+0000","last_became_peered":"2023-11-13T11:28:57.630018+0000","last_unstale":"2023-11-13T11:28:58.676483+0000","last_undegraded":"2023-11-13T11:28:58.676483+0000","last_fullsized":"2023-11-13T11:28:58.676483+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-13T11:28:57.010879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-13T11:28:57.010879+0000","last_clean_scrub_stamp":"2023-11-13T11:28:57.010879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-14T21:59:24.741766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":165,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-13T11:28:57.612976+0000","last_change":"2023-11-13T11:28:47.002866+0000","last_active":"2023-11-13T11:28:57.612976+0000","last_peered":"2023-11-13T11:28:57.612976+0000","last_clean":"2023-11-13T11:28:57.612976+0000","last_became_active":"2023-11-13T11:28:47.001494+0000","last_became_peered":"2023-11-13T11:28:47.001494+0000","last_unstale":"2023-11-13T11:28:57.612976+0000","last_undegraded":"2023-11-13T11:28:57.612976+0000","last_fullsized":"2023-11-13T11:28:57.612976+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-13T11:28:45.879416+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-13T11:28:45.879416+0000","last_clean_scrub_stamp":"2023-11-13T11:28:45.879416+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-14T14:38:55.166320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-13T11:28:58.676303+0000","last_change":"2023-11-13T11:28:57.040424+0000","last_active":"2023-11-13T11:28:58.676303+0000","last_peered":"2023-11-13T11:28:58.676303+0000","last_clean":"2023-11-13T11:28:58.676303+0000","last_became_active":"2023-11-13T11:28:57.039831+0000","last_became_peered":"2023-11-13T11:28:57.039831+0000","last_unstale":"2023-11-13T11:28:58.676303+0000","last_undegraded":"2023-11-13T11:28:58.676303+0000","last_fullsized":"2023-11-13T11:28:58.676303+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-13T11:28:56.008687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-13T11:28:56.008687+0000","last_clean_scrub_stamp":"2023-11-13T11:28:56.008687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-14T17:58:39.868445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-13T11:28:58.617352+0000","last_change":"2023-11-13T11:28:57.633871+0000","last_active":"2023-11-13T11:28:58.617352+0000","last_peered":"2023-11-13T11:28:58.617352+0000","last_clean":"2023-11-13T11:28:58.617352+0000","last_became_active":"2023-11-13T11:28:57.633554+0000","last_became_peered":"2023-11-13T11:28:57.633554+0000","last_unstale":"2023-11-13T11:28:58.617352+0000","last_undegraded":"2023-11-13T11:28:58.617352+0000","last_fullsized":"2023-11-13T11:28:58.617352+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-13T11:28:57.010879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-13T11:28:57.010879+0000","last_clean_scrub_stamp":"2023-11-13T11:28:57.010879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-14T12:45:23.017972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-13T11:28:58.676054+0000","last_change":"2023-11-13T11:28:57.042629+0000","last_active":"2023-11-13T11:28:58.676054+0000","last_peered":"2023-11-13T11:28:58.676054+0000","last_clean":"2023-11-13T11:28:58.676054+0000","last_became_active":"2023-11-13T11:28:57.042275+0000","last_became_peered":"2023-11-13T11:28:57.042275+0000","last_unstale":"2023-11-13T11:28:58.676054+0000","last_undegraded":"2023-11-13T11:28:58.676054+0000","last_fullsized":"2023-11-13T11:28:58.676054+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-13T11:28:56.008687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-13T11:28:56.008687+0000","last_clean_scrub_stamp":"2023-11-13T11:28:56.008687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-14T18:32:13.991035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-13T11:28:58.677781+0000","last_change":"2023-11-13T11:28:57.636085+0000","last_active":"2023-11-13T11:28:58.677781+0000","last_peered":"2023-11-13T11:28:58.677781+0000","last_clean":"2023-11-13T11:28:58.677781+0000","last_became_active":"2023-11-13T11:28:57.635801+0000","last_became_peered":"2023-11-13T11:28:57.635801+0000","last_unstale":"2023-11-13T11:28:58.677781+0000","last_undegraded":"2023-11-13T11:28:58.677781+0000","last_fullsized":"2023-11-13T11:28:58.677781+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-13T11:28:57.010879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-13T11:28:57.010879+0000","last_clean_scrub_stamp":"2023-11-13T11:28:57.010879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-14T12:34:10.639080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-13T11:28:58.676552+0000","last_change":"2023-11-13T11:28:57.043663+0000","last_active":"2023-11-13T11:28:58.676552+0000","last_peered":"2023-11-13T11:28:58.676552+0000","last_clean":"2023-11-13T11:28:58.676552+0000","last_became_active":"2023-11-13T11:28:57.043395+0000","last_became_peered":"2023-11-13T11:28:57.043395+0000","last_unstale":"2023-11-13T11:28:58.676552+0000","last_undegraded":"2023-11-13T11:28:58.676552+0000","last_fullsized":"2023-11-13T11:28:58.676552+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-13T11:28:56.008687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-13T11:28:56.008687+0000","last_clean_scrub_stamp":"2023-11-13T11:28:56.008687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-14T20:39:57.924545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-13T11:28:58.677021+0000","last_change":"2023-11-13T11:28:57.630182+0000","last_active":"2023-11-13T11:28:58.677021+0000","last_peered":"2023-11-13T11:28:58.677021+0000","last_clean":"2023-11-13T11:28:58.677021+0000","last_became_active":"2023-11-13T11:28:57.629803+0000","last_became_peered":"2023-11-13T11:28:57.629803+0000","last_unstale":"2023-11-13T11:28:58.677021+0000","last_undegraded":"2023-11-13T11:28:58.677021+0000","last_fullsized":"2023-11-13T11:28:58.677021+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-13T11:28:57.010879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-13T11:28:57.010879+0000","last_clean_scrub_stamp":"2023-11-13T11:28:57.010879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-14T20:31:05.051700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-13T11:28:58.676595+0000","last_change":"2023-11-13T11:28:57.044421+0000","last_active":"2023-11-13T11:28:58.676595+0000","last_peered":"2023-11-13T11:28:58.676595+0000","last_clean":"2023-11-13T11:28:58.676595+0000","last_became_active":"2023-11-13T11:28:57.044057+0000","last_became_peered":"2023-11-13T11:28:57.044057+0000","last_unstale":"2023-11-13T11:28:58.676595+0000","last_undegraded":"2023-11-13T11:28:58.676595+0000","last_fullsized":"2023-11-13T11:28:58.676595+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-13T11:28:56.008687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-13T11:28:56.008687+0000","last_clean_scrub_stamp":"2023-11-13T11:28:56.008687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-14T16:47:10.680362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-13T11:28:58.676967+0000","last_change":"2023-11-13T11:28:57.636497+0000","last_active":"2023-11-13T11:28:58.676967+0000","last_peered":"2023-11-13T11:28:58.676967+0000","last_clean":"2023-11-13T11:28:58.676967+0000","last_became_active":"2023-11-13T11:28:57.635945+0000","last_became_peered":"2023-11-13T11:28:57.635945+0000","last_unstale":"2023-11-13T11:28:58.676967+0000","last_undegraded":"2023-11-13T11:28:58.676967+0000","last_fullsized":"2023-11-13T11:28:58.676967+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-13T11:28:57.010879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-13T11:28:57.010879+0000","last_clean_scrub_stamp":"2023-11-13T11:28:57.010879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-14T14:29:59.365142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-13T11:28:58.677456+0000","last_change":"2023-11-13T11:28:57.039925+0000","last_active":"2023-11-13T11:28:58.677456+0000","last_peered":"2023-11-13T11:28:58.677456+0000","last_clean":"2023-11-13T11:28:58.677456+0000","last_became_active":"2023-11-13T11:28:57.039611+0000","last_became_peered":"2023-11-13T11:28:57.039611+0000","last_unstale":"2023-11-13T11:28:58.677456+0000","last_undegraded":"2023-11-13T11:28:58.677456+0000","last_fullsized":"2023-11-13T11:28:58.677456+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-13T11:28:56.008687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-13T11:28:56.008687+0000","last_clean_scrub_stamp":"2023-11-13T11:28:56.008687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-14T12:34:09.636888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-13T11:28:58.616113+0000","last_change":"2023-11-13T11:28:57.640311+0000","last_active":"2023-11-13T11:28:58.616113+0000","last_peered":"2023-11-13T11:28:58.616113+0000","last_clean":"2023-11-13T11:28:58.616113+0000","last_became_active":"2023-11-13T11:28:57.638311+0000","last_became_peered":"2023-11-13T11:28:57.638311+0000","last_unstale":"2023-11-13T11:28:58.616113+0000","last_undegraded":"2023-11-13T11:28:58.616113+0000","last_fullsized":"2023-11-13T11:28:58.616113+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-13T11:28:57.010879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-13T11:28:57.010879+0000","last_clean_scrub_stamp":"2023-11-13T11:28:57.010879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-14T19:51:05.461013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-13T11:28:58.676570+0000","last_change":"2023-11-13T11:28:57.045910+0000","last_active":"2023-11-13T11:28:58.676570+0000","last_peered":"2023-11-13T11:28:58.676570+0000","last_clean":"2023-11-13T11:28:58.676570+0000","last_became_active":"2023-11-13T11:28:57.045640+0000","last_became_peered":"2023-11-13T11:28:57.045640+0000","last_unstale":"2023-11-13T11:28:58.676570+0000","last_undegraded":"2023-11-13T11:28:58.676570+0000","last_fullsized":"2023-11-13T11:28:58.676570+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-13T11:28:56.008687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-13T11:28:56.008687+0000","last_clean_scrub_stamp":"2023-11-13T11:28:56.008687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-14T18:39:08.541955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-13T11:28:58.678192+0000","last_change":"2023-11-13T11:28:57.627422+0000","last_active":"2023-11-13T11:28:58.678192+0000","last_peered":"2023-11-13T11:28:58.678192+0000","last_clean":"2023-11-13T11:28:58.678192+0000","last_became_active":"2023-11-13T11:28:57.627122+0000","last_became_peered":"2023-11-13T11:28:57.627122+0000","last_unstale":"2023-11-13T11:28:58.678192+0000","last_undegraded":"2023-11-13T11:28:58.678192+0000","last_fullsized":"2023-11-13T11:28:58.678192+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-13T11:28:57.010879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-13T11:28:57.010879+0000","last_clean_scrub_stamp":"2023-11-13T11:28:57.010879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-14T22:16:57.888840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"22'1","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-13T11:28:59.950644+0000","last_change":"2023-11-13T11:28:57.026473+0000","last_active":"2023-11-13T11:28:59.950644+0000","last_peered":"2023-11-13T11:28:59.950644+0000","last_clean":"2023-11-13T11:28:59.950644+0000","last_became_active":"2023-11-13T11:28:57.025877+0000","last_became_peered":"2023-11-13T11:28:57.025877+0000","last_unstale":"2023-11-13T11:28:59.950644+0000","last_undegraded":"2023-11-13T11:28:59.950644+0000","last_fullsized":"2023-11-13T11:28:59.950644+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-13T11:28:56.008687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-13T11:28:56.008687+0000","last_clean_scrub_stamp":"2023-11-13T11:28:56.008687+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-14T11:40:57.839875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-13T11:28:58.617778+0000","last_change":"2023-11-13T11:28:57.632649+0000","last_active":"2023-11-13T11:28:58.617778+0000","last_peered":"2023-11-13T11:28:58.617778+0000","last_clean":"2023-11-13T11:28:58.617778+0000","last_became_active":"2023-11-13T11:28:57.632091+0000","last_became_peered":"2023-11-13T11:28:57.632091+0000","last_unstale":"2023-11-13T11:28:58.617778+0000","last_undegraded":"2023-11-13T11:28:58.617778+0000","last_fullsized":"2023-11-13T11:28:58.617778+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-13T11:28:57.010879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-13T11:28:57.010879+0000","last_clean_scrub_stamp":"2023-11-13T11:28:57.010879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-14T23:10:03.463557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"21'2","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-13T11:28:58.676636+0000","last_change":"2023-11-13T11:28:57.049041+0000","last_active":"2023-11-13T11:28:58.676636+0000","last_peered":"2023-11-13T11:28:58.676636+0000","last_clean":"2023-11-13T11:28:58.676636+0000","last_became_active":"2023-11-13T11:28:57.048609+0000","last_became_peered":"2023-11-13T11:28:57.048609+0000","last_unstale":"2023-11-13T11:28:58.676636+0000","last_undegraded":"2023-11-13T11:28:58.676636+0000","last_fullsized":"2023-11-13T11:28:58.676636+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-13T11:28:56.008687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-13T11:28:56.008687+0000","last_clean_scrub_stamp":"2023-11-13T11:28:56.008687+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-14T14:29:58.362950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-13T11:28:58.617616+0000","last_change":"2023-11-13T11:28:57.634721+0000","last_active":"2023-11-13T11:28:58.617616+0000","last_peered":"2023-11-13T11:28:58.617616+0000","last_clean":"2023-11-13T11:28:58.617616+0000","last_became_active":"2023-11-13T11:28:57.632021+0000","last_became_peered":"2023-11-13T11:28:57.632021+0000","last_unstale":"2023-11-13T11:28:58.617616+0000","last_undegraded":"2023-11-13T11:28:58.617616+0000","last_fullsized":"2023-11-13T11:28:58.617616+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-13T11:28:57.010879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-13T11:28:57.010879+0000","last_clean_scrub_stamp":"2023-11-13T11:28:57.010879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-14T20:31:05.051700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-13T11:28:58.676371+0000","last_change":"2023-11-13T11:28:57.034985+0000","last_active":"2023-11-13T11:28:58.676371+0000","last_peered":"2023-11-13T11:28:58.676371+0000","last_clean":"2023-11-13T11:28:58.676371+0000","last_became_active":"2023-11-13T11:28:57.033457+0000","last_became_peered":"2023-11-13T11:28:57.033457+0000","last_unstale":"2023-11-13T11:28:58.676371+0000","last_undegraded":"2023-11-13T11:28:58.676371+0000","last_fullsized":"2023-11-13T11:28:58.676371+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-13T11:28:56.008687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-13T11:28:56.008687+0000","last_clean_scrub_stamp":"2023-11-13T11:28:56.008687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-14T22:20:18.898387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-13T11:28:58.676138+0000","last_change":"2023-11-13T11:28:57.626943+0000","last_active":"2023-11-13T11:28:58.676138+0000","last_peered":"2023-11-13T11:28:58.676138+0000","last_clean":"2023-11-13T11:28:58.676138+0000","last_became_active":"2023-11-13T11:28:57.626766+0000","last_became_peered":"2023-11-13T11:28:57.626766+0000","last_unstale":"2023-11-13T11:28:58.676138+0000","last_undegraded":"2023-11-13T11:28:58.676138+0000","last_fullsized":"2023-11-13T11:28:58.676138+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-13T11:28:57.010879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-13T11:28:57.010879+0000","last_clean_scrub_stamp":"2023-11-13T11:28:57.010879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-14T22:55:42.143143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-13T11:28:58.617155+0000","last_change":"2023-11-13T11:28:57.034882+0000","last_active":"2023-11-13T11:28:58.617155+0000","last_peered":"2023-11-13T11:28:58.617155+0000","last_clean":"2023-11-13T11:28:58.617155+0000","last_became_active":"2023-11-13T11:28:57.032076+0000","last_became_peered":"2023-11-13T11:28:57.032076+0000","last_unstale":"2023-11-13T11:28:58.617155+0000","last_undegraded":"2023-11-13T11:28:58.617155+0000","last_fullsized":"2023-11-13T11:28:58.617155+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-13T11:28:56.008687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-13T11:28:56.008687+0000","last_clean_scrub_stamp":"2023-11-13T11:28:56.008687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-14T18:44:09.548832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-13T11:28:58.617060+0000","last_change":"2023-11-13T11:28:57.635615+0000","last_active":"2023-11-13T11:28:58.617060+0000","last_peered":"2023-11-13T11:28:58.617060+0000","last_clean":"2023-11-13T11:28:58.617060+0000","last_became_active":"2023-11-13T11:28:57.635320+0000","last_became_peered":"2023-11-13T11:28:57.635320+0000","last_unstale":"2023-11-13T11:28:58.617060+0000","last_undegraded":"2023-11-13T11:28:58.617060+0000","last_fullsized":"2023-11-13T11:28:58.617060+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-13T11:28:57.010879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-13T11:28:57.010879+0000","last_clean_scrub_stamp":"2023-11-13T11:28:57.010879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-14T18:32:14.993227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-13T11:28:58.677673+0000","last_change":"2023-11-13T11:28:57.043470+0000","last_active":"2023-11-13T11:28:58.677673+0000","last_peered":"2023-11-13T11:28:58.677673+0000","last_clean":"2023-11-13T11:28:58.677673+0000","last_became_active":"2023-11-13T11:28:57.043103+0000","last_became_peered":"2023-11-13T11:28:57.043103+0000","last_unstale":"2023-11-13T11:28:58.677673+0000","last_undegraded":"2023-11-13T11:28:58.677673+0000","last_fullsized":"2023-11-13T11:28:58.677673+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-13T11:28:56.008687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-13T11:28:56.008687+0000","last_clean_scrub_stamp":"2023-11-13T11:28:56.008687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-14T22:20:18.898387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-13T11:28:58.676669+0000","last_change":"2023-11-13T11:28:57.642841+0000","last_active":"2023-11-13T11:28:58.676669+0000","last_peered":"2023-11-13T11:28:58.676669+0000","last_clean":"2023-11-13T11:28:58.676669+0000","last_became_active":"2023-11-13T11:28:57.642544+0000","last_became_peered":"2023-11-13T11:28:57.642544+0000","last_unstale":"2023-11-13T11:28:58.676669+0000","last_undegraded":"2023-11-13T11:28:58.676669+0000","last_fullsized":"2023-11-13T11:28:58.676669+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-13T11:28:57.010879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-13T11:28:57.010879+0000","last_clean_scrub_stamp":"2023-11-13T11:28:57.010879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-14T13:40:46.543740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"21'2","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-13T11:28:58.676211+0000","last_change":"2023-11-13T11:28:57.040625+0000","last_active":"2023-11-13T11:28:58.676211+0000","last_peered":"2023-11-13T11:28:58.676211+0000","last_clean":"2023-11-13T11:28:58.676211+0000","last_became_active":"2023-11-13T11:28:57.040126+0000","last_became_peered":"2023-11-13T11:28:57.040126+0000","last_unstale":"2023-11-13T11:28:58.676211+0000","last_undegraded":"2023-11-13T11:28:58.676211+0000","last_fullsized":"2023-11-13T11:28:58.676211+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-13T11:28:56.008687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-13T11:28:56.008687+0000","last_clean_scrub_stamp":"2023-11-13T11:28:56.008687+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-14T12:47:28.656211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-13T11:28:58.676350+0000","last_change":"2023-11-13T11:28:57.627475+0000","last_active":"2023-11-13T11:28:58.676350+0000","last_peered":"2023-11-13T11:28:58.676350+0000","last_clean":"2023-11-13T11:28:58.676350+0000","last_became_active":"2023-11-13T11:28:57.627157+0000","last_became_peered":"2023-11-13T11:28:57.627157+0000","last_unstale":"2023-11-13T11:28:58.676350+0000","last_undegraded":"2023-11-13T11:28:58.676350+0000","last_fullsized":"2023-11-13T11:28:58.676350+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-13T11:28:57.010879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-13T11:28:57.010879+0000","last_clean_scrub_stamp":"2023-11-13T11:28:57.010879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-14T15:37:40.674035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-13T11:28:58.676431+0000","last_change":"2023-11-13T11:28:57.642899+0000","last_active":"2023-11-13T11:28:58.676431+0000","last_peered":"2023-11-13T11:28:58.676431+0000","last_clean":"2023-11-13T11:28:58.676431+0000","last_became_active":"2023-11-13T11:28:57.642602+0000","last_became_peered":"2023-11-13T11:28:57.642602+0000","last_unstale":"2023-11-13T11:28:58.676431+0000","last_undegraded":"2023-11-13T11:28:58.676431+0000","last_fullsized":"2023-11-13T11:28:58.676431+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-13T11:28:57.010879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-13T11:28:57.010879+0000","last_clean_scrub_stamp":"2023-11-13T11:28:57.010879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-14T13:30:56.684256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1c","version":"21'2","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-13T11:28:58.677239+0000","last_change":"2023-11-13T11:28:57.049062+0000","last_active":"2023-11-13T11:28:58.677239+0000","last_peered":"2023-11-13T11:28:58.677239+0000","last_clean":"2023-11-13T11:28:58.677239+0000","last_became_active":"2023-11-13T11:28:57.048825+0000","last_became_peered":"2023-11-13T11:28:57.048825+0000","last_unstale":"2023-11-13T11:28:58.677239+0000","last_undegraded":"2023-11-13T11:28:58.677239+0000","last_fullsized":"2023-11-13T11:28:58.677239+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-13T11:28:56.008687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-13T11:28:56.008687+0000","last_clean_scrub_stamp":"2023-11-13T11:28:56.008687+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-14T22:16:56.886648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-13T11:28:58.613304+0000","last_change":"2023-11-13T11:28:57.636491+0000","last_active":"2023-11-13T11:28:58.613304+0000","last_peered":"2023-11-13T11:28:58.613304+0000","last_clean":"2023-11-13T11:28:58.613304+0000","last_became_active":"2023-11-13T11:28:57.636231+0000","last_became_peered":"2023-11-13T11:28:57.636231+0000","last_unstale":"2023-11-13T11:28:58.613304+0000","last_undegraded":"2023-11-13T11:28:58.613304+0000","last_fullsized":"2023-11-13T11:28:58.613304+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-13T11:28:57.010879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-13T11:28:57.010879+0000","last_clean_scrub_stamp":"2023-11-13T11:28:57.010879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-14T22:20:19.900579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"21'2","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-13T11:28:58.677362+0000","last_change":"2023-11-13T11:28:57.045391+0000","last_active":"2023-11-13T11:28:58.677362+0000","last_peered":"2023-11-13T11:28:58.677362+0000","last_clean":"2023-11-13T11:28:58.677362+0000","last_became_active":"2023-11-13T11:28:57.045092+0000","last_became_peered":"2023-11-13T11:28:57.045092+0000","last_unstale":"2023-11-13T11:28:58.677362+0000","last_undegraded":"2023-11-13T11:28:58.677362+0000","last_fullsized":"2023-11-13T11:28:58.677362+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-13T11:28:56.008687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-13T11:28:56.008687+0000","last_clean_scrub_stamp":"2023-11-13T11:28:56.008687+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-14T17:58:39.868445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-13T11:28:58.677800+0000","last_change":"2023-11-13T11:28:57.625394+0000","last_active":"2023-11-13T11:28:58.677800+0000","last_peered":"2023-11-13T11:28:58.677800+0000","last_clean":"2023-11-13T11:28:58.677800+0000","last_became_active":"2023-11-13T11:28:57.624669+0000","last_became_peered":"2023-11-13T11:28:57.624669+0000","last_unstale":"2023-11-13T11:28:58.677800+0000","last_undegraded":"2023-11-13T11:28:58.677800+0000","last_fullsized":"2023-11-13T11:28:58.677800+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-13T11:28:57.010879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-13T11:28:57.010879+0000","last_clean_scrub_stamp":"2023-11-13T11:28:57.010879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-14T16:35:00.051619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1e","version":"21'1","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-13T11:28:58.677808+0000","last_change":"2023-11-13T11:28:57.042653+0000","last_active":"2023-11-13T11:28:58.677808+0000","last_peered":"2023-11-13T11:28:58.677808+0000","last_clean":"2023-11-13T11:28:58.677808+0000","last_became_active":"2023-11-13T11:28:57.042473+0000","last_became_peered":"2023-11-13T11:28:57.042473+0000","last_unstale":"2023-11-13T11:28:58.677808+0000","last_undegraded":"2023-11-13T11:28:58.677808+0000","last_fullsized":"2023-11-13T11:28:58.677808+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-13T11:28:56.008687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-13T11:28:56.008687+0000","last_clean_scrub_stamp":"2023-11-13T11:28:56.008687+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-14T22:16:56.886648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-13T11:28:58.677689+0000","last_change":"2023-11-13T11:28:57.636379+0000","last_active":"2023-11-13T11:28:58.677689+0000","last_peered":"2023-11-13T11:28:58.677689+0000","last_clean":"2023-11-13T11:28:58.677689+0000","last_became_active":"2023-11-13T11:28:57.636105+0000","last_became_peered":"2023-11-13T11:28:57.636105+0000","last_unstale":"2023-11-13T11:28:58.677689+0000","last_undegraded":"2023-11-13T11:28:58.677689+0000","last_fullsized":"2023-11-13T11:28:58.677689+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-13T11:28:57.010879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-13T11:28:57.010879+0000","last_clean_scrub_stamp":"2023-11-13T11:28:57.010879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-14T13:24:50.764716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1f","version":"21'4","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-13T11:28:58.617784+0000","last_change":"2023-11-13T11:28:57.046686+0000","last_active":"2023-11-13T11:28:58.617784+0000","last_peered":"2023-11-13T11:28:58.617784+0000","last_clean":"2023-11-13T11:28:58.617784+0000","last_became_active":"2023-11-13T11:28:57.046334+0000","last_became_peered":"2023-11-13T11:28:57.046334+0000","last_unstale":"2023-11-13T11:28:58.617784+0000","last_undegraded":"2023-11-13T11:28:58.617784+0000","last_fullsized":"2023-11-13T11:28:58.617784+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-13T11:28:56.008687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-13T11:28:56.008687+0000","last_clean_scrub_stamp":"2023-11-13T11:28:56.008687+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-14T16:02:42.356089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":15,"seq":64424509446,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":221184,"data_stored":76252,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67000000000000004}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1020000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.74399999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.113}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86299999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0820000000000001}]}]},{"osd":5,"up_from":15,"seq":64424509446,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27820,"kb_used_data":800,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344020,"statfs":{"total":96636764160,"available":96608276480,"internally_reserved":0,"allocated":819200,"data_stored":665743,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73299999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83699999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79400000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48699999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63600000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68600000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76200000000000001}]}]},{"osd":4,"up_from":15,"seq":64424509445,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27256,"kb_used_data":236,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344584,"statfs":{"total":96636764160,"available":96608854016,"internally_reserved":0,"allocated":241664,"data_stored":78536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50800000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57099999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.74199999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64000000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61499999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84899999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78700000000000003}]}]},{"osd":3,"up_from":15,"seq":64424509446,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27240,"kb_used_data":220,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344600,"statfs":{"total":96636764160,"available":96608870400,"internally_reserved":0,"allocated":225280,"data_stored":76834,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33500000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48199999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57599999999999996}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77200000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68000000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67200000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65600000000000003}]}]},{"osd":2,"up_from":15,"seq":64424509446,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27248,"kb_used_data":228,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344592,"statfs":{"total":96636764160,"available":96608862208,"internally_reserved":0,"allocated":233472,"data_stored":77864,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55500000000000005}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51900000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.5}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.754}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59699999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67900000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61099999999999999}]}]},{"osd":1,"up_from":15,"seq":64424509447,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27824,"kb_used_data":800,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344016,"statfs":{"total":96636764160,"available":96608272384,"internally_reserved":0,"allocated":819200,"data_stored":666690,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34899999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40300000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46500000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56299999999999994}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82599999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79600000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78200000000000003}]}]},{"osd":0,"up_from":15,"seq":64424509447,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27240,"kb_used_data":220,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344600,"statfs":{"total":96636764160,"available":96608870400,"internally_reserved":0,"allocated":225280,"data_stored":75339,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51400000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57199999999999995}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54000000000000004}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86599999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84499999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77900000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92400000000000004}]}]},{"osd":7,"up_from":14,"seq":60129542151,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27252,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344588,"statfs":{"total":96636764160,"available":96608858112,"internally_reserved":0,"allocated":229376,"data_stored":76376,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61099999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59299999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53000000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55200000000000005}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.499}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65000000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77600000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-13T11:29:06.763 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-13T11:29:06.935 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:06.931+0000 7f6217817640 1 Processor -- start 2023-11-13T11:29:06.935 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:06.931+0000 7f6217817640 1 -- start start 2023-11-13T11:29:06.936 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:06.931+0000 7f6217817640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f621006d2a0 0x7f62100b2760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:06.937 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:06.931+0000 7f6217817640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f62100b2ca0 0x7f62100b3120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:06.937 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:06.931+0000 7f6217817640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f62100cdae0 con 0x7f62100b2380 2023-11-13T11:29:06.937 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:06.931+0000 7f6217817640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f62100cddb0 con 0x7f62100b2ca0 2023-11-13T11:29:06.937 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:06.931+0000 7f6217817640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f62100ce090 con 0x7f621006d2a0 2023-11-13T11:29:06.938 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:06.931+0000 7f6214db2640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f621006d2a0 0x7f62100b2760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:06.938 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:06.931+0000 7f6215db4640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f62100b2ca0 0x7f62100b3120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:06.939 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:06.931+0000 7f6214db2640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f621006d2a0 0x7f62100b2760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.102:34042/0 (socket says 172.21.15.102:34042) 2023-11-13T11:29:06.939 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:06.931+0000 7f6214db2640 1 -- 172.21.15.102:0/4181842490 learned_addr learned my addr 172.21.15.102:0/4181842490 (peer_addr_for_me v2:172.21.15.102:0/0) 2023-11-13T11:29:06.939 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:06.931+0000 7f6215db4640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f62100b2ca0 0x7f62100b3120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.102:56526/0 (socket says 172.21.15.102:56526) 2023-11-13T11:29:06.939 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:06.931+0000 7f6215db4640 1 -- 172.21.15.102:0/4181842490 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f621006d2a0 msgr2=0x7f62100b2760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-13T11:29:06.940 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:06.931+0000 7f6215db4640 1 --2- 172.21.15.102:0/4181842490 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f621006d2a0 0x7f62100b2760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:06.940 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:06.931+0000 7f6215db4640 1 -- 172.21.15.102:0/4181842490 >> v1:172.21.15.154:6789/0 conn(0x7f62100b2380 legacy=0x7f62100cd3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:06.940 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:06.931+0000 7f6215db4640 1 -- 172.21.15.102:0/4181842490 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62100ce370 con 0x7f62100b2ca0 2023-11-13T11:29:06.941 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:06.935+0000 7f6215db4640 1 --2- 172.21.15.102:0/4181842490 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f62100b2ca0 0x7f62100b3120 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f6208009d90 tx=0x7f620801f130 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cdc45738f366c508 server_cookie=0 in_seq=0 out_seq=0 2023-11-13T11:29:06.942 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:06.935+0000 7f6207fff640 1 -- 172.21.15.102:0/4181842490 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62080af600 con 0x7f62100b2ca0 2023-11-13T11:29:06.942 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:06.935+0000 7f6207fff640 1 -- 172.21.15.102:0/4181842490 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f62080ab050 con 0x7f62100b2ca0 2023-11-13T11:29:06.942 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:06.935+0000 7f6207fff640 1 -- 172.21.15.102:0/4181842490 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62080af980 con 0x7f62100b2ca0 2023-11-13T11:29:06.942 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:06.935+0000 7f6217817640 1 -- 172.21.15.102:0/4181842490 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f62100b2ca0 msgr2=0x7f62100b3120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:06.943 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:06.935+0000 7f6217817640 1 --2- 172.21.15.102:0/4181842490 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f62100b2ca0 0x7f62100b3120 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f6208009d90 tx=0x7f620801f130 comp rx=0 tx=0).stop 2023-11-13T11:29:06.943 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:06.935+0000 7f6217817640 1 -- 172.21.15.102:0/4181842490 shutdown_connections 2023-11-13T11:29:06.943 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:06.935+0000 7f6217817640 1 --2- 172.21.15.102:0/4181842490 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f62100b2ca0 0x7f62100b3120 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:06.943 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:06.935+0000 7f6217817640 1 --2- 172.21.15.102:0/4181842490 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f621006d2a0 0x7f62100b2760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:06.943 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:06.935+0000 7f6217817640 1 -- 172.21.15.102:0/4181842490 >> 172.21.15.102:0/4181842490 conn(0x7f62100b0870 msgr2=0x7f62100b0c80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-13T11:29:06.944 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:06.935+0000 7f6217817640 1 -- 172.21.15.102:0/4181842490 shutdown_connections 2023-11-13T11:29:06.944 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:06.935+0000 7f6217817640 1 -- 172.21.15.102:0/4181842490 wait complete. 2023-11-13T11:29:06.946 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:06.939+0000 7f6217817640 1 Processor -- start 2023-11-13T11:29:06.946 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:06.939+0000 7f6217817640 1 -- start start 2023-11-13T11:29:06.946 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:06.939+0000 7f6217817640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f621006d2a0 0x7f62100c8f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:06.946 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:06.939+0000 7f6217817640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f62100b2380 0x7f62101e9340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:06.947 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:06.939+0000 7f6217817640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f62100b2ca0 0x7f62100c4520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:06.947 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:06.939+0000 7f6217817640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62100c4a60 con 0x7f621006d2a0 2023-11-13T11:29:06.947 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:06.939+0000 7f6217817640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62101f7ff0 con 0x7f62100b2380 2023-11-13T11:29:06.947 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:06.939+0000 7f6217817640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f62100ac4e0 con 0x7f62100b2ca0 2023-11-13T11:29:06.947 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:06.939+0000 7f62155b3640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f621006d2a0 0x7f62100c8f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:06.948 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:06.939+0000 7f62155b3640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f621006d2a0 0x7f62100c8f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:36568/0 (socket says 172.21.15.102:36568) 2023-11-13T11:29:06.948 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:06.939+0000 7f62155b3640 1 -- 172.21.15.102:0/2785114590 learned_addr learned my addr 172.21.15.102:0/2785114590 (peer_addr_for_me v2:172.21.15.102:0/0) 2023-11-13T11:29:06.948 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:06.939+0000 7f62155b3640 1 -- 172.21.15.102:0/2785114590 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f62100b2ca0 msgr2=0x7f62100c4520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:06.948 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:06.939+0000 7f62155b3640 1 --2- 172.21.15.102:0/2785114590 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f62100b2ca0 0x7f62100c4520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:06.948 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:06.939+0000 7f62155b3640 1 -- 172.21.15.102:0/2785114590 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f62100b2380 msgr2=0x7f62101e9340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:06.949 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:06.939+0000 7f62155b3640 1 --2- 172.21.15.102:0/2785114590 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f62100b2380 0x7f62101e9340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:06.949 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:06.939+0000 7f62155b3640 1 -- 172.21.15.102:0/2785114590 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6208009a70 con 0x7f621006d2a0 2023-11-13T11:29:06.949 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:06.939+0000 7f62155b3640 1 --2- 172.21.15.102:0/2785114590 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f621006d2a0 0x7f62100c8f30 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f620c00c500 tx=0x7f620c00c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-13T11:29:06.949 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:06.939+0000 7f6205ffb640 1 -- 172.21.15.102:0/2785114590 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f620c005220 con 0x7f621006d2a0 2023-11-13T11:29:06.949 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:06.939+0000 7f6205ffb640 1 -- 172.21.15.102:0/2785114590 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f620c005380 con 0x7f621006d2a0 2023-11-13T11:29:06.950 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:06.939+0000 7f6217817640 1 -- 172.21.15.102:0/2785114590 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f62100ac7c0 con 0x7f621006d2a0 2023-11-13T11:29:06.950 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:06.939+0000 7f6205ffb640 1 -- 172.21.15.102:0/2785114590 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f620c007270 con 0x7f621006d2a0 2023-11-13T11:29:06.950 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:06.939+0000 7f6217817640 1 -- 172.21.15.102:0/2785114590 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f62101f7a80 con 0x7f621006d2a0 2023-11-13T11:29:06.951 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:06.943+0000 7f6217817640 1 -- 172.21.15.102:0/2785114590 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f62100ac340 con 0x7f621006d2a0 2023-11-13T11:29:06.951 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:06.943+0000 7f6205ffb640 1 -- 172.21.15.102:0/2785114590 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f620c0073d0 con 0x7f621006d2a0 2023-11-13T11:29:06.951 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:06.943+0000 7f6205ffb640 1 --2- 172.21.15.102:0/2785114590 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f61f4066470 0x7f61f4068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:06.952 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:06.943+0000 7f6205ffb640 1 -- 172.21.15.102:0/2785114590 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f620c083760 con 0x7f621006d2a0 2023-11-13T11:29:06.952 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:06.943+0000 7f6214db2640 1 --2- 172.21.15.102:0/2785114590 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f61f4066470 0x7f61f4068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:06.952 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:06.943+0000 7f6214db2640 1 --2- 172.21.15.102:0/2785114590 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f61f4066470 0x7f61f4068930 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f62000094a0 tx=0x7f62000093f0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-13T11:29:06.953 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:06.947+0000 7f6205ffb640 1 -- 172.21.15.102:0/2785114590 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f62100ac340 con 0x7f621006d2a0 2023-11-13T11:29:07.101 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:07.095+0000 7f6217817640 1 -- 172.21.15.102:0/2785114590 --> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f6210070740 con 0x7f61f4066470 2023-11-13T11:29:07.109 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:07.103+0000 7f6205ffb640 1 -- 172.21.15.102:0/2785114590 <== mgr.4103 v2:172.21.15.102:6832/1009482693 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+264564 (secure 0 0 0) 0x7f6210070740 con 0x7f61f4066470 2023-11-13T11:29:07.111 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T11:29:07.113 INFO:teuthology.orchestra.run.smithi102.stderr:dumped all 2023-11-13T11:29:07.114 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:07.107+0000 7f6217817640 1 -- 172.21.15.102:0/2785114590 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f61f4066470 msgr2=0x7f61f4068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:07.114 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:07.107+0000 7f6217817640 1 --2- 172.21.15.102:0/2785114590 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f61f4066470 0x7f61f4068930 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f62000094a0 tx=0x7f62000093f0 comp rx=0 tx=0).stop 2023-11-13T11:29:07.115 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:07.107+0000 7f6217817640 1 -- 172.21.15.102:0/2785114590 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f621006d2a0 msgr2=0x7f62100c8f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:07.115 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:07.107+0000 7f6217817640 1 --2- 172.21.15.102:0/2785114590 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f621006d2a0 0x7f62100c8f30 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f620c00c500 tx=0x7f620c00c9c0 comp rx=0 tx=0).stop 2023-11-13T11:29:07.115 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:07.107+0000 7f6217817640 1 -- 172.21.15.102:0/2785114590 shutdown_connections 2023-11-13T11:29:07.115 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:07.107+0000 7f6217817640 1 --2- 172.21.15.102:0/2785114590 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f62100b2ca0 0x7f62100c4520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:07.116 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:07.107+0000 7f6217817640 1 --2- 172.21.15.102:0/2785114590 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f62100b2380 0x7f62101e9340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:07.116 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:07.107+0000 7f6217817640 1 --2- 172.21.15.102:0/2785114590 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f61f4066470 0x7f61f4068930 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:07.116 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:07.107+0000 7f6217817640 1 --2- 172.21.15.102:0/2785114590 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f621006d2a0 0x7f62100c8f30 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:07.116 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:07.107+0000 7f6217817640 1 -- 172.21.15.102:0/2785114590 >> 172.21.15.102:0/2785114590 conn(0x7f62100b0870 msgr2=0x7f62100a8490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-13T11:29:07.116 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:07.107+0000 7f6217817640 1 -- 172.21.15.102:0/2785114590 shutdown_connections 2023-11-13T11:29:07.117 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:07.107+0000 7f6217817640 1 -- 172.21.15.102:0/2785114590 wait complete. 2023-11-13T11:29:07.132 INFO:teuthology.orchestra.run.smithi102.stdout:{"pg_ready":true,"pg_map":{"version":27,"stamp":"2023-11-13T11:29:06.924805+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219116,"kb_used_data":2944,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755604,"statfs":{"total":773094113280,"available":772869738496,"internally_reserved":0,"allocated":3014656,"data_stored":1793634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"9.313817"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-13T11:28:58.677490+0000","last_change":"2023-11-13T11:28:57.639845+0000","last_active":"2023-11-13T11:28:58.677490+0000","last_peered":"2023-11-13T11:28:58.677490+0000","last_clean":"2023-11-13T11:28:58.677490+0000","last_became_active":"2023-11-13T11:28:57.639218+0000","last_became_peered":"2023-11-13T11:28:57.639218+0000","last_unstale":"2023-11-13T11:28:58.677490+0000","last_undegraded":"2023-11-13T11:28:58.677490+0000","last_fullsized":"2023-11-13T11:28:58.677490+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-13T11:28:57.010879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-13T11:28:57.010879+0000","last_clean_scrub_stamp":"2023-11-13T11:28:57.010879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-14T22:49:31.708378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-13T11:28:58.677700+0000","last_change":"2023-11-13T11:28:57.627422+0000","last_active":"2023-11-13T11:28:58.677700+0000","last_peered":"2023-11-13T11:28:58.677700+0000","last_clean":"2023-11-13T11:28:58.677700+0000","last_became_active":"2023-11-13T11:28:57.627084+0000","last_became_peered":"2023-11-13T11:28:57.627084+0000","last_unstale":"2023-11-13T11:28:58.677700+0000","last_undegraded":"2023-11-13T11:28:58.677700+0000","last_fullsized":"2023-11-13T11:28:58.677700+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-13T11:28:57.010879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-13T11:28:57.010879+0000","last_clean_scrub_stamp":"2023-11-13T11:28:57.010879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-14T13:51:35.559492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-13T11:28:58.677559+0000","last_change":"2023-11-13T11:28:57.624354+0000","last_active":"2023-11-13T11:28:58.677559+0000","last_peered":"2023-11-13T11:28:58.677559+0000","last_clean":"2023-11-13T11:28:58.677559+0000","last_became_active":"2023-11-13T11:28:57.624146+0000","last_became_peered":"2023-11-13T11:28:57.624146+0000","last_unstale":"2023-11-13T11:28:58.677559+0000","last_undegraded":"2023-11-13T11:28:58.677559+0000","last_fullsized":"2023-11-13T11:28:58.677559+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-13T11:28:57.010879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-13T11:28:57.010879+0000","last_clean_scrub_stamp":"2023-11-13T11:28:57.010879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-14T18:39:09.544147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-13T11:28:58.616239+0000","last_change":"2023-11-13T11:28:57.631455+0000","last_active":"2023-11-13T11:28:58.616239+0000","last_peered":"2023-11-13T11:28:58.616239+0000","last_clean":"2023-11-13T11:28:58.616239+0000","last_became_active":"2023-11-13T11:28:57.630777+0000","last_became_peered":"2023-11-13T11:28:57.630777+0000","last_unstale":"2023-11-13T11:28:58.616239+0000","last_undegraded":"2023-11-13T11:28:58.616239+0000","last_fullsized":"2023-11-13T11:28:58.616239+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-13T11:28:57.010879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-13T11:28:57.010879+0000","last_clean_scrub_stamp":"2023-11-13T11:28:57.010879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-14T12:47:29.658403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-13T11:28:58.676950+0000","last_change":"2023-11-13T11:28:57.636281+0000","last_active":"2023-11-13T11:28:58.676950+0000","last_peered":"2023-11-13T11:28:58.676950+0000","last_clean":"2023-11-13T11:28:58.676950+0000","last_became_active":"2023-11-13T11:28:57.635550+0000","last_became_peered":"2023-11-13T11:28:57.635550+0000","last_unstale":"2023-11-13T11:28:58.676950+0000","last_undegraded":"2023-11-13T11:28:58.676950+0000","last_fullsized":"2023-11-13T11:28:58.676950+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-13T11:28:57.010879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-13T11:28:57.010879+0000","last_clean_scrub_stamp":"2023-11-13T11:28:57.010879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-14T22:20:14.170174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-13T11:28:58.616167+0000","last_change":"2023-11-13T11:28:57.638583+0000","last_active":"2023-11-13T11:28:58.616167+0000","last_peered":"2023-11-13T11:28:58.616167+0000","last_clean":"2023-11-13T11:28:58.616167+0000","last_became_active":"2023-11-13T11:28:57.638322+0000","last_became_peered":"2023-11-13T11:28:57.638322+0000","last_unstale":"2023-11-13T11:28:58.616167+0000","last_undegraded":"2023-11-13T11:28:58.616167+0000","last_fullsized":"2023-11-13T11:28:58.616167+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-13T11:28:57.010879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-13T11:28:57.010879+0000","last_clean_scrub_stamp":"2023-11-13T11:28:57.010879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-14T22:20:19.900579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-13T11:28:58.676818+0000","last_change":"2023-11-13T11:28:57.628322+0000","last_active":"2023-11-13T11:28:58.676818+0000","last_peered":"2023-11-13T11:28:58.676818+0000","last_clean":"2023-11-13T11:28:58.676818+0000","last_became_active":"2023-11-13T11:28:57.628022+0000","last_became_peered":"2023-11-13T11:28:57.628022+0000","last_unstale":"2023-11-13T11:28:58.676818+0000","last_undegraded":"2023-11-13T11:28:58.676818+0000","last_fullsized":"2023-11-13T11:28:58.676818+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-13T11:28:57.010879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-13T11:28:57.010879+0000","last_clean_scrub_stamp":"2023-11-13T11:28:57.010879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-14T16:47:11.682554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-13T11:28:58.676863+0000","last_change":"2023-11-13T11:28:57.635006+0000","last_active":"2023-11-13T11:28:58.676863+0000","last_peered":"2023-11-13T11:28:58.676863+0000","last_clean":"2023-11-13T11:28:58.676863+0000","last_became_active":"2023-11-13T11:28:57.634769+0000","last_became_peered":"2023-11-13T11:28:57.634769+0000","last_unstale":"2023-11-13T11:28:58.676863+0000","last_undegraded":"2023-11-13T11:28:58.676863+0000","last_fullsized":"2023-11-13T11:28:58.676863+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-13T11:28:57.010879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-13T11:28:57.010879+0000","last_clean_scrub_stamp":"2023-11-13T11:28:57.010879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-14T21:42:19.412264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-13T11:28:58.613659+0000","last_change":"2023-11-13T11:28:57.623676+0000","last_active":"2023-11-13T11:28:58.613659+0000","last_peered":"2023-11-13T11:28:58.613659+0000","last_clean":"2023-11-13T11:28:58.613659+0000","last_became_active":"2023-11-13T11:28:57.623400+0000","last_became_peered":"2023-11-13T11:28:57.623400+0000","last_unstale":"2023-11-13T11:28:58.613659+0000","last_undegraded":"2023-11-13T11:28:58.613659+0000","last_fullsized":"2023-11-13T11:28:58.613659+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-13T11:28:57.010879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-13T11:28:57.010879+0000","last_clean_scrub_stamp":"2023-11-13T11:28:57.010879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-14T17:58:40.870637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-13T11:28:58.677620+0000","last_change":"2023-11-13T11:28:57.636734+0000","last_active":"2023-11-13T11:28:58.677620+0000","last_peered":"2023-11-13T11:28:58.677620+0000","last_clean":"2023-11-13T11:28:58.677620+0000","last_became_active":"2023-11-13T11:28:57.636461+0000","last_became_peered":"2023-11-13T11:28:57.636461+0000","last_unstale":"2023-11-13T11:28:58.677620+0000","last_undegraded":"2023-11-13T11:28:58.677620+0000","last_fullsized":"2023-11-13T11:28:58.677620+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-13T11:28:57.010879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-13T11:28:57.010879+0000","last_clean_scrub_stamp":"2023-11-13T11:28:57.010879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-14T13:13:26.359918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-13T11:28:58.677026+0000","last_change":"2023-11-13T11:28:57.639520+0000","last_active":"2023-11-13T11:28:58.677026+0000","last_peered":"2023-11-13T11:28:58.677026+0000","last_clean":"2023-11-13T11:28:58.677026+0000","last_became_active":"2023-11-13T11:28:57.639240+0000","last_became_peered":"2023-11-13T11:28:57.639240+0000","last_unstale":"2023-11-13T11:28:58.677026+0000","last_undegraded":"2023-11-13T11:28:58.677026+0000","last_fullsized":"2023-11-13T11:28:58.677026+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-13T11:28:57.010879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-13T11:28:57.010879+0000","last_clean_scrub_stamp":"2023-11-13T11:28:57.010879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-14T18:39:09.544147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-13T11:28:58.677082+0000","last_change":"2023-11-13T11:28:57.634782+0000","last_active":"2023-11-13T11:28:58.677082+0000","last_peered":"2023-11-13T11:28:58.677082+0000","last_clean":"2023-11-13T11:28:58.677082+0000","last_became_active":"2023-11-13T11:28:57.634488+0000","last_became_peered":"2023-11-13T11:28:57.634488+0000","last_unstale":"2023-11-13T11:28:58.677082+0000","last_undegraded":"2023-11-13T11:28:58.677082+0000","last_fullsized":"2023-11-13T11:28:58.677082+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-13T11:28:57.010879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-13T11:28:57.010879+0000","last_clean_scrub_stamp":"2023-11-13T11:28:57.010879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-14T13:24:50.764716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-13T11:28:58.677279+0000","last_change":"2023-11-13T11:28:57.644331+0000","last_active":"2023-11-13T11:28:58.677279+0000","last_peered":"2023-11-13T11:28:58.677279+0000","last_clean":"2023-11-13T11:28:58.677279+0000","last_became_active":"2023-11-13T11:28:57.643877+0000","last_became_peered":"2023-11-13T11:28:57.643877+0000","last_unstale":"2023-11-13T11:28:58.677279+0000","last_undegraded":"2023-11-13T11:28:58.677279+0000","last_fullsized":"2023-11-13T11:28:58.677279+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-13T11:28:57.010879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-13T11:28:57.010879+0000","last_clean_scrub_stamp":"2023-11-13T11:28:57.010879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-14T17:58:40.870637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-13T11:28:58.677454+0000","last_change":"2023-11-13T11:28:57.632228+0000","last_active":"2023-11-13T11:28:58.677454+0000","last_peered":"2023-11-13T11:28:58.677454+0000","last_clean":"2023-11-13T11:28:58.677454+0000","last_became_active":"2023-11-13T11:28:57.631793+0000","last_became_peered":"2023-11-13T11:28:57.631793+0000","last_unstale":"2023-11-13T11:28:58.677454+0000","last_undegraded":"2023-11-13T11:28:58.677454+0000","last_fullsized":"2023-11-13T11:28:58.677454+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-13T11:28:57.010879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-13T11:28:57.010879+0000","last_clean_scrub_stamp":"2023-11-13T11:28:57.010879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-14T11:40:58.842068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-13T11:28:58.677021+0000","last_change":"2023-11-13T11:28:57.643105+0000","last_active":"2023-11-13T11:28:58.677021+0000","last_peered":"2023-11-13T11:28:58.677021+0000","last_clean":"2023-11-13T11:28:58.677021+0000","last_became_active":"2023-11-13T11:28:57.642876+0000","last_became_peered":"2023-11-13T11:28:57.642876+0000","last_unstale":"2023-11-13T11:28:58.677021+0000","last_undegraded":"2023-11-13T11:28:58.677021+0000","last_fullsized":"2023-11-13T11:28:58.677021+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-13T11:28:57.010879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-13T11:28:57.010879+0000","last_clean_scrub_stamp":"2023-11-13T11:28:57.010879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-14T23:10:03.463557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-13T11:28:58.675939+0000","last_change":"2023-11-13T11:28:57.632118+0000","last_active":"2023-11-13T11:28:58.675939+0000","last_peered":"2023-11-13T11:28:58.675939+0000","last_clean":"2023-11-13T11:28:58.675939+0000","last_became_active":"2023-11-13T11:28:57.631823+0000","last_became_peered":"2023-11-13T11:28:57.631823+0000","last_unstale":"2023-11-13T11:28:58.675939+0000","last_undegraded":"2023-11-13T11:28:58.675939+0000","last_fullsized":"2023-11-13T11:28:58.675939+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-13T11:28:57.010879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-13T11:28:57.010879+0000","last_clean_scrub_stamp":"2023-11-13T11:28:57.010879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-14T16:35:00.051619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-13T11:28:58.676578+0000","last_change":"2023-11-13T11:28:57.636613+0000","last_active":"2023-11-13T11:28:58.676578+0000","last_peered":"2023-11-13T11:28:58.676578+0000","last_clean":"2023-11-13T11:28:58.676578+0000","last_became_active":"2023-11-13T11:28:57.636361+0000","last_became_peered":"2023-11-13T11:28:57.636361+0000","last_unstale":"2023-11-13T11:28:58.676578+0000","last_undegraded":"2023-11-13T11:28:58.676578+0000","last_fullsized":"2023-11-13T11:28:58.676578+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-13T11:28:57.010879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-13T11:28:57.010879+0000","last_clean_scrub_stamp":"2023-11-13T11:28:57.010879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-14T22:52:54.214180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-13T11:28:58.677191+0000","last_change":"2023-11-13T11:28:57.642425+0000","last_active":"2023-11-13T11:28:58.677191+0000","last_peered":"2023-11-13T11:28:58.677191+0000","last_clean":"2023-11-13T11:28:58.677191+0000","last_became_active":"2023-11-13T11:28:57.641266+0000","last_became_peered":"2023-11-13T11:28:57.641266+0000","last_unstale":"2023-11-13T11:28:58.677191+0000","last_undegraded":"2023-11-13T11:28:58.677191+0000","last_fullsized":"2023-11-13T11:28:58.677191+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-13T11:28:57.010879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-13T11:28:57.010879+0000","last_clean_scrub_stamp":"2023-11-13T11:28:57.010879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-14T13:10:19.954130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-13T11:28:58.676577+0000","last_change":"2023-11-13T11:28:57.637356+0000","last_active":"2023-11-13T11:28:58.676577+0000","last_peered":"2023-11-13T11:28:58.676577+0000","last_clean":"2023-11-13T11:28:58.676577+0000","last_became_active":"2023-11-13T11:28:57.637069+0000","last_became_peered":"2023-11-13T11:28:57.637069+0000","last_unstale":"2023-11-13T11:28:58.676577+0000","last_undegraded":"2023-11-13T11:28:58.676577+0000","last_fullsized":"2023-11-13T11:28:58.676577+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-13T11:28:57.010879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-13T11:28:57.010879+0000","last_clean_scrub_stamp":"2023-11-13T11:28:57.010879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-14T21:53:05.134410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-13T11:28:58.677142+0000","last_change":"2023-11-13T11:28:57.636634+0000","last_active":"2023-11-13T11:28:58.677142+0000","last_peered":"2023-11-13T11:28:58.677142+0000","last_clean":"2023-11-13T11:28:58.677142+0000","last_became_active":"2023-11-13T11:28:57.636278+0000","last_became_peered":"2023-11-13T11:28:57.636278+0000","last_unstale":"2023-11-13T11:28:58.677142+0000","last_undegraded":"2023-11-13T11:28:58.677142+0000","last_fullsized":"2023-11-13T11:28:58.677142+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-13T11:28:57.010879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-13T11:28:57.010879+0000","last_clean_scrub_stamp":"2023-11-13T11:28:57.010879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-14T13:51:35.559492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-13T11:28:58.617298+0000","last_change":"2023-11-13T11:28:57.633282+0000","last_active":"2023-11-13T11:28:58.617298+0000","last_peered":"2023-11-13T11:28:58.617298+0000","last_clean":"2023-11-13T11:28:58.617298+0000","last_became_active":"2023-11-13T11:28:57.633008+0000","last_became_peered":"2023-11-13T11:28:57.633008+0000","last_unstale":"2023-11-13T11:28:58.617298+0000","last_undegraded":"2023-11-13T11:28:58.617298+0000","last_fullsized":"2023-11-13T11:28:58.617298+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-13T11:28:57.010879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-13T11:28:57.010879+0000","last_clean_scrub_stamp":"2023-11-13T11:28:57.010879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-14T12:34:10.639080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-13T11:28:58.613391+0000","last_change":"2023-11-13T11:28:57.639417+0000","last_active":"2023-11-13T11:28:58.613391+0000","last_peered":"2023-11-13T11:28:58.613391+0000","last_clean":"2023-11-13T11:28:58.613391+0000","last_became_active":"2023-11-13T11:28:57.639132+0000","last_became_peered":"2023-11-13T11:28:57.639132+0000","last_unstale":"2023-11-13T11:28:58.613391+0000","last_undegraded":"2023-11-13T11:28:58.613391+0000","last_fullsized":"2023-11-13T11:28:58.613391+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-13T11:28:57.010879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-13T11:28:57.010879+0000","last_clean_scrub_stamp":"2023-11-13T11:28:57.010879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-14T12:47:29.658403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-13T11:28:58.677488+0000","last_change":"2023-11-13T11:28:57.633636+0000","last_active":"2023-11-13T11:28:58.677488+0000","last_peered":"2023-11-13T11:28:58.677488+0000","last_clean":"2023-11-13T11:28:58.677488+0000","last_became_active":"2023-11-13T11:28:57.632529+0000","last_became_peered":"2023-11-13T11:28:57.632529+0000","last_unstale":"2023-11-13T11:28:58.677488+0000","last_undegraded":"2023-11-13T11:28:58.677488+0000","last_fullsized":"2023-11-13T11:28:58.677488+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-13T11:28:57.010879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-13T11:28:57.010879+0000","last_clean_scrub_stamp":"2023-11-13T11:28:57.010879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-14T22:20:14.170174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-13T11:28:58.675948+0000","last_change":"2023-11-13T11:28:57.630397+0000","last_active":"2023-11-13T11:28:58.675948+0000","last_peered":"2023-11-13T11:28:58.675948+0000","last_clean":"2023-11-13T11:28:58.675948+0000","last_became_active":"2023-11-13T11:28:57.630049+0000","last_became_peered":"2023-11-13T11:28:57.630049+0000","last_unstale":"2023-11-13T11:28:58.675948+0000","last_undegraded":"2023-11-13T11:28:58.675948+0000","last_fullsized":"2023-11-13T11:28:58.675948+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-13T11:28:57.010879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-13T11:28:57.010879+0000","last_clean_scrub_stamp":"2023-11-13T11:28:57.010879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-14T22:49:31.708378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-13T11:28:58.677751+0000","last_change":"2023-11-13T11:28:57.627535+0000","last_active":"2023-11-13T11:28:58.677751+0000","last_peered":"2023-11-13T11:28:58.677751+0000","last_clean":"2023-11-13T11:28:58.677751+0000","last_became_active":"2023-11-13T11:28:57.625057+0000","last_became_peered":"2023-11-13T11:28:57.625057+0000","last_unstale":"2023-11-13T11:28:58.677751+0000","last_undegraded":"2023-11-13T11:28:58.677751+0000","last_fullsized":"2023-11-13T11:28:58.677751+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-13T11:28:57.010879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-13T11:28:57.010879+0000","last_clean_scrub_stamp":"2023-11-13T11:28:57.010879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-14T16:55:58.610937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-13T11:28:58.616465+0000","last_change":"2023-11-13T11:28:57.635961+0000","last_active":"2023-11-13T11:28:58.616465+0000","last_peered":"2023-11-13T11:28:58.616465+0000","last_clean":"2023-11-13T11:28:58.616465+0000","last_became_active":"2023-11-13T11:28:57.635672+0000","last_became_peered":"2023-11-13T11:28:57.635672+0000","last_unstale":"2023-11-13T11:28:58.616465+0000","last_undegraded":"2023-11-13T11:28:58.616465+0000","last_fullsized":"2023-11-13T11:28:58.616465+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-13T11:28:57.010879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-13T11:28:57.010879+0000","last_clean_scrub_stamp":"2023-11-13T11:28:57.010879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-14T17:58:40.870637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-13T11:28:58.678102+0000","last_change":"2023-11-13T11:28:57.632312+0000","last_active":"2023-11-13T11:28:58.678102+0000","last_peered":"2023-11-13T11:28:58.678102+0000","last_clean":"2023-11-13T11:28:58.678102+0000","last_became_active":"2023-11-13T11:28:57.631906+0000","last_became_peered":"2023-11-13T11:28:57.631906+0000","last_unstale":"2023-11-13T11:28:58.678102+0000","last_undegraded":"2023-11-13T11:28:58.678102+0000","last_fullsized":"2023-11-13T11:28:58.678102+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-13T11:28:57.010879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-13T11:28:57.010879+0000","last_clean_scrub_stamp":"2023-11-13T11:28:57.010879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-14T12:45:23.017972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-13T11:28:58.677455+0000","last_change":"2023-11-13T11:28:57.639397+0000","last_active":"2023-11-13T11:28:58.677455+0000","last_peered":"2023-11-13T11:28:58.677455+0000","last_clean":"2023-11-13T11:28:58.677455+0000","last_became_active":"2023-11-13T11:28:57.639114+0000","last_became_peered":"2023-11-13T11:28:57.639114+0000","last_unstale":"2023-11-13T11:28:58.677455+0000","last_undegraded":"2023-11-13T11:28:58.677455+0000","last_fullsized":"2023-11-13T11:28:58.677455+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-13T11:28:57.010879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-13T11:28:57.010879+0000","last_clean_scrub_stamp":"2023-11-13T11:28:57.010879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-14T16:02:43.358281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-13T11:28:58.677535+0000","last_change":"2023-11-13T11:28:57.632030+0000","last_active":"2023-11-13T11:28:58.677535+0000","last_peered":"2023-11-13T11:28:58.677535+0000","last_clean":"2023-11-13T11:28:58.677535+0000","last_became_active":"2023-11-13T11:28:57.631756+0000","last_became_peered":"2023-11-13T11:28:57.631756+0000","last_unstale":"2023-11-13T11:28:58.677535+0000","last_undegraded":"2023-11-13T11:28:58.677535+0000","last_fullsized":"2023-11-13T11:28:58.677535+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-13T11:28:57.010879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-13T11:28:57.010879+0000","last_clean_scrub_stamp":"2023-11-13T11:28:57.010879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-14T14:29:59.365142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-13T11:28:58.676220+0000","last_change":"2023-11-13T11:28:57.634137+0000","last_active":"2023-11-13T11:28:58.676220+0000","last_peered":"2023-11-13T11:28:58.676220+0000","last_clean":"2023-11-13T11:28:58.676220+0000","last_became_active":"2023-11-13T11:28:57.633803+0000","last_became_peered":"2023-11-13T11:28:57.633803+0000","last_unstale":"2023-11-13T11:28:58.676220+0000","last_undegraded":"2023-11-13T11:28:58.676220+0000","last_fullsized":"2023-11-13T11:28:58.676220+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-13T11:28:57.010879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-13T11:28:57.010879+0000","last_clean_scrub_stamp":"2023-11-13T11:28:57.010879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-14T12:18:09.759922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-13T11:28:58.676433+0000","last_change":"2023-11-13T11:28:57.637093+0000","last_active":"2023-11-13T11:28:58.676433+0000","last_peered":"2023-11-13T11:28:58.676433+0000","last_clean":"2023-11-13T11:28:58.676433+0000","last_became_active":"2023-11-13T11:28:57.636765+0000","last_became_peered":"2023-11-13T11:28:57.636765+0000","last_unstale":"2023-11-13T11:28:58.676433+0000","last_undegraded":"2023-11-13T11:28:58.676433+0000","last_fullsized":"2023-11-13T11:28:58.676433+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-13T11:28:57.010879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-13T11:28:57.010879+0000","last_clean_scrub_stamp":"2023-11-13T11:28:57.010879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-14T15:45:30.694781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-13T11:28:58.616081+0000","last_change":"2023-11-13T11:28:57.632897+0000","last_active":"2023-11-13T11:28:58.616081+0000","last_peered":"2023-11-13T11:28:58.616081+0000","last_clean":"2023-11-13T11:28:58.616081+0000","last_became_active":"2023-11-13T11:28:57.632596+0000","last_became_peered":"2023-11-13T11:28:57.632596+0000","last_unstale":"2023-11-13T11:28:58.616081+0000","last_undegraded":"2023-11-13T11:28:58.616081+0000","last_fullsized":"2023-11-13T11:28:58.616081+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-13T11:28:57.010879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-13T11:28:57.010879+0000","last_clean_scrub_stamp":"2023-11-13T11:28:57.010879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-14T18:44:10.551024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-13T11:28:58.613160+0000","last_change":"2023-11-13T11:28:57.625017+0000","last_active":"2023-11-13T11:28:58.613160+0000","last_peered":"2023-11-13T11:28:58.613160+0000","last_clean":"2023-11-13T11:28:58.613160+0000","last_became_active":"2023-11-13T11:28:57.624314+0000","last_became_peered":"2023-11-13T11:28:57.624314+0000","last_unstale":"2023-11-13T11:28:58.613160+0000","last_undegraded":"2023-11-13T11:28:58.613160+0000","last_fullsized":"2023-11-13T11:28:58.613160+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-13T11:28:57.010879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-13T11:28:57.010879+0000","last_clean_scrub_stamp":"2023-11-13T11:28:57.010879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-14T19:51:05.461013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1b","version":"21'1","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-13T11:28:58.677644+0000","last_change":"2023-11-13T11:28:57.043256+0000","last_active":"2023-11-13T11:28:58.677644+0000","last_peered":"2023-11-13T11:28:58.677644+0000","last_clean":"2023-11-13T11:28:58.677644+0000","last_became_active":"2023-11-13T11:28:57.041999+0000","last_became_peered":"2023-11-13T11:28:57.041999+0000","last_unstale":"2023-11-13T11:28:58.677644+0000","last_undegraded":"2023-11-13T11:28:58.677644+0000","last_fullsized":"2023-11-13T11:28:58.677644+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-13T11:28:56.008687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-13T11:28:56.008687+0000","last_clean_scrub_stamp":"2023-11-13T11:28:56.008687+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-14T18:32:13.991035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-13T11:28:58.617421+0000","last_change":"2023-11-13T11:28:57.635747+0000","last_active":"2023-11-13T11:28:58.617421+0000","last_peered":"2023-11-13T11:28:58.617421+0000","last_clean":"2023-11-13T11:28:58.617421+0000","last_became_active":"2023-11-13T11:28:57.635406+0000","last_became_peered":"2023-11-13T11:28:57.635406+0000","last_unstale":"2023-11-13T11:28:58.617421+0000","last_undegraded":"2023-11-13T11:28:58.617421+0000","last_fullsized":"2023-11-13T11:28:58.617421+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-13T11:28:57.010879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-13T11:28:57.010879+0000","last_clean_scrub_stamp":"2023-11-13T11:28:57.010879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-14T22:16:57.888840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1a","version":"21'1","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-13T11:28:58.676434+0000","last_change":"2023-11-13T11:28:57.047326+0000","last_active":"2023-11-13T11:28:58.676434+0000","last_peered":"2023-11-13T11:28:58.676434+0000","last_clean":"2023-11-13T11:28:58.676434+0000","last_became_active":"2023-11-13T11:28:57.047058+0000","last_became_peered":"2023-11-13T11:28:57.047058+0000","last_unstale":"2023-11-13T11:28:58.676434+0000","last_undegraded":"2023-11-13T11:28:58.676434+0000","last_fullsized":"2023-11-13T11:28:58.676434+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-13T11:28:56.008687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-13T11:28:56.008687+0000","last_clean_scrub_stamp":"2023-11-13T11:28:56.008687+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-14T21:42:18.410072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-13T11:28:58.677872+0000","last_change":"2023-11-13T11:28:57.039378+0000","last_active":"2023-11-13T11:28:58.677872+0000","last_peered":"2023-11-13T11:28:58.677872+0000","last_clean":"2023-11-13T11:28:58.677872+0000","last_became_active":"2023-11-13T11:28:57.038955+0000","last_became_peered":"2023-11-13T11:28:57.038955+0000","last_unstale":"2023-11-13T11:28:58.677872+0000","last_undegraded":"2023-11-13T11:28:58.677872+0000","last_fullsized":"2023-11-13T11:28:58.677872+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-13T11:28:56.008687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-13T11:28:56.008687+0000","last_clean_scrub_stamp":"2023-11-13T11:28:56.008687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-14T19:51:04.458821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-13T11:28:58.677161+0000","last_change":"2023-11-13T11:28:57.635612+0000","last_active":"2023-11-13T11:28:58.677161+0000","last_peered":"2023-11-13T11:28:58.677161+0000","last_clean":"2023-11-13T11:28:58.677161+0000","last_became_active":"2023-11-13T11:28:57.633904+0000","last_became_peered":"2023-11-13T11:28:57.633904+0000","last_unstale":"2023-11-13T11:28:58.677161+0000","last_undegraded":"2023-11-13T11:28:58.677161+0000","last_fullsized":"2023-11-13T11:28:58.677161+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-13T11:28:57.010879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-13T11:28:57.010879+0000","last_clean_scrub_stamp":"2023-11-13T11:28:57.010879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-14T16:47:11.682554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-13T11:28:58.676165+0000","last_change":"2023-11-13T11:28:57.050197+0000","last_active":"2023-11-13T11:28:58.676165+0000","last_peered":"2023-11-13T11:28:58.676165+0000","last_clean":"2023-11-13T11:28:58.676165+0000","last_became_active":"2023-11-13T11:28:57.049917+0000","last_became_peered":"2023-11-13T11:28:57.049917+0000","last_unstale":"2023-11-13T11:28:58.676165+0000","last_undegraded":"2023-11-13T11:28:58.676165+0000","last_fullsized":"2023-11-13T11:28:58.676165+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-13T11:28:56.008687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-13T11:28:56.008687+0000","last_clean_scrub_stamp":"2023-11-13T11:28:56.008687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-14T11:40:57.839875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-13T11:28:58.617477+0000","last_change":"2023-11-13T11:28:57.620218+0000","last_active":"2023-11-13T11:28:58.617477+0000","last_peered":"2023-11-13T11:28:58.617477+0000","last_clean":"2023-11-13T11:28:58.617477+0000","last_became_active":"2023-11-13T11:28:57.619919+0000","last_became_peered":"2023-11-13T11:28:57.619919+0000","last_unstale":"2023-11-13T11:28:58.617477+0000","last_undegraded":"2023-11-13T11:28:58.617477+0000","last_fullsized":"2023-11-13T11:28:58.617477+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-13T11:28:57.010879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-13T11:28:57.010879+0000","last_clean_scrub_stamp":"2023-11-13T11:28:57.010879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-14T21:42:19.412264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-13T11:28:58.613639+0000","last_change":"2023-11-13T11:28:57.041825+0000","last_active":"2023-11-13T11:28:58.613639+0000","last_peered":"2023-11-13T11:28:58.613639+0000","last_clean":"2023-11-13T11:28:58.613639+0000","last_became_active":"2023-11-13T11:28:57.041650+0000","last_became_peered":"2023-11-13T11:28:57.041650+0000","last_unstale":"2023-11-13T11:28:58.613639+0000","last_undegraded":"2023-11-13T11:28:58.613639+0000","last_fullsized":"2023-11-13T11:28:58.613639+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-13T11:28:56.008687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-13T11:28:56.008687+0000","last_clean_scrub_stamp":"2023-11-13T11:28:56.008687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-14T12:41:42.933021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-13T11:28:58.616521+0000","last_change":"2023-11-13T11:28:57.632784+0000","last_active":"2023-11-13T11:28:58.616521+0000","last_peered":"2023-11-13T11:28:58.616521+0000","last_clean":"2023-11-13T11:28:58.616521+0000","last_became_active":"2023-11-13T11:28:57.631854+0000","last_became_peered":"2023-11-13T11:28:57.631854+0000","last_unstale":"2023-11-13T11:28:58.616521+0000","last_undegraded":"2023-11-13T11:28:58.616521+0000","last_fullsized":"2023-11-13T11:28:58.616521+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-13T11:28:57.010879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-13T11:28:57.010879+0000","last_clean_scrub_stamp":"2023-11-13T11:28:57.010879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-14T11:40:58.842068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-13T11:28:58.677636+0000","last_change":"2023-11-13T11:28:57.049038+0000","last_active":"2023-11-13T11:28:58.677636+0000","last_peered":"2023-11-13T11:28:58.677636+0000","last_clean":"2023-11-13T11:28:58.677636+0000","last_became_active":"2023-11-13T11:28:57.048768+0000","last_became_peered":"2023-11-13T11:28:57.048768+0000","last_unstale":"2023-11-13T11:28:58.677636+0000","last_undegraded":"2023-11-13T11:28:58.677636+0000","last_fullsized":"2023-11-13T11:28:58.677636+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-13T11:28:56.008687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-13T11:28:56.008687+0000","last_clean_scrub_stamp":"2023-11-13T11:28:56.008687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-14T12:45:22.015780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-13T11:28:58.677861+0000","last_change":"2023-11-13T11:28:57.627287+0000","last_active":"2023-11-13T11:28:58.677861+0000","last_peered":"2023-11-13T11:28:58.677861+0000","last_clean":"2023-11-13T11:28:58.677861+0000","last_became_active":"2023-11-13T11:28:57.623471+0000","last_became_peered":"2023-11-13T11:28:57.623471+0000","last_unstale":"2023-11-13T11:28:58.677861+0000","last_undegraded":"2023-11-13T11:28:58.677861+0000","last_fullsized":"2023-11-13T11:28:58.677861+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-13T11:28:57.010879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-13T11:28:57.010879+0000","last_clean_scrub_stamp":"2023-11-13T11:28:57.010879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-14T22:49:31.708378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.15","version":"21'3","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-13T11:28:58.676868+0000","last_change":"2023-11-13T11:28:57.037793+0000","last_active":"2023-11-13T11:28:58.676868+0000","last_peered":"2023-11-13T11:28:58.676868+0000","last_clean":"2023-11-13T11:28:58.676868+0000","last_became_active":"2023-11-13T11:28:57.037300+0000","last_became_peered":"2023-11-13T11:28:57.037300+0000","last_unstale":"2023-11-13T11:28:58.676868+0000","last_undegraded":"2023-11-13T11:28:58.676868+0000","last_fullsized":"2023-11-13T11:28:58.676868+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-13T11:28:56.008687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-13T11:28:56.008687+0000","last_clean_scrub_stamp":"2023-11-13T11:28:56.008687+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-14T22:52:35.101002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-13T11:28:58.676110+0000","last_change":"2023-11-13T11:28:57.639554+0000","last_active":"2023-11-13T11:28:58.676110+0000","last_peered":"2023-11-13T11:28:58.676110+0000","last_clean":"2023-11-13T11:28:58.676110+0000","last_became_active":"2023-11-13T11:28:57.639192+0000","last_became_peered":"2023-11-13T11:28:57.639192+0000","last_unstale":"2023-11-13T11:28:58.676110+0000","last_undegraded":"2023-11-13T11:28:58.676110+0000","last_fullsized":"2023-11-13T11:28:58.676110+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-13T11:28:57.010879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-13T11:28:57.010879+0000","last_clean_scrub_stamp":"2023-11-13T11:28:57.010879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-14T13:13:26.359918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.14","version":"21'6","reported_seq":18,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-13T11:28:58.616288+0000","last_change":"2023-11-13T11:28:57.026285+0000","last_active":"2023-11-13T11:28:58.616288+0000","last_peered":"2023-11-13T11:28:58.616288+0000","last_clean":"2023-11-13T11:28:58.616288+0000","last_became_active":"2023-11-13T11:28:57.026026+0000","last_became_peered":"2023-11-13T11:28:57.026026+0000","last_unstale":"2023-11-13T11:28:58.616288+0000","last_undegraded":"2023-11-13T11:28:58.616288+0000","last_fullsized":"2023-11-13T11:28:58.616288+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-13T11:28:56.008687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-13T11:28:56.008687+0000","last_clean_scrub_stamp":"2023-11-13T11:28:56.008687+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-14T20:07:21.176638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-13T11:28:58.677361+0000","last_change":"2023-11-13T11:28:57.633747+0000","last_active":"2023-11-13T11:28:58.677361+0000","last_peered":"2023-11-13T11:28:58.677361+0000","last_clean":"2023-11-13T11:28:58.677361+0000","last_became_active":"2023-11-13T11:28:57.633454+0000","last_became_peered":"2023-11-13T11:28:57.633454+0000","last_unstale":"2023-11-13T11:28:58.677361+0000","last_undegraded":"2023-11-13T11:28:58.677361+0000","last_fullsized":"2023-11-13T11:28:58.677361+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-13T11:28:57.010879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-13T11:28:57.010879+0000","last_clean_scrub_stamp":"2023-11-13T11:28:57.010879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-14T16:35:00.051619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"21'2","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-13T11:28:58.676714+0000","last_change":"2023-11-13T11:28:57.039714+0000","last_active":"2023-11-13T11:28:58.676714+0000","last_peered":"2023-11-13T11:28:58.676714+0000","last_clean":"2023-11-13T11:28:58.676714+0000","last_became_active":"2023-11-13T11:28:57.039008+0000","last_became_peered":"2023-11-13T11:28:57.039008+0000","last_unstale":"2023-11-13T11:28:58.676714+0000","last_undegraded":"2023-11-13T11:28:58.676714+0000","last_fullsized":"2023-11-13T11:28:58.676714+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-13T11:28:56.008687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-13T11:28:56.008687+0000","last_clean_scrub_stamp":"2023-11-13T11:28:56.008687+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-14T11:45:58.589019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-13T11:28:58.677597+0000","last_change":"2023-11-13T11:28:57.641476+0000","last_active":"2023-11-13T11:28:58.677597+0000","last_peered":"2023-11-13T11:28:58.677597+0000","last_clean":"2023-11-13T11:28:58.677597+0000","last_became_active":"2023-11-13T11:28:57.640673+0000","last_became_peered":"2023-11-13T11:28:57.640673+0000","last_unstale":"2023-11-13T11:28:58.677597+0000","last_undegraded":"2023-11-13T11:28:58.677597+0000","last_fullsized":"2023-11-13T11:28:58.677597+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-13T11:28:57.010879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-13T11:28:57.010879+0000","last_clean_scrub_stamp":"2023-11-13T11:28:57.010879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-14T18:32:14.993227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-13T11:28:58.676518+0000","last_change":"2023-11-13T11:28:57.038744+0000","last_active":"2023-11-13T11:28:58.676518+0000","last_peered":"2023-11-13T11:28:58.676518+0000","last_clean":"2023-11-13T11:28:58.676518+0000","last_became_active":"2023-11-13T11:28:57.037589+0000","last_became_peered":"2023-11-13T11:28:57.037589+0000","last_unstale":"2023-11-13T11:28:58.676518+0000","last_undegraded":"2023-11-13T11:28:58.676518+0000","last_fullsized":"2023-11-13T11:28:58.676518+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-13T11:28:56.008687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-13T11:28:56.008687+0000","last_clean_scrub_stamp":"2023-11-13T11:28:56.008687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-14T20:31:04.049508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-13T11:28:58.676239+0000","last_change":"2023-11-13T11:28:57.642795+0000","last_active":"2023-11-13T11:28:58.676239+0000","last_peered":"2023-11-13T11:28:58.676239+0000","last_clean":"2023-11-13T11:28:58.676239+0000","last_became_active":"2023-11-13T11:28:57.642532+0000","last_became_peered":"2023-11-13T11:28:57.642532+0000","last_unstale":"2023-11-13T11:28:58.676239+0000","last_undegraded":"2023-11-13T11:28:58.676239+0000","last_fullsized":"2023-11-13T11:28:58.676239+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-13T11:28:57.010879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-13T11:28:57.010879+0000","last_clean_scrub_stamp":"2023-11-13T11:28:57.010879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-14T15:58:48.241029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-13T11:28:58.676905+0000","last_change":"2023-11-13T11:28:57.040384+0000","last_active":"2023-11-13T11:28:58.676905+0000","last_peered":"2023-11-13T11:28:58.676905+0000","last_clean":"2023-11-13T11:28:58.676905+0000","last_became_active":"2023-11-13T11:28:57.040131+0000","last_became_peered":"2023-11-13T11:28:57.040131+0000","last_unstale":"2023-11-13T11:28:58.676905+0000","last_undegraded":"2023-11-13T11:28:58.676905+0000","last_fullsized":"2023-11-13T11:28:58.676905+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-13T11:28:56.008687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-13T11:28:56.008687+0000","last_clean_scrub_stamp":"2023-11-13T11:28:56.008687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-14T20:31:04.049508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-13T11:28:58.613055+0000","last_change":"2023-11-13T11:28:57.624233+0000","last_active":"2023-11-13T11:28:58.613055+0000","last_peered":"2023-11-13T11:28:58.613055+0000","last_clean":"2023-11-13T11:28:58.613055+0000","last_became_active":"2023-11-13T11:28:57.623952+0000","last_became_peered":"2023-11-13T11:28:57.623952+0000","last_unstale":"2023-11-13T11:28:58.613055+0000","last_undegraded":"2023-11-13T11:28:58.613055+0000","last_fullsized":"2023-11-13T11:28:58.613055+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-13T11:28:57.010879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-13T11:28:57.010879+0000","last_clean_scrub_stamp":"2023-11-13T11:28:57.010879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-14T18:44:10.551024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.10","version":"21'8","reported_seq":20,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-13T11:28:58.616974+0000","last_change":"2023-11-13T11:28:57.035054+0000","last_active":"2023-11-13T11:28:58.616974+0000","last_peered":"2023-11-13T11:28:58.616974+0000","last_clean":"2023-11-13T11:28:58.616974+0000","last_became_active":"2023-11-13T11:28:57.034694+0000","last_became_peered":"2023-11-13T11:28:57.034694+0000","last_unstale":"2023-11-13T11:28:58.616974+0000","last_undegraded":"2023-11-13T11:28:58.616974+0000","last_fullsized":"2023-11-13T11:28:58.616974+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-13T11:28:56.008687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-13T11:28:56.008687+0000","last_clean_scrub_stamp":"2023-11-13T11:28:56.008687+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-14T19:51:04.458821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-13T11:28:58.675988+0000","last_change":"2023-11-13T11:28:57.640815+0000","last_active":"2023-11-13T11:28:58.675988+0000","last_peered":"2023-11-13T11:28:58.675988+0000","last_clean":"2023-11-13T11:28:58.675988+0000","last_became_active":"2023-11-13T11:28:57.639158+0000","last_became_peered":"2023-11-13T11:28:57.639158+0000","last_unstale":"2023-11-13T11:28:58.675988+0000","last_undegraded":"2023-11-13T11:28:58.675988+0000","last_fullsized":"2023-11-13T11:28:58.675988+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-13T11:28:57.010879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-13T11:28:57.010879+0000","last_clean_scrub_stamp":"2023-11-13T11:28:57.010879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-14T13:34:23.778868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.f","version":"21'1","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-13T11:28:58.677539+0000","last_change":"2023-11-13T11:28:57.047959+0000","last_active":"2023-11-13T11:28:58.677539+0000","last_peered":"2023-11-13T11:28:58.677539+0000","last_clean":"2023-11-13T11:28:58.677539+0000","last_became_active":"2023-11-13T11:28:57.047614+0000","last_became_peered":"2023-11-13T11:28:57.047614+0000","last_unstale":"2023-11-13T11:28:58.677539+0000","last_undegraded":"2023-11-13T11:28:58.677539+0000","last_fullsized":"2023-11-13T11:28:58.677539+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-13T11:28:56.008687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-13T11:28:56.008687+0000","last_clean_scrub_stamp":"2023-11-13T11:28:56.008687+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-14T18:32:13.991035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-13T11:28:58.616578+0000","last_change":"2023-11-13T11:28:57.644049+0000","last_active":"2023-11-13T11:28:58.616578+0000","last_peered":"2023-11-13T11:28:58.616578+0000","last_clean":"2023-11-13T11:28:58.616578+0000","last_became_active":"2023-11-13T11:28:57.643739+0000","last_became_peered":"2023-11-13T11:28:57.643739+0000","last_unstale":"2023-11-13T11:28:58.616578+0000","last_undegraded":"2023-11-13T11:28:58.616578+0000","last_fullsized":"2023-11-13T11:28:58.616578+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-13T11:28:57.010879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-13T11:28:57.010879+0000","last_clean_scrub_stamp":"2023-11-13T11:28:57.010879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-14T16:02:43.358281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.e","version":"21'2","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-13T11:28:58.617520+0000","last_change":"2023-11-13T11:28:57.037861+0000","last_active":"2023-11-13T11:28:58.617520+0000","last_peered":"2023-11-13T11:28:58.617520+0000","last_clean":"2023-11-13T11:28:58.617520+0000","last_became_active":"2023-11-13T11:28:57.037587+0000","last_became_peered":"2023-11-13T11:28:57.037587+0000","last_unstale":"2023-11-13T11:28:58.617520+0000","last_undegraded":"2023-11-13T11:28:58.617520+0000","last_fullsized":"2023-11-13T11:28:58.617520+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-13T11:28:56.008687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-13T11:28:56.008687+0000","last_clean_scrub_stamp":"2023-11-13T11:28:56.008687+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-14T12:47:28.656211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-13T11:28:58.677509+0000","last_change":"2023-11-13T11:28:57.627412+0000","last_active":"2023-11-13T11:28:58.677509+0000","last_peered":"2023-11-13T11:28:58.677509+0000","last_clean":"2023-11-13T11:28:58.677509+0000","last_became_active":"2023-11-13T11:28:57.627146+0000","last_became_peered":"2023-11-13T11:28:57.627146+0000","last_unstale":"2023-11-13T11:28:58.677509+0000","last_undegraded":"2023-11-13T11:28:58.677509+0000","last_fullsized":"2023-11-13T11:28:58.677509+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-13T11:28:57.010879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-13T11:28:57.010879+0000","last_clean_scrub_stamp":"2023-11-13T11:28:57.010879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-14T13:34:23.778868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"21'1","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-13T11:28:58.677545+0000","last_change":"2023-11-13T11:28:57.043781+0000","last_active":"2023-11-13T11:28:58.677545+0000","last_peered":"2023-11-13T11:28:58.677545+0000","last_clean":"2023-11-13T11:28:58.677545+0000","last_became_active":"2023-11-13T11:28:57.043532+0000","last_became_peered":"2023-11-13T11:28:57.043532+0000","last_unstale":"2023-11-13T11:28:58.677545+0000","last_undegraded":"2023-11-13T11:28:58.677545+0000","last_fullsized":"2023-11-13T11:28:58.677545+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-13T11:28:56.008687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-13T11:28:56.008687+0000","last_clean_scrub_stamp":"2023-11-13T11:28:56.008687+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-14T12:45:22.015780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-13T11:28:58.677199+0000","last_change":"2023-11-13T11:28:57.632085+0000","last_active":"2023-11-13T11:28:58.677199+0000","last_peered":"2023-11-13T11:28:58.677199+0000","last_clean":"2023-11-13T11:28:58.677199+0000","last_became_active":"2023-11-13T11:28:57.631814+0000","last_became_peered":"2023-11-13T11:28:57.631814+0000","last_unstale":"2023-11-13T11:28:58.677199+0000","last_undegraded":"2023-11-13T11:28:58.677199+0000","last_fullsized":"2023-11-13T11:28:58.677199+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-13T11:28:57.010879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-13T11:28:57.010879+0000","last_clean_scrub_stamp":"2023-11-13T11:28:57.010879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-14T16:55:58.610937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-13T11:28:58.677642+0000","last_change":"2023-11-13T11:28:57.039989+0000","last_active":"2023-11-13T11:28:58.677642+0000","last_peered":"2023-11-13T11:28:58.677642+0000","last_clean":"2023-11-13T11:28:58.677642+0000","last_became_active":"2023-11-13T11:28:57.039704+0000","last_became_peered":"2023-11-13T11:28:57.039704+0000","last_unstale":"2023-11-13T11:28:58.677642+0000","last_undegraded":"2023-11-13T11:28:58.677642+0000","last_fullsized":"2023-11-13T11:28:58.677642+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-13T11:28:56.008687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-13T11:28:56.008687+0000","last_clean_scrub_stamp":"2023-11-13T11:28:56.008687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-14T12:47:28.656211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-13T11:28:58.676483+0000","last_change":"2023-11-13T11:28:57.630328+0000","last_active":"2023-11-13T11:28:58.676483+0000","last_peered":"2023-11-13T11:28:58.676483+0000","last_clean":"2023-11-13T11:28:58.676483+0000","last_became_active":"2023-11-13T11:28:57.630018+0000","last_became_peered":"2023-11-13T11:28:57.630018+0000","last_unstale":"2023-11-13T11:28:58.676483+0000","last_undegraded":"2023-11-13T11:28:58.676483+0000","last_fullsized":"2023-11-13T11:28:58.676483+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-13T11:28:57.010879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-13T11:28:57.010879+0000","last_clean_scrub_stamp":"2023-11-13T11:28:57.010879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-14T21:59:24.741766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":165,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-13T11:28:57.612976+0000","last_change":"2023-11-13T11:28:47.002866+0000","last_active":"2023-11-13T11:28:57.612976+0000","last_peered":"2023-11-13T11:28:57.612976+0000","last_clean":"2023-11-13T11:28:57.612976+0000","last_became_active":"2023-11-13T11:28:47.001494+0000","last_became_peered":"2023-11-13T11:28:47.001494+0000","last_unstale":"2023-11-13T11:28:57.612976+0000","last_undegraded":"2023-11-13T11:28:57.612976+0000","last_fullsized":"2023-11-13T11:28:57.612976+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-13T11:28:45.879416+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-13T11:28:45.879416+0000","last_clean_scrub_stamp":"2023-11-13T11:28:45.879416+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-14T14:38:55.166320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-13T11:28:58.676303+0000","last_change":"2023-11-13T11:28:57.040424+0000","last_active":"2023-11-13T11:28:58.676303+0000","last_peered":"2023-11-13T11:28:58.676303+0000","last_clean":"2023-11-13T11:28:58.676303+0000","last_became_active":"2023-11-13T11:28:57.039831+0000","last_became_peered":"2023-11-13T11:28:57.039831+0000","last_unstale":"2023-11-13T11:28:58.676303+0000","last_undegraded":"2023-11-13T11:28:58.676303+0000","last_fullsized":"2023-11-13T11:28:58.676303+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-13T11:28:56.008687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-13T11:28:56.008687+0000","last_clean_scrub_stamp":"2023-11-13T11:28:56.008687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-14T17:58:39.868445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-13T11:28:58.617352+0000","last_change":"2023-11-13T11:28:57.633871+0000","last_active":"2023-11-13T11:28:58.617352+0000","last_peered":"2023-11-13T11:28:58.617352+0000","last_clean":"2023-11-13T11:28:58.617352+0000","last_became_active":"2023-11-13T11:28:57.633554+0000","last_became_peered":"2023-11-13T11:28:57.633554+0000","last_unstale":"2023-11-13T11:28:58.617352+0000","last_undegraded":"2023-11-13T11:28:58.617352+0000","last_fullsized":"2023-11-13T11:28:58.617352+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-13T11:28:57.010879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-13T11:28:57.010879+0000","last_clean_scrub_stamp":"2023-11-13T11:28:57.010879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-14T12:45:23.017972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-13T11:28:58.676054+0000","last_change":"2023-11-13T11:28:57.042629+0000","last_active":"2023-11-13T11:28:58.676054+0000","last_peered":"2023-11-13T11:28:58.676054+0000","last_clean":"2023-11-13T11:28:58.676054+0000","last_became_active":"2023-11-13T11:28:57.042275+0000","last_became_peered":"2023-11-13T11:28:57.042275+0000","last_unstale":"2023-11-13T11:28:58.676054+0000","last_undegraded":"2023-11-13T11:28:58.676054+0000","last_fullsized":"2023-11-13T11:28:58.676054+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-13T11:28:56.008687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-13T11:28:56.008687+0000","last_clean_scrub_stamp":"2023-11-13T11:28:56.008687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-14T18:32:13.991035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-13T11:28:58.677781+0000","last_change":"2023-11-13T11:28:57.636085+0000","last_active":"2023-11-13T11:28:58.677781+0000","last_peered":"2023-11-13T11:28:58.677781+0000","last_clean":"2023-11-13T11:28:58.677781+0000","last_became_active":"2023-11-13T11:28:57.635801+0000","last_became_peered":"2023-11-13T11:28:57.635801+0000","last_unstale":"2023-11-13T11:28:58.677781+0000","last_undegraded":"2023-11-13T11:28:58.677781+0000","last_fullsized":"2023-11-13T11:28:58.677781+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-13T11:28:57.010879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-13T11:28:57.010879+0000","last_clean_scrub_stamp":"2023-11-13T11:28:57.010879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-14T12:34:10.639080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-13T11:28:58.676552+0000","last_change":"2023-11-13T11:28:57.043663+0000","last_active":"2023-11-13T11:28:58.676552+0000","last_peered":"2023-11-13T11:28:58.676552+0000","last_clean":"2023-11-13T11:28:58.676552+0000","last_became_active":"2023-11-13T11:28:57.043395+0000","last_became_peered":"2023-11-13T11:28:57.043395+0000","last_unstale":"2023-11-13T11:28:58.676552+0000","last_undegraded":"2023-11-13T11:28:58.676552+0000","last_fullsized":"2023-11-13T11:28:58.676552+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-13T11:28:56.008687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-13T11:28:56.008687+0000","last_clean_scrub_stamp":"2023-11-13T11:28:56.008687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-14T20:39:57.924545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-13T11:28:58.677021+0000","last_change":"2023-11-13T11:28:57.630182+0000","last_active":"2023-11-13T11:28:58.677021+0000","last_peered":"2023-11-13T11:28:58.677021+0000","last_clean":"2023-11-13T11:28:58.677021+0000","last_became_active":"2023-11-13T11:28:57.629803+0000","last_became_peered":"2023-11-13T11:28:57.629803+0000","last_unstale":"2023-11-13T11:28:58.677021+0000","last_undegraded":"2023-11-13T11:28:58.677021+0000","last_fullsized":"2023-11-13T11:28:58.677021+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-13T11:28:57.010879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-13T11:28:57.010879+0000","last_clean_scrub_stamp":"2023-11-13T11:28:57.010879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-14T20:31:05.051700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-13T11:28:58.676595+0000","last_change":"2023-11-13T11:28:57.044421+0000","last_active":"2023-11-13T11:28:58.676595+0000","last_peered":"2023-11-13T11:28:58.676595+0000","last_clean":"2023-11-13T11:28:58.676595+0000","last_became_active":"2023-11-13T11:28:57.044057+0000","last_became_peered":"2023-11-13T11:28:57.044057+0000","last_unstale":"2023-11-13T11:28:58.676595+0000","last_undegraded":"2023-11-13T11:28:58.676595+0000","last_fullsized":"2023-11-13T11:28:58.676595+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-13T11:28:56.008687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-13T11:28:56.008687+0000","last_clean_scrub_stamp":"2023-11-13T11:28:56.008687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-14T16:47:10.680362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-13T11:28:58.676967+0000","last_change":"2023-11-13T11:28:57.636497+0000","last_active":"2023-11-13T11:28:58.676967+0000","last_peered":"2023-11-13T11:28:58.676967+0000","last_clean":"2023-11-13T11:28:58.676967+0000","last_became_active":"2023-11-13T11:28:57.635945+0000","last_became_peered":"2023-11-13T11:28:57.635945+0000","last_unstale":"2023-11-13T11:28:58.676967+0000","last_undegraded":"2023-11-13T11:28:58.676967+0000","last_fullsized":"2023-11-13T11:28:58.676967+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-13T11:28:57.010879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-13T11:28:57.010879+0000","last_clean_scrub_stamp":"2023-11-13T11:28:57.010879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-14T14:29:59.365142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-13T11:28:58.677456+0000","last_change":"2023-11-13T11:28:57.039925+0000","last_active":"2023-11-13T11:28:58.677456+0000","last_peered":"2023-11-13T11:28:58.677456+0000","last_clean":"2023-11-13T11:28:58.677456+0000","last_became_active":"2023-11-13T11:28:57.039611+0000","last_became_peered":"2023-11-13T11:28:57.039611+0000","last_unstale":"2023-11-13T11:28:58.677456+0000","last_undegraded":"2023-11-13T11:28:58.677456+0000","last_fullsized":"2023-11-13T11:28:58.677456+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-13T11:28:56.008687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-13T11:28:56.008687+0000","last_clean_scrub_stamp":"2023-11-13T11:28:56.008687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-14T12:34:09.636888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-13T11:28:58.616113+0000","last_change":"2023-11-13T11:28:57.640311+0000","last_active":"2023-11-13T11:28:58.616113+0000","last_peered":"2023-11-13T11:28:58.616113+0000","last_clean":"2023-11-13T11:28:58.616113+0000","last_became_active":"2023-11-13T11:28:57.638311+0000","last_became_peered":"2023-11-13T11:28:57.638311+0000","last_unstale":"2023-11-13T11:28:58.616113+0000","last_undegraded":"2023-11-13T11:28:58.616113+0000","last_fullsized":"2023-11-13T11:28:58.616113+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-13T11:28:57.010879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-13T11:28:57.010879+0000","last_clean_scrub_stamp":"2023-11-13T11:28:57.010879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-14T19:51:05.461013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-13T11:28:58.676570+0000","last_change":"2023-11-13T11:28:57.045910+0000","last_active":"2023-11-13T11:28:58.676570+0000","last_peered":"2023-11-13T11:28:58.676570+0000","last_clean":"2023-11-13T11:28:58.676570+0000","last_became_active":"2023-11-13T11:28:57.045640+0000","last_became_peered":"2023-11-13T11:28:57.045640+0000","last_unstale":"2023-11-13T11:28:58.676570+0000","last_undegraded":"2023-11-13T11:28:58.676570+0000","last_fullsized":"2023-11-13T11:28:58.676570+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-13T11:28:56.008687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-13T11:28:56.008687+0000","last_clean_scrub_stamp":"2023-11-13T11:28:56.008687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-14T18:39:08.541955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-13T11:28:58.678192+0000","last_change":"2023-11-13T11:28:57.627422+0000","last_active":"2023-11-13T11:28:58.678192+0000","last_peered":"2023-11-13T11:28:58.678192+0000","last_clean":"2023-11-13T11:28:58.678192+0000","last_became_active":"2023-11-13T11:28:57.627122+0000","last_became_peered":"2023-11-13T11:28:57.627122+0000","last_unstale":"2023-11-13T11:28:58.678192+0000","last_undegraded":"2023-11-13T11:28:58.678192+0000","last_fullsized":"2023-11-13T11:28:58.678192+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-13T11:28:57.010879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-13T11:28:57.010879+0000","last_clean_scrub_stamp":"2023-11-13T11:28:57.010879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-14T22:16:57.888840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"22'1","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-13T11:28:59.950644+0000","last_change":"2023-11-13T11:28:57.026473+0000","last_active":"2023-11-13T11:28:59.950644+0000","last_peered":"2023-11-13T11:28:59.950644+0000","last_clean":"2023-11-13T11:28:59.950644+0000","last_became_active":"2023-11-13T11:28:57.025877+0000","last_became_peered":"2023-11-13T11:28:57.025877+0000","last_unstale":"2023-11-13T11:28:59.950644+0000","last_undegraded":"2023-11-13T11:28:59.950644+0000","last_fullsized":"2023-11-13T11:28:59.950644+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-13T11:28:56.008687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-13T11:28:56.008687+0000","last_clean_scrub_stamp":"2023-11-13T11:28:56.008687+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-14T11:40:57.839875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-13T11:28:58.617778+0000","last_change":"2023-11-13T11:28:57.632649+0000","last_active":"2023-11-13T11:28:58.617778+0000","last_peered":"2023-11-13T11:28:58.617778+0000","last_clean":"2023-11-13T11:28:58.617778+0000","last_became_active":"2023-11-13T11:28:57.632091+0000","last_became_peered":"2023-11-13T11:28:57.632091+0000","last_unstale":"2023-11-13T11:28:58.617778+0000","last_undegraded":"2023-11-13T11:28:58.617778+0000","last_fullsized":"2023-11-13T11:28:58.617778+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-13T11:28:57.010879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-13T11:28:57.010879+0000","last_clean_scrub_stamp":"2023-11-13T11:28:57.010879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-14T23:10:03.463557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"21'2","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-13T11:28:58.676636+0000","last_change":"2023-11-13T11:28:57.049041+0000","last_active":"2023-11-13T11:28:58.676636+0000","last_peered":"2023-11-13T11:28:58.676636+0000","last_clean":"2023-11-13T11:28:58.676636+0000","last_became_active":"2023-11-13T11:28:57.048609+0000","last_became_peered":"2023-11-13T11:28:57.048609+0000","last_unstale":"2023-11-13T11:28:58.676636+0000","last_undegraded":"2023-11-13T11:28:58.676636+0000","last_fullsized":"2023-11-13T11:28:58.676636+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-13T11:28:56.008687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-13T11:28:56.008687+0000","last_clean_scrub_stamp":"2023-11-13T11:28:56.008687+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-14T14:29:58.362950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-13T11:28:58.617616+0000","last_change":"2023-11-13T11:28:57.634721+0000","last_active":"2023-11-13T11:28:58.617616+0000","last_peered":"2023-11-13T11:28:58.617616+0000","last_clean":"2023-11-13T11:28:58.617616+0000","last_became_active":"2023-11-13T11:28:57.632021+0000","last_became_peered":"2023-11-13T11:28:57.632021+0000","last_unstale":"2023-11-13T11:28:58.617616+0000","last_undegraded":"2023-11-13T11:28:58.617616+0000","last_fullsized":"2023-11-13T11:28:58.617616+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-13T11:28:57.010879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-13T11:28:57.010879+0000","last_clean_scrub_stamp":"2023-11-13T11:28:57.010879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-14T20:31:05.051700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-13T11:28:58.676371+0000","last_change":"2023-11-13T11:28:57.034985+0000","last_active":"2023-11-13T11:28:58.676371+0000","last_peered":"2023-11-13T11:28:58.676371+0000","last_clean":"2023-11-13T11:28:58.676371+0000","last_became_active":"2023-11-13T11:28:57.033457+0000","last_became_peered":"2023-11-13T11:28:57.033457+0000","last_unstale":"2023-11-13T11:28:58.676371+0000","last_undegraded":"2023-11-13T11:28:58.676371+0000","last_fullsized":"2023-11-13T11:28:58.676371+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-13T11:28:56.008687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-13T11:28:56.008687+0000","last_clean_scrub_stamp":"2023-11-13T11:28:56.008687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-14T22:20:18.898387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-13T11:28:58.676138+0000","last_change":"2023-11-13T11:28:57.626943+0000","last_active":"2023-11-13T11:28:58.676138+0000","last_peered":"2023-11-13T11:28:58.676138+0000","last_clean":"2023-11-13T11:28:58.676138+0000","last_became_active":"2023-11-13T11:28:57.626766+0000","last_became_peered":"2023-11-13T11:28:57.626766+0000","last_unstale":"2023-11-13T11:28:58.676138+0000","last_undegraded":"2023-11-13T11:28:58.676138+0000","last_fullsized":"2023-11-13T11:28:58.676138+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-13T11:28:57.010879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-13T11:28:57.010879+0000","last_clean_scrub_stamp":"2023-11-13T11:28:57.010879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-14T22:55:42.143143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-13T11:28:58.617155+0000","last_change":"2023-11-13T11:28:57.034882+0000","last_active":"2023-11-13T11:28:58.617155+0000","last_peered":"2023-11-13T11:28:58.617155+0000","last_clean":"2023-11-13T11:28:58.617155+0000","last_became_active":"2023-11-13T11:28:57.032076+0000","last_became_peered":"2023-11-13T11:28:57.032076+0000","last_unstale":"2023-11-13T11:28:58.617155+0000","last_undegraded":"2023-11-13T11:28:58.617155+0000","last_fullsized":"2023-11-13T11:28:58.617155+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-13T11:28:56.008687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-13T11:28:56.008687+0000","last_clean_scrub_stamp":"2023-11-13T11:28:56.008687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-14T18:44:09.548832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-13T11:28:58.617060+0000","last_change":"2023-11-13T11:28:57.635615+0000","last_active":"2023-11-13T11:28:58.617060+0000","last_peered":"2023-11-13T11:28:58.617060+0000","last_clean":"2023-11-13T11:28:58.617060+0000","last_became_active":"2023-11-13T11:28:57.635320+0000","last_became_peered":"2023-11-13T11:28:57.635320+0000","last_unstale":"2023-11-13T11:28:58.617060+0000","last_undegraded":"2023-11-13T11:28:58.617060+0000","last_fullsized":"2023-11-13T11:28:58.617060+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-13T11:28:57.010879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-13T11:28:57.010879+0000","last_clean_scrub_stamp":"2023-11-13T11:28:57.010879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-14T18:32:14.993227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-13T11:28:58.677673+0000","last_change":"2023-11-13T11:28:57.043470+0000","last_active":"2023-11-13T11:28:58.677673+0000","last_peered":"2023-11-13T11:28:58.677673+0000","last_clean":"2023-11-13T11:28:58.677673+0000","last_became_active":"2023-11-13T11:28:57.043103+0000","last_became_peered":"2023-11-13T11:28:57.043103+0000","last_unstale":"2023-11-13T11:28:58.677673+0000","last_undegraded":"2023-11-13T11:28:58.677673+0000","last_fullsized":"2023-11-13T11:28:58.677673+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-13T11:28:56.008687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-13T11:28:56.008687+0000","last_clean_scrub_stamp":"2023-11-13T11:28:56.008687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-14T22:20:18.898387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-13T11:28:58.676669+0000","last_change":"2023-11-13T11:28:57.642841+0000","last_active":"2023-11-13T11:28:58.676669+0000","last_peered":"2023-11-13T11:28:58.676669+0000","last_clean":"2023-11-13T11:28:58.676669+0000","last_became_active":"2023-11-13T11:28:57.642544+0000","last_became_peered":"2023-11-13T11:28:57.642544+0000","last_unstale":"2023-11-13T11:28:58.676669+0000","last_undegraded":"2023-11-13T11:28:58.676669+0000","last_fullsized":"2023-11-13T11:28:58.676669+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-13T11:28:57.010879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-13T11:28:57.010879+0000","last_clean_scrub_stamp":"2023-11-13T11:28:57.010879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-14T13:40:46.543740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"21'2","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-13T11:28:58.676211+0000","last_change":"2023-11-13T11:28:57.040625+0000","last_active":"2023-11-13T11:28:58.676211+0000","last_peered":"2023-11-13T11:28:58.676211+0000","last_clean":"2023-11-13T11:28:58.676211+0000","last_became_active":"2023-11-13T11:28:57.040126+0000","last_became_peered":"2023-11-13T11:28:57.040126+0000","last_unstale":"2023-11-13T11:28:58.676211+0000","last_undegraded":"2023-11-13T11:28:58.676211+0000","last_fullsized":"2023-11-13T11:28:58.676211+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-13T11:28:56.008687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-13T11:28:56.008687+0000","last_clean_scrub_stamp":"2023-11-13T11:28:56.008687+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-14T12:47:28.656211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-13T11:28:58.676350+0000","last_change":"2023-11-13T11:28:57.627475+0000","last_active":"2023-11-13T11:28:58.676350+0000","last_peered":"2023-11-13T11:28:58.676350+0000","last_clean":"2023-11-13T11:28:58.676350+0000","last_became_active":"2023-11-13T11:28:57.627157+0000","last_became_peered":"2023-11-13T11:28:57.627157+0000","last_unstale":"2023-11-13T11:28:58.676350+0000","last_undegraded":"2023-11-13T11:28:58.676350+0000","last_fullsized":"2023-11-13T11:28:58.676350+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-13T11:28:57.010879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-13T11:28:57.010879+0000","last_clean_scrub_stamp":"2023-11-13T11:28:57.010879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-14T15:37:40.674035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-13T11:28:58.676431+0000","last_change":"2023-11-13T11:28:57.642899+0000","last_active":"2023-11-13T11:28:58.676431+0000","last_peered":"2023-11-13T11:28:58.676431+0000","last_clean":"2023-11-13T11:28:58.676431+0000","last_became_active":"2023-11-13T11:28:57.642602+0000","last_became_peered":"2023-11-13T11:28:57.642602+0000","last_unstale":"2023-11-13T11:28:58.676431+0000","last_undegraded":"2023-11-13T11:28:58.676431+0000","last_fullsized":"2023-11-13T11:28:58.676431+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-13T11:28:57.010879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-13T11:28:57.010879+0000","last_clean_scrub_stamp":"2023-11-13T11:28:57.010879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-14T13:30:56.684256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1c","version":"21'2","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-13T11:28:58.677239+0000","last_change":"2023-11-13T11:28:57.049062+0000","last_active":"2023-11-13T11:28:58.677239+0000","last_peered":"2023-11-13T11:28:58.677239+0000","last_clean":"2023-11-13T11:28:58.677239+0000","last_became_active":"2023-11-13T11:28:57.048825+0000","last_became_peered":"2023-11-13T11:28:57.048825+0000","last_unstale":"2023-11-13T11:28:58.677239+0000","last_undegraded":"2023-11-13T11:28:58.677239+0000","last_fullsized":"2023-11-13T11:28:58.677239+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-13T11:28:56.008687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-13T11:28:56.008687+0000","last_clean_scrub_stamp":"2023-11-13T11:28:56.008687+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-14T22:16:56.886648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-13T11:28:58.613304+0000","last_change":"2023-11-13T11:28:57.636491+0000","last_active":"2023-11-13T11:28:58.613304+0000","last_peered":"2023-11-13T11:28:58.613304+0000","last_clean":"2023-11-13T11:28:58.613304+0000","last_became_active":"2023-11-13T11:28:57.636231+0000","last_became_peered":"2023-11-13T11:28:57.636231+0000","last_unstale":"2023-11-13T11:28:58.613304+0000","last_undegraded":"2023-11-13T11:28:58.613304+0000","last_fullsized":"2023-11-13T11:28:58.613304+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-13T11:28:57.010879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-13T11:28:57.010879+0000","last_clean_scrub_stamp":"2023-11-13T11:28:57.010879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-14T22:20:19.900579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"21'2","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-13T11:28:58.677362+0000","last_change":"2023-11-13T11:28:57.045391+0000","last_active":"2023-11-13T11:28:58.677362+0000","last_peered":"2023-11-13T11:28:58.677362+0000","last_clean":"2023-11-13T11:28:58.677362+0000","last_became_active":"2023-11-13T11:28:57.045092+0000","last_became_peered":"2023-11-13T11:28:57.045092+0000","last_unstale":"2023-11-13T11:28:58.677362+0000","last_undegraded":"2023-11-13T11:28:58.677362+0000","last_fullsized":"2023-11-13T11:28:58.677362+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-13T11:28:56.008687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-13T11:28:56.008687+0000","last_clean_scrub_stamp":"2023-11-13T11:28:56.008687+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-14T17:58:39.868445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-13T11:28:58.677800+0000","last_change":"2023-11-13T11:28:57.625394+0000","last_active":"2023-11-13T11:28:58.677800+0000","last_peered":"2023-11-13T11:28:58.677800+0000","last_clean":"2023-11-13T11:28:58.677800+0000","last_became_active":"2023-11-13T11:28:57.624669+0000","last_became_peered":"2023-11-13T11:28:57.624669+0000","last_unstale":"2023-11-13T11:28:58.677800+0000","last_undegraded":"2023-11-13T11:28:58.677800+0000","last_fullsized":"2023-11-13T11:28:58.677800+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-13T11:28:57.010879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-13T11:28:57.010879+0000","last_clean_scrub_stamp":"2023-11-13T11:28:57.010879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-14T16:35:00.051619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1e","version":"21'1","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-13T11:28:58.677808+0000","last_change":"2023-11-13T11:28:57.042653+0000","last_active":"2023-11-13T11:28:58.677808+0000","last_peered":"2023-11-13T11:28:58.677808+0000","last_clean":"2023-11-13T11:28:58.677808+0000","last_became_active":"2023-11-13T11:28:57.042473+0000","last_became_peered":"2023-11-13T11:28:57.042473+0000","last_unstale":"2023-11-13T11:28:58.677808+0000","last_undegraded":"2023-11-13T11:28:58.677808+0000","last_fullsized":"2023-11-13T11:28:58.677808+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-13T11:28:56.008687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-13T11:28:56.008687+0000","last_clean_scrub_stamp":"2023-11-13T11:28:56.008687+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-14T22:16:56.886648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-13T11:28:58.677689+0000","last_change":"2023-11-13T11:28:57.636379+0000","last_active":"2023-11-13T11:28:58.677689+0000","last_peered":"2023-11-13T11:28:58.677689+0000","last_clean":"2023-11-13T11:28:58.677689+0000","last_became_active":"2023-11-13T11:28:57.636105+0000","last_became_peered":"2023-11-13T11:28:57.636105+0000","last_unstale":"2023-11-13T11:28:58.677689+0000","last_undegraded":"2023-11-13T11:28:58.677689+0000","last_fullsized":"2023-11-13T11:28:58.677689+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-13T11:28:57.010879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-13T11:28:57.010879+0000","last_clean_scrub_stamp":"2023-11-13T11:28:57.010879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-14T13:24:50.764716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1f","version":"21'4","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-13T11:28:58.617784+0000","last_change":"2023-11-13T11:28:57.046686+0000","last_active":"2023-11-13T11:28:58.617784+0000","last_peered":"2023-11-13T11:28:58.617784+0000","last_clean":"2023-11-13T11:28:58.617784+0000","last_became_active":"2023-11-13T11:28:57.046334+0000","last_became_peered":"2023-11-13T11:28:57.046334+0000","last_unstale":"2023-11-13T11:28:58.617784+0000","last_undegraded":"2023-11-13T11:28:58.617784+0000","last_fullsized":"2023-11-13T11:28:58.617784+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-13T11:28:56.008687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-13T11:28:56.008687+0000","last_clean_scrub_stamp":"2023-11-13T11:28:56.008687+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-14T16:02:42.356089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":15,"seq":64424509447,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":221184,"data_stored":76252,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67000000000000004}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1020000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.74399999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.113}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86299999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0820000000000001}]}]},{"osd":5,"up_from":15,"seq":64424509447,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27820,"kb_used_data":800,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344020,"statfs":{"total":96636764160,"available":96608276480,"internally_reserved":0,"allocated":819200,"data_stored":665743,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80300000000000005}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69799999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76600000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65300000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88900000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82299999999999995}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68899999999999995}]}]},{"osd":4,"up_from":15,"seq":64424509446,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27256,"kb_used_data":236,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344584,"statfs":{"total":96636764160,"available":96608854016,"internally_reserved":0,"allocated":241664,"data_stored":78536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50800000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57099999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.74199999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64000000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61499999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84899999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78700000000000003}]}]},{"osd":3,"up_from":15,"seq":64424509447,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27240,"kb_used_data":220,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344600,"statfs":{"total":96636764160,"available":96608870400,"internally_reserved":0,"allocated":225280,"data_stored":76834,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79200000000000004}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.9199999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.9820000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.135}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3340000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.173}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.0070000000000001}]}]},{"osd":2,"up_from":15,"seq":64424509447,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27248,"kb_used_data":228,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344592,"statfs":{"total":96636764160,"available":96608862208,"internally_reserved":0,"allocated":233472,"data_stored":77864,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":8.6050000000000004}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":4.351}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54000000000000004}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":4.6310000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72599999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":4.7080000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":4.9530000000000003}]}]},{"osd":1,"up_from":15,"seq":64424509448,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27824,"kb_used_data":800,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344016,"statfs":{"total":96636764160,"available":96608272384,"internally_reserved":0,"allocated":819200,"data_stored":666690,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34899999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40300000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46500000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56299999999999994}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82599999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79600000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78200000000000003}]}]},{"osd":0,"up_from":15,"seq":64424509448,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27240,"kb_used_data":220,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344600,"statfs":{"total":96636764160,"available":96608870400,"internally_reserved":0,"allocated":225280,"data_stored":75339,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46800000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.433}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32900000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72399999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75800000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66300000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79500000000000004}]}]},{"osd":7,"up_from":14,"seq":60129542151,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27252,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344588,"statfs":{"total":96636764160,"available":96608858112,"internally_reserved":0,"allocated":229376,"data_stored":76376,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61099999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59299999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53000000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55200000000000005}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.499}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65000000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77600000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-13T11:29:07.139 INFO:tasks.ceph.ceph_manager.ceph:clean! 2023-11-13T11:29:07.140 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2023-11-13T11:29:07.140 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2023-11-13T11:29:07.140 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-11-13T11:29:07.315 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:07.307+0000 7fbe1090f640 1 Processor -- start 2023-11-13T11:29:07.315 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:07.307+0000 7fbe1090f640 1 -- start start 2023-11-13T11:29:07.319 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:07.311+0000 7fbe1090f640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fbe0c1606e0 0x7fbe0c0c69b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:07.319 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:07.311+0000 7fbe1090f640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbe0c0d1440 con 0x7fbe0c0d0c40 2023-11-13T11:29:07.319 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:07.311+0000 7fbe1090f640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbe0c0cdb10 con 0x7fbe0c0cf490 2023-11-13T11:29:07.320 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:07.311+0000 7fbe1090f640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe0c0d1690 con 0x7fbe0c1606e0 2023-11-13T11:29:07.320 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:07.311+0000 7fbe01d9b640 1 --1- >> v1:172.21.15.102:6789/0 conn(0x7fbe0c0d0c40 0x7fbe0c0b3e20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.102:6789/0 says I am v1:172.21.15.102:48020/0 (socket says 172.21.15.102:48020) 2023-11-13T11:29:07.320 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:07.311+0000 7fbe01d9b640 1 -- 172.21.15.102:0/1912459795 learned_addr learned my addr 172.21.15.102:0/1912459795 (peer_addr_for_me v1:172.21.15.102:0/0) 2023-11-13T11:29:07.320 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:07.311+0000 7fbe0a59c640 1 --2- 172.21.15.102:0/1912459795 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fbe0c1606e0 0x7fbe0c0c69b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:07.321 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:07.311+0000 7fbe09d9b640 1 -- 172.21.15.102:0/1912459795 <== mon.0 v1:172.21.15.102:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 673978515 0 0) 0x7fbe0c0d1440 con 0x7fbe0c0d0c40 2023-11-13T11:29:07.321 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:07.311+0000 7fbe09d9b640 1 -- 172.21.15.102:0/1912459795 --> v1:172.21.15.102:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbdf8003530 con 0x7fbe0c0d0c40 2023-11-13T11:29:07.321 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:07.311+0000 7fbe09d9b640 1 -- 172.21.15.102:0/1912459795 <== mon.0 v1:172.21.15.102:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2586151507 0 0) 0x7fbdf8003530 con 0x7fbe0c0d0c40 2023-11-13T11:29:07.321 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:07.311+0000 7fbe09d9b640 1 -- 172.21.15.102:0/1912459795 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fbe0c1606e0 msgr2=0x7fbe0c0c69b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-13T11:29:07.321 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:07.311+0000 7fbe09d9b640 1 --2- 172.21.15.102:0/1912459795 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fbe0c1606e0 0x7fbe0c0c69b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:07.322 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:07.311+0000 7fbe09d9b640 1 -- 172.21.15.102:0/1912459795 >> v1:172.21.15.154:6789/0 conn(0x7fbe0c0cf490 legacy=0x7fbe0c0cdfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:07.322 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:07.311+0000 7fbe09d9b640 1 -- 172.21.15.102:0/1912459795 --> v1:172.21.15.102:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe0c0d1970 con 0x7fbe0c0d0c40 2023-11-13T11:29:07.322 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:07.311+0000 7fbe09d9b640 1 -- 172.21.15.102:0/1912459795 <== mon.0 v1:172.21.15.102:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 895381068 0 0) 0x7fbdf4001680 con 0x7fbe0c0d0c40 2023-11-13T11:29:07.322 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:07.311+0000 7fbe09d9b640 1 -- 172.21.15.102:0/1912459795 >> v1:172.21.15.102:6789/0 conn(0x7fbe0c0d0c40 legacy=0x7fbe0c0b3e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:07.322 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:07.311+0000 7fbe09d9b640 1 --2- 172.21.15.102:0/1912459795 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fbe0c1606e0 0x7fbdf80039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:07.323 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:07.311+0000 7fbe09d9b640 1 --2- 172.21.15.102:0/1912459795 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fbdf8003f80 0x7fbdf80047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:07.323 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:07.311+0000 7fbe09d9b640 1 --2- 172.21.15.102:0/1912459795 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbdf8004d10 0x7fbdf8005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:07.323 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:07.311+0000 7fbe09d9b640 1 -- 172.21.15.102:0/1912459795 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe0c0d1690 con 0x7fbdf8003f80 2023-11-13T11:29:07.323 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:07.311+0000 7fbe09d9b640 1 -- 172.21.15.102:0/1912459795 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbdf800bb80 con 0x7fbdf8004d10 2023-11-13T11:29:07.324 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:07.311+0000 7fbe09d9b640 1 -- 172.21.15.102:0/1912459795 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbdf800bd40 con 0x7fbe0c1606e0 2023-11-13T11:29:07.324 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:07.311+0000 7fbe01d9b640 1 --2- 172.21.15.102:0/1912459795 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fbdf8003f80 0x7fbdf80047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:07.324 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:07.311+0000 7fbe0ad9d640 1 --2- 172.21.15.102:0/1912459795 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbdf8004d10 0x7fbdf8005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:07.325 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:07.311+0000 7fbe01d9b640 1 -- 172.21.15.102:0/1912459795 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fbe0c1606e0 msgr2=0x7fbdf80039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-13T11:29:07.325 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:07.311+0000 7fbe01d9b640 1 --2- 172.21.15.102:0/1912459795 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fbe0c1606e0 0x7fbdf80039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:07.325 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:07.311+0000 7fbe01d9b640 1 -- 172.21.15.102:0/1912459795 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbdf8004d10 msgr2=0x7fbdf8005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-13T11:29:07.325 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:07.311+0000 7fbe01d9b640 1 --2- 172.21.15.102:0/1912459795 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbdf8004d10 0x7fbdf8005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:07.325 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:07.311+0000 7fbe01d9b640 1 -- 172.21.15.102:0/1912459795 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbdf8003530 con 0x7fbdf8003f80 2023-11-13T11:29:07.326 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:07.311+0000 7fbe0ad9d640 1 --2- 172.21.15.102:0/1912459795 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbdf8004d10 0x7fbdf8005190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-13T11:29:07.330 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:07.315+0000 7fbe01d9b640 1 --2- 172.21.15.102:0/1912459795 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fbdf8003f80 0x7fbdf80047d0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fbdf400c0e0 tx=0x7fbdf401cb60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a7302a26f980dcf5 server_cookie=0 in_seq=0 out_seq=0 2023-11-13T11:29:07.330 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:07.315+0000 7fbe09d9b640 1 -- 172.21.15.102:0/1912459795 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbdf4005ae0 con 0x7fbdf8003f80 2023-11-13T11:29:07.330 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:07.315+0000 7fbe09d9b640 1 -- 172.21.15.102:0/1912459795 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbdf4005c40 con 0x7fbdf8003f80 2023-11-13T11:29:07.331 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:07.315+0000 7fbe09d9b640 1 -- 172.21.15.102:0/1912459795 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbdf40072b0 con 0x7fbdf8003f80 2023-11-13T11:29:07.331 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:07.315+0000 7fbe1090f640 1 -- 172.21.15.102:0/1912459795 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fbdf8003f80 msgr2=0x7fbdf80047d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:07.331 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:07.315+0000 7fbe1090f640 1 --2- 172.21.15.102:0/1912459795 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fbdf8003f80 0x7fbdf80047d0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fbdf400c0e0 tx=0x7fbdf401cb60 comp rx=0 tx=0).stop 2023-11-13T11:29:07.331 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:07.315+0000 7fbe0ad9d640 1 -- 172.21.15.102:0/1912459795 reap_dead start 2023-11-13T11:29:07.331 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:07.315+0000 7fbe1090f640 1 -- 172.21.15.102:0/1912459795 shutdown_connections 2023-11-13T11:29:07.332 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:07.315+0000 7fbe1090f640 1 -- 172.21.15.102:0/1912459795 >> 172.21.15.102:0/1912459795 conn(0x7fbe0c09c130 msgr2=0x7fbe0c0d2e60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-13T11:29:07.332 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:07.315+0000 7fbe1090f640 1 -- 172.21.15.102:0/1912459795 shutdown_connections 2023-11-13T11:29:07.332 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:07.315+0000 7fbe1090f640 1 -- 172.21.15.102:0/1912459795 wait complete. 2023-11-13T11:29:07.332 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:07.319+0000 7fbe1090f640 1 Processor -- start 2023-11-13T11:29:07.332 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:07.319+0000 7fbe1090f640 1 -- start start 2023-11-13T11:29:07.333 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:07.319+0000 7fbe1090f640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fbdf8003f80 0x7fbe0c0b3500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:07.333 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:07.319+0000 7fbe1090f640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fbe0c0b7d90 0x7fbe0c1590f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:07.333 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:07.319+0000 7fbe1090f640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbe0c155690 0x7fbe0c155b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:07.333 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:07.319+0000 7fbe1090f640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe0c0afa20 con 0x7fbe0c0b7d90 2023-11-13T11:29:07.333 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:07.319+0000 7fbe1090f640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe0c0b8880 con 0x7fbe0c155690 2023-11-13T11:29:07.334 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:07.319+0000 7fbe1090f640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe0c0b85a0 con 0x7fbdf8003f80 2023-11-13T11:29:07.334 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:07.319+0000 7fbe01d9b640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fbe0c0b7d90 0x7fbe0c1590f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:07.334 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:07.319+0000 7fbe01d9b640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fbe0c0b7d90 0x7fbe0c1590f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:36578/0 (socket says 172.21.15.102:36578) 2023-11-13T11:29:07.335 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:07.319+0000 7fbe01d9b640 1 -- 172.21.15.102:0/2688525761 learned_addr learned my addr 172.21.15.102:0/2688525761 (peer_addr_for_me v2:172.21.15.102:0/0) 2023-11-13T11:29:07.335 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:07.319+0000 7fbe0a59c640 1 --2- 172.21.15.102:0/2688525761 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fbdf8003f80 0x7fbe0c0b3500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:07.335 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:07.319+0000 7fbe0ad9d640 1 --2- 172.21.15.102:0/2688525761 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbe0c155690 0x7fbe0c155b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:07.336 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:07.319+0000 7fbe01d9b640 1 -- 172.21.15.102:0/2688525761 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fbdf8003f80 msgr2=0x7fbe0c0b3500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:07.336 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:07.319+0000 7fbe01d9b640 1 --2- 172.21.15.102:0/2688525761 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fbdf8003f80 0x7fbe0c0b3500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:07.336 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:07.319+0000 7fbe01d9b640 1 -- 172.21.15.102:0/2688525761 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbe0c155690 msgr2=0x7fbe0c155b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:07.336 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:07.319+0000 7fbe01d9b640 1 --2- 172.21.15.102:0/2688525761 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbe0c155690 0x7fbe0c155b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:07.336 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:07.319+0000 7fbe01d9b640 1 -- 172.21.15.102:0/2688525761 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe0c0ca060 con 0x7fbe0c0b7d90 2023-11-13T11:29:07.337 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:07.319+0000 7fbe01d9b640 1 --2- 172.21.15.102:0/2688525761 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fbe0c0b7d90 0x7fbe0c1590f0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fbdf400c0e0 tx=0x7fbdf8005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-13T11:29:07.337 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:07.319+0000 7fbe037fe640 1 -- 172.21.15.102:0/2688525761 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbdf40b4070 con 0x7fbe0c0b7d90 2023-11-13T11:29:07.337 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:07.319+0000 7fbe037fe640 1 -- 172.21.15.102:0/2688525761 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbdf40013c0 con 0x7fbe0c0b7d90 2023-11-13T11:29:07.337 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:07.319+0000 7fbe037fe640 1 -- 172.21.15.102:0/2688525761 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbdf4007090 con 0x7fbe0c0b7d90 2023-11-13T11:29:07.337 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:07.319+0000 7fbe1090f640 1 -- 172.21.15.102:0/2688525761 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbe0c0ca340 con 0x7fbe0c0b7d90 2023-11-13T11:29:07.338 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:07.319+0000 7fbe1090f640 1 -- 172.21.15.102:0/2688525761 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbe0c156050 con 0x7fbe0c0b7d90 2023-11-13T11:29:07.338 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:07.323+0000 7fbe1090f640 1 -- 172.21.15.102:0/2688525761 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbe0c068520 con 0x7fbe0c0b7d90 2023-11-13T11:29:07.338 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:07.323+0000 7fbe037fe640 1 -- 172.21.15.102:0/2688525761 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fbdf40071f0 con 0x7fbe0c0b7d90 2023-11-13T11:29:07.338 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:07.323+0000 7fbe037fe640 1 --2- 172.21.15.102:0/2688525761 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7fbdec0664a0 0x7fbdec068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:07.338 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:07.323+0000 7fbe037fe640 1 -- 172.21.15.102:0/2688525761 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fbdf411d750 con 0x7fbe0c0b7d90 2023-11-13T11:29:07.339 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:07.323+0000 7fbe0a59c640 1 --2- 172.21.15.102:0/2688525761 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7fbdec0664a0 0x7fbdec068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:07.339 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:07.323+0000 7fbe0a59c640 1 --2- 172.21.15.102:0/2688525761 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7fbdec0664a0 0x7fbdec068960 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fbdfc0112c0 tx=0x7fbdfc00d040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-13T11:29:07.339 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:07.327+0000 7fbe037fe640 1 -- 172.21.15.102:0/2688525761 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fbdf40eac70 con 0x7fbe0c0b7d90 2023-11-13T11:29:07.513 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:07.507+0000 7fbe1090f640 1 -- 172.21.15.102:0/2688525761 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7fbe0c0d0410 con 0x7fbe0c0b7d90 2023-11-13T11:29:07.513 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:07.507+0000 7fbe037fe640 1 -- 172.21.15.102:0/2688525761 <== mon.0 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+46 (secure 0 0 0) 0x7fbdf40ee290 con 0x7fbe0c0b7d90 2023-11-13T11:29:07.513 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T11:29:07.514 INFO:teuthology.orchestra.run.smithi102.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2023-11-13T11:29:07.515 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:07.511+0000 7fbe1090f640 1 -- 172.21.15.102:0/2688525761 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7fbdec0664a0 msgr2=0x7fbdec068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:07.515 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:07.511+0000 7fbe1090f640 1 --2- 172.21.15.102:0/2688525761 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7fbdec0664a0 0x7fbdec068960 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fbdfc0112c0 tx=0x7fbdfc00d040 comp rx=0 tx=0).stop 2023-11-13T11:29:07.515 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:07.511+0000 7fbe1090f640 1 -- 172.21.15.102:0/2688525761 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fbe0c0b7d90 msgr2=0x7fbe0c1590f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:07.515 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:07.511+0000 7fbe1090f640 1 --2- 172.21.15.102:0/2688525761 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fbe0c0b7d90 0x7fbe0c1590f0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fbdf400c0e0 tx=0x7fbdf8005800 comp rx=0 tx=0).stop 2023-11-13T11:29:07.515 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:07.511+0000 7fbe1090f640 1 -- 172.21.15.102:0/2688525761 shutdown_connections 2023-11-13T11:29:07.516 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:07.511+0000 7fbe1090f640 1 --2- 172.21.15.102:0/2688525761 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbe0c155690 0x7fbe0c155b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:07.516 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:07.511+0000 7fbe1090f640 1 --2- 172.21.15.102:0/2688525761 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7fbdec0664a0 0x7fbdec068960 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:07.516 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:07.511+0000 7fbe1090f640 1 --2- 172.21.15.102:0/2688525761 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fbe0c0b7d90 0x7fbe0c1590f0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:07.516 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:07.511+0000 7fbe1090f640 1 --2- 172.21.15.102:0/2688525761 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fbdf8003f80 0x7fbe0c0b3500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:07.516 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:07.511+0000 7fbe1090f640 1 -- 172.21.15.102:0/2688525761 >> 172.21.15.102:0/2688525761 conn(0x7fbe0c09c130 msgr2=0x7fbe0c161760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-13T11:29:07.517 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:07.511+0000 7fbe1090f640 1 -- 172.21.15.102:0/2688525761 shutdown_connections 2023-11-13T11:29:07.517 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:07.511+0000 7fbe1090f640 1 -- 172.21.15.102:0/2688525761 wait complete. 2023-11-13T11:29:07.537 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2023-11-13T11:29:07.538 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-13T11:29:07.675 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:07.671+0000 7f84c551e640 1 Processor -- start 2023-11-13T11:29:07.675 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:07.671+0000 7f84c551e640 1 -- start start 2023-11-13T11:29:07.676 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:07.671+0000 7f84c551e640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f84c015ce00 0x7f84c00cf340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:07.677 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:07.671+0000 7f84c551e640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f84c00d0940 0x7f84c00d1270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:07.677 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:07.671+0000 7f84c551e640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f84c00cfcb0 con 0x7f84c00d17b0 2023-11-13T11:29:07.677 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:07.671+0000 7f84c551e640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f84c00d1c60 con 0x7f84c015ce00 2023-11-13T11:29:07.677 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:07.671+0000 7f84c551e640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f84c00cff90 con 0x7f84c00d0940 2023-11-13T11:29:07.678 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:07.671+0000 7f84bffff640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f84c015ce00 0x7f84c00cf340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:07.678 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:07.671+0000 7f84bffff640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f84c015ce00 0x7f84c00cf340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:47634/0 (socket says 172.21.15.102:47634) 2023-11-13T11:29:07.678 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:07.671+0000 7f84bffff640 1 -- 172.21.15.102:0/2944828990 learned_addr learned my addr 172.21.15.102:0/2944828990 (peer_addr_for_me v2:172.21.15.102:0/0) 2023-11-13T11:29:07.678 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:07.671+0000 7f84bf7fe640 1 --2- 172.21.15.102:0/2944828990 >> v2:172.21.15.154:3300/0 conn(0x7f84c00d0940 0x7f84c00d1270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:07.678 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:07.671+0000 7f84bffff640 1 -- 172.21.15.102:0/2944828990 >> v2:172.21.15.154:3300/0 conn(0x7f84c00d0940 msgr2=0x7f84c00d1270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-13T11:29:07.679 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:07.671+0000 7f84bffff640 1 --2- 172.21.15.102:0/2944828990 >> v2:172.21.15.154:3300/0 conn(0x7f84c00d0940 0x7f84c00d1270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:07.679 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:07.671+0000 7f84bffff640 1 -- 172.21.15.102:0/2944828990 >> v1:172.21.15.154:6789/0 conn(0x7f84c00d17b0 legacy=0x7f84c00cd7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:07.679 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:07.671+0000 7f84bffff640 1 -- 172.21.15.102:0/2944828990 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84c00d0270 con 0x7f84c015ce00 2023-11-13T11:29:07.680 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:07.675+0000 7f84bffff640 1 --2- 172.21.15.102:0/2944828990 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f84c015ce00 0x7f84c00cf340 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f84c009c620 tx=0x7f84b001c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=465aca6a4bd40f67 server_cookie=0 in_seq=0 out_seq=0 2023-11-13T11:29:07.680 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:07.675+0000 7f84beffd640 1 -- 172.21.15.102:0/2944828990 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84b00aa430 con 0x7f84c015ce00 2023-11-13T11:29:07.681 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:07.675+0000 7f84beffd640 1 -- 172.21.15.102:0/2944828990 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f84b00aa590 con 0x7f84c015ce00 2023-11-13T11:29:07.681 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:07.675+0000 7f84beffd640 1 -- 172.21.15.102:0/2944828990 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84b00aa920 con 0x7f84c015ce00 2023-11-13T11:29:07.682 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:07.675+0000 7f84c551e640 1 -- 172.21.15.102:0/2944828990 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f84c015ce00 msgr2=0x7f84c00cf340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:07.682 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:07.675+0000 7f84c551e640 1 --2- 172.21.15.102:0/2944828990 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f84c015ce00 0x7f84c00cf340 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f84c009c620 tx=0x7f84b001c4d0 comp rx=0 tx=0).stop 2023-11-13T11:29:07.682 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:07.675+0000 7f84c551e640 1 -- 172.21.15.102:0/2944828990 shutdown_connections 2023-11-13T11:29:07.682 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:07.675+0000 7f84c551e640 1 --2- 172.21.15.102:0/2944828990 >> v2:172.21.15.154:3300/0 conn(0x7f84c00d0940 0x7f84c00d1270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:07.682 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:07.675+0000 7f84c551e640 1 --2- 172.21.15.102:0/2944828990 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f84c015ce00 0x7f84c00cf340 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:07.683 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:07.675+0000 7f84c551e640 1 -- 172.21.15.102:0/2944828990 >> 172.21.15.102:0/2944828990 conn(0x7f84c009bf60 msgr2=0x7f84c00d2c90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-13T11:29:07.683 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:07.675+0000 7f84c551e640 1 -- 172.21.15.102:0/2944828990 shutdown_connections 2023-11-13T11:29:07.683 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:07.675+0000 7f84c551e640 1 -- 172.21.15.102:0/2944828990 wait complete. 2023-11-13T11:29:07.685 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:07.679+0000 7f84c551e640 1 Processor -- start 2023-11-13T11:29:07.685 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:07.679+0000 7f84c551e640 1 -- start start 2023-11-13T11:29:07.685 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:07.679+0000 7f84c551e640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f84c00d0940 0x7f84c0151950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:07.685 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:07.679+0000 7f84c551e640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f84c00d17b0 0x7f84c015e820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:07.686 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:07.679+0000 7f84c551e640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f84c015ce00 0x7f84c015d420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:07.686 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:07.679+0000 7f84c551e640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84c0153a10 con 0x7f84c015ce00 2023-11-13T11:29:07.686 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:07.679+0000 7f84c551e640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84c0152160 con 0x7f84c00d17b0 2023-11-13T11:29:07.686 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:07.679+0000 7f84c551e640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f84c015dfc0 con 0x7f84c00d0940 2023-11-13T11:29:07.686 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:07.679+0000 7f84c4d1d640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f84c015ce00 0x7f84c015d420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:07.687 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:07.679+0000 7f84c4d1d640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f84c015ce00 0x7f84c015d420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:47650/0 (socket says 172.21.15.102:47650) 2023-11-13T11:29:07.687 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:07.679+0000 7f84c4d1d640 1 -- 172.21.15.102:0/418388183 learned_addr learned my addr 172.21.15.102:0/418388183 (peer_addr_for_me v2:172.21.15.102:0/0) 2023-11-13T11:29:07.687 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:07.679+0000 7f84bf7fe640 1 --2- 172.21.15.102:0/418388183 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f84c00d17b0 0x7f84c015e820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:07.687 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:07.679+0000 7f84bffff640 1 --2- 172.21.15.102:0/418388183 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f84c00d0940 0x7f84c0151950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:07.687 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:07.679+0000 7f84c4d1d640 1 -- 172.21.15.102:0/418388183 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f84c00d0940 msgr2=0x7f84c0151950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:07.688 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:07.679+0000 7f84c4d1d640 1 --2- 172.21.15.102:0/418388183 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f84c00d0940 0x7f84c0151950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:07.688 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:07.679+0000 7f84c4d1d640 1 -- 172.21.15.102:0/418388183 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f84c00d17b0 msgr2=0x7f84c015e820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:07.688 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:07.679+0000 7f84c4d1d640 1 --2- 172.21.15.102:0/418388183 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f84c00d17b0 0x7f84c015e820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:07.688 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:07.679+0000 7f84c4d1d640 1 -- 172.21.15.102:0/418388183 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84b00094d0 con 0x7f84c015ce00 2023-11-13T11:29:07.688 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:07.679+0000 7f84c4d1d640 1 --2- 172.21.15.102:0/418388183 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f84c015ce00 0x7f84c015d420 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f84b800c770 tx=0x7f84b800cc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-13T11:29:07.689 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:07.679+0000 7f84bcff9640 1 -- 172.21.15.102:0/418388183 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84b8003b80 con 0x7f84c015ce00 2023-11-13T11:29:07.689 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:07.679+0000 7f84bcff9640 1 -- 172.21.15.102:0/418388183 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f84b8003ce0 con 0x7f84c015ce00 2023-11-13T11:29:07.689 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:07.679+0000 7f84bcff9640 1 -- 172.21.15.102:0/418388183 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84b800aa90 con 0x7f84c015ce00 2023-11-13T11:29:07.689 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:07.679+0000 7f84c551e640 1 -- 172.21.15.102:0/418388183 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f84c015e2a0 con 0x7f84c015ce00 2023-11-13T11:29:07.690 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:07.679+0000 7f84c551e640 1 -- 172.21.15.102:0/418388183 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f84c0152690 con 0x7f84c015ce00 2023-11-13T11:29:07.690 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:07.679+0000 7f84c551e640 1 -- 172.21.15.102:0/418388183 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f84c0067680 con 0x7f84c015ce00 2023-11-13T11:29:07.691 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:07.683+0000 7f84bcff9640 1 -- 172.21.15.102:0/418388183 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f84b800abf0 con 0x7f84c015ce00 2023-11-13T11:29:07.691 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:07.683+0000 7f84bcff9640 1 --2- 172.21.15.102:0/418388183 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f84ac066470 0x7f84ac068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:07.691 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:07.683+0000 7f84bcff9640 1 -- 172.21.15.102:0/418388183 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f84b8083c10 con 0x7f84c015ce00 2023-11-13T11:29:07.691 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:07.683+0000 7f84bffff640 1 --2- 172.21.15.102:0/418388183 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f84ac066470 0x7f84ac068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:07.691 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:07.683+0000 7f84bffff640 1 --2- 172.21.15.102:0/418388183 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f84ac066470 0x7f84ac068930 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f84b00ae000 tx=0x7f84b00b5040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-13T11:29:07.692 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:07.687+0000 7f84bcff9640 1 -- 172.21.15.102:0/418388183 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f84b80510a0 con 0x7f84c015ce00 2023-11-13T11:29:07.841 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:07.835+0000 7f84c551e640 1 -- 172.21.15.102:0/418388183 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f84c0068520 con 0x7f84c015ce00 2023-11-13T11:29:07.842 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:07.835+0000 7f84bcff9640 1 -- 172.21.15.102:0/418388183 <== mon.0 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+16545 (secure 0 0 0) 0x7f84b80546c0 con 0x7f84c015ce00 2023-11-13T11:29:07.842 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T11:29:07.842 INFO:teuthology.orchestra.run.smithi102.stdout:{"epoch":22,"fsid":"97b3eb2b-7ccf-4aae-8d92-bff986c671ea","created":"2023-11-13T11:28:31.836724+0000","modified":"2023-11-13T11:28:58.608314+0000","last_up_change":"2023-11-13T11:28:44.876638+0000","last_in_change":"2023-11-13T11:28:35.312740+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-13T11:28:44.981356+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-13T11:28:55.958525+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-13T11:28:56.394264+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"bdefaa17-fcca-4c86-aa40-27dc33a789af","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6800","nonce":53303834},{"type":"v1","addr":"172.21.15.102:6801","nonce":53303834}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6802","nonce":53303834},{"type":"v1","addr":"172.21.15.102:6803","nonce":53303834}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6806","nonce":53303834},{"type":"v1","addr":"172.21.15.102:6807","nonce":53303834}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6804","nonce":53303834},{"type":"v1","addr":"172.21.15.102:6805","nonce":53303834}]},"public_addr":"172.21.15.102:6801/53303834","cluster_addr":"172.21.15.102:6803/53303834","heartbeat_back_addr":"172.21.15.102:6807/53303834","heartbeat_front_addr":"172.21.15.102:6805/53303834","state":["exists","up"]},{"osd":1,"uuid":"f0033196-dec9-4ae9-945e-6aeef6dbb47f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6808","nonce":1732708348},{"type":"v1","addr":"172.21.15.102:6809","nonce":1732708348}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6811","nonce":1732708348},{"type":"v1","addr":"172.21.15.102:6813","nonce":1732708348}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6818","nonce":1732708348},{"type":"v1","addr":"172.21.15.102:6820","nonce":1732708348}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6815","nonce":1732708348},{"type":"v1","addr":"172.21.15.102:6817","nonce":1732708348}]},"public_addr":"172.21.15.102:6809/1732708348","cluster_addr":"172.21.15.102:6813/1732708348","heartbeat_back_addr":"172.21.15.102:6820/1732708348","heartbeat_front_addr":"172.21.15.102:6817/1732708348","state":["exists","up"]},{"osd":2,"uuid":"496b0834-351e-4ec2-a714-86ed0c0ff4fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6810","nonce":1825475150},{"type":"v1","addr":"172.21.15.102:6812","nonce":1825475150}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6814","nonce":1825475150},{"type":"v1","addr":"172.21.15.102:6816","nonce":1825475150}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6822","nonce":1825475150},{"type":"v1","addr":"172.21.15.102:6823","nonce":1825475150}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6819","nonce":1825475150},{"type":"v1","addr":"172.21.15.102:6821","nonce":1825475150}]},"public_addr":"172.21.15.102:6812/1825475150","cluster_addr":"172.21.15.102:6816/1825475150","heartbeat_back_addr":"172.21.15.102:6823/1825475150","heartbeat_front_addr":"172.21.15.102:6821/1825475150","state":["exists","up"]},{"osd":3,"uuid":"3ba6cc41-e0a0-4273-86cb-90000c06a55a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6824","nonce":4149355528},{"type":"v1","addr":"172.21.15.102:6825","nonce":4149355528}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6826","nonce":4149355528},{"type":"v1","addr":"172.21.15.102:6827","nonce":4149355528}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6830","nonce":4149355528},{"type":"v1","addr":"172.21.15.102:6831","nonce":4149355528}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6828","nonce":4149355528},{"type":"v1","addr":"172.21.15.102:6829","nonce":4149355528}]},"public_addr":"172.21.15.102:6825/4149355528","cluster_addr":"172.21.15.102:6827/4149355528","heartbeat_back_addr":"172.21.15.102:6831/4149355528","heartbeat_front_addr":"172.21.15.102:6829/4149355528","state":["exists","up"]},{"osd":4,"uuid":"16e797d8-e6e7-4140-95c3-b85283c42a2a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6808","nonce":4028899241},{"type":"v1","addr":"172.21.15.154:6809","nonce":4028899241}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6810","nonce":4028899241},{"type":"v1","addr":"172.21.15.154:6811","nonce":4028899241}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6814","nonce":4028899241},{"type":"v1","addr":"172.21.15.154:6815","nonce":4028899241}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6812","nonce":4028899241},{"type":"v1","addr":"172.21.15.154:6813","nonce":4028899241}]},"public_addr":"172.21.15.154:6809/4028899241","cluster_addr":"172.21.15.154:6811/4028899241","heartbeat_back_addr":"172.21.15.154:6815/4028899241","heartbeat_front_addr":"172.21.15.154:6813/4028899241","state":["exists","up"]},{"osd":5,"uuid":"d6ab225c-1b55-450a-89a9-abe5c3f8d6af","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":3562396827},{"type":"v1","addr":"172.21.15.154:6801","nonce":3562396827}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":3562396827},{"type":"v1","addr":"172.21.15.154:6803","nonce":3562396827}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6806","nonce":3562396827},{"type":"v1","addr":"172.21.15.154:6807","nonce":3562396827}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6804","nonce":3562396827},{"type":"v1","addr":"172.21.15.154:6805","nonce":3562396827}]},"public_addr":"172.21.15.154:6801/3562396827","cluster_addr":"172.21.15.154:6803/3562396827","heartbeat_back_addr":"172.21.15.154:6807/3562396827","heartbeat_front_addr":"172.21.15.154:6805/3562396827","state":["exists","up"]},{"osd":6,"uuid":"96f905ac-491c-4662-8e2b-5bb8e929ab9d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6816","nonce":2933728751},{"type":"v1","addr":"172.21.15.154:6817","nonce":2933728751}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6818","nonce":2933728751},{"type":"v1","addr":"172.21.15.154:6819","nonce":2933728751}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6822","nonce":2933728751},{"type":"v1","addr":"172.21.15.154:6823","nonce":2933728751}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6820","nonce":2933728751},{"type":"v1","addr":"172.21.15.154:6821","nonce":2933728751}]},"public_addr":"172.21.15.154:6817/2933728751","cluster_addr":"172.21.15.154:6819/2933728751","heartbeat_back_addr":"172.21.15.154:6823/2933728751","heartbeat_front_addr":"172.21.15.154:6821/2933728751","state":["exists","up"]},{"osd":7,"uuid":"07012d3b-3ab4-40df-a471-93caed22e2dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6824","nonce":1753500785},{"type":"v1","addr":"172.21.15.154:6825","nonce":1753500785}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6826","nonce":1753500785},{"type":"v1","addr":"172.21.15.154:6827","nonce":1753500785}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6830","nonce":1753500785},{"type":"v1","addr":"172.21.15.154:6831","nonce":1753500785}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6828","nonce":1753500785},{"type":"v1","addr":"172.21.15.154:6829","nonce":1753500785}]},"public_addr":"172.21.15.154:6825/1753500785","cluster_addr":"172.21.15.154:6827/1753500785","heartbeat_back_addr":"172.21.15.154:6831/1753500785","heartbeat_front_addr":"172.21.15.154:6829/1753500785","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-13T11:28:40.978603+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-13T11:28:41.200985+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-13T11:28:41.222815+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-13T11:28:41.202162+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-13T11:28:40.925911+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-13T11:28:41.087725+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-13T11:28:41.072208+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-13T11:28:40.875257+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-13T11:29:07.844 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:07.839+0000 7f84c551e640 1 -- 172.21.15.102:0/418388183 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f84ac066470 msgr2=0x7f84ac068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:07.844 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:07.839+0000 7f84c551e640 1 --2- 172.21.15.102:0/418388183 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f84ac066470 0x7f84ac068930 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f84b00ae000 tx=0x7f84b00b5040 comp rx=0 tx=0).stop 2023-11-13T11:29:07.844 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:07.839+0000 7f84c551e640 1 -- 172.21.15.102:0/418388183 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f84c015ce00 msgr2=0x7f84c015d420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:07.844 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:07.839+0000 7f84c551e640 1 --2- 172.21.15.102:0/418388183 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f84c015ce00 0x7f84c015d420 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f84b800c770 tx=0x7f84b800cc30 comp rx=0 tx=0).stop 2023-11-13T11:29:07.845 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:07.839+0000 7f84c551e640 1 -- 172.21.15.102:0/418388183 shutdown_connections 2023-11-13T11:29:07.845 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:07.839+0000 7f84c551e640 1 --2- 172.21.15.102:0/418388183 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f84ac066470 0x7f84ac068930 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:07.845 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:07.839+0000 7f84c551e640 1 --2- 172.21.15.102:0/418388183 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f84c015ce00 0x7f84c015d420 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:07.845 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:07.839+0000 7f84c551e640 1 --2- 172.21.15.102:0/418388183 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f84c00d17b0 0x7f84c015e820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:07.845 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:07.839+0000 7f84c551e640 1 --2- 172.21.15.102:0/418388183 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f84c00d0940 0x7f84c0151950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:07.846 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:07.839+0000 7f84c551e640 1 -- 172.21.15.102:0/418388183 >> 172.21.15.102:0/418388183 conn(0x7f84c009bf60 msgr2=0x7f84c00b0270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-13T11:29:07.846 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:07.839+0000 7f84c551e640 1 -- 172.21.15.102:0/418388183 shutdown_connections 2023-11-13T11:29:07.846 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:07.839+0000 7f84c551e640 1 -- 172.21.15.102:0/418388183 wait complete. 2023-11-13T11:29:07.863 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-13T11:28:44.981356+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-13T11:28:55.958525+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-11-13T11:28:56.394264+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-13T11:29:07.864 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-13T11:29:08.006 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:07.999+0000 7f06210d6640 1 Processor -- start 2023-11-13T11:29:08.006 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:07.999+0000 7f06210d6640 1 -- start start 2023-11-13T11:29:08.008 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:08.003+0000 7f06210d6640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f061c06fc80 0x7f061c0711c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:08.009 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:08.003+0000 7f06210d6640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f061c0b21f0 con 0x7f061c159b30 2023-11-13T11:29:08.009 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:08.003+0000 7f06210d6640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f061c0b2440 con 0x7f061c0cf2d0 2023-11-13T11:29:08.009 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:08.003+0000 7f06210d6640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f061c0b2720 con 0x7f061c06fc80 2023-11-13T11:29:08.010 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:08.003+0000 7f061b59e640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f061c06fc80 0x7f061c0711c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:08.010 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:08.003+0000 7f061ad9d640 1 --1- >> v1:172.21.15.102:6789/0 conn(0x7f061c159b30 0x7f061c0cebc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.102:6789/0 says I am v1:172.21.15.102:49628/0 (socket says 172.21.15.102:49628) 2023-11-13T11:29:08.011 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:08.003+0000 7f061b59e640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f061c06fc80 0x7f061c0711c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:47654/0 (socket says 172.21.15.102:47654) 2023-11-13T11:29:08.011 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:08.003+0000 7f061ad9d640 1 -- 172.21.15.102:0/3723696408 learned_addr learned my addr 172.21.15.102:0/3723696408 (peer_addr_for_me v1:172.21.15.102:0/0) 2023-11-13T11:29:08.011 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:08.003+0000 7f061b59e640 1 -- 172.21.15.102:0/3723696408 >> v1:172.21.15.154:6789/0 conn(0x7f061c0cf2d0 legacy=0x7f061c0cbe90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:08.012 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:08.003+0000 7f061b59e640 1 -- 172.21.15.102:0/3723696408 >> v1:172.21.15.102:6789/0 conn(0x7f061c159b30 legacy=0x7f061c0cebc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:08.012 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:08.003+0000 7f061b59e640 1 -- 172.21.15.102:0/3723696408 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f061c0b2d20 con 0x7f061c06fc80 2023-11-13T11:29:08.017 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:08.007+0000 7f061b59e640 1 --2- 172.21.15.102:0/3723696408 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f061c06fc80 0x7f061c0711c0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f0614009dc0 tx=0x7f061401c900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ca41ed54b38437e1 server_cookie=0 in_seq=0 out_seq=0 2023-11-13T11:29:08.017 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:08.007+0000 7f061a59c640 1 -- 172.21.15.102:0/3723696408 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06140a5950 con 0x7f061c06fc80 2023-11-13T11:29:08.018 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:08.007+0000 7f061a59c640 1 -- 172.21.15.102:0/3723696408 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f06140a5ab0 con 0x7f061c06fc80 2023-11-13T11:29:08.018 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:08.007+0000 7f061a59c640 1 -- 172.21.15.102:0/3723696408 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06140a5e40 con 0x7f061c06fc80 2023-11-13T11:29:08.018 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:08.007+0000 7f06210d6640 1 -- 172.21.15.102:0/3723696408 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f061c06fc80 msgr2=0x7f061c0711c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:08.018 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:08.007+0000 7f06210d6640 1 --2- 172.21.15.102:0/3723696408 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f061c06fc80 0x7f061c0711c0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f0614009dc0 tx=0x7f061401c900 comp rx=0 tx=0).stop 2023-11-13T11:29:08.018 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:08.007+0000 7f06210d6640 1 -- 172.21.15.102:0/3723696408 shutdown_connections 2023-11-13T11:29:08.019 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:08.007+0000 7f06210d6640 1 --2- 172.21.15.102:0/3723696408 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f061c06fc80 0x7f061c0711c0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:08.019 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:08.007+0000 7f06210d6640 1 -- 172.21.15.102:0/3723696408 >> 172.21.15.102:0/3723696408 conn(0x7f061c06a410 msgr2=0x7f061c06a820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-13T11:29:08.019 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:08.007+0000 7f06210d6640 1 -- 172.21.15.102:0/3723696408 shutdown_connections 2023-11-13T11:29:08.020 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:08.007+0000 7f06210d6640 1 -- 172.21.15.102:0/3723696408 wait complete. 2023-11-13T11:29:08.020 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:08.007+0000 7f06210d6640 1 Processor -- start 2023-11-13T11:29:08.020 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:08.007+0000 7f06210d6640 1 -- start start 2023-11-13T11:29:08.021 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:08.011+0000 7f06210d6640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f061c06fc80 0x7f061c1474c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:08.021 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:08.011+0000 7f06210d6640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f061c0cf2d0 0x7f061c14b800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:08.021 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:08.011+0000 7f06210d6640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f061c159b30 0x7f061c1489a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:08.021 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:08.011+0000 7f06210d6640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f061c14c150 con 0x7f061c159b30 2023-11-13T11:29:08.021 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:08.011+0000 7f06210d6640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f061c14c430 con 0x7f061c06fc80 2023-11-13T11:29:08.022 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:08.011+0000 7f06210d6640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f061c14c710 con 0x7f061c0cf2d0 2023-11-13T11:29:08.022 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:08.011+0000 7f061b59e640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f061c159b30 0x7f061c1489a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:08.022 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:08.011+0000 7f061b59e640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f061c159b30 0x7f061c1489a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:47662/0 (socket says 172.21.15.102:47662) 2023-11-13T11:29:08.022 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:08.011+0000 7f061b59e640 1 -- 172.21.15.102:0/3890530330 learned_addr learned my addr 172.21.15.102:0/3890530330 (peer_addr_for_me v2:172.21.15.102:0/0) 2023-11-13T11:29:08.022 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:08.011+0000 7f0613fff640 1 --2- 172.21.15.102:0/3890530330 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f061c0cf2d0 0x7f061c14b800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:08.023 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:08.011+0000 7f061b59e640 1 -- 172.21.15.102:0/3890530330 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f061c0cf2d0 msgr2=0x7f061c14b800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:08.023 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:08.011+0000 7f061b59e640 1 --2- 172.21.15.102:0/3890530330 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f061c0cf2d0 0x7f061c14b800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:08.023 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:08.011+0000 7f061ad9d640 1 --2- 172.21.15.102:0/3890530330 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f061c06fc80 0x7f061c1474c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:08.023 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:08.011+0000 7f061b59e640 1 -- 172.21.15.102:0/3890530330 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f061c06fc80 msgr2=0x7f061c1474c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:08.023 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:08.011+0000 7f061b59e640 1 --2- 172.21.15.102:0/3890530330 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f061c06fc80 0x7f061c1474c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:08.023 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:08.011+0000 7f061b59e640 1 -- 172.21.15.102:0/3890530330 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0614009a70 con 0x7f061c159b30 2023-11-13T11:29:08.024 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:08.011+0000 7f0613fff640 1 --2- 172.21.15.102:0/3890530330 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f061c0cf2d0 0x7f061c14b800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-13T11:29:08.024 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:08.011+0000 7f061ad9d640 1 --2- 172.21.15.102:0/3890530330 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f061c06fc80 0x7f061c1474c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-13T11:29:08.024 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:08.011+0000 7f061b59e640 1 --2- 172.21.15.102:0/3890530330 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f061c159b30 0x7f061c1489a0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f061401a530 tx=0x7f06140196a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-13T11:29:08.024 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:08.011+0000 7f06137fe640 1 -- 172.21.15.102:0/3890530330 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06140adde0 con 0x7f061c159b30 2023-11-13T11:29:08.024 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:08.011+0000 7f06137fe640 1 -- 172.21.15.102:0/3890530330 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f06140b9450 con 0x7f061c159b30 2023-11-13T11:29:08.025 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:08.011+0000 7f06210d6640 1 -- 172.21.15.102:0/3890530330 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f061c14c9f0 con 0x7f061c159b30 2023-11-13T11:29:08.025 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:08.011+0000 7f06137fe640 1 -- 172.21.15.102:0/3890530330 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06140b9800 con 0x7f061c159b30 2023-11-13T11:29:08.025 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:08.011+0000 7f06210d6640 1 -- 172.21.15.102:0/3890530330 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f061c147a00 con 0x7f061c159b30 2023-11-13T11:29:08.025 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:08.011+0000 7f06210d6640 1 -- 172.21.15.102:0/3890530330 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f061c067640 con 0x7f061c159b30 2023-11-13T11:29:08.027 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:08.011+0000 7f06137fe640 1 -- 172.21.15.102:0/3890530330 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f06140b9960 con 0x7f061c159b30 2023-11-13T11:29:08.027 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:08.015+0000 7f06137fe640 1 --2- 172.21.15.102:0/3890530330 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f05fc066470 0x7f05fc068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:08.027 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:08.015+0000 7f06137fe640 1 -- 172.21.15.102:0/3890530330 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f061411f7e0 con 0x7f061c159b30 2023-11-13T11:29:08.027 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:08.015+0000 7f061ad9d640 1 --2- 172.21.15.102:0/3890530330 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f05fc066470 0x7f05fc068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:08.028 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:08.015+0000 7f061ad9d640 1 --2- 172.21.15.102:0/3890530330 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f05fc066470 0x7f05fc068930 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f060c005890 tx=0x7f060c009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-13T11:29:08.028 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:08.019+0000 7f06137fe640 1 -- 172.21.15.102:0/3890530330 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f06140ecbc0 con 0x7f061c159b30 2023-11-13T11:29:08.175 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:08.171+0000 7f06210d6640 1 -- 172.21.15.102:0/3890530330 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f061c068520 con 0x7f061c159b30 2023-11-13T11:29:08.175 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:08.171+0000 7f06137fe640 1 -- 172.21.15.102:0/3890530330 <== mon.0 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v22) v1 ==== 93+0+10 (secure 0 0 0) 0x7f06140f01e0 con 0x7f061c159b30 2023-11-13T11:29:08.176 INFO:teuthology.orchestra.run.smithi102.stdout:pg_num: 1 2023-11-13T11:29:08.177 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:08.171+0000 7f06210d6640 1 -- 172.21.15.102:0/3890530330 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f05fc066470 msgr2=0x7f05fc068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:08.178 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:08.171+0000 7f06210d6640 1 --2- 172.21.15.102:0/3890530330 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f05fc066470 0x7f05fc068930 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f060c005890 tx=0x7f060c009040 comp rx=0 tx=0).stop 2023-11-13T11:29:08.178 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:08.171+0000 7f06210d6640 1 -- 172.21.15.102:0/3890530330 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f061c159b30 msgr2=0x7f061c1489a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:08.178 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:08.171+0000 7f06210d6640 1 --2- 172.21.15.102:0/3890530330 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f061c159b30 0x7f061c1489a0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f061401a530 tx=0x7f06140196a0 comp rx=0 tx=0).stop 2023-11-13T11:29:08.178 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:08.171+0000 7f06210d6640 1 -- 172.21.15.102:0/3890530330 shutdown_connections 2023-11-13T11:29:08.178 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:08.171+0000 7f06210d6640 1 --2- 172.21.15.102:0/3890530330 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f05fc066470 0x7f05fc068930 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:08.179 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:08.171+0000 7f06210d6640 1 --2- 172.21.15.102:0/3890530330 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f061c159b30 0x7f061c1489a0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:08.179 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:08.171+0000 7f06210d6640 1 --2- 172.21.15.102:0/3890530330 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f061c0cf2d0 0x7f061c14b800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:08.179 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:08.171+0000 7f06210d6640 1 --2- 172.21.15.102:0/3890530330 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f061c06fc80 0x7f061c1474c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:08.179 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:08.171+0000 7f06210d6640 1 -- 172.21.15.102:0/3890530330 >> 172.21.15.102:0/3890530330 conn(0x7f061c06a410 msgr2=0x7f061c0b1480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-13T11:29:08.179 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:08.171+0000 7f06210d6640 1 -- 172.21.15.102:0/3890530330 shutdown_connections 2023-11-13T11:29:08.180 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:08.171+0000 7f06210d6640 1 -- 172.21.15.102:0/3890530330 wait complete. 2023-11-13T11:29:08.196 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-13T11:29:08.336 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:08.331+0000 7fa847b72640 1 Processor -- start 2023-11-13T11:29:08.337 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:08.331+0000 7fa847b72640 1 -- start start 2023-11-13T11:29:08.338 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:08.331+0000 7fa847b72640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fa84015d600 0x7fa8400b2e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:08.338 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:08.331+0000 7fa847b72640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7fa8400b3f60 0x7fa8400d3910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:08.338 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:08.331+0000 7fa847b72640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa8400b3840 con 0x7fa84015d220 2023-11-13T11:29:08.338 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:08.331+0000 7fa847b72640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa8400cecb0 con 0x7fa8400b3f60 2023-11-13T11:29:08.339 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:08.331+0000 7fa847b72640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa8400d0d00 con 0x7fa84015d600 2023-11-13T11:29:08.339 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:08.331+0000 7fa84610f640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7fa8400b3f60 0x7fa8400d3910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:08.340 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:08.331+0000 7fa84610f640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7fa8400b3f60 0x7fa8400d3910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:47674/0 (socket says 172.21.15.102:47674) 2023-11-13T11:29:08.340 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:08.331+0000 7fa84610f640 1 -- 172.21.15.102:0/2113604924 learned_addr learned my addr 172.21.15.102:0/2113604924 (peer_addr_for_me v2:172.21.15.102:0/0) 2023-11-13T11:29:08.340 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:08.331+0000 7fa84510d640 1 --2- 172.21.15.102:0/2113604924 >> v2:172.21.15.154:3300/0 conn(0x7fa84015d600 0x7fa8400b2e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:08.340 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:08.335+0000 7fa84610f640 1 -- 172.21.15.102:0/2113604924 >> v2:172.21.15.154:3300/0 conn(0x7fa84015d600 msgr2=0x7fa8400b2e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-13T11:29:08.340 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:08.335+0000 7fa84610f640 1 --2- 172.21.15.102:0/2113604924 >> v2:172.21.15.154:3300/0 conn(0x7fa84015d600 0x7fa8400b2e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:08.341 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:08.335+0000 7fa84610f640 1 -- 172.21.15.102:0/2113604924 >> v1:172.21.15.154:6789/0 conn(0x7fa84015d220 legacy=0x7fa8400b2750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:08.341 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:08.335+0000 7fa84610f640 1 -- 172.21.15.102:0/2113604924 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8400d0fe0 con 0x7fa8400b3f60 2023-11-13T11:29:08.341 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:08.335+0000 7fa84610f640 1 --2- 172.21.15.102:0/2113604924 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa8400b3f60 0x7fa8400d3910 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fa8400ceea0 tx=0x7fa83801c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b7c66f34aa470e05 server_cookie=0 in_seq=0 out_seq=0 2023-11-13T11:29:08.342 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:08.335+0000 7fa84490c640 1 -- 172.21.15.102:0/2113604924 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8380a56e0 con 0x7fa8400b3f60 2023-11-13T11:29:08.342 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:08.335+0000 7fa84490c640 1 -- 172.21.15.102:0/2113604924 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa8380a5840 con 0x7fa8400b3f60 2023-11-13T11:29:08.342 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:08.335+0000 7fa84490c640 1 -- 172.21.15.102:0/2113604924 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8380a5bd0 con 0x7fa8400b3f60 2023-11-13T11:29:08.343 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:08.335+0000 7fa847b72640 1 -- 172.21.15.102:0/2113604924 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa8400b3f60 msgr2=0x7fa8400d3910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:08.343 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:08.335+0000 7fa847b72640 1 --2- 172.21.15.102:0/2113604924 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa8400b3f60 0x7fa8400d3910 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fa8400ceea0 tx=0x7fa83801c880 comp rx=0 tx=0).stop 2023-11-13T11:29:08.344 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:08.339+0000 7fa847b72640 1 -- 172.21.15.102:0/2113604924 shutdown_connections 2023-11-13T11:29:08.344 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:08.339+0000 7fa847b72640 1 --2- 172.21.15.102:0/2113604924 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa8400b3f60 0x7fa8400d3910 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:08.344 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:08.339+0000 7fa847b72640 1 --2- 172.21.15.102:0/2113604924 >> v2:172.21.15.154:3300/0 conn(0x7fa84015d600 0x7fa8400b2e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:08.344 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:08.339+0000 7fa847b72640 1 -- 172.21.15.102:0/2113604924 >> 172.21.15.102:0/2113604924 conn(0x7fa8400d2df0 msgr2=0x7fa8400d3200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-13T11:29:08.344 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:08.339+0000 7fa847b72640 1 -- 172.21.15.102:0/2113604924 shutdown_connections 2023-11-13T11:29:08.345 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:08.339+0000 7fa847b72640 1 -- 172.21.15.102:0/2113604924 wait complete. 2023-11-13T11:29:08.346 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:08.339+0000 7fa847b72640 1 Processor -- start 2023-11-13T11:29:08.347 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:08.339+0000 7fa847b72640 1 -- start start 2023-11-13T11:29:08.347 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:08.339+0000 7fa847b72640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa8400b3f60 0x7fa84014a9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:08.347 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:08.339+0000 7fa847b72640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa84015d220 0x7fa840149bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:08.347 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:08.339+0000 7fa847b72640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa84015d600 0x7fa84014a110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:08.348 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:08.339+0000 7fa847b72640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8401609c0 con 0x7fa84015d600 2023-11-13T11:29:08.348 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:08.339+0000 7fa847b72640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8400c8870 con 0x7fa84015d220 2023-11-13T11:29:08.348 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:08.339+0000 7fa847b72640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8400c8b50 con 0x7fa8400b3f60 2023-11-13T11:29:08.348 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:08.339+0000 7fa84610f640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa84015d600 0x7fa84014a110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:08.348 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:08.339+0000 7fa84610f640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa84015d600 0x7fa84014a110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:47678/0 (socket says 172.21.15.102:47678) 2023-11-13T11:29:08.349 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:08.339+0000 7fa84610f640 1 -- 172.21.15.102:0/2176591098 learned_addr learned my addr 172.21.15.102:0/2176591098 (peer_addr_for_me v2:172.21.15.102:0/0) 2023-11-13T11:29:08.349 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:08.339+0000 7fa84510d640 1 --2- 172.21.15.102:0/2176591098 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa84015d220 0x7fa840149bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:08.349 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:08.339+0000 7fa84590e640 1 --2- 172.21.15.102:0/2176591098 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa8400b3f60 0x7fa84014a9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:08.349 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:08.339+0000 7fa84610f640 1 -- 172.21.15.102:0/2176591098 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa8400b3f60 msgr2=0x7fa84014a9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:08.349 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:08.339+0000 7fa84610f640 1 --2- 172.21.15.102:0/2176591098 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa8400b3f60 0x7fa84014a9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:08.350 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:08.339+0000 7fa84610f640 1 -- 172.21.15.102:0/2176591098 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa84015d220 msgr2=0x7fa840149bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:08.350 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:08.339+0000 7fa84610f640 1 --2- 172.21.15.102:0/2176591098 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa84015d220 0x7fa840149bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:08.350 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:08.339+0000 7fa84610f640 1 -- 172.21.15.102:0/2176591098 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa838009b30 con 0x7fa84015d600 2023-11-13T11:29:08.350 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:08.339+0000 7fa84590e640 1 --2- 172.21.15.102:0/2176591098 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa8400b3f60 0x7fa84014a9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-13T11:29:08.351 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:08.339+0000 7fa84610f640 1 --2- 172.21.15.102:0/2176591098 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa84015d600 0x7fa84014a110 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fa838019490 tx=0x7fa838019620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-13T11:29:08.351 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:08.339+0000 7fa8367fc640 1 -- 172.21.15.102:0/2176591098 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8380b8670 con 0x7fa84015d600 2023-11-13T11:29:08.351 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:08.343+0000 7fa8367fc640 1 -- 172.21.15.102:0/2176591098 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa8380b87d0 con 0x7fa84015d600 2023-11-13T11:29:08.351 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:08.343+0000 7fa847b72640 1 -- 172.21.15.102:0/2176591098 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa84015db80 con 0x7fa84015d600 2023-11-13T11:29:08.351 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:08.343+0000 7fa8367fc640 1 -- 172.21.15.102:0/2176591098 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8380b8b60 con 0x7fa84015d600 2023-11-13T11:29:08.352 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:08.343+0000 7fa847b72640 1 -- 172.21.15.102:0/2176591098 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa84014af30 con 0x7fa84015d600 2023-11-13T11:29:08.353 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:08.343+0000 7fa847b72640 1 -- 172.21.15.102:0/2176591098 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa8400c8ce0 con 0x7fa84015d600 2023-11-13T11:29:08.353 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:08.343+0000 7fa8367fc640 1 -- 172.21.15.102:0/2176591098 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fa8380b8cc0 con 0x7fa84015d600 2023-11-13T11:29:08.353 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:08.343+0000 7fa8367fc640 1 --2- 172.21.15.102:0/2176591098 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7fa824066470 0x7fa824068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:08.353 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:08.343+0000 7fa8367fc640 1 -- 172.21.15.102:0/2176591098 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa83811f2d0 con 0x7fa84015d600 2023-11-13T11:29:08.353 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:08.343+0000 7fa84590e640 1 --2- 172.21.15.102:0/2176591098 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7fa824066470 0x7fa824068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:08.354 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:08.347+0000 7fa84590e640 1 --2- 172.21.15.102:0/2176591098 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7fa824066470 0x7fa824068930 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fa83c000f70 tx=0x7fa83c009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-13T11:29:08.354 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:08.347+0000 7fa8367fc640 1 -- 172.21.15.102:0/2176591098 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fa8380ec6b0 con 0x7fa84015d600 2023-11-13T11:29:08.503 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:08.499+0000 7fa847b72640 1 -- 172.21.15.102:0/2176591098 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fa840068520 con 0x7fa84015d600 2023-11-13T11:29:08.504 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:08.499+0000 7fa8367fc640 1 -- 172.21.15.102:0/2176591098 <== mon.0 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v22) v1 ==== 104+0+11 (secure 0 0 0) 0x7fa838009510 con 0x7fa84015d600 2023-11-13T11:29:08.504 INFO:teuthology.orchestra.run.smithi102.stdout:pg_num: 32 2023-11-13T11:29:08.506 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:08.499+0000 7fa847b72640 1 -- 172.21.15.102:0/2176591098 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7fa824066470 msgr2=0x7fa824068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:08.506 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:08.499+0000 7fa847b72640 1 --2- 172.21.15.102:0/2176591098 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7fa824066470 0x7fa824068930 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fa83c000f70 tx=0x7fa83c009040 comp rx=0 tx=0).stop 2023-11-13T11:29:08.506 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:08.499+0000 7fa847b72640 1 -- 172.21.15.102:0/2176591098 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa84015d600 msgr2=0x7fa84014a110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:08.506 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:08.499+0000 7fa847b72640 1 --2- 172.21.15.102:0/2176591098 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa84015d600 0x7fa84014a110 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fa838019490 tx=0x7fa838019620 comp rx=0 tx=0).stop 2023-11-13T11:29:08.506 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:08.499+0000 7fa847b72640 1 -- 172.21.15.102:0/2176591098 shutdown_connections 2023-11-13T11:29:08.507 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:08.499+0000 7fa847b72640 1 --2- 172.21.15.102:0/2176591098 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7fa824066470 0x7fa824068930 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:08.507 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:08.499+0000 7fa847b72640 1 --2- 172.21.15.102:0/2176591098 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa84015d600 0x7fa84014a110 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:08.507 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:08.499+0000 7fa847b72640 1 --2- 172.21.15.102:0/2176591098 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa84015d220 0x7fa840149bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:08.507 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:08.499+0000 7fa847b72640 1 --2- 172.21.15.102:0/2176591098 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa8400b3f60 0x7fa84014a9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:08.508 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:08.499+0000 7fa847b72640 1 -- 172.21.15.102:0/2176591098 >> 172.21.15.102:0/2176591098 conn(0x7fa8400d2df0 msgr2=0x7fa8400afb80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-13T11:29:08.508 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:08.499+0000 7fa847b72640 1 -- 172.21.15.102:0/2176591098 shutdown_connections 2023-11-13T11:29:08.508 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:08.499+0000 7fa847b72640 1 -- 172.21.15.102:0/2176591098 wait complete. 2023-11-13T11:29:08.524 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-13T11:29:08.665 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:08.659+0000 7f485a372640 1 Processor -- start 2023-11-13T11:29:08.665 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:08.659+0000 7f485a372640 1 -- start start 2023-11-13T11:29:08.666 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:08.659+0000 7f485a372640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f4854159b30 0x7f485406fc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:08.667 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:08.659+0000 7f485a372640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f48540cf2d0 0x7f48540b3520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:08.667 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:08.659+0000 7f485a372640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f48540b21f0 con 0x7f48540711c0 2023-11-13T11:29:08.667 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:08.659+0000 7f485a372640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4854071650 con 0x7f4854159b30 2023-11-13T11:29:08.667 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:08.659+0000 7f485a372640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f48540b2440 con 0x7f48540cf2d0 2023-11-13T11:29:08.667 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:08.659+0000 7f4853fff640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f4854159b30 0x7f485406fc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:08.668 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:08.659+0000 7f4853fff640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f4854159b30 0x7f485406fc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:47684/0 (socket says 172.21.15.102:47684) 2023-11-13T11:29:08.668 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:08.659+0000 7f4853fff640 1 -- 172.21.15.102:0/897775627 learned_addr learned my addr 172.21.15.102:0/897775627 (peer_addr_for_me v2:172.21.15.102:0/0) 2023-11-13T11:29:08.668 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:08.663+0000 7f485890f640 1 --2- 172.21.15.102:0/897775627 >> v2:172.21.15.154:3300/0 conn(0x7f48540cf2d0 0x7f48540b3520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:08.668 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:08.663+0000 7f4853fff640 1 -- 172.21.15.102:0/897775627 >> v2:172.21.15.154:3300/0 conn(0x7f48540cf2d0 msgr2=0x7f48540b3520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-13T11:29:08.668 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:08.663+0000 7f4853fff640 1 --2- 172.21.15.102:0/897775627 >> v2:172.21.15.154:3300/0 conn(0x7f48540cf2d0 0x7f48540b3520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:08.669 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:08.663+0000 7f4853fff640 1 -- 172.21.15.102:0/897775627 >> v1:172.21.15.102:6789/0 conn(0x7f48540711c0 legacy=0x7f48540cebc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:08.669 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:08.663+0000 7f4853fff640 1 -- 172.21.15.102:0/897775627 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48540b2720 con 0x7f4854159b30 2023-11-13T11:29:08.669 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:08.663+0000 7f485890f640 1 --2- 172.21.15.102:0/897775627 >> v2:172.21.15.154:3300/0 conn(0x7f48540cf2d0 0x7f48540b3520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-13T11:29:08.670 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:08.663+0000 7f4853fff640 1 --2- 172.21.15.102:0/897775627 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4854159b30 0x7f485406fc80 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f48540cb6f0 tx=0x7f484401eba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a0969d0ffdeb488a server_cookie=0 in_seq=0 out_seq=0 2023-11-13T11:29:08.670 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:08.663+0000 7f4852ffd640 1 -- 172.21.15.102:0/897775627 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48440a7c70 con 0x7f4854159b30 2023-11-13T11:29:08.670 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:08.663+0000 7f4852ffd640 1 -- 172.21.15.102:0/897775627 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f48440a7dd0 con 0x7f4854159b30 2023-11-13T11:29:08.670 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:08.663+0000 7f4852ffd640 1 -- 172.21.15.102:0/897775627 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48440af660 con 0x7f4854159b30 2023-11-13T11:29:08.671 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:08.663+0000 7f485a372640 1 -- 172.21.15.102:0/897775627 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4854159b30 msgr2=0x7f485406fc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:08.671 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:08.663+0000 7f485a372640 1 --2- 172.21.15.102:0/897775627 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4854159b30 0x7f485406fc80 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f48540cb6f0 tx=0x7f484401eba0 comp rx=0 tx=0).stop 2023-11-13T11:29:08.672 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:08.667+0000 7f485a372640 1 -- 172.21.15.102:0/897775627 shutdown_connections 2023-11-13T11:29:08.672 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:08.667+0000 7f485a372640 1 --2- 172.21.15.102:0/897775627 >> v2:172.21.15.154:3300/0 conn(0x7f48540cf2d0 0x7f48540b3520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:08.672 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:08.667+0000 7f485a372640 1 --2- 172.21.15.102:0/897775627 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4854159b30 0x7f485406fc80 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:08.672 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:08.667+0000 7f485a372640 1 -- 172.21.15.102:0/897775627 >> 172.21.15.102:0/897775627 conn(0x7f485406a410 msgr2=0x7f485406a820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-13T11:29:08.672 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:08.667+0000 7f485a372640 1 -- 172.21.15.102:0/897775627 shutdown_connections 2023-11-13T11:29:08.673 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:08.667+0000 7f485a372640 1 -- 172.21.15.102:0/897775627 wait complete. 2023-11-13T11:29:08.675 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:08.667+0000 7f485a372640 1 Processor -- start 2023-11-13T11:29:08.675 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:08.667+0000 7f485a372640 1 -- start start 2023-11-13T11:29:08.676 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:08.667+0000 7f485a372640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f48540711c0 0x7f485414d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:08.676 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:08.667+0000 7f485a372640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f48540cf2d0 0x7f485414c8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:08.676 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:08.667+0000 7f485a372640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4854159b30 0x7f48540af050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:08.676 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:08.667+0000 7f485a372640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f485414f9d0 con 0x7f48540cf2d0 2023-11-13T11:29:08.676 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:08.667+0000 7f485a372640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48541534b0 con 0x7f4854159b30 2023-11-13T11:29:08.677 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:08.667+0000 7f485a372640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4854153750 con 0x7f48540711c0 2023-11-13T11:29:08.677 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:08.667+0000 7f48537fe640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f48540cf2d0 0x7f485414c8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:08.677 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:08.667+0000 7f48537fe640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f48540cf2d0 0x7f485414c8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:47690/0 (socket says 172.21.15.102:47690) 2023-11-13T11:29:08.677 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:08.667+0000 7f48537fe640 1 -- 172.21.15.102:0/2319284150 learned_addr learned my addr 172.21.15.102:0/2319284150 (peer_addr_for_me v2:172.21.15.102:0/0) 2023-11-13T11:29:08.677 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:08.667+0000 7f485890f640 1 --2- 172.21.15.102:0/2319284150 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4854159b30 0x7f48540af050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:08.678 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:08.667+0000 7f4853fff640 1 --2- 172.21.15.102:0/2319284150 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f48540711c0 0x7f485414d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:08.678 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:08.667+0000 7f48537fe640 1 -- 172.21.15.102:0/2319284150 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f48540711c0 msgr2=0x7f485414d0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:08.678 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:08.667+0000 7f48537fe640 1 --2- 172.21.15.102:0/2319284150 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f48540711c0 0x7f485414d0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:08.678 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:08.667+0000 7f48537fe640 1 -- 172.21.15.102:0/2319284150 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4854159b30 msgr2=0x7f48540af050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:08.679 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:08.667+0000 7f48537fe640 1 --2- 172.21.15.102:0/2319284150 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4854159b30 0x7f48540af050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:08.679 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:08.667+0000 7f48537fe640 1 -- 172.21.15.102:0/2319284150 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f484400b770 con 0x7f48540cf2d0 2023-11-13T11:29:08.679 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:08.667+0000 7f485890f640 1 --2- 172.21.15.102:0/2319284150 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4854159b30 0x7f48540af050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-13T11:29:08.679 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:08.667+0000 7f4853fff640 1 --2- 172.21.15.102:0/2319284150 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f48540711c0 0x7f485414d0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-13T11:29:08.679 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:08.667+0000 7f48537fe640 1 --2- 172.21.15.102:0/2319284150 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f48540cf2d0 0x7f485414c8a0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f484800c500 tx=0x7f484800c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-13T11:29:08.679 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:08.671+0000 7f4850ff9640 1 -- 172.21.15.102:0/2319284150 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4848005220 con 0x7f48540cf2d0 2023-11-13T11:29:08.680 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:08.671+0000 7f4850ff9640 1 -- 172.21.15.102:0/2319284150 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4848005380 con 0x7f48540cf2d0 2023-11-13T11:29:08.680 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:08.671+0000 7f4850ff9640 1 -- 172.21.15.102:0/2319284150 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4848007270 con 0x7f48540cf2d0 2023-11-13T11:29:08.680 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:08.671+0000 7f485a372640 1 -- 172.21.15.102:0/2319284150 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4854153a30 con 0x7f48540cf2d0 2023-11-13T11:29:08.680 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:08.671+0000 7f485a372640 1 -- 172.21.15.102:0/2319284150 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4854153ff0 con 0x7f48540cf2d0 2023-11-13T11:29:08.680 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:08.671+0000 7f485a372640 1 -- 172.21.15.102:0/2319284150 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4854154210 con 0x7f48540cf2d0 2023-11-13T11:29:08.681 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:08.671+0000 7f4850ff9640 1 -- 172.21.15.102:0/2319284150 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f48480073d0 con 0x7f48540cf2d0 2023-11-13T11:29:08.682 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:08.671+0000 7f4850ff9640 1 --2- 172.21.15.102:0/2319284150 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f4840066470 0x7f4840068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:08.682 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:08.671+0000 7f4850ff9640 1 -- 172.21.15.102:0/2319284150 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f4848083800 con 0x7f48540cf2d0 2023-11-13T11:29:08.682 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:08.671+0000 7f4853fff640 1 --2- 172.21.15.102:0/2319284150 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f4840066470 0x7f4840068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:08.682 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:08.671+0000 7f4853fff640 1 --2- 172.21.15.102:0/2319284150 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f4840066470 0x7f4840068930 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f48440b1000 tx=0x7f4844008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-13T11:29:08.682 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:08.675+0000 7f4850ff9640 1 -- 172.21.15.102:0/2319284150 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f4848050bf0 con 0x7f48540cf2d0 2023-11-13T11:29:08.831 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:08.827+0000 7f485a372640 1 -- 172.21.15.102:0/2319284150 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f4854067640 con 0x7f48540cf2d0 2023-11-13T11:29:08.832 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:08.827+0000 7f4850ff9640 1 -- 172.21.15.102:0/2319284150 <== mon.0 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v22) v1 ==== 100+0+11 (secure 0 0 0) 0x7f4848054210 con 0x7f48540cf2d0 2023-11-13T11:29:08.832 INFO:teuthology.orchestra.run.smithi102.stdout:pg_num: 64 2023-11-13T11:29:08.833 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:08.827+0000 7f485a372640 1 -- 172.21.15.102:0/2319284150 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f4840066470 msgr2=0x7f4840068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:08.834 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:08.827+0000 7f485a372640 1 --2- 172.21.15.102:0/2319284150 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f4840066470 0x7f4840068930 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f48440b1000 tx=0x7f4844008040 comp rx=0 tx=0).stop 2023-11-13T11:29:08.834 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:08.827+0000 7f485a372640 1 -- 172.21.15.102:0/2319284150 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f48540cf2d0 msgr2=0x7f485414c8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:08.834 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:08.827+0000 7f485a372640 1 --2- 172.21.15.102:0/2319284150 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f48540cf2d0 0x7f485414c8a0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f484800c500 tx=0x7f484800c9c0 comp rx=0 tx=0).stop 2023-11-13T11:29:08.834 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:08.827+0000 7f485a372640 1 -- 172.21.15.102:0/2319284150 shutdown_connections 2023-11-13T11:29:08.835 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:08.827+0000 7f485a372640 1 --2- 172.21.15.102:0/2319284150 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4854159b30 0x7f48540af050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:08.835 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:08.827+0000 7f485a372640 1 --2- 172.21.15.102:0/2319284150 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f4840066470 0x7f4840068930 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:08.835 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:08.827+0000 7f485a372640 1 --2- 172.21.15.102:0/2319284150 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f48540cf2d0 0x7f485414c8a0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:08.835 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:08.827+0000 7f485a372640 1 --2- 172.21.15.102:0/2319284150 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f48540711c0 0x7f485414d0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:08.835 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:08.827+0000 7f485a372640 1 -- 172.21.15.102:0/2319284150 >> 172.21.15.102:0/2319284150 conn(0x7f485406a410 msgr2=0x7f485406d570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-13T11:29:08.836 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:08.827+0000 7f485a372640 1 -- 172.21.15.102:0/2319284150 shutdown_connections 2023-11-13T11:29:08.836 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:08.827+0000 7f485a372640 1 -- 172.21.15.102:0/2319284150 wait complete. 2023-11-13T11:29:08.853 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-13T11:29:08.990 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:08.983+0000 7f0ce9ee3640 1 Processor -- start 2023-11-13T11:29:08.991 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:08.987+0000 7f0ce9ee3640 1 -- start start 2023-11-13T11:29:08.992 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:08.987+0000 7f0ce9ee3640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0ce4143520 0x7f0ce415b280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:08.992 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:08.987+0000 7f0ce9ee3640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f0ce406ce40 0x7f0ce406d2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:08.992 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:08.987+0000 7f0ce9ee3640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f0ce40b26f0 0x7f0ce40b2b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:08.993 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:08.987+0000 7f0ce9ee3640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0ce406d7e0 con 0x7f0ce406ce40 2023-11-13T11:29:08.993 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:08.987+0000 7f0ce9ee3640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0ce40b3460 con 0x7f0ce40b26f0 2023-11-13T11:29:08.993 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:08.987+0000 7f0ce9ee3640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ce4143900 con 0x7f0ce4143520 2023-11-13T11:29:08.994 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:08.987+0000 7f0cdbfff640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f0ce406ce40 0x7f0ce406d2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:08.994 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:08.987+0000 7f0cdbfff640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f0ce406ce40 0x7f0ce406d2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:47692/0 (socket says 172.21.15.102:47692) 2023-11-13T11:29:08.994 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:08.987+0000 7f0cdbfff640 1 -- 172.21.15.102:0/2225341610 learned_addr learned my addr 172.21.15.102:0/2225341610 (peer_addr_for_me v2:172.21.15.102:0/0) 2023-11-13T11:29:08.998 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:08.987+0000 7f0ce3fff640 1 --2- 172.21.15.102:0/2225341610 >> v2:172.21.15.154:3300/0 conn(0x7f0ce40b26f0 0x7f0ce40b2b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:08.998 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:08.987+0000 7f0ce37fe640 1 --2- 172.21.15.102:0/2225341610 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0ce4143520 0x7f0ce415b280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:08.999 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:08.987+0000 7f0cdbfff640 1 -- 172.21.15.102:0/2225341610 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0ce4143520 msgr2=0x7f0ce415b280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-13T11:29:08.999 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:08.987+0000 7f0cdbfff640 1 --2- 172.21.15.102:0/2225341610 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0ce4143520 0x7f0ce415b280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:09.000 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:08.987+0000 7f0cdbfff640 1 -- 172.21.15.102:0/2225341610 >> v2:172.21.15.154:3300/0 conn(0x7f0ce40b26f0 msgr2=0x7f0ce40b2b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-13T11:29:09.000 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:08.987+0000 7f0cdbfff640 1 --2- 172.21.15.102:0/2225341610 >> v2:172.21.15.154:3300/0 conn(0x7f0ce40b26f0 0x7f0ce40b2b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:09.000 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:08.987+0000 7f0cdbfff640 1 -- 172.21.15.102:0/2225341610 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ce415b7c0 con 0x7f0ce406ce40 2023-11-13T11:29:09.001 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:08.991+0000 7f0cdbfff640 1 --2- 172.21.15.102:0/2225341610 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0ce406ce40 0x7f0ce406d2a0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f0ce40b2100 tx=0x7f0ccc01c440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=307d87e540d46de1 server_cookie=0 in_seq=0 out_seq=0 2023-11-13T11:29:09.001 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:08.991+0000 7f0ce2ffd640 1 -- 172.21.15.102:0/2225341610 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ccc0ab600 con 0x7f0ce406ce40 2023-11-13T11:29:09.001 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:08.991+0000 7f0ce2ffd640 1 -- 172.21.15.102:0/2225341610 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ccc0ab760 con 0x7f0ce406ce40 2023-11-13T11:29:09.002 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:08.991+0000 7f0ce2ffd640 1 -- 172.21.15.102:0/2225341610 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ccc0abaf0 con 0x7f0ce406ce40 2023-11-13T11:29:09.002 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:08.991+0000 7f0ce9ee3640 1 -- 172.21.15.102:0/2225341610 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0ce406ce40 msgr2=0x7f0ce406d2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:09.002 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:08.991+0000 7f0ce9ee3640 1 --2- 172.21.15.102:0/2225341610 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0ce406ce40 0x7f0ce406d2a0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f0ce40b2100 tx=0x7f0ccc01c440 comp rx=0 tx=0).stop 2023-11-13T11:29:09.003 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:08.991+0000 7f0ce9ee3640 1 -- 172.21.15.102:0/2225341610 shutdown_connections 2023-11-13T11:29:09.003 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:08.991+0000 7f0ce9ee3640 1 --2- 172.21.15.102:0/2225341610 >> v2:172.21.15.154:3300/0 conn(0x7f0ce40b26f0 0x7f0ce40b2b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:09.003 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:08.991+0000 7f0ce9ee3640 1 --2- 172.21.15.102:0/2225341610 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0ce406ce40 0x7f0ce406d2a0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:09.004 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:08.991+0000 7f0ce9ee3640 1 --2- 172.21.15.102:0/2225341610 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0ce4143520 0x7f0ce415b280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:09.004 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:08.991+0000 7f0ce9ee3640 1 -- 172.21.15.102:0/2225341610 >> 172.21.15.102:0/2225341610 conn(0x7f0ce406a240 msgr2=0x7f0ce406a650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-13T11:29:09.004 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:08.991+0000 7f0ce9ee3640 1 -- 172.21.15.102:0/2225341610 shutdown_connections 2023-11-13T11:29:09.005 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:08.991+0000 7f0ce9ee3640 1 -- 172.21.15.102:0/2225341610 wait complete. 2023-11-13T11:29:09.005 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:08.991+0000 7f0ce9ee3640 1 Processor -- start 2023-11-13T11:29:09.006 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:08.991+0000 7f0ce9ee3640 1 -- start start 2023-11-13T11:29:09.010 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:08.995+0000 7f0ce9ee3640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0ce406ce40 0x7f0ce41537b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:09.010 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:08.995+0000 7f0ce9ee3640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0ce40b26f0 0x7f0ce413f5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:09.011 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:08.995+0000 7f0ce9ee3640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0ce4143520 0x7f0ce4136a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:09.011 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:08.995+0000 7f0ce9ee3640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ce40afca0 con 0x7f0ce406ce40 2023-11-13T11:29:09.011 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:08.995+0000 7f0ce9ee3640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ce4140400 con 0x7f0ce4143520 2023-11-13T11:29:09.012 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:08.995+0000 7f0ce9ee3640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ce40af6e0 con 0x7f0ce40b26f0 2023-11-13T11:29:09.012 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:08.995+0000 7f0ce37fe640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0ce406ce40 0x7f0ce41537b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:09.013 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:08.995+0000 7f0ce37fe640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0ce406ce40 0x7f0ce41537b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:47706/0 (socket says 172.21.15.102:47706) 2023-11-13T11:29:09.013 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:08.995+0000 7f0ce37fe640 1 -- 172.21.15.102:0/3520991567 learned_addr learned my addr 172.21.15.102:0/3520991567 (peer_addr_for_me v2:172.21.15.102:0/0) 2023-11-13T11:29:09.013 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:08.995+0000 7f0ce3fff640 1 --2- 172.21.15.102:0/3520991567 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0ce4143520 0x7f0ce4136a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:09.014 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:08.995+0000 7f0cdbfff640 1 --2- 172.21.15.102:0/3520991567 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0ce40b26f0 0x7f0ce413f5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:09.014 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:08.995+0000 7f0ce37fe640 1 -- 172.21.15.102:0/3520991567 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0ce40b26f0 msgr2=0x7f0ce413f5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:09.014 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:08.995+0000 7f0ce37fe640 1 --2- 172.21.15.102:0/3520991567 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0ce40b26f0 0x7f0ce413f5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:09.015 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:08.995+0000 7f0ce37fe640 1 -- 172.21.15.102:0/3520991567 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0ce4143520 msgr2=0x7f0ce4136a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:09.015 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:08.995+0000 7f0ce37fe640 1 --2- 172.21.15.102:0/3520991567 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0ce4143520 0x7f0ce4136a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:09.016 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:08.995+0000 7f0ce37fe640 1 -- 172.21.15.102:0/3520991567 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ccc0094d0 con 0x7f0ce406ce40 2023-11-13T11:29:09.016 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:08.995+0000 7f0ce37fe640 1 --2- 172.21.15.102:0/3520991567 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0ce406ce40 0x7f0ce41537b0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f0cd400d5f0 tx=0x7f0cd400dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-13T11:29:09.016 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:08.995+0000 7f0ce0ff9640 1 -- 172.21.15.102:0/3520991567 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cd40125f0 con 0x7f0ce406ce40 2023-11-13T11:29:09.017 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:08.995+0000 7f0ce0ff9640 1 -- 172.21.15.102:0/3520991567 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0cd4012750 con 0x7f0ce406ce40 2023-11-13T11:29:09.017 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:08.995+0000 7f0ce0ff9640 1 -- 172.21.15.102:0/3520991567 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cd4012ae0 con 0x7f0ce406ce40 2023-11-13T11:29:09.017 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:08.995+0000 7f0ce9ee3640 1 -- 172.21.15.102:0/3520991567 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0ce40af9c0 con 0x7f0ce406ce40 2023-11-13T11:29:09.018 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:08.995+0000 7f0ce9ee3640 1 -- 172.21.15.102:0/3520991567 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0ce413fb10 con 0x7f0ce406ce40 2023-11-13T11:29:09.018 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:08.995+0000 7f0ce9ee3640 1 -- 172.21.15.102:0/3520991567 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0ce4068520 con 0x7f0ce406ce40 2023-11-13T11:29:09.018 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:08.995+0000 7f0ce0ff9640 1 -- 172.21.15.102:0/3520991567 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f0cd4012c40 con 0x7f0ce406ce40 2023-11-13T11:29:09.019 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:08.999+0000 7f0ce0ff9640 1 --2- 172.21.15.102:0/3520991567 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f0cc4066470 0x7f0cc4068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:09.019 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:08.999+0000 7f0ce0ff9640 1 -- 172.21.15.102:0/3520991567 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f0cd40841d0 con 0x7f0ce406ce40 2023-11-13T11:29:09.020 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:08.999+0000 7f0cdbfff640 1 --2- 172.21.15.102:0/3520991567 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f0cc4066470 0x7f0cc4068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:09.020 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:08.999+0000 7f0cdbfff640 1 --2- 172.21.15.102:0/3520991567 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f0cc4066470 0x7f0cc4068930 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f0ccc0af000 tx=0x7f0ccc0b6040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-13T11:29:09.020 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:09.003+0000 7f0ce0ff9640 1 -- 172.21.15.102:0/3520991567 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f0cd40516f0 con 0x7f0ce406ce40 2023-11-13T11:29:09.190 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:09.183+0000 7f0ce9ee3640 1 -- 172.21.15.102:0/3520991567 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f0ce413fd30 con 0x7f0ce406ce40 2023-11-13T11:29:09.191 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:09.183+0000 7f0ce0ff9640 1 -- 172.21.15.102:0/3520991567 <== mon.0 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4913 (secure 0 0 0) 0x7f0cd4007380 con 0x7f0ce406ce40 2023-11-13T11:29:09.192 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T11:29:09.192 INFO:teuthology.orchestra.run.smithi102.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4226,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.102:6836/659983176","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6835","nonce":659983176},{"type":"v1","addr":"172.21.15.102:6836","nonce":659983176}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4270,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.102:6837/1874856825","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6834","nonce":1874856825},{"type":"v1","addr":"172.21.15.102:6837","nonce":1874856825}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4276,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6834/532911681","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6832","nonce":532911681},{"type":"v1","addr":"172.21.15.154:6834","nonce":532911681}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-13T11:28:57.401001+0000","modified":"2023-11-13T11:29:00.404631+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4279},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4279":{"gid":4279,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.154:6835/3766337294","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6833","nonce":3766337294},{"type":"v1","addr":"172.21.15.154:6835","nonce":3766337294}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-11-13T11:29:09.194 INFO:teuthology.orchestra.run.smithi102.stderr:dumped fsmap epoch 8 2023-11-13T11:29:09.194 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:09.187+0000 7f0ce9ee3640 1 -- 172.21.15.102:0/3520991567 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f0cc4066470 msgr2=0x7f0cc4068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:09.194 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:09.187+0000 7f0ce9ee3640 1 --2- 172.21.15.102:0/3520991567 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f0cc4066470 0x7f0cc4068930 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f0ccc0af000 tx=0x7f0ccc0b6040 comp rx=0 tx=0).stop 2023-11-13T11:29:09.194 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:09.187+0000 7f0ce9ee3640 1 -- 172.21.15.102:0/3520991567 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0ce406ce40 msgr2=0x7f0ce41537b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:09.195 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:09.187+0000 7f0ce9ee3640 1 --2- 172.21.15.102:0/3520991567 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0ce406ce40 0x7f0ce41537b0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f0cd400d5f0 tx=0x7f0cd400dab0 comp rx=0 tx=0).stop 2023-11-13T11:29:09.195 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:09.187+0000 7f0ce9ee3640 1 -- 172.21.15.102:0/3520991567 shutdown_connections 2023-11-13T11:29:09.195 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:09.187+0000 7f0ce9ee3640 1 --2- 172.21.15.102:0/3520991567 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0ce4143520 0x7f0ce4136a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:09.195 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:09.187+0000 7f0ce9ee3640 1 --2- 172.21.15.102:0/3520991567 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0ce40b26f0 0x7f0ce413f5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:09.195 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:09.187+0000 7f0ce9ee3640 1 --2- 172.21.15.102:0/3520991567 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f0cc4066470 0x7f0cc4068930 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:09.196 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:09.187+0000 7f0ce9ee3640 1 --2- 172.21.15.102:0/3520991567 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0ce406ce40 0x7f0ce41537b0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:09.196 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:09.187+0000 7f0ce9ee3640 1 -- 172.21.15.102:0/3520991567 >> 172.21.15.102:0/3520991567 conn(0x7f0ce406a240 msgr2=0x7f0ce406a620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-13T11:29:09.197 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:09.187+0000 7f0ce9ee3640 1 -- 172.21.15.102:0/3520991567 shutdown_connections 2023-11-13T11:29:09.197 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:09.187+0000 7f0ce9ee3640 1 -- 172.21.15.102:0/3520991567 wait complete. 2023-11-13T11:29:09.212 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-13T11:29:09.349 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:09.343+0000 7f2faae46640 1 Processor -- start 2023-11-13T11:29:09.350 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:09.343+0000 7f2faae46640 1 -- start start 2023-11-13T11:29:09.350 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:09.347+0000 7f2faae46640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2fa413df40 0x7f2fa415e990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:09.351 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:09.347+0000 7f2faae46640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f2fa406c1a0 0x7f2fa413f6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:09.351 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:09.347+0000 7f2faae46640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2fa413e530 con 0x7f2fa406dc70 2023-11-13T11:29:09.351 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:09.347+0000 7f2faae46640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2fa415f290 con 0x7f2fa406c1a0 2023-11-13T11:29:09.351 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:09.347+0000 7f2faae46640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2fa415f570 con 0x7f2fa413df40 2023-11-13T11:29:09.352 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:09.347+0000 7f2fa8be2640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2fa413df40 0x7f2fa415e990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:09.353 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:09.347+0000 7f2fa93e3640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f2fa406c1a0 0x7f2fa413f6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:09.353 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:09.347+0000 7f2fa8be2640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2fa413df40 0x7f2fa415e990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.102:50494/0 (socket says 172.21.15.102:50494) 2023-11-13T11:29:09.353 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:09.347+0000 7f2fa8be2640 1 -- 172.21.15.102:0/2273881163 learned_addr learned my addr 172.21.15.102:0/2273881163 (peer_addr_for_me v2:172.21.15.102:0/0) 2023-11-13T11:29:09.353 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:09.347+0000 7f2fa93e3640 1 -- 172.21.15.102:0/2273881163 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2fa413df40 msgr2=0x7f2fa415e990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-13T11:29:09.353 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:09.347+0000 7f2fa93e3640 1 --2- 172.21.15.102:0/2273881163 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2fa413df40 0x7f2fa415e990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:09.354 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:09.347+0000 7f2fa93e3640 1 -- 172.21.15.102:0/2273881163 >> v1:172.21.15.154:6789/0 conn(0x7f2fa406dc70 legacy=0x7f2fa406ba90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:09.354 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:09.347+0000 7f2fa93e3640 1 -- 172.21.15.102:0/2273881163 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2fa415f850 con 0x7f2fa406c1a0 2023-11-13T11:29:09.354 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:09.347+0000 7f2fa8be2640 1 --2- 172.21.15.102:0/2273881163 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2fa413df40 0x7f2fa415e990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-13T11:29:09.354 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:09.351+0000 7f2fa93e3640 1 --2- 172.21.15.102:0/2273881163 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2fa406c1a0 0x7f2fa413f6d0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f2f9c009d90 tx=0x7f2f9c01c950 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f5f5179483ed9cda server_cookie=0 in_seq=0 out_seq=0 2023-11-13T11:29:09.355 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:09.351+0000 7f2f9b7fe640 1 -- 172.21.15.102:0/2273881163 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f9c0a5900 con 0x7f2fa406c1a0 2023-11-13T11:29:09.355 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:09.351+0000 7f2f9b7fe640 1 -- 172.21.15.102:0/2273881163 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f9c0a5a60 con 0x7f2fa406c1a0 2023-11-13T11:29:09.356 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:09.351+0000 7f2f9b7fe640 1 -- 172.21.15.102:0/2273881163 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f9c0a5df0 con 0x7f2fa406c1a0 2023-11-13T11:29:09.356 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:09.351+0000 7f2faae46640 1 -- 172.21.15.102:0/2273881163 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2fa406c1a0 msgr2=0x7f2fa413f6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:09.357 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:09.351+0000 7f2faae46640 1 --2- 172.21.15.102:0/2273881163 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2fa406c1a0 0x7f2fa413f6d0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f2f9c009d90 tx=0x7f2f9c01c950 comp rx=0 tx=0).stop 2023-11-13T11:29:09.357 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:09.351+0000 7f2faae46640 1 -- 172.21.15.102:0/2273881163 shutdown_connections 2023-11-13T11:29:09.357 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:09.351+0000 7f2faae46640 1 --2- 172.21.15.102:0/2273881163 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2fa406c1a0 0x7f2fa413f6d0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:09.357 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:09.351+0000 7f2faae46640 1 --2- 172.21.15.102:0/2273881163 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2fa413df40 0x7f2fa415e990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:09.358 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:09.351+0000 7f2faae46640 1 -- 172.21.15.102:0/2273881163 >> 172.21.15.102:0/2273881163 conn(0x7f2fa40b0870 msgr2=0x7f2fa40b0c80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-13T11:29:09.358 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:09.351+0000 7f2faae46640 1 -- 172.21.15.102:0/2273881163 shutdown_connections 2023-11-13T11:29:09.358 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:09.351+0000 7f2faae46640 1 -- 172.21.15.102:0/2273881163 wait complete. 2023-11-13T11:29:09.360 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:09.351+0000 7f2faae46640 1 Processor -- start 2023-11-13T11:29:09.361 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:09.351+0000 7f2faae46640 1 -- start start 2023-11-13T11:29:09.361 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:09.355+0000 7f2faae46640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2fa406c1a0 0x7f2fa4141e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:09.361 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:09.355+0000 7f2faae46640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2fa406dc70 0x7f2fa415a260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:09.361 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:09.355+0000 7f2faae46640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2fa413df40 0x7f2fa41355c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:09.362 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:09.355+0000 7f2faae46640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2fa4136320 con 0x7f2fa406dc70 2023-11-13T11:29:09.362 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:09.355+0000 7f2faae46640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2fa40b2500 con 0x7f2fa413df40 2023-11-13T11:29:09.362 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:09.355+0000 7f2faae46640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2fa4135b00 con 0x7f2fa406c1a0 2023-11-13T11:29:09.362 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:09.355+0000 7f2f9bfff640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2fa406dc70 0x7f2fa415a260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:09.362 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:09.355+0000 7f2f9bfff640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2fa406dc70 0x7f2fa415a260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:47722/0 (socket says 172.21.15.102:47722) 2023-11-13T11:29:09.363 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:09.355+0000 7f2f9bfff640 1 -- 172.21.15.102:0/3151973506 learned_addr learned my addr 172.21.15.102:0/3151973506 (peer_addr_for_me v2:172.21.15.102:0/0) 2023-11-13T11:29:09.363 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:09.355+0000 7f2fa8be2640 1 --2- 172.21.15.102:0/3151973506 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2fa406c1a0 0x7f2fa4141e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:09.363 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:09.355+0000 7f2fa93e3640 1 --2- 172.21.15.102:0/3151973506 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2fa413df40 0x7f2fa41355c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:09.363 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:09.355+0000 7f2f9bfff640 1 -- 172.21.15.102:0/3151973506 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2fa406c1a0 msgr2=0x7f2fa4141e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:09.363 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:09.355+0000 7f2f9bfff640 1 --2- 172.21.15.102:0/3151973506 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2fa406c1a0 0x7f2fa4141e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:09.364 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:09.355+0000 7f2f9bfff640 1 -- 172.21.15.102:0/3151973506 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2fa413df40 msgr2=0x7f2fa41355c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:09.364 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:09.355+0000 7f2f9bfff640 1 --2- 172.21.15.102:0/3151973506 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2fa413df40 0x7f2fa41355c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:09.364 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:09.355+0000 7f2f9bfff640 1 -- 172.21.15.102:0/3151973506 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2fa00094d0 con 0x7f2fa406dc70 2023-11-13T11:29:09.364 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:09.355+0000 7f2f9bfff640 1 --2- 172.21.15.102:0/3151973506 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2fa406dc70 0x7f2fa415a260 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f2f9400c4d0 tx=0x7f2f9400c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-13T11:29:09.364 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:09.355+0000 7f2f997fa640 1 -- 172.21.15.102:0/3151973506 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f940052d0 con 0x7f2fa406dc70 2023-11-13T11:29:09.365 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:09.355+0000 7f2f997fa640 1 -- 172.21.15.102:0/3151973506 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f94005430 con 0x7f2fa406dc70 2023-11-13T11:29:09.365 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:09.355+0000 7f2faae46640 1 -- 172.21.15.102:0/3151973506 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2f9c009a70 con 0x7f2fa406dc70 2023-11-13T11:29:09.365 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:09.355+0000 7f2f997fa640 1 -- 172.21.15.102:0/3151973506 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f94012830 con 0x7f2fa406dc70 2023-11-13T11:29:09.365 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:09.355+0000 7f2faae46640 1 -- 172.21.15.102:0/3151973506 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2fa4136040 con 0x7f2fa406dc70 2023-11-13T11:29:09.366 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:09.355+0000 7f2faae46640 1 -- 172.21.15.102:0/3151973506 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2fa40b1ff0 con 0x7f2fa406dc70 2023-11-13T11:29:09.367 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:09.359+0000 7f2f997fa640 1 -- 172.21.15.102:0/3151973506 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f2f94012990 con 0x7f2fa406dc70 2023-11-13T11:29:09.367 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:09.359+0000 7f2f997fa640 1 --2- 172.21.15.102:0/3151973506 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f2f90066470 0x7f2f90068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:09.367 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:09.359+0000 7f2f997fa640 1 -- 172.21.15.102:0/3151973506 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f2f940837d0 con 0x7f2fa406dc70 2023-11-13T11:29:09.367 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:09.359+0000 7f2fa8be2640 1 --2- 172.21.15.102:0/3151973506 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f2f90066470 0x7f2f90068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:09.367 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:09.359+0000 7f2fa8be2640 1 --2- 172.21.15.102:0/3151973506 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f2f90066470 0x7f2f90068930 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f2fa0006cb0 tx=0x7f2fa0009240 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-13T11:29:09.368 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:09.363+0000 7f2f997fa640 1 -- 172.21.15.102:0/3151973506 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f2fa40b1ff0 con 0x7f2fa406dc70 2023-11-13T11:29:09.517 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:09.511+0000 7f2faae46640 1 -- 172.21.15.102:0/3151973506 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2fa40b1ff0 con 0x7f2fa406dc70 2023-11-13T11:29:09.518 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:09.511+0000 7f2f997fa640 1 -- 172.21.15.102:0/3151973506 <== mon.0 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+16545 (secure 0 0 0) 0x7f2fa40b1ff0 con 0x7f2fa406dc70 2023-11-13T11:29:09.519 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T11:29:09.519 INFO:teuthology.orchestra.run.smithi102.stdout:{"epoch":22,"fsid":"97b3eb2b-7ccf-4aae-8d92-bff986c671ea","created":"2023-11-13T11:28:31.836724+0000","modified":"2023-11-13T11:28:58.608314+0000","last_up_change":"2023-11-13T11:28:44.876638+0000","last_in_change":"2023-11-13T11:28:35.312740+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-13T11:28:44.981356+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-13T11:28:55.958525+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-13T11:28:56.394264+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"bdefaa17-fcca-4c86-aa40-27dc33a789af","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6800","nonce":53303834},{"type":"v1","addr":"172.21.15.102:6801","nonce":53303834}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6802","nonce":53303834},{"type":"v1","addr":"172.21.15.102:6803","nonce":53303834}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6806","nonce":53303834},{"type":"v1","addr":"172.21.15.102:6807","nonce":53303834}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6804","nonce":53303834},{"type":"v1","addr":"172.21.15.102:6805","nonce":53303834}]},"public_addr":"172.21.15.102:6801/53303834","cluster_addr":"172.21.15.102:6803/53303834","heartbeat_back_addr":"172.21.15.102:6807/53303834","heartbeat_front_addr":"172.21.15.102:6805/53303834","state":["exists","up"]},{"osd":1,"uuid":"f0033196-dec9-4ae9-945e-6aeef6dbb47f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6808","nonce":1732708348},{"type":"v1","addr":"172.21.15.102:6809","nonce":1732708348}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6811","nonce":1732708348},{"type":"v1","addr":"172.21.15.102:6813","nonce":1732708348}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6818","nonce":1732708348},{"type":"v1","addr":"172.21.15.102:6820","nonce":1732708348}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6815","nonce":1732708348},{"type":"v1","addr":"172.21.15.102:6817","nonce":1732708348}]},"public_addr":"172.21.15.102:6809/1732708348","cluster_addr":"172.21.15.102:6813/1732708348","heartbeat_back_addr":"172.21.15.102:6820/1732708348","heartbeat_front_addr":"172.21.15.102:6817/1732708348","state":["exists","up"]},{"osd":2,"uuid":"496b0834-351e-4ec2-a714-86ed0c0ff4fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6810","nonce":1825475150},{"type":"v1","addr":"172.21.15.102:6812","nonce":1825475150}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6814","nonce":1825475150},{"type":"v1","addr":"172.21.15.102:6816","nonce":1825475150}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6822","nonce":1825475150},{"type":"v1","addr":"172.21.15.102:6823","nonce":1825475150}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6819","nonce":1825475150},{"type":"v1","addr":"172.21.15.102:6821","nonce":1825475150}]},"public_addr":"172.21.15.102:6812/1825475150","cluster_addr":"172.21.15.102:6816/1825475150","heartbeat_back_addr":"172.21.15.102:6823/1825475150","heartbeat_front_addr":"172.21.15.102:6821/1825475150","state":["exists","up"]},{"osd":3,"uuid":"3ba6cc41-e0a0-4273-86cb-90000c06a55a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6824","nonce":4149355528},{"type":"v1","addr":"172.21.15.102:6825","nonce":4149355528}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6826","nonce":4149355528},{"type":"v1","addr":"172.21.15.102:6827","nonce":4149355528}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6830","nonce":4149355528},{"type":"v1","addr":"172.21.15.102:6831","nonce":4149355528}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6828","nonce":4149355528},{"type":"v1","addr":"172.21.15.102:6829","nonce":4149355528}]},"public_addr":"172.21.15.102:6825/4149355528","cluster_addr":"172.21.15.102:6827/4149355528","heartbeat_back_addr":"172.21.15.102:6831/4149355528","heartbeat_front_addr":"172.21.15.102:6829/4149355528","state":["exists","up"]},{"osd":4,"uuid":"16e797d8-e6e7-4140-95c3-b85283c42a2a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6808","nonce":4028899241},{"type":"v1","addr":"172.21.15.154:6809","nonce":4028899241}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6810","nonce":4028899241},{"type":"v1","addr":"172.21.15.154:6811","nonce":4028899241}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6814","nonce":4028899241},{"type":"v1","addr":"172.21.15.154:6815","nonce":4028899241}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6812","nonce":4028899241},{"type":"v1","addr":"172.21.15.154:6813","nonce":4028899241}]},"public_addr":"172.21.15.154:6809/4028899241","cluster_addr":"172.21.15.154:6811/4028899241","heartbeat_back_addr":"172.21.15.154:6815/4028899241","heartbeat_front_addr":"172.21.15.154:6813/4028899241","state":["exists","up"]},{"osd":5,"uuid":"d6ab225c-1b55-450a-89a9-abe5c3f8d6af","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":3562396827},{"type":"v1","addr":"172.21.15.154:6801","nonce":3562396827}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":3562396827},{"type":"v1","addr":"172.21.15.154:6803","nonce":3562396827}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6806","nonce":3562396827},{"type":"v1","addr":"172.21.15.154:6807","nonce":3562396827}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6804","nonce":3562396827},{"type":"v1","addr":"172.21.15.154:6805","nonce":3562396827}]},"public_addr":"172.21.15.154:6801/3562396827","cluster_addr":"172.21.15.154:6803/3562396827","heartbeat_back_addr":"172.21.15.154:6807/3562396827","heartbeat_front_addr":"172.21.15.154:6805/3562396827","state":["exists","up"]},{"osd":6,"uuid":"96f905ac-491c-4662-8e2b-5bb8e929ab9d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6816","nonce":2933728751},{"type":"v1","addr":"172.21.15.154:6817","nonce":2933728751}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6818","nonce":2933728751},{"type":"v1","addr":"172.21.15.154:6819","nonce":2933728751}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6822","nonce":2933728751},{"type":"v1","addr":"172.21.15.154:6823","nonce":2933728751}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6820","nonce":2933728751},{"type":"v1","addr":"172.21.15.154:6821","nonce":2933728751}]},"public_addr":"172.21.15.154:6817/2933728751","cluster_addr":"172.21.15.154:6819/2933728751","heartbeat_back_addr":"172.21.15.154:6823/2933728751","heartbeat_front_addr":"172.21.15.154:6821/2933728751","state":["exists","up"]},{"osd":7,"uuid":"07012d3b-3ab4-40df-a471-93caed22e2dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6824","nonce":1753500785},{"type":"v1","addr":"172.21.15.154:6825","nonce":1753500785}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6826","nonce":1753500785},{"type":"v1","addr":"172.21.15.154:6827","nonce":1753500785}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6830","nonce":1753500785},{"type":"v1","addr":"172.21.15.154:6831","nonce":1753500785}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6828","nonce":1753500785},{"type":"v1","addr":"172.21.15.154:6829","nonce":1753500785}]},"public_addr":"172.21.15.154:6825/1753500785","cluster_addr":"172.21.15.154:6827/1753500785","heartbeat_back_addr":"172.21.15.154:6831/1753500785","heartbeat_front_addr":"172.21.15.154:6829/1753500785","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-13T11:28:40.978603+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-13T11:28:41.200985+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-13T11:28:41.222815+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-13T11:28:41.202162+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-13T11:28:40.925911+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-13T11:28:41.087725+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-13T11:28:41.072208+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-13T11:28:40.875257+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-13T11:29:09.521 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:09.515+0000 7f2faae46640 1 -- 172.21.15.102:0/3151973506 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f2f90066470 msgr2=0x7f2f90068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:09.521 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:09.515+0000 7f2faae46640 1 --2- 172.21.15.102:0/3151973506 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f2f90066470 0x7f2f90068930 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f2fa0006cb0 tx=0x7f2fa0009240 comp rx=0 tx=0).stop 2023-11-13T11:29:09.521 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:09.515+0000 7f2faae46640 1 -- 172.21.15.102:0/3151973506 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2fa406dc70 msgr2=0x7f2fa415a260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:09.522 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:09.515+0000 7f2faae46640 1 --2- 172.21.15.102:0/3151973506 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2fa406dc70 0x7f2fa415a260 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f2f9400c4d0 tx=0x7f2f9400c990 comp rx=0 tx=0).stop 2023-11-13T11:29:09.522 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:09.515+0000 7f2faae46640 1 -- 172.21.15.102:0/3151973506 shutdown_connections 2023-11-13T11:29:09.522 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:09.515+0000 7f2faae46640 1 --2- 172.21.15.102:0/3151973506 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2fa413df40 0x7f2fa41355c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:09.522 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:09.515+0000 7f2faae46640 1 --2- 172.21.15.102:0/3151973506 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f2f90066470 0x7f2f90068930 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:09.523 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:09.515+0000 7f2faae46640 1 --2- 172.21.15.102:0/3151973506 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2fa406dc70 0x7f2fa415a260 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:09.523 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:09.515+0000 7f2faae46640 1 --2- 172.21.15.102:0/3151973506 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2fa406c1a0 0x7f2fa4141e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:09.523 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:09.515+0000 7f2faae46640 1 -- 172.21.15.102:0/3151973506 >> 172.21.15.102:0/3151973506 conn(0x7f2fa40b0870 msgr2=0x7f2fa415e6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-13T11:29:09.523 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:09.515+0000 7f2faae46640 1 -- 172.21.15.102:0/3151973506 shutdown_connections 2023-11-13T11:29:09.523 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:09.515+0000 7f2faae46640 1 -- 172.21.15.102:0/3151973506 wait complete. 2023-11-13T11:29:09.540 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-13T11:28:44.981356+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-13T11:28:55.958525+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-11-13T11:28:56.394264+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-13T11:29:09.541 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-13T11:29:09.683 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:09.679+0000 7fab28357640 1 Processor -- start 2023-11-13T11:29:09.683 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:09.679+0000 7fab28357640 1 -- start start 2023-11-13T11:29:09.684 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:09.679+0000 7fab28357640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fab200cf2d0 0x7fab2006fc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:09.684 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:09.679+0000 7fab28357640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fab200b21f0 con 0x7fab200711c0 2023-11-13T11:29:09.685 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:09.679+0000 7fab28357640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fab200b2440 con 0x7fab20159b30 2023-11-13T11:29:09.685 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:09.679+0000 7fab28357640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fab20071670 con 0x7fab200cf2d0 2023-11-13T11:29:09.685 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:09.679+0000 7fab268f4640 1 --1- >> v1:172.21.15.102:6789/0 conn(0x7fab200711c0 0x7fab200cbe90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.102:6789/0 says I am v1:172.21.15.102:49652/0 (socket says 172.21.15.102:49652) 2023-11-13T11:29:09.685 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:09.679+0000 7fab268f4640 1 -- 172.21.15.102:0/1384712711 learned_addr learned my addr 172.21.15.102:0/1384712711 (peer_addr_for_me v1:172.21.15.102:0/0) 2023-11-13T11:29:09.685 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:09.679+0000 7fab258f2640 1 --2- 172.21.15.102:0/1384712711 >> v2:172.21.15.154:3300/0 conn(0x7fab200cf2d0 0x7fab2006fc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:09.686 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:09.679+0000 7fab250f1640 1 -- 172.21.15.102:0/1384712711 <== mon.0 v1:172.21.15.102:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3588333609 0 0) 0x7fab200b21f0 con 0x7fab200711c0 2023-11-13T11:29:09.687 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:09.679+0000 7fab250f1640 1 -- 172.21.15.102:0/1384712711 --> v1:172.21.15.102:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fab0c003530 con 0x7fab200711c0 2023-11-13T11:29:09.687 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:09.679+0000 7fab250f1640 1 -- 172.21.15.102:0/1384712711 <== mon.1 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3536756619 0 0) 0x7fab200b2440 con 0x7fab20159b30 2023-11-13T11:29:09.687 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:09.679+0000 7fab250f1640 1 -- 172.21.15.102:0/1384712711 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fab200b21f0 con 0x7fab20159b30 2023-11-13T11:29:09.687 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:09.679+0000 7fab258f2640 1 -- 172.21.15.102:0/1384712711 >> v1:172.21.15.154:6789/0 conn(0x7fab20159b30 legacy=0x7fab200cebc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:09.687 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:09.679+0000 7fab258f2640 1 -- 172.21.15.102:0/1384712711 >> v1:172.21.15.102:6789/0 conn(0x7fab200711c0 legacy=0x7fab200cbe90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:09.688 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:09.679+0000 7fab258f2640 1 -- 172.21.15.102:0/1384712711 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab200b2720 con 0x7fab200cf2d0 2023-11-13T11:29:09.689 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:09.683+0000 7fab258f2640 1 --2- 172.21.15.102:0/1384712711 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fab200cf2d0 0x7fab2006fc80 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fab100097c0 tx=0x7fab1001c450 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c3159b87f2d8a443 server_cookie=0 in_seq=0 out_seq=0 2023-11-13T11:29:09.689 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:09.683+0000 7fab250f1640 1 -- 172.21.15.102:0/1384712711 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab100ac640 con 0x7fab200cf2d0 2023-11-13T11:29:09.689 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:09.683+0000 7fab250f1640 1 -- 172.21.15.102:0/1384712711 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab100ac7a0 con 0x7fab200cf2d0 2023-11-13T11:29:09.689 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:09.683+0000 7fab250f1640 1 -- 172.21.15.102:0/1384712711 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab100acb30 con 0x7fab200cf2d0 2023-11-13T11:29:09.690 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:09.683+0000 7fab28357640 1 -- 172.21.15.102:0/1384712711 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fab200cf2d0 msgr2=0x7fab2006fc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:09.690 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:09.683+0000 7fab28357640 1 --2- 172.21.15.102:0/1384712711 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fab200cf2d0 0x7fab2006fc80 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fab100097c0 tx=0x7fab1001c450 comp rx=0 tx=0).stop 2023-11-13T11:29:09.690 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:09.683+0000 7fab28357640 1 -- 172.21.15.102:0/1384712711 shutdown_connections 2023-11-13T11:29:09.690 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:09.683+0000 7fab28357640 1 --2- 172.21.15.102:0/1384712711 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fab200cf2d0 0x7fab2006fc80 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:09.691 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:09.683+0000 7fab28357640 1 -- 172.21.15.102:0/1384712711 >> 172.21.15.102:0/1384712711 conn(0x7fab2006a410 msgr2=0x7fab2006a820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-13T11:29:09.691 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:09.683+0000 7fab28357640 1 -- 172.21.15.102:0/1384712711 shutdown_connections 2023-11-13T11:29:09.691 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:09.683+0000 7fab28357640 1 -- 172.21.15.102:0/1384712711 wait complete. 2023-11-13T11:29:09.693 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:09.687+0000 7fab28357640 1 Processor -- start 2023-11-13T11:29:09.693 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:09.687+0000 7fab28357640 1 -- start start 2023-11-13T11:29:09.693 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:09.687+0000 7fab28357640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fab200711c0 0x7fab2015b1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:09.694 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:09.687+0000 7fab28357640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fab200cf2d0 0x7fab201504e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:09.694 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:09.687+0000 7fab28357640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fab20159b30 0x7fab2014b1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:09.694 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:09.687+0000 7fab28357640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab2014dc20 con 0x7fab200711c0 2023-11-13T11:29:09.694 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:09.687+0000 7fab28357640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab2014cfa0 con 0x7fab20159b30 2023-11-13T11:29:09.694 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:09.687+0000 7fab28357640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab2014d280 con 0x7fab200cf2d0 2023-11-13T11:29:09.695 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:09.687+0000 7fab260f3640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fab200711c0 0x7fab2015b1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:09.695 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:09.687+0000 7fab260f3640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fab200711c0 0x7fab2015b1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:47726/0 (socket says 172.21.15.102:47726) 2023-11-13T11:29:09.695 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:09.687+0000 7fab260f3640 1 -- 172.21.15.102:0/3455475135 learned_addr learned my addr 172.21.15.102:0/3455475135 (peer_addr_for_me v2:172.21.15.102:0/0) 2023-11-13T11:29:09.695 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:09.687+0000 7fab258f2640 1 --2- 172.21.15.102:0/3455475135 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fab200cf2d0 0x7fab201504e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:09.695 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:09.687+0000 7fab268f4640 1 --2- 172.21.15.102:0/3455475135 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fab20159b30 0x7fab2014b1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:09.696 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:09.687+0000 7fab260f3640 1 -- 172.21.15.102:0/3455475135 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fab200cf2d0 msgr2=0x7fab201504e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:09.696 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:09.687+0000 7fab260f3640 1 --2- 172.21.15.102:0/3455475135 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fab200cf2d0 0x7fab201504e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:09.696 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:09.687+0000 7fab260f3640 1 -- 172.21.15.102:0/3455475135 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fab20159b30 msgr2=0x7fab2014b1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:09.696 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:09.687+0000 7fab260f3640 1 --2- 172.21.15.102:0/3455475135 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fab20159b30 0x7fab2014b1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:09.696 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:09.687+0000 7fab260f3640 1 -- 172.21.15.102:0/3455475135 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab10009420 con 0x7fab200711c0 2023-11-13T11:29:09.697 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:09.687+0000 7fab260f3640 1 --2- 172.21.15.102:0/3455475135 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fab200711c0 0x7fab2015b1b0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fab1c00c430 tx=0x7fab1c00c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-13T11:29:09.697 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:09.687+0000 7fab16ffd640 1 -- 172.21.15.102:0/3455475135 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab1c0052d0 con 0x7fab200711c0 2023-11-13T11:29:09.697 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:09.687+0000 7fab16ffd640 1 -- 172.21.15.102:0/3455475135 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab1c005450 con 0x7fab200711c0 2023-11-13T11:29:09.697 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:09.687+0000 7fab28357640 1 -- 172.21.15.102:0/3455475135 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fab2014d560 con 0x7fab200711c0 2023-11-13T11:29:09.697 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:09.687+0000 7fab16ffd640 1 -- 172.21.15.102:0/3455475135 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab1c003840 con 0x7fab200711c0 2023-11-13T11:29:09.698 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:09.687+0000 7fab28357640 1 -- 172.21.15.102:0/3455475135 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fab2015b6f0 con 0x7fab200711c0 2023-11-13T11:29:09.699 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:09.687+0000 7fab28357640 1 -- 172.21.15.102:0/3455475135 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fab20067640 con 0x7fab200711c0 2023-11-13T11:29:09.699 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:09.691+0000 7fab16ffd640 1 -- 172.21.15.102:0/3455475135 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fab1c0039a0 con 0x7fab200711c0 2023-11-13T11:29:09.699 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:09.691+0000 7fab16ffd640 1 --2- 172.21.15.102:0/3455475135 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7fab04066470 0x7fab04068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:09.699 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:09.691+0000 7fab16ffd640 1 -- 172.21.15.102:0/3455475135 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fab1c083420 con 0x7fab200711c0 2023-11-13T11:29:09.699 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:09.691+0000 7fab258f2640 1 --2- 172.21.15.102:0/3455475135 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7fab04066470 0x7fab04068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:09.700 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:09.691+0000 7fab258f2640 1 --2- 172.21.15.102:0/3455475135 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7fab04066470 0x7fab04068930 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fab100ae000 tx=0x7fab10008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-13T11:29:09.700 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:09.695+0000 7fab16ffd640 1 -- 172.21.15.102:0/3455475135 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fab1c050940 con 0x7fab200711c0 2023-11-13T11:29:09.850 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:09.843+0000 7fab28357640 1 -- 172.21.15.102:0/3455475135 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fab201592c0 con 0x7fab200711c0 2023-11-13T11:29:09.851 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:09.847+0000 7fab16ffd640 1 -- 172.21.15.102:0/3455475135 <== mon.0 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v22) v1 ==== 93+0+10 (secure 0 0 0) 0x7fab1c053f60 con 0x7fab200711c0 2023-11-13T11:29:09.851 INFO:teuthology.orchestra.run.smithi102.stdout:pg_num: 1 2023-11-13T11:29:09.853 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:09.847+0000 7fab28357640 1 -- 172.21.15.102:0/3455475135 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7fab04066470 msgr2=0x7fab04068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:09.853 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:09.847+0000 7fab28357640 1 --2- 172.21.15.102:0/3455475135 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7fab04066470 0x7fab04068930 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fab100ae000 tx=0x7fab10008040 comp rx=0 tx=0).stop 2023-11-13T11:29:09.853 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:09.847+0000 7fab28357640 1 -- 172.21.15.102:0/3455475135 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fab200711c0 msgr2=0x7fab2015b1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:09.853 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:09.847+0000 7fab28357640 1 --2- 172.21.15.102:0/3455475135 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fab200711c0 0x7fab2015b1b0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fab1c00c430 tx=0x7fab1c00c8f0 comp rx=0 tx=0).stop 2023-11-13T11:29:09.853 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:09.847+0000 7fab28357640 1 -- 172.21.15.102:0/3455475135 shutdown_connections 2023-11-13T11:29:09.854 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:09.847+0000 7fab28357640 1 --2- 172.21.15.102:0/3455475135 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fab20159b30 0x7fab2014b1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:09.854 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:09.847+0000 7fab28357640 1 --2- 172.21.15.102:0/3455475135 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fab200cf2d0 0x7fab201504e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:09.854 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:09.847+0000 7fab28357640 1 --2- 172.21.15.102:0/3455475135 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7fab04066470 0x7fab04068930 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:09.854 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:09.847+0000 7fab28357640 1 --2- 172.21.15.102:0/3455475135 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fab200711c0 0x7fab2015b1b0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:09.854 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:09.847+0000 7fab28357640 1 -- 172.21.15.102:0/3455475135 >> 172.21.15.102:0/3455475135 conn(0x7fab2006a410 msgr2=0x7fab200ceb90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-13T11:29:09.855 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:09.847+0000 7fab28357640 1 -- 172.21.15.102:0/3455475135 shutdown_connections 2023-11-13T11:29:09.855 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:09.847+0000 7fab28357640 1 -- 172.21.15.102:0/3455475135 wait complete. 2023-11-13T11:29:09.871 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-13T11:29:10.013 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:10.007+0000 7f48e29aa640 1 Processor -- start 2023-11-13T11:29:10.013 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:10.007+0000 7f48e29aa640 1 -- start start 2023-11-13T11:29:10.014 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:10.007+0000 7f48e29aa640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f48dc159b30 0x7f48dc06fc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:10.014 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:10.007+0000 7f48e29aa640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f48dc0cf2d0 0x7f48dc0b3520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:10.015 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:10.007+0000 7f48e29aa640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f48dc071620 con 0x7f48dc0711c0 2023-11-13T11:29:10.015 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:10.007+0000 7f48e29aa640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f48dc0b21f0 con 0x7f48dc0cf2d0 2023-11-13T11:29:10.015 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:10.007+0000 7f48e29aa640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f48dc0b2440 con 0x7f48dc159b30 2023-11-13T11:29:10.015 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:10.007+0000 7f48db7fe640 1 --1- >> v1:172.21.15.102:6789/0 conn(0x7f48dc0711c0 0x7f48dc0cebc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.102:6789/0 says I am v1:172.21.15.102:49662/0 (socket says 172.21.15.102:49662) 2023-11-13T11:29:10.015 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:10.007+0000 7f48db7fe640 1 -- 172.21.15.102:0/161785742 learned_addr learned my addr 172.21.15.102:0/161785742 (peer_addr_for_me v1:172.21.15.102:0/0) 2023-11-13T11:29:10.016 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:10.011+0000 7f48e0f47640 1 --2- 172.21.15.102:0/161785742 >> v2:172.21.15.154:3300/0 conn(0x7f48dc0cf2d0 0x7f48dc0b3520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:10.016 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:10.011+0000 7f48dbfff640 1 --2- 172.21.15.102:0/161785742 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f48dc159b30 0x7f48dc06fc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:10.016 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:10.011+0000 7f48daffd640 1 -- 172.21.15.102:0/161785742 <== mon.0 v1:172.21.15.102:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3402448380 0 0) 0x7f48d0001120 con 0x7f48dc0711c0 2023-11-13T11:29:10.017 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:10.011+0000 7f48daffd640 1 -- 172.21.15.102:0/161785742 --> v1:172.21.15.102:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f48c4003530 con 0x7f48dc0711c0 2023-11-13T11:29:10.017 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:10.011+0000 7f48e0f47640 1 -- 172.21.15.102:0/161785742 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f48dc159b30 msgr2=0x7f48dc06fc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-13T11:29:10.017 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:10.011+0000 7f48e0f47640 1 --2- 172.21.15.102:0/161785742 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f48dc159b30 0x7f48dc06fc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:10.017 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:10.011+0000 7f48e0f47640 1 -- 172.21.15.102:0/161785742 >> v1:172.21.15.102:6789/0 conn(0x7f48dc0711c0 legacy=0x7f48dc0cebc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:10.017 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:10.011+0000 7f48e0f47640 1 -- 172.21.15.102:0/161785742 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48dc0b2720 con 0x7f48dc0cf2d0 2023-11-13T11:29:10.019 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:10.011+0000 7f48e0f47640 1 --2- 172.21.15.102:0/161785742 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f48dc0cf2d0 0x7f48dc0b3520 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f48d4009d90 tx=0x7f48d401c920 comp rx=0 tx=0).ready entity=mon.1 client_cookie=26418f551b4c981c server_cookie=0 in_seq=0 out_seq=0 2023-11-13T11:29:10.019 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:10.011+0000 7f48daffd640 1 -- 172.21.15.102:0/161785742 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48d40a59e0 con 0x7f48dc0cf2d0 2023-11-13T11:29:10.019 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:10.011+0000 7f48daffd640 1 -- 172.21.15.102:0/161785742 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f48d40a5b40 con 0x7f48dc0cf2d0 2023-11-13T11:29:10.020 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:10.011+0000 7f48daffd640 1 -- 172.21.15.102:0/161785742 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48d40ad440 con 0x7f48dc0cf2d0 2023-11-13T11:29:10.020 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:10.015+0000 7f48e29aa640 1 -- 172.21.15.102:0/161785742 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f48dc0cf2d0 msgr2=0x7f48dc0b3520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:10.020 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:10.015+0000 7f48e29aa640 1 --2- 172.21.15.102:0/161785742 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f48dc0cf2d0 0x7f48dc0b3520 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f48d4009d90 tx=0x7f48d401c920 comp rx=0 tx=0).stop 2023-11-13T11:29:10.020 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:10.015+0000 7f48e29aa640 1 -- 172.21.15.102:0/161785742 shutdown_connections 2023-11-13T11:29:10.021 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:10.015+0000 7f48e29aa640 1 --2- 172.21.15.102:0/161785742 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f48dc0cf2d0 0x7f48dc0b3520 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:10.021 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:10.015+0000 7f48e29aa640 1 --2- 172.21.15.102:0/161785742 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f48dc159b30 0x7f48dc06fc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:10.021 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:10.015+0000 7f48e29aa640 1 -- 172.21.15.102:0/161785742 >> 172.21.15.102:0/161785742 conn(0x7f48dc06a410 msgr2=0x7f48dc06a820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-13T11:29:10.021 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:10.015+0000 7f48e29aa640 1 -- 172.21.15.102:0/161785742 shutdown_connections 2023-11-13T11:29:10.022 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:10.015+0000 7f48e29aa640 1 -- 172.21.15.102:0/161785742 wait complete. 2023-11-13T11:29:10.024 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:10.015+0000 7f48e29aa640 1 Processor -- start 2023-11-13T11:29:10.024 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:10.015+0000 7f48e29aa640 1 -- start start 2023-11-13T11:29:10.024 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:10.015+0000 7f48e29aa640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f48dc0711c0 0x7f48dc15aaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:10.024 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:10.015+0000 7f48e29aa640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f48dc0cf2d0 0x7f48dc14f370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:10.025 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:10.015+0000 7f48e29aa640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f48dc159b30 0x7f48dc14f8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:10.025 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:10.015+0000 7f48e29aa640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48dc156090 con 0x7f48dc159b30 2023-11-13T11:29:10.025 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:10.015+0000 7f48e29aa640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48dc0ae350 con 0x7f48dc0711c0 2023-11-13T11:29:10.025 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:10.015+0000 7f48e29aa640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f48dc1557f0 con 0x7f48dc0cf2d0 2023-11-13T11:29:10.025 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:10.015+0000 7f48e0f47640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f48dc159b30 0x7f48dc14f8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:10.026 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:10.015+0000 7f48e0f47640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f48dc159b30 0x7f48dc14f8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:47736/0 (socket says 172.21.15.102:47736) 2023-11-13T11:29:10.026 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:10.015+0000 7f48e0f47640 1 -- 172.21.15.102:0/2430947216 learned_addr learned my addr 172.21.15.102:0/2430947216 (peer_addr_for_me v2:172.21.15.102:0/0) 2023-11-13T11:29:10.026 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:10.015+0000 7f48db7fe640 1 --2- 172.21.15.102:0/2430947216 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f48dc0cf2d0 0x7f48dc14f370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:10.026 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:10.015+0000 7f48dbfff640 1 --2- 172.21.15.102:0/2430947216 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f48dc0711c0 0x7f48dc15aaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:10.027 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:10.019+0000 7f48e0f47640 1 -- 172.21.15.102:0/2430947216 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f48dc0cf2d0 msgr2=0x7f48dc14f370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:10.027 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:10.019+0000 7f48e0f47640 1 --2- 172.21.15.102:0/2430947216 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f48dc0cf2d0 0x7f48dc14f370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:10.027 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:10.019+0000 7f48e0f47640 1 -- 172.21.15.102:0/2430947216 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f48dc0711c0 msgr2=0x7f48dc15aaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:10.029 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:10.019+0000 7f48e0f47640 1 --2- 172.21.15.102:0/2430947216 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f48dc0711c0 0x7f48dc15aaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:10.029 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:10.019+0000 7f48e0f47640 1 -- 172.21.15.102:0/2430947216 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48d4009a70 con 0x7f48dc159b30 2023-11-13T11:29:10.030 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:10.019+0000 7f48e0f47640 1 --2- 172.21.15.102:0/2430947216 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f48dc159b30 0x7f48dc14f8b0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f48d40b0040 tx=0x7f48d40196c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-13T11:29:10.030 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:10.019+0000 7f48d8ff9640 1 -- 172.21.15.102:0/2430947216 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48d40adce0 con 0x7f48dc159b30 2023-11-13T11:29:10.032 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:10.019+0000 7f48d8ff9640 1 -- 172.21.15.102:0/2430947216 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f48d40ade40 con 0x7f48dc159b30 2023-11-13T11:29:10.032 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:10.019+0000 7f48d8ff9640 1 -- 172.21.15.102:0/2430947216 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48d40b9690 con 0x7f48dc159b30 2023-11-13T11:29:10.032 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:10.019+0000 7f48e29aa640 1 -- 172.21.15.102:0/2430947216 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f48dc155ad0 con 0x7f48dc159b30 2023-11-13T11:29:10.032 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:10.019+0000 7f48e29aa640 1 -- 172.21.15.102:0/2430947216 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f48dc15b030 con 0x7f48dc159b30 2023-11-13T11:29:10.035 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:10.019+0000 7f48e29aa640 1 -- 172.21.15.102:0/2430947216 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f48dc0ae120 con 0x7f48dc159b30 2023-11-13T11:29:10.035 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:10.019+0000 7f48d8ff9640 1 -- 172.21.15.102:0/2430947216 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f48d40b97f0 con 0x7f48dc159b30 2023-11-13T11:29:10.035 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:10.019+0000 7f48d8ff9640 1 --2- 172.21.15.102:0/2430947216 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f48c8066470 0x7f48c8068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:10.035 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:10.019+0000 7f48d8ff9640 1 -- 172.21.15.102:0/2430947216 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f48d411f4b0 con 0x7f48dc159b30 2023-11-13T11:29:10.036 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:10.019+0000 7f48dbfff640 1 --2- 172.21.15.102:0/2430947216 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f48c8066470 0x7f48c8068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:10.036 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:10.023+0000 7f48dbfff640 1 --2- 172.21.15.102:0/2430947216 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f48c8066470 0x7f48c8068930 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f48cc009ac0 tx=0x7f48cc009190 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-13T11:29:10.036 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:10.023+0000 7f48d8ff9640 1 -- 172.21.15.102:0/2430947216 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f48dc0ae120 con 0x7f48dc159b30 2023-11-13T11:29:10.182 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:10.175+0000 7f48e29aa640 1 -- 172.21.15.102:0/2430947216 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f48dc067640 con 0x7f48dc159b30 2023-11-13T11:29:10.182 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:10.175+0000 7f48d8ff9640 1 -- 172.21.15.102:0/2430947216 <== mon.0 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v22) v1 ==== 104+0+11 (secure 0 0 0) 0x7f48d40ec940 con 0x7f48dc159b30 2023-11-13T11:29:10.183 INFO:teuthology.orchestra.run.smithi102.stdout:pg_num: 32 2023-11-13T11:29:10.184 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:10.179+0000 7f48e29aa640 1 -- 172.21.15.102:0/2430947216 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f48c8066470 msgr2=0x7f48c8068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:10.185 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:10.179+0000 7f48e29aa640 1 --2- 172.21.15.102:0/2430947216 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f48c8066470 0x7f48c8068930 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f48cc009ac0 tx=0x7f48cc009190 comp rx=0 tx=0).stop 2023-11-13T11:29:10.185 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:10.179+0000 7f48e29aa640 1 -- 172.21.15.102:0/2430947216 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f48dc159b30 msgr2=0x7f48dc14f8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:10.185 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:10.179+0000 7f48e29aa640 1 --2- 172.21.15.102:0/2430947216 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f48dc159b30 0x7f48dc14f8b0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f48d40b0040 tx=0x7f48d40196c0 comp rx=0 tx=0).stop 2023-11-13T11:29:10.185 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:10.179+0000 7f48e29aa640 1 -- 172.21.15.102:0/2430947216 shutdown_connections 2023-11-13T11:29:10.185 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:10.179+0000 7f48e29aa640 1 --2- 172.21.15.102:0/2430947216 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f48c8066470 0x7f48c8068930 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:10.186 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:10.179+0000 7f48e29aa640 1 --2- 172.21.15.102:0/2430947216 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f48dc159b30 0x7f48dc14f8b0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:10.186 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:10.179+0000 7f48e29aa640 1 --2- 172.21.15.102:0/2430947216 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f48dc0cf2d0 0x7f48dc14f370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:10.186 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:10.179+0000 7f48e29aa640 1 --2- 172.21.15.102:0/2430947216 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f48dc0711c0 0x7f48dc15aaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:10.186 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:10.179+0000 7f48e29aa640 1 -- 172.21.15.102:0/2430947216 >> 172.21.15.102:0/2430947216 conn(0x7f48dc06a410 msgr2=0x7f48dc0ac8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-13T11:29:10.186 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:10.179+0000 7f48e29aa640 1 -- 172.21.15.102:0/2430947216 shutdown_connections 2023-11-13T11:29:10.187 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:10.179+0000 7f48e29aa640 1 -- 172.21.15.102:0/2430947216 wait complete. 2023-11-13T11:29:10.204 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-13T11:29:10.344 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:10.339+0000 7fa510617640 1 Processor -- start 2023-11-13T11:29:10.345 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:10.339+0000 7fa510617640 1 -- start start 2023-11-13T11:29:10.346 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:10.339+0000 7fa510617640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa5081446e0 0x7fa5080cb360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:10.346 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:10.339+0000 7fa510617640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fa50815bad0 0x7fa5080b2110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:10.346 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:10.339+0000 7fa510617640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa5080cbc40 con 0x7fa5080b11b0 2023-11-13T11:29:10.346 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:10.339+0000 7fa510617640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa5080ce3d0 con 0x7fa50815bad0 2023-11-13T11:29:10.347 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:10.339+0000 7fa510617640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa5080cdb10 con 0x7fa5081446e0 2023-11-13T11:29:10.347 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:10.339+0000 7fa50dbb2640 1 --1- >> v1:172.21.15.102:6789/0 conn(0x7fa5080b11b0 0x7fa50815b3c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.102:6789/0 says I am v1:172.21.15.102:49672/0 (socket says 172.21.15.102:49672) 2023-11-13T11:29:10.347 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:10.339+0000 7fa50dbb2640 1 -- 172.21.15.102:0/898309640 learned_addr learned my addr 172.21.15.102:0/898309640 (peer_addr_for_me v1:172.21.15.102:0/0) 2023-11-13T11:29:10.348 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:10.339+0000 7fa50e3b3640 1 --2- 172.21.15.102:0/898309640 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa5081446e0 0x7fa5080cb360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:10.348 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:10.339+0000 7fa50ebb4640 1 --2- 172.21.15.102:0/898309640 >> v2:172.21.15.154:3300/0 conn(0x7fa50815bad0 0x7fa5080b2110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:10.348 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:10.343+0000 7fa50d3b1640 1 -- 172.21.15.102:0/898309640 <== mon.0 v1:172.21.15.102:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 180005464 0 0) 0x7fa4f8001120 con 0x7fa5080b11b0 2023-11-13T11:29:10.349 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:10.343+0000 7fa50d3b1640 1 -- 172.21.15.102:0/898309640 --> v1:172.21.15.102:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa4f4003530 con 0x7fa5080b11b0 2023-11-13T11:29:10.349 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:10.343+0000 7fa50e3b3640 1 -- 172.21.15.102:0/898309640 >> v2:172.21.15.154:3300/0 conn(0x7fa50815bad0 msgr2=0x7fa5080b2110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-13T11:29:10.349 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:10.343+0000 7fa50e3b3640 1 --2- 172.21.15.102:0/898309640 >> v2:172.21.15.154:3300/0 conn(0x7fa50815bad0 0x7fa5080b2110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:10.349 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:10.343+0000 7fa50e3b3640 1 -- 172.21.15.102:0/898309640 >> v1:172.21.15.102:6789/0 conn(0x7fa5080b11b0 legacy=0x7fa50815b3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:10.349 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:10.343+0000 7fa50e3b3640 1 -- 172.21.15.102:0/898309640 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa508144ac0 con 0x7fa5081446e0 2023-11-13T11:29:10.350 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:10.343+0000 7fa50ebb4640 1 --2- 172.21.15.102:0/898309640 >> v2:172.21.15.154:3300/0 conn(0x7fa50815bad0 0x7fa5080b2110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-13T11:29:10.351 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:10.343+0000 7fa50e3b3640 1 --2- 172.21.15.102:0/898309640 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa5081446e0 0x7fa5080cb360 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fa5040097c0 tx=0x7fa50401c3f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ffedd81a3059dfd1 server_cookie=0 in_seq=0 out_seq=0 2023-11-13T11:29:10.351 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:10.343+0000 7fa50d3b1640 1 -- 172.21.15.102:0/898309640 <== mon.2 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5040ab600 con 0x7fa5081446e0 2023-11-13T11:29:10.351 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:10.343+0000 7fa50d3b1640 1 -- 172.21.15.102:0/898309640 <== mon.2 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa5040a7050 con 0x7fa5081446e0 2023-11-13T11:29:10.351 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:10.343+0000 7fa50d3b1640 1 -- 172.21.15.102:0/898309640 <== mon.2 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5040ab980 con 0x7fa5081446e0 2023-11-13T11:29:10.352 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:10.347+0000 7fa510617640 1 -- 172.21.15.102:0/898309640 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa5081446e0 msgr2=0x7fa5080cb360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:10.352 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:10.347+0000 7fa510617640 1 --2- 172.21.15.102:0/898309640 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa5081446e0 0x7fa5080cb360 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fa5040097c0 tx=0x7fa50401c3f0 comp rx=0 tx=0).stop 2023-11-13T11:29:10.352 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:10.347+0000 7fa510617640 1 -- 172.21.15.102:0/898309640 shutdown_connections 2023-11-13T11:29:10.352 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:10.347+0000 7fa510617640 1 --2- 172.21.15.102:0/898309640 >> v2:172.21.15.154:3300/0 conn(0x7fa50815bad0 0x7fa5080b2110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:10.352 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:10.347+0000 7fa510617640 1 --2- 172.21.15.102:0/898309640 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa5081446e0 0x7fa5080cb360 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:10.353 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:10.347+0000 7fa510617640 1 -- 172.21.15.102:0/898309640 >> 172.21.15.102:0/898309640 conn(0x7fa5080b0690 msgr2=0x7fa5080b0aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-13T11:29:10.353 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:10.347+0000 7fa510617640 1 -- 172.21.15.102:0/898309640 shutdown_connections 2023-11-13T11:29:10.353 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:10.347+0000 7fa510617640 1 -- 172.21.15.102:0/898309640 wait complete. 2023-11-13T11:29:10.355 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:10.347+0000 7fa510617640 1 Processor -- start 2023-11-13T11:29:10.355 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:10.347+0000 7fa510617640 1 -- start start 2023-11-13T11:29:10.356 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:10.347+0000 7fa510617640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa5080b11b0 0x7fa5081598d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:10.356 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:10.347+0000 7fa510617640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa5081446e0 0x7fa50815e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:10.356 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:10.347+0000 7fa510617640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa50815bad0 0x7fa50815ecb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:10.356 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:10.347+0000 7fa510617640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa508140b00 con 0x7fa50815bad0 2023-11-13T11:29:10.356 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:10.347+0000 7fa510617640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5080714f0 con 0x7fa5081446e0 2023-11-13T11:29:10.357 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:10.347+0000 7fa510617640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa5080caf00 con 0x7fa5080b11b0 2023-11-13T11:29:10.357 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:10.347+0000 7fa50ebb4640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa50815bad0 0x7fa50815ecb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:10.357 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:10.347+0000 7fa50ebb4640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa50815bad0 0x7fa50815ecb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:47744/0 (socket says 172.21.15.102:47744) 2023-11-13T11:29:10.357 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:10.347+0000 7fa50ebb4640 1 -- 172.21.15.102:0/445600685 learned_addr learned my addr 172.21.15.102:0/445600685 (peer_addr_for_me v2:172.21.15.102:0/0) 2023-11-13T11:29:10.357 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:10.347+0000 7fa50dbb2640 1 --2- 172.21.15.102:0/445600685 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa5081446e0 0x7fa50815e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:10.358 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:10.347+0000 7fa50e3b3640 1 --2- 172.21.15.102:0/445600685 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa5080b11b0 0x7fa5081598d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:10.358 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:10.347+0000 7fa50ebb4640 1 -- 172.21.15.102:0/445600685 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa5080b11b0 msgr2=0x7fa5081598d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:10.358 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:10.347+0000 7fa50ebb4640 1 --2- 172.21.15.102:0/445600685 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa5080b11b0 0x7fa5081598d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:10.358 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:10.347+0000 7fa50ebb4640 1 -- 172.21.15.102:0/445600685 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa5081446e0 msgr2=0x7fa50815e770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:10.358 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:10.347+0000 7fa50ebb4640 1 --2- 172.21.15.102:0/445600685 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa5081446e0 0x7fa50815e770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:10.359 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:10.347+0000 7fa50ebb4640 1 -- 172.21.15.102:0/445600685 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa500009a70 con 0x7fa50815bad0 2023-11-13T11:29:10.359 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:10.351+0000 7fa50ebb4640 1 --2- 172.21.15.102:0/445600685 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa50815bad0 0x7fa50815ecb0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fa50000efc0 tx=0x7fa50000c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-13T11:29:10.359 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:10.351+0000 7fa4feffd640 1 -- 172.21.15.102:0/445600685 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa500009c20 con 0x7fa50815bad0 2023-11-13T11:29:10.359 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:10.351+0000 7fa4feffd640 1 -- 172.21.15.102:0/445600685 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa50000f040 con 0x7fa50815bad0 2023-11-13T11:29:10.359 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:10.351+0000 7fa4feffd640 1 -- 172.21.15.102:0/445600685 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5000039a0 con 0x7fa50815bad0 2023-11-13T11:29:10.360 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:10.351+0000 7fa510617640 1 -- 172.21.15.102:0/445600685 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa504009420 con 0x7fa50815bad0 2023-11-13T11:29:10.360 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:10.351+0000 7fa510617640 1 -- 172.21.15.102:0/445600685 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa508071740 con 0x7fa50815bad0 2023-11-13T11:29:10.361 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:10.351+0000 7fa510617640 1 -- 172.21.15.102:0/445600685 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa508140c40 con 0x7fa50815bad0 2023-11-13T11:29:10.361 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:10.351+0000 7fa4feffd640 1 -- 172.21.15.102:0/445600685 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fa500014480 con 0x7fa50815bad0 2023-11-13T11:29:10.361 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:10.351+0000 7fa4feffd640 1 --2- 172.21.15.102:0/445600685 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7fa4ec0664a0 0x7fa4ec068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:10.361 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:10.351+0000 7fa4feffd640 1 -- 172.21.15.102:0/445600685 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa500084840 con 0x7fa50815bad0 2023-11-13T11:29:10.361 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:10.351+0000 7fa50e3b3640 1 --2- 172.21.15.102:0/445600685 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7fa4ec0664a0 0x7fa4ec068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:10.362 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:10.351+0000 7fa50e3b3640 1 --2- 172.21.15.102:0/445600685 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7fa4ec0664a0 0x7fa4ec068960 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fa5040ad000 tx=0x7fa504008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-13T11:29:10.362 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:10.355+0000 7fa4feffd640 1 -- 172.21.15.102:0/445600685 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fa508140c40 con 0x7fa50815bad0 2023-11-13T11:29:10.510 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:10.503+0000 7fa510617640 1 -- 172.21.15.102:0/445600685 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fa508140c40 con 0x7fa50815bad0 2023-11-13T11:29:10.511 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:10.503+0000 7fa4feffd640 1 -- 172.21.15.102:0/445600685 <== mon.0 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v22) v1 ==== 100+0+11 (secure 0 0 0) 0x7fa500018020 con 0x7fa50815bad0 2023-11-13T11:29:10.511 INFO:teuthology.orchestra.run.smithi102.stdout:pg_num: 64 2023-11-13T11:29:10.512 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:10.507+0000 7fa510617640 1 -- 172.21.15.102:0/445600685 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7fa4ec0664a0 msgr2=0x7fa4ec068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:10.513 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:10.507+0000 7fa510617640 1 --2- 172.21.15.102:0/445600685 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7fa4ec0664a0 0x7fa4ec068960 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fa5040ad000 tx=0x7fa504008040 comp rx=0 tx=0).stop 2023-11-13T11:29:10.513 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:10.507+0000 7fa510617640 1 -- 172.21.15.102:0/445600685 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa50815bad0 msgr2=0x7fa50815ecb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:10.513 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:10.507+0000 7fa510617640 1 --2- 172.21.15.102:0/445600685 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa50815bad0 0x7fa50815ecb0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fa50000efc0 tx=0x7fa50000c490 comp rx=0 tx=0).stop 2023-11-13T11:29:10.513 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:10.507+0000 7fa510617640 1 -- 172.21.15.102:0/445600685 shutdown_connections 2023-11-13T11:29:10.513 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:10.507+0000 7fa510617640 1 --2- 172.21.15.102:0/445600685 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7fa4ec0664a0 0x7fa4ec068960 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:10.514 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:10.507+0000 7fa510617640 1 --2- 172.21.15.102:0/445600685 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa50815bad0 0x7fa50815ecb0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:10.514 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:10.507+0000 7fa510617640 1 --2- 172.21.15.102:0/445600685 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa5081446e0 0x7fa50815e770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:10.514 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:10.507+0000 7fa510617640 1 --2- 172.21.15.102:0/445600685 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa5080b11b0 0x7fa5081598d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:10.514 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:10.507+0000 7fa510617640 1 -- 172.21.15.102:0/445600685 >> 172.21.15.102:0/445600685 conn(0x7fa5080b0690 msgr2=0x7fa50806bbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-13T11:29:10.514 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:10.507+0000 7fa510617640 1 -- 172.21.15.102:0/445600685 shutdown_connections 2023-11-13T11:29:10.515 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:10.507+0000 7fa510617640 1 -- 172.21.15.102:0/445600685 wait complete. 2023-11-13T11:29:10.531 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-13T11:29:10.668 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:10.663+0000 7eff1db57640 1 Processor -- start 2023-11-13T11:29:10.669 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:10.663+0000 7eff1db57640 1 -- start start 2023-11-13T11:29:10.669 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:10.663+0000 7eff1db57640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7eff18071900 0x7eff1815e3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:10.670 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:10.663+0000 7eff1db57640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7eff1806caa0 0x7eff180b1c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:10.670 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:10.663+0000 7eff1db57640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7eff1815e910 con 0x7eff18140540 2023-11-13T11:29:10.670 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:10.663+0000 7eff1db57640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7eff18140920 con 0x7eff18071900 2023-11-13T11:29:10.670 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:10.663+0000 7eff1db57640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff180ccc50 con 0x7eff1806caa0 2023-11-13T11:29:10.671 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:10.663+0000 7eff177fe640 1 --1- >> v1:172.21.15.102:6789/0 conn(0x7eff18140540 0x7eff180711f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.102:6789/0 says I am v1:172.21.15.102:49674/0 (socket says 172.21.15.102:49674) 2023-11-13T11:29:10.671 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:10.663+0000 7eff177fe640 1 -- 172.21.15.102:0/3947605929 learned_addr learned my addr 172.21.15.102:0/3947605929 (peer_addr_for_me v1:172.21.15.102:0/0) 2023-11-13T11:29:10.671 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:10.663+0000 7eff0ffff640 1 --2- 172.21.15.102:0/3947605929 >> v2:172.21.15.102:3300/0 conn(0x7eff18071900 0x7eff1815e3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:10.671 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:10.663+0000 7eff17fff640 1 --2- 172.21.15.102:0/3947605929 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7eff1806caa0 0x7eff180b1c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:10.672 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:10.663+0000 7eff0ffff640 1 -- 172.21.15.102:0/3947605929 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7eff1806caa0 msgr2=0x7eff180b1c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-13T11:29:10.672 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:10.663+0000 7eff0ffff640 1 --2- 172.21.15.102:0/3947605929 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7eff1806caa0 0x7eff180b1c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:10.672 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:10.663+0000 7eff0ffff640 1 -- 172.21.15.102:0/3947605929 >> v1:172.21.15.102:6789/0 conn(0x7eff18140540 legacy=0x7eff180711f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:10.673 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:10.663+0000 7eff0ffff640 1 -- 172.21.15.102:0/3947605929 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff1806cfc0 con 0x7eff18071900 2023-11-13T11:29:10.674 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:10.667+0000 7eff0ffff640 1 --2- 172.21.15.102:0/3947605929 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7eff18071900 0x7eff1815e3d0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7eff000097c0 tx=0x7eff0001c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=befb32e5bfab3993 server_cookie=0 in_seq=0 out_seq=0 2023-11-13T11:29:10.675 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:10.667+0000 7eff16ffd640 1 -- 172.21.15.102:0/3947605929 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff000ab650 con 0x7eff18071900 2023-11-13T11:29:10.675 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:10.667+0000 7eff16ffd640 1 -- 172.21.15.102:0/3947605929 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff000ab7b0 con 0x7eff18071900 2023-11-13T11:29:10.675 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:10.667+0000 7eff16ffd640 1 -- 172.21.15.102:0/3947605929 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff000abb40 con 0x7eff18071900 2023-11-13T11:29:10.675 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:10.667+0000 7eff1db57640 1 -- 172.21.15.102:0/3947605929 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7eff18071900 msgr2=0x7eff1815e3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:10.675 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:10.667+0000 7eff1db57640 1 --2- 172.21.15.102:0/3947605929 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7eff18071900 0x7eff1815e3d0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7eff000097c0 tx=0x7eff0001c450 comp rx=0 tx=0).stop 2023-11-13T11:29:10.676 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:10.667+0000 7eff1db57640 1 -- 172.21.15.102:0/3947605929 shutdown_connections 2023-11-13T11:29:10.676 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:10.667+0000 7eff1db57640 1 --2- 172.21.15.102:0/3947605929 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7eff1806caa0 0x7eff180b1c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:10.676 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:10.667+0000 7eff1db57640 1 --2- 172.21.15.102:0/3947605929 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7eff18071900 0x7eff1815e3d0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:10.676 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:10.667+0000 7eff1db57640 1 -- 172.21.15.102:0/3947605929 >> 172.21.15.102:0/3947605929 conn(0x7eff180b0870 msgr2=0x7eff180b0c80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-13T11:29:10.676 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:10.667+0000 7eff1db57640 1 -- 172.21.15.102:0/3947605929 shutdown_connections 2023-11-13T11:29:10.677 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:10.667+0000 7eff1db57640 1 -- 172.21.15.102:0/3947605929 wait complete. 2023-11-13T11:29:10.679 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:10.671+0000 7eff1db57640 1 Processor -- start 2023-11-13T11:29:10.679 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:10.671+0000 7eff1db57640 1 -- start start 2023-11-13T11:29:10.679 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:10.671+0000 7eff1db57640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7eff1806caa0 0x7eff180ca590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:10.679 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:10.671+0000 7eff1db57640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7eff18071900 0x7eff18161300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:10.679 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:10.671+0000 7eff1db57640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7eff18140540 0x7eff1812c1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:10.680 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:10.671+0000 7eff1db57640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff1812bd80 con 0x7eff1806caa0 2023-11-13T11:29:10.680 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:10.671+0000 7eff1db57640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff1812b100 con 0x7eff18071900 2023-11-13T11:29:10.680 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:10.671+0000 7eff1db57640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff1812b3e0 con 0x7eff18140540 2023-11-13T11:29:10.680 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:10.671+0000 7eff177fe640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7eff1806caa0 0x7eff180ca590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:10.680 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:10.671+0000 7eff177fe640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7eff1806caa0 0x7eff180ca590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:47760/0 (socket says 172.21.15.102:47760) 2023-11-13T11:29:10.681 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:10.671+0000 7eff177fe640 1 -- 172.21.15.102:0/697964919 learned_addr learned my addr 172.21.15.102:0/697964919 (peer_addr_for_me v2:172.21.15.102:0/0) 2023-11-13T11:29:10.681 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:10.671+0000 7eff0ffff640 1 --2- 172.21.15.102:0/697964919 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7eff18071900 0x7eff18161300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:10.681 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:10.671+0000 7eff17fff640 1 --2- 172.21.15.102:0/697964919 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7eff18140540 0x7eff1812c1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:10.681 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:10.671+0000 7eff177fe640 1 -- 172.21.15.102:0/697964919 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7eff18140540 msgr2=0x7eff1812c1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:10.681 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:10.671+0000 7eff177fe640 1 --2- 172.21.15.102:0/697964919 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7eff18140540 0x7eff1812c1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:10.682 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:10.671+0000 7eff177fe640 1 -- 172.21.15.102:0/697964919 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7eff18071900 msgr2=0x7eff18161300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:10.682 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:10.671+0000 7eff177fe640 1 --2- 172.21.15.102:0/697964919 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7eff18071900 0x7eff18161300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:10.682 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:10.671+0000 7eff177fe640 1 -- 172.21.15.102:0/697964919 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff00009420 con 0x7eff1806caa0 2023-11-13T11:29:10.682 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:10.671+0000 7eff177fe640 1 --2- 172.21.15.102:0/697964919 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7eff1806caa0 0x7eff180ca590 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7eff0800c400 tx=0x7eff0800c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-13T11:29:10.682 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:10.671+0000 7eff14ff9640 1 -- 172.21.15.102:0/697964919 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff08005cf0 con 0x7eff1806caa0 2023-11-13T11:29:10.683 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:10.671+0000 7eff14ff9640 1 -- 172.21.15.102:0/697964919 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff08005e50 con 0x7eff1806caa0 2023-11-13T11:29:10.683 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:10.671+0000 7eff14ff9640 1 -- 172.21.15.102:0/697964919 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff080072d0 con 0x7eff1806caa0 2023-11-13T11:29:10.683 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:10.671+0000 7eff1db57640 1 -- 172.21.15.102:0/697964919 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7eff1812b6c0 con 0x7eff1806caa0 2023-11-13T11:29:10.683 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:10.671+0000 7eff1db57640 1 -- 172.21.15.102:0/697964919 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7eff180caad0 con 0x7eff1806caa0 2023-11-13T11:29:10.683 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:10.675+0000 7eff1db57640 1 -- 172.21.15.102:0/697964919 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7eff1813d8c0 con 0x7eff1806caa0 2023-11-13T11:29:10.684 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:10.675+0000 7eff14ff9640 1 -- 172.21.15.102:0/697964919 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7eff08007430 con 0x7eff1806caa0 2023-11-13T11:29:10.684 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:10.675+0000 7eff14ff9640 1 --2- 172.21.15.102:0/697964919 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7efef8066470 0x7efef8068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:10.685 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:10.675+0000 7eff14ff9640 1 -- 172.21.15.102:0/697964919 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7eff08083220 con 0x7eff1806caa0 2023-11-13T11:29:10.685 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:10.675+0000 7eff0ffff640 1 --2- 172.21.15.102:0/697964919 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7efef8066470 0x7efef8068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:10.685 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:10.675+0000 7eff0ffff640 1 --2- 172.21.15.102:0/697964919 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7efef8066470 0x7efef8068930 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7eff000af000 tx=0x7eff000a7000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-13T11:29:10.686 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:10.679+0000 7eff14ff9640 1 -- 172.21.15.102:0/697964919 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7eff080506b0 con 0x7eff1806caa0 2023-11-13T11:29:10.864 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:10.859+0000 7eff1db57640 1 -- 172.21.15.102:0/697964919 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7eff1815e910 con 0x7eff1806caa0 2023-11-13T11:29:10.864 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:10.859+0000 7eff14ff9640 1 -- 172.21.15.102:0/697964919 <== mon.0 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4913 (secure 0 0 0) 0x7eff1815e910 con 0x7eff1806caa0 2023-11-13T11:29:10.865 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T11:29:10.865 INFO:teuthology.orchestra.run.smithi102.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4226,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.102:6836/659983176","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6835","nonce":659983176},{"type":"v1","addr":"172.21.15.102:6836","nonce":659983176}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4270,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.102:6837/1874856825","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6834","nonce":1874856825},{"type":"v1","addr":"172.21.15.102:6837","nonce":1874856825}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4276,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6834/532911681","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6832","nonce":532911681},{"type":"v1","addr":"172.21.15.154:6834","nonce":532911681}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-13T11:28:57.401001+0000","modified":"2023-11-13T11:29:00.404631+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4279},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4279":{"gid":4279,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.154:6835/3766337294","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6833","nonce":3766337294},{"type":"v1","addr":"172.21.15.154:6835","nonce":3766337294}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-11-13T11:29:10.865 INFO:teuthology.orchestra.run.smithi102.stderr:dumped fsmap epoch 8 2023-11-13T11:29:10.866 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:10.859+0000 7eff1db57640 1 -- 172.21.15.102:0/697964919 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7efef8066470 msgr2=0x7efef8068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:10.867 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:10.859+0000 7eff1db57640 1 --2- 172.21.15.102:0/697964919 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7efef8066470 0x7efef8068930 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7eff000af000 tx=0x7eff000a7000 comp rx=0 tx=0).stop 2023-11-13T11:29:10.867 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:10.859+0000 7eff1db57640 1 -- 172.21.15.102:0/697964919 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7eff1806caa0 msgr2=0x7eff180ca590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:10.867 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:10.859+0000 7eff1db57640 1 --2- 172.21.15.102:0/697964919 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7eff1806caa0 0x7eff180ca590 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7eff0800c400 tx=0x7eff0800c8c0 comp rx=0 tx=0).stop 2023-11-13T11:29:10.867 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:10.859+0000 7eff1db57640 1 -- 172.21.15.102:0/697964919 shutdown_connections 2023-11-13T11:29:10.868 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:10.859+0000 7eff1db57640 1 --2- 172.21.15.102:0/697964919 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7eff18140540 0x7eff1812c1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:10.868 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:10.859+0000 7eff1db57640 1 --2- 172.21.15.102:0/697964919 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7eff18071900 0x7eff18161300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:10.868 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:10.859+0000 7eff1db57640 1 --2- 172.21.15.102:0/697964919 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7efef8066470 0x7efef8068930 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:10.868 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:10.859+0000 7eff1db57640 1 --2- 172.21.15.102:0/697964919 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7eff1806caa0 0x7eff180ca590 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:10.869 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:10.859+0000 7eff1db57640 1 -- 172.21.15.102:0/697964919 >> 172.21.15.102:0/697964919 conn(0x7eff180b0870 msgr2=0x7eff180711f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-13T11:29:10.869 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:10.859+0000 7eff1db57640 1 -- 172.21.15.102:0/697964919 shutdown_connections 2023-11-13T11:29:10.869 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:10.859+0000 7eff1db57640 1 -- 172.21.15.102:0/697964919 wait complete. 2023-11-13T11:29:10.886 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-13T11:29:11.024 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:11.019+0000 7f7c92ce4640 1 Processor -- start 2023-11-13T11:29:11.025 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:11.019+0000 7f7c92ce4640 1 -- start start 2023-11-13T11:29:11.026 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:11.019+0000 7f7c92ce4640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f7c8c1606e0 0x7f7c8c0c69b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:11.026 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:11.019+0000 7f7c92ce4640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f7c8c0cf490 0x7f7c8c0cf920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:11.027 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:11.019+0000 7f7c92ce4640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7c8c0d1440 con 0x7f7c8c0d0c40 2023-11-13T11:29:11.027 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:11.019+0000 7f7c92ce4640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7c8c0cfe60 con 0x7f7c8c0cf490 2023-11-13T11:29:11.027 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:11.019+0000 7f7c92ce4640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7c8c0cdb10 con 0x7f7c8c1606e0 2023-11-13T11:29:11.027 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:11.019+0000 7f7c91281640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f7c8c0cf490 0x7f7c8c0cf920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:11.027 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:11.019+0000 7f7c8bfff640 1 --1- >> v1:172.21.15.102:6789/0 conn(0x7f7c8c0d0c40 0x7f7c8c0b3e20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.102:6789/0 says I am v1:172.21.15.102:49690/0 (socket says 172.21.15.102:49690) 2023-11-13T11:29:11.028 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:11.019+0000 7f7c8bfff640 1 -- 172.21.15.102:0/228256765 learned_addr learned my addr 172.21.15.102:0/228256765 (peer_addr_for_me v1:172.21.15.102:0/0) 2023-11-13T11:29:11.028 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:11.019+0000 7f7c91281640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f7c8c0cf490 0x7f7c8c0cf920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:47768/0 (socket says 172.21.15.102:47768) 2023-11-13T11:29:11.028 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:11.019+0000 7f7c90a80640 1 --2- 172.21.15.102:0/228256765 >> v2:172.21.15.154:3300/0 conn(0x7f7c8c1606e0 0x7f7c8c0c69b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:11.028 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:11.019+0000 7f7c8b7fe640 1 -- 172.21.15.102:0/228256765 <== mon.0 v1:172.21.15.102:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 844598741 0 0) 0x7f7c8c0d1440 con 0x7f7c8c0d0c40 2023-11-13T11:29:11.028 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:11.019+0000 7f7c8b7fe640 1 -- 172.21.15.102:0/228256765 --> v1:172.21.15.102:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7c7c003530 con 0x7f7c8c0d0c40 2023-11-13T11:29:11.029 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:11.019+0000 7f7c91281640 1 -- 172.21.15.102:0/228256765 >> v2:172.21.15.154:3300/0 conn(0x7f7c8c1606e0 msgr2=0x7f7c8c0c69b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-13T11:29:11.029 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:11.019+0000 7f7c91281640 1 --2- 172.21.15.102:0/228256765 >> v2:172.21.15.154:3300/0 conn(0x7f7c8c1606e0 0x7f7c8c0c69b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:11.029 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:11.019+0000 7f7c91281640 1 -- 172.21.15.102:0/228256765 >> v1:172.21.15.102:6789/0 conn(0x7f7c8c0d0c40 legacy=0x7f7c8c0b3e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:11.029 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:11.019+0000 7f7c91281640 1 -- 172.21.15.102:0/228256765 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c8c0d1690 con 0x7f7c8c0cf490 2023-11-13T11:29:11.029 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:11.019+0000 7f7c90a80640 1 --2- 172.21.15.102:0/228256765 >> v2:172.21.15.154:3300/0 conn(0x7f7c8c1606e0 0x7f7c8c0c69b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-13T11:29:11.031 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:11.023+0000 7f7c91281640 1 --2- 172.21.15.102:0/228256765 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7c8c0cf490 0x7f7c8c0cf920 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f7c8c08c0a0 tx=0x7f7c8401c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b82f6fa583dac075 server_cookie=0 in_seq=0 out_seq=0 2023-11-13T11:29:11.031 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:11.023+0000 7f7c8b7fe640 1 -- 172.21.15.102:0/228256765 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c840a5930 con 0x7f7c8c0cf490 2023-11-13T11:29:11.031 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:11.023+0000 7f7c8b7fe640 1 -- 172.21.15.102:0/228256765 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c840a5a90 con 0x7f7c8c0cf490 2023-11-13T11:29:11.031 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:11.023+0000 7f7c8b7fe640 1 -- 172.21.15.102:0/228256765 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c840a5e20 con 0x7f7c8c0cf490 2023-11-13T11:29:11.031 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:11.023+0000 7f7c92ce4640 1 -- 172.21.15.102:0/228256765 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7c8c0cf490 msgr2=0x7f7c8c0cf920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:11.032 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:11.023+0000 7f7c92ce4640 1 --2- 172.21.15.102:0/228256765 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7c8c0cf490 0x7f7c8c0cf920 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f7c8c08c0a0 tx=0x7f7c8401c850 comp rx=0 tx=0).stop 2023-11-13T11:29:11.032 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:11.023+0000 7f7c92ce4640 1 -- 172.21.15.102:0/228256765 shutdown_connections 2023-11-13T11:29:11.032 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:11.023+0000 7f7c92ce4640 1 --2- 172.21.15.102:0/228256765 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7c8c0cf490 0x7f7c8c0cf920 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:11.032 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:11.023+0000 7f7c92ce4640 1 --2- 172.21.15.102:0/228256765 >> v2:172.21.15.154:3300/0 conn(0x7f7c8c1606e0 0x7f7c8c0c69b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:11.032 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:11.023+0000 7f7c92ce4640 1 -- 172.21.15.102:0/228256765 >> 172.21.15.102:0/228256765 conn(0x7f7c8c09c130 msgr2=0x7f7c8c0d2e60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-13T11:29:11.033 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:11.023+0000 7f7c92ce4640 1 -- 172.21.15.102:0/228256765 shutdown_connections 2023-11-13T11:29:11.033 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:11.023+0000 7f7c92ce4640 1 -- 172.21.15.102:0/228256765 wait complete. 2023-11-13T11:29:11.035 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:11.027+0000 7f7c92ce4640 1 Processor -- start 2023-11-13T11:29:11.035 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:11.027+0000 7f7c92ce4640 1 -- start start 2023-11-13T11:29:11.035 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:11.027+0000 7f7c92ce4640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7c8c0cf490 0x7f7c8c159c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:11.035 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:11.027+0000 7f7c92ce4640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7c8c0d0c40 0x7f7c8c0cc590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:11.036 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:11.027+0000 7f7c92ce4640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7c8c1606e0 0x7f7c8c14eab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:11.036 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:11.027+0000 7f7c92ce4640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c8c1585a0 con 0x7f7c8c0cf490 2023-11-13T11:29:11.036 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:11.027+0000 7f7c92ce4640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c8c156730 con 0x7f7c8c0d0c40 2023-11-13T11:29:11.036 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:11.027+0000 7f7c92ce4640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c8c1569d0 con 0x7f7c8c1606e0 2023-11-13T11:29:11.036 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:11.027+0000 7f7c90a80640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7c8c0cf490 0x7f7c8c159c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:11.037 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:11.027+0000 7f7c90a80640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7c8c0cf490 0x7f7c8c159c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:47774/0 (socket says 172.21.15.102:47774) 2023-11-13T11:29:11.037 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:11.027+0000 7f7c90a80640 1 -- 172.21.15.102:0/3386413099 learned_addr learned my addr 172.21.15.102:0/3386413099 (peer_addr_for_me v2:172.21.15.102:0/0) 2023-11-13T11:29:11.037 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:11.027+0000 7f7c90a80640 1 -- 172.21.15.102:0/3386413099 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7c8c1606e0 msgr2=0x7f7c8c14eab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:11.037 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:11.027+0000 7f7c90a80640 1 --2- 172.21.15.102:0/3386413099 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7c8c1606e0 0x7f7c8c14eab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:11.037 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:11.027+0000 7f7c90a80640 1 -- 172.21.15.102:0/3386413099 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7c8c0d0c40 msgr2=0x7f7c8c0cc590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:11.038 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:11.027+0000 7f7c90a80640 1 --2- 172.21.15.102:0/3386413099 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7c8c0d0c40 0x7f7c8c0cc590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:11.038 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:11.027+0000 7f7c90a80640 1 -- 172.21.15.102:0/3386413099 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c80009420 con 0x7f7c8c0cf490 2023-11-13T11:29:11.038 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:11.027+0000 7f7c90a80640 1 --2- 172.21.15.102:0/3386413099 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7c8c0cf490 0x7f7c8c159c10 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f7c8000e980 tx=0x7f7c8000ee40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-13T11:29:11.038 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:11.027+0000 7f7c897fa640 1 -- 172.21.15.102:0/3386413099 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c8000ca00 con 0x7f7c8c0cf490 2023-11-13T11:29:11.038 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:11.027+0000 7f7c897fa640 1 -- 172.21.15.102:0/3386413099 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c8000cb60 con 0x7f7c8c0cf490 2023-11-13T11:29:11.039 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:11.027+0000 7f7c897fa640 1 -- 172.21.15.102:0/3386413099 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c80013470 con 0x7f7c8c0cf490 2023-11-13T11:29:11.039 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:11.027+0000 7f7c92ce4640 1 -- 172.21.15.102:0/3386413099 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7c84009a70 con 0x7f7c8c0cf490 2023-11-13T11:29:11.039 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:11.027+0000 7f7c92ce4640 1 -- 172.21.15.102:0/3386413099 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7c8c0cad20 con 0x7f7c8c0cf490 2023-11-13T11:29:11.039 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:11.031+0000 7f7c92ce4640 1 -- 172.21.15.102:0/3386413099 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7c8c068520 con 0x7f7c8c0cf490 2023-11-13T11:29:11.040 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:11.031+0000 7f7c897fa640 1 -- 172.21.15.102:0/3386413099 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f7c800135d0 con 0x7f7c8c0cf490 2023-11-13T11:29:11.040 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:11.031+0000 7f7c897fa640 1 --2- 172.21.15.102:0/3386413099 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f7c70066470 0x7f7c70068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:11.041 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:11.031+0000 7f7c897fa640 1 -- 172.21.15.102:0/3386413099 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f7c80084100 con 0x7f7c8c0cf490 2023-11-13T11:29:11.041 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:11.031+0000 7f7c8bfff640 1 --2- 172.21.15.102:0/3386413099 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f7c70066470 0x7f7c70068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:11.041 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:11.031+0000 7f7c8bfff640 1 --2- 172.21.15.102:0/3386413099 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f7c70066470 0x7f7c70068930 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f7c78007fd0 tx=0x7f7c78007940 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-13T11:29:11.041 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:11.035+0000 7f7c897fa640 1 -- 172.21.15.102:0/3386413099 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f7c80051570 con 0x7f7c8c0cf490 2023-11-13T11:29:11.194 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:11.187+0000 7f7c92ce4640 1 -- 172.21.15.102:0/3386413099 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7c8c156b90 con 0x7f7c8c0cf490 2023-11-13T11:29:11.195 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:11.191+0000 7f7c897fa640 1 -- 172.21.15.102:0/3386413099 <== mon.0 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+16545 (secure 0 0 0) 0x7f7c80054b90 con 0x7f7c8c0cf490 2023-11-13T11:29:11.195 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T11:29:11.197 INFO:teuthology.orchestra.run.smithi102.stdout:{"epoch":22,"fsid":"97b3eb2b-7ccf-4aae-8d92-bff986c671ea","created":"2023-11-13T11:28:31.836724+0000","modified":"2023-11-13T11:28:58.608314+0000","last_up_change":"2023-11-13T11:28:44.876638+0000","last_in_change":"2023-11-13T11:28:35.312740+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-13T11:28:44.981356+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-13T11:28:55.958525+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-13T11:28:56.394264+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"bdefaa17-fcca-4c86-aa40-27dc33a789af","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6800","nonce":53303834},{"type":"v1","addr":"172.21.15.102:6801","nonce":53303834}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6802","nonce":53303834},{"type":"v1","addr":"172.21.15.102:6803","nonce":53303834}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6806","nonce":53303834},{"type":"v1","addr":"172.21.15.102:6807","nonce":53303834}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6804","nonce":53303834},{"type":"v1","addr":"172.21.15.102:6805","nonce":53303834}]},"public_addr":"172.21.15.102:6801/53303834","cluster_addr":"172.21.15.102:6803/53303834","heartbeat_back_addr":"172.21.15.102:6807/53303834","heartbeat_front_addr":"172.21.15.102:6805/53303834","state":["exists","up"]},{"osd":1,"uuid":"f0033196-dec9-4ae9-945e-6aeef6dbb47f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6808","nonce":1732708348},{"type":"v1","addr":"172.21.15.102:6809","nonce":1732708348}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6811","nonce":1732708348},{"type":"v1","addr":"172.21.15.102:6813","nonce":1732708348}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6818","nonce":1732708348},{"type":"v1","addr":"172.21.15.102:6820","nonce":1732708348}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6815","nonce":1732708348},{"type":"v1","addr":"172.21.15.102:6817","nonce":1732708348}]},"public_addr":"172.21.15.102:6809/1732708348","cluster_addr":"172.21.15.102:6813/1732708348","heartbeat_back_addr":"172.21.15.102:6820/1732708348","heartbeat_front_addr":"172.21.15.102:6817/1732708348","state":["exists","up"]},{"osd":2,"uuid":"496b0834-351e-4ec2-a714-86ed0c0ff4fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6810","nonce":1825475150},{"type":"v1","addr":"172.21.15.102:6812","nonce":1825475150}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6814","nonce":1825475150},{"type":"v1","addr":"172.21.15.102:6816","nonce":1825475150}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6822","nonce":1825475150},{"type":"v1","addr":"172.21.15.102:6823","nonce":1825475150}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6819","nonce":1825475150},{"type":"v1","addr":"172.21.15.102:6821","nonce":1825475150}]},"public_addr":"172.21.15.102:6812/1825475150","cluster_addr":"172.21.15.102:6816/1825475150","heartbeat_back_addr":"172.21.15.102:6823/1825475150","heartbeat_front_addr":"172.21.15.102:6821/1825475150","state":["exists","up"]},{"osd":3,"uuid":"3ba6cc41-e0a0-4273-86cb-90000c06a55a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6824","nonce":4149355528},{"type":"v1","addr":"172.21.15.102:6825","nonce":4149355528}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6826","nonce":4149355528},{"type":"v1","addr":"172.21.15.102:6827","nonce":4149355528}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6830","nonce":4149355528},{"type":"v1","addr":"172.21.15.102:6831","nonce":4149355528}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6828","nonce":4149355528},{"type":"v1","addr":"172.21.15.102:6829","nonce":4149355528}]},"public_addr":"172.21.15.102:6825/4149355528","cluster_addr":"172.21.15.102:6827/4149355528","heartbeat_back_addr":"172.21.15.102:6831/4149355528","heartbeat_front_addr":"172.21.15.102:6829/4149355528","state":["exists","up"]},{"osd":4,"uuid":"16e797d8-e6e7-4140-95c3-b85283c42a2a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6808","nonce":4028899241},{"type":"v1","addr":"172.21.15.154:6809","nonce":4028899241}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6810","nonce":4028899241},{"type":"v1","addr":"172.21.15.154:6811","nonce":4028899241}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6814","nonce":4028899241},{"type":"v1","addr":"172.21.15.154:6815","nonce":4028899241}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6812","nonce":4028899241},{"type":"v1","addr":"172.21.15.154:6813","nonce":4028899241}]},"public_addr":"172.21.15.154:6809/4028899241","cluster_addr":"172.21.15.154:6811/4028899241","heartbeat_back_addr":"172.21.15.154:6815/4028899241","heartbeat_front_addr":"172.21.15.154:6813/4028899241","state":["exists","up"]},{"osd":5,"uuid":"d6ab225c-1b55-450a-89a9-abe5c3f8d6af","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":3562396827},{"type":"v1","addr":"172.21.15.154:6801","nonce":3562396827}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":3562396827},{"type":"v1","addr":"172.21.15.154:6803","nonce":3562396827}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6806","nonce":3562396827},{"type":"v1","addr":"172.21.15.154:6807","nonce":3562396827}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6804","nonce":3562396827},{"type":"v1","addr":"172.21.15.154:6805","nonce":3562396827}]},"public_addr":"172.21.15.154:6801/3562396827","cluster_addr":"172.21.15.154:6803/3562396827","heartbeat_back_addr":"172.21.15.154:6807/3562396827","heartbeat_front_addr":"172.21.15.154:6805/3562396827","state":["exists","up"]},{"osd":6,"uuid":"96f905ac-491c-4662-8e2b-5bb8e929ab9d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6816","nonce":2933728751},{"type":"v1","addr":"172.21.15.154:6817","nonce":2933728751}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6818","nonce":2933728751},{"type":"v1","addr":"172.21.15.154:6819","nonce":2933728751}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6822","nonce":2933728751},{"type":"v1","addr":"172.21.15.154:6823","nonce":2933728751}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6820","nonce":2933728751},{"type":"v1","addr":"172.21.15.154:6821","nonce":2933728751}]},"public_addr":"172.21.15.154:6817/2933728751","cluster_addr":"172.21.15.154:6819/2933728751","heartbeat_back_addr":"172.21.15.154:6823/2933728751","heartbeat_front_addr":"172.21.15.154:6821/2933728751","state":["exists","up"]},{"osd":7,"uuid":"07012d3b-3ab4-40df-a471-93caed22e2dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6824","nonce":1753500785},{"type":"v1","addr":"172.21.15.154:6825","nonce":1753500785}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6826","nonce":1753500785},{"type":"v1","addr":"172.21.15.154:6827","nonce":1753500785}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6830","nonce":1753500785},{"type":"v1","addr":"172.21.15.154:6831","nonce":1753500785}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6828","nonce":1753500785},{"type":"v1","addr":"172.21.15.154:6829","nonce":1753500785}]},"public_addr":"172.21.15.154:6825/1753500785","cluster_addr":"172.21.15.154:6827/1753500785","heartbeat_back_addr":"172.21.15.154:6831/1753500785","heartbeat_front_addr":"172.21.15.154:6829/1753500785","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-13T11:28:40.978603+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-13T11:28:41.200985+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-13T11:28:41.222815+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-13T11:28:41.202162+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-13T11:28:40.925911+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-13T11:28:41.087725+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-13T11:28:41.072208+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-13T11:28:40.875257+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-13T11:29:11.199 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:11.191+0000 7f7c92ce4640 1 -- 172.21.15.102:0/3386413099 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f7c70066470 msgr2=0x7f7c70068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:11.199 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:11.191+0000 7f7c92ce4640 1 --2- 172.21.15.102:0/3386413099 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f7c70066470 0x7f7c70068930 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f7c78007fd0 tx=0x7f7c78007940 comp rx=0 tx=0).stop 2023-11-13T11:29:11.199 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:11.191+0000 7f7c92ce4640 1 -- 172.21.15.102:0/3386413099 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7c8c0cf490 msgr2=0x7f7c8c159c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:11.199 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:11.191+0000 7f7c92ce4640 1 --2- 172.21.15.102:0/3386413099 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7c8c0cf490 0x7f7c8c159c10 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f7c8000e980 tx=0x7f7c8000ee40 comp rx=0 tx=0).stop 2023-11-13T11:29:11.199 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:11.191+0000 7f7c92ce4640 1 -- 172.21.15.102:0/3386413099 shutdown_connections 2023-11-13T11:29:11.200 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:11.191+0000 7f7c92ce4640 1 --2- 172.21.15.102:0/3386413099 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7c8c1606e0 0x7f7c8c14eab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:11.200 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:11.191+0000 7f7c92ce4640 1 --2- 172.21.15.102:0/3386413099 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7c8c0d0c40 0x7f7c8c0cc590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:11.200 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:11.191+0000 7f7c92ce4640 1 --2- 172.21.15.102:0/3386413099 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f7c70066470 0x7f7c70068930 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:11.200 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:11.191+0000 7f7c92ce4640 1 --2- 172.21.15.102:0/3386413099 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7c8c0cf490 0x7f7c8c159c10 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:11.200 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:11.191+0000 7f7c92ce4640 1 -- 172.21.15.102:0/3386413099 >> 172.21.15.102:0/3386413099 conn(0x7f7c8c09c130 msgr2=0x7f7c8c15dce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-13T11:29:11.201 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:11.191+0000 7f7c92ce4640 1 -- 172.21.15.102:0/3386413099 shutdown_connections 2023-11-13T11:29:11.201 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:11.191+0000 7f7c92ce4640 1 -- 172.21.15.102:0/3386413099 wait complete. 2023-11-13T11:29:11.216 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-13T11:29:11.354 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:11.347+0000 7f69142e3640 1 Processor -- start 2023-11-13T11:29:11.355 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:11.351+0000 7f69142e3640 1 -- start start 2023-11-13T11:29:11.356 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:11.351+0000 7f69142e3640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f690c0cfba0 0x7f690c0c69b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:11.356 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:11.351+0000 7f69142e3640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f690c0d1440 con 0x7f690c1606e0 2023-11-13T11:29:11.356 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:11.351+0000 7f69142e3640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f690c0cdb10 con 0x7f690c0d0c40 2023-11-13T11:29:11.356 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:11.351+0000 7f69142e3640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f690c0d1690 con 0x7f690c0cfba0 2023-11-13T11:29:11.357 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:11.351+0000 7f691207f640 1 --1- >> v1:172.21.15.102:6789/0 conn(0x7f690c1606e0 0x7f690c0b3e20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.102:6789/0 says I am v1:172.21.15.102:49696/0 (socket says 172.21.15.102:49696) 2023-11-13T11:29:11.357 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:11.351+0000 7f691207f640 1 -- 172.21.15.102:0/183920135 learned_addr learned my addr 172.21.15.102:0/183920135 (peer_addr_for_me v1:172.21.15.102:0/0) 2023-11-13T11:29:11.359 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:11.351+0000 7f6912880640 1 --2- 172.21.15.102:0/183920135 >> v2:172.21.15.154:3300/0 conn(0x7f690c0cfba0 0x7f690c0c69b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:11.359 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:11.351+0000 7f691107d640 1 -- 172.21.15.102:0/183920135 <== mon.0 v1:172.21.15.102:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 798493742 0 0) 0x7f690c0d1440 con 0x7f690c1606e0 2023-11-13T11:29:11.360 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:11.351+0000 7f691107d640 1 -- 172.21.15.102:0/183920135 --> v1:172.21.15.102:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f68f8003530 con 0x7f690c1606e0 2023-11-13T11:29:11.360 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:11.351+0000 7f691107d640 1 -- 172.21.15.102:0/183920135 <== mon.0 v1:172.21.15.102:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2575513568 0 0) 0x7f68f8003530 con 0x7f690c1606e0 2023-11-13T11:29:11.360 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:11.351+0000 7f691107d640 1 -- 172.21.15.102:0/183920135 >> v2:172.21.15.154:3300/0 conn(0x7f690c0cfba0 msgr2=0x7f690c0c69b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-13T11:29:11.360 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:11.351+0000 7f691107d640 1 --2- 172.21.15.102:0/183920135 >> v2:172.21.15.154:3300/0 conn(0x7f690c0cfba0 0x7f690c0c69b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:11.360 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:11.351+0000 7f691107d640 1 -- 172.21.15.102:0/183920135 >> v1:172.21.15.154:6789/0 conn(0x7f690c0d0c40 legacy=0x7f690c0cf490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:11.361 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:11.351+0000 7f691107d640 1 -- 172.21.15.102:0/183920135 --> v1:172.21.15.102:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f690c0d1970 con 0x7f690c1606e0 2023-11-13T11:29:11.361 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:11.351+0000 7f691107d640 1 -- 172.21.15.102:0/183920135 <== mon.0 v1:172.21.15.102:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 895381068 0 0) 0x7f6908001680 con 0x7f690c1606e0 2023-11-13T11:29:11.361 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:11.351+0000 7f691107d640 1 -- 172.21.15.102:0/183920135 >> v1:172.21.15.102:6789/0 conn(0x7f690c1606e0 legacy=0x7f690c0b3e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:11.361 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:11.351+0000 7f691107d640 1 --2- 172.21.15.102:0/183920135 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f68f8003980 0x7f68f8003d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:11.362 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:11.351+0000 7f691107d640 1 --2- 172.21.15.102:0/183920135 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f68f8004380 0x7f68f8004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:11.362 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:11.351+0000 7f691107d640 1 --2- 172.21.15.102:0/183920135 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f68f80050f0 0x7f68f800b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:11.362 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:11.351+0000 7f691107d640 1 -- 172.21.15.102:0/183920135 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f690c0d1690 con 0x7f68f8003980 2023-11-13T11:29:11.362 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:11.351+0000 7f691107d640 1 -- 172.21.15.102:0/183920135 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68f800c030 con 0x7f68f8004380 2023-11-13T11:29:11.362 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:11.351+0000 7f691107d640 1 -- 172.21.15.102:0/183920135 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f68f800c1f0 con 0x7f68f80050f0 2023-11-13T11:29:11.363 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:11.351+0000 7f691207f640 1 --2- 172.21.15.102:0/183920135 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f68f8003980 0x7f68f8003d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:11.363 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:11.351+0000 7f691187e640 1 --2- 172.21.15.102:0/183920135 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f68f8004380 0x7f68f8004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:11.363 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:11.351+0000 7f6912880640 1 --2- 172.21.15.102:0/183920135 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f68f80050f0 0x7f68f800b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:11.363 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:11.351+0000 7f691207f640 1 -- 172.21.15.102:0/183920135 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f68f80050f0 msgr2=0x7f68f800b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-13T11:29:11.364 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:11.351+0000 7f691207f640 1 --2- 172.21.15.102:0/183920135 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f68f80050f0 0x7f68f800b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:11.364 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:11.351+0000 7f691207f640 1 -- 172.21.15.102:0/183920135 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f68f8004380 msgr2=0x7f68f8004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-13T11:29:11.364 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:11.351+0000 7f691207f640 1 --2- 172.21.15.102:0/183920135 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f68f8004380 0x7f68f8004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:11.364 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:11.351+0000 7f691207f640 1 -- 172.21.15.102:0/183920135 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68f8003530 con 0x7f68f8003980 2023-11-13T11:29:11.365 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:11.351+0000 7f6912880640 1 --2- 172.21.15.102:0/183920135 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f68f80050f0 0x7f68f800b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-13T11:29:11.365 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:11.351+0000 7f6912880640 1 -- 172.21.15.102:0/183920135 reap_dead start 2023-11-13T11:29:11.369 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:11.355+0000 7f691207f640 1 --2- 172.21.15.102:0/183920135 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f68f8003980 0x7f68f8003d60 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f690800c210 tx=0x7f690801cbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d5edb9eafcde6adb server_cookie=0 in_seq=0 out_seq=0 2023-11-13T11:29:11.369 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:11.355+0000 7f691107d640 1 -- 172.21.15.102:0/183920135 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6908005ae0 con 0x7f68f8003980 2023-11-13T11:29:11.369 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:11.355+0000 7f691107d640 1 -- 172.21.15.102:0/183920135 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6908005c60 con 0x7f68f8003980 2023-11-13T11:29:11.369 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:11.355+0000 7f691107d640 1 -- 172.21.15.102:0/183920135 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69080a59e0 con 0x7f68f8003980 2023-11-13T11:29:11.370 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:11.355+0000 7f69142e3640 1 -- 172.21.15.102:0/183920135 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f68f8003980 msgr2=0x7f68f8003d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:11.370 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:11.355+0000 7f69142e3640 1 --2- 172.21.15.102:0/183920135 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f68f8003980 0x7f68f8003d60 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f690800c210 tx=0x7f690801cbe0 comp rx=0 tx=0).stop 2023-11-13T11:29:11.370 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:11.355+0000 7f69142e3640 1 -- 172.21.15.102:0/183920135 shutdown_connections 2023-11-13T11:29:11.370 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:11.355+0000 7f69142e3640 1 --2- 172.21.15.102:0/183920135 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f68f8003980 0x7f68f8003d60 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:11.370 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:11.355+0000 7f69142e3640 1 -- 172.21.15.102:0/183920135 >> 172.21.15.102:0/183920135 conn(0x7f690c09c130 msgr2=0x7f690c0d2e60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-13T11:29:11.371 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:11.355+0000 7f69142e3640 1 -- 172.21.15.102:0/183920135 shutdown_connections 2023-11-13T11:29:11.371 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:11.355+0000 7f69142e3640 1 -- 172.21.15.102:0/183920135 wait complete. 2023-11-13T11:29:11.371 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:11.359+0000 7f69142e3640 1 Processor -- start 2023-11-13T11:29:11.371 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:11.359+0000 7f69142e3640 1 -- start start 2023-11-13T11:29:11.372 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:11.359+0000 7f69142e3640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f68f8003980 0x7f690c0b74e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:11.372 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:11.359+0000 7f69142e3640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f690c152590 0x7f690c15cd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:11.372 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:11.359+0000 7f69142e3640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f690c15e780 0x7f690c15ec00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:11.372 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:11.359+0000 7f69142e3640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f690c15d240 con 0x7f68f8003980 2023-11-13T11:29:11.373 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:11.359+0000 7f69142e3640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f690c0caa70 con 0x7f690c15e780 2023-11-13T11:29:11.373 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:11.359+0000 7f69142e3640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f690c0b7ac0 con 0x7f690c152590 2023-11-13T11:29:11.374 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:11.359+0000 7f691207f640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f68f8003980 0x7f690c0b74e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:11.374 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:11.359+0000 7f691207f640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f68f8003980 0x7f690c0b74e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:47806/0 (socket says 172.21.15.102:47806) 2023-11-13T11:29:11.374 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:11.359+0000 7f691207f640 1 -- 172.21.15.102:0/3287258832 learned_addr learned my addr 172.21.15.102:0/3287258832 (peer_addr_for_me v2:172.21.15.102:0/0) 2023-11-13T11:29:11.374 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:11.359+0000 7f691207f640 1 -- 172.21.15.102:0/3287258832 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f690c152590 msgr2=0x7f690c15cd00 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-11-13T11:29:11.375 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:11.359+0000 7f691207f640 1 --2- 172.21.15.102:0/3287258832 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f690c152590 0x7f690c15cd00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:11.375 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:11.359+0000 7f691207f640 1 -- 172.21.15.102:0/3287258832 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f690c15e780 msgr2=0x7f690c15ec00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:11.375 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:11.359+0000 7f691207f640 1 --2- 172.21.15.102:0/3287258832 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f690c15e780 0x7f690c15ec00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:11.375 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:11.359+0000 7f691207f640 1 -- 172.21.15.102:0/3287258832 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f690c0b7da0 con 0x7f68f8003980 2023-11-13T11:29:11.375 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:11.359+0000 7f691207f640 1 --2- 172.21.15.102:0/3287258832 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f68f8003980 0x7f690c0b74e0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f690800c210 tx=0x7f68f8005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-13T11:29:11.376 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:11.359+0000 7f6902ffd640 1 -- 172.21.15.102:0/3287258832 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69080b4070 con 0x7f68f8003980 2023-11-13T11:29:11.376 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:11.359+0000 7f6902ffd640 1 -- 172.21.15.102:0/3287258832 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6908001480 con 0x7f68f8003980 2023-11-13T11:29:11.376 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:11.359+0000 7f6902ffd640 1 -- 172.21.15.102:0/3287258832 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69080017f0 con 0x7f68f8003980 2023-11-13T11:29:11.376 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:11.359+0000 7f69142e3640 1 -- 172.21.15.102:0/3287258832 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f690c15d240 con 0x7f68f8003980 2023-11-13T11:29:11.376 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:11.359+0000 7f69142e3640 1 -- 172.21.15.102:0/3287258832 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f690c0b8360 con 0x7f68f8003980 2023-11-13T11:29:11.376 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:11.363+0000 7f69142e3640 1 -- 172.21.15.102:0/3287258832 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f690c0cabb0 con 0x7f68f8003980 2023-11-13T11:29:11.377 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:11.363+0000 7f6902ffd640 1 -- 172.21.15.102:0/3287258832 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f69080a57a0 con 0x7f68f8003980 2023-11-13T11:29:11.378 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:11.363+0000 7f6902ffd640 1 --2- 172.21.15.102:0/3287258832 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f68f0066470 0x7f68f0068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:11.378 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:11.363+0000 7f6902ffd640 1 -- 172.21.15.102:0/3287258832 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f690811d940 con 0x7f68f8003980 2023-11-13T11:29:11.378 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:11.363+0000 7f691187e640 1 --2- 172.21.15.102:0/3287258832 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f68f0066470 0x7f68f0068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:11.378 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:11.363+0000 7f691187e640 1 --2- 172.21.15.102:0/3287258832 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f68f0066470 0x7f68f0068930 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f690c0cca00 tx=0x7f68fc009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-13T11:29:11.379 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:11.367+0000 7f6902ffd640 1 -- 172.21.15.102:0/3287258832 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f69080ead20 con 0x7f68f8003980 2023-11-13T11:29:11.550 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:11.543+0000 7f69142e3640 1 -- 172.21.15.102:0/3287258832 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f690c068520 con 0x7f68f8003980 2023-11-13T11:29:11.551 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:11.547+0000 7f6902ffd640 1 -- 172.21.15.102:0/3287258832 <== mon.0 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4913 (secure 0 0 0) 0x7f69080ee340 con 0x7f68f8003980 2023-11-13T11:29:11.551 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T11:29:11.552 INFO:teuthology.orchestra.run.smithi102.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4226,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.102:6836/659983176","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6835","nonce":659983176},{"type":"v1","addr":"172.21.15.102:6836","nonce":659983176}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4270,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.102:6837/1874856825","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6834","nonce":1874856825},{"type":"v1","addr":"172.21.15.102:6837","nonce":1874856825}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4276,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6834/532911681","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6832","nonce":532911681},{"type":"v1","addr":"172.21.15.154:6834","nonce":532911681}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-13T11:28:57.401001+0000","modified":"2023-11-13T11:29:00.404631+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4279},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4279":{"gid":4279,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.154:6835/3766337294","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6833","nonce":3766337294},{"type":"v1","addr":"172.21.15.154:6835","nonce":3766337294}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-11-13T11:29:11.552 INFO:teuthology.orchestra.run.smithi102.stderr:dumped fsmap epoch 8 2023-11-13T11:29:11.553 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:11.547+0000 7f69142e3640 1 -- 172.21.15.102:0/3287258832 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f68f0066470 msgr2=0x7f68f0068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:11.553 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:11.547+0000 7f69142e3640 1 --2- 172.21.15.102:0/3287258832 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f68f0066470 0x7f68f0068930 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f690c0cca00 tx=0x7f68fc009040 comp rx=0 tx=0).stop 2023-11-13T11:29:11.553 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:11.547+0000 7f69142e3640 1 -- 172.21.15.102:0/3287258832 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f68f8003980 msgr2=0x7f690c0b74e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:11.554 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:11.547+0000 7f69142e3640 1 --2- 172.21.15.102:0/3287258832 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f68f8003980 0x7f690c0b74e0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f690800c210 tx=0x7f68f8005800 comp rx=0 tx=0).stop 2023-11-13T11:29:11.554 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:11.547+0000 7f69142e3640 1 -- 172.21.15.102:0/3287258832 shutdown_connections 2023-11-13T11:29:11.554 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:11.547+0000 7f69142e3640 1 --2- 172.21.15.102:0/3287258832 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f690c15e780 0x7f690c15ec00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:11.555 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:11.547+0000 7f69142e3640 1 --2- 172.21.15.102:0/3287258832 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f690c152590 0x7f690c15cd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:11.555 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:11.547+0000 7f69142e3640 1 --2- 172.21.15.102:0/3287258832 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f68f0066470 0x7f68f0068930 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:11.555 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:11.547+0000 7f69142e3640 1 --2- 172.21.15.102:0/3287258832 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f68f8003980 0x7f690c0b74e0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:11.555 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:11.547+0000 7f69142e3640 1 -- 172.21.15.102:0/3287258832 >> 172.21.15.102:0/3287258832 conn(0x7f690c09c130 msgr2=0x7f690c161530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-13T11:29:11.555 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:11.547+0000 7f69142e3640 1 -- 172.21.15.102:0/3287258832 shutdown_connections 2023-11-13T11:29:11.556 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:11.547+0000 7f69142e3640 1 -- 172.21.15.102:0/3287258832 wait complete. 2023-11-13T11:29:11.974 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 8, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-11-13T11:28:57.401001+0000', 'modified': '2023-11-13T11:29:00.404631+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4279}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4279': {'gid': 4279, 'name': 'd', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.154:6835/3766337294', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.154:6833', 'nonce': 3766337294}, {'type': 'v1', 'addr': '172.21.15.154:6835', 'nonce': 3766337294}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [3], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-11-13T11:29:11.974 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-11-13T11:29:11.975 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.d status 2023-11-13T11:29:12.116 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:12.111+0000 7f955150e640 1 Processor -- start 2023-11-13T11:29:12.116 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:12.111+0000 7f955150e640 1 -- start start 2023-11-13T11:29:12.118 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:12.111+0000 7f955150e640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f954c06caa0 0x7f954c15e3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:12.118 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:12.111+0000 7f955150e640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f954c15e910 con 0x7f954c071900 2023-11-13T11:29:12.118 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:12.111+0000 7f955150e640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f954c140920 con 0x7f954c140540 2023-11-13T11:29:12.118 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:12.111+0000 7f955150e640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f954c0ccc50 con 0x7f954c06caa0 2023-11-13T11:29:12.118 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:12.111+0000 7f954b7fe640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f954c06caa0 0x7f954c15e3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:12.119 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:12.111+0000 7f95427fc640 1 --1- >> v1:172.21.15.102:6789/0 conn(0x7f954c071900 0x7f954c0b1c00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.102:6789/0 says I am v1:172.21.15.102:49704/0 (socket says 172.21.15.102:49704) 2023-11-13T11:29:12.119 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:12.111+0000 7f95427fc640 1 -- 172.21.15.102:0/91674293 learned_addr learned my addr 172.21.15.102:0/91674293 (peer_addr_for_me v1:172.21.15.102:0/0) 2023-11-13T11:29:12.120 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:12.111+0000 7f954a7fc640 1 -- 172.21.15.102:0/91674293 <== mon.0 v1:172.21.15.102:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4023681463 0 0) 0x7f95340014a0 con 0x7f954c071900 2023-11-13T11:29:12.120 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:12.111+0000 7f954a7fc640 1 -- 172.21.15.102:0/91674293 --> v1:172.21.15.102:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9538005740 con 0x7f954c071900 2023-11-13T11:29:12.120 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:12.111+0000 7f954b7fe640 1 -- 172.21.15.102:0/91674293 >> v1:172.21.15.154:6789/0 conn(0x7f954c140540 legacy=0x7f954c0711f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:12.120 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:12.111+0000 7f954b7fe640 1 -- 172.21.15.102:0/91674293 >> v1:172.21.15.102:6789/0 conn(0x7f954c071900 legacy=0x7f954c0b1c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:12.121 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:12.111+0000 7f954b7fe640 1 -- 172.21.15.102:0/91674293 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f954c06cfc0 con 0x7f954c06caa0 2023-11-13T11:29:12.123 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:12.115+0000 7f954b7fe640 1 --2- 172.21.15.102:0/91674293 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f954c06caa0 0x7f954c15e3d0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f95440097c0 tx=0x7f954401c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6c3fe9feff38d7fe server_cookie=0 in_seq=0 out_seq=0 2023-11-13T11:29:12.123 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:12.115+0000 7f954a7fc640 1 -- 172.21.15.102:0/91674293 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95440ab650 con 0x7f954c06caa0 2023-11-13T11:29:12.123 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:12.115+0000 7f954a7fc640 1 -- 172.21.15.102:0/91674293 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f95440ab7b0 con 0x7f954c06caa0 2023-11-13T11:29:12.123 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:12.115+0000 7f954a7fc640 1 -- 172.21.15.102:0/91674293 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95440abb20 con 0x7f954c06caa0 2023-11-13T11:29:12.124 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:12.115+0000 7f955150e640 1 -- 172.21.15.102:0/91674293 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f954c06caa0 msgr2=0x7f954c15e3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:12.124 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:12.115+0000 7f955150e640 1 --2- 172.21.15.102:0/91674293 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f954c06caa0 0x7f954c15e3d0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f95440097c0 tx=0x7f954401c450 comp rx=0 tx=0).stop 2023-11-13T11:29:12.124 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:12.115+0000 7f955150e640 1 -- 172.21.15.102:0/91674293 shutdown_connections 2023-11-13T11:29:12.124 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:12.115+0000 7f955150e640 1 --2- 172.21.15.102:0/91674293 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f954c06caa0 0x7f954c15e3d0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:12.124 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:12.115+0000 7f955150e640 1 -- 172.21.15.102:0/91674293 >> 172.21.15.102:0/91674293 conn(0x7f954c0b0870 msgr2=0x7f954c0b0c80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-13T11:29:12.125 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:12.115+0000 7f955150e640 1 -- 172.21.15.102:0/91674293 shutdown_connections 2023-11-13T11:29:12.125 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:12.115+0000 7f955150e640 1 -- 172.21.15.102:0/91674293 wait complete. 2023-11-13T11:29:12.127 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:12.119+0000 7f955150e640 1 Processor -- start 2023-11-13T11:29:12.127 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:12.119+0000 7f955150e640 1 -- start start 2023-11-13T11:29:12.127 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:12.119+0000 7f955150e640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f954c06caa0 0x7f954c13c960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:12.128 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:12.119+0000 7f955150e640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f954c071900 0x7f954c152cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:12.128 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:12.119+0000 7f955150e640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f954c140540 0x7f954c155b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:12.128 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:12.119+0000 7f955150e640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f954c1533a0 con 0x7f954c140540 2023-11-13T11:29:12.128 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:12.119+0000 7f955150e640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f954c150e70 con 0x7f954c06caa0 2023-11-13T11:29:12.128 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:12.119+0000 7f955150e640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f954c151150 con 0x7f954c071900 2023-11-13T11:29:12.128 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:12.119+0000 7f954b7fe640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f954c140540 0x7f954c155b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:12.129 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:12.119+0000 7f954b7fe640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f954c140540 0x7f954c155b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:47816/0 (socket says 172.21.15.102:47816) 2023-11-13T11:29:12.129 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:12.119+0000 7f954b7fe640 1 -- 172.21.15.102:0/1978348418 learned_addr learned my addr 172.21.15.102:0/1978348418 (peer_addr_for_me v2:172.21.15.102:0/0) 2023-11-13T11:29:12.129 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:12.119+0000 7f95427fc640 1 --2- 172.21.15.102:0/1978348418 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f954c071900 0x7f954c152cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:12.129 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:12.119+0000 7f954affd640 1 --2- 172.21.15.102:0/1978348418 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f954c06caa0 0x7f954c13c960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:12.129 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:12.119+0000 7f954b7fe640 1 -- 172.21.15.102:0/1978348418 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f954c071900 msgr2=0x7f954c152cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:12.130 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:12.119+0000 7f954b7fe640 1 --2- 172.21.15.102:0/1978348418 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f954c071900 0x7f954c152cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:12.130 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:12.119+0000 7f954b7fe640 1 -- 172.21.15.102:0/1978348418 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f954c06caa0 msgr2=0x7f954c13c960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:12.130 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:12.119+0000 7f954b7fe640 1 --2- 172.21.15.102:0/1978348418 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f954c06caa0 0x7f954c13c960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:12.130 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:12.119+0000 7f954b7fe640 1 -- 172.21.15.102:0/1978348418 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9544009420 con 0x7f954c140540 2023-11-13T11:29:12.130 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:12.119+0000 7f954affd640 1 --2- 172.21.15.102:0/1978348418 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f954c06caa0 0x7f954c13c960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-13T11:29:12.131 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:12.119+0000 7f954b7fe640 1 --2- 172.21.15.102:0/1978348418 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f954c140540 0x7f954c155b70 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f95440ad040 tx=0x7f954401ac90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-13T11:29:12.131 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:12.119+0000 7f9543fff640 1 -- 172.21.15.102:0/1978348418 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9544004230 con 0x7f954c140540 2023-11-13T11:29:12.131 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:12.119+0000 7f9543fff640 1 -- 172.21.15.102:0/1978348418 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f95440b9070 con 0x7f954c140540 2023-11-13T11:29:12.132 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:12.119+0000 7f955150e640 1 -- 172.21.15.102:0/1978348418 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f954c151430 con 0x7f954c140540 2023-11-13T11:29:12.132 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:12.119+0000 7f9543fff640 1 -- 172.21.15.102:0/1978348418 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9544003620 con 0x7f954c140540 2023-11-13T11:29:12.132 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:12.119+0000 7f955150e640 1 -- 172.21.15.102:0/1978348418 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f954c13d4b0 con 0x7f954c140540 2023-11-13T11:29:12.137 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:12.123+0000 7f9543fff640 1 -- 172.21.15.102:0/1978348418 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f9544003780 con 0x7f954c140540 2023-11-13T11:29:12.137 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:12.123+0000 7f9543fff640 1 --2- 172.21.15.102:0/1978348418 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f952c066470 0x7f952c068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:12.138 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:12.123+0000 7f9543fff640 1 -- 172.21.15.102:0/1978348418 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f95440bb070 con 0x7f954c140540 2023-11-13T11:29:12.138 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:12.123+0000 7f954affd640 1 --2- 172.21.15.102:0/1978348418 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f952c066470 0x7f952c068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:12.138 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:12.123+0000 7f9554876000 1 Processor -- start 2023-11-13T11:29:12.138 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:12.127+0000 7f954affd640 1 --2- 172.21.15.102:0/1978348418 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f952c066470 0x7f952c068930 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f953c001670 tx=0x7f953c009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-13T11:29:12.138 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:12.127+0000 7f9554876000 1 -- start start 2023-11-13T11:29:12.139 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:12.127+0000 7f9554876000 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x5557aba68c90 0x5557aba69070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:12.139 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:12.127+0000 7f9554876000 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5557aba695b0 0x5557aba1ede0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:12.139 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:12.127+0000 7f9554876000 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5557aba1f320 0x5557aba1f700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:12.139 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:12.127+0000 7f9554876000 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x5557ab889130 con 0x5557aba695b0 2023-11-13T11:29:12.139 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:12.127+0000 7f9554876000 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x5557ab8769a0 con 0x5557aba1f320 2023-11-13T11:29:12.140 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:12.127+0000 7f9554876000 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x5557ab873ed0 con 0x5557aba68c90 2023-11-13T11:29:12.140 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:12.127+0000 7f95427fc640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5557aba695b0 0x5557aba1ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:12.140 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:12.127+0000 7f95427fc640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5557aba695b0 0x5557aba1ede0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:47818/0 (socket says 172.21.15.102:47818) 2023-11-13T11:29:12.140 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:12.127+0000 7f95427fc640 1 -- 172.21.15.102:0/4132680093 learned_addr learned my addr 172.21.15.102:0/4132680093 (peer_addr_for_me v2:172.21.15.102:0/0) 2023-11-13T11:29:12.140 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:12.127+0000 7f954affd640 1 --2- 172.21.15.102:0/4132680093 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x5557aba68c90 0x5557aba69070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:12.140 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:12.127+0000 7f954b7fe640 1 --2- 172.21.15.102:0/4132680093 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5557aba1f320 0x5557aba1f700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:12.141 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:12.127+0000 7f95427fc640 1 -- 172.21.15.102:0/4132680093 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x5557aba68c90 msgr2=0x5557aba69070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-13T11:29:12.141 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:12.127+0000 7f95427fc640 1 --2- 172.21.15.102:0/4132680093 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x5557aba68c90 0x5557aba69070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:12.141 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:12.127+0000 7f95427fc640 1 -- 172.21.15.102:0/4132680093 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5557aba1f320 msgr2=0x5557aba1f700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-13T11:29:12.141 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:12.127+0000 7f95427fc640 1 --2- 172.21.15.102:0/4132680093 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5557aba1f320 0x5557aba1f700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:12.141 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:12.127+0000 7f95427fc640 1 -- 172.21.15.102:0/4132680093 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5557ab567890 con 0x5557aba695b0 2023-11-13T11:29:12.142 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:12.127+0000 7f954affd640 1 --2- 172.21.15.102:0/4132680093 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x5557aba68c90 0x5557aba69070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-13T11:29:12.142 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:12.127+0000 7f95427fc640 1 --2- 172.21.15.102:0/4132680093 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5557aba695b0 0x5557aba1ede0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f9534002070 tx=0x7f953400e530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d6ec70c19e0f0961 server_cookie=0 in_seq=0 out_seq=0 2023-11-13T11:29:12.142 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:12.127+0000 7f9540ff9640 1 -- 172.21.15.102:0/4132680093 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9534014480 con 0x5557aba695b0 2023-11-13T11:29:12.142 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:12.127+0000 7f9540ff9640 1 -- 172.21.15.102:0/4132680093 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f95340145e0 con 0x5557aba695b0 2023-11-13T11:29:12.142 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:12.127+0000 7f9540ff9640 1 -- 172.21.15.102:0/4132680093 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9534014990 con 0x5557aba695b0 2023-11-13T11:29:12.143 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:12.127+0000 7f9554876000 1 -- 172.21.15.102:0/4132680093 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5557aba695b0 msgr2=0x5557aba1ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:12.143 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:12.127+0000 7f9554876000 1 --2- 172.21.15.102:0/4132680093 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5557aba695b0 0x5557aba1ede0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f9534002070 tx=0x7f953400e530 comp rx=0 tx=0).stop 2023-11-13T11:29:12.143 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:12.127+0000 7f9554876000 1 -- 172.21.15.102:0/4132680093 shutdown_connections 2023-11-13T11:29:12.143 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:12.127+0000 7f9554876000 1 --2- 172.21.15.102:0/4132680093 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5557aba1f320 0x5557aba1f700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:12.143 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:12.127+0000 7f9554876000 1 --2- 172.21.15.102:0/4132680093 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5557aba695b0 0x5557aba1ede0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:12.144 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:12.127+0000 7f9554876000 1 --2- 172.21.15.102:0/4132680093 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x5557aba68c90 0x5557aba69070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:12.144 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:12.127+0000 7f9554876000 1 -- 172.21.15.102:0/4132680093 >> 172.21.15.102:0/4132680093 conn(0x5557aba1b2d0 msgr2=0x5557aba1d6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-13T11:29:12.144 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:12.127+0000 7f9554876000 1 -- 172.21.15.102:0/4132680093 shutdown_connections 2023-11-13T11:29:12.144 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:12.127+0000 7f9554876000 1 -- 172.21.15.102:0/4132680093 wait complete. 2023-11-13T11:29:12.144 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:12.127+0000 7f9554876000 1 -- start start 2023-11-13T11:29:12.145 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:12.131+0000 7f9554876000 1 Processor -- start 2023-11-13T11:29:12.145 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:12.131+0000 7f9554876000 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x5557aba1f320 0x5557aba23d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:12.145 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:12.131+0000 7f9554876000 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5557aba68c90 0x5557aba24280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:12.145 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:12.131+0000 7f9554876000 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5557aba695b0 0x5557aba37910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:12.145 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:12.131+0000 7f9554876000 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x5557ab86f7c0 con 0x5557aba695b0 2023-11-13T11:29:12.146 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:12.131+0000 7f9554876000 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x5557ab827bf0 con 0x5557aba68c90 2023-11-13T11:29:12.146 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:12.131+0000 7f9554876000 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x5557ab82da90 con 0x5557aba1f320 2023-11-13T11:29:12.146 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:12.131+0000 7f9554876000 10 client.0 _ll_register_callbacks cb 0x5557aba0a3c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-13T11:29:12.146 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:12.131+0000 7f954b7fe640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5557aba695b0 0x5557aba37910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:12.146 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:12.131+0000 7f954b7fe640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5557aba695b0 0x5557aba37910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:47826/0 (socket says 172.21.15.102:47826) 2023-11-13T11:29:12.147 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:12.131+0000 7f954b7fe640 1 -- 172.21.15.102:0/2004566282 learned_addr learned my addr 172.21.15.102:0/2004566282 (peer_addr_for_me v2:172.21.15.102:0/0) 2023-11-13T11:29:12.147 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:12.131+0000 7f954affd640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x5557aba1f320 0x5557aba23d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:12.147 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:12.131+0000 7f95427fc640 1 --2- 172.21.15.102:0/2004566282 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5557aba68c90 0x5557aba24280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:12.147 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:12.131+0000 7f954b7fe640 1 -- 172.21.15.102:0/2004566282 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x5557aba1f320 msgr2=0x5557aba23d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-13T11:29:12.147 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:12.131+0000 7f954b7fe640 1 --2- 172.21.15.102:0/2004566282 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x5557aba1f320 0x5557aba23d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:12.148 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:12.131+0000 7f954b7fe640 1 -- 172.21.15.102:0/2004566282 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5557aba68c90 msgr2=0x5557aba24280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-13T11:29:12.148 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:12.131+0000 7f954b7fe640 1 --2- 172.21.15.102:0/2004566282 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5557aba68c90 0x5557aba24280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:12.148 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:12.131+0000 7f954b7fe640 1 -- 172.21.15.102:0/2004566282 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f953400f040 con 0x5557aba695b0 2023-11-13T11:29:12.148 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:12.131+0000 7f954b7fe640 1 --2- 172.21.15.102:0/2004566282 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5557aba695b0 0x5557aba37910 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f954401c9c0 tx=0x7f95440ef460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2005121859ba2714 server_cookie=0 in_seq=0 out_seq=0 2023-11-13T11:29:12.149 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:12.131+0000 7f9529ffb640 10 client.0 ms_handle_connect on v2:172.21.15.102:3300/0 2023-11-13T11:29:12.149 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:12.131+0000 7f9529ffb640 1 -- 172.21.15.102:0/2004566282 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95440f3b90 con 0x5557aba695b0 2023-11-13T11:29:12.149 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:12.131+0000 7f9529ffb640 1 -- 172.21.15.102:0/2004566282 <== mon.0 v2:172.21.15.102:3300/0 2 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f95440f7d40 con 0x5557aba695b0 2023-11-13T11:29:12.149 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:12.131+0000 7f9554876000 1 -- 172.21.15.102:0/2004566282 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5557ab831470 con 0x5557aba695b0 2023-11-13T11:29:12.149 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:12.131+0000 7f9529ffb640 1 -- 172.21.15.102:0/2004566282 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_get_version_reply(handle=1 version=8) v2 ==== 24+0+0 (secure 0 0 0) 0x7f95440f78b0 con 0x5557aba695b0 2023-11-13T11:29:12.149 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:12.131+0000 7f9554876000 10 client.4686 fetch_fsmap learned FSMap version 8 2023-11-13T11:29:12.150 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:12.131+0000 7f9554876000 1 -- 172.21.15.102:0/2004566282 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,fsmap=8,monmap=2+}) v3 -- 0x5557ab830190 con 0x5557aba695b0 2023-11-13T11:29:12.150 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:12.131+0000 7f9529ffb640 1 -- 172.21.15.102:0/2004566282 <== mon.0 v2:172.21.15.102:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5557ab831470 con 0x5557aba695b0 2023-11-13T11:29:12.150 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:12.131+0000 7f9529ffb640 1 -- 172.21.15.102:0/2004566282 <== mon.0 v2:172.21.15.102:3300/0 5 ==== fsmap(e 8) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f95440c8020 con 0x5557aba695b0 2023-11-13T11:29:12.150 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:12.131+0000 7f9554876000 10 client.4686 fetch_fsmap finished waiting for FSMap version 8 2023-11-13T11:29:12.150 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:12.131+0000 7f9554876000 10 client.4686 resolve_mds: resolved name 'd' to daemon mds.d 2023-11-13T11:29:12.151 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:12.131+0000 7f9554876000 20 client.4686 populate_metadata read hostname 'smithi102' 2023-11-13T11:29:12.151 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:12.131+0000 7f9554876000 1 --2- 172.21.15.102:0/2004566282 >> [v2:172.21.15.154:6833/3766337294,v1:172.21.15.154:6835/3766337294] conn(0x5557aba38320 0x5557aba7af50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:12.151 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:12.131+0000 7f9554876000 4 client.4686 mds_command: new command op to 4279 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-11-13T11:29:12.151 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:12.131+0000 7f9554876000 1 -- 172.21.15.102:0/2004566282 --> [v2:172.21.15.154:6833/3766337294,v1:172.21.15.154:6835/3766337294] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5557ab834b50 con 0x5557aba38320 2023-11-13T11:29:12.151 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:12.131+0000 7f954affd640 1 --2- 172.21.15.102:0/2004566282 >> [v2:172.21.15.154:6833/3766337294,v1:172.21.15.154:6835/3766337294] conn(0x5557aba38320 0x5557aba7af50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:12.153 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:12.131+0000 7f954affd640 1 --2- 172.21.15.102:0/2004566282 >> [v2:172.21.15.154:6833/3766337294,v1:172.21.15.154:6835/3766337294] conn(0x5557aba38320 0x5557aba7af50 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5ceacc1f025443de server_cookie=3715d1cb16aa417b in_seq=0 out_seq=0 2023-11-13T11:29:12.153 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:12.131+0000 7f9529ffb640 10 client.4686 ms_handle_connect on v2:172.21.15.154:6833/3766337294 2023-11-13T11:29:12.153 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:12.135+0000 7f9529ffb640 1 -- 172.21.15.102:0/2004566282 <== mds.0 v2:172.21.15.154:6833/3766337294 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x5557ab834b50 con 0x5557aba38320 2023-11-13T11:29:12.153 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:12.135+0000 7f9529ffb640 10 client.4686 handle_command_reply: tid=0 2023-11-13T11:29:12.153 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:12.135+0000 7f9554876000 1 client.4686 shutdown 2023-11-13T11:29:12.154 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:12.135+0000 7f9554876000 1 -- 172.21.15.102:0/2004566282 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5557aba695b0 msgr2=0x5557aba37910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:12.154 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:12.135+0000 7f9554876000 1 --2- 172.21.15.102:0/2004566282 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5557aba695b0 0x5557aba37910 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f954401c9c0 tx=0x7f95440ef460 comp rx=0 tx=0).stop 2023-11-13T11:29:12.154 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:12.135+0000 7f9554876000 1 -- 172.21.15.102:0/2004566282 shutdown_connections 2023-11-13T11:29:12.154 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:12.135+0000 7f9554876000 1 --2- 172.21.15.102:0/2004566282 >> [v2:172.21.15.154:6833/3766337294,v1:172.21.15.154:6835/3766337294] conn(0x5557aba38320 0x5557aba7af50 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:12.154 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:12.135+0000 7f9554876000 1 --2- 172.21.15.102:0/2004566282 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5557aba695b0 0x5557aba37910 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:12.155 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:12.135+0000 7f9554876000 1 --2- 172.21.15.102:0/2004566282 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5557aba68c90 0x5557aba24280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:12.155 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:12.135+0000 7f9554876000 1 --2- 172.21.15.102:0/2004566282 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x5557aba1f320 0x5557aba23d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:12.155 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:12.135+0000 7f9529ffb640 0 client.4686 ms_handle_reset on v2:172.21.15.154:6833/3766337294 2023-11-13T11:29:12.155 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:12.135+0000 7f9554876000 1 -- 172.21.15.102:0/2004566282 >> 172.21.15.102:0/2004566282 conn(0x5557aba1b2d0 msgr2=0x5557aba1d6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-13T11:29:12.155 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:12.135+0000 7f9554876000 1 -- 172.21.15.102:0/2004566282 shutdown_connections 2023-11-13T11:29:12.156 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:12.135+0000 7f9554876000 1 -- 172.21.15.102:0/2004566282 wait complete. 2023-11-13T11:29:12.156 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:12.135+0000 7f9554876000 20 client.4686 trim_cache size 0 max 16384 2023-11-13T11:29:12.158 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:12.151+0000 7f9554876000 1 Processor -- start 2023-11-13T11:29:12.158 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:12.151+0000 7f9554876000 1 -- start start 2023-11-13T11:29:12.158 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:12.151+0000 7f9554876000 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5557aba1f320 0x5557aba67a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:12.158 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:12.151+0000 7f9554876000 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x5557aba68c90 0x5557aba66b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:12.158 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:12.151+0000 7f9554876000 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5557aba695b0 0x5557aba67070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:12.159 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:12.151+0000 7f9554876000 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x5557ab528940 con 0x5557aba695b0 2023-11-13T11:29:12.159 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:12.151+0000 7f9554876000 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x5557aba378c0 con 0x5557aba1f320 2023-11-13T11:29:12.159 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:12.151+0000 7f9554876000 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x5557aba1ac70 con 0x5557aba68c90 2023-11-13T11:29:12.159 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:12.151+0000 7f954b7fe640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5557aba695b0 0x5557aba67070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:12.159 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:12.151+0000 7f954b7fe640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5557aba695b0 0x5557aba67070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:47836/0 (socket says 172.21.15.102:47836) 2023-11-13T11:29:12.160 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:12.151+0000 7f954b7fe640 1 -- 172.21.15.102:0/1848337448 learned_addr learned my addr 172.21.15.102:0/1848337448 (peer_addr_for_me v2:172.21.15.102:0/0) 2023-11-13T11:29:12.160 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:12.151+0000 7f954b7fe640 1 -- 172.21.15.102:0/1848337448 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x5557aba68c90 msgr2=0x5557aba66b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-13T11:29:12.160 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:12.151+0000 7f954b7fe640 1 --2- 172.21.15.102:0/1848337448 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x5557aba68c90 0x5557aba66b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:12.160 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:12.151+0000 7f954b7fe640 1 -- 172.21.15.102:0/1848337448 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5557aba1f320 msgr2=0x5557aba67a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-13T11:29:12.160 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:12.151+0000 7f954b7fe640 1 --2- 172.21.15.102:0/1848337448 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5557aba1f320 0x5557aba67a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:12.161 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:12.151+0000 7f954b7fe640 1 -- 172.21.15.102:0/1848337448 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5557ab816490 con 0x5557aba695b0 2023-11-13T11:29:12.161 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:12.151+0000 7f954b7fe640 1 --2- 172.21.15.102:0/1848337448 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5557aba695b0 0x5557aba67070 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f954401c930 tx=0x7f9544106000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1ec489887730fc2b server_cookie=0 in_seq=0 out_seq=0 2023-11-13T11:29:12.161 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:12.151+0000 7f95417fa640 1 -- 172.21.15.102:0/1848337448 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95440f78b0 con 0x5557aba695b0 2023-11-13T11:29:12.161 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:12.151+0000 7f95417fa640 1 -- 172.21.15.102:0/1848337448 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f95440ef580 con 0x5557aba695b0 2023-11-13T11:29:12.161 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:12.151+0000 7f95417fa640 1 -- 172.21.15.102:0/1848337448 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95440f3b90 con 0x5557aba695b0 2023-11-13T11:29:12.161 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:12.151+0000 7f9554876000 1 -- 172.21.15.102:0/1848337448 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5557aba695b0 msgr2=0x5557aba67070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:12.162 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:12.151+0000 7f9554876000 1 --2- 172.21.15.102:0/1848337448 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5557aba695b0 0x5557aba67070 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f954401c930 tx=0x7f9544106000 comp rx=0 tx=0).stop 2023-11-13T11:29:12.162 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:12.151+0000 7f9554876000 1 -- 172.21.15.102:0/1848337448 shutdown_connections 2023-11-13T11:29:12.162 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:12.151+0000 7f9554876000 1 --2- 172.21.15.102:0/1848337448 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5557aba695b0 0x5557aba67070 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:12.162 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:12.151+0000 7f9554876000 1 --2- 172.21.15.102:0/1848337448 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x5557aba68c90 0x5557aba66b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:12.162 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:12.151+0000 7f9554876000 1 --2- 172.21.15.102:0/1848337448 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5557aba1f320 0x5557aba67a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:12.163 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:12.151+0000 7f9554876000 1 -- 172.21.15.102:0/1848337448 >> 172.21.15.102:0/1848337448 conn(0x5557aba1b2d0 msgr2=0x5557aba1d6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-13T11:29:12.163 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:12.151+0000 7f9554876000 1 -- 172.21.15.102:0/1848337448 shutdown_connections 2023-11-13T11:29:12.163 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:12.151+0000 7f9554876000 1 -- 172.21.15.102:0/1848337448 wait complete. 2023-11-13T11:29:12.166 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:12.151+0000 7f9554876000 1 -- start start 2023-11-13T11:29:12.166 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:12.155+0000 7f9554876000 1 Processor -- start 2023-11-13T11:29:12.167 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:12.155+0000 7f9554876000 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5557aba1f320 0x5557aba4b7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:12.167 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:12.155+0000 7f9554876000 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x5557aba68c90 0x5557aba4bd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:12.167 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:12.155+0000 7f9554876000 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5557aba695b0 0x5557aba7af50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:12.167 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:12.155+0000 7f9554876000 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x5557ab86cbc0 con 0x5557aba1f320 2023-11-13T11:29:12.168 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:12.155+0000 7f9554876000 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x5557ab849e30 con 0x5557aba695b0 2023-11-13T11:29:12.168 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:12.155+0000 7f9554876000 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x5557ab865aa0 con 0x5557aba68c90 2023-11-13T11:29:12.168 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:12.155+0000 7f9554876000 10 client.0 _ll_register_callbacks cb 0x5557ab8bdc00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-13T11:29:12.168 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:12.155+0000 7f954affd640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5557aba1f320 0x5557aba4b7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:12.168 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:12.155+0000 7f954affd640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5557aba1f320 0x5557aba4b7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:47852/0 (socket says 172.21.15.102:47852) 2023-11-13T11:29:12.169 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:12.155+0000 7f954affd640 1 -- 172.21.15.102:0/1308949127 learned_addr learned my addr 172.21.15.102:0/1308949127 (peer_addr_for_me v2:172.21.15.102:0/0) 2023-11-13T11:29:12.169 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:12.155+0000 7f95427fc640 1 --2- 172.21.15.102:0/1308949127 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x5557aba68c90 0x5557aba4bd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:12.169 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:12.155+0000 7f954b7fe640 1 --2- 172.21.15.102:0/1308949127 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5557aba695b0 0x5557aba7af50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:12.169 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:12.155+0000 7f954affd640 1 -- 172.21.15.102:0/1308949127 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x5557aba68c90 msgr2=0x5557aba4bd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-13T11:29:12.169 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:12.155+0000 7f954affd640 1 --2- 172.21.15.102:0/1308949127 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x5557aba68c90 0x5557aba4bd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:12.170 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:12.155+0000 7f954affd640 1 -- 172.21.15.102:0/1308949127 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5557aba695b0 msgr2=0x5557aba7af50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-13T11:29:12.170 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:12.155+0000 7f954affd640 1 --2- 172.21.15.102:0/1308949127 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5557aba695b0 0x5557aba7af50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:12.170 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:12.155+0000 7f954affd640 1 -- 172.21.15.102:0/1308949127 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5557ab830190 con 0x5557aba1f320 2023-11-13T11:29:12.170 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:12.155+0000 7f954affd640 1 --2- 172.21.15.102:0/1308949127 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5557aba1f320 0x5557aba4b7e0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f953c007e90 tx=0x7f953c000ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4261ea3fcb2d7f8b server_cookie=0 in_seq=0 out_seq=0 2023-11-13T11:29:12.170 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:12.155+0000 7f9529ffb640 10 client.0 ms_handle_connect on v2:172.21.15.102:3300/0 2023-11-13T11:29:12.171 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:12.155+0000 7f9529ffb640 1 -- 172.21.15.102:0/1308949127 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f953c00ecb0 con 0x5557aba1f320 2023-11-13T11:29:12.171 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:12.155+0000 7f9529ffb640 1 -- 172.21.15.102:0/1308949127 <== mon.0 v2:172.21.15.102:3300/0 2 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f953c00ee10 con 0x5557aba1f320 2023-11-13T11:29:12.171 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:12.155+0000 7f9554876000 1 -- 172.21.15.102:0/1308949127 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5557ab86e110 con 0x5557aba1f320 2023-11-13T11:29:12.171 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:12.155+0000 7f9529ffb640 1 -- 172.21.15.102:0/1308949127 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_get_version_reply(handle=1 version=8) v2 ==== 24+0+0 (secure 0 0 0) 0x7f953c003600 con 0x5557aba1f320 2023-11-13T11:29:12.171 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:12.155+0000 7f9554876000 10 client.4692 fetch_fsmap learned FSMap version 8 2023-11-13T11:29:12.172 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:12.155+0000 7f9554876000 1 -- 172.21.15.102:0/1308949127 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,fsmap=8,monmap=2+}) v3 -- 0x5557ab567cc0 con 0x5557aba1f320 2023-11-13T11:29:12.172 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:12.155+0000 7f9529ffb640 1 -- 172.21.15.102:0/1308949127 <== mon.0 v2:172.21.15.102:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5557ab86e110 con 0x5557aba1f320 2023-11-13T11:29:12.172 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:12.155+0000 7f9529ffb640 1 -- 172.21.15.102:0/1308949127 <== mon.0 v2:172.21.15.102:3300/0 5 ==== fsmap(e 8) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f953c003760 con 0x5557aba1f320 2023-11-13T11:29:12.172 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:12.155+0000 7f9554876000 10 client.4692 fetch_fsmap finished waiting for FSMap version 8 2023-11-13T11:29:12.172 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:12.155+0000 7f9554876000 10 client.4692 resolve_mds: resolved name 'd' to daemon mds.d 2023-11-13T11:29:12.172 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:12.155+0000 7f9554876000 20 client.4692 populate_metadata read hostname 'smithi102' 2023-11-13T11:29:12.173 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:12.155+0000 7f9554876000 1 --2- 172.21.15.102:0/1308949127 >> [v2:172.21.15.154:6833/3766337294,v1:172.21.15.154:6835/3766337294] conn(0x5557aba7b490 0x5557aba7b870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:12.173 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:12.155+0000 7f9554876000 4 client.4692 mds_command: new command op to 4279 tid=0 multi_id=0 [{"prefix": "status"}] 2023-11-13T11:29:12.173 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:12.155+0000 7f9554876000 1 -- 172.21.15.102:0/1308949127 --> [v2:172.21.15.154:6833/3766337294,v1:172.21.15.154:6835/3766337294] -- command(tid 0: {"prefix": "status"}) v1 -- 0x5557ab89d9a0 con 0x5557aba7b490 2023-11-13T11:29:12.173 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:12.155+0000 7f95427fc640 1 --2- 172.21.15.102:0/1308949127 >> [v2:172.21.15.154:6833/3766337294,v1:172.21.15.154:6835/3766337294] conn(0x5557aba7b490 0x5557aba7b870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:12.173 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:12.155+0000 7f95427fc640 1 --2- 172.21.15.102:0/1308949127 >> [v2:172.21.15.154:6833/3766337294,v1:172.21.15.154:6835/3766337294] conn(0x5557aba7b490 0x5557aba7b870 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f600a56bf0d9e3b1 server_cookie=b85b96432860c44f in_seq=0 out_seq=0 2023-11-13T11:29:12.174 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:12.155+0000 7f9529ffb640 10 client.4692 ms_handle_connect on v2:172.21.15.154:6833/3766337294 2023-11-13T11:29:12.174 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:12.159+0000 7f9529ffb640 1 -- 172.21.15.102:0/1308949127 <== mds.0 v2:172.21.15.154:6833/3766337294 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+330 (crc 0 0 0) 0x5557ab89d9a0 con 0x5557aba7b490 2023-11-13T11:29:12.174 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:12.159+0000 7f9529ffb640 10 client.4692 handle_command_reply: tid=0 2023-11-13T11:29:12.174 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:12.159+0000 7f9554876000 1 client.4692 shutdown 2023-11-13T11:29:12.174 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:12.159+0000 7f9554876000 1 -- 172.21.15.102:0/1308949127 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5557aba1f320 msgr2=0x5557aba4b7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:12.175 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:12.159+0000 7f9554876000 1 --2- 172.21.15.102:0/1308949127 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5557aba1f320 0x5557aba4b7e0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f953c007e90 tx=0x7f953c000ee0 comp rx=0 tx=0).stop 2023-11-13T11:29:12.175 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:12.159+0000 7f9554876000 1 -- 172.21.15.102:0/1308949127 shutdown_connections 2023-11-13T11:29:12.175 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:12.159+0000 7f9554876000 1 --2- 172.21.15.102:0/1308949127 >> [v2:172.21.15.154:6833/3766337294,v1:172.21.15.154:6835/3766337294] conn(0x5557aba7b490 0x5557aba7b870 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:12.175 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:12.159+0000 7f9554876000 1 --2- 172.21.15.102:0/1308949127 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5557aba695b0 0x5557aba7af50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:12.175 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:12.159+0000 7f9554876000 1 --2- 172.21.15.102:0/1308949127 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x5557aba68c90 0x5557aba4bd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:12.176 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:12.159+0000 7f9554876000 1 --2- 172.21.15.102:0/1308949127 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5557aba1f320 0x5557aba4b7e0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:12.176 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:12.159+0000 7f9529ffb640 0 client.4692 ms_handle_reset on v2:172.21.15.154:6833/3766337294 2023-11-13T11:29:12.176 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:12.159+0000 7f9554876000 1 -- 172.21.15.102:0/1308949127 >> 172.21.15.102:0/1308949127 conn(0x5557aba1b2d0 msgr2=0x5557aba760f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-13T11:29:12.176 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:12.159+0000 7f9554876000 1 -- 172.21.15.102:0/1308949127 shutdown_connections 2023-11-13T11:29:12.176 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:12.159+0000 7f9554876000 1 -- 172.21.15.102:0/1308949127 wait complete. 2023-11-13T11:29:12.176 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:12.159+0000 7f9554876000 20 client.4692 trim_cache size 0 max 16384 2023-11-13T11:29:12.177 INFO:teuthology.orchestra.run.smithi102.stdout:{ 2023-11-13T11:29:12.177 INFO:teuthology.orchestra.run.smithi102.stdout: "cluster_fsid": "97b3eb2b-7ccf-4aae-8d92-bff986c671ea", 2023-11-13T11:29:12.177 INFO:teuthology.orchestra.run.smithi102.stdout: "whoami": 0, 2023-11-13T11:29:12.178 INFO:teuthology.orchestra.run.smithi102.stdout: "id": 4279, 2023-11-13T11:29:12.178 INFO:teuthology.orchestra.run.smithi102.stdout: "want_state": "up:active", 2023-11-13T11:29:12.178 INFO:teuthology.orchestra.run.smithi102.stdout: "state": "up:active", 2023-11-13T11:29:12.178 INFO:teuthology.orchestra.run.smithi102.stdout: "fs_name": "cephfs", 2023-11-13T11:29:12.178 INFO:teuthology.orchestra.run.smithi102.stdout: "rank_uptime": 14.142676938999999, 2023-11-13T11:29:12.178 INFO:teuthology.orchestra.run.smithi102.stdout: "mdsmap_epoch": 8, 2023-11-13T11:29:12.179 INFO:teuthology.orchestra.run.smithi102.stdout: "osdmap_epoch": 22, 2023-11-13T11:29:12.179 INFO:teuthology.orchestra.run.smithi102.stdout: "osdmap_epoch_barrier": 22, 2023-11-13T11:29:12.179 INFO:teuthology.orchestra.run.smithi102.stdout: "uptime": 20.828912368000001 2023-11-13T11:29:12.179 INFO:teuthology.orchestra.run.smithi102.stdout:} 2023-11-13T11:29:12.180 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:12.159+0000 7f955150e640 1 -- 172.21.15.102:0/1978348418 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f952c066470 msgr2=0x7f952c068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:12.180 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:12.159+0000 7f955150e640 1 --2- 172.21.15.102:0/1978348418 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f952c066470 0x7f952c068930 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f953c001670 tx=0x7f953c009040 comp rx=0 tx=0).stop 2023-11-13T11:29:12.181 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:12.159+0000 7f955150e640 1 -- 172.21.15.102:0/1978348418 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f954c140540 msgr2=0x7f954c155b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:12.181 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:12.159+0000 7f955150e640 1 --2- 172.21.15.102:0/1978348418 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f954c140540 0x7f954c155b70 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f95440ad040 tx=0x7f954401ac90 comp rx=0 tx=0).stop 2023-11-13T11:29:12.181 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:12.159+0000 7f955150e640 1 -- 172.21.15.102:0/1978348418 shutdown_connections 2023-11-13T11:29:12.181 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:12.159+0000 7f955150e640 1 --2- 172.21.15.102:0/1978348418 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f952c066470 0x7f952c068930 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:12.181 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:12.159+0000 7f955150e640 1 --2- 172.21.15.102:0/1978348418 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f954c140540 0x7f954c155b70 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:12.181 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:12.159+0000 7f955150e640 1 --2- 172.21.15.102:0/1978348418 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f954c071900 0x7f954c152cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:12.182 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:12.159+0000 7f955150e640 1 --2- 172.21.15.102:0/1978348418 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f954c06caa0 0x7f954c13c960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:12.182 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:12.159+0000 7f955150e640 1 -- 172.21.15.102:0/1978348418 >> 172.21.15.102:0/1978348418 conn(0x7f954c0b0870 msgr2=0x7f954c0cd250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-13T11:29:12.182 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:12.159+0000 7f955150e640 1 -- 172.21.15.102:0/1978348418 shutdown_connections 2023-11-13T11:29:12.182 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:12.159+0000 7f955150e640 1 -- 172.21.15.102:0/1978348418 wait complete. 2023-11-13T11:29:12.184 INFO:teuthology.run_tasks:Running task ceph-fuse... 2023-11-13T11:29:12.207 INFO:tasks.ceph_fuse:Running ceph_fuse task... 2023-11-13T11:29:12.208 INFO:tasks.ceph_fuse:config is {'client.0': {}, 'client.2': {}, 'client.1': {}, 'client.3': {}} 2023-11-13T11:29:12.208 INFO:tasks.ceph_fuse:client.0 config is {} 2023-11-13T11:29:12.209 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-11-13T11:29:12.209 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-11-13T11:29:12.210 INFO:tasks.ceph_fuse:client.2 config is {} 2023-11-13T11:29:12.210 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-11-13T11:29:12.210 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2023-11-13T11:29:12.210 INFO:tasks.ceph_fuse:client.1 config is {} 2023-11-13T11:29:12.211 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-11-13T11:29:12.211 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-11-13T11:29:12.211 INFO:tasks.ceph_fuse:client.3 config is {} 2023-11-13T11:29:12.211 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-11-13T11:29:12.212 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.3 2023-11-13T11:29:12.212 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-13T11:29:12.212 DEBUG:teuthology.orchestra.run.smithi102:> ip netns list 2023-11-13T11:29:12.223 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-13T11:29:12.223 DEBUG:teuthology.orchestra.run.smithi102:> sudo ip link delete ceph-brx 2023-11-13T11:29:12.289 INFO:teuthology.orchestra.run.smithi102.stderr:Cannot find device "ceph-brx" 2023-11-13T11:29:12.290 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-13T11:29:12.291 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-13T11:29:12.291 DEBUG:teuthology.orchestra.run.smithi154:> ip netns list 2023-11-13T11:29:12.302 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-13T11:29:12.302 DEBUG:teuthology.orchestra.run.smithi154:> sudo ip link delete ceph-brx 2023-11-13T11:29:12.368 INFO:teuthology.orchestra.run.smithi154.stderr:Cannot find device "ceph-brx" 2023-11-13T11:29:12.369 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-13T11:29:12.370 INFO:tasks.ceph_fuse:Mounting ceph-fuse clients... 2023-11-13T11:29:12.371 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-11-13T11:29:12.508 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:12.503+0000 7f1a7ec6b640 1 Processor -- start 2023-11-13T11:29:12.509 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:12.503+0000 7f1a7ec6b640 1 -- start start 2023-11-13T11:29:12.510 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:12.503+0000 7f1a7ec6b640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f1a7806c2c0 0x7f1a780cf810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:12.510 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:12.503+0000 7f1a7ec6b640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f1a7815d300 0x7f1a7806b560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:12.510 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:12.503+0000 7f1a7ec6b640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1a780b0a80 con 0x7f1a7815cf20 2023-11-13T11:29:12.511 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:12.503+0000 7f1a7ec6b640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1a7815d6e0 con 0x7f1a7806c2c0 2023-11-13T11:29:12.511 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:12.503+0000 7f1a7ec6b640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1a780cfea0 con 0x7f1a7815d300 2023-11-13T11:29:12.511 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:12.503+0000 7f1a77fff640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f1a7806c2c0 0x7f1a780cf810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:12.511 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:12.503+0000 7f1a77fff640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f1a7806c2c0 0x7f1a780cf810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:47864/0 (socket says 172.21.15.102:47864) 2023-11-13T11:29:12.512 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:12.503+0000 7f1a77fff640 1 -- 172.21.15.102:0/2879191151 learned_addr learned my addr 172.21.15.102:0/2879191151 (peer_addr_for_me v2:172.21.15.102:0/0) 2023-11-13T11:29:12.512 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:12.503+0000 7f1a7d208640 1 --2- 172.21.15.102:0/2879191151 >> v2:172.21.15.154:3300/0 conn(0x7f1a7815d300 0x7f1a7806b560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:12.512 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:12.503+0000 7f1a77fff640 1 -- 172.21.15.102:0/2879191151 >> v2:172.21.15.154:3300/0 conn(0x7f1a7815d300 msgr2=0x7f1a7806b560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-13T11:29:12.512 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:12.503+0000 7f1a77fff640 1 --2- 172.21.15.102:0/2879191151 >> v2:172.21.15.154:3300/0 conn(0x7f1a7815d300 0x7f1a7806b560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:12.513 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:12.503+0000 7f1a77fff640 1 -- 172.21.15.102:0/2879191151 >> v1:172.21.15.154:6789/0 conn(0x7f1a7815cf20 legacy=0x7f1a7806bbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-13T11:29:12.513 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:12.503+0000 7f1a77fff640 1 -- 172.21.15.102:0/2879191151 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a780b0430 con 0x7f1a7806c2c0 2023-11-13T11:29:12.513 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:12.503+0000 7f1a7d208640 1 --2- 172.21.15.102:0/2879191151 >> v2:172.21.15.154:3300/0 conn(0x7f1a7815d300 0x7f1a7806b560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-13T11:29:12.515 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:12.507+0000 7f1a77fff640 1 --2- 172.21.15.102:0/2879191151 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1a7806c2c0 0x7f1a780cf810 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f1a780b2600 tx=0x7f1a6401c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8136c93762cf9efb server_cookie=0 in_seq=0 out_seq=0 2023-11-13T11:29:12.515 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:12.507+0000 7f1a777fe640 1 -- 172.21.15.102:0/2879191151 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a640aa610 con 0x7f1a7806c2c0 2023-11-13T11:29:12.515 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:12.507+0000 7f1a777fe640 1 -- 172.21.15.102:0/2879191151 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a640a6040 con 0x7f1a7806c2c0 2023-11-13T11:29:12.516 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:12.507+0000 7f1a777fe640 1 -- 172.21.15.102:0/2879191151 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a640aa990 con 0x7f1a7806c2c0 2023-11-13T11:29:12.516 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:12.507+0000 7f1a7ec6b640 1 -- 172.21.15.102:0/2879191151 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1a7806c2c0 msgr2=0x7f1a780cf810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:12.516 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:12.507+0000 7f1a7ec6b640 1 --2- 172.21.15.102:0/2879191151 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1a7806c2c0 0x7f1a780cf810 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f1a780b2600 tx=0x7f1a6401c490 comp rx=0 tx=0).stop 2023-11-13T11:29:12.516 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:12.507+0000 7f1a7ec6b640 1 -- 172.21.15.102:0/2879191151 shutdown_connections 2023-11-13T11:29:12.516 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:12.507+0000 7f1a7ec6b640 1 --2- 172.21.15.102:0/2879191151 >> v2:172.21.15.154:3300/0 conn(0x7f1a7815d300 0x7f1a7806b560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:12.517 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:12.507+0000 7f1a7ec6b640 1 --2- 172.21.15.102:0/2879191151 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1a7806c2c0 0x7f1a780cf810 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:12.517 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:12.507+0000 7f1a7ec6b640 1 -- 172.21.15.102:0/2879191151 >> 172.21.15.102:0/2879191151 conn(0x7f1a780d0b70 msgr2=0x7f1a780d0f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-13T11:29:12.517 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:12.507+0000 7f1a7ec6b640 1 -- 172.21.15.102:0/2879191151 shutdown_connections 2023-11-13T11:29:12.517 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:12.507+0000 7f1a7ec6b640 1 -- 172.21.15.102:0/2879191151 wait complete. 2023-11-13T11:29:12.519 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:12.511+0000 7f1a7ec6b640 1 Processor -- start 2023-11-13T11:29:12.520 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:12.511+0000 7f1a7ec6b640 1 -- start start 2023-11-13T11:29:12.520 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:12.511+0000 7f1a7ec6b640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1a7806c2c0 0x7f1a780c62f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:12.520 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:12.511+0000 7f1a7ec6b640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1a7815cf20 0x7f1a780c6830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:12.520 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:12.511+0000 7f1a7ec6b640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1a7815d300 0x7f1a780c46a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:12.521 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:12.511+0000 7f1a7ec6b640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a7814cef0 con 0x7f1a7815d300 2023-11-13T11:29:12.521 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:12.511+0000 7f1a7ec6b640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a781604a0 con 0x7f1a7815cf20 2023-11-13T11:29:12.521 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:12.511+0000 7f1a7ec6b640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a7815f550 con 0x7f1a7806c2c0 2023-11-13T11:29:12.521 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:12.511+0000 7f1a7d208640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1a7815d300 0x7f1a780c46a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:12.521 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:12.511+0000 7f1a7d208640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1a7815d300 0x7f1a780c46a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:47876/0 (socket says 172.21.15.102:47876) 2023-11-13T11:29:12.522 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:12.511+0000 7f1a7d208640 1 -- 172.21.15.102:0/49835169 learned_addr learned my addr 172.21.15.102:0/49835169 (peer_addr_for_me v2:172.21.15.102:0/0) 2023-11-13T11:29:12.522 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:12.511+0000 7f1a77fff640 1 --2- 172.21.15.102:0/49835169 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1a7815cf20 0x7f1a780c6830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:12.522 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:12.511+0000 7f1a7ca07640 1 --2- 172.21.15.102:0/49835169 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1a7806c2c0 0x7f1a780c62f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:12.522 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:12.511+0000 7f1a7d208640 1 -- 172.21.15.102:0/49835169 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1a7806c2c0 msgr2=0x7f1a780c62f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:12.523 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:12.511+0000 7f1a7d208640 1 --2- 172.21.15.102:0/49835169 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1a7806c2c0 0x7f1a780c62f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:12.523 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:12.511+0000 7f1a7d208640 1 -- 172.21.15.102:0/49835169 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1a7815cf20 msgr2=0x7f1a780c6830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:12.523 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:12.511+0000 7f1a7d208640 1 --2- 172.21.15.102:0/49835169 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1a7815cf20 0x7f1a780c6830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:12.523 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:12.511+0000 7f1a7d208640 1 -- 172.21.15.102:0/49835169 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a640094d0 con 0x7f1a7815d300 2023-11-13T11:29:12.523 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:12.511+0000 7f1a7d208640 1 --2- 172.21.15.102:0/49835169 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1a7815d300 0x7f1a780c46a0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f1a70007ea0 tx=0x7f1a70007f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-13T11:29:12.524 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:12.511+0000 7f1a757fa640 1 -- 172.21.15.102:0/49835169 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a70003ba0 con 0x7f1a7815d300 2023-11-13T11:29:12.524 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:12.511+0000 7f1a757fa640 1 -- 172.21.15.102:0/49835169 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a7000f040 con 0x7f1a7815d300 2023-11-13T11:29:12.524 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:12.511+0000 7f1a7ec6b640 1 -- 172.21.15.102:0/49835169 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1a7815ef90 con 0x7f1a7815d300 2023-11-13T11:29:12.524 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:12.511+0000 7f1a757fa640 1 -- 172.21.15.102:0/49835169 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a7000de70 con 0x7f1a7815d300 2023-11-13T11:29:12.524 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:12.511+0000 7f1a7ec6b640 1 -- 172.21.15.102:0/49835169 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1a7814cb80 con 0x7f1a7815d300 2023-11-13T11:29:12.525 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:12.515+0000 7f1a7ec6b640 1 -- 172.21.15.102:0/49835169 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1a7814d0a0 con 0x7f1a7815d300 2023-11-13T11:29:12.526 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:12.515+0000 7f1a757fa640 1 -- 172.21.15.102:0/49835169 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f1a70004030 con 0x7f1a7815d300 2023-11-13T11:29:12.526 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:12.515+0000 7f1a757fa640 1 --2- 172.21.15.102:0/49835169 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f1a5c066470 0x7f1a5c068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:12.526 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:12.515+0000 7f1a757fa640 1 -- 172.21.15.102:0/49835169 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f1a70084170 con 0x7f1a7815d300 2023-11-13T11:29:12.526 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:12.515+0000 7f1a7ca07640 1 --2- 172.21.15.102:0/49835169 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f1a5c066470 0x7f1a5c068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:12.527 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:12.515+0000 7f1a7ca07640 1 --2- 172.21.15.102:0/49835169 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f1a5c066470 0x7f1a5c068930 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f1a780c79d0 tx=0x7f1a6c007e40 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-13T11:29:12.527 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:12.519+0000 7f1a757fa640 1 -- 172.21.15.102:0/49835169 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f1a7814d0a0 con 0x7f1a7815d300 2023-11-13T11:29:12.707 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:12.703+0000 7f1a7ec6b640 1 -- 172.21.15.102:0/49835169 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f1a7814d0a0 con 0x7f1a7815d300 2023-11-13T11:29:12.708 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:12.703+0000 7f1a757fa640 1 -- 172.21.15.102:0/49835169 <== mon.0 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) v1 ==== 53+0+73 (secure 0 0 0) 0x7f1a7814d0a0 con 0x7f1a7815d300 2023-11-13T11:29:12.708 INFO:teuthology.orchestra.run.smithi102.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-11-13T11:29:12.710 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:12.703+0000 7f1a7ec6b640 1 -- 172.21.15.102:0/49835169 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f1a5c066470 msgr2=0x7f1a5c068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:12.710 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:12.703+0000 7f1a7ec6b640 1 --2- 172.21.15.102:0/49835169 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f1a5c066470 0x7f1a5c068930 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f1a780c79d0 tx=0x7f1a6c007e40 comp rx=0 tx=0).stop 2023-11-13T11:29:12.710 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:12.703+0000 7f1a7ec6b640 1 -- 172.21.15.102:0/49835169 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1a7815d300 msgr2=0x7f1a780c46a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:12.711 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:12.703+0000 7f1a7ec6b640 1 --2- 172.21.15.102:0/49835169 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1a7815d300 0x7f1a780c46a0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f1a70007ea0 tx=0x7f1a70007f90 comp rx=0 tx=0).stop 2023-11-13T11:29:12.711 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:12.703+0000 7f1a7ec6b640 1 -- 172.21.15.102:0/49835169 shutdown_connections 2023-11-13T11:29:12.711 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:12.703+0000 7f1a7ec6b640 1 --2- 172.21.15.102:0/49835169 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f1a5c066470 0x7f1a5c068930 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:12.711 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:12.703+0000 7f1a7ec6b640 1 --2- 172.21.15.102:0/49835169 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1a7815d300 0x7f1a780c46a0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:12.711 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:12.703+0000 7f1a7ec6b640 1 --2- 172.21.15.102:0/49835169 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1a7815cf20 0x7f1a780c6830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:12.712 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:12.703+0000 7f1a7ec6b640 1 --2- 172.21.15.102:0/49835169 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1a7806c2c0 0x7f1a780c62f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:12.712 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:12.703+0000 7f1a7ec6b640 1 -- 172.21.15.102:0/49835169 >> 172.21.15.102:0/49835169 conn(0x7f1a780d0b70 msgr2=0x7f1a780cf620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-13T11:29:12.712 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:12.703+0000 7f1a7ec6b640 1 -- 172.21.15.102:0/49835169 shutdown_connections 2023-11-13T11:29:12.712 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:12.703+0000 7f1a7ec6b640 1 -- 172.21.15.102:0/49835169 wait complete. 2023-11-13T11:29:12.728 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-11-13T11:29:12.729 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-11-13T11:29:12.729 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi102.front.sepia.ceph.com 2023-11-13T11:29:12.729 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-11-13T11:29:12.730 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-11-13T11:29:12.730 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-11-13T11:29:12.730 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-11-13T11:29:12.730 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-11-13T11:29:12.731 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2023-11-13T11:29:12.731 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-13T11:29:12.731 DEBUG:teuthology.orchestra.run.smithi102:> ip addr 2023-11-13T11:29:12.741 INFO:teuthology.orchestra.run.smithi102.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-11-13T11:29:12.741 INFO:teuthology.orchestra.run.smithi102.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-11-13T11:29:12.741 INFO:teuthology.orchestra.run.smithi102.stdout: inet 127.0.0.1/8 scope host lo 2023-11-13T11:29:12.741 INFO:teuthology.orchestra.run.smithi102.stdout: valid_lft forever preferred_lft forever 2023-11-13T11:29:12.742 INFO:teuthology.orchestra.run.smithi102.stdout: inet6 ::1/128 scope host 2023-11-13T11:29:12.742 INFO:teuthology.orchestra.run.smithi102.stdout: valid_lft forever preferred_lft forever 2023-11-13T11:29:12.742 INFO:teuthology.orchestra.run.smithi102.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-11-13T11:29:12.742 INFO:teuthology.orchestra.run.smithi102.stdout: link/ether 0c:c4:7a:d8:d9:dc brd ff:ff:ff:ff:ff:ff 2023-11-13T11:29:12.743 INFO:teuthology.orchestra.run.smithi102.stdout: altname enp7s0f0 2023-11-13T11:29:12.743 INFO:teuthology.orchestra.run.smithi102.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-11-13T11:29:12.743 INFO:teuthology.orchestra.run.smithi102.stdout: link/ether 0c:c4:7a:d8:d9:dd brd ff:ff:ff:ff:ff:ff 2023-11-13T11:29:12.743 INFO:teuthology.orchestra.run.smithi102.stdout: altname enp7s0f1 2023-11-13T11:29:12.743 INFO:teuthology.orchestra.run.smithi102.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-11-13T11:29:12.744 INFO:teuthology.orchestra.run.smithi102.stdout: link/ether 0c:c4:7a:8f:d7:68 brd ff:ff:ff:ff:ff:ff 2023-11-13T11:29:12.744 INFO:teuthology.orchestra.run.smithi102.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-11-13T11:29:12.744 INFO:teuthology.orchestra.run.smithi102.stdout: link/ether 0c:c4:7a:8f:d7:69 brd ff:ff:ff:ff:ff:ff 2023-11-13T11:29:12.744 INFO:teuthology.orchestra.run.smithi102.stdout: inet 172.21.15.102/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2023-11-13T11:29:12.744 INFO:teuthology.orchestra.run.smithi102.stdout: valid_lft 42411sec preferred_lft 42411sec 2023-11-13T11:29:12.745 INFO:teuthology.orchestra.run.smithi102.stdout: inet6 fe80::ec4:7aff:fe8f:d769/64 scope link 2023-11-13T11:29:12.745 INFO:teuthology.orchestra.run.smithi102.stdout: valid_lft forever preferred_lft forever 2023-11-13T11:29:12.745 INFO:teuthology.orchestra.run.smithi102.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-11-13T11:29:12.745 INFO:teuthology.orchestra.run.smithi102.stdout: link/ether 02:42:47:27:4a:d8 brd ff:ff:ff:ff:ff:ff 2023-11-13T11:29:12.745 INFO:teuthology.orchestra.run.smithi102.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-11-13T11:29:12.746 INFO:teuthology.orchestra.run.smithi102.stdout: valid_lft forever preferred_lft forever 2023-11-13T11:29:12.747 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2023-11-13T11:29:12.748 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-13T11:29:12.748 DEBUG:teuthology.orchestra.run.smithi102:> (cd / && exec bash -c ' 2023-11-13T11:29:12.748 DEBUG:teuthology.orchestra.run.smithi102:> set -e 2023-11-13T11:29:12.748 DEBUG:teuthology.orchestra.run.smithi102:> sudo ip link add name ceph-brx type bridge 2023-11-13T11:29:12.749 DEBUG:teuthology.orchestra.run.smithi102:> sudo ip addr flush dev ceph-brx 2023-11-13T11:29:12.749 DEBUG:teuthology.orchestra.run.smithi102:> sudo ip link set ceph-brx up 2023-11-13T11:29:12.749 DEBUG:teuthology.orchestra.run.smithi102:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2023-11-13T11:29:12.750 DEBUG:teuthology.orchestra.run.smithi102:> ') 2023-11-13T11:29:12.865 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-13T11:29:12.865 DEBUG:teuthology.orchestra.run.smithi102:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-11-13T11:29:12.885 INFO:teuthology.orchestra.run.smithi102.stdout:1 2023-11-13T11:29:12.887 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-13T11:29:12.887 DEBUG:teuthology.orchestra.run.smithi102:> route 2023-11-13T11:29:12.960 INFO:teuthology.orchestra.run.smithi102.stdout:Kernel IP routing table 2023-11-13T11:29:12.960 INFO:teuthology.orchestra.run.smithi102.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-11-13T11:29:12.960 INFO:teuthology.orchestra.run.smithi102.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2023-11-13T11:29:12.961 INFO:teuthology.orchestra.run.smithi102.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-11-13T11:29:12.961 INFO:teuthology.orchestra.run.smithi102.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-11-13T11:29:12.961 INFO:teuthology.orchestra.run.smithi102.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-11-13T11:29:12.961 INFO:teuthology.orchestra.run.smithi102.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-11-13T11:29:12.962 INFO:teuthology.orchestra.run.smithi102.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-11-13T11:29:12.962 INFO:teuthology.orchestra.run.smithi102.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-11-13T11:29:12.962 INFO:teuthology.orchestra.run.smithi102.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-11-13T11:29:12.963 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-13T11:29:12.963 DEBUG:teuthology.orchestra.run.smithi102:> (cd / && exec bash -c ' 2023-11-13T11:29:12.963 DEBUG:teuthology.orchestra.run.smithi102:> set -e 2023-11-13T11:29:12.964 DEBUG:teuthology.orchestra.run.smithi102:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-11-13T11:29:12.964 DEBUG:teuthology.orchestra.run.smithi102:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-11-13T11:29:12.964 DEBUG:teuthology.orchestra.run.smithi102:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-11-13T11:29:12.964 DEBUG:teuthology.orchestra.run.smithi102:> ') 2023-11-13T11:29:13.054 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-13T11:29:13.055 DEBUG:teuthology.orchestra.run.smithi102:> ip netns list 2023-11-13T11:29:13.065 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-13T11:29:13.065 DEBUG:teuthology.orchestra.run.smithi102:> ip netns list-id 2023-11-13T11:29:13.115 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-13T11:29:13.116 DEBUG:teuthology.orchestra.run.smithi102:> (cd / && exec bash -c ' 2023-11-13T11:29:13.116 DEBUG:teuthology.orchestra.run.smithi102:> set -e 2023-11-13T11:29:13.116 DEBUG:teuthology.orchestra.run.smithi102:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-13T11:29:13.117 DEBUG:teuthology.orchestra.run.smithi102:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2023-11-13T11:29:13.117 DEBUG:teuthology.orchestra.run.smithi102:> ') 2023-11-13T11:29:13.197 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2023-11-13T11:29:13.197 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-13T11:29:13.198 DEBUG:teuthology.orchestra.run.smithi102:> (cd / && exec bash -c ' 2023-11-13T11:29:13.198 DEBUG:teuthology.orchestra.run.smithi102:> set -e 2023-11-13T11:29:13.198 DEBUG:teuthology.orchestra.run.smithi102:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2023-11-13T11:29:13.199 DEBUG:teuthology.orchestra.run.smithi102:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2023-11-13T11:29:13.199 DEBUG:teuthology.orchestra.run.smithi102:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2023-11-13T11:29:13.199 DEBUG:teuthology.orchestra.run.smithi102:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2023-11-13T11:29:13.200 DEBUG:teuthology.orchestra.run.smithi102:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2023-11-13T11:29:13.200 DEBUG:teuthology.orchestra.run.smithi102:> ') 2023-11-13T11:29:13.359 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-13T11:29:13.360 DEBUG:teuthology.orchestra.run.smithi102:> (cd / && exec bash -c ' 2023-11-13T11:29:13.360 DEBUG:teuthology.orchestra.run.smithi102:> set -e 2023-11-13T11:29:13.360 DEBUG:teuthology.orchestra.run.smithi102:> sudo ip link set brx.0 up 2023-11-13T11:29:13.361 DEBUG:teuthology.orchestra.run.smithi102:> sudo ip link set dev brx.0 master ceph-brx 2023-11-13T11:29:13.361 DEBUG:teuthology.orchestra.run.smithi102:> ') 2023-11-13T11:29:13.402 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2023-11-13T11:29:13.403 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-13T11:29:13.403 DEBUG:teuthology.orchestra.run.smithi102:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-11-13T11:29:13.455 INFO:teuthology.orchestra.run.smithi102.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-11-13T11:29:13.456 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-13T11:29:13.456 DEBUG:teuthology.orchestra.run.smithi102:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-11-13T11:29:13.510 DEBUG:teuthology.orchestra.run.smithi102:> sudo modprobe fuse 2023-11-13T11:29:13.571 DEBUG:teuthology.orchestra.run.smithi102:> cat /proc/self/mounts | awk '{print $2}' 2023-11-13T11:29:13.624 INFO:teuthology.orchestra.run.smithi102.stdout:/sys 2023-11-13T11:29:13.624 INFO:teuthology.orchestra.run.smithi102.stdout:/proc 2023-11-13T11:29:13.624 INFO:teuthology.orchestra.run.smithi102.stdout:/dev 2023-11-13T11:29:13.625 INFO:teuthology.orchestra.run.smithi102.stdout:/dev/pts 2023-11-13T11:29:13.625 INFO:teuthology.orchestra.run.smithi102.stdout:/run 2023-11-13T11:29:13.625 INFO:teuthology.orchestra.run.smithi102.stdout:/ 2023-11-13T11:29:13.625 INFO:teuthology.orchestra.run.smithi102.stdout:/sys/kernel/security 2023-11-13T11:29:13.625 INFO:teuthology.orchestra.run.smithi102.stdout:/dev/shm 2023-11-13T11:29:13.626 INFO:teuthology.orchestra.run.smithi102.stdout:/run/lock 2023-11-13T11:29:13.626 INFO:teuthology.orchestra.run.smithi102.stdout:/sys/fs/cgroup 2023-11-13T11:29:13.626 INFO:teuthology.orchestra.run.smithi102.stdout:/sys/fs/pstore 2023-11-13T11:29:13.626 INFO:teuthology.orchestra.run.smithi102.stdout:/sys/fs/bpf 2023-11-13T11:29:13.626 INFO:teuthology.orchestra.run.smithi102.stdout:/proc/sys/fs/binfmt_misc 2023-11-13T11:29:13.627 INFO:teuthology.orchestra.run.smithi102.stdout:/dev/hugepages 2023-11-13T11:29:13.627 INFO:teuthology.orchestra.run.smithi102.stdout:/dev/mqueue 2023-11-13T11:29:13.627 INFO:teuthology.orchestra.run.smithi102.stdout:/sys/kernel/debug 2023-11-13T11:29:13.627 INFO:teuthology.orchestra.run.smithi102.stdout:/sys/kernel/tracing 2023-11-13T11:29:13.627 INFO:teuthology.orchestra.run.smithi102.stdout:/proc/fs/nfsd 2023-11-13T11:29:13.628 INFO:teuthology.orchestra.run.smithi102.stdout:/sys/fs/fuse/connections 2023-11-13T11:29:13.628 INFO:teuthology.orchestra.run.smithi102.stdout:/sys/kernel/config 2023-11-13T11:29:13.628 INFO:teuthology.orchestra.run.smithi102.stdout:/run/credentials/systemd-sysusers.service 2023-11-13T11:29:13.628 INFO:teuthology.orchestra.run.smithi102.stdout:/run/rpc_pipefs 2023-11-13T11:29:13.628 INFO:teuthology.orchestra.run.smithi102.stdout:/run/user/1000 2023-11-13T11:29:13.629 INFO:teuthology.orchestra.run.smithi102.stdout:/var/lib/ceph 2023-11-13T11:29:13.629 INFO:teuthology.orchestra.run.smithi102.stdout:/var/lib/ceph/osd/ceph-0 2023-11-13T11:29:13.629 INFO:teuthology.orchestra.run.smithi102.stdout:/var/lib/ceph/osd/ceph-1 2023-11-13T11:29:13.629 INFO:teuthology.orchestra.run.smithi102.stdout:/var/lib/ceph/osd/ceph-2 2023-11-13T11:29:13.629 INFO:teuthology.orchestra.run.smithi102.stdout:/var/lib/ceph/osd/ceph-3 2023-11-13T11:29:13.630 INFO:teuthology.orchestra.run.smithi102.stdout:/run/netns 2023-11-13T11:29:13.630 INFO:teuthology.orchestra.run.smithi102.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-13T11:29:13.630 INFO:teuthology.orchestra.run.smithi102.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-13T11:29:13.631 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-13T11:29:13.632 DEBUG:teuthology.orchestra.run.smithi102:> ls /sys/fs/fuse/connections 2023-11-13T11:29:13.687 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-11-13T11:29:13.687 DEBUG:teuthology.orchestra.run.smithi102:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2023-11-13T11:29:13.737 DEBUG:teuthology.orchestra.run.smithi102:> sudo modprobe fuse 2023-11-13T11:29:13.760 DEBUG:teuthology.orchestra.run.smithi102:> cat /proc/self/mounts | awk '{print $2}' 2023-11-13T11:29:13.812 INFO:teuthology.orchestra.run.smithi102.stdout:/sys 2023-11-13T11:29:13.812 INFO:teuthology.orchestra.run.smithi102.stdout:/proc 2023-11-13T11:29:13.813 INFO:teuthology.orchestra.run.smithi102.stdout:/dev 2023-11-13T11:29:13.813 INFO:teuthology.orchestra.run.smithi102.stdout:/dev/pts 2023-11-13T11:29:13.813 INFO:teuthology.orchestra.run.smithi102.stdout:/run 2023-11-13T11:29:13.813 INFO:teuthology.orchestra.run.smithi102.stdout:/ 2023-11-13T11:29:13.814 INFO:teuthology.orchestra.run.smithi102.stdout:/sys/kernel/security 2023-11-13T11:29:13.814 INFO:teuthology.orchestra.run.smithi102.stdout:/dev/shm 2023-11-13T11:29:13.814 INFO:teuthology.orchestra.run.smithi102.stdout:/run/lock 2023-11-13T11:29:13.814 INFO:teuthology.orchestra.run.smithi102.stdout:/sys/fs/cgroup 2023-11-13T11:29:13.814 INFO:teuthology.orchestra.run.smithi102.stdout:/sys/fs/pstore 2023-11-13T11:29:13.815 INFO:teuthology.orchestra.run.smithi102.stdout:/sys/fs/bpf 2023-11-13T11:29:13.815 INFO:teuthology.orchestra.run.smithi102.stdout:/proc/sys/fs/binfmt_misc 2023-11-13T11:29:13.815 INFO:teuthology.orchestra.run.smithi102.stdout:/dev/hugepages 2023-11-13T11:29:13.815 INFO:teuthology.orchestra.run.smithi102.stdout:/dev/mqueue 2023-11-13T11:29:13.815 INFO:teuthology.orchestra.run.smithi102.stdout:/sys/kernel/debug 2023-11-13T11:29:13.815 INFO:teuthology.orchestra.run.smithi102.stdout:/sys/kernel/tracing 2023-11-13T11:29:13.816 INFO:teuthology.orchestra.run.smithi102.stdout:/proc/fs/nfsd 2023-11-13T11:29:13.816 INFO:teuthology.orchestra.run.smithi102.stdout:/sys/fs/fuse/connections 2023-11-13T11:29:13.816 INFO:teuthology.orchestra.run.smithi102.stdout:/sys/kernel/config 2023-11-13T11:29:13.816 INFO:teuthology.orchestra.run.smithi102.stdout:/run/credentials/systemd-sysusers.service 2023-11-13T11:29:13.816 INFO:teuthology.orchestra.run.smithi102.stdout:/run/rpc_pipefs 2023-11-13T11:29:13.817 INFO:teuthology.orchestra.run.smithi102.stdout:/run/user/1000 2023-11-13T11:29:13.817 INFO:teuthology.orchestra.run.smithi102.stdout:/var/lib/ceph 2023-11-13T11:29:13.817 INFO:teuthology.orchestra.run.smithi102.stdout:/var/lib/ceph/osd/ceph-0 2023-11-13T11:29:13.817 INFO:teuthology.orchestra.run.smithi102.stdout:/var/lib/ceph/osd/ceph-1 2023-11-13T11:29:13.817 INFO:teuthology.orchestra.run.smithi102.stdout:/var/lib/ceph/osd/ceph-2 2023-11-13T11:29:13.818 INFO:teuthology.orchestra.run.smithi102.stdout:/var/lib/ceph/osd/ceph-3 2023-11-13T11:29:13.818 INFO:teuthology.orchestra.run.smithi102.stdout:/run/netns 2023-11-13T11:29:13.818 INFO:teuthology.orchestra.run.smithi102.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-13T11:29:13.818 INFO:teuthology.orchestra.run.smithi102.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-13T11:29:13.819 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-13T11:29:13.820 DEBUG:teuthology.orchestra.run.smithi102:> ls /sys/fs/fuse/connections 2023-11-13T11:29:13.843 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi102.stderr:2023-11-13T11:29:13.838+0000 7f1a07e45580 -1 init, newargv = 0x556827f6cf90 newargc=15 2023-11-13T11:29:13.844 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi102.stderr:ceph-fuse[45408]: starting ceph client 2023-11-13T11:29:13.852 INFO:teuthology.orchestra.run.smithi102.stdout:43 2023-11-13T11:29:13.853 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi102.stderr:ceph-fuse[45408]: starting fuse 2023-11-13T11:29:13.854 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [43] 2023-11-13T11:29:13.855 DEBUG:teuthology.orchestra.run.smithi102:> sudo stdin-killer -- python3 -c ' 2023-11-13T11:29:13.855 DEBUG:teuthology.orchestra.run.smithi102:> import glob 2023-11-13T11:29:13.856 DEBUG:teuthology.orchestra.run.smithi102:> import re 2023-11-13T11:29:13.856 DEBUG:teuthology.orchestra.run.smithi102:> import os 2023-11-13T11:29:13.856 DEBUG:teuthology.orchestra.run.smithi102:> import subprocess 2023-11-13T11:29:13.857 DEBUG:teuthology.orchestra.run.smithi102:> 2023-11-13T11:29:13.857 DEBUG:teuthology.orchestra.run.smithi102:> def _find_admin_socket(client_name): 2023-11-13T11:29:13.857 DEBUG:teuthology.orchestra.run.smithi102:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2023-11-13T11:29:13.858 DEBUG:teuthology.orchestra.run.smithi102:> files = glob.glob(asok_path) 2023-11-13T11:29:13.858 DEBUG:teuthology.orchestra.run.smithi102:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2023-11-13T11:29:13.858 DEBUG:teuthology.orchestra.run.smithi102:> 2023-11-13T11:29:13.859 DEBUG:teuthology.orchestra.run.smithi102:> # Given a non-glob path, it better be there 2023-11-13T11:29:13.859 DEBUG:teuthology.orchestra.run.smithi102:> if "*" not in asok_path: 2023-11-13T11:29:13.860 DEBUG:teuthology.orchestra.run.smithi102:> assert(len(files) == 1) 2023-11-13T11:29:13.860 DEBUG:teuthology.orchestra.run.smithi102:> return files[0] 2023-11-13T11:29:13.860 DEBUG:teuthology.orchestra.run.smithi102:> 2023-11-13T11:29:13.861 DEBUG:teuthology.orchestra.run.smithi102:> for f in files: 2023-11-13T11:29:13.861 DEBUG:teuthology.orchestra.run.smithi102:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-11-13T11:29:13.861 DEBUG:teuthology.orchestra.run.smithi102:> if os.path.exists("/proc/{0}".format(pid)): 2023-11-13T11:29:13.862 DEBUG:teuthology.orchestra.run.smithi102:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-11-13T11:29:13.862 DEBUG:teuthology.orchestra.run.smithi102:> contents = proc_f.read() 2023-11-13T11:29:13.862 DEBUG:teuthology.orchestra.run.smithi102:> if mountpoint in contents: 2023-11-13T11:29:13.862 DEBUG:teuthology.orchestra.run.smithi102:> return f 2023-11-13T11:29:13.863 DEBUG:teuthology.orchestra.run.smithi102:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-11-13T11:29:13.863 DEBUG:teuthology.orchestra.run.smithi102:> 2023-11-13T11:29:13.864 DEBUG:teuthology.orchestra.run.smithi102:> print(_find_admin_socket("client.0")) 2023-11-13T11:29:13.864 DEBUG:teuthology.orchestra.run.smithi102:> ' 2023-11-13T11:29:13.982 INFO:teuthology.orchestra.run.smithi102.stdout:/var/run/ceph/ceph-client.0.45408.asok 2023-11-13T11:29:13.985 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:13 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-11-13T11:29:13.993 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.45408.asok 2023-11-13T11:29:13.994 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-13T11:29:13.994 DEBUG:teuthology.orchestra.run.smithi102:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.45408.asok status 2023-11-13T11:29:14.164 INFO:teuthology.orchestra.run.smithi102.stdout:{ 2023-11-13T11:29:14.164 INFO:teuthology.orchestra.run.smithi102.stdout: "metadata": { 2023-11-13T11:29:14.164 INFO:teuthology.orchestra.run.smithi102.stdout: "ceph_sha1": "35f0debb3cc28955b7132ef4c509cd138a09d56b", 2023-11-13T11:29:14.165 INFO:teuthology.orchestra.run.smithi102.stdout: "ceph_version": "ceph version 18.0.0-7288-g35f0debb (35f0debb3cc28955b7132ef4c509cd138a09d56b) reef (dev)", 2023-11-13T11:29:14.165 INFO:teuthology.orchestra.run.smithi102.stdout: "entity_id": "0", 2023-11-13T11:29:14.165 INFO:teuthology.orchestra.run.smithi102.stdout: "hostname": "smithi102", 2023-11-13T11:29:14.165 INFO:teuthology.orchestra.run.smithi102.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2023-11-13T11:29:14.165 INFO:teuthology.orchestra.run.smithi102.stdout: "pid": "45408", 2023-11-13T11:29:14.166 INFO:teuthology.orchestra.run.smithi102.stdout: "root": "/" 2023-11-13T11:29:14.166 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-11-13T11:29:14.166 INFO:teuthology.orchestra.run.smithi102.stdout: "dentry_count": 0, 2023-11-13T11:29:14.166 INFO:teuthology.orchestra.run.smithi102.stdout: "dentry_pinned_count": 0, 2023-11-13T11:29:14.166 INFO:teuthology.orchestra.run.smithi102.stdout: "id": 4704, 2023-11-13T11:29:14.167 INFO:teuthology.orchestra.run.smithi102.stdout: "inst": { 2023-11-13T11:29:14.167 INFO:teuthology.orchestra.run.smithi102.stdout: "name": { 2023-11-13T11:29:14.167 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "client", 2023-11-13T11:29:14.167 INFO:teuthology.orchestra.run.smithi102.stdout: "num": 4704 2023-11-13T11:29:14.167 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-11-13T11:29:14.168 INFO:teuthology.orchestra.run.smithi102.stdout: "addr": { 2023-11-13T11:29:14.168 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "v1", 2023-11-13T11:29:14.168 INFO:teuthology.orchestra.run.smithi102.stdout: "addr": "192.168.0.1:0", 2023-11-13T11:29:14.168 INFO:teuthology.orchestra.run.smithi102.stdout: "nonce": 1566729397 2023-11-13T11:29:14.168 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-11-13T11:29:14.169 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-11-13T11:29:14.169 INFO:teuthology.orchestra.run.smithi102.stdout: "addr": { 2023-11-13T11:29:14.169 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "v1", 2023-11-13T11:29:14.169 INFO:teuthology.orchestra.run.smithi102.stdout: "addr": "192.168.0.1:0", 2023-11-13T11:29:14.169 INFO:teuthology.orchestra.run.smithi102.stdout: "nonce": 1566729397 2023-11-13T11:29:14.170 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-11-13T11:29:14.170 INFO:teuthology.orchestra.run.smithi102.stdout: "inst_str": "client.4704 192.168.0.1:0/1566729397", 2023-11-13T11:29:14.170 INFO:teuthology.orchestra.run.smithi102.stdout: "addr_str": "192.168.0.1:0/1566729397", 2023-11-13T11:29:14.170 INFO:teuthology.orchestra.run.smithi102.stdout: "inode_count": 1, 2023-11-13T11:29:14.170 INFO:teuthology.orchestra.run.smithi102.stdout: "mds_epoch": 8, 2023-11-13T11:29:14.171 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_epoch": 22, 2023-11-13T11:29:14.171 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_epoch_barrier": 0, 2023-11-13T11:29:14.171 INFO:teuthology.orchestra.run.smithi102.stdout: "blocklisted": false, 2023-11-13T11:29:14.171 INFO:teuthology.orchestra.run.smithi102.stdout: "fs_name": "cephfs" 2023-11-13T11:29:14.171 INFO:teuthology.orchestra.run.smithi102.stdout:} 2023-11-13T11:29:14.179 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-11-13T11:29:14.317 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:14.310+0000 7faf6cf57640 1 Processor -- start 2023-11-13T11:29:14.317 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:14.310+0000 7faf6cf57640 1 -- start start 2023-11-13T11:29:14.318 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:14.310+0000 7faf6cf57640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7faf680b2a70 0x7faf68168090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:14.318 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:14.310+0000 7faf6cf57640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faf680cdc30 con 0x7faf6815da20 2023-11-13T11:29:14.319 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:14.310+0000 7faf6cf57640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faf680cd300 con 0x7faf680719b0 2023-11-13T11:29:14.319 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:14.310+0000 7faf6cf57640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faf680cd5e0 con 0x7faf680b2a70 2023-11-13T11:29:14.319 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:14.310+0000 7faf6659c640 1 --1- >> v1:172.21.15.102:6789/0 conn(0x7faf6815da20 0x7faf6815de00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.102:6789/0 says I am v1:172.21.15.102:49710/0 (socket says 172.21.15.102:49710) 2023-11-13T11:29:14.319 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:14.310+0000 7faf6659c640 1 -- 172.21.15.102:0/2035289740 learned_addr learned my addr 172.21.15.102:0/2035289740 (peer_addr_for_me v1:172.21.15.102:0/0) 2023-11-13T11:29:14.319 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:14.310+0000 7faf66d9d640 1 --2- 172.21.15.102:0/2035289740 >> v2:172.21.15.102:3300/0 conn(0x7faf680b2a70 0x7faf68168090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:14.320 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:14.314+0000 7faf66d9d640 1 -- 172.21.15.102:0/2035289740 >> v1:172.21.15.154:6789/0 conn(0x7faf680719b0 legacy=0x7faf680b2360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:14.320 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:14.314+0000 7faf66d9d640 1 -- 172.21.15.102:0/2035289740 >> v1:172.21.15.102:6789/0 conn(0x7faf6815da20 legacy=0x7faf6815de00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:14.320 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:14.314+0000 7faf66d9d640 1 -- 172.21.15.102:0/2035289740 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf680cd8c0 con 0x7faf680b2a70 2023-11-13T11:29:14.321 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:14.314+0000 7faf66d9d640 1 --2- 172.21.15.102:0/2035289740 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7faf680b2a70 0x7faf68168090 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7faf600097c0 tx=0x7faf6001c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c0c37078bb0f828c server_cookie=0 in_seq=0 out_seq=0 2023-11-13T11:29:14.322 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:14.314+0000 7faf65d9b640 1 -- 172.21.15.102:0/2035289740 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf600a8050 con 0x7faf680b2a70 2023-11-13T11:29:14.322 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:14.314+0000 7faf65d9b640 1 -- 172.21.15.102:0/2035289740 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf600ac5f0 con 0x7faf680b2a70 2023-11-13T11:29:14.323 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:14.314+0000 7faf65d9b640 1 -- 172.21.15.102:0/2035289740 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf600ac980 con 0x7faf680b2a70 2023-11-13T11:29:14.323 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:14.314+0000 7faf6cf57640 1 -- 172.21.15.102:0/2035289740 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7faf680b2a70 msgr2=0x7faf68168090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:14.323 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:14.314+0000 7faf6cf57640 1 --2- 172.21.15.102:0/2035289740 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7faf680b2a70 0x7faf68168090 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7faf600097c0 tx=0x7faf6001c480 comp rx=0 tx=0).stop 2023-11-13T11:29:14.323 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:14.314+0000 7faf6cf57640 1 -- 172.21.15.102:0/2035289740 shutdown_connections 2023-11-13T11:29:14.324 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:14.314+0000 7faf6cf57640 1 --2- 172.21.15.102:0/2035289740 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7faf680b2a70 0x7faf68168090 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:14.324 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:14.314+0000 7faf6cf57640 1 -- 172.21.15.102:0/2035289740 >> 172.21.15.102:0/2035289740 conn(0x7faf680b0870 msgr2=0x7faf680b0c80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-13T11:29:14.324 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:14.314+0000 7faf6cf57640 1 -- 172.21.15.102:0/2035289740 shutdown_connections 2023-11-13T11:29:14.324 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:14.318+0000 7faf6cf57640 1 -- 172.21.15.102:0/2035289740 wait complete. 2023-11-13T11:29:14.325 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:14.318+0000 7faf6cf57640 1 Processor -- start 2023-11-13T11:29:14.325 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:14.318+0000 7faf6cf57640 1 -- start start 2023-11-13T11:29:14.327 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:14.318+0000 7faf6cf57640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7faf680719b0 0x7faf68152db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:14.327 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:14.318+0000 7faf6cf57640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7faf680b2a70 0x7faf68154430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:14.327 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:14.318+0000 7faf6cf57640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7faf6815da20 0x7faf681581b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:14.327 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:14.318+0000 7faf6cf57640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf68153fa0 con 0x7faf6815da20 2023-11-13T11:29:14.328 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:14.318+0000 7faf6cf57640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf681586f0 con 0x7faf680719b0 2023-11-13T11:29:14.328 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:14.318+0000 7faf6cf57640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf68153390 con 0x7faf680b2a70 2023-11-13T11:29:14.328 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:14.318+0000 7faf66d9d640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7faf6815da20 0x7faf681581b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:14.328 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:14.318+0000 7faf66d9d640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7faf6815da20 0x7faf681581b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:47888/0 (socket says 172.21.15.102:47888) 2023-11-13T11:29:14.328 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:14.318+0000 7faf66d9d640 1 -- 172.21.15.102:0/519121457 learned_addr learned my addr 172.21.15.102:0/519121457 (peer_addr_for_me v2:172.21.15.102:0/0) 2023-11-13T11:29:14.329 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:14.318+0000 7faf6659c640 1 --2- 172.21.15.102:0/519121457 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7faf680719b0 0x7faf68152db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:14.329 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:14.318+0000 7faf5dd9b640 1 --2- 172.21.15.102:0/519121457 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7faf680b2a70 0x7faf68154430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:14.329 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:14.318+0000 7faf66d9d640 1 -- 172.21.15.102:0/519121457 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7faf680b2a70 msgr2=0x7faf68154430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:14.329 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:14.318+0000 7faf66d9d640 1 --2- 172.21.15.102:0/519121457 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7faf680b2a70 0x7faf68154430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:14.329 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:14.318+0000 7faf66d9d640 1 -- 172.21.15.102:0/519121457 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7faf680719b0 msgr2=0x7faf68152db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:14.330 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:14.318+0000 7faf66d9d640 1 --2- 172.21.15.102:0/519121457 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7faf680719b0 0x7faf68152db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:14.330 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:14.318+0000 7faf66d9d640 1 -- 172.21.15.102:0/519121457 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf60009420 con 0x7faf6815da20 2023-11-13T11:29:14.330 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:14.322+0000 7faf66d9d640 1 --2- 172.21.15.102:0/519121457 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7faf6815da20 0x7faf681581b0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7faf600af040 tx=0x7faf60019220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-13T11:29:14.330 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:14.322+0000 7faf5f7fe640 1 -- 172.21.15.102:0/519121457 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf600b5620 con 0x7faf6815da20 2023-11-13T11:29:14.330 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:14.322+0000 7faf5f7fe640 1 -- 172.21.15.102:0/519121457 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf600b5780 con 0x7faf6815da20 2023-11-13T11:29:14.333 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:14.322+0000 7faf5f7fe640 1 -- 172.21.15.102:0/519121457 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf600b5b10 con 0x7faf6815da20 2023-11-13T11:29:14.333 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:14.322+0000 7faf6cf57640 1 -- 172.21.15.102:0/519121457 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faf6815e720 con 0x7faf6815da20 2023-11-13T11:29:14.334 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:14.322+0000 7faf6cf57640 1 -- 172.21.15.102:0/519121457 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faf68153950 con 0x7faf6815da20 2023-11-13T11:29:14.335 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:14.322+0000 7faf6cf57640 1 -- 172.21.15.102:0/519121457 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faf68068520 con 0x7faf6815da20 2023-11-13T11:29:14.335 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:14.322+0000 7faf5f7fe640 1 -- 172.21.15.102:0/519121457 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7faf600b3040 con 0x7faf6815da20 2023-11-13T11:29:14.335 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:14.322+0000 7faf5f7fe640 1 --2- 172.21.15.102:0/519121457 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7faf48066470 0x7faf48068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:14.336 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:14.322+0000 7faf5f7fe640 1 -- 172.21.15.102:0/519121457 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7faf6011d9a0 con 0x7faf6815da20 2023-11-13T11:29:14.336 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:14.322+0000 7faf6659c640 1 --2- 172.21.15.102:0/519121457 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7faf48066470 0x7faf48068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:14.336 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:14.326+0000 7faf6659c640 1 --2- 172.21.15.102:0/519121457 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7faf48066470 0x7faf48068930 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7faf58005890 tx=0x7faf58009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-13T11:29:14.336 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:14.326+0000 7faf5f7fe640 1 -- 172.21.15.102:0/519121457 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7faf600eaef0 con 0x7faf6815da20 2023-11-13T11:29:14.516 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:14.510+0000 7faf6cf57640 1 -- 172.21.15.102:0/519121457 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7faf680ae2c0 con 0x7faf6815da20 2023-11-13T11:29:14.516 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:14.510+0000 7faf5f7fe640 1 -- 172.21.15.102:0/519121457 <== mon.0 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) v1 ==== 53+0+73 (secure 0 0 0) 0x7faf600b1070 con 0x7faf6815da20 2023-11-13T11:29:14.517 INFO:teuthology.orchestra.run.smithi102.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-11-13T11:29:14.518 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:14.510+0000 7faf6cf57640 1 -- 172.21.15.102:0/519121457 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7faf48066470 msgr2=0x7faf48068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:14.519 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:14.510+0000 7faf6cf57640 1 --2- 172.21.15.102:0/519121457 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7faf48066470 0x7faf48068930 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7faf58005890 tx=0x7faf58009040 comp rx=0 tx=0).stop 2023-11-13T11:29:14.519 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:14.510+0000 7faf6cf57640 1 -- 172.21.15.102:0/519121457 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7faf6815da20 msgr2=0x7faf681581b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:14.519 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:14.510+0000 7faf6cf57640 1 --2- 172.21.15.102:0/519121457 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7faf6815da20 0x7faf681581b0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7faf600af040 tx=0x7faf60019220 comp rx=0 tx=0).stop 2023-11-13T11:29:14.519 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:14.510+0000 7faf6cf57640 1 -- 172.21.15.102:0/519121457 shutdown_connections 2023-11-13T11:29:14.519 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:14.510+0000 7faf6cf57640 1 --2- 172.21.15.102:0/519121457 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7faf48066470 0x7faf48068930 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:14.520 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:14.510+0000 7faf6cf57640 1 --2- 172.21.15.102:0/519121457 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7faf6815da20 0x7faf681581b0 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:14.520 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:14.510+0000 7faf6cf57640 1 --2- 172.21.15.102:0/519121457 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7faf680b2a70 0x7faf68154430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:14.520 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:14.510+0000 7faf6cf57640 1 --2- 172.21.15.102:0/519121457 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7faf680719b0 0x7faf68152db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:14.520 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:14.510+0000 7faf6cf57640 1 -- 172.21.15.102:0/519121457 >> 172.21.15.102:0/519121457 conn(0x7faf680b0870 msgr2=0x7faf68167e10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-13T11:29:14.520 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:14.510+0000 7faf6cf57640 1 -- 172.21.15.102:0/519121457 shutdown_connections 2023-11-13T11:29:14.521 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:14.510+0000 7faf6cf57640 1 -- 172.21.15.102:0/519121457 wait complete. 2023-11-13T11:29:14.538 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-11-13T11:29:14.539 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-11-13T11:29:14.539 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi102.front.sepia.ceph.com 2023-11-13T11:29:14.540 INFO:tasks.cephfs.mount:self.client.name = client.2 2023-11-13T11:29:14.540 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2023-11-13T11:29:14.540 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-11-13T11:29:14.540 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-11-13T11:29:14.541 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-11-13T11:29:14.541 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.2' 2023-11-13T11:29:14.542 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-13T11:29:14.542 DEBUG:teuthology.orchestra.run.smithi102:> ip addr 2023-11-13T11:29:14.553 INFO:teuthology.orchestra.run.smithi102.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-11-13T11:29:14.553 INFO:teuthology.orchestra.run.smithi102.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-11-13T11:29:14.554 INFO:teuthology.orchestra.run.smithi102.stdout: inet 127.0.0.1/8 scope host lo 2023-11-13T11:29:14.554 INFO:teuthology.orchestra.run.smithi102.stdout: valid_lft forever preferred_lft forever 2023-11-13T11:29:14.554 INFO:teuthology.orchestra.run.smithi102.stdout: inet6 ::1/128 scope host 2023-11-13T11:29:14.554 INFO:teuthology.orchestra.run.smithi102.stdout: valid_lft forever preferred_lft forever 2023-11-13T11:29:14.555 INFO:teuthology.orchestra.run.smithi102.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-11-13T11:29:14.555 INFO:teuthology.orchestra.run.smithi102.stdout: link/ether 0c:c4:7a:d8:d9:dc brd ff:ff:ff:ff:ff:ff 2023-11-13T11:29:14.555 INFO:teuthology.orchestra.run.smithi102.stdout: altname enp7s0f0 2023-11-13T11:29:14.555 INFO:teuthology.orchestra.run.smithi102.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-11-13T11:29:14.555 INFO:teuthology.orchestra.run.smithi102.stdout: link/ether 0c:c4:7a:d8:d9:dd brd ff:ff:ff:ff:ff:ff 2023-11-13T11:29:14.556 INFO:teuthology.orchestra.run.smithi102.stdout: altname enp7s0f1 2023-11-13T11:29:14.556 INFO:teuthology.orchestra.run.smithi102.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-11-13T11:29:14.556 INFO:teuthology.orchestra.run.smithi102.stdout: link/ether 0c:c4:7a:8f:d7:68 brd ff:ff:ff:ff:ff:ff 2023-11-13T11:29:14.556 INFO:teuthology.orchestra.run.smithi102.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-11-13T11:29:14.556 INFO:teuthology.orchestra.run.smithi102.stdout: link/ether 0c:c4:7a:8f:d7:69 brd ff:ff:ff:ff:ff:ff 2023-11-13T11:29:14.557 INFO:teuthology.orchestra.run.smithi102.stdout: inet 172.21.15.102/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2023-11-13T11:29:14.557 INFO:teuthology.orchestra.run.smithi102.stdout: valid_lft 42409sec preferred_lft 42409sec 2023-11-13T11:29:14.557 INFO:teuthology.orchestra.run.smithi102.stdout: inet6 fe80::ec4:7aff:fe8f:d769/64 scope link 2023-11-13T11:29:14.557 INFO:teuthology.orchestra.run.smithi102.stdout: valid_lft forever preferred_lft forever 2023-11-13T11:29:14.557 INFO:teuthology.orchestra.run.smithi102.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-11-13T11:29:14.558 INFO:teuthology.orchestra.run.smithi102.stdout: link/ether 02:42:47:27:4a:d8 brd ff:ff:ff:ff:ff:ff 2023-11-13T11:29:14.558 INFO:teuthology.orchestra.run.smithi102.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-11-13T11:29:14.558 INFO:teuthology.orchestra.run.smithi102.stdout: valid_lft forever preferred_lft forever 2023-11-13T11:29:14.558 INFO:teuthology.orchestra.run.smithi102.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-11-13T11:29:14.559 INFO:teuthology.orchestra.run.smithi102.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2023-11-13T11:29:14.559 INFO:teuthology.orchestra.run.smithi102.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-11-13T11:29:14.559 INFO:teuthology.orchestra.run.smithi102.stdout: valid_lft forever preferred_lft forever 2023-11-13T11:29:14.559 INFO:teuthology.orchestra.run.smithi102.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link tentative 2023-11-13T11:29:14.559 INFO:teuthology.orchestra.run.smithi102.stdout: valid_lft forever preferred_lft forever 2023-11-13T11:29:14.560 INFO:teuthology.orchestra.run.smithi102.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-11-13T11:29:14.560 INFO:teuthology.orchestra.run.smithi102.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-13T11:29:14.560 INFO:teuthology.orchestra.run.smithi102.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link tentative 2023-11-13T11:29:14.560 INFO:teuthology.orchestra.run.smithi102.stdout: valid_lft forever preferred_lft forever 2023-11-13T11:29:14.560 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-13T11:29:14.561 DEBUG:teuthology.orchestra.run.smithi102:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-11-13T11:29:14.613 INFO:teuthology.orchestra.run.smithi102.stdout:1 2023-11-13T11:29:14.615 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-13T11:29:14.616 DEBUG:teuthology.orchestra.run.smithi102:> route 2023-11-13T11:29:14.669 INFO:teuthology.orchestra.run.smithi102.stdout:Kernel IP routing table 2023-11-13T11:29:14.669 INFO:teuthology.orchestra.run.smithi102.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-11-13T11:29:14.670 INFO:teuthology.orchestra.run.smithi102.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2023-11-13T11:29:14.670 INFO:teuthology.orchestra.run.smithi102.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-11-13T11:29:14.670 INFO:teuthology.orchestra.run.smithi102.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-11-13T11:29:14.670 INFO:teuthology.orchestra.run.smithi102.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-11-13T11:29:14.670 INFO:teuthology.orchestra.run.smithi102.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-11-13T11:29:14.671 INFO:teuthology.orchestra.run.smithi102.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-11-13T11:29:14.671 INFO:teuthology.orchestra.run.smithi102.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-11-13T11:29:14.671 INFO:teuthology.orchestra.run.smithi102.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-11-13T11:29:14.671 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-13T11:29:14.672 DEBUG:teuthology.orchestra.run.smithi102:> (cd / && exec bash -c ' 2023-11-13T11:29:14.672 DEBUG:teuthology.orchestra.run.smithi102:> set -e 2023-11-13T11:29:14.673 DEBUG:teuthology.orchestra.run.smithi102:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-11-13T11:29:14.673 DEBUG:teuthology.orchestra.run.smithi102:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-11-13T11:29:14.673 DEBUG:teuthology.orchestra.run.smithi102:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-11-13T11:29:14.673 DEBUG:teuthology.orchestra.run.smithi102:> ') 2023-11-13T11:29:14.764 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-13T11:29:14.765 DEBUG:teuthology.orchestra.run.smithi102:> ip netns list 2023-11-13T11:29:14.774 INFO:teuthology.orchestra.run.smithi102.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-11-13T11:29:14.775 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-13T11:29:14.775 DEBUG:teuthology.orchestra.run.smithi102:> ip netns list-id 2023-11-13T11:29:14.830 INFO:teuthology.orchestra.run.smithi102.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.0) 2023-11-13T11:29:14.831 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-13T11:29:14.832 DEBUG:teuthology.orchestra.run.smithi102:> (cd / && exec bash -c ' 2023-11-13T11:29:14.832 DEBUG:teuthology.orchestra.run.smithi102:> set -e 2023-11-13T11:29:14.832 DEBUG:teuthology.orchestra.run.smithi102:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-13T11:29:14.833 DEBUG:teuthology.orchestra.run.smithi102:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.2 1 2023-11-13T11:29:14.833 DEBUG:teuthology.orchestra.run.smithi102:> ') 2023-11-13T11:29:14.913 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-13T11:29:14.914 DEBUG:teuthology.orchestra.run.smithi102:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2023-11-13T11:29:14.977 INFO:teuthology.orchestra.run.smithi102.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-11-13T11:29:14.977 INFO:teuthology.orchestra.run.smithi102.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-11-13T11:29:14.977 INFO:teuthology.orchestra.run.smithi102.stdout: inet 127.0.0.1/8 scope host lo 2023-11-13T11:29:14.977 INFO:teuthology.orchestra.run.smithi102.stdout: valid_lft forever preferred_lft forever 2023-11-13T11:29:14.978 INFO:teuthology.orchestra.run.smithi102.stdout: inet6 ::1/128 scope host 2023-11-13T11:29:14.978 INFO:teuthology.orchestra.run.smithi102.stdout: valid_lft forever preferred_lft forever 2023-11-13T11:29:14.978 INFO:teuthology.orchestra.run.smithi102.stdout:2: veth0@if8: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-11-13T11:29:14.978 INFO:teuthology.orchestra.run.smithi102.stdout: link/ether ae:7f:e4:43:31:12 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-11-13T11:29:14.979 INFO:teuthology.orchestra.run.smithi102.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-11-13T11:29:14.979 INFO:teuthology.orchestra.run.smithi102.stdout: valid_lft forever preferred_lft forever 2023-11-13T11:29:14.979 INFO:teuthology.orchestra.run.smithi102.stdout: inet6 fe80::ac7f:e4ff:fe43:3112/64 scope link 2023-11-13T11:29:14.979 INFO:teuthology.orchestra.run.smithi102.stdout: valid_lft forever preferred_lft forever 2023-11-13T11:29:14.980 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-13T11:29:14.981 DEBUG:teuthology.orchestra.run.smithi102:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2023-11-13T11:29:15.044 INFO:teuthology.orchestra.run.smithi102.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-11-13T11:29:15.044 INFO:teuthology.orchestra.run.smithi102.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-11-13T11:29:15.044 INFO:teuthology.orchestra.run.smithi102.stdout: inet 127.0.0.1/8 scope host lo 2023-11-13T11:29:15.045 INFO:teuthology.orchestra.run.smithi102.stdout: valid_lft forever preferred_lft forever 2023-11-13T11:29:15.045 INFO:teuthology.orchestra.run.smithi102.stdout: inet6 ::1/128 scope host 2023-11-13T11:29:15.045 INFO:teuthology.orchestra.run.smithi102.stdout: valid_lft forever preferred_lft forever 2023-11-13T11:29:15.045 INFO:teuthology.orchestra.run.smithi102.stdout:2: veth0@if8: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-11-13T11:29:15.046 INFO:teuthology.orchestra.run.smithi102.stdout: link/ether ae:7f:e4:43:31:12 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-11-13T11:29:15.046 INFO:teuthology.orchestra.run.smithi102.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-11-13T11:29:15.046 INFO:teuthology.orchestra.run.smithi102.stdout: valid_lft forever preferred_lft forever 2023-11-13T11:29:15.046 INFO:teuthology.orchestra.run.smithi102.stdout: inet6 fe80::ac7f:e4ff:fe43:3112/64 scope link 2023-11-13T11:29:15.047 INFO:teuthology.orchestra.run.smithi102.stdout: valid_lft forever preferred_lft forever 2023-11-13T11:29:15.048 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.2' with 192.168.0.2/16 2023-11-13T11:29:15.048 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-13T11:29:15.049 DEBUG:teuthology.orchestra.run.smithi102:> (cd / && exec bash -c ' 2023-11-13T11:29:15.049 DEBUG:teuthology.orchestra.run.smithi102:> set -e 2023-11-13T11:29:15.049 DEBUG:teuthology.orchestra.run.smithi102:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.2 type veth peer name brx.1 2023-11-13T11:29:15.050 DEBUG:teuthology.orchestra.run.smithi102:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2023-11-13T11:29:15.050 DEBUG:teuthology.orchestra.run.smithi102:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set veth0 up 2023-11-13T11:29:15.050 DEBUG:teuthology.orchestra.run.smithi102:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set lo up 2023-11-13T11:29:15.051 DEBUG:teuthology.orchestra.run.smithi102:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip route add default via 192.168.255.254 2023-11-13T11:29:15.051 DEBUG:teuthology.orchestra.run.smithi102:> ') 2023-11-13T11:29:15.191 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-13T11:29:15.191 DEBUG:teuthology.orchestra.run.smithi102:> (cd / && exec bash -c ' 2023-11-13T11:29:15.192 DEBUG:teuthology.orchestra.run.smithi102:> set -e 2023-11-13T11:29:15.192 DEBUG:teuthology.orchestra.run.smithi102:> sudo ip link set brx.1 up 2023-11-13T11:29:15.192 DEBUG:teuthology.orchestra.run.smithi102:> sudo ip link set dev brx.1 master ceph-brx 2023-11-13T11:29:15.193 DEBUG:teuthology.orchestra.run.smithi102:> ') 2023-11-13T11:29:15.232 INFO:tasks.cephfs.fuse_mount:Client client.2 config is {} 2023-11-13T11:29:15.233 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-13T11:29:15.233 DEBUG:teuthology.orchestra.run.smithi102:> mkdir -p -v /home/ubuntu/cephtest/mnt.2 2023-11-13T11:29:15.287 INFO:teuthology.orchestra.run.smithi102.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.2' 2023-11-13T11:29:15.287 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-13T11:29:15.288 DEBUG:teuthology.orchestra.run.smithi102:> chmod 0000 /home/ubuntu/cephtest/mnt.2 2023-11-13T11:29:15.338 DEBUG:teuthology.orchestra.run.smithi102:> sudo modprobe fuse 2023-11-13T11:29:15.403 DEBUG:teuthology.orchestra.run.smithi102:> cat /proc/self/mounts | awk '{print $2}' 2023-11-13T11:29:15.460 INFO:teuthology.orchestra.run.smithi102.stdout:/sys 2023-11-13T11:29:15.461 INFO:teuthology.orchestra.run.smithi102.stdout:/proc 2023-11-13T11:29:15.461 INFO:teuthology.orchestra.run.smithi102.stdout:/dev 2023-11-13T11:29:15.461 INFO:teuthology.orchestra.run.smithi102.stdout:/dev/pts 2023-11-13T11:29:15.461 INFO:teuthology.orchestra.run.smithi102.stdout:/run 2023-11-13T11:29:15.461 INFO:teuthology.orchestra.run.smithi102.stdout:/ 2023-11-13T11:29:15.462 INFO:teuthology.orchestra.run.smithi102.stdout:/sys/kernel/security 2023-11-13T11:29:15.462 INFO:teuthology.orchestra.run.smithi102.stdout:/dev/shm 2023-11-13T11:29:15.462 INFO:teuthology.orchestra.run.smithi102.stdout:/run/lock 2023-11-13T11:29:15.462 INFO:teuthology.orchestra.run.smithi102.stdout:/sys/fs/cgroup 2023-11-13T11:29:15.462 INFO:teuthology.orchestra.run.smithi102.stdout:/sys/fs/pstore 2023-11-13T11:29:15.463 INFO:teuthology.orchestra.run.smithi102.stdout:/sys/fs/bpf 2023-11-13T11:29:15.463 INFO:teuthology.orchestra.run.smithi102.stdout:/proc/sys/fs/binfmt_misc 2023-11-13T11:29:15.463 INFO:teuthology.orchestra.run.smithi102.stdout:/dev/hugepages 2023-11-13T11:29:15.463 INFO:teuthology.orchestra.run.smithi102.stdout:/dev/mqueue 2023-11-13T11:29:15.463 INFO:teuthology.orchestra.run.smithi102.stdout:/sys/kernel/debug 2023-11-13T11:29:15.464 INFO:teuthology.orchestra.run.smithi102.stdout:/sys/kernel/tracing 2023-11-13T11:29:15.464 INFO:teuthology.orchestra.run.smithi102.stdout:/proc/fs/nfsd 2023-11-13T11:29:15.464 INFO:teuthology.orchestra.run.smithi102.stdout:/sys/fs/fuse/connections 2023-11-13T11:29:15.464 INFO:teuthology.orchestra.run.smithi102.stdout:/sys/kernel/config 2023-11-13T11:29:15.464 INFO:teuthology.orchestra.run.smithi102.stdout:/run/credentials/systemd-sysusers.service 2023-11-13T11:29:15.465 INFO:teuthology.orchestra.run.smithi102.stdout:/run/rpc_pipefs 2023-11-13T11:29:15.465 INFO:teuthology.orchestra.run.smithi102.stdout:/run/user/1000 2023-11-13T11:29:15.465 INFO:teuthology.orchestra.run.smithi102.stdout:/var/lib/ceph 2023-11-13T11:29:15.465 INFO:teuthology.orchestra.run.smithi102.stdout:/var/lib/ceph/osd/ceph-0 2023-11-13T11:29:15.465 INFO:teuthology.orchestra.run.smithi102.stdout:/var/lib/ceph/osd/ceph-1 2023-11-13T11:29:15.465 INFO:teuthology.orchestra.run.smithi102.stdout:/var/lib/ceph/osd/ceph-2 2023-11-13T11:29:15.466 INFO:teuthology.orchestra.run.smithi102.stdout:/var/lib/ceph/osd/ceph-3 2023-11-13T11:29:15.466 INFO:teuthology.orchestra.run.smithi102.stdout:/run/netns 2023-11-13T11:29:15.466 INFO:teuthology.orchestra.run.smithi102.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-13T11:29:15.466 INFO:teuthology.orchestra.run.smithi102.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-13T11:29:15.466 INFO:teuthology.orchestra.run.smithi102.stdout:/home/ubuntu/cephtest/mnt.0 2023-11-13T11:29:15.467 INFO:teuthology.orchestra.run.smithi102.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-13T11:29:15.467 INFO:teuthology.orchestra.run.smithi102.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-13T11:29:15.468 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-13T11:29:15.468 DEBUG:teuthology.orchestra.run.smithi102:> ls /sys/fs/fuse/connections 2023-11-13T11:29:15.518 INFO:teuthology.orchestra.run.smithi102.stdout:43 2023-11-13T11:29:15.519 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [43] 2023-11-13T11:29:15.519 DEBUG:teuthology.orchestra.run.smithi102:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.2 --id 2) 2023-11-13T11:29:15.569 DEBUG:teuthology.orchestra.run.smithi102:> sudo modprobe fuse 2023-11-13T11:29:15.592 DEBUG:teuthology.orchestra.run.smithi102:> cat /proc/self/mounts | awk '{print $2}' 2023-11-13T11:29:15.648 INFO:teuthology.orchestra.run.smithi102.stdout:/sys 2023-11-13T11:29:15.649 INFO:teuthology.orchestra.run.smithi102.stdout:/proc 2023-11-13T11:29:15.649 INFO:teuthology.orchestra.run.smithi102.stdout:/dev 2023-11-13T11:29:15.649 INFO:teuthology.orchestra.run.smithi102.stdout:/dev/pts 2023-11-13T11:29:15.649 INFO:teuthology.orchestra.run.smithi102.stdout:/run 2023-11-13T11:29:15.650 INFO:teuthology.orchestra.run.smithi102.stdout:/ 2023-11-13T11:29:15.650 INFO:teuthology.orchestra.run.smithi102.stdout:/sys/kernel/security 2023-11-13T11:29:15.650 INFO:teuthology.orchestra.run.smithi102.stdout:/dev/shm 2023-11-13T11:29:15.650 INFO:teuthology.orchestra.run.smithi102.stdout:/run/lock 2023-11-13T11:29:15.650 INFO:teuthology.orchestra.run.smithi102.stdout:/sys/fs/cgroup 2023-11-13T11:29:15.651 INFO:teuthology.orchestra.run.smithi102.stdout:/sys/fs/pstore 2023-11-13T11:29:15.651 INFO:teuthology.orchestra.run.smithi102.stdout:/sys/fs/bpf 2023-11-13T11:29:15.651 INFO:teuthology.orchestra.run.smithi102.stdout:/proc/sys/fs/binfmt_misc 2023-11-13T11:29:15.651 INFO:teuthology.orchestra.run.smithi102.stdout:/dev/hugepages 2023-11-13T11:29:15.651 INFO:teuthology.orchestra.run.smithi102.stdout:/dev/mqueue 2023-11-13T11:29:15.652 INFO:teuthology.orchestra.run.smithi102.stdout:/sys/kernel/debug 2023-11-13T11:29:15.652 INFO:teuthology.orchestra.run.smithi102.stdout:/sys/kernel/tracing 2023-11-13T11:29:15.652 INFO:teuthology.orchestra.run.smithi102.stdout:/proc/fs/nfsd 2023-11-13T11:29:15.652 INFO:teuthology.orchestra.run.smithi102.stdout:/sys/fs/fuse/connections 2023-11-13T11:29:15.652 INFO:teuthology.orchestra.run.smithi102.stdout:/sys/kernel/config 2023-11-13T11:29:15.653 INFO:teuthology.orchestra.run.smithi102.stdout:/run/credentials/systemd-sysusers.service 2023-11-13T11:29:15.653 INFO:teuthology.orchestra.run.smithi102.stdout:/run/rpc_pipefs 2023-11-13T11:29:15.653 INFO:teuthology.orchestra.run.smithi102.stdout:/run/user/1000 2023-11-13T11:29:15.653 INFO:teuthology.orchestra.run.smithi102.stdout:/var/lib/ceph 2023-11-13T11:29:15.653 INFO:teuthology.orchestra.run.smithi102.stdout:/var/lib/ceph/osd/ceph-0 2023-11-13T11:29:15.653 INFO:teuthology.orchestra.run.smithi102.stdout:/var/lib/ceph/osd/ceph-1 2023-11-13T11:29:15.654 INFO:teuthology.orchestra.run.smithi102.stdout:/var/lib/ceph/osd/ceph-2 2023-11-13T11:29:15.654 INFO:teuthology.orchestra.run.smithi102.stdout:/var/lib/ceph/osd/ceph-3 2023-11-13T11:29:15.654 INFO:teuthology.orchestra.run.smithi102.stdout:/run/netns 2023-11-13T11:29:15.654 INFO:teuthology.orchestra.run.smithi102.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-13T11:29:15.654 INFO:teuthology.orchestra.run.smithi102.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-13T11:29:15.655 INFO:teuthology.orchestra.run.smithi102.stdout:/home/ubuntu/cephtest/mnt.0 2023-11-13T11:29:15.655 INFO:teuthology.orchestra.run.smithi102.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-13T11:29:15.655 INFO:teuthology.orchestra.run.smithi102.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-13T11:29:15.656 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-13T11:29:15.656 DEBUG:teuthology.orchestra.run.smithi102:> ls /sys/fs/fuse/connections 2023-11-13T11:29:15.664 INFO:tasks.cephfs.fuse_mount.ceph-fuse.2.smithi102.stderr:2023-11-13T11:29:15.658+0000 7f7110648580 -1 init, newargv = 0x561a8c52aed0 newargc=15 2023-11-13T11:29:15.664 INFO:tasks.cephfs.fuse_mount.ceph-fuse.2.smithi102.stderr:ceph-fuse[45540]: starting ceph client 2023-11-13T11:29:15.672 INFO:tasks.cephfs.fuse_mount.ceph-fuse.2.smithi102.stderr:ceph-fuse[45540]: starting fuse 2023-11-13T11:29:15.673 INFO:teuthology.orchestra.run.smithi102.stdout:43 2023-11-13T11:29:15.673 INFO:teuthology.orchestra.run.smithi102.stdout:44 2023-11-13T11:29:15.674 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [43, 44] 2023-11-13T11:29:15.674 DEBUG:teuthology.orchestra.run.smithi102:> sudo stdin-killer -- python3 -c ' 2023-11-13T11:29:15.674 DEBUG:teuthology.orchestra.run.smithi102:> import glob 2023-11-13T11:29:15.675 DEBUG:teuthology.orchestra.run.smithi102:> import re 2023-11-13T11:29:15.675 DEBUG:teuthology.orchestra.run.smithi102:> import os 2023-11-13T11:29:15.675 DEBUG:teuthology.orchestra.run.smithi102:> import subprocess 2023-11-13T11:29:15.676 DEBUG:teuthology.orchestra.run.smithi102:> 2023-11-13T11:29:15.676 DEBUG:teuthology.orchestra.run.smithi102:> def _find_admin_socket(client_name): 2023-11-13T11:29:15.676 DEBUG:teuthology.orchestra.run.smithi102:> asok_path = "/var/run/ceph/ceph-client.2.*.asok" 2023-11-13T11:29:15.676 DEBUG:teuthology.orchestra.run.smithi102:> files = glob.glob(asok_path) 2023-11-13T11:29:15.677 DEBUG:teuthology.orchestra.run.smithi102:> mountpoint = "/home/ubuntu/cephtest/mnt.2" 2023-11-13T11:29:15.677 DEBUG:teuthology.orchestra.run.smithi102:> 2023-11-13T11:29:15.677 DEBUG:teuthology.orchestra.run.smithi102:> # Given a non-glob path, it better be there 2023-11-13T11:29:15.677 DEBUG:teuthology.orchestra.run.smithi102:> if "*" not in asok_path: 2023-11-13T11:29:15.678 DEBUG:teuthology.orchestra.run.smithi102:> assert(len(files) == 1) 2023-11-13T11:29:15.678 DEBUG:teuthology.orchestra.run.smithi102:> return files[0] 2023-11-13T11:29:15.678 DEBUG:teuthology.orchestra.run.smithi102:> 2023-11-13T11:29:15.679 DEBUG:teuthology.orchestra.run.smithi102:> for f in files: 2023-11-13T11:29:15.679 DEBUG:teuthology.orchestra.run.smithi102:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-11-13T11:29:15.679 DEBUG:teuthology.orchestra.run.smithi102:> if os.path.exists("/proc/{0}".format(pid)): 2023-11-13T11:29:15.679 DEBUG:teuthology.orchestra.run.smithi102:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-11-13T11:29:15.680 DEBUG:teuthology.orchestra.run.smithi102:> contents = proc_f.read() 2023-11-13T11:29:15.680 DEBUG:teuthology.orchestra.run.smithi102:> if mountpoint in contents: 2023-11-13T11:29:15.680 DEBUG:teuthology.orchestra.run.smithi102:> return f 2023-11-13T11:29:15.681 DEBUG:teuthology.orchestra.run.smithi102:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-11-13T11:29:15.681 DEBUG:teuthology.orchestra.run.smithi102:> 2023-11-13T11:29:15.681 DEBUG:teuthology.orchestra.run.smithi102:> print(_find_admin_socket("client.2")) 2023-11-13T11:29:15.681 DEBUG:teuthology.orchestra.run.smithi102:> ' 2023-11-13T11:29:15.798 INFO:teuthology.orchestra.run.smithi102.stdout:/var/run/ceph/ceph-client.2.45540.asok 2023-11-13T11:29:15.802 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:15 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-11-13T11:29:15.810 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.2.45540.asok 2023-11-13T11:29:15.810 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-13T11:29:15.811 DEBUG:teuthology.orchestra.run.smithi102:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.2.45540.asok status 2023-11-13T11:29:15.982 INFO:teuthology.orchestra.run.smithi102.stdout:{ 2023-11-13T11:29:15.983 INFO:teuthology.orchestra.run.smithi102.stdout: "metadata": { 2023-11-13T11:29:15.983 INFO:teuthology.orchestra.run.smithi102.stdout: "ceph_sha1": "35f0debb3cc28955b7132ef4c509cd138a09d56b", 2023-11-13T11:29:15.983 INFO:teuthology.orchestra.run.smithi102.stdout: "ceph_version": "ceph version 18.0.0-7288-g35f0debb (35f0debb3cc28955b7132ef4c509cd138a09d56b) reef (dev)", 2023-11-13T11:29:15.983 INFO:teuthology.orchestra.run.smithi102.stdout: "entity_id": "2", 2023-11-13T11:29:15.983 INFO:teuthology.orchestra.run.smithi102.stdout: "hostname": "smithi102", 2023-11-13T11:29:15.984 INFO:teuthology.orchestra.run.smithi102.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.2", 2023-11-13T11:29:15.984 INFO:teuthology.orchestra.run.smithi102.stdout: "pid": "45540", 2023-11-13T11:29:15.984 INFO:teuthology.orchestra.run.smithi102.stdout: "root": "/" 2023-11-13T11:29:15.984 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-11-13T11:29:15.984 INFO:teuthology.orchestra.run.smithi102.stdout: "dentry_count": 0, 2023-11-13T11:29:15.985 INFO:teuthology.orchestra.run.smithi102.stdout: "dentry_pinned_count": 0, 2023-11-13T11:29:15.985 INFO:teuthology.orchestra.run.smithi102.stdout: "id": 4719, 2023-11-13T11:29:15.985 INFO:teuthology.orchestra.run.smithi102.stdout: "inst": { 2023-11-13T11:29:15.985 INFO:teuthology.orchestra.run.smithi102.stdout: "name": { 2023-11-13T11:29:15.985 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "client", 2023-11-13T11:29:15.986 INFO:teuthology.orchestra.run.smithi102.stdout: "num": 4719 2023-11-13T11:29:15.986 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-11-13T11:29:15.986 INFO:teuthology.orchestra.run.smithi102.stdout: "addr": { 2023-11-13T11:29:15.986 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "v1", 2023-11-13T11:29:15.986 INFO:teuthology.orchestra.run.smithi102.stdout: "addr": "192.168.0.2:0", 2023-11-13T11:29:15.987 INFO:teuthology.orchestra.run.smithi102.stdout: "nonce": 4240848473 2023-11-13T11:29:15.987 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-11-13T11:29:15.987 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-11-13T11:29:15.987 INFO:teuthology.orchestra.run.smithi102.stdout: "addr": { 2023-11-13T11:29:15.987 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "v1", 2023-11-13T11:29:15.987 INFO:teuthology.orchestra.run.smithi102.stdout: "addr": "192.168.0.2:0", 2023-11-13T11:29:15.988 INFO:teuthology.orchestra.run.smithi102.stdout: "nonce": 4240848473 2023-11-13T11:29:15.988 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-11-13T11:29:15.988 INFO:teuthology.orchestra.run.smithi102.stdout: "inst_str": "client.4719 192.168.0.2:0/4240848473", 2023-11-13T11:29:15.988 INFO:teuthology.orchestra.run.smithi102.stdout: "addr_str": "192.168.0.2:0/4240848473", 2023-11-13T11:29:15.989 INFO:teuthology.orchestra.run.smithi102.stdout: "inode_count": 1, 2023-11-13T11:29:15.989 INFO:teuthology.orchestra.run.smithi102.stdout: "mds_epoch": 8, 2023-11-13T11:29:15.989 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_epoch": 22, 2023-11-13T11:29:15.989 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_epoch_barrier": 0, 2023-11-13T11:29:15.989 INFO:teuthology.orchestra.run.smithi102.stdout: "blocklisted": false, 2023-11-13T11:29:15.990 INFO:teuthology.orchestra.run.smithi102.stdout: "fs_name": "cephfs" 2023-11-13T11:29:15.990 INFO:teuthology.orchestra.run.smithi102.stdout:} 2023-11-13T11:29:15.997 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-11-13T11:29:16.135 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:16.130+0000 7f647e617640 1 Processor -- start 2023-11-13T11:29:16.136 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:16.130+0000 7f647e617640 1 -- start start 2023-11-13T11:29:16.137 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:16.130+0000 7f647e617640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f647806dc70 0x7f647806ba90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:16.137 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:16.130+0000 7f647e617640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f647813e530 con 0x7f647813df40 2023-11-13T11:29:16.137 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:16.130+0000 7f647e617640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f647815f290 con 0x7f647806bfd0 2023-11-13T11:29:16.137 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:16.130+0000 7f647e617640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f647806c480 con 0x7f647806dc70 2023-11-13T11:29:16.137 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:16.130+0000 7f6477fff640 1 --1- >> v1:172.21.15.102:6789/0 conn(0x7f647813df40 0x7f647815e990 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.102:6789/0 says I am v1:172.21.15.102:49726/0 (socket says 172.21.15.102:49726) 2023-11-13T11:29:16.138 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:16.130+0000 7f6477fff640 1 -- 172.21.15.102:0/1263838321 learned_addr learned my addr 172.21.15.102:0/1263838321 (peer_addr_for_me v1:172.21.15.102:0/0) 2023-11-13T11:29:16.138 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:16.130+0000 7f64777fe640 1 --2- 172.21.15.102:0/1263838321 >> v2:172.21.15.102:3300/0 conn(0x7f647806dc70 0x7f647806ba90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:16.139 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:16.130+0000 7f64777fe640 1 -- 172.21.15.102:0/1263838321 >> v1:172.21.15.154:6789/0 conn(0x7f647806bfd0 legacy=0x7f647813f6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:16.139 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:16.130+0000 7f64777fe640 1 -- 172.21.15.102:0/1263838321 >> v1:172.21.15.102:6789/0 conn(0x7f647813df40 legacy=0x7f647815e990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:16.139 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:16.130+0000 7f64777fe640 1 -- 172.21.15.102:0/1263838321 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f647815f570 con 0x7f647806dc70 2023-11-13T11:29:16.139 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:16.130+0000 7f6476ffd640 1 -- 172.21.15.102:0/1263838321 <== mon.0 v1:172.21.15.102:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2800460079 0 0) 0x7f647813e530 con 0x7f647813df40 2023-11-13T11:29:16.140 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:16.134+0000 7f64777fe640 1 --2- 172.21.15.102:0/1263838321 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f647806dc70 0x7f647806ba90 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f646c0097c0 tx=0x7f646c01c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=925f7a482b2e927f server_cookie=0 in_seq=0 out_seq=0 2023-11-13T11:29:16.140 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:16.134+0000 7f6476ffd640 1 -- 172.21.15.102:0/1263838321 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f646c0ab600 con 0x7f647806dc70 2023-11-13T11:29:16.141 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:16.134+0000 7f6476ffd640 1 -- 172.21.15.102:0/1263838321 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f646c0a7050 con 0x7f647806dc70 2023-11-13T11:29:16.141 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:16.134+0000 7f6476ffd640 1 -- 172.21.15.102:0/1263838321 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f646c0ab980 con 0x7f647806dc70 2023-11-13T11:29:16.142 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:16.134+0000 7f647e617640 1 -- 172.21.15.102:0/1263838321 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f647806dc70 msgr2=0x7f647806ba90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:16.142 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:16.134+0000 7f647e617640 1 --2- 172.21.15.102:0/1263838321 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f647806dc70 0x7f647806ba90 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f646c0097c0 tx=0x7f646c01c480 comp rx=0 tx=0).stop 2023-11-13T11:29:16.142 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:16.134+0000 7f647e617640 1 -- 172.21.15.102:0/1263838321 shutdown_connections 2023-11-13T11:29:16.142 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:16.134+0000 7f647e617640 1 --2- 172.21.15.102:0/1263838321 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f647806dc70 0x7f647806ba90 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:16.142 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:16.134+0000 7f647e617640 1 -- 172.21.15.102:0/1263838321 >> 172.21.15.102:0/1263838321 conn(0x7f64780b0870 msgr2=0x7f64780b0c80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-13T11:29:16.143 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:16.134+0000 7f647e617640 1 -- 172.21.15.102:0/1263838321 shutdown_connections 2023-11-13T11:29:16.143 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:16.134+0000 7f647e617640 1 -- 172.21.15.102:0/1263838321 wait complete. 2023-11-13T11:29:16.143 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:16.138+0000 7f647e617640 1 Processor -- start 2023-11-13T11:29:16.144 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:16.138+0000 7f647e617640 1 -- start start 2023-11-13T11:29:16.145 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:16.138+0000 7f647e617640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f647806bfd0 0x7f6478142c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:16.146 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:16.138+0000 7f647e617640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f647806dc70 0x7f6478157d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:16.146 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:16.138+0000 7f647e617640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f647813df40 0x7f64781582c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:16.146 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:16.138+0000 7f647e617640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64781427b0 con 0x7f647806dc70 2023-11-13T11:29:16.146 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:16.138+0000 7f647e617640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f647813f8b0 con 0x7f647806bfd0 2023-11-13T11:29:16.147 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:16.138+0000 7f647e617640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6478142160 con 0x7f647813df40 2023-11-13T11:29:16.147 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:16.138+0000 7f64777fe640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f647806dc70 0x7f6478157d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:16.147 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:16.138+0000 7f64777fe640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f647806dc70 0x7f6478157d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:47900/0 (socket says 172.21.15.102:47900) 2023-11-13T11:29:16.147 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:16.138+0000 7f64777fe640 1 -- 172.21.15.102:0/1908748430 learned_addr learned my addr 172.21.15.102:0/1908748430 (peer_addr_for_me v2:172.21.15.102:0/0) 2023-11-13T11:29:16.147 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:16.138+0000 7f6477fff640 1 --2- 172.21.15.102:0/1908748430 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f647806bfd0 0x7f6478142c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:16.148 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:16.138+0000 7f647cbb4640 1 --2- 172.21.15.102:0/1908748430 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f647813df40 0x7f64781582c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:16.148 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:16.138+0000 7f64777fe640 1 -- 172.21.15.102:0/1908748430 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f647813df40 msgr2=0x7f64781582c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:16.148 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:16.138+0000 7f64777fe640 1 --2- 172.21.15.102:0/1908748430 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f647813df40 0x7f64781582c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:16.148 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:16.138+0000 7f64777fe640 1 -- 172.21.15.102:0/1908748430 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f647806bfd0 msgr2=0x7f6478142c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:16.148 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:16.138+0000 7f64777fe640 1 --2- 172.21.15.102:0/1908748430 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f647806bfd0 0x7f6478142c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:16.148 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:16.138+0000 7f64777fe640 1 -- 172.21.15.102:0/1908748430 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f646c009420 con 0x7f647806dc70 2023-11-13T11:29:16.149 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:16.138+0000 7f64777fe640 1 --2- 172.21.15.102:0/1908748430 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f647806dc70 0x7f6478157d80 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f646c01a0b0 tx=0x7f646c01acc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-13T11:29:16.149 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:16.138+0000 7f6474ff9640 1 -- 172.21.15.102:0/1908748430 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f646c004220 con 0x7f647806dc70 2023-11-13T11:29:16.149 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:16.138+0000 7f6474ff9640 1 -- 172.21.15.102:0/1908748430 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f646c004380 con 0x7f647806dc70 2023-11-13T11:29:16.149 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:16.138+0000 7f6474ff9640 1 -- 172.21.15.102:0/1908748430 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f646c003820 con 0x7f647806dc70 2023-11-13T11:29:16.149 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:16.138+0000 7f647e617640 1 -- 172.21.15.102:0/1908748430 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6478142440 con 0x7f647806dc70 2023-11-13T11:29:16.150 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:16.138+0000 7f647e617640 1 -- 172.21.15.102:0/1908748430 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f647813fb90 con 0x7f647806dc70 2023-11-13T11:29:16.151 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:16.142+0000 7f647e617640 1 -- 172.21.15.102:0/1908748430 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6478068520 con 0x7f647806dc70 2023-11-13T11:29:16.151 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:16.142+0000 7f6474ff9640 1 -- 172.21.15.102:0/1908748430 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f646c003980 con 0x7f647806dc70 2023-11-13T11:29:16.151 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:16.142+0000 7f6474ff9640 1 --2- 172.21.15.102:0/1908748430 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f6464066470 0x7f6464068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:16.151 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:16.142+0000 7f6474ff9640 1 -- 172.21.15.102:0/1908748430 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f646c11e460 con 0x7f647806dc70 2023-11-13T11:29:16.151 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:16.142+0000 7f6477fff640 1 --2- 172.21.15.102:0/1908748430 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f6464066470 0x7f6464068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:16.152 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:16.142+0000 7f6477fff640 1 --2- 172.21.15.102:0/1908748430 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f6464066470 0x7f6464068930 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f6468000f70 tx=0x7f6468007240 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-13T11:29:16.152 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:16.146+0000 7f6474ff9640 1 -- 172.21.15.102:0/1908748430 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f646c0eb8f0 con 0x7f647806dc70 2023-11-13T11:29:16.334 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:16.326+0000 7f647e617640 1 -- 172.21.15.102:0/1908748430 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f647806feb0 con 0x7f647806dc70 2023-11-13T11:29:16.334 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:16.326+0000 7f6474ff9640 1 -- 172.21.15.102:0/1908748430 <== mon.0 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) v1 ==== 53+0+73 (secure 0 0 0) 0x7f646c0b0060 con 0x7f647806dc70 2023-11-13T11:29:16.335 INFO:teuthology.orchestra.run.smithi102.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-11-13T11:29:16.336 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:16.330+0000 7f647e617640 1 -- 172.21.15.102:0/1908748430 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f6464066470 msgr2=0x7f6464068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:16.336 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:16.330+0000 7f647e617640 1 --2- 172.21.15.102:0/1908748430 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f6464066470 0x7f6464068930 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f6468000f70 tx=0x7f6468007240 comp rx=0 tx=0).stop 2023-11-13T11:29:16.337 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:16.330+0000 7f647e617640 1 -- 172.21.15.102:0/1908748430 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f647806dc70 msgr2=0x7f6478157d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:16.337 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:16.330+0000 7f647e617640 1 --2- 172.21.15.102:0/1908748430 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f647806dc70 0x7f6478157d80 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f646c01a0b0 tx=0x7f646c01acc0 comp rx=0 tx=0).stop 2023-11-13T11:29:16.337 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:16.330+0000 7f647e617640 1 -- 172.21.15.102:0/1908748430 shutdown_connections 2023-11-13T11:29:16.337 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:16.330+0000 7f647e617640 1 --2- 172.21.15.102:0/1908748430 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f647813df40 0x7f64781582c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:16.337 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:16.330+0000 7f647e617640 1 --2- 172.21.15.102:0/1908748430 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f6464066470 0x7f6464068930 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:16.337 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:16.330+0000 7f647e617640 1 --2- 172.21.15.102:0/1908748430 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f647806dc70 0x7f6478157d80 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:16.338 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:16.330+0000 7f647e617640 1 --2- 172.21.15.102:0/1908748430 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f647806bfd0 0x7f6478142c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:16.338 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:16.330+0000 7f647e617640 1 -- 172.21.15.102:0/1908748430 >> 172.21.15.102:0/1908748430 conn(0x7f64780b0870 msgr2=0x7f64780660d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-13T11:29:16.338 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:16.330+0000 7f647e617640 1 -- 172.21.15.102:0/1908748430 shutdown_connections 2023-11-13T11:29:16.338 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:16.330+0000 7f647e617640 1 -- 172.21.15.102:0/1908748430 wait complete. 2023-11-13T11:29:16.355 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-11-13T11:29:16.355 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-11-13T11:29:16.355 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi154.front.sepia.ceph.com 2023-11-13T11:29:16.356 INFO:tasks.cephfs.mount:self.client.name = client.1 2023-11-13T11:29:16.356 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-11-13T11:29:16.356 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-11-13T11:29:16.356 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-11-13T11:29:16.357 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-11-13T11:29:16.357 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.1' 2023-11-13T11:29:16.357 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-13T11:29:16.358 DEBUG:teuthology.orchestra.run.smithi154:> ip addr 2023-11-13T11:29:16.368 INFO:teuthology.orchestra.run.smithi154.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-11-13T11:29:16.368 INFO:teuthology.orchestra.run.smithi154.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-11-13T11:29:16.368 INFO:teuthology.orchestra.run.smithi154.stdout: inet 127.0.0.1/8 scope host lo 2023-11-13T11:29:16.369 INFO:teuthology.orchestra.run.smithi154.stdout: valid_lft forever preferred_lft forever 2023-11-13T11:29:16.369 INFO:teuthology.orchestra.run.smithi154.stdout: inet6 ::1/128 scope host 2023-11-13T11:29:16.369 INFO:teuthology.orchestra.run.smithi154.stdout: valid_lft forever preferred_lft forever 2023-11-13T11:29:16.369 INFO:teuthology.orchestra.run.smithi154.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-11-13T11:29:16.369 INFO:teuthology.orchestra.run.smithi154.stdout: link/ether 0c:c4:7a:d9:1a:54 brd ff:ff:ff:ff:ff:ff 2023-11-13T11:29:16.370 INFO:teuthology.orchestra.run.smithi154.stdout: altname enp7s0f0 2023-11-13T11:29:16.370 INFO:teuthology.orchestra.run.smithi154.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-11-13T11:29:16.370 INFO:teuthology.orchestra.run.smithi154.stdout: link/ether 0c:c4:7a:d9:1a:55 brd ff:ff:ff:ff:ff:ff 2023-11-13T11:29:16.370 INFO:teuthology.orchestra.run.smithi154.stdout: altname enp7s0f1 2023-11-13T11:29:16.370 INFO:teuthology.orchestra.run.smithi154.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-11-13T11:29:16.371 INFO:teuthology.orchestra.run.smithi154.stdout: link/ether 0c:c4:7a:88:77:60 brd ff:ff:ff:ff:ff:ff 2023-11-13T11:29:16.371 INFO:teuthology.orchestra.run.smithi154.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-11-13T11:29:16.371 INFO:teuthology.orchestra.run.smithi154.stdout: link/ether 0c:c4:7a:88:77:61 brd ff:ff:ff:ff:ff:ff 2023-11-13T11:29:16.371 INFO:teuthology.orchestra.run.smithi154.stdout: inet 172.21.15.154/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2023-11-13T11:29:16.372 INFO:teuthology.orchestra.run.smithi154.stdout: valid_lft 42400sec preferred_lft 42400sec 2023-11-13T11:29:16.372 INFO:teuthology.orchestra.run.smithi154.stdout: inet6 fe80::ec4:7aff:fe88:7761/64 scope link 2023-11-13T11:29:16.372 INFO:teuthology.orchestra.run.smithi154.stdout: valid_lft forever preferred_lft forever 2023-11-13T11:29:16.372 INFO:teuthology.orchestra.run.smithi154.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-11-13T11:29:16.373 INFO:teuthology.orchestra.run.smithi154.stdout: link/ether 02:42:33:07:1f:bd brd ff:ff:ff:ff:ff:ff 2023-11-13T11:29:16.373 INFO:teuthology.orchestra.run.smithi154.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-11-13T11:29:16.373 INFO:teuthology.orchestra.run.smithi154.stdout: valid_lft forever preferred_lft forever 2023-11-13T11:29:16.374 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2023-11-13T11:29:16.375 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-13T11:29:16.375 DEBUG:teuthology.orchestra.run.smithi154:> (cd / && exec bash -c ' 2023-11-13T11:29:16.376 DEBUG:teuthology.orchestra.run.smithi154:> set -e 2023-11-13T11:29:16.376 DEBUG:teuthology.orchestra.run.smithi154:> sudo ip link add name ceph-brx type bridge 2023-11-13T11:29:16.376 DEBUG:teuthology.orchestra.run.smithi154:> sudo ip addr flush dev ceph-brx 2023-11-13T11:29:16.377 DEBUG:teuthology.orchestra.run.smithi154:> sudo ip link set ceph-brx up 2023-11-13T11:29:16.377 DEBUG:teuthology.orchestra.run.smithi154:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2023-11-13T11:29:16.377 DEBUG:teuthology.orchestra.run.smithi154:> ') 2023-11-13T11:29:16.490 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-13T11:29:16.491 DEBUG:teuthology.orchestra.run.smithi154:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-11-13T11:29:16.510 INFO:teuthology.orchestra.run.smithi154.stdout:1 2023-11-13T11:29:16.512 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-13T11:29:16.512 DEBUG:teuthology.orchestra.run.smithi154:> route 2023-11-13T11:29:16.591 INFO:teuthology.orchestra.run.smithi154.stdout:Kernel IP routing table 2023-11-13T11:29:16.592 INFO:teuthology.orchestra.run.smithi154.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-11-13T11:29:16.592 INFO:teuthology.orchestra.run.smithi154.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2023-11-13T11:29:16.592 INFO:teuthology.orchestra.run.smithi154.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-11-13T11:29:16.592 INFO:teuthology.orchestra.run.smithi154.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-11-13T11:29:16.592 INFO:teuthology.orchestra.run.smithi154.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-11-13T11:29:16.593 INFO:teuthology.orchestra.run.smithi154.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-11-13T11:29:16.593 INFO:teuthology.orchestra.run.smithi154.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-11-13T11:29:16.593 INFO:teuthology.orchestra.run.smithi154.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-11-13T11:29:16.593 INFO:teuthology.orchestra.run.smithi154.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-11-13T11:29:16.594 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-13T11:29:16.594 DEBUG:teuthology.orchestra.run.smithi154:> (cd / && exec bash -c ' 2023-11-13T11:29:16.594 DEBUG:teuthology.orchestra.run.smithi154:> set -e 2023-11-13T11:29:16.595 DEBUG:teuthology.orchestra.run.smithi154:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-11-13T11:29:16.595 DEBUG:teuthology.orchestra.run.smithi154:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-11-13T11:29:16.595 DEBUG:teuthology.orchestra.run.smithi154:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-11-13T11:29:16.595 DEBUG:teuthology.orchestra.run.smithi154:> ') 2023-11-13T11:29:16.687 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-13T11:29:16.688 DEBUG:teuthology.orchestra.run.smithi154:> ip netns list 2023-11-13T11:29:16.698 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-13T11:29:16.698 DEBUG:teuthology.orchestra.run.smithi154:> ip netns list-id 2023-11-13T11:29:16.747 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-13T11:29:16.748 DEBUG:teuthology.orchestra.run.smithi154:> (cd / && exec bash -c ' 2023-11-13T11:29:16.748 DEBUG:teuthology.orchestra.run.smithi154:> set -e 2023-11-13T11:29:16.749 DEBUG:teuthology.orchestra.run.smithi154:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.1 2023-11-13T11:29:16.749 DEBUG:teuthology.orchestra.run.smithi154:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.1 0 2023-11-13T11:29:16.749 DEBUG:teuthology.orchestra.run.smithi154:> ') 2023-11-13T11:29:16.834 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.1' with 192.168.0.1/16 2023-11-13T11:29:16.834 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-13T11:29:16.834 DEBUG:teuthology.orchestra.run.smithi154:> (cd / && exec bash -c ' 2023-11-13T11:29:16.835 DEBUG:teuthology.orchestra.run.smithi154:> set -e 2023-11-13T11:29:16.835 DEBUG:teuthology.orchestra.run.smithi154:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.1 type veth peer name brx.0 2023-11-13T11:29:16.835 DEBUG:teuthology.orchestra.run.smithi154:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2023-11-13T11:29:16.836 DEBUG:teuthology.orchestra.run.smithi154:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set veth0 up 2023-11-13T11:29:16.836 DEBUG:teuthology.orchestra.run.smithi154:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set lo up 2023-11-13T11:29:16.836 DEBUG:teuthology.orchestra.run.smithi154:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip route add default via 192.168.255.254 2023-11-13T11:29:16.837 DEBUG:teuthology.orchestra.run.smithi154:> ') 2023-11-13T11:29:16.998 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-13T11:29:16.999 DEBUG:teuthology.orchestra.run.smithi154:> (cd / && exec bash -c ' 2023-11-13T11:29:16.999 DEBUG:teuthology.orchestra.run.smithi154:> set -e 2023-11-13T11:29:16.999 DEBUG:teuthology.orchestra.run.smithi154:> sudo ip link set brx.0 up 2023-11-13T11:29:16.999 DEBUG:teuthology.orchestra.run.smithi154:> sudo ip link set dev brx.0 master ceph-brx 2023-11-13T11:29:17.000 DEBUG:teuthology.orchestra.run.smithi154:> ') 2023-11-13T11:29:17.041 INFO:tasks.cephfs.fuse_mount:Client client.1 config is {} 2023-11-13T11:29:17.041 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-13T11:29:17.041 DEBUG:teuthology.orchestra.run.smithi154:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2023-11-13T11:29:17.091 INFO:teuthology.orchestra.run.smithi154.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2023-11-13T11:29:17.092 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-13T11:29:17.092 DEBUG:teuthology.orchestra.run.smithi154:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2023-11-13T11:29:17.143 DEBUG:teuthology.orchestra.run.smithi154:> sudo modprobe fuse 2023-11-13T11:29:17.212 DEBUG:teuthology.orchestra.run.smithi154:> cat /proc/self/mounts | awk '{print $2}' 2023-11-13T11:29:17.265 INFO:teuthology.orchestra.run.smithi154.stdout:/sys 2023-11-13T11:29:17.265 INFO:teuthology.orchestra.run.smithi154.stdout:/proc 2023-11-13T11:29:17.265 INFO:teuthology.orchestra.run.smithi154.stdout:/dev 2023-11-13T11:29:17.266 INFO:teuthology.orchestra.run.smithi154.stdout:/dev/pts 2023-11-13T11:29:17.266 INFO:teuthology.orchestra.run.smithi154.stdout:/run 2023-11-13T11:29:17.266 INFO:teuthology.orchestra.run.smithi154.stdout:/ 2023-11-13T11:29:17.266 INFO:teuthology.orchestra.run.smithi154.stdout:/sys/kernel/security 2023-11-13T11:29:17.266 INFO:teuthology.orchestra.run.smithi154.stdout:/dev/shm 2023-11-13T11:29:17.267 INFO:teuthology.orchestra.run.smithi154.stdout:/run/lock 2023-11-13T11:29:17.267 INFO:teuthology.orchestra.run.smithi154.stdout:/sys/fs/cgroup 2023-11-13T11:29:17.267 INFO:teuthology.orchestra.run.smithi154.stdout:/sys/fs/pstore 2023-11-13T11:29:17.267 INFO:teuthology.orchestra.run.smithi154.stdout:/sys/fs/bpf 2023-11-13T11:29:17.267 INFO:teuthology.orchestra.run.smithi154.stdout:/proc/sys/fs/binfmt_misc 2023-11-13T11:29:17.268 INFO:teuthology.orchestra.run.smithi154.stdout:/dev/hugepages 2023-11-13T11:29:17.268 INFO:teuthology.orchestra.run.smithi154.stdout:/dev/mqueue 2023-11-13T11:29:17.268 INFO:teuthology.orchestra.run.smithi154.stdout:/sys/kernel/debug 2023-11-13T11:29:17.268 INFO:teuthology.orchestra.run.smithi154.stdout:/sys/kernel/tracing 2023-11-13T11:29:17.268 INFO:teuthology.orchestra.run.smithi154.stdout:/proc/fs/nfsd 2023-11-13T11:29:17.268 INFO:teuthology.orchestra.run.smithi154.stdout:/sys/fs/fuse/connections 2023-11-13T11:29:17.269 INFO:teuthology.orchestra.run.smithi154.stdout:/sys/kernel/config 2023-11-13T11:29:17.269 INFO:teuthology.orchestra.run.smithi154.stdout:/run/credentials/systemd-sysusers.service 2023-11-13T11:29:17.269 INFO:teuthology.orchestra.run.smithi154.stdout:/run/rpc_pipefs 2023-11-13T11:29:17.269 INFO:teuthology.orchestra.run.smithi154.stdout:/run/user/1000 2023-11-13T11:29:17.269 INFO:teuthology.orchestra.run.smithi154.stdout:/var/lib/ceph 2023-11-13T11:29:17.270 INFO:teuthology.orchestra.run.smithi154.stdout:/var/lib/ceph/osd/ceph-4 2023-11-13T11:29:17.270 INFO:teuthology.orchestra.run.smithi154.stdout:/var/lib/ceph/osd/ceph-5 2023-11-13T11:29:17.270 INFO:teuthology.orchestra.run.smithi154.stdout:/var/lib/ceph/osd/ceph-6 2023-11-13T11:29:17.270 INFO:teuthology.orchestra.run.smithi154.stdout:/var/lib/ceph/osd/ceph-7 2023-11-13T11:29:17.270 INFO:teuthology.orchestra.run.smithi154.stdout:/run/netns 2023-11-13T11:29:17.271 INFO:teuthology.orchestra.run.smithi154.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2023-11-13T11:29:17.271 INFO:teuthology.orchestra.run.smithi154.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2023-11-13T11:29:17.272 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-13T11:29:17.272 DEBUG:teuthology.orchestra.run.smithi154:> ls /sys/fs/fuse/connections 2023-11-13T11:29:17.323 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-11-13T11:29:17.324 DEBUG:teuthology.orchestra.run.smithi154:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.1 --id 1) 2023-11-13T11:29:17.370 DEBUG:teuthology.orchestra.run.smithi154:> sudo modprobe fuse 2023-11-13T11:29:17.392 DEBUG:teuthology.orchestra.run.smithi154:> cat /proc/self/mounts | awk '{print $2}' 2023-11-13T11:29:17.445 INFO:teuthology.orchestra.run.smithi154.stdout:/sys 2023-11-13T11:29:17.445 INFO:teuthology.orchestra.run.smithi154.stdout:/proc 2023-11-13T11:29:17.446 INFO:teuthology.orchestra.run.smithi154.stdout:/dev 2023-11-13T11:29:17.446 INFO:teuthology.orchestra.run.smithi154.stdout:/dev/pts 2023-11-13T11:29:17.446 INFO:teuthology.orchestra.run.smithi154.stdout:/run 2023-11-13T11:29:17.446 INFO:teuthology.orchestra.run.smithi154.stdout:/ 2023-11-13T11:29:17.446 INFO:teuthology.orchestra.run.smithi154.stdout:/sys/kernel/security 2023-11-13T11:29:17.447 INFO:teuthology.orchestra.run.smithi154.stdout:/dev/shm 2023-11-13T11:29:17.447 INFO:teuthology.orchestra.run.smithi154.stdout:/run/lock 2023-11-13T11:29:17.447 INFO:teuthology.orchestra.run.smithi154.stdout:/sys/fs/cgroup 2023-11-13T11:29:17.447 INFO:teuthology.orchestra.run.smithi154.stdout:/sys/fs/pstore 2023-11-13T11:29:17.447 INFO:teuthology.orchestra.run.smithi154.stdout:/sys/fs/bpf 2023-11-13T11:29:17.448 INFO:teuthology.orchestra.run.smithi154.stdout:/proc/sys/fs/binfmt_misc 2023-11-13T11:29:17.448 INFO:teuthology.orchestra.run.smithi154.stdout:/dev/hugepages 2023-11-13T11:29:17.448 INFO:teuthology.orchestra.run.smithi154.stdout:/dev/mqueue 2023-11-13T11:29:17.448 INFO:teuthology.orchestra.run.smithi154.stdout:/sys/kernel/debug 2023-11-13T11:29:17.448 INFO:teuthology.orchestra.run.smithi154.stdout:/sys/kernel/tracing 2023-11-13T11:29:17.449 INFO:teuthology.orchestra.run.smithi154.stdout:/proc/fs/nfsd 2023-11-13T11:29:17.449 INFO:teuthology.orchestra.run.smithi154.stdout:/sys/fs/fuse/connections 2023-11-13T11:29:17.449 INFO:teuthology.orchestra.run.smithi154.stdout:/sys/kernel/config 2023-11-13T11:29:17.449 INFO:teuthology.orchestra.run.smithi154.stdout:/run/credentials/systemd-sysusers.service 2023-11-13T11:29:17.449 INFO:teuthology.orchestra.run.smithi154.stdout:/run/rpc_pipefs 2023-11-13T11:29:17.450 INFO:teuthology.orchestra.run.smithi154.stdout:/run/user/1000 2023-11-13T11:29:17.450 INFO:teuthology.orchestra.run.smithi154.stdout:/var/lib/ceph 2023-11-13T11:29:17.450 INFO:teuthology.orchestra.run.smithi154.stdout:/var/lib/ceph/osd/ceph-4 2023-11-13T11:29:17.450 INFO:teuthology.orchestra.run.smithi154.stdout:/var/lib/ceph/osd/ceph-5 2023-11-13T11:29:17.450 INFO:teuthology.orchestra.run.smithi154.stdout:/var/lib/ceph/osd/ceph-6 2023-11-13T11:29:17.451 INFO:teuthology.orchestra.run.smithi154.stdout:/var/lib/ceph/osd/ceph-7 2023-11-13T11:29:17.451 INFO:teuthology.orchestra.run.smithi154.stdout:/run/netns 2023-11-13T11:29:17.451 INFO:teuthology.orchestra.run.smithi154.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2023-11-13T11:29:17.451 INFO:teuthology.orchestra.run.smithi154.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2023-11-13T11:29:17.452 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-13T11:29:17.453 DEBUG:teuthology.orchestra.run.smithi154:> ls /sys/fs/fuse/connections 2023-11-13T11:29:17.484 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi154.stderr:2023-11-13T11:29:17.479+0000 7feae9de4580 -1 init, newargv = 0x55dd372abc00 newargc=15 2023-11-13T11:29:17.484 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi154.stderr:ceph-fuse[43485]: starting ceph client 2023-11-13T11:29:17.492 INFO:teuthology.orchestra.run.smithi154.stdout:43 2023-11-13T11:29:17.493 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi154.stderr:ceph-fuse[43485]: starting fuse 2023-11-13T11:29:17.493 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [43] 2023-11-13T11:29:17.493 DEBUG:teuthology.orchestra.run.smithi154:> sudo stdin-killer -- python3 -c ' 2023-11-13T11:29:17.494 DEBUG:teuthology.orchestra.run.smithi154:> import glob 2023-11-13T11:29:17.494 DEBUG:teuthology.orchestra.run.smithi154:> import re 2023-11-13T11:29:17.494 DEBUG:teuthology.orchestra.run.smithi154:> import os 2023-11-13T11:29:17.495 DEBUG:teuthology.orchestra.run.smithi154:> import subprocess 2023-11-13T11:29:17.495 DEBUG:teuthology.orchestra.run.smithi154:> 2023-11-13T11:29:17.495 DEBUG:teuthology.orchestra.run.smithi154:> def _find_admin_socket(client_name): 2023-11-13T11:29:17.496 DEBUG:teuthology.orchestra.run.smithi154:> asok_path = "/var/run/ceph/ceph-client.1.*.asok" 2023-11-13T11:29:17.496 DEBUG:teuthology.orchestra.run.smithi154:> files = glob.glob(asok_path) 2023-11-13T11:29:17.496 DEBUG:teuthology.orchestra.run.smithi154:> mountpoint = "/home/ubuntu/cephtest/mnt.1" 2023-11-13T11:29:17.497 DEBUG:teuthology.orchestra.run.smithi154:> 2023-11-13T11:29:17.497 DEBUG:teuthology.orchestra.run.smithi154:> # Given a non-glob path, it better be there 2023-11-13T11:29:17.497 DEBUG:teuthology.orchestra.run.smithi154:> if "*" not in asok_path: 2023-11-13T11:29:17.497 DEBUG:teuthology.orchestra.run.smithi154:> assert(len(files) == 1) 2023-11-13T11:29:17.498 DEBUG:teuthology.orchestra.run.smithi154:> return files[0] 2023-11-13T11:29:17.498 DEBUG:teuthology.orchestra.run.smithi154:> 2023-11-13T11:29:17.498 DEBUG:teuthology.orchestra.run.smithi154:> for f in files: 2023-11-13T11:29:17.499 DEBUG:teuthology.orchestra.run.smithi154:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-11-13T11:29:17.499 DEBUG:teuthology.orchestra.run.smithi154:> if os.path.exists("/proc/{0}".format(pid)): 2023-11-13T11:29:17.499 DEBUG:teuthology.orchestra.run.smithi154:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-11-13T11:29:17.500 DEBUG:teuthology.orchestra.run.smithi154:> contents = proc_f.read() 2023-11-13T11:29:17.500 DEBUG:teuthology.orchestra.run.smithi154:> if mountpoint in contents: 2023-11-13T11:29:17.501 DEBUG:teuthology.orchestra.run.smithi154:> return f 2023-11-13T11:29:17.501 DEBUG:teuthology.orchestra.run.smithi154:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-11-13T11:29:17.502 DEBUG:teuthology.orchestra.run.smithi154:> 2023-11-13T11:29:17.502 DEBUG:teuthology.orchestra.run.smithi154:> print(_find_admin_socket("client.1")) 2023-11-13T11:29:17.502 DEBUG:teuthology.orchestra.run.smithi154:> ' 2023-11-13T11:29:17.620 INFO:teuthology.orchestra.run.smithi154.stdout:/var/run/ceph/ceph-client.1.43485.asok 2023-11-13T11:29:17.624 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-13T11:29:17 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-11-13T11:29:17.631 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.1.43485.asok 2023-11-13T11:29:17.632 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-13T11:29:17.632 DEBUG:teuthology.orchestra.run.smithi154:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.1.43485.asok status 2023-11-13T11:29:17.806 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2023-11-13T11:29:17.807 INFO:teuthology.orchestra.run.smithi154.stdout: "metadata": { 2023-11-13T11:29:17.807 INFO:teuthology.orchestra.run.smithi154.stdout: "ceph_sha1": "35f0debb3cc28955b7132ef4c509cd138a09d56b", 2023-11-13T11:29:17.807 INFO:teuthology.orchestra.run.smithi154.stdout: "ceph_version": "ceph version 18.0.0-7288-g35f0debb (35f0debb3cc28955b7132ef4c509cd138a09d56b) reef (dev)", 2023-11-13T11:29:17.807 INFO:teuthology.orchestra.run.smithi154.stdout: "entity_id": "1", 2023-11-13T11:29:17.807 INFO:teuthology.orchestra.run.smithi154.stdout: "hostname": "smithi154", 2023-11-13T11:29:17.808 INFO:teuthology.orchestra.run.smithi154.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.1", 2023-11-13T11:29:17.808 INFO:teuthology.orchestra.run.smithi154.stdout: "pid": "43485", 2023-11-13T11:29:17.808 INFO:teuthology.orchestra.run.smithi154.stdout: "root": "/" 2023-11-13T11:29:17.808 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2023-11-13T11:29:17.808 INFO:teuthology.orchestra.run.smithi154.stdout: "dentry_count": 0, 2023-11-13T11:29:17.809 INFO:teuthology.orchestra.run.smithi154.stdout: "dentry_pinned_count": 0, 2023-11-13T11:29:17.809 INFO:teuthology.orchestra.run.smithi154.stdout: "id": 4484, 2023-11-13T11:29:17.809 INFO:teuthology.orchestra.run.smithi154.stdout: "inst": { 2023-11-13T11:29:17.809 INFO:teuthology.orchestra.run.smithi154.stdout: "name": { 2023-11-13T11:29:17.809 INFO:teuthology.orchestra.run.smithi154.stdout: "type": "client", 2023-11-13T11:29:17.809 INFO:teuthology.orchestra.run.smithi154.stdout: "num": 4484 2023-11-13T11:29:17.810 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2023-11-13T11:29:17.810 INFO:teuthology.orchestra.run.smithi154.stdout: "addr": { 2023-11-13T11:29:17.810 INFO:teuthology.orchestra.run.smithi154.stdout: "type": "v1", 2023-11-13T11:29:17.810 INFO:teuthology.orchestra.run.smithi154.stdout: "addr": "192.168.0.1:0", 2023-11-13T11:29:17.810 INFO:teuthology.orchestra.run.smithi154.stdout: "nonce": 794146164 2023-11-13T11:29:17.811 INFO:teuthology.orchestra.run.smithi154.stdout: } 2023-11-13T11:29:17.811 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2023-11-13T11:29:17.811 INFO:teuthology.orchestra.run.smithi154.stdout: "addr": { 2023-11-13T11:29:17.811 INFO:teuthology.orchestra.run.smithi154.stdout: "type": "v1", 2023-11-13T11:29:17.811 INFO:teuthology.orchestra.run.smithi154.stdout: "addr": "192.168.0.1:0", 2023-11-13T11:29:17.812 INFO:teuthology.orchestra.run.smithi154.stdout: "nonce": 794146164 2023-11-13T11:29:17.812 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2023-11-13T11:29:17.812 INFO:teuthology.orchestra.run.smithi154.stdout: "inst_str": "client.4484 192.168.0.1:0/794146164", 2023-11-13T11:29:17.812 INFO:teuthology.orchestra.run.smithi154.stdout: "addr_str": "192.168.0.1:0/794146164", 2023-11-13T11:29:17.812 INFO:teuthology.orchestra.run.smithi154.stdout: "inode_count": 1, 2023-11-13T11:29:17.813 INFO:teuthology.orchestra.run.smithi154.stdout: "mds_epoch": 8, 2023-11-13T11:29:17.813 INFO:teuthology.orchestra.run.smithi154.stdout: "osd_epoch": 22, 2023-11-13T11:29:17.813 INFO:teuthology.orchestra.run.smithi154.stdout: "osd_epoch_barrier": 0, 2023-11-13T11:29:17.813 INFO:teuthology.orchestra.run.smithi154.stdout: "blocklisted": false, 2023-11-13T11:29:17.813 INFO:teuthology.orchestra.run.smithi154.stdout: "fs_name": "cephfs" 2023-11-13T11:29:17.813 INFO:teuthology.orchestra.run.smithi154.stdout:} 2023-11-13T11:29:17.821 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-11-13T11:29:17.968 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:17.962+0000 7f2cbe180640 1 Processor -- start 2023-11-13T11:29:17.968 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:17.962+0000 7f2cbe180640 1 -- start start 2023-11-13T11:29:17.969 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:17.962+0000 7f2cbe180640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f2cb813df40 0x7f2cb815e990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:17.969 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:17.962+0000 7f2cbe180640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f2cb806c1a0 0x7f2cb813f6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:17.969 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:17.962+0000 7f2cbe180640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2cb813e530 con 0x7f2cb806dc70 2023-11-13T11:29:17.970 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:17.962+0000 7f2cbe180640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2cb815f290 con 0x7f2cb813df40 2023-11-13T11:29:17.970 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:17.962+0000 7f2cbe180640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2cb815f570 con 0x7f2cb806c1a0 2023-11-13T11:29:17.970 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:17.962+0000 7f2caffff640 1 --1- >> v1:172.21.15.102:6789/0 conn(0x7f2cb806dc70 0x7f2cb806ba90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.102:6789/0 says I am v1:172.21.15.102:36686/0 (socket says 172.21.15.102:36686) 2023-11-13T11:29:17.970 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:17.962+0000 7f2cb77fe640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f2cb813df40 0x7f2cb815e990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:17.971 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:17.962+0000 7f2caffff640 1 -- 172.21.15.102:0/3228222659 learned_addr learned my addr 172.21.15.102:0/3228222659 (peer_addr_for_me v1:172.21.15.102:0/0) 2023-11-13T11:29:17.971 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:17.962+0000 7f2cb7fff640 1 --2- 172.21.15.102:0/3228222659 >> v2:172.21.15.154:3300/0 conn(0x7f2cb806c1a0 0x7f2cb813f6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:17.972 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:17.962+0000 7f2cb77fe640 1 -- 172.21.15.102:0/3228222659 >> v2:172.21.15.154:3300/0 conn(0x7f2cb806c1a0 msgr2=0x7f2cb813f6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-13T11:29:17.972 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:17.962+0000 7f2cb77fe640 1 --2- 172.21.15.102:0/3228222659 >> v2:172.21.15.154:3300/0 conn(0x7f2cb806c1a0 0x7f2cb813f6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:17.972 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:17.962+0000 7f2cb77fe640 1 -- 172.21.15.102:0/3228222659 >> v1:172.21.15.102:6789/0 conn(0x7f2cb806dc70 legacy=0x7f2cb806ba90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:17.972 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:17.962+0000 7f2cb77fe640 1 -- 172.21.15.102:0/3228222659 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2cb815f850 con 0x7f2cb813df40 2023-11-13T11:29:17.972 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:17.962+0000 7f2cb6ffd640 1 -- 172.21.15.102:0/3228222659 <== mon.0 v1:172.21.15.102:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1708825439 0 0) 0x7f2cb813e530 con 0x7f2cb806dc70 2023-11-13T11:29:17.974 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:17.966+0000 7f2cb77fe640 1 --2- 172.21.15.102:0/3228222659 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2cb813df40 0x7f2cb815e990 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f2cb80b1900 tx=0x7f2ca801c460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b295bbbb3e5bfb13 server_cookie=0 in_seq=0 out_seq=0 2023-11-13T11:29:17.974 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:17.966+0000 7f2cb6ffd640 1 -- 172.21.15.102:0/3228222659 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ca8004230 con 0x7f2cb813df40 2023-11-13T11:29:17.974 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:17.966+0000 7f2cb6ffd640 1 -- 172.21.15.102:0/3228222659 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ca80a7050 con 0x7f2cb813df40 2023-11-13T11:29:17.974 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:17.966+0000 7f2cb6ffd640 1 -- 172.21.15.102:0/3228222659 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ca8003620 con 0x7f2cb813df40 2023-11-13T11:29:17.974 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:17.966+0000 7f2cbe180640 1 -- 172.21.15.102:0/3228222659 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2cb813df40 msgr2=0x7f2cb815e990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:17.975 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:17.966+0000 7f2cbe180640 1 --2- 172.21.15.102:0/3228222659 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2cb813df40 0x7f2cb815e990 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f2cb80b1900 tx=0x7f2ca801c460 comp rx=0 tx=0).stop 2023-11-13T11:29:17.975 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:17.966+0000 7f2cbe180640 1 -- 172.21.15.102:0/3228222659 shutdown_connections 2023-11-13T11:29:17.975 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:17.966+0000 7f2cbe180640 1 --2- 172.21.15.102:0/3228222659 >> v2:172.21.15.154:3300/0 conn(0x7f2cb806c1a0 0x7f2cb813f6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:17.975 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:17.966+0000 7f2cbe180640 1 --2- 172.21.15.102:0/3228222659 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2cb813df40 0x7f2cb815e990 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:17.975 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:17.966+0000 7f2cbe180640 1 -- 172.21.15.102:0/3228222659 >> 172.21.15.102:0/3228222659 conn(0x7f2cb80b0870 msgr2=0x7f2cb80b0c80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-13T11:29:17.976 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:17.966+0000 7f2cbe180640 1 -- 172.21.15.102:0/3228222659 shutdown_connections 2023-11-13T11:29:17.976 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:17.966+0000 7f2cbe180640 1 -- 172.21.15.102:0/3228222659 wait complete. 2023-11-13T11:29:17.978 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:17.970+0000 7f2cbe180640 1 Processor -- start 2023-11-13T11:29:17.978 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:17.970+0000 7f2cbe180640 1 -- start start 2023-11-13T11:29:17.978 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:17.970+0000 7f2cbe180640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2cb806c1a0 0x7f2cb81596c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:17.979 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:17.970+0000 7f2cbe180640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2cb806dc70 0x7f2cb8142000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:17.979 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:17.970+0000 7f2cbe180640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2cb813df40 0x7f2cb8142540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:17.979 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:17.970+0000 7f2cbe180640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2cb815c700 con 0x7f2cb813df40 2023-11-13T11:29:17.979 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:17.970+0000 7f2cbe180640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2cb815c420 con 0x7f2cb806dc70 2023-11-13T11:29:17.979 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:17.970+0000 7f2cbe180640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2cb8142bd0 con 0x7f2cb806c1a0 2023-11-13T11:29:17.980 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:17.970+0000 7f2cb7fff640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2cb813df40 0x7f2cb8142540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:17.980 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:17.970+0000 7f2cb7fff640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2cb813df40 0x7f2cb8142540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:50402/0 (socket says 172.21.15.102:50402) 2023-11-13T11:29:17.980 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:17.970+0000 7f2cb7fff640 1 -- 172.21.15.102:0/604123083 learned_addr learned my addr 172.21.15.102:0/604123083 (peer_addr_for_me v2:172.21.15.102:0/0) 2023-11-13T11:29:17.980 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:17.970+0000 7f2cb77fe640 1 --2- 172.21.15.102:0/604123083 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2cb806c1a0 0x7f2cb81596c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:17.980 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:17.970+0000 7f2caffff640 1 --2- 172.21.15.102:0/604123083 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2cb806dc70 0x7f2cb8142000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:17.981 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:17.970+0000 7f2cb7fff640 1 -- 172.21.15.102:0/604123083 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2cb806c1a0 msgr2=0x7f2cb81596c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:17.981 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:17.970+0000 7f2cb7fff640 1 --2- 172.21.15.102:0/604123083 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2cb806c1a0 0x7f2cb81596c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:17.981 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:17.970+0000 7f2cb7fff640 1 -- 172.21.15.102:0/604123083 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2cb806dc70 msgr2=0x7f2cb8142000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:17.981 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:17.970+0000 7f2cb7fff640 1 --2- 172.21.15.102:0/604123083 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2cb806dc70 0x7f2cb8142000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:17.981 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:17.970+0000 7f2cb7fff640 1 -- 172.21.15.102:0/604123083 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ca8009420 con 0x7f2cb813df40 2023-11-13T11:29:17.981 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:17.970+0000 7f2cb7fff640 1 --2- 172.21.15.102:0/604123083 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2cb813df40 0x7f2cb8142540 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f2cb0007e30 tx=0x7f2cb000e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-13T11:29:17.982 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:17.970+0000 7f2cb4ff9640 1 -- 172.21.15.102:0/604123083 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cb0014420 con 0x7f2cb813df40 2023-11-13T11:29:17.982 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:17.970+0000 7f2cb4ff9640 1 -- 172.21.15.102:0/604123083 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2cb00145a0 con 0x7f2cb813df40 2023-11-13T11:29:17.982 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:17.970+0000 7f2cb4ff9640 1 -- 172.21.15.102:0/604123083 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cb0014950 con 0x7f2cb813df40 2023-11-13T11:29:17.982 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:17.970+0000 7f2cbe180640 1 -- 172.21.15.102:0/604123083 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2cb8142eb0 con 0x7f2cb813df40 2023-11-13T11:29:17.982 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:17.970+0000 7f2cbe180640 1 -- 172.21.15.102:0/604123083 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2cb81391f0 con 0x7f2cb813df40 2023-11-13T11:29:17.983 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:17.974+0000 7f2cbe180640 1 -- 172.21.15.102:0/604123083 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2cb80ae4c0 con 0x7f2cb813df40 2023-11-13T11:29:17.984 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:17.974+0000 7f2cb4ff9640 1 -- 172.21.15.102:0/604123083 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f2cb0014ab0 con 0x7f2cb813df40 2023-11-13T11:29:17.984 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:17.974+0000 7f2cb4ff9640 1 --2- 172.21.15.102:0/604123083 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f2c98066470 0x7f2c98068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:17.984 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:17.974+0000 7f2cb4ff9640 1 -- 172.21.15.102:0/604123083 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f2cb0084740 con 0x7f2cb813df40 2023-11-13T11:29:17.984 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:17.974+0000 7f2cb77fe640 1 --2- 172.21.15.102:0/604123083 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f2c98066470 0x7f2c98068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:17.984 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:17.974+0000 7f2cb77fe640 1 --2- 172.21.15.102:0/604123083 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f2c98066470 0x7f2c98068930 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f2ca80ad000 tx=0x7f2ca80a6000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-13T11:29:17.985 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:17.978+0000 7f2cb4ff9640 1 -- 172.21.15.102:0/604123083 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f2cb0051bd0 con 0x7f2cb813df40 2023-11-13T11:29:18.168 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:18.162+0000 7f2cbe180640 1 -- 172.21.15.102:0/604123083 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f2cb8068520 con 0x7f2cb813df40 2023-11-13T11:29:18.168 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:18.162+0000 7f2cb4ff9640 1 -- 172.21.15.102:0/604123083 <== mon.0 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) v1 ==== 53+0+73 (secure 0 0 0) 0x7f2cb00551f0 con 0x7f2cb813df40 2023-11-13T11:29:18.169 INFO:teuthology.orchestra.run.smithi102.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-11-13T11:29:18.170 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:18.162+0000 7f2cbe180640 1 -- 172.21.15.102:0/604123083 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f2c98066470 msgr2=0x7f2c98068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:18.170 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:18.162+0000 7f2cbe180640 1 --2- 172.21.15.102:0/604123083 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f2c98066470 0x7f2c98068930 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f2ca80ad000 tx=0x7f2ca80a6000 comp rx=0 tx=0).stop 2023-11-13T11:29:18.171 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:18.162+0000 7f2cbe180640 1 -- 172.21.15.102:0/604123083 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2cb813df40 msgr2=0x7f2cb8142540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:18.171 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:18.162+0000 7f2cbe180640 1 --2- 172.21.15.102:0/604123083 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2cb813df40 0x7f2cb8142540 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f2cb0007e30 tx=0x7f2cb000e4b0 comp rx=0 tx=0).stop 2023-11-13T11:29:18.171 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:18.162+0000 7f2cbe180640 1 -- 172.21.15.102:0/604123083 shutdown_connections 2023-11-13T11:29:18.171 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:18.162+0000 7f2cbe180640 1 --2- 172.21.15.102:0/604123083 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f2c98066470 0x7f2c98068930 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:18.171 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:18.162+0000 7f2cbe180640 1 --2- 172.21.15.102:0/604123083 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2cb813df40 0x7f2cb8142540 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:18.171 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:18.162+0000 7f2cbe180640 1 --2- 172.21.15.102:0/604123083 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2cb806dc70 0x7f2cb8142000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:18.172 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:18.162+0000 7f2cbe180640 1 --2- 172.21.15.102:0/604123083 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2cb806c1a0 0x7f2cb81596c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:18.172 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:18.162+0000 7f2cbe180640 1 -- 172.21.15.102:0/604123083 >> 172.21.15.102:0/604123083 conn(0x7f2cb80b0870 msgr2=0x7f2cb80acc80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-13T11:29:18.172 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:18.162+0000 7f2cbe180640 1 -- 172.21.15.102:0/604123083 shutdown_connections 2023-11-13T11:29:18.172 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:18.162+0000 7f2cbe180640 1 -- 172.21.15.102:0/604123083 wait complete. 2023-11-13T11:29:18.191 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-11-13T11:29:18.191 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-11-13T11:29:18.192 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi154.front.sepia.ceph.com 2023-11-13T11:29:18.192 INFO:tasks.cephfs.mount:self.client.name = client.3 2023-11-13T11:29:18.192 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.3 2023-11-13T11:29:18.192 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-11-13T11:29:18.193 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-11-13T11:29:18.193 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-11-13T11:29:18.193 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.3' 2023-11-13T11:29:18.194 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-13T11:29:18.194 DEBUG:teuthology.orchestra.run.smithi154:> ip addr 2023-11-13T11:29:18.206 INFO:teuthology.orchestra.run.smithi154.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-11-13T11:29:18.207 INFO:teuthology.orchestra.run.smithi154.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-11-13T11:29:18.207 INFO:teuthology.orchestra.run.smithi154.stdout: inet 127.0.0.1/8 scope host lo 2023-11-13T11:29:18.208 INFO:teuthology.orchestra.run.smithi154.stdout: valid_lft forever preferred_lft forever 2023-11-13T11:29:18.208 INFO:teuthology.orchestra.run.smithi154.stdout: inet6 ::1/128 scope host 2023-11-13T11:29:18.208 INFO:teuthology.orchestra.run.smithi154.stdout: valid_lft forever preferred_lft forever 2023-11-13T11:29:18.209 INFO:teuthology.orchestra.run.smithi154.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-11-13T11:29:18.209 INFO:teuthology.orchestra.run.smithi154.stdout: link/ether 0c:c4:7a:d9:1a:54 brd ff:ff:ff:ff:ff:ff 2023-11-13T11:29:18.209 INFO:teuthology.orchestra.run.smithi154.stdout: altname enp7s0f0 2023-11-13T11:29:18.210 INFO:teuthology.orchestra.run.smithi154.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-11-13T11:29:18.210 INFO:teuthology.orchestra.run.smithi154.stdout: link/ether 0c:c4:7a:d9:1a:55 brd ff:ff:ff:ff:ff:ff 2023-11-13T11:29:18.211 INFO:teuthology.orchestra.run.smithi154.stdout: altname enp7s0f1 2023-11-13T11:29:18.211 INFO:teuthology.orchestra.run.smithi154.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-11-13T11:29:18.212 INFO:teuthology.orchestra.run.smithi154.stdout: link/ether 0c:c4:7a:88:77:60 brd ff:ff:ff:ff:ff:ff 2023-11-13T11:29:18.212 INFO:teuthology.orchestra.run.smithi154.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-11-13T11:29:18.212 INFO:teuthology.orchestra.run.smithi154.stdout: link/ether 0c:c4:7a:88:77:61 brd ff:ff:ff:ff:ff:ff 2023-11-13T11:29:18.214 INFO:teuthology.orchestra.run.smithi154.stdout: inet 172.21.15.154/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2023-11-13T11:29:18.214 INFO:teuthology.orchestra.run.smithi154.stdout: valid_lft 42398sec preferred_lft 42398sec 2023-11-13T11:29:18.215 INFO:teuthology.orchestra.run.smithi154.stdout: inet6 fe80::ec4:7aff:fe88:7761/64 scope link 2023-11-13T11:29:18.216 INFO:teuthology.orchestra.run.smithi154.stdout: valid_lft forever preferred_lft forever 2023-11-13T11:29:18.216 INFO:teuthology.orchestra.run.smithi154.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-11-13T11:29:18.216 INFO:teuthology.orchestra.run.smithi154.stdout: link/ether 02:42:33:07:1f:bd brd ff:ff:ff:ff:ff:ff 2023-11-13T11:29:18.217 INFO:teuthology.orchestra.run.smithi154.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-11-13T11:29:18.217 INFO:teuthology.orchestra.run.smithi154.stdout: valid_lft forever preferred_lft forever 2023-11-13T11:29:18.217 INFO:teuthology.orchestra.run.smithi154.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-11-13T11:29:18.217 INFO:teuthology.orchestra.run.smithi154.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2023-11-13T11:29:18.217 INFO:teuthology.orchestra.run.smithi154.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-11-13T11:29:18.218 INFO:teuthology.orchestra.run.smithi154.stdout: valid_lft forever preferred_lft forever 2023-11-13T11:29:18.218 INFO:teuthology.orchestra.run.smithi154.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link tentative 2023-11-13T11:29:18.218 INFO:teuthology.orchestra.run.smithi154.stdout: valid_lft forever preferred_lft forever 2023-11-13T11:29:18.218 INFO:teuthology.orchestra.run.smithi154.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-11-13T11:29:18.218 INFO:teuthology.orchestra.run.smithi154.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2023-11-13T11:29:18.219 INFO:teuthology.orchestra.run.smithi154.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link tentative 2023-11-13T11:29:18.219 INFO:teuthology.orchestra.run.smithi154.stdout: valid_lft forever preferred_lft forever 2023-11-13T11:29:18.219 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-13T11:29:18.220 DEBUG:teuthology.orchestra.run.smithi154:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-11-13T11:29:18.270 INFO:teuthology.orchestra.run.smithi154.stdout:1 2023-11-13T11:29:18.272 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-13T11:29:18.273 DEBUG:teuthology.orchestra.run.smithi154:> route 2023-11-13T11:29:18.327 INFO:teuthology.orchestra.run.smithi154.stdout:Kernel IP routing table 2023-11-13T11:29:18.328 INFO:teuthology.orchestra.run.smithi154.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-11-13T11:29:18.328 INFO:teuthology.orchestra.run.smithi154.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2023-11-13T11:29:18.328 INFO:teuthology.orchestra.run.smithi154.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-11-13T11:29:18.328 INFO:teuthology.orchestra.run.smithi154.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-11-13T11:29:18.329 INFO:teuthology.orchestra.run.smithi154.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-11-13T11:29:18.329 INFO:teuthology.orchestra.run.smithi154.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-11-13T11:29:18.329 INFO:teuthology.orchestra.run.smithi154.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-11-13T11:29:18.329 INFO:teuthology.orchestra.run.smithi154.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-11-13T11:29:18.329 INFO:teuthology.orchestra.run.smithi154.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-11-13T11:29:18.330 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-13T11:29:18.330 DEBUG:teuthology.orchestra.run.smithi154:> (cd / && exec bash -c ' 2023-11-13T11:29:18.331 DEBUG:teuthology.orchestra.run.smithi154:> set -e 2023-11-13T11:29:18.331 DEBUG:teuthology.orchestra.run.smithi154:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-11-13T11:29:18.331 DEBUG:teuthology.orchestra.run.smithi154:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-11-13T11:29:18.332 DEBUG:teuthology.orchestra.run.smithi154:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-11-13T11:29:18.332 DEBUG:teuthology.orchestra.run.smithi154:> ') 2023-11-13T11:29:18.423 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-13T11:29:18.423 DEBUG:teuthology.orchestra.run.smithi154:> ip netns list 2023-11-13T11:29:18.434 INFO:teuthology.orchestra.run.smithi154.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-11-13T11:29:18.435 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-13T11:29:18.435 DEBUG:teuthology.orchestra.run.smithi154:> ip netns list-id 2023-11-13T11:29:18.485 INFO:teuthology.orchestra.run.smithi154.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.1) 2023-11-13T11:29:18.486 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-13T11:29:18.486 DEBUG:teuthology.orchestra.run.smithi154:> (cd / && exec bash -c ' 2023-11-13T11:29:18.487 DEBUG:teuthology.orchestra.run.smithi154:> set -e 2023-11-13T11:29:18.487 DEBUG:teuthology.orchestra.run.smithi154:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.3 2023-11-13T11:29:18.487 DEBUG:teuthology.orchestra.run.smithi154:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.3 1 2023-11-13T11:29:18.487 DEBUG:teuthology.orchestra.run.smithi154:> ') 2023-11-13T11:29:18.567 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-13T11:29:18.567 DEBUG:teuthology.orchestra.run.smithi154:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2023-11-13T11:29:18.638 INFO:teuthology.orchestra.run.smithi154.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-11-13T11:29:18.638 INFO:teuthology.orchestra.run.smithi154.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-11-13T11:29:18.639 INFO:teuthology.orchestra.run.smithi154.stdout: inet 127.0.0.1/8 scope host lo 2023-11-13T11:29:18.639 INFO:teuthology.orchestra.run.smithi154.stdout: valid_lft forever preferred_lft forever 2023-11-13T11:29:18.639 INFO:teuthology.orchestra.run.smithi154.stdout: inet6 ::1/128 scope host 2023-11-13T11:29:18.640 INFO:teuthology.orchestra.run.smithi154.stdout: valid_lft forever preferred_lft forever 2023-11-13T11:29:18.640 INFO:teuthology.orchestra.run.smithi154.stdout:2: veth0@if8: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-11-13T11:29:18.641 INFO:teuthology.orchestra.run.smithi154.stdout: link/ether 6a:e5:c7:1a:e0:8f brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-11-13T11:29:18.641 INFO:teuthology.orchestra.run.smithi154.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-11-13T11:29:18.642 INFO:teuthology.orchestra.run.smithi154.stdout: valid_lft forever preferred_lft forever 2023-11-13T11:29:18.642 INFO:teuthology.orchestra.run.smithi154.stdout: inet6 fe80::68e5:c7ff:fe1a:e08f/64 scope link tentative 2023-11-13T11:29:18.642 INFO:teuthology.orchestra.run.smithi154.stdout: valid_lft forever preferred_lft forever 2023-11-13T11:29:18.644 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-13T11:29:18.644 DEBUG:teuthology.orchestra.run.smithi154:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2023-11-13T11:29:18.708 INFO:teuthology.orchestra.run.smithi154.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-11-13T11:29:18.708 INFO:teuthology.orchestra.run.smithi154.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-11-13T11:29:18.708 INFO:teuthology.orchestra.run.smithi154.stdout: inet 127.0.0.1/8 scope host lo 2023-11-13T11:29:18.708 INFO:teuthology.orchestra.run.smithi154.stdout: valid_lft forever preferred_lft forever 2023-11-13T11:29:18.709 INFO:teuthology.orchestra.run.smithi154.stdout: inet6 ::1/128 scope host 2023-11-13T11:29:18.709 INFO:teuthology.orchestra.run.smithi154.stdout: valid_lft forever preferred_lft forever 2023-11-13T11:29:18.709 INFO:teuthology.orchestra.run.smithi154.stdout:2: veth0@if8: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-11-13T11:29:18.709 INFO:teuthology.orchestra.run.smithi154.stdout: link/ether 6a:e5:c7:1a:e0:8f brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-11-13T11:29:18.709 INFO:teuthology.orchestra.run.smithi154.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-11-13T11:29:18.710 INFO:teuthology.orchestra.run.smithi154.stdout: valid_lft forever preferred_lft forever 2023-11-13T11:29:18.710 INFO:teuthology.orchestra.run.smithi154.stdout: inet6 fe80::68e5:c7ff:fe1a:e08f/64 scope link tentative 2023-11-13T11:29:18.710 INFO:teuthology.orchestra.run.smithi154.stdout: valid_lft forever preferred_lft forever 2023-11-13T11:29:18.711 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.3' with 192.168.0.2/16 2023-11-13T11:29:18.712 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-13T11:29:18.712 DEBUG:teuthology.orchestra.run.smithi154:> (cd / && exec bash -c ' 2023-11-13T11:29:18.712 DEBUG:teuthology.orchestra.run.smithi154:> set -e 2023-11-13T11:29:18.713 DEBUG:teuthology.orchestra.run.smithi154:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.3 type veth peer name brx.1 2023-11-13T11:29:18.713 DEBUG:teuthology.orchestra.run.smithi154:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2023-11-13T11:29:18.713 DEBUG:teuthology.orchestra.run.smithi154:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set veth0 up 2023-11-13T11:29:18.714 DEBUG:teuthology.orchestra.run.smithi154:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set lo up 2023-11-13T11:29:18.714 DEBUG:teuthology.orchestra.run.smithi154:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip route add default via 192.168.255.254 2023-11-13T11:29:18.714 DEBUG:teuthology.orchestra.run.smithi154:> ') 2023-11-13T11:29:18.852 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-13T11:29:18.853 DEBUG:teuthology.orchestra.run.smithi154:> (cd / && exec bash -c ' 2023-11-13T11:29:18.853 DEBUG:teuthology.orchestra.run.smithi154:> set -e 2023-11-13T11:29:18.853 DEBUG:teuthology.orchestra.run.smithi154:> sudo ip link set brx.1 up 2023-11-13T11:29:18.854 DEBUG:teuthology.orchestra.run.smithi154:> sudo ip link set dev brx.1 master ceph-brx 2023-11-13T11:29:18.854 DEBUG:teuthology.orchestra.run.smithi154:> ') 2023-11-13T11:29:18.895 INFO:tasks.cephfs.fuse_mount:Client client.3 config is {} 2023-11-13T11:29:18.896 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-13T11:29:18.896 DEBUG:teuthology.orchestra.run.smithi154:> mkdir -p -v /home/ubuntu/cephtest/mnt.3 2023-11-13T11:29:18.951 INFO:teuthology.orchestra.run.smithi154.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.3' 2023-11-13T11:29:18.952 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-13T11:29:18.952 DEBUG:teuthology.orchestra.run.smithi154:> chmod 0000 /home/ubuntu/cephtest/mnt.3 2023-11-13T11:29:19.004 DEBUG:teuthology.orchestra.run.smithi154:> sudo modprobe fuse 2023-11-13T11:29:19.069 DEBUG:teuthology.orchestra.run.smithi154:> cat /proc/self/mounts | awk '{print $2}' 2023-11-13T11:29:19.121 INFO:teuthology.orchestra.run.smithi154.stdout:/sys 2023-11-13T11:29:19.121 INFO:teuthology.orchestra.run.smithi154.stdout:/proc 2023-11-13T11:29:19.122 INFO:teuthology.orchestra.run.smithi154.stdout:/dev 2023-11-13T11:29:19.122 INFO:teuthology.orchestra.run.smithi154.stdout:/dev/pts 2023-11-13T11:29:19.122 INFO:teuthology.orchestra.run.smithi154.stdout:/run 2023-11-13T11:29:19.122 INFO:teuthology.orchestra.run.smithi154.stdout:/ 2023-11-13T11:29:19.122 INFO:teuthology.orchestra.run.smithi154.stdout:/sys/kernel/security 2023-11-13T11:29:19.123 INFO:teuthology.orchestra.run.smithi154.stdout:/dev/shm 2023-11-13T11:29:19.123 INFO:teuthology.orchestra.run.smithi154.stdout:/run/lock 2023-11-13T11:29:19.123 INFO:teuthology.orchestra.run.smithi154.stdout:/sys/fs/cgroup 2023-11-13T11:29:19.123 INFO:teuthology.orchestra.run.smithi154.stdout:/sys/fs/pstore 2023-11-13T11:29:19.123 INFO:teuthology.orchestra.run.smithi154.stdout:/sys/fs/bpf 2023-11-13T11:29:19.124 INFO:teuthology.orchestra.run.smithi154.stdout:/proc/sys/fs/binfmt_misc 2023-11-13T11:29:19.124 INFO:teuthology.orchestra.run.smithi154.stdout:/dev/hugepages 2023-11-13T11:29:19.124 INFO:teuthology.orchestra.run.smithi154.stdout:/dev/mqueue 2023-11-13T11:29:19.124 INFO:teuthology.orchestra.run.smithi154.stdout:/sys/kernel/debug 2023-11-13T11:29:19.124 INFO:teuthology.orchestra.run.smithi154.stdout:/sys/kernel/tracing 2023-11-13T11:29:19.124 INFO:teuthology.orchestra.run.smithi154.stdout:/proc/fs/nfsd 2023-11-13T11:29:19.125 INFO:teuthology.orchestra.run.smithi154.stdout:/sys/fs/fuse/connections 2023-11-13T11:29:19.125 INFO:teuthology.orchestra.run.smithi154.stdout:/sys/kernel/config 2023-11-13T11:29:19.125 INFO:teuthology.orchestra.run.smithi154.stdout:/run/credentials/systemd-sysusers.service 2023-11-13T11:29:19.125 INFO:teuthology.orchestra.run.smithi154.stdout:/run/rpc_pipefs 2023-11-13T11:29:19.126 INFO:teuthology.orchestra.run.smithi154.stdout:/run/user/1000 2023-11-13T11:29:19.126 INFO:teuthology.orchestra.run.smithi154.stdout:/var/lib/ceph 2023-11-13T11:29:19.126 INFO:teuthology.orchestra.run.smithi154.stdout:/var/lib/ceph/osd/ceph-4 2023-11-13T11:29:19.127 INFO:teuthology.orchestra.run.smithi154.stdout:/var/lib/ceph/osd/ceph-5 2023-11-13T11:29:19.127 INFO:teuthology.orchestra.run.smithi154.stdout:/var/lib/ceph/osd/ceph-6 2023-11-13T11:29:19.127 INFO:teuthology.orchestra.run.smithi154.stdout:/var/lib/ceph/osd/ceph-7 2023-11-13T11:29:19.127 INFO:teuthology.orchestra.run.smithi154.stdout:/run/netns 2023-11-13T11:29:19.127 INFO:teuthology.orchestra.run.smithi154.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2023-11-13T11:29:19.127 INFO:teuthology.orchestra.run.smithi154.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2023-11-13T11:29:19.128 INFO:teuthology.orchestra.run.smithi154.stdout:/home/ubuntu/cephtest/mnt.1 2023-11-13T11:29:19.128 INFO:teuthology.orchestra.run.smithi154.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 2023-11-13T11:29:19.128 INFO:teuthology.orchestra.run.smithi154.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 2023-11-13T11:29:19.129 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-13T11:29:19.130 DEBUG:teuthology.orchestra.run.smithi154:> ls /sys/fs/fuse/connections 2023-11-13T11:29:19.180 INFO:teuthology.orchestra.run.smithi154.stdout:43 2023-11-13T11:29:19.180 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [43] 2023-11-13T11:29:19.181 DEBUG:teuthology.orchestra.run.smithi154:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.3 --id 3) 2023-11-13T11:29:19.227 DEBUG:teuthology.orchestra.run.smithi154:> sudo modprobe fuse 2023-11-13T11:29:19.249 DEBUG:teuthology.orchestra.run.smithi154:> cat /proc/self/mounts | awk '{print $2}' 2023-11-13T11:29:19.305 INFO:teuthology.orchestra.run.smithi154.stdout:/sys 2023-11-13T11:29:19.306 INFO:teuthology.orchestra.run.smithi154.stdout:/proc 2023-11-13T11:29:19.306 INFO:teuthology.orchestra.run.smithi154.stdout:/dev 2023-11-13T11:29:19.306 INFO:teuthology.orchestra.run.smithi154.stdout:/dev/pts 2023-11-13T11:29:19.307 INFO:teuthology.orchestra.run.smithi154.stdout:/run 2023-11-13T11:29:19.307 INFO:teuthology.orchestra.run.smithi154.stdout:/ 2023-11-13T11:29:19.307 INFO:teuthology.orchestra.run.smithi154.stdout:/sys/kernel/security 2023-11-13T11:29:19.308 INFO:teuthology.orchestra.run.smithi154.stdout:/dev/shm 2023-11-13T11:29:19.308 INFO:teuthology.orchestra.run.smithi154.stdout:/run/lock 2023-11-13T11:29:19.308 INFO:teuthology.orchestra.run.smithi154.stdout:/sys/fs/cgroup 2023-11-13T11:29:19.308 INFO:teuthology.orchestra.run.smithi154.stdout:/sys/fs/pstore 2023-11-13T11:29:19.308 INFO:teuthology.orchestra.run.smithi154.stdout:/sys/fs/bpf 2023-11-13T11:29:19.309 INFO:teuthology.orchestra.run.smithi154.stdout:/proc/sys/fs/binfmt_misc 2023-11-13T11:29:19.309 INFO:teuthology.orchestra.run.smithi154.stdout:/dev/hugepages 2023-11-13T11:29:19.309 INFO:teuthology.orchestra.run.smithi154.stdout:/dev/mqueue 2023-11-13T11:29:19.309 INFO:teuthology.orchestra.run.smithi154.stdout:/sys/kernel/debug 2023-11-13T11:29:19.309 INFO:teuthology.orchestra.run.smithi154.stdout:/sys/kernel/tracing 2023-11-13T11:29:19.310 INFO:teuthology.orchestra.run.smithi154.stdout:/proc/fs/nfsd 2023-11-13T11:29:19.310 INFO:teuthology.orchestra.run.smithi154.stdout:/sys/fs/fuse/connections 2023-11-13T11:29:19.310 INFO:teuthology.orchestra.run.smithi154.stdout:/sys/kernel/config 2023-11-13T11:29:19.310 INFO:teuthology.orchestra.run.smithi154.stdout:/run/credentials/systemd-sysusers.service 2023-11-13T11:29:19.311 INFO:teuthology.orchestra.run.smithi154.stdout:/run/rpc_pipefs 2023-11-13T11:29:19.311 INFO:teuthology.orchestra.run.smithi154.stdout:/run/user/1000 2023-11-13T11:29:19.311 INFO:teuthology.orchestra.run.smithi154.stdout:/var/lib/ceph 2023-11-13T11:29:19.311 INFO:teuthology.orchestra.run.smithi154.stdout:/var/lib/ceph/osd/ceph-4 2023-11-13T11:29:19.311 INFO:teuthology.orchestra.run.smithi154.stdout:/var/lib/ceph/osd/ceph-5 2023-11-13T11:29:19.312 INFO:teuthology.orchestra.run.smithi154.stdout:/var/lib/ceph/osd/ceph-6 2023-11-13T11:29:19.312 INFO:teuthology.orchestra.run.smithi154.stdout:/var/lib/ceph/osd/ceph-7 2023-11-13T11:29:19.312 INFO:teuthology.orchestra.run.smithi154.stdout:/run/netns 2023-11-13T11:29:19.312 INFO:teuthology.orchestra.run.smithi154.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2023-11-13T11:29:19.312 INFO:teuthology.orchestra.run.smithi154.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2023-11-13T11:29:19.313 INFO:teuthology.orchestra.run.smithi154.stdout:/home/ubuntu/cephtest/mnt.1 2023-11-13T11:29:19.313 INFO:teuthology.orchestra.run.smithi154.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 2023-11-13T11:29:19.313 INFO:teuthology.orchestra.run.smithi154.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 2023-11-13T11:29:19.315 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-13T11:29:19.316 DEBUG:teuthology.orchestra.run.smithi154:> ls /sys/fs/fuse/connections 2023-11-13T11:29:19.322 INFO:tasks.cephfs.fuse_mount.ceph-fuse.3.smithi154.stderr:2023-11-13T11:29:19.315+0000 7f42d4e16580 -1 init, newargv = 0x562c3ba89770 newargc=15 2023-11-13T11:29:19.322 INFO:tasks.cephfs.fuse_mount.ceph-fuse.3.smithi154.stderr:ceph-fuse[43591]: starting ceph client 2023-11-13T11:29:19.328 INFO:tasks.cephfs.fuse_mount.ceph-fuse.3.smithi154.stderr:ceph-fuse[43591]: starting fuse 2023-11-13T11:29:19.331 INFO:teuthology.orchestra.run.smithi154.stdout:43 2023-11-13T11:29:19.332 INFO:teuthology.orchestra.run.smithi154.stdout:44 2023-11-13T11:29:19.332 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [43, 44] 2023-11-13T11:29:19.333 DEBUG:teuthology.orchestra.run.smithi154:> sudo stdin-killer -- python3 -c ' 2023-11-13T11:29:19.333 DEBUG:teuthology.orchestra.run.smithi154:> import glob 2023-11-13T11:29:19.333 DEBUG:teuthology.orchestra.run.smithi154:> import re 2023-11-13T11:29:19.333 DEBUG:teuthology.orchestra.run.smithi154:> import os 2023-11-13T11:29:19.334 DEBUG:teuthology.orchestra.run.smithi154:> import subprocess 2023-11-13T11:29:19.334 DEBUG:teuthology.orchestra.run.smithi154:> 2023-11-13T11:29:19.334 DEBUG:teuthology.orchestra.run.smithi154:> def _find_admin_socket(client_name): 2023-11-13T11:29:19.335 DEBUG:teuthology.orchestra.run.smithi154:> asok_path = "/var/run/ceph/ceph-client.3.*.asok" 2023-11-13T11:29:19.335 DEBUG:teuthology.orchestra.run.smithi154:> files = glob.glob(asok_path) 2023-11-13T11:29:19.335 DEBUG:teuthology.orchestra.run.smithi154:> mountpoint = "/home/ubuntu/cephtest/mnt.3" 2023-11-13T11:29:19.336 DEBUG:teuthology.orchestra.run.smithi154:> 2023-11-13T11:29:19.336 DEBUG:teuthology.orchestra.run.smithi154:> # Given a non-glob path, it better be there 2023-11-13T11:29:19.336 DEBUG:teuthology.orchestra.run.smithi154:> if "*" not in asok_path: 2023-11-13T11:29:19.337 DEBUG:teuthology.orchestra.run.smithi154:> assert(len(files) == 1) 2023-11-13T11:29:19.338 DEBUG:teuthology.orchestra.run.smithi154:> return files[0] 2023-11-13T11:29:19.338 DEBUG:teuthology.orchestra.run.smithi154:> 2023-11-13T11:29:19.339 DEBUG:teuthology.orchestra.run.smithi154:> for f in files: 2023-11-13T11:29:19.339 DEBUG:teuthology.orchestra.run.smithi154:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-11-13T11:29:19.339 DEBUG:teuthology.orchestra.run.smithi154:> if os.path.exists("/proc/{0}".format(pid)): 2023-11-13T11:29:19.340 DEBUG:teuthology.orchestra.run.smithi154:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-11-13T11:29:19.340 DEBUG:teuthology.orchestra.run.smithi154:> contents = proc_f.read() 2023-11-13T11:29:19.340 DEBUG:teuthology.orchestra.run.smithi154:> if mountpoint in contents: 2023-11-13T11:29:19.341 DEBUG:teuthology.orchestra.run.smithi154:> return f 2023-11-13T11:29:19.341 DEBUG:teuthology.orchestra.run.smithi154:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-11-13T11:29:19.342 DEBUG:teuthology.orchestra.run.smithi154:> 2023-11-13T11:29:19.343 DEBUG:teuthology.orchestra.run.smithi154:> print(_find_admin_socket("client.3")) 2023-11-13T11:29:19.343 DEBUG:teuthology.orchestra.run.smithi154:> ' 2023-11-13T11:29:19.461 INFO:teuthology.orchestra.run.smithi154.stdout:/var/run/ceph/ceph-client.3.43591.asok 2023-11-13T11:29:19.462 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-13T11:29:19 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-11-13T11:29:19.467 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.3.43591.asok 2023-11-13T11:29:19.467 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-13T11:29:19.468 DEBUG:teuthology.orchestra.run.smithi154:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.3.43591.asok status 2023-11-13T11:29:19.641 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2023-11-13T11:29:19.641 INFO:teuthology.orchestra.run.smithi154.stdout: "metadata": { 2023-11-13T11:29:19.642 INFO:teuthology.orchestra.run.smithi154.stdout: "ceph_sha1": "35f0debb3cc28955b7132ef4c509cd138a09d56b", 2023-11-13T11:29:19.642 INFO:teuthology.orchestra.run.smithi154.stdout: "ceph_version": "ceph version 18.0.0-7288-g35f0debb (35f0debb3cc28955b7132ef4c509cd138a09d56b) reef (dev)", 2023-11-13T11:29:19.642 INFO:teuthology.orchestra.run.smithi154.stdout: "entity_id": "3", 2023-11-13T11:29:19.642 INFO:teuthology.orchestra.run.smithi154.stdout: "hostname": "smithi154", 2023-11-13T11:29:19.643 INFO:teuthology.orchestra.run.smithi154.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.3", 2023-11-13T11:29:19.643 INFO:teuthology.orchestra.run.smithi154.stdout: "pid": "43591", 2023-11-13T11:29:19.643 INFO:teuthology.orchestra.run.smithi154.stdout: "root": "/" 2023-11-13T11:29:19.643 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2023-11-13T11:29:19.644 INFO:teuthology.orchestra.run.smithi154.stdout: "dentry_count": 0, 2023-11-13T11:29:19.644 INFO:teuthology.orchestra.run.smithi154.stdout: "dentry_pinned_count": 0, 2023-11-13T11:29:19.644 INFO:teuthology.orchestra.run.smithi154.stdout: "id": 4493, 2023-11-13T11:29:19.644 INFO:teuthology.orchestra.run.smithi154.stdout: "inst": { 2023-11-13T11:29:19.644 INFO:teuthology.orchestra.run.smithi154.stdout: "name": { 2023-11-13T11:29:19.645 INFO:teuthology.orchestra.run.smithi154.stdout: "type": "client", 2023-11-13T11:29:19.645 INFO:teuthology.orchestra.run.smithi154.stdout: "num": 4493 2023-11-13T11:29:19.645 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2023-11-13T11:29:19.645 INFO:teuthology.orchestra.run.smithi154.stdout: "addr": { 2023-11-13T11:29:19.645 INFO:teuthology.orchestra.run.smithi154.stdout: "type": "v1", 2023-11-13T11:29:19.646 INFO:teuthology.orchestra.run.smithi154.stdout: "addr": "192.168.0.2:0", 2023-11-13T11:29:19.646 INFO:teuthology.orchestra.run.smithi154.stdout: "nonce": 1059822939 2023-11-13T11:29:19.646 INFO:teuthology.orchestra.run.smithi154.stdout: } 2023-11-13T11:29:19.646 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2023-11-13T11:29:19.647 INFO:teuthology.orchestra.run.smithi154.stdout: "addr": { 2023-11-13T11:29:19.647 INFO:teuthology.orchestra.run.smithi154.stdout: "type": "v1", 2023-11-13T11:29:19.647 INFO:teuthology.orchestra.run.smithi154.stdout: "addr": "192.168.0.2:0", 2023-11-13T11:29:19.647 INFO:teuthology.orchestra.run.smithi154.stdout: "nonce": 1059822939 2023-11-13T11:29:19.647 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2023-11-13T11:29:19.648 INFO:teuthology.orchestra.run.smithi154.stdout: "inst_str": "client.4493 192.168.0.2:0/1059822939", 2023-11-13T11:29:19.648 INFO:teuthology.orchestra.run.smithi154.stdout: "addr_str": "192.168.0.2:0/1059822939", 2023-11-13T11:29:19.648 INFO:teuthology.orchestra.run.smithi154.stdout: "inode_count": 1, 2023-11-13T11:29:19.649 INFO:teuthology.orchestra.run.smithi154.stdout: "mds_epoch": 8, 2023-11-13T11:29:19.649 INFO:teuthology.orchestra.run.smithi154.stdout: "osd_epoch": 22, 2023-11-13T11:29:19.650 INFO:teuthology.orchestra.run.smithi154.stdout: "osd_epoch_barrier": 0, 2023-11-13T11:29:19.650 INFO:teuthology.orchestra.run.smithi154.stdout: "blocklisted": false, 2023-11-13T11:29:19.651 INFO:teuthology.orchestra.run.smithi154.stdout: "fs_name": "cephfs" 2023-11-13T11:29:19.651 INFO:teuthology.orchestra.run.smithi154.stdout:} 2023-11-13T11:29:19.657 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-13T11:29:19.657 DEBUG:teuthology.orchestra.run.smithi102:> stat --file-system '--printf=%T 2023-11-13T11:29:19.658 DEBUG:teuthology.orchestra.run.smithi102:> ' -- /home/ubuntu/cephtest/mnt.0 2023-11-13T11:29:19.673 INFO:teuthology.orchestra.run.smithi102.stdout:fuseblk 2023-11-13T11:29:19.673 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2023-11-13T11:29:19.674 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-13T11:29:19.674 DEBUG:teuthology.orchestra.run.smithi102:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-11-13T11:29:19.721 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T11:29:19.739 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-13T11:29:19.740 DEBUG:teuthology.orchestra.run.smithi102:> stat --file-system '--printf=%T 2023-11-13T11:29:19.740 DEBUG:teuthology.orchestra.run.smithi102:> ' -- /home/ubuntu/cephtest/mnt.2 2023-11-13T11:29:19.785 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T11:29:19.795 INFO:teuthology.orchestra.run.smithi102.stdout:fuseblk 2023-11-13T11:29:19.796 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.2 2023-11-13T11:29:19.796 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-13T11:29:19.797 DEBUG:teuthology.orchestra.run.smithi102:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.2 2023-11-13T11:29:19.903 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-13T11:29:19.903 DEBUG:teuthology.orchestra.run.smithi154:> stat --file-system '--printf=%T 2023-11-13T11:29:19.903 DEBUG:teuthology.orchestra.run.smithi154:> ' -- /home/ubuntu/cephtest/mnt.1 2023-11-13T11:29:19.913 INFO:teuthology.orchestra.run.smithi154.stdout:fuseblk 2023-11-13T11:29:19.914 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.1 2023-11-13T11:29:19.914 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-13T11:29:19.915 DEBUG:teuthology.orchestra.run.smithi154:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2023-11-13T11:29:19.975 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-13T11:29:19.976 DEBUG:teuthology.orchestra.run.smithi154:> stat --file-system '--printf=%T 2023-11-13T11:29:19.976 DEBUG:teuthology.orchestra.run.smithi154:> ' -- /home/ubuntu/cephtest/mnt.3 2023-11-13T11:29:20.028 INFO:teuthology.orchestra.run.smithi154.stdout:fuseblk 2023-11-13T11:29:20.028 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.3 2023-11-13T11:29:20.029 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-13T11:29:20.029 DEBUG:teuthology.orchestra.run.smithi154:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.3 2023-11-13T11:29:20.094 INFO:teuthology.run_tasks:Running task cephfs_test_runner... 2023-11-13T11:29:20.112 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-13T11:29:20.259 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:20.254+0000 7f98a2c5a640 1 Processor -- start 2023-11-13T11:29:20.259 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:20.254+0000 7f98a2c5a640 1 -- start start 2023-11-13T11:29:20.260 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:20.254+0000 7f98a2c5a640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f989c0cfeb0 0x7f989c0d38f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:20.260 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:20.254+0000 7f98a2c5a640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f989c0d1380 0x7f989c0b30b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:20.260 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:20.254+0000 7f98a2c5a640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f989c0b2660 con 0x7f989c15d290 2023-11-13T11:29:20.260 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:20.254+0000 7f98a2c5a640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f989c0d18b0 con 0x7f989c0d1380 2023-11-13T11:29:20.260 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:20.254+0000 7f98a2c5a640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f989c0d1b90 con 0x7f989c0cfeb0 2023-11-13T11:29:20.262 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:20.254+0000 7f98a09f6640 1 --1- >> v1:172.21.15.102:6789/0 conn(0x7f989c15d290 0x7f989c0cf7a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.102:6789/0 says I am v1:172.21.15.102:36702/0 (socket says 172.21.15.102:36702) 2023-11-13T11:29:20.263 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:20.254+0000 7f98a09f6640 1 -- 172.21.15.102:0/2653994995 learned_addr learned my addr 172.21.15.102:0/2653994995 (peer_addr_for_me v1:172.21.15.102:0/0) 2023-11-13T11:29:20.263 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:20.254+0000 7f98937fe640 1 -- 172.21.15.102:0/2653994995 <== mon.0 v1:172.21.15.102:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1286102186 0 0) 0x7f989c0b2660 con 0x7f989c15d290 2023-11-13T11:29:20.263 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:20.254+0000 7f98937fe640 1 -- 172.21.15.102:0/2653994995 --> v1:172.21.15.102:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9884003530 con 0x7f989c15d290 2023-11-13T11:29:20.263 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:20.254+0000 7f98a11f7640 1 --2- 172.21.15.102:0/2653994995 >> v2:172.21.15.154:3300/0 conn(0x7f989c0d1380 0x7f989c0b30b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:20.264 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:20.254+0000 7f9893fff640 1 --2- 172.21.15.102:0/2653994995 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f989c0cfeb0 0x7f989c0d38f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:20.264 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:20.254+0000 7f98937fe640 1 -- 172.21.15.102:0/2653994995 <== mon.0 v1:172.21.15.102:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3828161590 0 0) 0x7f9884003530 con 0x7f989c15d290 2023-11-13T11:29:20.264 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:20.254+0000 7f98937fe640 1 -- 172.21.15.102:0/2653994995 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f989c0cfeb0 msgr2=0x7f989c0d38f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-13T11:29:20.264 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:20.254+0000 7f98937fe640 1 --2- 172.21.15.102:0/2653994995 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f989c0cfeb0 0x7f989c0d38f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:20.264 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:20.254+0000 7f98937fe640 1 -- 172.21.15.102:0/2653994995 >> v2:172.21.15.154:3300/0 conn(0x7f989c0d1380 msgr2=0x7f989c0b30b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-13T11:29:20.264 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:20.254+0000 7f98937fe640 1 --2- 172.21.15.102:0/2653994995 >> v2:172.21.15.154:3300/0 conn(0x7f989c0d1380 0x7f989c0b30b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:20.265 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:20.254+0000 7f98937fe640 1 -- 172.21.15.102:0/2653994995 --> v1:172.21.15.102:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f989c0b28b0 con 0x7f989c15d290 2023-11-13T11:29:20.265 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:20.254+0000 7f98937fe640 1 -- 172.21.15.102:0/2653994995 <== mon.0 v1:172.21.15.102:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 895381068 0 0) 0x7f9898001680 con 0x7f989c15d290 2023-11-13T11:29:20.265 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:20.254+0000 7f98937fe640 1 -- 172.21.15.102:0/2653994995 >> v1:172.21.15.102:6789/0 conn(0x7f989c15d290 legacy=0x7f989c0cf7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:20.265 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:20.254+0000 7f98937fe640 1 --2- 172.21.15.102:0/2653994995 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9884003980 0x7f9884003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:20.265 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:20.254+0000 7f98937fe640 1 --2- 172.21.15.102:0/2653994995 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f98840047d0 0x7f9884004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:20.266 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:20.254+0000 7f98937fe640 1 --2- 172.21.15.102:0/2653994995 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f989c0cfeb0 0x7f9884005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:20.266 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:20.254+0000 7f98937fe640 1 -- 172.21.15.102:0/2653994995 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f989c0d18b0 con 0x7f98840047d0 2023-11-13T11:29:20.266 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:20.254+0000 7f98937fe640 1 -- 172.21.15.102:0/2653994995 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f989c0d1b90 con 0x7f9884003980 2023-11-13T11:29:20.266 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:20.254+0000 7f98937fe640 1 -- 172.21.15.102:0/2653994995 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f988400b990 con 0x7f989c0cfeb0 2023-11-13T11:29:20.267 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:20.254+0000 7f9893fff640 1 --2- 172.21.15.102:0/2653994995 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f98840047d0 0x7f9884004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:20.268 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:20.254+0000 7f98a11f7640 1 --2- 172.21.15.102:0/2653994995 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f989c0cfeb0 0x7f9884005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:20.268 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:20.254+0000 7f98a09f6640 1 --2- 172.21.15.102:0/2653994995 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9884003980 0x7f9884003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:20.268 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:20.254+0000 7f9893fff640 1 -- 172.21.15.102:0/2653994995 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f989c0cfeb0 msgr2=0x7f9884005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-13T11:29:20.269 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:20.254+0000 7f9893fff640 1 --2- 172.21.15.102:0/2653994995 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f989c0cfeb0 0x7f9884005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:20.269 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:20.254+0000 7f9893fff640 1 -- 172.21.15.102:0/2653994995 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9884003980 msgr2=0x7f9884003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-13T11:29:20.269 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:20.254+0000 7f9893fff640 1 --2- 172.21.15.102:0/2653994995 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9884003980 0x7f9884003da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:20.269 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:20.254+0000 7f9893fff640 1 -- 172.21.15.102:0/2653994995 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9884003530 con 0x7f98840047d0 2023-11-13T11:29:20.269 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:20.254+0000 7f98a09f6640 1 --2- 172.21.15.102:0/2653994995 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9884003980 0x7f9884003da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-13T11:29:20.275 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:20.258+0000 7f9893fff640 1 --2- 172.21.15.102:0/2653994995 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f98840047d0 0x7f9884004c50 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f988c009ae0 tx=0x7f988c01ca50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=133fd20138e9ce55 server_cookie=0 in_seq=0 out_seq=0 2023-11-13T11:29:20.277 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:20.258+0000 7f98937fe640 1 -- 172.21.15.102:0/2653994995 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f988c0a6460 con 0x7f98840047d0 2023-11-13T11:29:20.277 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:20.258+0000 7f98937fe640 1 -- 172.21.15.102:0/2653994995 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f988c0a65c0 con 0x7f98840047d0 2023-11-13T11:29:20.278 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:20.258+0000 7f98937fe640 1 -- 172.21.15.102:0/2653994995 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f988c0a6970 con 0x7f98840047d0 2023-11-13T11:29:20.279 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:20.258+0000 7f98a2c5a640 1 -- 172.21.15.102:0/2653994995 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f98840047d0 msgr2=0x7f9884004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:20.279 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:20.258+0000 7f98a2c5a640 1 --2- 172.21.15.102:0/2653994995 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f98840047d0 0x7f9884004c50 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f988c009ae0 tx=0x7f988c01ca50 comp rx=0 tx=0).stop 2023-11-13T11:29:20.279 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:20.258+0000 7f98a11f7640 1 -- 172.21.15.102:0/2653994995 reap_dead start 2023-11-13T11:29:20.280 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:20.258+0000 7f98a2c5a640 1 -- 172.21.15.102:0/2653994995 shutdown_connections 2023-11-13T11:29:20.280 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:20.258+0000 7f98a2c5a640 1 -- 172.21.15.102:0/2653994995 >> 172.21.15.102:0/2653994995 conn(0x7f989c0d2dd0 msgr2=0x7f989c0d31e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-13T11:29:20.280 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:20.258+0000 7f98a2c5a640 1 -- 172.21.15.102:0/2653994995 shutdown_connections 2023-11-13T11:29:20.281 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:20.258+0000 7f98a2c5a640 1 -- 172.21.15.102:0/2653994995 wait complete. 2023-11-13T11:29:20.281 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:20.262+0000 7f98a2c5a640 1 Processor -- start 2023-11-13T11:29:20.281 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:20.262+0000 7f98a2c5a640 1 -- start start 2023-11-13T11:29:20.282 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:20.262+0000 7f98a2c5a640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f98840047d0 0x7f989c0b0260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:20.282 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:20.262+0000 7f98a2c5a640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f989c15f0e0 0x7f989c15f560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:20.282 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:20.262+0000 7f98a2c5a640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f989c0c8630 0x7f989c0c8ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:20.282 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:20.262+0000 7f98a2c5a640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f989c0ca1f0 con 0x7f989c15f0e0 2023-11-13T11:29:20.282 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:20.262+0000 7f98a2c5a640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f989c0c9ea0 con 0x7f98840047d0 2023-11-13T11:29:20.283 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:20.262+0000 7f98a2c5a640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f989c0c8ff0 con 0x7f989c0c8630 2023-11-13T11:29:20.283 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:20.262+0000 7f9893fff640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f989c15f0e0 0x7f989c15f560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:20.283 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:20.262+0000 7f9893fff640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f989c15f0e0 0x7f989c15f560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:50426/0 (socket says 172.21.15.102:50426) 2023-11-13T11:29:20.283 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:20.262+0000 7f9893fff640 1 -- 172.21.15.102:0/3277788880 learned_addr learned my addr 172.21.15.102:0/3277788880 (peer_addr_for_me v2:172.21.15.102:0/0) 2023-11-13T11:29:20.284 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:20.262+0000 7f98a11f7640 1 --2- 172.21.15.102:0/3277788880 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f989c0c8630 0x7f989c0c8ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:20.284 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:20.262+0000 7f98a09f6640 1 --2- 172.21.15.102:0/3277788880 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f98840047d0 0x7f989c0b0260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:20.284 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:20.262+0000 7f9893fff640 1 -- 172.21.15.102:0/3277788880 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f989c0c8630 msgr2=0x7f989c0c8ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:20.284 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:20.262+0000 7f9893fff640 1 --2- 172.21.15.102:0/3277788880 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f989c0c8630 0x7f989c0c8ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:20.284 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:20.262+0000 7f9893fff640 1 -- 172.21.15.102:0/3277788880 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f98840047d0 msgr2=0x7f989c0b0260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:20.285 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:20.262+0000 7f9893fff640 1 --2- 172.21.15.102:0/3277788880 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f98840047d0 0x7f989c0b0260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:20.285 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:20.262+0000 7f9893fff640 1 -- 172.21.15.102:0/3277788880 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f989c15fb80 con 0x7f989c15f0e0 2023-11-13T11:29:20.285 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:20.262+0000 7f9893fff640 1 --2- 172.21.15.102:0/3277788880 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f989c15f0e0 0x7f989c15f560 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f988c01c880 tx=0x7f9884005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-13T11:29:20.286 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:20.262+0000 7f98917fa640 1 -- 172.21.15.102:0/3277788880 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f988c0a6730 con 0x7f989c15f0e0 2023-11-13T11:29:20.286 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:20.262+0000 7f98917fa640 1 -- 172.21.15.102:0/3277788880 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f988c0a7440 con 0x7f989c15f0e0 2023-11-13T11:29:20.286 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:20.262+0000 7f98917fa640 1 -- 172.21.15.102:0/3277788880 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f988c0a77f0 con 0x7f989c15f0e0 2023-11-13T11:29:20.286 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:20.262+0000 7f98a2c5a640 1 -- 172.21.15.102:0/3277788880 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f989c15fe60 con 0x7f989c15f0e0 2023-11-13T11:29:20.286 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:20.262+0000 7f98a2c5a640 1 -- 172.21.15.102:0/3277788880 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f989c157980 con 0x7f989c15f0e0 2023-11-13T11:29:20.287 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:20.266+0000 7f98a2c5a640 1 -- 172.21.15.102:0/3277788880 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f989c068520 con 0x7f989c15f0e0 2023-11-13T11:29:20.287 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:20.266+0000 7f98917fa640 1 -- 172.21.15.102:0/3277788880 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f988c0a7950 con 0x7f989c15f0e0 2023-11-13T11:29:20.287 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:20.266+0000 7f98917fa640 1 --2- 172.21.15.102:0/3277788880 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f98880664a0 0x7f9888068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:20.287 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:20.266+0000 7f98917fa640 1 -- 172.21.15.102:0/3277788880 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f988c11d9b0 con 0x7f989c15f0e0 2023-11-13T11:29:20.287 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:20.266+0000 7f98a09f6640 1 --2- 172.21.15.102:0/3277788880 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f98880664a0 0x7f9888068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:20.288 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:20.266+0000 7f98a09f6640 1 --2- 172.21.15.102:0/3277788880 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f98880664a0 0x7f9888068960 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f9898000fc0 tx=0x7f9898009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-13T11:29:20.289 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:20.270+0000 7f98917fa640 1 -- 172.21.15.102:0/3277788880 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f988c0eaf50 con 0x7f989c15f0e0 2023-11-13T11:29:20.427 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:20.422+0000 7f98a2c5a640 1 -- 172.21.15.102:0/3277788880 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f989c0b46a0 con 0x7f989c15f0e0 2023-11-13T11:29:20.428 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:20.422+0000 7f98917fa640 1 -- 172.21.15.102:0/3277788880 <== mon.0 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+16545 (secure 0 0 0) 0x7f988c0be070 con 0x7f989c15f0e0 2023-11-13T11:29:20.429 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T11:29:20.429 INFO:teuthology.orchestra.run.smithi102.stdout:{"epoch":22,"fsid":"97b3eb2b-7ccf-4aae-8d92-bff986c671ea","created":"2023-11-13T11:28:31.836724+0000","modified":"2023-11-13T11:28:58.608314+0000","last_up_change":"2023-11-13T11:28:44.876638+0000","last_in_change":"2023-11-13T11:28:35.312740+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-13T11:28:44.981356+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-13T11:28:55.958525+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-13T11:28:56.394264+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"bdefaa17-fcca-4c86-aa40-27dc33a789af","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6800","nonce":53303834},{"type":"v1","addr":"172.21.15.102:6801","nonce":53303834}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6802","nonce":53303834},{"type":"v1","addr":"172.21.15.102:6803","nonce":53303834}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6806","nonce":53303834},{"type":"v1","addr":"172.21.15.102:6807","nonce":53303834}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6804","nonce":53303834},{"type":"v1","addr":"172.21.15.102:6805","nonce":53303834}]},"public_addr":"172.21.15.102:6801/53303834","cluster_addr":"172.21.15.102:6803/53303834","heartbeat_back_addr":"172.21.15.102:6807/53303834","heartbeat_front_addr":"172.21.15.102:6805/53303834","state":["exists","up"]},{"osd":1,"uuid":"f0033196-dec9-4ae9-945e-6aeef6dbb47f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6808","nonce":1732708348},{"type":"v1","addr":"172.21.15.102:6809","nonce":1732708348}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6811","nonce":1732708348},{"type":"v1","addr":"172.21.15.102:6813","nonce":1732708348}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6818","nonce":1732708348},{"type":"v1","addr":"172.21.15.102:6820","nonce":1732708348}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6815","nonce":1732708348},{"type":"v1","addr":"172.21.15.102:6817","nonce":1732708348}]},"public_addr":"172.21.15.102:6809/1732708348","cluster_addr":"172.21.15.102:6813/1732708348","heartbeat_back_addr":"172.21.15.102:6820/1732708348","heartbeat_front_addr":"172.21.15.102:6817/1732708348","state":["exists","up"]},{"osd":2,"uuid":"496b0834-351e-4ec2-a714-86ed0c0ff4fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6810","nonce":1825475150},{"type":"v1","addr":"172.21.15.102:6812","nonce":1825475150}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6814","nonce":1825475150},{"type":"v1","addr":"172.21.15.102:6816","nonce":1825475150}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6822","nonce":1825475150},{"type":"v1","addr":"172.21.15.102:6823","nonce":1825475150}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6819","nonce":1825475150},{"type":"v1","addr":"172.21.15.102:6821","nonce":1825475150}]},"public_addr":"172.21.15.102:6812/1825475150","cluster_addr":"172.21.15.102:6816/1825475150","heartbeat_back_addr":"172.21.15.102:6823/1825475150","heartbeat_front_addr":"172.21.15.102:6821/1825475150","state":["exists","up"]},{"osd":3,"uuid":"3ba6cc41-e0a0-4273-86cb-90000c06a55a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6824","nonce":4149355528},{"type":"v1","addr":"172.21.15.102:6825","nonce":4149355528}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6826","nonce":4149355528},{"type":"v1","addr":"172.21.15.102:6827","nonce":4149355528}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6830","nonce":4149355528},{"type":"v1","addr":"172.21.15.102:6831","nonce":4149355528}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6828","nonce":4149355528},{"type":"v1","addr":"172.21.15.102:6829","nonce":4149355528}]},"public_addr":"172.21.15.102:6825/4149355528","cluster_addr":"172.21.15.102:6827/4149355528","heartbeat_back_addr":"172.21.15.102:6831/4149355528","heartbeat_front_addr":"172.21.15.102:6829/4149355528","state":["exists","up"]},{"osd":4,"uuid":"16e797d8-e6e7-4140-95c3-b85283c42a2a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6808","nonce":4028899241},{"type":"v1","addr":"172.21.15.154:6809","nonce":4028899241}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6810","nonce":4028899241},{"type":"v1","addr":"172.21.15.154:6811","nonce":4028899241}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6814","nonce":4028899241},{"type":"v1","addr":"172.21.15.154:6815","nonce":4028899241}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6812","nonce":4028899241},{"type":"v1","addr":"172.21.15.154:6813","nonce":4028899241}]},"public_addr":"172.21.15.154:6809/4028899241","cluster_addr":"172.21.15.154:6811/4028899241","heartbeat_back_addr":"172.21.15.154:6815/4028899241","heartbeat_front_addr":"172.21.15.154:6813/4028899241","state":["exists","up"]},{"osd":5,"uuid":"d6ab225c-1b55-450a-89a9-abe5c3f8d6af","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":3562396827},{"type":"v1","addr":"172.21.15.154:6801","nonce":3562396827}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":3562396827},{"type":"v1","addr":"172.21.15.154:6803","nonce":3562396827}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6806","nonce":3562396827},{"type":"v1","addr":"172.21.15.154:6807","nonce":3562396827}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6804","nonce":3562396827},{"type":"v1","addr":"172.21.15.154:6805","nonce":3562396827}]},"public_addr":"172.21.15.154:6801/3562396827","cluster_addr":"172.21.15.154:6803/3562396827","heartbeat_back_addr":"172.21.15.154:6807/3562396827","heartbeat_front_addr":"172.21.15.154:6805/3562396827","state":["exists","up"]},{"osd":6,"uuid":"96f905ac-491c-4662-8e2b-5bb8e929ab9d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6816","nonce":2933728751},{"type":"v1","addr":"172.21.15.154:6817","nonce":2933728751}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6818","nonce":2933728751},{"type":"v1","addr":"172.21.15.154:6819","nonce":2933728751}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6822","nonce":2933728751},{"type":"v1","addr":"172.21.15.154:6823","nonce":2933728751}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6820","nonce":2933728751},{"type":"v1","addr":"172.21.15.154:6821","nonce":2933728751}]},"public_addr":"172.21.15.154:6817/2933728751","cluster_addr":"172.21.15.154:6819/2933728751","heartbeat_back_addr":"172.21.15.154:6823/2933728751","heartbeat_front_addr":"172.21.15.154:6821/2933728751","state":["exists","up"]},{"osd":7,"uuid":"07012d3b-3ab4-40df-a471-93caed22e2dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6824","nonce":1753500785},{"type":"v1","addr":"172.21.15.154:6825","nonce":1753500785}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6826","nonce":1753500785},{"type":"v1","addr":"172.21.15.154:6827","nonce":1753500785}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6830","nonce":1753500785},{"type":"v1","addr":"172.21.15.154:6831","nonce":1753500785}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6828","nonce":1753500785},{"type":"v1","addr":"172.21.15.154:6829","nonce":1753500785}]},"public_addr":"172.21.15.154:6825/1753500785","cluster_addr":"172.21.15.154:6827/1753500785","heartbeat_back_addr":"172.21.15.154:6831/1753500785","heartbeat_front_addr":"172.21.15.154:6829/1753500785","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-13T11:28:40.978603+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-13T11:28:41.200985+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-13T11:28:41.222815+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-13T11:28:41.202162+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-13T11:28:40.925911+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-13T11:28:41.087725+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-13T11:28:41.072208+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-13T11:28:40.875257+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-13T11:29:20.430 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:20.422+0000 7f98a2c5a640 1 -- 172.21.15.102:0/3277788880 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f98880664a0 msgr2=0x7f9888068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:20.431 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:20.422+0000 7f98a2c5a640 1 --2- 172.21.15.102:0/3277788880 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f98880664a0 0x7f9888068960 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f9898000fc0 tx=0x7f9898009040 comp rx=0 tx=0).stop 2023-11-13T11:29:20.431 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:20.422+0000 7f98a2c5a640 1 -- 172.21.15.102:0/3277788880 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f989c15f0e0 msgr2=0x7f989c15f560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:20.431 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:20.422+0000 7f98a2c5a640 1 --2- 172.21.15.102:0/3277788880 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f989c15f0e0 0x7f989c15f560 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f988c01c880 tx=0x7f9884005800 comp rx=0 tx=0).stop 2023-11-13T11:29:20.431 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:20.422+0000 7f98a2c5a640 1 -- 172.21.15.102:0/3277788880 shutdown_connections 2023-11-13T11:29:20.431 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:20.422+0000 7f98a2c5a640 1 --2- 172.21.15.102:0/3277788880 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f989c0c8630 0x7f989c0c8ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:20.432 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:20.422+0000 7f98a2c5a640 1 --2- 172.21.15.102:0/3277788880 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f98880664a0 0x7f9888068960 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:20.432 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:20.422+0000 7f98a2c5a640 1 --2- 172.21.15.102:0/3277788880 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f989c15f0e0 0x7f989c15f560 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:20.432 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:20.422+0000 7f98a2c5a640 1 --2- 172.21.15.102:0/3277788880 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f98840047d0 0x7f989c0b0260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:20.432 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:20.422+0000 7f98a2c5a640 1 -- 172.21.15.102:0/3277788880 >> 172.21.15.102:0/3277788880 conn(0x7f989c0d2dd0 msgr2=0x7f989c0c9200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-13T11:29:20.433 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:20.422+0000 7f98a2c5a640 1 -- 172.21.15.102:0/3277788880 shutdown_connections 2023-11-13T11:29:20.433 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:20.426+0000 7f98a2c5a640 1 -- 172.21.15.102:0/3277788880 wait complete. 2023-11-13T11:29:20.450 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-13T11:28:44.981356+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-13T11:28:55.958525+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-11-13T11:28:56.394264+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-13T11:29:20.450 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-13T11:29:20.590 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:20.582+0000 7f5f3dee4640 1 Processor -- start 2023-11-13T11:29:20.591 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:20.582+0000 7f5f3dee4640 1 -- start start 2023-11-13T11:29:20.592 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:20.586+0000 7f5f3dee4640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5f381553c0 0x7f5f380cebc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:20.592 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:20.586+0000 7f5f3dee4640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f5f3815bac0 0x7f5f380cf100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:20.592 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:20.586+0000 7f5f3dee4640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5f3815c150 con 0x7f5f3806c800 2023-11-13T11:29:20.592 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:20.586+0000 7f5f3dee4640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5f3806c3e0 con 0x7f5f3815bac0 2023-11-13T11:29:20.593 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:20.586+0000 7f5f3dee4640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f3815bf30 con 0x7f5f381553c0 2023-11-13T11:29:20.593 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:20.586+0000 7f5f37fff640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f5f3815bac0 0x7f5f380cf100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:20.593 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:20.586+0000 7f5f37fff640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f5f3815bac0 0x7f5f380cf100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:50436/0 (socket says 172.21.15.102:50436) 2023-11-13T11:29:20.593 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:20.586+0000 7f5f37fff640 1 -- 172.21.15.102:0/3348490658 learned_addr learned my addr 172.21.15.102:0/3348490658 (peer_addr_for_me v2:172.21.15.102:0/0) 2023-11-13T11:29:20.594 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:20.586+0000 7f5f377fe640 1 --2- 172.21.15.102:0/3348490658 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5f381553c0 0x7f5f380cebc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:20.594 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:20.586+0000 7f5f37fff640 1 -- 172.21.15.102:0/3348490658 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5f381553c0 msgr2=0x7f5f380cebc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-13T11:29:20.594 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:20.586+0000 7f5f37fff640 1 --2- 172.21.15.102:0/3348490658 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5f381553c0 0x7f5f380cebc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:20.595 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:20.586+0000 7f5f37fff640 1 -- 172.21.15.102:0/3348490658 >> v1:172.21.15.154:6789/0 conn(0x7f5f3806c800 legacy=0x7f5f3815b3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-13T11:29:20.595 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:20.586+0000 7f5f37fff640 1 -- 172.21.15.102:0/3348490658 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f3806bd20 con 0x7f5f3815bac0 2023-11-13T11:29:20.595 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:20.586+0000 7f5f377fe640 1 --2- 172.21.15.102:0/3348490658 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5f381553c0 0x7f5f380cebc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-13T11:29:20.596 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:20.590+0000 7f5f37fff640 1 --2- 172.21.15.102:0/3348490658 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5f3815bac0 0x7f5f380cf100 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f5f30009e80 tx=0x7f5f3001c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ca6b282558882b76 server_cookie=0 in_seq=0 out_seq=0 2023-11-13T11:29:20.597 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:20.590+0000 7f5f367fc640 1 -- 172.21.15.102:0/3348490658 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f300a5700 con 0x7f5f3815bac0 2023-11-13T11:29:20.597 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:20.590+0000 7f5f367fc640 1 -- 172.21.15.102:0/3348490658 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f300a5860 con 0x7f5f3815bac0 2023-11-13T11:29:20.597 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:20.590+0000 7f5f367fc640 1 -- 172.21.15.102:0/3348490658 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f300a5bf0 con 0x7f5f3815bac0 2023-11-13T11:29:20.598 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:20.590+0000 7f5f3dee4640 1 -- 172.21.15.102:0/3348490658 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5f3815bac0 msgr2=0x7f5f380cf100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:20.598 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:20.590+0000 7f5f3dee4640 1 --2- 172.21.15.102:0/3348490658 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5f3815bac0 0x7f5f380cf100 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f5f30009e80 tx=0x7f5f3001c920 comp rx=0 tx=0).stop 2023-11-13T11:29:20.598 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:20.590+0000 7f5f3dee4640 1 -- 172.21.15.102:0/3348490658 shutdown_connections 2023-11-13T11:29:20.598 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:20.590+0000 7f5f3dee4640 1 --2- 172.21.15.102:0/3348490658 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5f3815bac0 0x7f5f380cf100 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:20.598 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:20.590+0000 7f5f3dee4640 1 --2- 172.21.15.102:0/3348490658 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5f381553c0 0x7f5f380cebc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:20.599 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:20.590+0000 7f5f3dee4640 1 -- 172.21.15.102:0/3348490658 >> 172.21.15.102:0/3348490658 conn(0x7f5f3806a410 msgr2=0x7f5f3806a820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-13T11:29:20.599 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:20.590+0000 7f5f3dee4640 1 -- 172.21.15.102:0/3348490658 shutdown_connections 2023-11-13T11:29:20.599 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:20.590+0000 7f5f3dee4640 1 -- 172.21.15.102:0/3348490658 wait complete. 2023-11-13T11:29:20.601 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:20.590+0000 7f5f3dee4640 1 Processor -- start 2023-11-13T11:29:20.602 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:20.590+0000 7f5f3dee4640 1 -- start start 2023-11-13T11:29:20.602 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:20.594+0000 7f5f3dee4640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5f3806c800 0x7f5f3814cf20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:20.602 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:20.594+0000 7f5f3dee4640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5f381553c0 0x7f5f38157d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:20.602 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:20.594+0000 7f5f3dee4640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5f3815bac0 0x7f5f381f3cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:20.602 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:20.594+0000 7f5f3dee4640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f38156260 con 0x7f5f3815bac0 2023-11-13T11:29:20.603 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:20.594+0000 7f5f3dee4640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f3814d460 con 0x7f5f3806c800 2023-11-13T11:29:20.603 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:20.594+0000 7f5f3dee4640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f381586b0 con 0x7f5f381553c0 2023-11-13T11:29:20.603 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:20.594+0000 7f5f37fff640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5f3815bac0 0x7f5f381f3cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:20.603 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:20.594+0000 7f5f377fe640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5f3806c800 0x7f5f3814cf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:20.603 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:20.594+0000 7f5f36ffd640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5f381553c0 0x7f5f38157d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:20.604 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:20.594+0000 7f5f377fe640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5f3806c800 0x7f5f3814cf20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.102:36612/0 (socket says 172.21.15.102:36612) 2023-11-13T11:29:20.604 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:20.594+0000 7f5f36ffd640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5f381553c0 0x7f5f38157d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.102:43660/0 (socket says 172.21.15.102:43660) 2023-11-13T11:29:20.604 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:20.594+0000 7f5f37fff640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5f3815bac0 0x7f5f381f3cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:50452/0 (socket says 172.21.15.102:50452) 2023-11-13T11:29:20.604 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:20.594+0000 7f5f377fe640 1 -- 172.21.15.102:0/3226974550 learned_addr learned my addr 172.21.15.102:0/3226974550 (peer_addr_for_me v2:172.21.15.102:0/0) 2023-11-13T11:29:20.605 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:20.594+0000 7f5f377fe640 1 -- 172.21.15.102:0/3226974550 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5f381553c0 msgr2=0x7f5f38157d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:20.605 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:20.594+0000 7f5f377fe640 1 --2- 172.21.15.102:0/3226974550 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5f381553c0 0x7f5f38157d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:20.605 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:20.594+0000 7f5f377fe640 1 -- 172.21.15.102:0/3226974550 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5f3815bac0 msgr2=0x7f5f381f3cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:20.605 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:20.594+0000 7f5f377fe640 1 --2- 172.21.15.102:0/3226974550 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5f3815bac0 0x7f5f381f3cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:20.605 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:20.594+0000 7f5f377fe640 1 -- 172.21.15.102:0/3226974550 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f30009b30 con 0x7f5f3806c800 2023-11-13T11:29:20.606 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:20.594+0000 7f5f37fff640 1 --2- 172.21.15.102:0/3226974550 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5f3815bac0 0x7f5f381f3cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-13T11:29:20.606 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:20.594+0000 7f5f377fe640 1 --2- 172.21.15.102:0/3226974550 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5f3806c800 0x7f5f3814cf20 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f5f2800c820 tx=0x7f5f2800cce0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-13T11:29:20.606 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:20.594+0000 7f5f1ffff640 1 -- 172.21.15.102:0/3226974550 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f28007a30 con 0x7f5f3806c800 2023-11-13T11:29:20.606 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:20.594+0000 7f5f1ffff640 1 -- 172.21.15.102:0/3226974550 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f28007b90 con 0x7f5f3806c800 2023-11-13T11:29:20.606 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:20.594+0000 7f5f3dee4640 1 -- 172.21.15.102:0/3226974550 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5f38155ba0 con 0x7f5f3806c800 2023-11-13T11:29:20.607 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:20.594+0000 7f5f1ffff640 1 -- 172.21.15.102:0/3226974550 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f2800ce10 con 0x7f5f3806c800 2023-11-13T11:29:20.607 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:20.594+0000 7f5f3dee4640 1 -- 172.21.15.102:0/3226974550 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5f38158990 con 0x7f5f3806c800 2023-11-13T11:29:20.607 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:20.594+0000 7f5f3dee4640 1 -- 172.21.15.102:0/3226974550 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5f38067640 con 0x7f5f3806c800 2023-11-13T11:29:20.608 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:20.598+0000 7f5f1ffff640 1 -- 172.21.15.102:0/3226974550 <== mon.1 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f5f280113f0 con 0x7f5f3806c800 2023-11-13T11:29:20.608 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:20.598+0000 7f5f1ffff640 1 --2- 172.21.15.102:0/3226974550 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f5f24066470 0x7f5f24068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:20.608 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:20.598+0000 7f5f1ffff640 1 -- 172.21.15.102:0/3226974550 <== mon.1 v2:172.21.15.154:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f5f28083e90 con 0x7f5f3806c800 2023-11-13T11:29:20.609 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:20.598+0000 7f5f36ffd640 1 --2- 172.21.15.102:0/3226974550 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f5f24066470 0x7f5f24068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:20.609 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:20.598+0000 7f5f36ffd640 1 --2- 172.21.15.102:0/3226974550 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f5f24066470 0x7f5f24068930 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f5f3806d240 tx=0x7f5f2c00f040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-13T11:29:20.609 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:20.602+0000 7f5f1ffff640 1 -- 172.21.15.102:0/3226974550 <== mon.1 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f5f280513b0 con 0x7f5f3806c800 2023-11-13T11:29:20.759 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:20.754+0000 7f5f3dee4640 1 -- 172.21.15.102:0/3226974550 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f5f38068520 con 0x7f5f3806c800 2023-11-13T11:29:20.759 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:20.754+0000 7f5f1ffff640 1 -- 172.21.15.102:0/3226974550 <== mon.1 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v22) v1 ==== 93+0+10 (secure 0 0 0) 0x7f5f280549d0 con 0x7f5f3806c800 2023-11-13T11:29:20.760 INFO:teuthology.orchestra.run.smithi102.stdout:pg_num: 1 2023-11-13T11:29:20.761 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:20.754+0000 7f5f3dee4640 1 -- 172.21.15.102:0/3226974550 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f5f24066470 msgr2=0x7f5f24068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:20.761 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:20.754+0000 7f5f3dee4640 1 --2- 172.21.15.102:0/3226974550 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f5f24066470 0x7f5f24068930 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f5f3806d240 tx=0x7f5f2c00f040 comp rx=0 tx=0).stop 2023-11-13T11:29:20.762 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:20.754+0000 7f5f3dee4640 1 -- 172.21.15.102:0/3226974550 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5f3806c800 msgr2=0x7f5f3814cf20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:20.762 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:20.754+0000 7f5f3dee4640 1 --2- 172.21.15.102:0/3226974550 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5f3806c800 0x7f5f3814cf20 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f5f2800c820 tx=0x7f5f2800cce0 comp rx=0 tx=0).stop 2023-11-13T11:29:20.762 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:20.754+0000 7f5f3dee4640 1 -- 172.21.15.102:0/3226974550 shutdown_connections 2023-11-13T11:29:20.762 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:20.754+0000 7f5f3dee4640 1 --2- 172.21.15.102:0/3226974550 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f5f24066470 0x7f5f24068930 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:20.762 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:20.754+0000 7f5f3dee4640 1 --2- 172.21.15.102:0/3226974550 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5f3815bac0 0x7f5f381f3cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:20.763 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:20.754+0000 7f5f3dee4640 1 --2- 172.21.15.102:0/3226974550 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5f381553c0 0x7f5f38157d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:20.763 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:20.754+0000 7f5f3dee4640 1 --2- 172.21.15.102:0/3226974550 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5f3806c800 0x7f5f3814cf20 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:20.763 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:20.754+0000 7f5f3dee4640 1 -- 172.21.15.102:0/3226974550 >> 172.21.15.102:0/3226974550 conn(0x7f5f3806a410 msgr2=0x7f5f38071430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-13T11:29:20.763 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:20.754+0000 7f5f3dee4640 1 -- 172.21.15.102:0/3226974550 shutdown_connections 2023-11-13T11:29:20.763 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:20.754+0000 7f5f3dee4640 1 -- 172.21.15.102:0/3226974550 wait complete. 2023-11-13T11:29:20.780 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-13T11:29:20.921 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:20.914+0000 7f77793c1640 1 Processor -- start 2023-11-13T11:29:20.921 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:20.914+0000 7f77793c1640 1 -- start start 2023-11-13T11:29:20.923 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:20.914+0000 7f77793c1640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f777415d090 0x7f77740d1000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:20.923 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:20.914+0000 7f77793c1640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f777415d470 0x7f77740d1540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:20.923 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:20.914+0000 7f77793c1640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f77740cfca0 0x7f77740b24c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:20.924 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:20.914+0000 7f77793c1640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f77740b3b00 con 0x7f77740cfca0 2023-11-13T11:29:20.924 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:20.914+0000 7f77793c1640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f77740d3b00 con 0x7f777415d090 2023-11-13T11:29:20.924 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:20.914+0000 7f77793c1640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f77740d1a80 con 0x7f777415d470 2023-11-13T11:29:20.924 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:20.918+0000 7f77737fe640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f77740cfca0 0x7f77740b24c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:20.924 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:20.918+0000 7f77737fe640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f77740cfca0 0x7f77740b24c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:50456/0 (socket says 172.21.15.102:50456) 2023-11-13T11:29:20.925 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:20.918+0000 7f77737fe640 1 -- 172.21.15.102:0/1029680018 learned_addr learned my addr 172.21.15.102:0/1029680018 (peer_addr_for_me v2:172.21.15.102:0/0) 2023-11-13T11:29:20.925 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:20.918+0000 7f7772ffd640 1 --2- 172.21.15.102:0/1029680018 >> v2:172.21.15.154:3300/0 conn(0x7f777415d090 0x7f77740d1000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:20.925 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:20.918+0000 7f776a7fc640 1 --2- 172.21.15.102:0/1029680018 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f777415d470 0x7f77740d1540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:20.925 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:20.918+0000 7f77737fe640 1 -- 172.21.15.102:0/1029680018 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f777415d470 msgr2=0x7f77740d1540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-13T11:29:20.925 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:20.918+0000 7f77737fe640 1 --2- 172.21.15.102:0/1029680018 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f777415d470 0x7f77740d1540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:20.926 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:20.918+0000 7f77737fe640 1 -- 172.21.15.102:0/1029680018 >> v2:172.21.15.154:3300/0 conn(0x7f777415d090 msgr2=0x7f77740d1000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-13T11:29:20.926 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:20.918+0000 7f77737fe640 1 --2- 172.21.15.102:0/1029680018 >> v2:172.21.15.154:3300/0 conn(0x7f777415d090 0x7f77740d1000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:20.926 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:20.918+0000 7f77737fe640 1 -- 172.21.15.102:0/1029680018 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77740b3820 con 0x7f77740cfca0 2023-11-13T11:29:20.926 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:20.918+0000 7f776a7fc640 1 --2- 172.21.15.102:0/1029680018 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f777415d470 0x7f77740d1540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-13T11:29:20.928 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:20.918+0000 7f77737fe640 1 --2- 172.21.15.102:0/1029680018 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f77740cfca0 0x7f77740b24c0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f777408c350 tx=0x7f776c01c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=30db3ef9509a9609 server_cookie=0 in_seq=0 out_seq=0 2023-11-13T11:29:20.928 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:20.918+0000 7f77727fc640 1 -- 172.21.15.102:0/1029680018 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f776c0a5790 con 0x7f77740cfca0 2023-11-13T11:29:20.928 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:20.918+0000 7f77727fc640 1 -- 172.21.15.102:0/1029680018 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f776c0a58f0 con 0x7f77740cfca0 2023-11-13T11:29:20.928 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:20.918+0000 7f77727fc640 1 -- 172.21.15.102:0/1029680018 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f776c0a5c80 con 0x7f77740cfca0 2023-11-13T11:29:20.928 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:20.922+0000 7f77793c1640 1 -- 172.21.15.102:0/1029680018 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f77740cfca0 msgr2=0x7f77740b24c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:20.929 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:20.922+0000 7f77793c1640 1 --2- 172.21.15.102:0/1029680018 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f77740cfca0 0x7f77740b24c0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f777408c350 tx=0x7f776c01c910 comp rx=0 tx=0).stop 2023-11-13T11:29:20.929 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:20.922+0000 7f77793c1640 1 -- 172.21.15.102:0/1029680018 shutdown_connections 2023-11-13T11:29:20.929 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:20.922+0000 7f77793c1640 1 --2- 172.21.15.102:0/1029680018 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f77740cfca0 0x7f77740b24c0 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:20.930 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:20.922+0000 7f77793c1640 1 --2- 172.21.15.102:0/1029680018 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f777415d470 0x7f77740d1540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:20.930 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:20.922+0000 7f77793c1640 1 --2- 172.21.15.102:0/1029680018 >> v2:172.21.15.154:3300/0 conn(0x7f777415d090 0x7f77740d1000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:20.930 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:20.922+0000 7f77793c1640 1 -- 172.21.15.102:0/1029680018 >> 172.21.15.102:0/1029680018 conn(0x7f77740d2b60 msgr2=0x7f77740d2f70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-13T11:29:20.930 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:20.922+0000 7f77793c1640 1 -- 172.21.15.102:0/1029680018 shutdown_connections 2023-11-13T11:29:20.931 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:20.922+0000 7f77793c1640 1 -- 172.21.15.102:0/1029680018 wait complete. 2023-11-13T11:29:20.933 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:20.922+0000 7f77793c1640 1 Processor -- start 2023-11-13T11:29:20.933 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:20.922+0000 7f77793c1640 1 -- start start 2023-11-13T11:29:20.933 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:20.922+0000 7f77793c1640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f77740cfca0 0x7f777414c310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:20.933 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:20.922+0000 7f77793c1640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f777415d090 0x7f7774156bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:20.933 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:20.922+0000 7f77793c1640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f777415d470 0x7f77740cb4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:20.934 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:20.922+0000 7f77793c1640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7774157670 con 0x7f77740cfca0 2023-11-13T11:29:20.934 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:20.922+0000 7f77793c1640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7774157950 con 0x7f777415d090 2023-11-13T11:29:20.934 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:20.922+0000 7f77793c1640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7774157c30 con 0x7f777415d470 2023-11-13T11:29:20.934 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:20.922+0000 7f7772ffd640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f77740cfca0 0x7f777414c310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:20.934 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:20.922+0000 7f7772ffd640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f77740cfca0 0x7f777414c310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:50458/0 (socket says 172.21.15.102:50458) 2023-11-13T11:29:20.935 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:20.922+0000 7f7772ffd640 1 -- 172.21.15.102:0/3059300446 learned_addr learned my addr 172.21.15.102:0/3059300446 (peer_addr_for_me v2:172.21.15.102:0/0) 2023-11-13T11:29:20.935 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:20.922+0000 7f77737fe640 1 --2- 172.21.15.102:0/3059300446 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f777415d470 0x7f77740cb4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:20.935 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:20.922+0000 7f776a7fc640 1 --2- 172.21.15.102:0/3059300446 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f777415d090 0x7f7774156bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:20.935 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:20.926+0000 7f7772ffd640 1 -- 172.21.15.102:0/3059300446 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f777415d470 msgr2=0x7f77740cb4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:20.935 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:20.926+0000 7f7772ffd640 1 --2- 172.21.15.102:0/3059300446 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f777415d470 0x7f77740cb4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:20.936 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:20.926+0000 7f7772ffd640 1 -- 172.21.15.102:0/3059300446 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f777415d090 msgr2=0x7f7774156bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:20.936 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:20.926+0000 7f7772ffd640 1 --2- 172.21.15.102:0/3059300446 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f777415d090 0x7f7774156bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:20.936 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:20.926+0000 7f7772ffd640 1 -- 172.21.15.102:0/3059300446 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f776c009b30 con 0x7f77740cfca0 2023-11-13T11:29:20.936 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:20.926+0000 7f7772ffd640 1 --2- 172.21.15.102:0/3059300446 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f77740cfca0 0x7f777414c310 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f776400d800 tx=0x7f776400dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-13T11:29:20.936 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:20.926+0000 7f776bfff640 1 -- 172.21.15.102:0/3059300446 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77640096a0 con 0x7f77740cfca0 2023-11-13T11:29:20.937 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:20.926+0000 7f776bfff640 1 -- 172.21.15.102:0/3059300446 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7764009800 con 0x7f77740cfca0 2023-11-13T11:29:20.937 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:20.926+0000 7f776bfff640 1 -- 172.21.15.102:0/3059300446 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7764009b70 con 0x7f77740cfca0 2023-11-13T11:29:20.937 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:20.926+0000 7f77793c1640 1 -- 172.21.15.102:0/3059300446 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7774157f10 con 0x7f77740cfca0 2023-11-13T11:29:20.937 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:20.926+0000 7f77793c1640 1 -- 172.21.15.102:0/3059300446 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f777414fdc0 con 0x7f77740cfca0 2023-11-13T11:29:20.937 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:20.926+0000 7f77793c1640 1 -- 172.21.15.102:0/3059300446 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f77740d0580 con 0x7f77740cfca0 2023-11-13T11:29:20.938 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:20.926+0000 7f776bfff640 1 -- 172.21.15.102:0/3059300446 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f7764009cd0 con 0x7f77740cfca0 2023-11-13T11:29:20.939 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:20.926+0000 7f776bfff640 1 --2- 172.21.15.102:0/3059300446 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f7754066470 0x7f7754068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:20.939 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:20.926+0000 7f776bfff640 1 -- 172.21.15.102:0/3059300446 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f7764084520 con 0x7f77740cfca0 2023-11-13T11:29:20.939 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:20.926+0000 7f776a7fc640 1 --2- 172.21.15.102:0/3059300446 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f7754066470 0x7f7754068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:20.939 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:20.930+0000 7f776a7fc640 1 --2- 172.21.15.102:0/3059300446 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f7754066470 0x7f7754068930 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f7774158e40 tx=0x7f775c008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-13T11:29:20.939 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:20.930+0000 7f776bfff640 1 -- 172.21.15.102:0/3059300446 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f77640519b0 con 0x7f77740cfca0 2023-11-13T11:29:21.090 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:21.082+0000 7f77793c1640 1 -- 172.21.15.102:0/3059300446 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f7774068520 con 0x7f77740cfca0 2023-11-13T11:29:21.090 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:21.082+0000 7f776bfff640 1 -- 172.21.15.102:0/3059300446 <== mon.0 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v22) v1 ==== 104+0+11 (secure 0 0 0) 0x7f7764054fd0 con 0x7f77740cfca0 2023-11-13T11:29:21.091 INFO:teuthology.orchestra.run.smithi102.stdout:pg_num: 32 2023-11-13T11:29:21.092 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:21.086+0000 7f77793c1640 1 -- 172.21.15.102:0/3059300446 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f7754066470 msgr2=0x7f7754068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:21.092 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:21.086+0000 7f77793c1640 1 --2- 172.21.15.102:0/3059300446 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f7754066470 0x7f7754068930 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f7774158e40 tx=0x7f775c008040 comp rx=0 tx=0).stop 2023-11-13T11:29:21.093 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:21.086+0000 7f77793c1640 1 -- 172.21.15.102:0/3059300446 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f77740cfca0 msgr2=0x7f777414c310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:21.093 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:21.086+0000 7f77793c1640 1 --2- 172.21.15.102:0/3059300446 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f77740cfca0 0x7f777414c310 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f776400d800 tx=0x7f776400dcc0 comp rx=0 tx=0).stop 2023-11-13T11:29:21.093 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:21.086+0000 7f77793c1640 1 -- 172.21.15.102:0/3059300446 shutdown_connections 2023-11-13T11:29:21.093 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:21.086+0000 7f77793c1640 1 --2- 172.21.15.102:0/3059300446 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f777415d470 0x7f77740cb4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:21.093 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:21.086+0000 7f77793c1640 1 --2- 172.21.15.102:0/3059300446 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f777415d090 0x7f7774156bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:21.094 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:21.086+0000 7f77793c1640 1 --2- 172.21.15.102:0/3059300446 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f7754066470 0x7f7754068930 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:21.094 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:21.086+0000 7f77793c1640 1 --2- 172.21.15.102:0/3059300446 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f77740cfca0 0x7f777414c310 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:21.094 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:21.086+0000 7f77793c1640 1 -- 172.21.15.102:0/3059300446 >> 172.21.15.102:0/3059300446 conn(0x7f77740d2b60 msgr2=0x7f77740b1220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-13T11:29:21.094 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:21.086+0000 7f77793c1640 1 -- 172.21.15.102:0/3059300446 shutdown_connections 2023-11-13T11:29:21.094 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:21.086+0000 7f77793c1640 1 -- 172.21.15.102:0/3059300446 wait complete. 2023-11-13T11:29:21.112 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-13T11:29:21.252 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:21.246+0000 7fb9d918d640 1 Processor -- start 2023-11-13T11:29:21.252 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:21.246+0000 7fb9d918d640 1 -- start start 2023-11-13T11:29:21.253 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:21.246+0000 7fb9d918d640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb9d415d0c0 0x7fb9d406a450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:21.254 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:21.246+0000 7fb9d918d640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7fb9d406b4b0 0x7fb9d40cfd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:21.254 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:21.246+0000 7fb9d918d640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fb9d40b02c0 0x7fb9d40b0770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:21.254 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:21.246+0000 7fb9d918d640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb9d40cefd0 con 0x7fb9d406b4b0 2023-11-13T11:29:21.254 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:21.246+0000 7fb9d918d640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb9d406ba00 con 0x7fb9d40b02c0 2023-11-13T11:29:21.254 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:21.246+0000 7fb9d918d640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb9d40cf220 con 0x7fb9d415d0c0 2023-11-13T11:29:21.255 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:21.246+0000 7fb9ca59c640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7fb9d406b4b0 0x7fb9d40cfd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:21.255 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:21.246+0000 7fb9ca59c640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7fb9d406b4b0 0x7fb9d40cfd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:50474/0 (socket says 172.21.15.102:50474) 2023-11-13T11:29:21.255 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:21.246+0000 7fb9ca59c640 1 -- 172.21.15.102:0/4155103115 learned_addr learned my addr 172.21.15.102:0/4155103115 (peer_addr_for_me v2:172.21.15.102:0/0) 2023-11-13T11:29:21.255 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:21.246+0000 7fb9d359e640 1 --2- 172.21.15.102:0/4155103115 >> v2:172.21.15.154:3300/0 conn(0x7fb9d40b02c0 0x7fb9d40b0770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:21.255 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:21.246+0000 7fb9d2d9d640 1 --2- 172.21.15.102:0/4155103115 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb9d415d0c0 0x7fb9d406a450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:21.256 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:21.246+0000 7fb9ca59c640 1 -- 172.21.15.102:0/4155103115 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb9d415d0c0 msgr2=0x7fb9d406a450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-13T11:29:21.256 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:21.246+0000 7fb9ca59c640 1 --2- 172.21.15.102:0/4155103115 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb9d415d0c0 0x7fb9d406a450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:21.256 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:21.246+0000 7fb9ca59c640 1 -- 172.21.15.102:0/4155103115 >> v2:172.21.15.154:3300/0 conn(0x7fb9d40b02c0 msgr2=0x7fb9d40b0770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-13T11:29:21.256 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:21.246+0000 7fb9ca59c640 1 --2- 172.21.15.102:0/4155103115 >> v2:172.21.15.154:3300/0 conn(0x7fb9d40b02c0 0x7fb9d40b0770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:21.256 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:21.246+0000 7fb9ca59c640 1 -- 172.21.15.102:0/4155103115 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9d40cf500 con 0x7fb9d406b4b0 2023-11-13T11:29:21.258 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:21.250+0000 7fb9ca59c640 1 --2- 172.21.15.102:0/4155103115 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb9d406b4b0 0x7fb9d40cfd00 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fb9d406ef00 tx=0x7fb9bc01c9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=604fca90abba2a4e server_cookie=0 in_seq=0 out_seq=0 2023-11-13T11:29:21.258 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:21.250+0000 7fb9d259c640 1 -- 172.21.15.102:0/4155103115 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9bc0a5820 con 0x7fb9d406b4b0 2023-11-13T11:29:21.258 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:21.250+0000 7fb9d259c640 1 -- 172.21.15.102:0/4155103115 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb9bc0a5980 con 0x7fb9d406b4b0 2023-11-13T11:29:21.258 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:21.250+0000 7fb9d259c640 1 -- 172.21.15.102:0/4155103115 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9bc0a5d10 con 0x7fb9d406b4b0 2023-11-13T11:29:21.258 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:21.250+0000 7fb9d918d640 1 -- 172.21.15.102:0/4155103115 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb9d406b4b0 msgr2=0x7fb9d40cfd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:21.259 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:21.250+0000 7fb9d918d640 1 --2- 172.21.15.102:0/4155103115 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb9d406b4b0 0x7fb9d40cfd00 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fb9d406ef00 tx=0x7fb9bc01c9a0 comp rx=0 tx=0).stop 2023-11-13T11:29:21.259 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:21.250+0000 7fb9d918d640 1 -- 172.21.15.102:0/4155103115 shutdown_connections 2023-11-13T11:29:21.259 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:21.250+0000 7fb9d918d640 1 --2- 172.21.15.102:0/4155103115 >> v2:172.21.15.154:3300/0 conn(0x7fb9d40b02c0 0x7fb9d40b0770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:21.259 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:21.250+0000 7fb9d918d640 1 --2- 172.21.15.102:0/4155103115 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb9d406b4b0 0x7fb9d40cfd00 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:21.259 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:21.250+0000 7fb9d918d640 1 --2- 172.21.15.102:0/4155103115 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb9d415d0c0 0x7fb9d406a450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:21.260 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:21.250+0000 7fb9d918d640 1 -- 172.21.15.102:0/4155103115 >> 172.21.15.102:0/4155103115 conn(0x7fb9d40709d0 msgr2=0x7fb9d40b4120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-13T11:29:21.260 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:21.250+0000 7fb9d918d640 1 -- 172.21.15.102:0/4155103115 shutdown_connections 2023-11-13T11:29:21.260 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:21.250+0000 7fb9d918d640 1 -- 172.21.15.102:0/4155103115 wait complete. 2023-11-13T11:29:21.262 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:21.254+0000 7fb9d918d640 1 Processor -- start 2023-11-13T11:29:21.262 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:21.254+0000 7fb9d918d640 1 -- start start 2023-11-13T11:29:21.263 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:21.254+0000 7fb9d918d640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb9d406b4b0 0x7fb9d409ca90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:21.263 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:21.254+0000 7fb9d918d640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb9d40b02c0 0x7fb9d406a240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:21.263 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:21.254+0000 7fb9d918d640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb9d415d0c0 0x7fb9d406a780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:21.263 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:21.254+0000 7fb9d918d640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9d4152fc0 con 0x7fb9d406b4b0 2023-11-13T11:29:21.263 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:21.254+0000 7fb9d918d640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9d409cfd0 con 0x7fb9d40b02c0 2023-11-13T11:29:21.264 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:21.254+0000 7fb9d918d640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb9d4152660 con 0x7fb9d415d0c0 2023-11-13T11:29:21.264 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:21.254+0000 7fb9d2d9d640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb9d406b4b0 0x7fb9d409ca90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:21.264 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:21.254+0000 7fb9d2d9d640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb9d406b4b0 0x7fb9d409ca90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:50490/0 (socket says 172.21.15.102:50490) 2023-11-13T11:29:21.264 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:21.254+0000 7fb9d2d9d640 1 -- 172.21.15.102:0/4167707237 learned_addr learned my addr 172.21.15.102:0/4167707237 (peer_addr_for_me v2:172.21.15.102:0/0) 2023-11-13T11:29:21.264 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:21.254+0000 7fb9d359e640 1 --2- 172.21.15.102:0/4167707237 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb9d415d0c0 0x7fb9d406a780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:21.265 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:21.254+0000 7fb9ca59c640 1 --2- 172.21.15.102:0/4167707237 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb9d40b02c0 0x7fb9d406a240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:21.266 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:21.254+0000 7fb9d2d9d640 1 -- 172.21.15.102:0/4167707237 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb9d415d0c0 msgr2=0x7fb9d406a780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:21.266 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:21.254+0000 7fb9d2d9d640 1 --2- 172.21.15.102:0/4167707237 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb9d415d0c0 0x7fb9d406a780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:21.266 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:21.254+0000 7fb9d2d9d640 1 -- 172.21.15.102:0/4167707237 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb9d40b02c0 msgr2=0x7fb9d406a240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:21.266 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:21.254+0000 7fb9d2d9d640 1 --2- 172.21.15.102:0/4167707237 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb9d40b02c0 0x7fb9d406a240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:21.266 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:21.254+0000 7fb9d2d9d640 1 -- 172.21.15.102:0/4167707237 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9bc009b30 con 0x7fb9d406b4b0 2023-11-13T11:29:21.267 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:21.254+0000 7fb9d2d9d640 1 --2- 172.21.15.102:0/4167707237 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb9d406b4b0 0x7fb9d409ca90 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fb9c400e870 tx=0x7fb9c400ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-13T11:29:21.267 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:21.254+0000 7fb9cbfff640 1 -- 172.21.15.102:0/4167707237 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9c4009510 con 0x7fb9d406b4b0 2023-11-13T11:29:21.267 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:21.254+0000 7fb9cbfff640 1 -- 172.21.15.102:0/4167707237 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb9c400eec0 con 0x7fb9d406b4b0 2023-11-13T11:29:21.267 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:21.254+0000 7fb9cbfff640 1 -- 172.21.15.102:0/4167707237 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9c400cb40 con 0x7fb9d406b4b0 2023-11-13T11:29:21.267 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:21.254+0000 7fb9d918d640 1 -- 172.21.15.102:0/4167707237 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb9d4152900 con 0x7fb9d406b4b0 2023-11-13T11:29:21.268 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:21.254+0000 7fb9d918d640 1 -- 172.21.15.102:0/4167707237 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb9d41604e0 con 0x7fb9d406b4b0 2023-11-13T11:29:21.269 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:21.258+0000 7fb9d918d640 1 -- 172.21.15.102:0/4167707237 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb9d4153230 con 0x7fb9d406b4b0 2023-11-13T11:29:21.269 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:21.258+0000 7fb9cbfff640 1 -- 172.21.15.102:0/4167707237 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fb9c400cca0 con 0x7fb9d406b4b0 2023-11-13T11:29:21.269 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:21.258+0000 7fb9cbfff640 1 --2- 172.21.15.102:0/4167707237 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7fb9b4066470 0x7fb9b4068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:21.269 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:21.258+0000 7fb9cbfff640 1 -- 172.21.15.102:0/4167707237 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb9c40843e0 con 0x7fb9d406b4b0 2023-11-13T11:29:21.270 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:21.258+0000 7fb9ca59c640 1 --2- 172.21.15.102:0/4167707237 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7fb9b4066470 0x7fb9b4068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:21.270 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:21.258+0000 7fb9ca59c640 1 --2- 172.21.15.102:0/4167707237 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7fb9b4066470 0x7fb9b4068930 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fb9bc0ae000 tx=0x7fb9bc0a7070 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-13T11:29:21.270 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:21.262+0000 7fb9cbfff640 1 -- 172.21.15.102:0/4167707237 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fb9c40517e0 con 0x7fb9d406b4b0 2023-11-13T11:29:21.417 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:21.410+0000 7fb9d918d640 1 -- 172.21.15.102:0/4167707237 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fb9d4068520 con 0x7fb9d406b4b0 2023-11-13T11:29:21.417 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:21.410+0000 7fb9cbfff640 1 -- 172.21.15.102:0/4167707237 <== mon.0 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v22) v1 ==== 100+0+11 (secure 0 0 0) 0x7fb9c4054e00 con 0x7fb9d406b4b0 2023-11-13T11:29:21.418 INFO:teuthology.orchestra.run.smithi102.stdout:pg_num: 64 2023-11-13T11:29:21.419 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:21.414+0000 7fb9d918d640 1 -- 172.21.15.102:0/4167707237 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7fb9b4066470 msgr2=0x7fb9b4068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:21.420 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:21.414+0000 7fb9d918d640 1 --2- 172.21.15.102:0/4167707237 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7fb9b4066470 0x7fb9b4068930 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fb9bc0ae000 tx=0x7fb9bc0a7070 comp rx=0 tx=0).stop 2023-11-13T11:29:21.420 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:21.414+0000 7fb9d918d640 1 -- 172.21.15.102:0/4167707237 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb9d406b4b0 msgr2=0x7fb9d409ca90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:21.420 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:21.414+0000 7fb9d918d640 1 --2- 172.21.15.102:0/4167707237 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb9d406b4b0 0x7fb9d409ca90 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fb9c400e870 tx=0x7fb9c400ec70 comp rx=0 tx=0).stop 2023-11-13T11:29:21.420 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:21.414+0000 7fb9d918d640 1 -- 172.21.15.102:0/4167707237 shutdown_connections 2023-11-13T11:29:21.421 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:21.414+0000 7fb9d918d640 1 --2- 172.21.15.102:0/4167707237 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb9d415d0c0 0x7fb9d406a780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:21.421 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:21.414+0000 7fb9d918d640 1 --2- 172.21.15.102:0/4167707237 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb9d40b02c0 0x7fb9d406a240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:21.421 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:21.414+0000 7fb9d918d640 1 --2- 172.21.15.102:0/4167707237 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7fb9b4066470 0x7fb9b4068930 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:21.421 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:21.414+0000 7fb9d918d640 1 --2- 172.21.15.102:0/4167707237 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb9d406b4b0 0x7fb9d409ca90 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:21.421 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:21.414+0000 7fb9d918d640 1 -- 172.21.15.102:0/4167707237 >> 172.21.15.102:0/4167707237 conn(0x7fb9d40709d0 msgr2=0x7fb9d40b4120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-13T11:29:21.422 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:21.414+0000 7fb9d918d640 1 -- 172.21.15.102:0/4167707237 shutdown_connections 2023-11-13T11:29:21.422 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:21.414+0000 7fb9d918d640 1 -- 172.21.15.102:0/4167707237 wait complete. 2023-11-13T11:29:21.439 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-13T11:29:21.577 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:21.570+0000 7f0ac9c79640 1 Processor -- start 2023-11-13T11:29:21.578 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:21.570+0000 7f0ac9c79640 1 -- start start 2023-11-13T11:29:21.579 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:21.570+0000 7f0ac9c79640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f0ac406e0d0 0x7f0ac40b2de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:21.579 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:21.570+0000 7f0ac9c79640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0ac406b960 0x7f0ac40adc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:21.579 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:21.570+0000 7f0ac9c79640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0ac406e4b0 con 0x7f0ac40b3320 2023-11-13T11:29:21.580 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:21.570+0000 7f0ac9c79640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0ac406c430 con 0x7f0ac406e0d0 2023-11-13T11:29:21.580 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:21.570+0000 7f0ac9c79640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ac40b37c0 con 0x7f0ac406b960 2023-11-13T11:29:21.580 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:21.570+0000 7f0ac37fe640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f0ac406e0d0 0x7f0ac40b2de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:21.580 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:21.570+0000 7f0ac3fff640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0ac406b960 0x7f0ac40adc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:21.580 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:21.570+0000 7f0ac2ffd640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f0ac40b3320 0x7f0ac406b250 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.102:53188/0 (socket says 172.21.15.102:53188) 2023-11-13T11:29:21.581 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:21.570+0000 7f0ac2ffd640 1 -- 172.21.15.102:0/1481345037 learned_addr learned my addr 172.21.15.102:0/1481345037 (peer_addr_for_me v1:172.21.15.102:0/0) 2023-11-13T11:29:21.581 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:21.570+0000 7f0ac37fe640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f0ac406e0d0 0x7f0ac40b2de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.102:36654/0 (socket says 172.21.15.102:36654) 2023-11-13T11:29:21.581 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:21.570+0000 7f0ac3fff640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0ac406b960 0x7f0ac40adc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.102:43698/0 (socket says 172.21.15.102:43698) 2023-11-13T11:29:21.581 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:21.574+0000 7f0ac37fe640 1 -- 172.21.15.102:0/1481345037 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0ac406b960 msgr2=0x7f0ac40adc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-13T11:29:21.581 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:21.574+0000 7f0ac37fe640 1 --2- 172.21.15.102:0/1481345037 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0ac406b960 0x7f0ac40adc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:21.581 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:21.574+0000 7f0ac37fe640 1 -- 172.21.15.102:0/1481345037 >> v1:172.21.15.154:6789/0 conn(0x7f0ac40b3320 legacy=0x7f0ac406b250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:21.582 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:21.574+0000 7f0ac37fe640 1 -- 172.21.15.102:0/1481345037 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ac40b3aa0 con 0x7f0ac406e0d0 2023-11-13T11:29:21.583 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:21.574+0000 7f0ac37fe640 1 --2- 172.21.15.102:0/1481345037 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0ac406e0d0 0x7f0ac40b2de0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f0ab40097c0 tx=0x7f0ab401c450 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e6d1d98f1b00cf3c server_cookie=0 in_seq=0 out_seq=0 2023-11-13T11:29:21.583 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:21.574+0000 7f0ac27fc640 1 -- 172.21.15.102:0/1481345037 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ab40ab650 con 0x7f0ac406e0d0 2023-11-13T11:29:21.583 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:21.574+0000 7f0ac27fc640 1 -- 172.21.15.102:0/1481345037 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ab40ab7b0 con 0x7f0ac406e0d0 2023-11-13T11:29:21.584 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:21.574+0000 7f0ac27fc640 1 -- 172.21.15.102:0/1481345037 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ab40abb40 con 0x7f0ac406e0d0 2023-11-13T11:29:21.584 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:21.578+0000 7f0ac9c79640 1 -- 172.21.15.102:0/1481345037 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0ac406e0d0 msgr2=0x7f0ac40b2de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:21.584 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:21.578+0000 7f0ac9c79640 1 --2- 172.21.15.102:0/1481345037 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0ac406e0d0 0x7f0ac40b2de0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f0ab40097c0 tx=0x7f0ab401c450 comp rx=0 tx=0).stop 2023-11-13T11:29:21.584 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:21.578+0000 7f0ac9c79640 1 -- 172.21.15.102:0/1481345037 shutdown_connections 2023-11-13T11:29:21.585 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:21.578+0000 7f0ac9c79640 1 --2- 172.21.15.102:0/1481345037 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0ac406b960 0x7f0ac40adc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:21.585 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:21.578+0000 7f0ac9c79640 1 --2- 172.21.15.102:0/1481345037 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0ac406e0d0 0x7f0ac40b2de0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:21.585 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:21.578+0000 7f0ac9c79640 1 -- 172.21.15.102:0/1481345037 >> 172.21.15.102:0/1481345037 conn(0x7f0ac4070590 msgr2=0x7f0ac40709a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-13T11:29:21.585 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:21.578+0000 7f0ac9c79640 1 -- 172.21.15.102:0/1481345037 shutdown_connections 2023-11-13T11:29:21.586 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:21.578+0000 7f0ac9c79640 1 -- 172.21.15.102:0/1481345037 wait complete. 2023-11-13T11:29:21.588 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:21.578+0000 7f0ac9c79640 1 Processor -- start 2023-11-13T11:29:21.589 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:21.578+0000 7f0ac9c79640 1 -- start start 2023-11-13T11:29:21.589 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:21.578+0000 7f0ac9c79640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0ac406b960 0x7f0ac4151ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:21.589 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:21.578+0000 7f0ac9c79640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0ac406e0d0 0x7f0ac414b6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:21.590 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:21.578+0000 7f0ac9c79640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0ac40b3320 0x7f0ac4149000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:21.590 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:21.578+0000 7f0ac9c79640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ac406ad80 con 0x7f0ac406e0d0 2023-11-13T11:29:21.590 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:21.578+0000 7f0ac9c79640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ac4153980 con 0x7f0ac40b3320 2023-11-13T11:29:21.590 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:21.578+0000 7f0ac9c79640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ac414bbe0 con 0x7f0ac406b960 2023-11-13T11:29:21.591 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:21.578+0000 7f0ac2ffd640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0ac406e0d0 0x7f0ac414b6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:21.591 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:21.578+0000 7f0ac2ffd640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0ac406e0d0 0x7f0ac414b6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:50506/0 (socket says 172.21.15.102:50506) 2023-11-13T11:29:21.591 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:21.578+0000 7f0ac2ffd640 1 -- 172.21.15.102:0/1039275488 learned_addr learned my addr 172.21.15.102:0/1039275488 (peer_addr_for_me v2:172.21.15.102:0/0) 2023-11-13T11:29:21.591 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:21.582+0000 7f0ac37fe640 1 --2- 172.21.15.102:0/1039275488 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0ac406b960 0x7f0ac4151ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:21.591 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:21.582+0000 7f0ac3fff640 1 --2- 172.21.15.102:0/1039275488 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0ac40b3320 0x7f0ac4149000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:21.592 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:21.582+0000 7f0ac2ffd640 1 -- 172.21.15.102:0/1039275488 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0ac406b960 msgr2=0x7f0ac4151ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:21.592 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:21.582+0000 7f0ac2ffd640 1 --2- 172.21.15.102:0/1039275488 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0ac406b960 0x7f0ac4151ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:21.592 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:21.582+0000 7f0ac2ffd640 1 -- 172.21.15.102:0/1039275488 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0ac40b3320 msgr2=0x7f0ac4149000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:21.592 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:21.582+0000 7f0ac2ffd640 1 --2- 172.21.15.102:0/1039275488 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0ac40b3320 0x7f0ac4149000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:21.592 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:21.582+0000 7f0ac2ffd640 1 -- 172.21.15.102:0/1039275488 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ab4009420 con 0x7f0ac406e0d0 2023-11-13T11:29:21.593 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:21.582+0000 7f0ac2ffd640 1 --2- 172.21.15.102:0/1039275488 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0ac406e0d0 0x7f0ac414b6a0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f0ab8001ec0 tx=0x7f0ab800c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-13T11:29:21.593 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:21.582+0000 7f0aabfff640 1 -- 172.21.15.102:0/1039275488 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ab8005cf0 con 0x7f0ac406e0d0 2023-11-13T11:29:21.593 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:21.582+0000 7f0aabfff640 1 -- 172.21.15.102:0/1039275488 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ab8005e50 con 0x7f0ac406e0d0 2023-11-13T11:29:21.593 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:21.582+0000 7f0aabfff640 1 -- 172.21.15.102:0/1039275488 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ab80072d0 con 0x7f0ac406e0d0 2023-11-13T11:29:21.593 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:21.582+0000 7f0ac9c79640 1 -- 172.21.15.102:0/1039275488 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0ac4152100 con 0x7f0ac406e0d0 2023-11-13T11:29:21.594 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:21.582+0000 7f0ac9c79640 1 -- 172.21.15.102:0/1039275488 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0ac406b240 con 0x7f0ac406e0d0 2023-11-13T11:29:21.595 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:21.582+0000 7f0ac9c79640 1 -- 172.21.15.102:0/1039275488 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0ac4153ac0 con 0x7f0ac406e0d0 2023-11-13T11:29:21.595 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:21.582+0000 7f0aabfff640 1 -- 172.21.15.102:0/1039275488 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f0ab8007430 con 0x7f0ac406e0d0 2023-11-13T11:29:21.595 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:21.582+0000 7f0aabfff640 1 --2- 172.21.15.102:0/1039275488 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f0ab0066470 0x7f0ab0068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:21.595 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:21.582+0000 7f0aabfff640 1 -- 172.21.15.102:0/1039275488 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f0ab8083110 con 0x7f0ac406e0d0 2023-11-13T11:29:21.596 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:21.582+0000 7f0ac37fe640 1 --2- 172.21.15.102:0/1039275488 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f0ab0066470 0x7f0ab0068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:21.596 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:21.586+0000 7f0ac37fe640 1 --2- 172.21.15.102:0/1039275488 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f0ab0066470 0x7f0ab0068930 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f0ab40af000 tx=0x7f0ab40a7000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-13T11:29:21.596 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:21.586+0000 7f0aabfff640 1 -- 172.21.15.102:0/1039275488 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f0ac4153ac0 con 0x7f0ac406e0d0 2023-11-13T11:29:21.759 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:21.754+0000 7f0ac9c79640 1 -- 172.21.15.102:0/1039275488 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0ac406e4b0 con 0x7f0ac406e0d0 2023-11-13T11:29:21.760 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:21.754+0000 7f0aabfff640 1 -- 172.21.15.102:0/1039275488 <== mon.0 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+16545 (secure 0 0 0) 0x7f0ac406e4b0 con 0x7f0ac406e0d0 2023-11-13T11:29:21.761 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T11:29:21.761 INFO:teuthology.orchestra.run.smithi102.stdout:{"epoch":22,"fsid":"97b3eb2b-7ccf-4aae-8d92-bff986c671ea","created":"2023-11-13T11:28:31.836724+0000","modified":"2023-11-13T11:28:58.608314+0000","last_up_change":"2023-11-13T11:28:44.876638+0000","last_in_change":"2023-11-13T11:28:35.312740+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-13T11:28:44.981356+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-13T11:28:55.958525+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-13T11:28:56.394264+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"bdefaa17-fcca-4c86-aa40-27dc33a789af","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6800","nonce":53303834},{"type":"v1","addr":"172.21.15.102:6801","nonce":53303834}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6802","nonce":53303834},{"type":"v1","addr":"172.21.15.102:6803","nonce":53303834}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6806","nonce":53303834},{"type":"v1","addr":"172.21.15.102:6807","nonce":53303834}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6804","nonce":53303834},{"type":"v1","addr":"172.21.15.102:6805","nonce":53303834}]},"public_addr":"172.21.15.102:6801/53303834","cluster_addr":"172.21.15.102:6803/53303834","heartbeat_back_addr":"172.21.15.102:6807/53303834","heartbeat_front_addr":"172.21.15.102:6805/53303834","state":["exists","up"]},{"osd":1,"uuid":"f0033196-dec9-4ae9-945e-6aeef6dbb47f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6808","nonce":1732708348},{"type":"v1","addr":"172.21.15.102:6809","nonce":1732708348}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6811","nonce":1732708348},{"type":"v1","addr":"172.21.15.102:6813","nonce":1732708348}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6818","nonce":1732708348},{"type":"v1","addr":"172.21.15.102:6820","nonce":1732708348}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6815","nonce":1732708348},{"type":"v1","addr":"172.21.15.102:6817","nonce":1732708348}]},"public_addr":"172.21.15.102:6809/1732708348","cluster_addr":"172.21.15.102:6813/1732708348","heartbeat_back_addr":"172.21.15.102:6820/1732708348","heartbeat_front_addr":"172.21.15.102:6817/1732708348","state":["exists","up"]},{"osd":2,"uuid":"496b0834-351e-4ec2-a714-86ed0c0ff4fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6810","nonce":1825475150},{"type":"v1","addr":"172.21.15.102:6812","nonce":1825475150}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6814","nonce":1825475150},{"type":"v1","addr":"172.21.15.102:6816","nonce":1825475150}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6822","nonce":1825475150},{"type":"v1","addr":"172.21.15.102:6823","nonce":1825475150}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6819","nonce":1825475150},{"type":"v1","addr":"172.21.15.102:6821","nonce":1825475150}]},"public_addr":"172.21.15.102:6812/1825475150","cluster_addr":"172.21.15.102:6816/1825475150","heartbeat_back_addr":"172.21.15.102:6823/1825475150","heartbeat_front_addr":"172.21.15.102:6821/1825475150","state":["exists","up"]},{"osd":3,"uuid":"3ba6cc41-e0a0-4273-86cb-90000c06a55a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6824","nonce":4149355528},{"type":"v1","addr":"172.21.15.102:6825","nonce":4149355528}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6826","nonce":4149355528},{"type":"v1","addr":"172.21.15.102:6827","nonce":4149355528}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6830","nonce":4149355528},{"type":"v1","addr":"172.21.15.102:6831","nonce":4149355528}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6828","nonce":4149355528},{"type":"v1","addr":"172.21.15.102:6829","nonce":4149355528}]},"public_addr":"172.21.15.102:6825/4149355528","cluster_addr":"172.21.15.102:6827/4149355528","heartbeat_back_addr":"172.21.15.102:6831/4149355528","heartbeat_front_addr":"172.21.15.102:6829/4149355528","state":["exists","up"]},{"osd":4,"uuid":"16e797d8-e6e7-4140-95c3-b85283c42a2a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6808","nonce":4028899241},{"type":"v1","addr":"172.21.15.154:6809","nonce":4028899241}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6810","nonce":4028899241},{"type":"v1","addr":"172.21.15.154:6811","nonce":4028899241}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6814","nonce":4028899241},{"type":"v1","addr":"172.21.15.154:6815","nonce":4028899241}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6812","nonce":4028899241},{"type":"v1","addr":"172.21.15.154:6813","nonce":4028899241}]},"public_addr":"172.21.15.154:6809/4028899241","cluster_addr":"172.21.15.154:6811/4028899241","heartbeat_back_addr":"172.21.15.154:6815/4028899241","heartbeat_front_addr":"172.21.15.154:6813/4028899241","state":["exists","up"]},{"osd":5,"uuid":"d6ab225c-1b55-450a-89a9-abe5c3f8d6af","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":3562396827},{"type":"v1","addr":"172.21.15.154:6801","nonce":3562396827}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":3562396827},{"type":"v1","addr":"172.21.15.154:6803","nonce":3562396827}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6806","nonce":3562396827},{"type":"v1","addr":"172.21.15.154:6807","nonce":3562396827}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6804","nonce":3562396827},{"type":"v1","addr":"172.21.15.154:6805","nonce":3562396827}]},"public_addr":"172.21.15.154:6801/3562396827","cluster_addr":"172.21.15.154:6803/3562396827","heartbeat_back_addr":"172.21.15.154:6807/3562396827","heartbeat_front_addr":"172.21.15.154:6805/3562396827","state":["exists","up"]},{"osd":6,"uuid":"96f905ac-491c-4662-8e2b-5bb8e929ab9d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6816","nonce":2933728751},{"type":"v1","addr":"172.21.15.154:6817","nonce":2933728751}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6818","nonce":2933728751},{"type":"v1","addr":"172.21.15.154:6819","nonce":2933728751}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6822","nonce":2933728751},{"type":"v1","addr":"172.21.15.154:6823","nonce":2933728751}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6820","nonce":2933728751},{"type":"v1","addr":"172.21.15.154:6821","nonce":2933728751}]},"public_addr":"172.21.15.154:6817/2933728751","cluster_addr":"172.21.15.154:6819/2933728751","heartbeat_back_addr":"172.21.15.154:6823/2933728751","heartbeat_front_addr":"172.21.15.154:6821/2933728751","state":["exists","up"]},{"osd":7,"uuid":"07012d3b-3ab4-40df-a471-93caed22e2dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6824","nonce":1753500785},{"type":"v1","addr":"172.21.15.154:6825","nonce":1753500785}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6826","nonce":1753500785},{"type":"v1","addr":"172.21.15.154:6827","nonce":1753500785}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6830","nonce":1753500785},{"type":"v1","addr":"172.21.15.154:6831","nonce":1753500785}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6828","nonce":1753500785},{"type":"v1","addr":"172.21.15.154:6829","nonce":1753500785}]},"public_addr":"172.21.15.154:6825/1753500785","cluster_addr":"172.21.15.154:6827/1753500785","heartbeat_back_addr":"172.21.15.154:6831/1753500785","heartbeat_front_addr":"172.21.15.154:6829/1753500785","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-13T11:28:40.978603+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-13T11:28:41.200985+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-13T11:28:41.222815+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-13T11:28:41.202162+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-13T11:28:40.925911+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-13T11:28:41.087725+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-13T11:28:41.072208+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-13T11:28:40.875257+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-13T11:29:21.762 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:21.754+0000 7f0ac9c79640 1 -- 172.21.15.102:0/1039275488 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f0ab0066470 msgr2=0x7f0ab0068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:21.763 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:21.754+0000 7f0ac9c79640 1 --2- 172.21.15.102:0/1039275488 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f0ab0066470 0x7f0ab0068930 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f0ab40af000 tx=0x7f0ab40a7000 comp rx=0 tx=0).stop 2023-11-13T11:29:21.763 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:21.754+0000 7f0ac9c79640 1 -- 172.21.15.102:0/1039275488 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0ac406e0d0 msgr2=0x7f0ac414b6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:21.763 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:21.754+0000 7f0ac9c79640 1 --2- 172.21.15.102:0/1039275488 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0ac406e0d0 0x7f0ac414b6a0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f0ab8001ec0 tx=0x7f0ab800c890 comp rx=0 tx=0).stop 2023-11-13T11:29:21.763 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:21.754+0000 7f0ac9c79640 1 -- 172.21.15.102:0/1039275488 shutdown_connections 2023-11-13T11:29:21.763 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:21.754+0000 7f0ac9c79640 1 --2- 172.21.15.102:0/1039275488 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0ac40b3320 0x7f0ac4149000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:21.764 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:21.754+0000 7f0ac9c79640 1 --2- 172.21.15.102:0/1039275488 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f0ab0066470 0x7f0ab0068930 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:21.764 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:21.754+0000 7f0ac9c79640 1 --2- 172.21.15.102:0/1039275488 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0ac406e0d0 0x7f0ac414b6a0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:21.764 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:21.754+0000 7f0ac9c79640 1 --2- 172.21.15.102:0/1039275488 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0ac406b960 0x7f0ac4151ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:21.764 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:21.754+0000 7f0ac9c79640 1 -- 172.21.15.102:0/1039275488 >> 172.21.15.102:0/1039275488 conn(0x7f0ac4070590 msgr2=0x7f0ac415ed00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-13T11:29:21.764 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:21.758+0000 7f0ac9c79640 1 -- 172.21.15.102:0/1039275488 shutdown_connections 2023-11-13T11:29:21.765 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:21.758+0000 7f0ac9c79640 1 -- 172.21.15.102:0/1039275488 wait complete. 2023-11-13T11:29:21.782 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-13T11:28:44.981356+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-13T11:28:55.958525+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-11-13T11:28:56.394264+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-13T11:29:21.783 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-13T11:29:21.924 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:21.918+0000 7f1306b65640 1 Processor -- start 2023-11-13T11:29:21.925 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:21.918+0000 7f1306b65640 1 -- start start 2023-11-13T11:29:21.926 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:21.918+0000 7f1306b65640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f13000c7620 0x7f130006e7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:21.926 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:21.918+0000 7f1306b65640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f13000d0000 0x7f13000cbfd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:21.926 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:21.918+0000 7f1306b65640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f13000d0430 con 0x7f130006ed10 2023-11-13T11:29:21.926 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:21.918+0000 7f1306b65640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f130006f1a0 con 0x7f13000c7620 2023-11-13T11:29:21.927 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:21.918+0000 7f1306b65640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f13000cbb40 con 0x7f13000d0000 2023-11-13T11:29:21.927 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:21.918+0000 7f12f7fff640 1 --1- >> v1:172.21.15.102:6789/0 conn(0x7f130006ed10 0x7f13000cf8f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.102:6789/0 says I am v1:172.21.15.102:36710/0 (socket says 172.21.15.102:36710) 2023-11-13T11:29:21.927 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:21.918+0000 7f1304901640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f13000c7620 0x7f130006e7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:21.927 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:21.918+0000 7f12f7fff640 1 -- 172.21.15.102:0/2008946549 learned_addr learned my addr 172.21.15.102:0/2008946549 (peer_addr_for_me v1:172.21.15.102:0/0) 2023-11-13T11:29:21.927 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:21.918+0000 7f1305102640 1 --2- 172.21.15.102:0/2008946549 >> v2:172.21.15.154:3300/0 conn(0x7f13000d0000 0x7f13000cbfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:21.928 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:21.918+0000 7f12f77fe640 1 -- 172.21.15.102:0/2008946549 <== mon.0 v1:172.21.15.102:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3580109237 0 0) 0x7f12f0001120 con 0x7f130006ed10 2023-11-13T11:29:21.928 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:21.918+0000 7f1304901640 1 -- 172.21.15.102:0/2008946549 >> v2:172.21.15.154:3300/0 conn(0x7f13000d0000 msgr2=0x7f13000cbfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-13T11:29:21.929 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:21.918+0000 7f1304901640 1 --2- 172.21.15.102:0/2008946549 >> v2:172.21.15.154:3300/0 conn(0x7f13000d0000 0x7f13000cbfd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:21.929 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:21.918+0000 7f1304901640 1 -- 172.21.15.102:0/2008946549 >> v1:172.21.15.102:6789/0 conn(0x7f130006ed10 legacy=0x7f13000cf8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:21.929 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:21.922+0000 7f1304901640 1 -- 172.21.15.102:0/2008946549 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13000d0670 con 0x7f13000c7620 2023-11-13T11:29:21.930 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:21.922+0000 7f1304901640 1 --2- 172.21.15.102:0/2008946549 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f13000c7620 0x7f130006e7d0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f1300070d20 tx=0x7f12fc01c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5552b8ea7e8ad167 server_cookie=0 in_seq=0 out_seq=0 2023-11-13T11:29:21.930 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:21.922+0000 7f12f77fe640 1 -- 172.21.15.102:0/2008946549 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12fc0ac600 con 0x7f13000c7620 2023-11-13T11:29:21.931 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:21.922+0000 7f12f77fe640 1 -- 172.21.15.102:0/2008946549 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f12fc0a8050 con 0x7f13000c7620 2023-11-13T11:29:21.931 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:21.922+0000 7f12f77fe640 1 -- 172.21.15.102:0/2008946549 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12fc0ac980 con 0x7f13000c7620 2023-11-13T11:29:21.931 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:21.922+0000 7f1306b65640 1 -- 172.21.15.102:0/2008946549 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f13000c7620 msgr2=0x7f130006e7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:21.931 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:21.922+0000 7f1306b65640 1 --2- 172.21.15.102:0/2008946549 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f13000c7620 0x7f130006e7d0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f1300070d20 tx=0x7f12fc01c3a0 comp rx=0 tx=0).stop 2023-11-13T11:29:21.931 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:21.922+0000 7f1306b65640 1 -- 172.21.15.102:0/2008946549 shutdown_connections 2023-11-13T11:29:21.932 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:21.922+0000 7f1306b65640 1 --2- 172.21.15.102:0/2008946549 >> v2:172.21.15.154:3300/0 conn(0x7f13000d0000 0x7f13000cbfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:21.932 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:21.922+0000 7f1306b65640 1 --2- 172.21.15.102:0/2008946549 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f13000c7620 0x7f130006e7d0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:21.932 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:21.922+0000 7f1306b65640 1 -- 172.21.15.102:0/2008946549 >> 172.21.15.102:0/2008946549 conn(0x7f13000b27d0 msgr2=0x7f13000b2bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-13T11:29:21.932 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:21.922+0000 7f1306b65640 1 -- 172.21.15.102:0/2008946549 shutdown_connections 2023-11-13T11:29:21.932 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:21.922+0000 7f1306b65640 1 -- 172.21.15.102:0/2008946549 wait complete. 2023-11-13T11:29:21.934 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:21.926+0000 7f1306b65640 1 Processor -- start 2023-11-13T11:29:21.935 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:21.926+0000 7f1306b65640 1 -- start start 2023-11-13T11:29:21.935 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:21.926+0000 7f1306b65640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f130006ed10 0x7f130014a6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:21.935 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:21.926+0000 7f1306b65640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f13000c7620 0x7f130006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:21.935 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:21.926+0000 7f1306b65640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f13000d0000 0x7f130015a590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:21.936 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:21.926+0000 7f1306b65640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f130014ac10 con 0x7f130006ed10 2023-11-13T11:29:21.936 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:21.926+0000 7f1306b65640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f130006d260 con 0x7f13000c7620 2023-11-13T11:29:21.936 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:21.926+0000 7f1306b65640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1300159ab0 con 0x7f13000d0000 2023-11-13T11:29:21.936 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:21.926+0000 7f1304901640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f130006ed10 0x7f130014a6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:21.936 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:21.926+0000 7f1304901640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f130006ed10 0x7f130014a6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:50512/0 (socket says 172.21.15.102:50512) 2023-11-13T11:29:21.937 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:21.926+0000 7f1304901640 1 -- 172.21.15.102:0/4120021392 learned_addr learned my addr 172.21.15.102:0/4120021392 (peer_addr_for_me v2:172.21.15.102:0/0) 2023-11-13T11:29:21.937 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:21.926+0000 7f1305102640 1 --2- 172.21.15.102:0/4120021392 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f13000d0000 0x7f130015a590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:21.937 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:21.926+0000 7f1304901640 1 -- 172.21.15.102:0/4120021392 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f13000d0000 msgr2=0x7f130015a590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:21.937 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:21.926+0000 7f12f7fff640 1 --2- 172.21.15.102:0/4120021392 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f13000c7620 0x7f130006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:21.938 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:21.926+0000 7f1304901640 1 --2- 172.21.15.102:0/4120021392 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f13000d0000 0x7f130015a590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:21.938 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:21.926+0000 7f1304901640 1 -- 172.21.15.102:0/4120021392 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f13000c7620 msgr2=0x7f130006c8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:21.938 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:21.926+0000 7f1304901640 1 --2- 172.21.15.102:0/4120021392 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f13000c7620 0x7f130006c8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:21.938 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:21.926+0000 7f1304901640 1 -- 172.21.15.102:0/4120021392 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12fc009420 con 0x7f130006ed10 2023-11-13T11:29:21.939 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:21.926+0000 7f1305102640 1 --2- 172.21.15.102:0/4120021392 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f13000d0000 0x7f130015a590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-13T11:29:21.939 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:21.926+0000 7f12f7fff640 1 --2- 172.21.15.102:0/4120021392 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f13000c7620 0x7f130006c8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-13T11:29:21.939 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:21.926+0000 7f1304901640 1 --2- 172.21.15.102:0/4120021392 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f130006ed10 0x7f130014a6d0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f12fc019fd0 tx=0x7f12fc01abe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-13T11:29:21.940 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:21.926+0000 7f12f57fa640 1 -- 172.21.15.102:0/4120021392 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12fc0b7650 con 0x7f130006ed10 2023-11-13T11:29:21.940 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:21.926+0000 7f12f57fa640 1 -- 172.21.15.102:0/4120021392 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f12fc0b77d0 con 0x7f130006ed10 2023-11-13T11:29:21.940 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:21.926+0000 7f12f57fa640 1 -- 172.21.15.102:0/4120021392 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12fc0b7b80 con 0x7f130006ed10 2023-11-13T11:29:21.940 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:21.926+0000 7f1306b65640 1 -- 172.21.15.102:0/4120021392 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1300159d90 con 0x7f130006ed10 2023-11-13T11:29:21.941 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:21.926+0000 7f1306b65640 1 -- 172.21.15.102:0/4120021392 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f13001596f0 con 0x7f130006ed10 2023-11-13T11:29:21.942 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:21.930+0000 7f1306b65640 1 -- 172.21.15.102:0/4120021392 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f13001598e0 con 0x7f130006ed10 2023-11-13T11:29:21.942 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:21.930+0000 7f12f57fa640 1 -- 172.21.15.102:0/4120021392 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f12fc0b3070 con 0x7f130006ed10 2023-11-13T11:29:21.942 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:21.930+0000 7f12f57fa640 1 --2- 172.21.15.102:0/4120021392 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f12ec066470 0x7f12ec068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:21.942 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:21.930+0000 7f12f57fa640 1 -- 172.21.15.102:0/4120021392 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f12fc11e6c0 con 0x7f130006ed10 2023-11-13T11:29:21.943 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:21.930+0000 7f12f7fff640 1 --2- 172.21.15.102:0/4120021392 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f12ec066470 0x7f12ec068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:21.943 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:21.930+0000 7f12f7fff640 1 --2- 172.21.15.102:0/4120021392 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f12ec066470 0x7f12ec068930 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f12f0007fd0 tx=0x7f12f0009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-13T11:29:21.943 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:21.934+0000 7f12f57fa640 1 -- 172.21.15.102:0/4120021392 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f12fc0eba90 con 0x7f130006ed10 2023-11-13T11:29:22.092 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:22.086+0000 7f1306b65640 1 -- 172.21.15.102:0/4120021392 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f1300068520 con 0x7f130006ed10 2023-11-13T11:29:22.092 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:22.086+0000 7f12f57fa640 1 -- 172.21.15.102:0/4120021392 <== mon.0 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v22) v1 ==== 93+0+10 (secure 0 0 0) 0x7f12fc0ef0b0 con 0x7f130006ed10 2023-11-13T11:29:22.092 INFO:teuthology.orchestra.run.smithi102.stdout:pg_num: 1 2023-11-13T11:29:22.094 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:22.086+0000 7f1306b65640 1 -- 172.21.15.102:0/4120021392 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f12ec066470 msgr2=0x7f12ec068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:22.094 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:22.086+0000 7f1306b65640 1 --2- 172.21.15.102:0/4120021392 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f12ec066470 0x7f12ec068930 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f12f0007fd0 tx=0x7f12f0009040 comp rx=0 tx=0).stop 2023-11-13T11:29:22.094 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:22.086+0000 7f1306b65640 1 -- 172.21.15.102:0/4120021392 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f130006ed10 msgr2=0x7f130014a6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:22.095 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:22.086+0000 7f1306b65640 1 --2- 172.21.15.102:0/4120021392 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f130006ed10 0x7f130014a6d0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f12fc019fd0 tx=0x7f12fc01abe0 comp rx=0 tx=0).stop 2023-11-13T11:29:22.095 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:22.086+0000 7f1306b65640 1 -- 172.21.15.102:0/4120021392 shutdown_connections 2023-11-13T11:29:22.095 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:22.086+0000 7f1306b65640 1 --2- 172.21.15.102:0/4120021392 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f13000d0000 0x7f130015a590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:22.095 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:22.086+0000 7f1306b65640 1 --2- 172.21.15.102:0/4120021392 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f13000c7620 0x7f130006c8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:22.095 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:22.086+0000 7f1306b65640 1 --2- 172.21.15.102:0/4120021392 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f12ec066470 0x7f12ec068930 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:22.096 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:22.086+0000 7f1306b65640 1 --2- 172.21.15.102:0/4120021392 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f130006ed10 0x7f130014a6d0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:22.096 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:22.086+0000 7f1306b65640 1 -- 172.21.15.102:0/4120021392 >> 172.21.15.102:0/4120021392 conn(0x7f13000b27d0 msgr2=0x7f13000cdf80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-13T11:29:22.096 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:22.086+0000 7f1306b65640 1 -- 172.21.15.102:0/4120021392 shutdown_connections 2023-11-13T11:29:22.096 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:22.086+0000 7f1306b65640 1 -- 172.21.15.102:0/4120021392 wait complete. 2023-11-13T11:29:22.114 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-13T11:29:22.255 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:22.250+0000 7f7989405640 1 Processor -- start 2023-11-13T11:29:22.256 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:22.250+0000 7f7989405640 1 -- start start 2023-11-13T11:29:22.257 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:22.250+0000 7f7989405640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f798415d220 0x7f79840d3910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:22.257 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:22.250+0000 7f7989405640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f798415d600 0x7f79840b2750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:22.257 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:22.250+0000 7f7989405640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f79840b3f60 0x7f79840b2c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:22.258 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:22.250+0000 7f7989405640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f79840b3840 con 0x7f798415d600 2023-11-13T11:29:22.258 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:22.250+0000 7f7989405640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f79840cecb0 con 0x7f798415d220 2023-11-13T11:29:22.258 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:22.250+0000 7f7989405640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79840d0d00 con 0x7f79840b3f60 2023-11-13T11:29:22.258 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:22.250+0000 7f797a7fc640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f798415d600 0x7f79840b2750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:22.258 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:22.250+0000 7f797a7fc640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f798415d600 0x7f79840b2750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:50526/0 (socket says 172.21.15.102:50526) 2023-11-13T11:29:22.259 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:22.250+0000 7f797a7fc640 1 -- 172.21.15.102:0/3618234368 learned_addr learned my addr 172.21.15.102:0/3618234368 (peer_addr_for_me v2:172.21.15.102:0/0) 2023-11-13T11:29:22.259 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:22.250+0000 7f79837fe640 1 --2- 172.21.15.102:0/3618234368 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f79840b3f60 0x7f79840b2c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:22.259 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:22.250+0000 7f7982ffd640 1 --2- 172.21.15.102:0/3618234368 >> v2:172.21.15.154:3300/0 conn(0x7f798415d220 0x7f79840d3910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:22.259 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:22.250+0000 7f797a7fc640 1 -- 172.21.15.102:0/3618234368 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f79840b3f60 msgr2=0x7f79840b2c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-13T11:29:22.259 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:22.250+0000 7f797a7fc640 1 --2- 172.21.15.102:0/3618234368 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f79840b3f60 0x7f79840b2c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:22.260 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:22.250+0000 7f797a7fc640 1 -- 172.21.15.102:0/3618234368 >> v2:172.21.15.154:3300/0 conn(0x7f798415d220 msgr2=0x7f79840d3910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-13T11:29:22.260 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:22.250+0000 7f797a7fc640 1 --2- 172.21.15.102:0/3618234368 >> v2:172.21.15.154:3300/0 conn(0x7f798415d220 0x7f79840d3910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:22.260 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:22.250+0000 7f797a7fc640 1 -- 172.21.15.102:0/3618234368 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79840d0fe0 con 0x7f798415d600 2023-11-13T11:29:22.260 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:22.250+0000 7f7982ffd640 1 --2- 172.21.15.102:0/3618234368 >> v2:172.21.15.154:3300/0 conn(0x7f798415d220 0x7f79840d3910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-13T11:29:22.261 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:22.254+0000 7f797a7fc640 1 --2- 172.21.15.102:0/3618234368 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f798415d600 0x7f79840b2750 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f798408afe0 tx=0x7f796c01c3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5fa7c8f002548fbd server_cookie=0 in_seq=0 out_seq=0 2023-11-13T11:29:22.262 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:22.254+0000 7f79827fc640 1 -- 172.21.15.102:0/3618234368 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f796c0ab600 con 0x7f798415d600 2023-11-13T11:29:22.262 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:22.254+0000 7f79827fc640 1 -- 172.21.15.102:0/3618234368 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f796c0a7050 con 0x7f798415d600 2023-11-13T11:29:22.262 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:22.254+0000 7f79827fc640 1 -- 172.21.15.102:0/3618234368 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f796c0ab980 con 0x7f798415d600 2023-11-13T11:29:22.262 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:22.254+0000 7f7989405640 1 -- 172.21.15.102:0/3618234368 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f798415d600 msgr2=0x7f79840b2750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:22.263 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:22.254+0000 7f7989405640 1 --2- 172.21.15.102:0/3618234368 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f798415d600 0x7f79840b2750 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f798408afe0 tx=0x7f796c01c3b0 comp rx=0 tx=0).stop 2023-11-13T11:29:22.263 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:22.254+0000 7f7989405640 1 -- 172.21.15.102:0/3618234368 shutdown_connections 2023-11-13T11:29:22.263 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:22.254+0000 7f7989405640 1 --2- 172.21.15.102:0/3618234368 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f79840b3f60 0x7f79840b2c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:22.263 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:22.254+0000 7f7989405640 1 --2- 172.21.15.102:0/3618234368 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f798415d600 0x7f79840b2750 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:22.263 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:22.254+0000 7f7989405640 1 --2- 172.21.15.102:0/3618234368 >> v2:172.21.15.154:3300/0 conn(0x7f798415d220 0x7f79840d3910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:22.264 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:22.254+0000 7f7989405640 1 -- 172.21.15.102:0/3618234368 >> 172.21.15.102:0/3618234368 conn(0x7f79840d2df0 msgr2=0x7f79840d3200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-13T11:29:22.264 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:22.254+0000 7f7989405640 1 -- 172.21.15.102:0/3618234368 shutdown_connections 2023-11-13T11:29:22.264 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:22.254+0000 7f7989405640 1 -- 172.21.15.102:0/3618234368 wait complete. 2023-11-13T11:29:22.266 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:22.258+0000 7f7989405640 1 Processor -- start 2023-11-13T11:29:22.266 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:22.258+0000 7f7989405640 1 -- start start 2023-11-13T11:29:22.266 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:22.258+0000 7f7989405640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f79840b3f60 0x7f7984152860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:22.266 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:22.258+0000 7f7989405640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f798415d220 0x7f798414e5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:22.267 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:22.258+0000 7f7989405640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f798415d600 0x7f798414ee50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:22.267 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:22.258+0000 7f7989405640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7984152da0 con 0x7f798415d600 2023-11-13T11:29:22.267 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:22.258+0000 7f7989405640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f798415a3b0 con 0x7f798415d220 2023-11-13T11:29:22.267 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:22.258+0000 7f7989405640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7984159980 con 0x7f79840b3f60 2023-11-13T11:29:22.267 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:22.258+0000 7f79837fe640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f798415d600 0x7f798414ee50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:22.268 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:22.258+0000 7f79837fe640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f798415d600 0x7f798414ee50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:50538/0 (socket says 172.21.15.102:50538) 2023-11-13T11:29:22.268 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:22.258+0000 7f79837fe640 1 -- 172.21.15.102:0/334833951 learned_addr learned my addr 172.21.15.102:0/334833951 (peer_addr_for_me v2:172.21.15.102:0/0) 2023-11-13T11:29:22.268 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:22.258+0000 7f797a7fc640 1 --2- 172.21.15.102:0/334833951 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f798415d220 0x7f798414e5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:22.268 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:22.258+0000 7f7982ffd640 1 --2- 172.21.15.102:0/334833951 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f79840b3f60 0x7f7984152860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:22.268 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:22.258+0000 7f79837fe640 1 -- 172.21.15.102:0/334833951 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f79840b3f60 msgr2=0x7f7984152860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:22.269 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:22.258+0000 7f79837fe640 1 --2- 172.21.15.102:0/334833951 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f79840b3f60 0x7f7984152860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:22.269 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:22.258+0000 7f79837fe640 1 -- 172.21.15.102:0/334833951 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f798415d220 msgr2=0x7f798414e5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:22.269 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:22.258+0000 7f79837fe640 1 --2- 172.21.15.102:0/334833951 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f798415d220 0x7f798414e5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:22.269 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:22.258+0000 7f79837fe640 1 -- 172.21.15.102:0/334833951 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f796c0094d0 con 0x7f798415d600 2023-11-13T11:29:22.269 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:22.258+0000 7f79837fe640 1 --2- 172.21.15.102:0/334833951 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f798415d600 0x7f798414ee50 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f797c00ef00 tx=0x7f797c00b480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-13T11:29:22.269 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:22.258+0000 7f797bfff640 1 -- 172.21.15.102:0/334833951 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f797c010040 con 0x7f798415d600 2023-11-13T11:29:22.270 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:22.258+0000 7f797bfff640 1 -- 172.21.15.102:0/334833951 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f797c014400 con 0x7f798415d600 2023-11-13T11:29:22.270 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:22.258+0000 7f7989405640 1 -- 172.21.15.102:0/334833951 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7984159c60 con 0x7f798415d600 2023-11-13T11:29:22.270 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:22.258+0000 7f797bfff640 1 -- 172.21.15.102:0/334833951 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f797c009ea0 con 0x7f798415d600 2023-11-13T11:29:22.270 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:22.258+0000 7f7989405640 1 -- 172.21.15.102:0/334833951 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f798415a8e0 con 0x7f798415d600 2023-11-13T11:29:22.271 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:22.258+0000 7f7989405640 1 -- 172.21.15.102:0/334833951 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f798415aad0 con 0x7f798415d600 2023-11-13T11:29:22.271 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:22.262+0000 7f797bfff640 1 -- 172.21.15.102:0/334833951 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f797c0147b0 con 0x7f798415d600 2023-11-13T11:29:22.272 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:22.262+0000 7f797bfff640 1 --2- 172.21.15.102:0/334833951 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f7964066470 0x7f7964068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:22.272 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:22.262+0000 7f797bfff640 1 -- 172.21.15.102:0/334833951 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f797c0843a0 con 0x7f798415d600 2023-11-13T11:29:22.272 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:22.262+0000 7f7982ffd640 1 --2- 172.21.15.102:0/334833951 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f7964066470 0x7f7964068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:22.272 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:22.262+0000 7f7982ffd640 1 --2- 172.21.15.102:0/334833951 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f7964066470 0x7f7964068930 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f7974009950 tx=0x7f7974008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-13T11:29:22.273 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:22.266+0000 7f797bfff640 1 -- 172.21.15.102:0/334833951 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f797c051960 con 0x7f798415d600 2023-11-13T11:29:22.422 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:22.414+0000 7f7989405640 1 -- 172.21.15.102:0/334833951 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f7984068520 con 0x7f798415d600 2023-11-13T11:29:22.423 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:22.418+0000 7f797bfff640 1 -- 172.21.15.102:0/334833951 <== mon.0 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v22) v1 ==== 104+0+11 (secure 0 0 0) 0x7f797c054f80 con 0x7f798415d600 2023-11-13T11:29:22.423 INFO:teuthology.orchestra.run.smithi102.stdout:pg_num: 32 2023-11-13T11:29:22.425 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:22.418+0000 7f7989405640 1 -- 172.21.15.102:0/334833951 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f7964066470 msgr2=0x7f7964068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:22.425 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:22.418+0000 7f7989405640 1 --2- 172.21.15.102:0/334833951 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f7964066470 0x7f7964068930 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f7974009950 tx=0x7f7974008040 comp rx=0 tx=0).stop 2023-11-13T11:29:22.425 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:22.418+0000 7f7989405640 1 -- 172.21.15.102:0/334833951 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f798415d600 msgr2=0x7f798414ee50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:22.425 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:22.418+0000 7f7989405640 1 --2- 172.21.15.102:0/334833951 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f798415d600 0x7f798414ee50 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f797c00ef00 tx=0x7f797c00b480 comp rx=0 tx=0).stop 2023-11-13T11:29:22.426 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:22.418+0000 7f7989405640 1 -- 172.21.15.102:0/334833951 shutdown_connections 2023-11-13T11:29:22.426 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:22.418+0000 7f7989405640 1 --2- 172.21.15.102:0/334833951 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f7964066470 0x7f7964068930 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:22.426 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:22.418+0000 7f7989405640 1 --2- 172.21.15.102:0/334833951 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f798415d600 0x7f798414ee50 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:22.426 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:22.418+0000 7f7989405640 1 --2- 172.21.15.102:0/334833951 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f798415d220 0x7f798414e5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:22.426 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:22.418+0000 7f7989405640 1 --2- 172.21.15.102:0/334833951 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f79840b3f60 0x7f7984152860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:22.427 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:22.418+0000 7f7989405640 1 -- 172.21.15.102:0/334833951 >> 172.21.15.102:0/334833951 conn(0x7f79840d2df0 msgr2=0x7f79840d3750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-13T11:29:22.427 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:22.418+0000 7f7989405640 1 -- 172.21.15.102:0/334833951 shutdown_connections 2023-11-13T11:29:22.427 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:22.418+0000 7f7989405640 1 -- 172.21.15.102:0/334833951 wait complete. 2023-11-13T11:29:22.444 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-13T11:29:22.583 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:22.578+0000 7f6db4609640 1 Processor -- start 2023-11-13T11:29:22.584 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:22.578+0000 7f6db4609640 1 -- start start 2023-11-13T11:29:22.585 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:22.578+0000 7f6db4609640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f6dac1553c0 0x7f6dac0cebc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:22.585 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:22.578+0000 7f6db4609640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6dac15bed0 con 0x7f6dac06c800 2023-11-13T11:29:22.585 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:22.578+0000 7f6db4609640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6dac15c150 con 0x7f6dac15bac0 2023-11-13T11:29:22.585 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:22.578+0000 7f6db4609640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6dac06c3e0 con 0x7f6dac1553c0 2023-11-13T11:29:22.586 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:22.578+0000 7f6db23a5640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f6dac1553c0 0x7f6dac0cebc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:22.586 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:22.578+0000 7f6db1ba4640 1 --1- >> v1:172.21.15.102:6789/0 conn(0x7f6dac06c800 0x7f6dac15b3b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.102:6789/0 says I am v1:172.21.15.102:36724/0 (socket says 172.21.15.102:36724) 2023-11-13T11:29:22.586 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:22.578+0000 7f6db1ba4640 1 -- 172.21.15.102:0/1082186556 learned_addr learned my addr 172.21.15.102:0/1082186556 (peer_addr_for_me v1:172.21.15.102:0/0) 2023-11-13T11:29:22.587 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:22.578+0000 7f6db23a5640 1 -- 172.21.15.102:0/1082186556 >> v1:172.21.15.154:6789/0 conn(0x7f6dac15bac0 legacy=0x7f6dac06fc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:22.587 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:22.578+0000 7f6db23a5640 1 -- 172.21.15.102:0/1082186556 >> v1:172.21.15.102:6789/0 conn(0x7f6dac06c800 legacy=0x7f6dac15b3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:22.587 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:22.578+0000 7f6db23a5640 1 -- 172.21.15.102:0/1082186556 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6dac06bd20 con 0x7f6dac1553c0 2023-11-13T11:29:22.588 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:22.578+0000 7f6db13a3640 1 -- 172.21.15.102:0/1082186556 <== mon.0 v1:172.21.15.102:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4146775033 0 0) 0x7f6dac15bed0 con 0x7f6dac06c800 2023-11-13T11:29:22.588 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:22.582+0000 7f6db23a5640 1 --2- 172.21.15.102:0/1082186556 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6dac1553c0 0x7f6dac0cebc0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f6da80097c0 tx=0x7f6dac070b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fb4bfca3864285aa server_cookie=0 in_seq=0 out_seq=0 2023-11-13T11:29:22.589 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:22.582+0000 7f6db13a3640 1 -- 172.21.15.102:0/1082186556 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6da80ab600 con 0x7f6dac1553c0 2023-11-13T11:29:22.590 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:22.582+0000 7f6db13a3640 1 -- 172.21.15.102:0/1082186556 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6da80a7050 con 0x7f6dac1553c0 2023-11-13T11:29:22.590 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:22.582+0000 7f6db13a3640 1 -- 172.21.15.102:0/1082186556 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6da80ab980 con 0x7f6dac1553c0 2023-11-13T11:29:22.590 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:22.582+0000 7f6db4609640 1 -- 172.21.15.102:0/1082186556 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6dac1553c0 msgr2=0x7f6dac0cebc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:22.590 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:22.582+0000 7f6db4609640 1 --2- 172.21.15.102:0/1082186556 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6dac1553c0 0x7f6dac0cebc0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f6da80097c0 tx=0x7f6dac070b30 comp rx=0 tx=0).stop 2023-11-13T11:29:22.590 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:22.582+0000 7f6db4609640 1 -- 172.21.15.102:0/1082186556 shutdown_connections 2023-11-13T11:29:22.591 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:22.582+0000 7f6db4609640 1 --2- 172.21.15.102:0/1082186556 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6dac1553c0 0x7f6dac0cebc0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:22.591 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:22.582+0000 7f6db4609640 1 -- 172.21.15.102:0/1082186556 >> 172.21.15.102:0/1082186556 conn(0x7f6dac06a410 msgr2=0x7f6dac06a820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-13T11:29:22.591 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:22.582+0000 7f6db4609640 1 -- 172.21.15.102:0/1082186556 shutdown_connections 2023-11-13T11:29:22.591 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:22.582+0000 7f6db4609640 1 -- 172.21.15.102:0/1082186556 wait complete. 2023-11-13T11:29:22.594 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:22.586+0000 7f6db4609640 1 Processor -- start 2023-11-13T11:29:22.594 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:22.586+0000 7f6db4609640 1 -- start start 2023-11-13T11:29:22.594 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:22.586+0000 7f6db4609640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6dac06c800 0x7f6dac153f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:22.594 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:22.586+0000 7f6db4609640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6dac1553c0 0x7f6dac0aebb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:22.595 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:22.586+0000 7f6db4609640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6dac15bac0 0x7f6dac1f6390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:22.595 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:22.586+0000 7f6db4609640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6dac156c40 con 0x7f6dac06c800 2023-11-13T11:29:22.595 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:22.586+0000 7f6db4609640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6dac154490 con 0x7f6dac15bac0 2023-11-13T11:29:22.595 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:22.586+0000 7f6db4609640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6dac155fc0 con 0x7f6dac1553c0 2023-11-13T11:29:22.595 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:22.586+0000 7f6db23a5640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6dac06c800 0x7f6dac153f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:22.596 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:22.586+0000 7f6db23a5640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6dac06c800 0x7f6dac153f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:50560/0 (socket says 172.21.15.102:50560) 2023-11-13T11:29:22.596 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:22.586+0000 7f6db23a5640 1 -- 172.21.15.102:0/1167128926 learned_addr learned my addr 172.21.15.102:0/1167128926 (peer_addr_for_me v2:172.21.15.102:0/0) 2023-11-13T11:29:22.596 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:22.586+0000 7f6db1ba4640 1 --2- 172.21.15.102:0/1167128926 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6dac1553c0 0x7f6dac0aebb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:22.596 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:22.586+0000 7f6db2ba6640 1 --2- 172.21.15.102:0/1167128926 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6dac15bac0 0x7f6dac1f6390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:22.596 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:22.586+0000 7f6db23a5640 1 -- 172.21.15.102:0/1167128926 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6dac1553c0 msgr2=0x7f6dac0aebb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:22.597 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:22.586+0000 7f6db23a5640 1 --2- 172.21.15.102:0/1167128926 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6dac1553c0 0x7f6dac0aebb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:22.597 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:22.586+0000 7f6db23a5640 1 -- 172.21.15.102:0/1167128926 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6dac15bac0 msgr2=0x7f6dac1f6390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:22.597 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:22.586+0000 7f6db23a5640 1 --2- 172.21.15.102:0/1167128926 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6dac15bac0 0x7f6dac1f6390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:22.597 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:22.586+0000 7f6db23a5640 1 -- 172.21.15.102:0/1167128926 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6da8009420 con 0x7f6dac06c800 2023-11-13T11:29:22.597 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:22.586+0000 7f6db23a5640 1 --2- 172.21.15.102:0/1167128926 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6dac06c800 0x7f6dac153f50 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f6da801a020 tx=0x7f6da8019190 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-13T11:29:22.597 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:22.586+0000 7f6da2ffd640 1 -- 172.21.15.102:0/1167128926 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6da8004030 con 0x7f6dac06c800 2023-11-13T11:29:22.598 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:22.586+0000 7f6da2ffd640 1 -- 172.21.15.102:0/1167128926 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6da8004190 con 0x7f6dac06c800 2023-11-13T11:29:22.598 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:22.586+0000 7f6da2ffd640 1 -- 172.21.15.102:0/1167128926 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6da8004500 con 0x7f6dac06c800 2023-11-13T11:29:22.598 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:22.586+0000 7f6db4609640 1 -- 172.21.15.102:0/1167128926 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6dac1562a0 con 0x7f6dac06c800 2023-11-13T11:29:22.598 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:22.586+0000 7f6db4609640 1 -- 172.21.15.102:0/1167128926 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6dac156860 con 0x7f6dac06c800 2023-11-13T11:29:22.599 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:22.586+0000 7f6db4609640 1 -- 172.21.15.102:0/1167128926 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6dac067640 con 0x7f6dac06c800 2023-11-13T11:29:22.599 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:22.590+0000 7f6da2ffd640 1 -- 172.21.15.102:0/1167128926 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f6da80b2040 con 0x7f6dac06c800 2023-11-13T11:29:22.600 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:22.590+0000 7f6da2ffd640 1 --2- 172.21.15.102:0/1167128926 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f6d90066470 0x7f6d90068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:22.600 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:22.590+0000 7f6da2ffd640 1 -- 172.21.15.102:0/1167128926 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f6da811dff0 con 0x7f6dac06c800 2023-11-13T11:29:22.600 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:22.590+0000 7f6db1ba4640 1 --2- 172.21.15.102:0/1167128926 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f6d90066470 0x7f6d90068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:22.600 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:22.590+0000 7f6db1ba4640 1 --2- 172.21.15.102:0/1167128926 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f6d90066470 0x7f6d90068930 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f6dac06cf50 tx=0x7f6d9c007d10 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-13T11:29:22.601 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:22.594+0000 7f6da2ffd640 1 -- 172.21.15.102:0/1167128926 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f6da80eb410 con 0x7f6dac06c800 2023-11-13T11:29:22.750 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:22.742+0000 7f6db4609640 1 -- 172.21.15.102:0/1167128926 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f6dac068520 con 0x7f6dac06c800 2023-11-13T11:29:22.750 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:22.742+0000 7f6da2ffd640 1 -- 172.21.15.102:0/1167128926 <== mon.0 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v22) v1 ==== 100+0+11 (secure 0 0 0) 0x7f6da80c20a0 con 0x7f6dac06c800 2023-11-13T11:29:22.751 INFO:teuthology.orchestra.run.smithi102.stdout:pg_num: 64 2023-11-13T11:29:22.752 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:22.746+0000 7f6db4609640 1 -- 172.21.15.102:0/1167128926 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f6d90066470 msgr2=0x7f6d90068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:22.752 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:22.746+0000 7f6db4609640 1 --2- 172.21.15.102:0/1167128926 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f6d90066470 0x7f6d90068930 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f6dac06cf50 tx=0x7f6d9c007d10 comp rx=0 tx=0).stop 2023-11-13T11:29:22.753 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:22.746+0000 7f6db4609640 1 -- 172.21.15.102:0/1167128926 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6dac06c800 msgr2=0x7f6dac153f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:22.753 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:22.746+0000 7f6db4609640 1 --2- 172.21.15.102:0/1167128926 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6dac06c800 0x7f6dac153f50 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f6da801a020 tx=0x7f6da8019190 comp rx=0 tx=0).stop 2023-11-13T11:29:22.753 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:22.746+0000 7f6db4609640 1 -- 172.21.15.102:0/1167128926 shutdown_connections 2023-11-13T11:29:22.753 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:22.746+0000 7f6db4609640 1 --2- 172.21.15.102:0/1167128926 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6dac15bac0 0x7f6dac1f6390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:22.753 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:22.746+0000 7f6db4609640 1 --2- 172.21.15.102:0/1167128926 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6dac1553c0 0x7f6dac0aebb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:22.753 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:22.746+0000 7f6db4609640 1 --2- 172.21.15.102:0/1167128926 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f6d90066470 0x7f6d90068930 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:22.754 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:22.746+0000 7f6db4609640 1 --2- 172.21.15.102:0/1167128926 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6dac06c800 0x7f6dac153f50 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:22.754 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:22.746+0000 7f6db4609640 1 -- 172.21.15.102:0/1167128926 >> 172.21.15.102:0/1167128926 conn(0x7f6dac06a410 msgr2=0x7f6dac0b34a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-13T11:29:22.754 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:22.746+0000 7f6db4609640 1 -- 172.21.15.102:0/1167128926 shutdown_connections 2023-11-13T11:29:22.754 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:22.746+0000 7f6db4609640 1 -- 172.21.15.102:0/1167128926 wait complete. 2023-11-13T11:29:22.772 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-13T11:29:22.914 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:22.906+0000 7f7032a09640 1 Processor -- start 2023-11-13T11:29:22.915 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:22.906+0000 7f7032a09640 1 -- start start 2023-11-13T11:29:22.916 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:22.910+0000 7f7032a09640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f702c159420 0x7f702c06d8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:22.917 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:22.910+0000 7f7032a09640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f702c0cae80 0x7f702c0cd250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:22.917 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:22.910+0000 7f7032a09640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f702c06c270 0x7f702c0cd790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:22.917 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:22.910+0000 7f7032a09640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f702c06dde0 con 0x7f702c06c270 2023-11-13T11:29:22.917 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:22.910+0000 7f7032a09640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f702c06c800 con 0x7f702c0cae80 2023-11-13T11:29:22.918 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:22.910+0000 7f7032a09640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f702c06cae0 con 0x7f702c159420 2023-11-13T11:29:22.918 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:22.910+0000 7f7030fa6640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f702c06c270 0x7f702c0cd790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:22.918 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:22.910+0000 7f7030fa6640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f702c06c270 0x7f702c0cd790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:50574/0 (socket says 172.21.15.102:50574) 2023-11-13T11:29:22.918 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:22.910+0000 7f7030fa6640 1 -- 172.21.15.102:0/789949888 learned_addr learned my addr 172.21.15.102:0/789949888 (peer_addr_for_me v2:172.21.15.102:0/0) 2023-11-13T11:29:22.918 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:22.910+0000 7f702bfff640 1 --2- 172.21.15.102:0/789949888 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f702c159420 0x7f702c06d8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:22.919 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:22.910+0000 7f702b7fe640 1 --2- 172.21.15.102:0/789949888 >> v2:172.21.15.154:3300/0 conn(0x7f702c0cae80 0x7f702c0cd250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:22.919 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:22.910+0000 7f7030fa6640 1 -- 172.21.15.102:0/789949888 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f702c159420 msgr2=0x7f702c06d8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-13T11:29:22.919 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:22.910+0000 7f7030fa6640 1 --2- 172.21.15.102:0/789949888 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f702c159420 0x7f702c06d8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:22.919 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:22.910+0000 7f7030fa6640 1 -- 172.21.15.102:0/789949888 >> v2:172.21.15.154:3300/0 conn(0x7f702c0cae80 msgr2=0x7f702c0cd250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-13T11:29:22.920 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:22.910+0000 7f7030fa6640 1 --2- 172.21.15.102:0/789949888 >> v2:172.21.15.154:3300/0 conn(0x7f702c0cae80 0x7f702c0cd250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:22.920 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:22.910+0000 7f7030fa6640 1 -- 172.21.15.102:0/789949888 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f702c06cdc0 con 0x7f702c06c270 2023-11-13T11:29:22.922 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:22.914+0000 7f7030fa6640 1 --2- 172.21.15.102:0/789949888 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f702c06c270 0x7f702c0cd790 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f702c06b810 tx=0x7f702401f1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f27bb52d657c7284 server_cookie=0 in_seq=0 out_seq=0 2023-11-13T11:29:22.922 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:22.914+0000 7f702affd640 1 -- 172.21.15.102:0/789949888 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70240af400 con 0x7f702c06c270 2023-11-13T11:29:22.922 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:22.914+0000 7f702affd640 1 -- 172.21.15.102:0/789949888 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f70240ab050 con 0x7f702c06c270 2023-11-13T11:29:22.923 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:22.914+0000 7f702affd640 1 -- 172.21.15.102:0/789949888 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70240af780 con 0x7f702c06c270 2023-11-13T11:29:22.923 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:22.914+0000 7f7032a09640 1 -- 172.21.15.102:0/789949888 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f702c06c270 msgr2=0x7f702c0cd790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:22.923 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:22.914+0000 7f7032a09640 1 --2- 172.21.15.102:0/789949888 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f702c06c270 0x7f702c0cd790 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f702c06b810 tx=0x7f702401f1c0 comp rx=0 tx=0).stop 2023-11-13T11:29:22.924 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:22.914+0000 7f7032a09640 1 -- 172.21.15.102:0/789949888 shutdown_connections 2023-11-13T11:29:22.924 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:22.914+0000 7f7032a09640 1 --2- 172.21.15.102:0/789949888 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f702c06c270 0x7f702c0cd790 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:22.924 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:22.914+0000 7f7032a09640 1 --2- 172.21.15.102:0/789949888 >> v2:172.21.15.154:3300/0 conn(0x7f702c0cae80 0x7f702c0cd250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:22.924 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:22.914+0000 7f7032a09640 1 --2- 172.21.15.102:0/789949888 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f702c159420 0x7f702c06d8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:22.925 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:22.914+0000 7f7032a09640 1 -- 172.21.15.102:0/789949888 >> 172.21.15.102:0/789949888 conn(0x7f702c0b0870 msgr2=0x7f702c0b0c80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-13T11:29:22.925 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:22.914+0000 7f7032a09640 1 -- 172.21.15.102:0/789949888 shutdown_connections 2023-11-13T11:29:22.925 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:22.914+0000 7f7032a09640 1 -- 172.21.15.102:0/789949888 wait complete. 2023-11-13T11:29:22.925 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:22.914+0000 7f7032a09640 1 Processor -- start 2023-11-13T11:29:22.925 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:22.914+0000 7f7032a09640 1 -- start start 2023-11-13T11:29:22.928 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:22.918+0000 7f7032a09640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f702c06c270 0x7f702c1f6a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:22.928 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:22.918+0000 7f7032a09640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f702c0cae80 0x7f702c1e44a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:22.928 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:22.918+0000 7f7032a09640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f702c159420 0x7f702c140760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:22.929 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:22.918+0000 7f7032a09640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f702c1e58a0 con 0x7f702c159420 2023-11-13T11:29:22.929 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:22.918+0000 7f7032a09640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f702c1f6f90 con 0x7f702c0cae80 2023-11-13T11:29:22.929 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:22.918+0000 7f7032a09640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f702c1e49e0 con 0x7f702c06c270 2023-11-13T11:29:22.929 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:22.918+0000 7f7030fa6640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f702c159420 0x7f702c140760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:22.929 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:22.918+0000 7f7030fa6640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f702c159420 0x7f702c140760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:50590/0 (socket says 172.21.15.102:50590) 2023-11-13T11:29:22.930 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:22.918+0000 7f7030fa6640 1 -- 172.21.15.102:0/2206257275 learned_addr learned my addr 172.21.15.102:0/2206257275 (peer_addr_for_me v2:172.21.15.102:0/0) 2023-11-13T11:29:22.930 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:22.918+0000 7f702b7fe640 1 --2- 172.21.15.102:0/2206257275 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f702c0cae80 0x7f702c1e44a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:22.930 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:22.918+0000 7f702bfff640 1 --2- 172.21.15.102:0/2206257275 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f702c06c270 0x7f702c1f6a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:22.931 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:22.918+0000 7f7030fa6640 1 -- 172.21.15.102:0/2206257275 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f702c06c270 msgr2=0x7f702c1f6a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:22.931 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:22.918+0000 7f7030fa6640 1 --2- 172.21.15.102:0/2206257275 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f702c06c270 0x7f702c1f6a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:22.931 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:22.918+0000 7f7030fa6640 1 -- 172.21.15.102:0/2206257275 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f702c0cae80 msgr2=0x7f702c1e44a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:22.931 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:22.918+0000 7f7030fa6640 1 --2- 172.21.15.102:0/2206257275 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f702c0cae80 0x7f702c1e44a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:22.932 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:22.918+0000 7f7030fa6640 1 -- 172.21.15.102:0/2206257275 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7024009b30 con 0x7f702c159420 2023-11-13T11:29:22.932 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:22.918+0000 7f7030fa6640 1 --2- 172.21.15.102:0/2206257275 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f702c159420 0x7f702c140760 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f70240b2040 tx=0x7f702401bf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-13T11:29:22.932 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:22.918+0000 7f7028ff9640 1 -- 172.21.15.102:0/2206257275 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70240afdc0 con 0x7f702c159420 2023-11-13T11:29:22.932 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:22.918+0000 7f7028ff9640 1 -- 172.21.15.102:0/2206257275 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7024009510 con 0x7f702c159420 2023-11-13T11:29:22.932 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:22.918+0000 7f7028ff9640 1 -- 172.21.15.102:0/2206257275 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70240ba660 con 0x7f702c159420 2023-11-13T11:29:22.933 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:22.918+0000 7f7032a09640 1 -- 172.21.15.102:0/2206257275 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f702c1e3400 con 0x7f702c159420 2023-11-13T11:29:22.933 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:22.918+0000 7f7032a09640 1 -- 172.21.15.102:0/2206257275 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f702c1e39c0 con 0x7f702c159420 2023-11-13T11:29:22.933 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:22.918+0000 7f7032a09640 1 -- 172.21.15.102:0/2206257275 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f702c068520 con 0x7f702c159420 2023-11-13T11:29:22.934 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:22.922+0000 7f7028ff9640 1 -- 172.21.15.102:0/2206257275 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f70240b6040 con 0x7f702c159420 2023-11-13T11:29:22.934 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:22.922+0000 7f7028ff9640 1 --2- 172.21.15.102:0/2206257275 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f7018066470 0x7f7018068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:22.934 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:22.922+0000 7f7028ff9640 1 -- 172.21.15.102:0/2206257275 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f7024121e90 con 0x7f702c159420 2023-11-13T11:29:22.934 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:22.922+0000 7f702bfff640 1 --2- 172.21.15.102:0/2206257275 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f7018066470 0x7f7018068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:22.935 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:22.922+0000 7f702bfff640 1 --2- 172.21.15.102:0/2206257275 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f7018066470 0x7f7018068930 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f701c00bb10 tx=0x7f701c008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-13T11:29:22.935 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:22.926+0000 7f7028ff9640 1 -- 172.21.15.102:0/2206257275 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f70240ef4e0 con 0x7f702c159420 2023-11-13T11:29:23.082 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:23.074+0000 7f7032a09640 1 -- 172.21.15.102:0/2206257275 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f702c071e80 con 0x7f702c159420 2023-11-13T11:29:23.083 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:23.078+0000 7f7028ff9640 1 -- 172.21.15.102:0/2206257275 <== mon.0 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+16545 (secure 0 0 0) 0x7f70240f2b00 con 0x7f702c159420 2023-11-13T11:29:23.083 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T11:29:23.083 INFO:teuthology.orchestra.run.smithi102.stdout:{"epoch":22,"fsid":"97b3eb2b-7ccf-4aae-8d92-bff986c671ea","created":"2023-11-13T11:28:31.836724+0000","modified":"2023-11-13T11:28:58.608314+0000","last_up_change":"2023-11-13T11:28:44.876638+0000","last_in_change":"2023-11-13T11:28:35.312740+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-13T11:28:44.981356+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-13T11:28:55.958525+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-13T11:28:56.394264+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"bdefaa17-fcca-4c86-aa40-27dc33a789af","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6800","nonce":53303834},{"type":"v1","addr":"172.21.15.102:6801","nonce":53303834}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6802","nonce":53303834},{"type":"v1","addr":"172.21.15.102:6803","nonce":53303834}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6806","nonce":53303834},{"type":"v1","addr":"172.21.15.102:6807","nonce":53303834}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6804","nonce":53303834},{"type":"v1","addr":"172.21.15.102:6805","nonce":53303834}]},"public_addr":"172.21.15.102:6801/53303834","cluster_addr":"172.21.15.102:6803/53303834","heartbeat_back_addr":"172.21.15.102:6807/53303834","heartbeat_front_addr":"172.21.15.102:6805/53303834","state":["exists","up"]},{"osd":1,"uuid":"f0033196-dec9-4ae9-945e-6aeef6dbb47f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6808","nonce":1732708348},{"type":"v1","addr":"172.21.15.102:6809","nonce":1732708348}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6811","nonce":1732708348},{"type":"v1","addr":"172.21.15.102:6813","nonce":1732708348}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6818","nonce":1732708348},{"type":"v1","addr":"172.21.15.102:6820","nonce":1732708348}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6815","nonce":1732708348},{"type":"v1","addr":"172.21.15.102:6817","nonce":1732708348}]},"public_addr":"172.21.15.102:6809/1732708348","cluster_addr":"172.21.15.102:6813/1732708348","heartbeat_back_addr":"172.21.15.102:6820/1732708348","heartbeat_front_addr":"172.21.15.102:6817/1732708348","state":["exists","up"]},{"osd":2,"uuid":"496b0834-351e-4ec2-a714-86ed0c0ff4fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6810","nonce":1825475150},{"type":"v1","addr":"172.21.15.102:6812","nonce":1825475150}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6814","nonce":1825475150},{"type":"v1","addr":"172.21.15.102:6816","nonce":1825475150}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6822","nonce":1825475150},{"type":"v1","addr":"172.21.15.102:6823","nonce":1825475150}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6819","nonce":1825475150},{"type":"v1","addr":"172.21.15.102:6821","nonce":1825475150}]},"public_addr":"172.21.15.102:6812/1825475150","cluster_addr":"172.21.15.102:6816/1825475150","heartbeat_back_addr":"172.21.15.102:6823/1825475150","heartbeat_front_addr":"172.21.15.102:6821/1825475150","state":["exists","up"]},{"osd":3,"uuid":"3ba6cc41-e0a0-4273-86cb-90000c06a55a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6824","nonce":4149355528},{"type":"v1","addr":"172.21.15.102:6825","nonce":4149355528}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6826","nonce":4149355528},{"type":"v1","addr":"172.21.15.102:6827","nonce":4149355528}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6830","nonce":4149355528},{"type":"v1","addr":"172.21.15.102:6831","nonce":4149355528}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6828","nonce":4149355528},{"type":"v1","addr":"172.21.15.102:6829","nonce":4149355528}]},"public_addr":"172.21.15.102:6825/4149355528","cluster_addr":"172.21.15.102:6827/4149355528","heartbeat_back_addr":"172.21.15.102:6831/4149355528","heartbeat_front_addr":"172.21.15.102:6829/4149355528","state":["exists","up"]},{"osd":4,"uuid":"16e797d8-e6e7-4140-95c3-b85283c42a2a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6808","nonce":4028899241},{"type":"v1","addr":"172.21.15.154:6809","nonce":4028899241}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6810","nonce":4028899241},{"type":"v1","addr":"172.21.15.154:6811","nonce":4028899241}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6814","nonce":4028899241},{"type":"v1","addr":"172.21.15.154:6815","nonce":4028899241}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6812","nonce":4028899241},{"type":"v1","addr":"172.21.15.154:6813","nonce":4028899241}]},"public_addr":"172.21.15.154:6809/4028899241","cluster_addr":"172.21.15.154:6811/4028899241","heartbeat_back_addr":"172.21.15.154:6815/4028899241","heartbeat_front_addr":"172.21.15.154:6813/4028899241","state":["exists","up"]},{"osd":5,"uuid":"d6ab225c-1b55-450a-89a9-abe5c3f8d6af","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":3562396827},{"type":"v1","addr":"172.21.15.154:6801","nonce":3562396827}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":3562396827},{"type":"v1","addr":"172.21.15.154:6803","nonce":3562396827}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6806","nonce":3562396827},{"type":"v1","addr":"172.21.15.154:6807","nonce":3562396827}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6804","nonce":3562396827},{"type":"v1","addr":"172.21.15.154:6805","nonce":3562396827}]},"public_addr":"172.21.15.154:6801/3562396827","cluster_addr":"172.21.15.154:6803/3562396827","heartbeat_back_addr":"172.21.15.154:6807/3562396827","heartbeat_front_addr":"172.21.15.154:6805/3562396827","state":["exists","up"]},{"osd":6,"uuid":"96f905ac-491c-4662-8e2b-5bb8e929ab9d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6816","nonce":2933728751},{"type":"v1","addr":"172.21.15.154:6817","nonce":2933728751}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6818","nonce":2933728751},{"type":"v1","addr":"172.21.15.154:6819","nonce":2933728751}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6822","nonce":2933728751},{"type":"v1","addr":"172.21.15.154:6823","nonce":2933728751}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6820","nonce":2933728751},{"type":"v1","addr":"172.21.15.154:6821","nonce":2933728751}]},"public_addr":"172.21.15.154:6817/2933728751","cluster_addr":"172.21.15.154:6819/2933728751","heartbeat_back_addr":"172.21.15.154:6823/2933728751","heartbeat_front_addr":"172.21.15.154:6821/2933728751","state":["exists","up"]},{"osd":7,"uuid":"07012d3b-3ab4-40df-a471-93caed22e2dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6824","nonce":1753500785},{"type":"v1","addr":"172.21.15.154:6825","nonce":1753500785}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6826","nonce":1753500785},{"type":"v1","addr":"172.21.15.154:6827","nonce":1753500785}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6830","nonce":1753500785},{"type":"v1","addr":"172.21.15.154:6831","nonce":1753500785}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6828","nonce":1753500785},{"type":"v1","addr":"172.21.15.154:6829","nonce":1753500785}]},"public_addr":"172.21.15.154:6825/1753500785","cluster_addr":"172.21.15.154:6827/1753500785","heartbeat_back_addr":"172.21.15.154:6831/1753500785","heartbeat_front_addr":"172.21.15.154:6829/1753500785","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-13T11:28:40.978603+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-13T11:28:41.200985+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-13T11:28:41.222815+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-13T11:28:41.202162+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-13T11:28:40.925911+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-13T11:28:41.087725+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-13T11:28:41.072208+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-13T11:28:40.875257+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-13T11:29:23.085 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:23.078+0000 7f7032a09640 1 -- 172.21.15.102:0/2206257275 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f7018066470 msgr2=0x7f7018068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:23.085 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:23.078+0000 7f7032a09640 1 --2- 172.21.15.102:0/2206257275 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f7018066470 0x7f7018068930 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f701c00bb10 tx=0x7f701c008040 comp rx=0 tx=0).stop 2023-11-13T11:29:23.085 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:23.078+0000 7f7032a09640 1 -- 172.21.15.102:0/2206257275 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f702c159420 msgr2=0x7f702c140760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:23.085 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:23.078+0000 7f7032a09640 1 --2- 172.21.15.102:0/2206257275 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f702c159420 0x7f702c140760 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f70240b2040 tx=0x7f702401bf60 comp rx=0 tx=0).stop 2023-11-13T11:29:23.086 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:23.078+0000 7f7032a09640 1 -- 172.21.15.102:0/2206257275 shutdown_connections 2023-11-13T11:29:23.086 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:23.078+0000 7f7032a09640 1 --2- 172.21.15.102:0/2206257275 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f7018066470 0x7f7018068930 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:23.086 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:23.078+0000 7f7032a09640 1 --2- 172.21.15.102:0/2206257275 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f702c159420 0x7f702c140760 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:23.086 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:23.078+0000 7f7032a09640 1 --2- 172.21.15.102:0/2206257275 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f702c0cae80 0x7f702c1e44a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:23.087 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:23.078+0000 7f7032a09640 1 --2- 172.21.15.102:0/2206257275 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f702c06c270 0x7f702c1f6a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:23.087 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:23.078+0000 7f7032a09640 1 -- 172.21.15.102:0/2206257275 >> 172.21.15.102:0/2206257275 conn(0x7f702c0b0870 msgr2=0x7f702c154c00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-13T11:29:23.087 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:23.078+0000 7f7032a09640 1 -- 172.21.15.102:0/2206257275 shutdown_connections 2023-11-13T11:29:23.087 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:23.078+0000 7f7032a09640 1 -- 172.21.15.102:0/2206257275 wait complete. 2023-11-13T11:29:23.104 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-13T11:28:44.981356+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-13T11:28:55.958525+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-11-13T11:28:56.394264+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-13T11:29:23.105 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-13T11:29:23.245 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:23.238+0000 7f4f86481640 1 Processor -- start 2023-11-13T11:29:23.246 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:23.238+0000 7f4f86481640 1 -- start start 2023-11-13T11:29:23.247 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:23.242+0000 7f4f86481640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4f80153f90 0x7f4f8015ac10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:23.248 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:23.242+0000 7f4f86481640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f4f800b3380 0x7f4f8006cad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:23.248 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:23.242+0000 7f4f86481640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4f8015a1a0 con 0x7f4f80154370 2023-11-13T11:29:23.248 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:23.242+0000 7f4f86481640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4f80070d40 con 0x7f4f800b3380 2023-11-13T11:29:23.248 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:23.242+0000 7f4f86481640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f8015a410 con 0x7f4f80153f90 2023-11-13T11:29:23.249 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:23.242+0000 7f4f84c7e640 1 --1- >> v1:172.21.15.102:6789/0 conn(0x7f4f80154370 0x7f4f80070480 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.102:6789/0 says I am v1:172.21.15.102:36726/0 (socket says 172.21.15.102:36726) 2023-11-13T11:29:23.249 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:23.242+0000 7f4f84c7e640 1 -- 172.21.15.102:0/3987521716 learned_addr learned my addr 172.21.15.102:0/3987521716 (peer_addr_for_me v1:172.21.15.102:0/0) 2023-11-13T11:29:23.249 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:23.242+0000 7f4f85c80640 1 --2- 172.21.15.102:0/3987521716 >> v2:172.21.15.102:3300/0 conn(0x7f4f800b3380 0x7f4f8006cad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:23.249 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:23.242+0000 7f4f8547f640 1 --2- 172.21.15.102:0/3987521716 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4f80153f90 0x7f4f8015ac10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:23.249 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:23.242+0000 7f4f77fff640 1 -- 172.21.15.102:0/3987521716 <== mon.0 v1:172.21.15.102:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3714158096 0 0) 0x7f4f8015a1a0 con 0x7f4f80154370 2023-11-13T11:29:23.249 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:23.242+0000 7f4f77fff640 1 -- 172.21.15.102:0/3987521716 --> v1:172.21.15.102:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4f6c003530 con 0x7f4f80154370 2023-11-13T11:29:23.250 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:23.242+0000 7f4f85c80640 1 -- 172.21.15.102:0/3987521716 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4f80153f90 msgr2=0x7f4f8015ac10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-13T11:29:23.250 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:23.242+0000 7f4f85c80640 1 --2- 172.21.15.102:0/3987521716 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4f80153f90 0x7f4f8015ac10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:23.250 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:23.242+0000 7f4f85c80640 1 -- 172.21.15.102:0/3987521716 >> v1:172.21.15.102:6789/0 conn(0x7f4f80154370 legacy=0x7f4f80070480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:23.250 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:23.242+0000 7f4f85c80640 1 -- 172.21.15.102:0/3987521716 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f8015a6f0 con 0x7f4f800b3380 2023-11-13T11:29:23.251 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:23.242+0000 7f4f85c80640 1 --2- 172.21.15.102:0/3987521716 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4f800b3380 0x7f4f8006cad0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f4f78009d90 tx=0x7f4f7801c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=909cf9f7a14c47ec server_cookie=0 in_seq=0 out_seq=0 2023-11-13T11:29:23.252 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:23.246+0000 7f4f77fff640 1 -- 172.21.15.102:0/3987521716 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f780a5810 con 0x7f4f800b3380 2023-11-13T11:29:23.252 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:23.246+0000 7f4f77fff640 1 -- 172.21.15.102:0/3987521716 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f780a5970 con 0x7f4f800b3380 2023-11-13T11:29:23.252 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:23.246+0000 7f4f77fff640 1 -- 172.21.15.102:0/3987521716 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f780a5d00 con 0x7f4f800b3380 2023-11-13T11:29:23.252 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:23.246+0000 7f4f86481640 1 -- 172.21.15.102:0/3987521716 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4f800b3380 msgr2=0x7f4f8006cad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:23.252 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:23.246+0000 7f4f86481640 1 --2- 172.21.15.102:0/3987521716 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4f800b3380 0x7f4f8006cad0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f4f78009d90 tx=0x7f4f7801c950 comp rx=0 tx=0).stop 2023-11-13T11:29:23.253 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:23.246+0000 7f4f86481640 1 -- 172.21.15.102:0/3987521716 shutdown_connections 2023-11-13T11:29:23.253 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:23.246+0000 7f4f86481640 1 --2- 172.21.15.102:0/3987521716 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4f800b3380 0x7f4f8006cad0 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:23.253 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:23.246+0000 7f4f86481640 1 --2- 172.21.15.102:0/3987521716 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4f80153f90 0x7f4f8015ac10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:23.253 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:23.246+0000 7f4f86481640 1 -- 172.21.15.102:0/3987521716 >> 172.21.15.102:0/3987521716 conn(0x7f4f800b04d0 msgr2=0x7f4f800b08e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-13T11:29:23.253 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:23.246+0000 7f4f86481640 1 -- 172.21.15.102:0/3987521716 shutdown_connections 2023-11-13T11:29:23.254 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:23.246+0000 7f4f86481640 1 -- 172.21.15.102:0/3987521716 wait complete. 2023-11-13T11:29:23.256 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:23.246+0000 7f4f86481640 1 Processor -- start 2023-11-13T11:29:23.256 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:23.246+0000 7f4f86481640 1 -- start start 2023-11-13T11:29:23.256 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:23.246+0000 7f4f86481640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4f800b3380 0x7f4f8014af70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:23.256 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:23.246+0000 7f4f86481640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4f80153f90 0x7f4f8014d170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:23.257 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:23.246+0000 7f4f86481640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4f80154370 0x7f4f8014d6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:23.257 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:23.246+0000 7f4f86481640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f8015add0 con 0x7f4f80154370 2023-11-13T11:29:23.257 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:23.246+0000 7f4f86481640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f8015bc40 con 0x7f4f80153f90 2023-11-13T11:29:23.257 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:23.246+0000 7f4f86481640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f80151ed0 con 0x7f4f800b3380 2023-11-13T11:29:23.257 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:23.246+0000 7f4f85c80640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4f80154370 0x7f4f8014d6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:23.258 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:23.250+0000 7f4f85c80640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4f80154370 0x7f4f8014d6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:50608/0 (socket says 172.21.15.102:50608) 2023-11-13T11:29:23.258 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:23.250+0000 7f4f85c80640 1 -- 172.21.15.102:0/2051814309 learned_addr learned my addr 172.21.15.102:0/2051814309 (peer_addr_for_me v2:172.21.15.102:0/0) 2023-11-13T11:29:23.258 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:23.250+0000 7f4f8547f640 1 --2- 172.21.15.102:0/2051814309 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4f800b3380 0x7f4f8014af70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:23.258 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:23.250+0000 7f4f84c7e640 1 --2- 172.21.15.102:0/2051814309 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4f80153f90 0x7f4f8014d170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:23.258 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:23.250+0000 7f4f85c80640 1 -- 172.21.15.102:0/2051814309 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4f800b3380 msgr2=0x7f4f8014af70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:23.259 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:23.250+0000 7f4f85c80640 1 --2- 172.21.15.102:0/2051814309 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4f800b3380 0x7f4f8014af70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:23.259 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:23.250+0000 7f4f85c80640 1 -- 172.21.15.102:0/2051814309 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4f80153f90 msgr2=0x7f4f8014d170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:23.259 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:23.250+0000 7f4f85c80640 1 --2- 172.21.15.102:0/2051814309 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4f80153f90 0x7f4f8014d170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:23.259 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:23.250+0000 7f4f85c80640 1 -- 172.21.15.102:0/2051814309 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f78009a70 con 0x7f4f80154370 2023-11-13T11:29:23.259 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:23.250+0000 7f4f85c80640 1 --2- 172.21.15.102:0/2051814309 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4f80154370 0x7f4f8014d6b0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f4f7801b000 tx=0x7f4f780196f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-13T11:29:23.260 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:23.250+0000 7f4f75ffb640 1 -- 172.21.15.102:0/2051814309 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f780b9860 con 0x7f4f80154370 2023-11-13T11:29:23.260 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:23.250+0000 7f4f75ffb640 1 -- 172.21.15.102:0/2051814309 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f780b99c0 con 0x7f4f80154370 2023-11-13T11:29:23.260 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:23.250+0000 7f4f86481640 1 -- 172.21.15.102:0/2051814309 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4f8015e3a0 con 0x7f4f80154370 2023-11-13T11:29:23.260 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:23.250+0000 7f4f75ffb640 1 -- 172.21.15.102:0/2051814309 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f780b9d30 con 0x7f4f80154370 2023-11-13T11:29:23.261 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:23.250+0000 7f4f86481640 1 -- 172.21.15.102:0/2051814309 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4f8015bee0 con 0x7f4f80154370 2023-11-13T11:29:23.262 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:23.250+0000 7f4f86481640 1 -- 172.21.15.102:0/2051814309 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4f80068520 con 0x7f4f80154370 2023-11-13T11:29:23.262 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:23.250+0000 7f4f75ffb640 1 -- 172.21.15.102:0/2051814309 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f4f780ad440 con 0x7f4f80154370 2023-11-13T11:29:23.262 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:23.254+0000 7f4f75ffb640 1 --2- 172.21.15.102:0/2051814309 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f4f64066470 0x7f4f64068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:23.262 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:23.254+0000 7f4f75ffb640 1 -- 172.21.15.102:0/2051814309 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f4f7811f2b0 con 0x7f4f80154370 2023-11-13T11:29:23.262 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:23.254+0000 7f4f8547f640 1 --2- 172.21.15.102:0/2051814309 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f4f64066470 0x7f4f64068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:23.263 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:23.254+0000 7f4f8547f640 1 --2- 172.21.15.102:0/2051814309 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f4f64066470 0x7f4f64068930 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f4f7c009b60 tx=0x7f4f7c009190 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-13T11:29:23.263 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:23.254+0000 7f4f75ffb640 1 -- 172.21.15.102:0/2051814309 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f4f780ec8e0 con 0x7f4f80154370 2023-11-13T11:29:23.414 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:23.406+0000 7f4f86481640 1 -- 172.21.15.102:0/2051814309 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f4f8015c0d0 con 0x7f4f80154370 2023-11-13T11:29:23.414 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:23.406+0000 7f4f75ffb640 1 -- 172.21.15.102:0/2051814309 <== mon.0 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v22) v1 ==== 93+0+10 (secure 0 0 0) 0x7f4f780eff00 con 0x7f4f80154370 2023-11-13T11:29:23.415 INFO:teuthology.orchestra.run.smithi102.stdout:pg_num: 1 2023-11-13T11:29:23.416 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:23.410+0000 7f4f86481640 1 -- 172.21.15.102:0/2051814309 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f4f64066470 msgr2=0x7f4f64068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:23.417 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:23.410+0000 7f4f86481640 1 --2- 172.21.15.102:0/2051814309 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f4f64066470 0x7f4f64068930 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f4f7c009b60 tx=0x7f4f7c009190 comp rx=0 tx=0).stop 2023-11-13T11:29:23.417 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:23.410+0000 7f4f86481640 1 -- 172.21.15.102:0/2051814309 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4f80154370 msgr2=0x7f4f8014d6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:23.417 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:23.410+0000 7f4f86481640 1 --2- 172.21.15.102:0/2051814309 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4f80154370 0x7f4f8014d6b0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f4f7801b000 tx=0x7f4f780196f0 comp rx=0 tx=0).stop 2023-11-13T11:29:23.417 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:23.410+0000 7f4f86481640 1 -- 172.21.15.102:0/2051814309 shutdown_connections 2023-11-13T11:29:23.417 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:23.410+0000 7f4f86481640 1 --2- 172.21.15.102:0/2051814309 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f4f64066470 0x7f4f64068930 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:23.418 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:23.410+0000 7f4f86481640 1 --2- 172.21.15.102:0/2051814309 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4f80154370 0x7f4f8014d6b0 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:23.418 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:23.410+0000 7f4f86481640 1 --2- 172.21.15.102:0/2051814309 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4f80153f90 0x7f4f8014d170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:23.418 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:23.410+0000 7f4f86481640 1 --2- 172.21.15.102:0/2051814309 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4f800b3380 0x7f4f8014af70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:23.418 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:23.410+0000 7f4f86481640 1 -- 172.21.15.102:0/2051814309 >> 172.21.15.102:0/2051814309 conn(0x7f4f800b04d0 msgr2=0x7f4f800ce7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-13T11:29:23.418 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:23.410+0000 7f4f86481640 1 -- 172.21.15.102:0/2051814309 shutdown_connections 2023-11-13T11:29:23.419 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:23.410+0000 7f4f86481640 1 -- 172.21.15.102:0/2051814309 wait complete. 2023-11-13T11:29:23.435 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-13T11:29:23.575 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:23.570+0000 7f7fb03f8640 1 Processor -- start 2023-11-13T11:29:23.575 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:23.570+0000 7f7fb03f8640 1 -- start start 2023-11-13T11:29:23.577 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:23.570+0000 7f7fb03f8640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f7fa8159420 0x7f7fa80b3580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:23.577 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:23.570+0000 7f7fb03f8640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f7fa8070320 0x7f7fa806c160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:23.578 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:23.570+0000 7f7fb03f8640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7fa80b2af0 con 0x7f7fa80ce320 2023-11-13T11:29:23.578 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:23.570+0000 7f7fb03f8640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7fa80b2dd0 con 0x7f7fa8070320 2023-11-13T11:29:23.578 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:23.570+0000 7f7fb03f8640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7fa80b30b0 con 0x7f7fa8159420 2023-11-13T11:29:23.578 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:23.570+0000 7f7fae995640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f7fa8070320 0x7f7fa806c160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:23.578 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:23.570+0000 7f7fae995640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f7fa8070320 0x7f7fa806c160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:50612/0 (socket says 172.21.15.102:50612) 2023-11-13T11:29:23.579 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:23.570+0000 7f7fae995640 1 -- 172.21.15.102:0/2633447310 learned_addr learned my addr 172.21.15.102:0/2633447310 (peer_addr_for_me v2:172.21.15.102:0/0) 2023-11-13T11:29:23.579 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:23.570+0000 7f7fae194640 1 --2- 172.21.15.102:0/2633447310 >> v2:172.21.15.154:3300/0 conn(0x7f7fa8159420 0x7f7fa80b3580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:23.579 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:23.570+0000 7f7fae995640 1 -- 172.21.15.102:0/2633447310 >> v2:172.21.15.154:3300/0 conn(0x7f7fa8159420 msgr2=0x7f7fa80b3580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-13T11:29:23.579 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:23.570+0000 7f7fae995640 1 --2- 172.21.15.102:0/2633447310 >> v2:172.21.15.154:3300/0 conn(0x7f7fa8159420 0x7f7fa80b3580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:23.579 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:23.570+0000 7f7fae995640 1 -- 172.21.15.102:0/2633447310 >> v1:172.21.15.154:6789/0 conn(0x7f7fa80ce320 legacy=0x7f7fa806fc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-13T11:29:23.580 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:23.570+0000 7f7fae995640 1 -- 172.21.15.102:0/2633447310 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7fa806bc40 con 0x7f7fa8070320 2023-11-13T11:29:23.580 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:23.570+0000 7f7fae194640 1 --2- 172.21.15.102:0/2633447310 >> v2:172.21.15.154:3300/0 conn(0x7f7fa8159420 0x7f7fa80b3580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-13T11:29:23.581 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:23.574+0000 7f7fae995640 1 --2- 172.21.15.102:0/2633447310 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7fa8070320 0x7f7fa806c160 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f7fa806b120 tx=0x7f7fa001eb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6cbbb6fd7ce8558e server_cookie=0 in_seq=0 out_seq=0 2023-11-13T11:29:23.581 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:23.574+0000 7f7fad192640 1 -- 172.21.15.102:0/2633447310 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fa000b2d0 con 0x7f7fa8070320 2023-11-13T11:29:23.582 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:23.574+0000 7f7fad192640 1 -- 172.21.15.102:0/2633447310 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7fa000b430 con 0x7f7fa8070320 2023-11-13T11:29:23.582 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:23.574+0000 7f7fad192640 1 -- 172.21.15.102:0/2633447310 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fa00a7a10 con 0x7f7fa8070320 2023-11-13T11:29:23.582 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:23.574+0000 7f7fb03f8640 1 -- 172.21.15.102:0/2633447310 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7fa8070320 msgr2=0x7f7fa806c160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:23.582 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:23.574+0000 7f7fb03f8640 1 --2- 172.21.15.102:0/2633447310 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7fa8070320 0x7f7fa806c160 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f7fa806b120 tx=0x7f7fa001eb90 comp rx=0 tx=0).stop 2023-11-13T11:29:23.582 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:23.574+0000 7f7fb03f8640 1 -- 172.21.15.102:0/2633447310 shutdown_connections 2023-11-13T11:29:23.583 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:23.574+0000 7f7fb03f8640 1 --2- 172.21.15.102:0/2633447310 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7fa8070320 0x7f7fa806c160 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:23.583 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:23.574+0000 7f7fb03f8640 1 --2- 172.21.15.102:0/2633447310 >> v2:172.21.15.154:3300/0 conn(0x7f7fa8159420 0x7f7fa80b3580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:23.583 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:23.574+0000 7f7fb03f8640 1 -- 172.21.15.102:0/2633447310 >> 172.21.15.102:0/2633447310 conn(0x7f7fa806a410 msgr2=0x7f7fa806a820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-13T11:29:23.583 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:23.574+0000 7f7fb03f8640 1 -- 172.21.15.102:0/2633447310 shutdown_connections 2023-11-13T11:29:23.583 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:23.574+0000 7f7fb03f8640 1 -- 172.21.15.102:0/2633447310 wait complete. 2023-11-13T11:29:23.585 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:23.578+0000 7f7fb03f8640 1 Processor -- start 2023-11-13T11:29:23.585 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:23.578+0000 7f7fb03f8640 1 -- start start 2023-11-13T11:29:23.586 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:23.578+0000 7f7fb03f8640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7fa8070320 0x7f7fa81f5960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:23.586 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:23.578+0000 7f7fb03f8640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7fa80ce320 0x7f7fa8157430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:23.586 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:23.578+0000 7f7fb03f8640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7fa8159420 0x7f7fa8150930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:23.587 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:23.578+0000 7f7fb03f8640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7fa815b990 con 0x7f7fa8070320 2023-11-13T11:29:23.587 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:23.578+0000 7f7fb03f8640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7fa8157d60 con 0x7f7fa8159420 2023-11-13T11:29:23.587 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:23.578+0000 7f7fb03f8640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7fa8158040 con 0x7f7fa80ce320 2023-11-13T11:29:23.587 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:23.578+0000 7f7fae194640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7fa8070320 0x7f7fa81f5960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:23.587 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:23.578+0000 7f7fae194640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7fa8070320 0x7f7fa81f5960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:50620/0 (socket says 172.21.15.102:50620) 2023-11-13T11:29:23.588 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:23.578+0000 7f7fae194640 1 -- 172.21.15.102:0/3961108771 learned_addr learned my addr 172.21.15.102:0/3961108771 (peer_addr_for_me v2:172.21.15.102:0/0) 2023-11-13T11:29:23.588 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:23.578+0000 7f7fae194640 1 -- 172.21.15.102:0/3961108771 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7fa80ce320 msgr2=0x7f7fa8157430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:23.588 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:23.578+0000 7f7fae194640 1 --2- 172.21.15.102:0/3961108771 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7fa80ce320 0x7f7fa8157430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:23.588 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:23.578+0000 7f7fae194640 1 -- 172.21.15.102:0/3961108771 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7fa8159420 msgr2=0x7f7fa8150930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:23.588 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:23.578+0000 7f7fae194640 1 --2- 172.21.15.102:0/3961108771 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7fa8159420 0x7f7fa8150930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:23.589 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:23.578+0000 7f7fae194640 1 -- 172.21.15.102:0/3961108771 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7fa000bd40 con 0x7f7fa8070320 2023-11-13T11:29:23.589 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:23.578+0000 7f7fae194640 1 --2- 172.21.15.102:0/3961108771 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7fa8070320 0x7f7fa81f5960 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f7fa400c7f0 tx=0x7f7fa400ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-13T11:29:23.589 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:23.578+0000 7f7f9effd640 1 -- 172.21.15.102:0/3961108771 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fa4007820 con 0x7f7fa8070320 2023-11-13T11:29:23.589 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:23.578+0000 7f7f9effd640 1 -- 172.21.15.102:0/3961108771 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7fa4007980 con 0x7f7fa8070320 2023-11-13T11:29:23.589 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:23.578+0000 7f7f9effd640 1 -- 172.21.15.102:0/3961108771 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fa4007d30 con 0x7f7fa8070320 2023-11-13T11:29:23.589 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:23.578+0000 7f7fb03f8640 1 -- 172.21.15.102:0/3961108771 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7fa815bc30 con 0x7f7fa8070320 2023-11-13T11:29:23.590 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:23.578+0000 7f7fb03f8640 1 -- 172.21.15.102:0/3961108771 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7fa8157970 con 0x7f7fa8070320 2023-11-13T11:29:23.591 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:23.578+0000 7f7fb03f8640 1 -- 172.21.15.102:0/3961108771 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7fa815b7f0 con 0x7f7fa8070320 2023-11-13T11:29:23.591 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:23.582+0000 7f7f9effd640 1 -- 172.21.15.102:0/3961108771 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f7fa40113f0 con 0x7f7fa8070320 2023-11-13T11:29:23.591 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:23.582+0000 7f7f9effd640 1 --2- 172.21.15.102:0/3961108771 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f7f8c066470 0x7f7f8c068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:23.591 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:23.582+0000 7f7f9effd640 1 -- 172.21.15.102:0/3961108771 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f7fa4084180 con 0x7f7fa8070320 2023-11-13T11:29:23.592 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:23.582+0000 7f7fad993640 1 --2- 172.21.15.102:0/3961108771 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f7f8c066470 0x7f7f8c068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:23.592 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:23.582+0000 7f7fad993640 1 --2- 172.21.15.102:0/3961108771 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f7f8c066470 0x7f7f8c068930 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f7fa80ae0a0 tx=0x7f7f980079c0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-13T11:29:23.592 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:23.586+0000 7f7f9effd640 1 -- 172.21.15.102:0/3961108771 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f7fa815b7f0 con 0x7f7fa8070320 2023-11-13T11:29:23.744 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:23.738+0000 7f7fb03f8640 1 -- 172.21.15.102:0/3961108771 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f7fa815b7f0 con 0x7f7fa8070320 2023-11-13T11:29:23.745 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:23.738+0000 7f7f9effd640 1 -- 172.21.15.102:0/3961108771 <== mon.0 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v22) v1 ==== 104+0+11 (secure 0 0 0) 0x7f7fa815b7f0 con 0x7f7fa8070320 2023-11-13T11:29:23.745 INFO:teuthology.orchestra.run.smithi102.stdout:pg_num: 32 2023-11-13T11:29:23.747 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:23.738+0000 7f7fb03f8640 1 -- 172.21.15.102:0/3961108771 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f7f8c066470 msgr2=0x7f7f8c068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:23.747 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:23.738+0000 7f7fb03f8640 1 --2- 172.21.15.102:0/3961108771 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f7f8c066470 0x7f7f8c068930 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f7fa80ae0a0 tx=0x7f7f980079c0 comp rx=0 tx=0).stop 2023-11-13T11:29:23.747 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:23.738+0000 7f7fb03f8640 1 -- 172.21.15.102:0/3961108771 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7fa8070320 msgr2=0x7f7fa81f5960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:23.747 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:23.738+0000 7f7fb03f8640 1 --2- 172.21.15.102:0/3961108771 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7fa8070320 0x7f7fa81f5960 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f7fa400c7f0 tx=0x7f7fa400ccb0 comp rx=0 tx=0).stop 2023-11-13T11:29:23.747 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:23.738+0000 7f7fb03f8640 1 -- 172.21.15.102:0/3961108771 shutdown_connections 2023-11-13T11:29:23.748 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:23.738+0000 7f7fb03f8640 1 --2- 172.21.15.102:0/3961108771 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7fa8159420 0x7f7fa8150930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:23.748 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:23.738+0000 7f7fb03f8640 1 --2- 172.21.15.102:0/3961108771 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7fa80ce320 0x7f7fa8157430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:23.748 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:23.738+0000 7f7fb03f8640 1 --2- 172.21.15.102:0/3961108771 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f7f8c066470 0x7f7f8c068930 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:23.748 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:23.738+0000 7f7fb03f8640 1 --2- 172.21.15.102:0/3961108771 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7fa8070320 0x7f7fa81f5960 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:23.748 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:23.738+0000 7f7fb03f8640 1 -- 172.21.15.102:0/3961108771 >> 172.21.15.102:0/3961108771 conn(0x7f7fa806a410 msgr2=0x7f7fa806fc10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-13T11:29:23.749 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:23.742+0000 7f7fb03f8640 1 -- 172.21.15.102:0/3961108771 shutdown_connections 2023-11-13T11:29:23.749 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:23.742+0000 7f7fb03f8640 1 -- 172.21.15.102:0/3961108771 wait complete. 2023-11-13T11:29:23.766 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-13T11:29:23.906 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:23.898+0000 7fd2df955640 1 Processor -- start 2023-11-13T11:29:23.907 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:23.898+0000 7fd2df955640 1 -- start start 2023-11-13T11:29:23.908 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:23.902+0000 7fd2df955640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fd2d8159b30 0x7fd2d806fc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:23.908 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:23.902+0000 7fd2df955640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd2d80cf2d0 0x7fd2d80b3520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:23.908 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:23.902+0000 7fd2df955640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd2d80b21f0 con 0x7fd2d80711c0 2023-11-13T11:29:23.908 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:23.902+0000 7fd2df955640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd2d8071650 con 0x7fd2d8159b30 2023-11-13T11:29:23.909 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:23.902+0000 7fd2df955640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd2d80b2440 con 0x7fd2d80cf2d0 2023-11-13T11:29:23.909 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:23.902+0000 7fd2dcef0640 1 --1- >> v1:172.21.15.102:6789/0 conn(0x7fd2d80711c0 0x7fd2d80cebc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.102:6789/0 says I am v1:172.21.15.102:36734/0 (socket says 172.21.15.102:36734) 2023-11-13T11:29:23.909 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:23.902+0000 7fd2dcef0640 1 -- 172.21.15.102:0/2688371832 learned_addr learned my addr 172.21.15.102:0/2688371832 (peer_addr_for_me v1:172.21.15.102:0/0) 2023-11-13T11:29:23.911 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:23.902+0000 7fd2dd6f1640 1 --2- 172.21.15.102:0/2688371832 >> v2:172.21.15.154:3300/0 conn(0x7fd2d8159b30 0x7fd2d806fc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:23.911 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:23.902+0000 7fd2ddef2640 1 --2- 172.21.15.102:0/2688371832 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd2d80cf2d0 0x7fd2d80b3520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:23.911 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:23.902+0000 7fd2cffff640 1 -- 172.21.15.102:0/2688371832 <== mon.0 v1:172.21.15.102:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1894055294 0 0) 0x7fd2d80b21f0 con 0x7fd2d80711c0 2023-11-13T11:29:23.911 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:23.902+0000 7fd2cffff640 1 -- 172.21.15.102:0/2688371832 --> v1:172.21.15.102:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd2c4003530 con 0x7fd2d80711c0 2023-11-13T11:29:23.912 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:23.902+0000 7fd2cffff640 1 -- 172.21.15.102:0/2688371832 <== mon.0 v1:172.21.15.102:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2401201561 0 0) 0x7fd2c4003530 con 0x7fd2d80711c0 2023-11-13T11:29:23.912 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:23.902+0000 7fd2cffff640 1 -- 172.21.15.102:0/2688371832 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd2d80cf2d0 msgr2=0x7fd2d80b3520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-13T11:29:23.912 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:23.902+0000 7fd2cffff640 1 --2- 172.21.15.102:0/2688371832 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd2d80cf2d0 0x7fd2d80b3520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:23.912 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:23.902+0000 7fd2cffff640 1 -- 172.21.15.102:0/2688371832 >> v2:172.21.15.154:3300/0 conn(0x7fd2d8159b30 msgr2=0x7fd2d806fc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-13T11:29:23.912 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:23.902+0000 7fd2cffff640 1 --2- 172.21.15.102:0/2688371832 >> v2:172.21.15.154:3300/0 conn(0x7fd2d8159b30 0x7fd2d806fc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:23.913 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:23.902+0000 7fd2cffff640 1 -- 172.21.15.102:0/2688371832 --> v1:172.21.15.102:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2d80b2720 con 0x7fd2d80711c0 2023-11-13T11:29:23.913 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:23.902+0000 7fd2cffff640 1 -- 172.21.15.102:0/2688371832 <== mon.0 v1:172.21.15.102:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 895381068 0 0) 0x7fd2c8001680 con 0x7fd2d80711c0 2023-11-13T11:29:23.913 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:23.902+0000 7fd2cffff640 1 -- 172.21.15.102:0/2688371832 >> v1:172.21.15.102:6789/0 conn(0x7fd2d80711c0 legacy=0x7fd2d80cebc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:23.913 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:23.902+0000 7fd2cffff640 1 --2- 172.21.15.102:0/2688371832 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd2c4003980 0x7fd2c4003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:23.913 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:23.902+0000 7fd2cffff640 1 --2- 172.21.15.102:0/2688371832 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd2c40047d0 0x7fd2c4004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:23.914 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:23.902+0000 7fd2cffff640 1 --2- 172.21.15.102:0/2688371832 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd2c4005190 0x7fd2c400dba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:23.914 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:23.902+0000 7fd2cffff640 1 -- 172.21.15.102:0/2688371832 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2d8071650 con 0x7fd2c40047d0 2023-11-13T11:29:23.914 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:23.902+0000 7fd2cffff640 1 -- 172.21.15.102:0/2688371832 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2d80b2440 con 0x7fd2c4003980 2023-11-13T11:29:23.914 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:23.902+0000 7fd2cffff640 1 -- 172.21.15.102:0/2688371832 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd2c400e0e0 con 0x7fd2c4005190 2023-11-13T11:29:23.914 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:23.902+0000 7fd2ddef2640 1 --2- 172.21.15.102:0/2688371832 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd2d80cf2d0 0x7fd2d80b3520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-13T11:29:23.914 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:23.902+0000 7fd2dcef0640 1 --2- 172.21.15.102:0/2688371832 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd2c40047d0 0x7fd2c4004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:23.915 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:23.902+0000 7fd2dd6f1640 1 --2- 172.21.15.102:0/2688371832 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd2c4003980 0x7fd2c4003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:23.915 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:23.902+0000 7fd2ddef2640 1 --2- 172.21.15.102:0/2688371832 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd2c4005190 0x7fd2c400dba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:23.915 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:23.902+0000 7fd2dcef0640 1 -- 172.21.15.102:0/2688371832 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd2c4005190 msgr2=0x7fd2c400dba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-13T11:29:23.915 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:23.902+0000 7fd2dcef0640 1 --2- 172.21.15.102:0/2688371832 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd2c4005190 0x7fd2c400dba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:23.915 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:23.902+0000 7fd2dcef0640 1 -- 172.21.15.102:0/2688371832 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd2c4003980 msgr2=0x7fd2c4003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-13T11:29:23.916 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:23.902+0000 7fd2dcef0640 1 --2- 172.21.15.102:0/2688371832 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd2c4003980 0x7fd2c4003da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:23.916 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:23.902+0000 7fd2dcef0640 1 -- 172.21.15.102:0/2688371832 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2c4003530 con 0x7fd2c40047d0 2023-11-13T11:29:23.919 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:23.906+0000 7fd2dcef0640 1 --2- 172.21.15.102:0/2688371832 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd2c40047d0 0x7fd2c4004c50 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fd2c800c270 tx=0x7fd2c801f3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d7fb754a9bb87511 server_cookie=0 in_seq=0 out_seq=0 2023-11-13T11:29:23.919 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:23.906+0000 7fd2cffff640 1 -- 172.21.15.102:0/2688371832 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2c8005ae0 con 0x7fd2c40047d0 2023-11-13T11:29:23.920 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:23.906+0000 7fd2cffff640 1 -- 172.21.15.102:0/2688371832 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd2c80ab070 con 0x7fd2c40047d0 2023-11-13T11:29:23.920 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:23.906+0000 7fd2cffff640 1 -- 172.21.15.102:0/2688371832 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2c8005ea0 con 0x7fd2c40047d0 2023-11-13T11:29:23.920 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:23.906+0000 7fd2df955640 1 -- 172.21.15.102:0/2688371832 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd2c40047d0 msgr2=0x7fd2c4004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:23.920 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:23.906+0000 7fd2df955640 1 --2- 172.21.15.102:0/2688371832 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd2c40047d0 0x7fd2c4004c50 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fd2c800c270 tx=0x7fd2c801f3b0 comp rx=0 tx=0).stop 2023-11-13T11:29:23.920 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:23.906+0000 7fd2ddef2640 1 -- 172.21.15.102:0/2688371832 reap_dead start 2023-11-13T11:29:23.920 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:23.906+0000 7fd2df955640 1 -- 172.21.15.102:0/2688371832 shutdown_connections 2023-11-13T11:29:23.921 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:23.906+0000 7fd2df955640 1 -- 172.21.15.102:0/2688371832 >> 172.21.15.102:0/2688371832 conn(0x7fd2d806a410 msgr2=0x7fd2d806a820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-13T11:29:23.921 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:23.906+0000 7fd2df955640 1 -- 172.21.15.102:0/2688371832 shutdown_connections 2023-11-13T11:29:23.921 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:23.906+0000 7fd2df955640 1 -- 172.21.15.102:0/2688371832 wait complete. 2023-11-13T11:29:23.921 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:23.910+0000 7fd2df955640 1 Processor -- start 2023-11-13T11:29:23.921 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:23.910+0000 7fd2df955640 1 -- start start 2023-11-13T11:29:23.922 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:23.910+0000 7fd2df955640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd2c40047d0 0x7fd2d814b4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:23.922 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:23.910+0000 7fd2df955640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd2d815c390 0x7fd2d815c7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:23.922 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:23.910+0000 7fd2df955640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd2d80ccfd0 0x7fd2d80cd450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:23.922 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:23.910+0000 7fd2df955640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2d815b1e0 con 0x7fd2c40047d0 2023-11-13T11:29:23.923 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:23.910+0000 7fd2df955640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2d80cd990 con 0x7fd2d815c390 2023-11-13T11:29:23.923 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:23.910+0000 7fd2df955640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd2d814cb90 con 0x7fd2d80ccfd0 2023-11-13T11:29:23.923 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:23.910+0000 7fd2dd6f1640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd2c40047d0 0x7fd2d814b4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:23.924 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:23.910+0000 7fd2dd6f1640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd2c40047d0 0x7fd2d814b4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:50638/0 (socket says 172.21.15.102:50638) 2023-11-13T11:29:23.924 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:23.910+0000 7fd2dd6f1640 1 -- 172.21.15.102:0/2215335064 learned_addr learned my addr 172.21.15.102:0/2215335064 (peer_addr_for_me v2:172.21.15.102:0/0) 2023-11-13T11:29:23.924 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:23.910+0000 7fd2ddef2640 1 --2- 172.21.15.102:0/2215335064 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd2d80ccfd0 0x7fd2d80cd450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:23.925 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:23.910+0000 7fd2dcef0640 1 --2- 172.21.15.102:0/2215335064 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd2d815c390 0x7fd2d815c7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:23.925 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:23.910+0000 7fd2dd6f1640 1 -- 172.21.15.102:0/2215335064 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd2d80ccfd0 msgr2=0x7fd2d80cd450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:23.925 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:23.910+0000 7fd2dd6f1640 1 --2- 172.21.15.102:0/2215335064 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd2d80ccfd0 0x7fd2d80cd450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:23.925 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:23.910+0000 7fd2dd6f1640 1 -- 172.21.15.102:0/2215335064 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd2d815c390 msgr2=0x7fd2d815c7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:23.925 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:23.910+0000 7fd2dd6f1640 1 --2- 172.21.15.102:0/2215335064 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd2d815c390 0x7fd2d815c7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:23.926 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:23.910+0000 7fd2dd6f1640 1 -- 172.21.15.102:0/2215335064 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2d814ba20 con 0x7fd2c40047d0 2023-11-13T11:29:23.926 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:23.910+0000 7fd2dd6f1640 1 --2- 172.21.15.102:0/2215335064 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd2c40047d0 0x7fd2d814b4e0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fd2d4011960 tx=0x7fd2d4011e20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-13T11:29:23.926 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:23.910+0000 7fd2cdffb640 1 -- 172.21.15.102:0/2215335064 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2d400fa90 con 0x7fd2c40047d0 2023-11-13T11:29:23.926 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:23.910+0000 7fd2cdffb640 1 -- 172.21.15.102:0/2215335064 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd2d400fbf0 con 0x7fd2c40047d0 2023-11-13T11:29:23.926 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:23.910+0000 7fd2cdffb640 1 -- 172.21.15.102:0/2215335064 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2d4014440 con 0x7fd2c40047d0 2023-11-13T11:29:23.927 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:23.910+0000 7fd2df955640 1 -- 172.21.15.102:0/2215335064 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd2d815a660 con 0x7fd2c40047d0 2023-11-13T11:29:23.927 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:23.910+0000 7fd2df955640 1 -- 172.21.15.102:0/2215335064 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd2d815ac20 con 0x7fd2c40047d0 2023-11-13T11:29:23.927 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:23.914+0000 7fd2df955640 1 -- 172.21.15.102:0/2215335064 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd2d8067640 con 0x7fd2c40047d0 2023-11-13T11:29:23.928 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:23.914+0000 7fd2cdffb640 1 -- 172.21.15.102:0/2215335064 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fd2d40145a0 con 0x7fd2c40047d0 2023-11-13T11:29:23.928 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:23.914+0000 7fd2cdffb640 1 --2- 172.21.15.102:0/2215335064 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7fd2bc066470 0x7fd2bc068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:23.928 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:23.914+0000 7fd2cdffb640 1 -- 172.21.15.102:0/2215335064 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd2d4084670 con 0x7fd2c40047d0 2023-11-13T11:29:23.929 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:23.914+0000 7fd2dcef0640 1 --2- 172.21.15.102:0/2215335064 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7fd2bc066470 0x7fd2bc068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:23.929 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:23.914+0000 7fd2dcef0640 1 --2- 172.21.15.102:0/2215335064 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7fd2bc066470 0x7fd2bc068930 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fd2c80ae000 tx=0x7fd2c8001a80 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-13T11:29:23.929 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:23.918+0000 7fd2cdffb640 1 -- 172.21.15.102:0/2215335064 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fd2d4051af0 con 0x7fd2c40047d0 2023-11-13T11:29:24.077 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:24.070+0000 7fd2df955640 1 -- 172.21.15.102:0/2215335064 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fd2d8068520 con 0x7fd2c40047d0 2023-11-13T11:29:24.078 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:24.070+0000 7fd2cdffb640 1 -- 172.21.15.102:0/2215335064 <== mon.0 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v22) v1 ==== 100+0+11 (secure 0 0 0) 0x7fd2d4055110 con 0x7fd2c40047d0 2023-11-13T11:29:24.079 INFO:teuthology.orchestra.run.smithi102.stdout:pg_num: 64 2023-11-13T11:29:24.080 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:24.074+0000 7fd2df955640 1 -- 172.21.15.102:0/2215335064 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7fd2bc066470 msgr2=0x7fd2bc068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:24.080 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:24.074+0000 7fd2df955640 1 --2- 172.21.15.102:0/2215335064 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7fd2bc066470 0x7fd2bc068930 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fd2c80ae000 tx=0x7fd2c8001a80 comp rx=0 tx=0).stop 2023-11-13T11:29:24.080 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:24.074+0000 7fd2df955640 1 -- 172.21.15.102:0/2215335064 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd2c40047d0 msgr2=0x7fd2d814b4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:24.081 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:24.074+0000 7fd2df955640 1 --2- 172.21.15.102:0/2215335064 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd2c40047d0 0x7fd2d814b4e0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fd2d4011960 tx=0x7fd2d4011e20 comp rx=0 tx=0).stop 2023-11-13T11:29:24.081 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:24.074+0000 7fd2df955640 1 -- 172.21.15.102:0/2215335064 shutdown_connections 2023-11-13T11:29:24.081 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:24.074+0000 7fd2df955640 1 --2- 172.21.15.102:0/2215335064 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd2d80ccfd0 0x7fd2d80cd450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:24.081 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:24.074+0000 7fd2df955640 1 --2- 172.21.15.102:0/2215335064 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd2d815c390 0x7fd2d815c7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:24.081 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:24.074+0000 7fd2df955640 1 --2- 172.21.15.102:0/2215335064 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7fd2bc066470 0x7fd2bc068930 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:24.082 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:24.074+0000 7fd2df955640 1 --2- 172.21.15.102:0/2215335064 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd2c40047d0 0x7fd2d814b4e0 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:24.082 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:24.074+0000 7fd2df955640 1 -- 172.21.15.102:0/2215335064 >> 172.21.15.102:0/2215335064 conn(0x7fd2d806a410 msgr2=0x7fd2d806c430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-13T11:29:24.082 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:24.074+0000 7fd2df955640 1 -- 172.21.15.102:0/2215335064 shutdown_connections 2023-11-13T11:29:24.082 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:24.074+0000 7fd2df955640 1 -- 172.21.15.102:0/2215335064 wait complete. 2023-11-13T11:29:24.099 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-13T11:29:24.237 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:24.230+0000 7f04e6a9c640 1 Processor -- start 2023-11-13T11:29:24.237 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:24.230+0000 7f04e6a9c640 1 -- start start 2023-11-13T11:29:24.238 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:24.230+0000 7f04e6a9c640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f04e006dc70 0x7f04e006ba90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:24.238 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:24.230+0000 7f04e6a9c640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f04e006bfd0 0x7f04e013f6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:24.238 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:24.230+0000 7f04e6a9c640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f04e013e530 con 0x7f04e013df40 2023-11-13T11:29:24.238 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:24.230+0000 7f04e6a9c640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f04e006c480 con 0x7f04e006dc70 2023-11-13T11:29:24.239 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:24.230+0000 7f04e6a9c640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f04e015f0a0 con 0x7f04e006bfd0 2023-11-13T11:29:24.239 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:24.230+0000 7f04d7fff640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f04e006dc70 0x7f04e006ba90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:24.240 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:24.230+0000 7f04d7fff640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f04e006dc70 0x7f04e006ba90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:50646/0 (socket says 172.21.15.102:50646) 2023-11-13T11:29:24.240 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:24.230+0000 7f04d7fff640 1 -- 172.21.15.102:0/294247717 learned_addr learned my addr 172.21.15.102:0/294247717 (peer_addr_for_me v2:172.21.15.102:0/0) 2023-11-13T11:29:24.240 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:24.230+0000 7f04e5039640 1 --2- 172.21.15.102:0/294247717 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f04e006bfd0 0x7f04e013f6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:24.240 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:24.234+0000 7f04d7fff640 1 -- 172.21.15.102:0/294247717 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f04e006bfd0 msgr2=0x7f04e013f6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-13T11:29:24.241 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:24.234+0000 7f04d7fff640 1 --2- 172.21.15.102:0/294247717 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f04e006bfd0 0x7f04e013f6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:24.241 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:24.234+0000 7f04d7fff640 1 -- 172.21.15.102:0/294247717 >> v1:172.21.15.154:6789/0 conn(0x7f04e013df40 legacy=0x7f04e015e990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:24.241 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:24.234+0000 7f04d7fff640 1 -- 172.21.15.102:0/294247717 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04e015f290 con 0x7f04e006dc70 2023-11-13T11:29:24.242 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:24.234+0000 7f04d7fff640 1 --2- 172.21.15.102:0/294247717 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f04e006dc70 0x7f04e006ba90 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f04d0009870 tx=0x7f04d001c540 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7dc381d8e5f75cf9 server_cookie=0 in_seq=0 out_seq=0 2023-11-13T11:29:24.243 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:24.234+0000 7f04d77fe640 1 -- 172.21.15.102:0/294247717 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04d00a7070 con 0x7f04e006dc70 2023-11-13T11:29:24.243 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:24.234+0000 7f04d77fe640 1 -- 172.21.15.102:0/294247717 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f04d00ab430 con 0x7f04e006dc70 2023-11-13T11:29:24.243 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:24.234+0000 7f04d77fe640 1 -- 172.21.15.102:0/294247717 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04d00ab7c0 con 0x7f04e006dc70 2023-11-13T11:29:24.243 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:24.234+0000 7f04e6a9c640 1 -- 172.21.15.102:0/294247717 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f04e006dc70 msgr2=0x7f04e006ba90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:24.244 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:24.234+0000 7f04e6a9c640 1 --2- 172.21.15.102:0/294247717 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f04e006dc70 0x7f04e006ba90 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f04d0009870 tx=0x7f04d001c540 comp rx=0 tx=0).stop 2023-11-13T11:29:24.244 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:24.234+0000 7f04e6a9c640 1 -- 172.21.15.102:0/294247717 shutdown_connections 2023-11-13T11:29:24.244 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:24.234+0000 7f04e6a9c640 1 --2- 172.21.15.102:0/294247717 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f04e006bfd0 0x7f04e013f6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:24.244 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:24.234+0000 7f04e6a9c640 1 --2- 172.21.15.102:0/294247717 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f04e006dc70 0x7f04e006ba90 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:24.245 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:24.234+0000 7f04e6a9c640 1 -- 172.21.15.102:0/294247717 >> 172.21.15.102:0/294247717 conn(0x7f04e00b0870 msgr2=0x7f04e00b0c80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-13T11:29:24.245 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:24.234+0000 7f04e6a9c640 1 -- 172.21.15.102:0/294247717 shutdown_connections 2023-11-13T11:29:24.245 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:24.234+0000 7f04e6a9c640 1 -- 172.21.15.102:0/294247717 wait complete. 2023-11-13T11:29:24.247 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:24.238+0000 7f04e6a9c640 1 Processor -- start 2023-11-13T11:29:24.247 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:24.238+0000 7f04e6a9c640 1 -- start start 2023-11-13T11:29:24.248 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:24.238+0000 7f04e6a9c640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f04e006bfd0 0x7f04e0137820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:24.248 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:24.238+0000 7f04e6a9c640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f04e006dc70 0x7f04e00cd4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:24.248 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:24.238+0000 7f04e6a9c640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f04e013df40 0x7f04e015c7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:24.248 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:24.238+0000 7f04e6a9c640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04e015b710 con 0x7f04e006dc70 2023-11-13T11:29:24.249 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:24.238+0000 7f04e6a9c640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04e015b9f0 con 0x7f04e013df40 2023-11-13T11:29:24.249 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:24.238+0000 7f04e6a9c640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f04e015bcd0 con 0x7f04e006bfd0 2023-11-13T11:29:24.249 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:24.238+0000 7f04d7fff640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f04e006dc70 0x7f04e00cd4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:24.249 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:24.238+0000 7f04d7fff640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f04e006dc70 0x7f04e00cd4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:50650/0 (socket says 172.21.15.102:50650) 2023-11-13T11:29:24.249 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:24.238+0000 7f04d7fff640 1 -- 172.21.15.102:0/544027701 learned_addr learned my addr 172.21.15.102:0/544027701 (peer_addr_for_me v2:172.21.15.102:0/0) 2023-11-13T11:29:24.250 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:24.238+0000 7f04d7fff640 1 -- 172.21.15.102:0/544027701 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f04e006bfd0 msgr2=0x7f04e0137820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:24.250 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:24.238+0000 7f04d7fff640 1 --2- 172.21.15.102:0/544027701 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f04e006bfd0 0x7f04e0137820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:24.250 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:24.238+0000 7f04d7fff640 1 -- 172.21.15.102:0/544027701 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f04e013df40 msgr2=0x7f04e015c7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:24.250 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:24.238+0000 7f04d7fff640 1 --2- 172.21.15.102:0/544027701 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f04e013df40 0x7f04e015c7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:24.251 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:24.238+0000 7f04d7fff640 1 -- 172.21.15.102:0/544027701 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04d00094d0 con 0x7f04e006dc70 2023-11-13T11:29:24.251 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:24.238+0000 7f04d7fff640 1 --2- 172.21.15.102:0/544027701 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f04e006dc70 0x7f04e00cd4c0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f04d00ad040 tx=0x7f04d00192e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-13T11:29:24.251 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:24.238+0000 7f04d57fa640 1 -- 172.21.15.102:0/544027701 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04d00bc070 con 0x7f04e006dc70 2023-11-13T11:29:24.251 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:24.238+0000 7f04d57fa640 1 -- 172.21.15.102:0/544027701 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f04d00b4420 con 0x7f04e006dc70 2023-11-13T11:29:24.251 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:24.238+0000 7f04e6a9c640 1 -- 172.21.15.102:0/544027701 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f04e015bfb0 con 0x7f04e006dc70 2023-11-13T11:29:24.252 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:24.238+0000 7f04d57fa640 1 -- 172.21.15.102:0/544027701 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04d00b47d0 con 0x7f04e006dc70 2023-11-13T11:29:24.252 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:24.242+0000 7f04e6a9c640 1 -- 172.21.15.102:0/544027701 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f04e0137d60 con 0x7f04e006dc70 2023-11-13T11:29:24.252 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:24.242+0000 7f04e6a9c640 1 -- 172.21.15.102:0/544027701 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f04e0068520 con 0x7f04e006dc70 2023-11-13T11:29:24.253 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:24.242+0000 7f04d57fa640 1 -- 172.21.15.102:0/544027701 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f04d00b4930 con 0x7f04e006dc70 2023-11-13T11:29:24.253 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:24.242+0000 7f04d57fa640 1 --2- 172.21.15.102:0/544027701 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f04cc0664a0 0x7f04cc068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:24.253 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:24.242+0000 7f04d57fa640 1 -- 172.21.15.102:0/544027701 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f04d011d740 con 0x7f04e006dc70 2023-11-13T11:29:24.254 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:24.242+0000 7f04e4838640 1 --2- 172.21.15.102:0/544027701 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f04cc0664a0 0x7f04cc068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:24.254 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:24.246+0000 7f04e4838640 1 --2- 172.21.15.102:0/544027701 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f04cc0664a0 0x7f04cc068960 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f04dc000f70 tx=0x7f04dc0079c0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-13T11:29:24.254 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:24.246+0000 7f04d57fa640 1 -- 172.21.15.102:0/544027701 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f04d00eabb0 con 0x7f04e006dc70 2023-11-13T11:29:24.404 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:24.398+0000 7f04e6a9c640 1 -- 172.21.15.102:0/544027701 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f04e015c460 con 0x7f04e006dc70 2023-11-13T11:29:24.405 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:24.398+0000 7f04d57fa640 1 -- 172.21.15.102:0/544027701 <== mon.0 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+16545 (secure 0 0 0) 0x7f04d00ee1d0 con 0x7f04e006dc70 2023-11-13T11:29:24.406 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T11:29:24.406 INFO:teuthology.orchestra.run.smithi102.stdout:{"epoch":22,"fsid":"97b3eb2b-7ccf-4aae-8d92-bff986c671ea","created":"2023-11-13T11:28:31.836724+0000","modified":"2023-11-13T11:28:58.608314+0000","last_up_change":"2023-11-13T11:28:44.876638+0000","last_in_change":"2023-11-13T11:28:35.312740+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-13T11:28:44.981356+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-13T11:28:55.958525+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-13T11:28:56.394264+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"bdefaa17-fcca-4c86-aa40-27dc33a789af","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6800","nonce":53303834},{"type":"v1","addr":"172.21.15.102:6801","nonce":53303834}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6802","nonce":53303834},{"type":"v1","addr":"172.21.15.102:6803","nonce":53303834}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6806","nonce":53303834},{"type":"v1","addr":"172.21.15.102:6807","nonce":53303834}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6804","nonce":53303834},{"type":"v1","addr":"172.21.15.102:6805","nonce":53303834}]},"public_addr":"172.21.15.102:6801/53303834","cluster_addr":"172.21.15.102:6803/53303834","heartbeat_back_addr":"172.21.15.102:6807/53303834","heartbeat_front_addr":"172.21.15.102:6805/53303834","state":["exists","up"]},{"osd":1,"uuid":"f0033196-dec9-4ae9-945e-6aeef6dbb47f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6808","nonce":1732708348},{"type":"v1","addr":"172.21.15.102:6809","nonce":1732708348}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6811","nonce":1732708348},{"type":"v1","addr":"172.21.15.102:6813","nonce":1732708348}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6818","nonce":1732708348},{"type":"v1","addr":"172.21.15.102:6820","nonce":1732708348}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6815","nonce":1732708348},{"type":"v1","addr":"172.21.15.102:6817","nonce":1732708348}]},"public_addr":"172.21.15.102:6809/1732708348","cluster_addr":"172.21.15.102:6813/1732708348","heartbeat_back_addr":"172.21.15.102:6820/1732708348","heartbeat_front_addr":"172.21.15.102:6817/1732708348","state":["exists","up"]},{"osd":2,"uuid":"496b0834-351e-4ec2-a714-86ed0c0ff4fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6810","nonce":1825475150},{"type":"v1","addr":"172.21.15.102:6812","nonce":1825475150}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6814","nonce":1825475150},{"type":"v1","addr":"172.21.15.102:6816","nonce":1825475150}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6822","nonce":1825475150},{"type":"v1","addr":"172.21.15.102:6823","nonce":1825475150}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6819","nonce":1825475150},{"type":"v1","addr":"172.21.15.102:6821","nonce":1825475150}]},"public_addr":"172.21.15.102:6812/1825475150","cluster_addr":"172.21.15.102:6816/1825475150","heartbeat_back_addr":"172.21.15.102:6823/1825475150","heartbeat_front_addr":"172.21.15.102:6821/1825475150","state":["exists","up"]},{"osd":3,"uuid":"3ba6cc41-e0a0-4273-86cb-90000c06a55a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6824","nonce":4149355528},{"type":"v1","addr":"172.21.15.102:6825","nonce":4149355528}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6826","nonce":4149355528},{"type":"v1","addr":"172.21.15.102:6827","nonce":4149355528}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6830","nonce":4149355528},{"type":"v1","addr":"172.21.15.102:6831","nonce":4149355528}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6828","nonce":4149355528},{"type":"v1","addr":"172.21.15.102:6829","nonce":4149355528}]},"public_addr":"172.21.15.102:6825/4149355528","cluster_addr":"172.21.15.102:6827/4149355528","heartbeat_back_addr":"172.21.15.102:6831/4149355528","heartbeat_front_addr":"172.21.15.102:6829/4149355528","state":["exists","up"]},{"osd":4,"uuid":"16e797d8-e6e7-4140-95c3-b85283c42a2a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6808","nonce":4028899241},{"type":"v1","addr":"172.21.15.154:6809","nonce":4028899241}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6810","nonce":4028899241},{"type":"v1","addr":"172.21.15.154:6811","nonce":4028899241}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6814","nonce":4028899241},{"type":"v1","addr":"172.21.15.154:6815","nonce":4028899241}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6812","nonce":4028899241},{"type":"v1","addr":"172.21.15.154:6813","nonce":4028899241}]},"public_addr":"172.21.15.154:6809/4028899241","cluster_addr":"172.21.15.154:6811/4028899241","heartbeat_back_addr":"172.21.15.154:6815/4028899241","heartbeat_front_addr":"172.21.15.154:6813/4028899241","state":["exists","up"]},{"osd":5,"uuid":"d6ab225c-1b55-450a-89a9-abe5c3f8d6af","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":3562396827},{"type":"v1","addr":"172.21.15.154:6801","nonce":3562396827}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":3562396827},{"type":"v1","addr":"172.21.15.154:6803","nonce":3562396827}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6806","nonce":3562396827},{"type":"v1","addr":"172.21.15.154:6807","nonce":3562396827}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6804","nonce":3562396827},{"type":"v1","addr":"172.21.15.154:6805","nonce":3562396827}]},"public_addr":"172.21.15.154:6801/3562396827","cluster_addr":"172.21.15.154:6803/3562396827","heartbeat_back_addr":"172.21.15.154:6807/3562396827","heartbeat_front_addr":"172.21.15.154:6805/3562396827","state":["exists","up"]},{"osd":6,"uuid":"96f905ac-491c-4662-8e2b-5bb8e929ab9d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6816","nonce":2933728751},{"type":"v1","addr":"172.21.15.154:6817","nonce":2933728751}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6818","nonce":2933728751},{"type":"v1","addr":"172.21.15.154:6819","nonce":2933728751}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6822","nonce":2933728751},{"type":"v1","addr":"172.21.15.154:6823","nonce":2933728751}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6820","nonce":2933728751},{"type":"v1","addr":"172.21.15.154:6821","nonce":2933728751}]},"public_addr":"172.21.15.154:6817/2933728751","cluster_addr":"172.21.15.154:6819/2933728751","heartbeat_back_addr":"172.21.15.154:6823/2933728751","heartbeat_front_addr":"172.21.15.154:6821/2933728751","state":["exists","up"]},{"osd":7,"uuid":"07012d3b-3ab4-40df-a471-93caed22e2dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6824","nonce":1753500785},{"type":"v1","addr":"172.21.15.154:6825","nonce":1753500785}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6826","nonce":1753500785},{"type":"v1","addr":"172.21.15.154:6827","nonce":1753500785}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6830","nonce":1753500785},{"type":"v1","addr":"172.21.15.154:6831","nonce":1753500785}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6828","nonce":1753500785},{"type":"v1","addr":"172.21.15.154:6829","nonce":1753500785}]},"public_addr":"172.21.15.154:6825/1753500785","cluster_addr":"172.21.15.154:6827/1753500785","heartbeat_back_addr":"172.21.15.154:6831/1753500785","heartbeat_front_addr":"172.21.15.154:6829/1753500785","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-13T11:28:40.978603+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-13T11:28:41.200985+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-13T11:28:41.222815+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-13T11:28:41.202162+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-13T11:28:40.925911+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-13T11:28:41.087725+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-13T11:28:41.072208+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-13T11:28:40.875257+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-13T11:29:24.407 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:24.402+0000 7f04e6a9c640 1 -- 172.21.15.102:0/544027701 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f04cc0664a0 msgr2=0x7f04cc068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:24.408 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:24.402+0000 7f04e6a9c640 1 --2- 172.21.15.102:0/544027701 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f04cc0664a0 0x7f04cc068960 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f04dc000f70 tx=0x7f04dc0079c0 comp rx=0 tx=0).stop 2023-11-13T11:29:24.408 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:24.402+0000 7f04e6a9c640 1 -- 172.21.15.102:0/544027701 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f04e006dc70 msgr2=0x7f04e00cd4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:24.408 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:24.402+0000 7f04e6a9c640 1 --2- 172.21.15.102:0/544027701 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f04e006dc70 0x7f04e00cd4c0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f04d00ad040 tx=0x7f04d00192e0 comp rx=0 tx=0).stop 2023-11-13T11:29:24.408 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:24.402+0000 7f04e6a9c640 1 -- 172.21.15.102:0/544027701 shutdown_connections 2023-11-13T11:29:24.409 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:24.402+0000 7f04e6a9c640 1 --2- 172.21.15.102:0/544027701 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f04e013df40 0x7f04e015c7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:24.409 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:24.402+0000 7f04e6a9c640 1 --2- 172.21.15.102:0/544027701 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f04cc0664a0 0x7f04cc068960 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:24.409 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:24.402+0000 7f04e6a9c640 1 --2- 172.21.15.102:0/544027701 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f04e006dc70 0x7f04e00cd4c0 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:24.409 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:24.402+0000 7f04e6a9c640 1 --2- 172.21.15.102:0/544027701 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f04e006bfd0 0x7f04e0137820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:24.409 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:24.402+0000 7f04e6a9c640 1 -- 172.21.15.102:0/544027701 >> 172.21.15.102:0/544027701 conn(0x7f04e00b0870 msgr2=0x7f04e015e8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-13T11:29:24.410 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:24.402+0000 7f04e6a9c640 1 -- 172.21.15.102:0/544027701 shutdown_connections 2023-11-13T11:29:24.410 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:24.402+0000 7f04e6a9c640 1 -- 172.21.15.102:0/544027701 wait complete. 2023-11-13T11:29:24.426 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-13T11:28:44.981356+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-13T11:28:55.958525+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-11-13T11:28:56.394264+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-13T11:29:24.427 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-13T11:29:24.567 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:24.562+0000 7fa7339f8640 1 Processor -- start 2023-11-13T11:29:24.567 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:24.562+0000 7fa7339f8640 1 -- start start 2023-11-13T11:29:24.569 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:24.562+0000 7fa7339f8640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fa72c0cf2d0 0x7fa72c0ad780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:24.569 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:24.562+0000 7fa7339f8640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7fa72c0adcc0 0x7fa72c0b1920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:24.570 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:24.562+0000 7fa7339f8640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa72c1619a0 con 0x7fa72c1615c0 2023-11-13T11:29:24.570 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:24.562+0000 7fa7339f8640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa72c06cae0 con 0x7fa72c0adcc0 2023-11-13T11:29:24.570 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:24.562+0000 7fa7339f8640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa72c06bd20 con 0x7fa72c0cf2d0 2023-11-13T11:29:24.570 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:24.562+0000 7fa731f95640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7fa72c0adcc0 0x7fa72c0b1920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:24.570 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:24.562+0000 7fa731f95640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7fa72c0adcc0 0x7fa72c0b1920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:50658/0 (socket says 172.21.15.102:50658) 2023-11-13T11:29:24.571 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:24.562+0000 7fa731f95640 1 -- 172.21.15.102:0/1247420800 learned_addr learned my addr 172.21.15.102:0/1247420800 (peer_addr_for_me v2:172.21.15.102:0/0) 2023-11-13T11:29:24.571 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:24.562+0000 7fa730f93640 1 --2- 172.21.15.102:0/1247420800 >> v2:172.21.15.154:3300/0 conn(0x7fa72c0cf2d0 0x7fa72c0ad780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:24.571 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:24.562+0000 7fa731f95640 1 -- 172.21.15.102:0/1247420800 >> v2:172.21.15.154:3300/0 conn(0x7fa72c0cf2d0 msgr2=0x7fa72c0ad780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-13T11:29:24.571 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:24.562+0000 7fa731f95640 1 --2- 172.21.15.102:0/1247420800 >> v2:172.21.15.154:3300/0 conn(0x7fa72c0cf2d0 0x7fa72c0ad780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:24.572 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:24.562+0000 7fa731f95640 1 -- 172.21.15.102:0/1247420800 >> v1:172.21.15.154:6789/0 conn(0x7fa72c1615c0 legacy=0x7fa72c0cebc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:24.572 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:24.562+0000 7fa731f95640 1 -- 172.21.15.102:0/1247420800 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa72c06c000 con 0x7fa72c0adcc0 2023-11-13T11:29:24.573 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:24.566+0000 7fa731f95640 1 --2- 172.21.15.102:0/1247420800 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa72c0adcc0 0x7fa72c0b1920 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fa72c06d5b0 tx=0x7fa72401c9d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9bdbddc6100cd8a6 server_cookie=0 in_seq=0 out_seq=0 2023-11-13T11:29:24.573 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:24.566+0000 7fa723fff640 1 -- 172.21.15.102:0/1247420800 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7240a5890 con 0x7fa72c0adcc0 2023-11-13T11:29:24.573 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:24.566+0000 7fa723fff640 1 -- 172.21.15.102:0/1247420800 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa7240a59f0 con 0x7fa72c0adcc0 2023-11-13T11:29:24.574 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:24.566+0000 7fa723fff640 1 -- 172.21.15.102:0/1247420800 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7240a5d80 con 0x7fa72c0adcc0 2023-11-13T11:29:24.574 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:24.566+0000 7fa7339f8640 1 -- 172.21.15.102:0/1247420800 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa72c0adcc0 msgr2=0x7fa72c0b1920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:24.574 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:24.566+0000 7fa7339f8640 1 --2- 172.21.15.102:0/1247420800 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa72c0adcc0 0x7fa72c0b1920 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fa72c06d5b0 tx=0x7fa72401c9d0 comp rx=0 tx=0).stop 2023-11-13T11:29:24.574 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:24.566+0000 7fa7339f8640 1 -- 172.21.15.102:0/1247420800 shutdown_connections 2023-11-13T11:29:24.575 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:24.566+0000 7fa7339f8640 1 --2- 172.21.15.102:0/1247420800 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa72c0adcc0 0x7fa72c0b1920 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:24.575 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:24.566+0000 7fa7339f8640 1 --2- 172.21.15.102:0/1247420800 >> v2:172.21.15.154:3300/0 conn(0x7fa72c0cf2d0 0x7fa72c0ad780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:24.575 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:24.566+0000 7fa7339f8640 1 -- 172.21.15.102:0/1247420800 >> 172.21.15.102:0/1247420800 conn(0x7fa72c06a410 msgr2=0x7fa72c06a820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-13T11:29:24.575 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:24.566+0000 7fa7339f8640 1 -- 172.21.15.102:0/1247420800 shutdown_connections 2023-11-13T11:29:24.575 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:24.566+0000 7fa7339f8640 1 -- 172.21.15.102:0/1247420800 wait complete. 2023-11-13T11:29:24.577 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:24.570+0000 7fa7339f8640 1 Processor -- start 2023-11-13T11:29:24.578 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:24.570+0000 7fa7339f8640 1 -- start start 2023-11-13T11:29:24.578 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:24.570+0000 7fa7339f8640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa72c0adcc0 0x7fa72c162540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:24.578 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:24.570+0000 7fa7339f8640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa72c0cf2d0 0x7fa72c14ac80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:24.579 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:24.570+0000 7fa7339f8640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa72c1615c0 0x7fa72c163c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:24.579 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:24.570+0000 7fa7339f8640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa72c1636a0 con 0x7fa72c1615c0 2023-11-13T11:29:24.579 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:24.570+0000 7fa7339f8640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa72c14b1c0 con 0x7fa72c0cf2d0 2023-11-13T11:29:24.579 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:24.570+0000 7fa7339f8640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa72c14ba00 con 0x7fa72c0adcc0 2023-11-13T11:29:24.579 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:24.570+0000 7fa731f95640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa72c1615c0 0x7fa72c163c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:24.580 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:24.570+0000 7fa731f95640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa72c1615c0 0x7fa72c163c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:50672/0 (socket says 172.21.15.102:50672) 2023-11-13T11:29:24.580 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:24.570+0000 7fa731f95640 1 -- 172.21.15.102:0/4119542780 learned_addr learned my addr 172.21.15.102:0/4119542780 (peer_addr_for_me v2:172.21.15.102:0/0) 2023-11-13T11:29:24.580 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:24.570+0000 7fa730f93640 1 --2- 172.21.15.102:0/4119542780 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa72c0cf2d0 0x7fa72c14ac80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:24.580 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:24.570+0000 7fa731794640 1 --2- 172.21.15.102:0/4119542780 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa72c0adcc0 0x7fa72c162540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:24.580 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:24.570+0000 7fa731f95640 1 -- 172.21.15.102:0/4119542780 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa72c0adcc0 msgr2=0x7fa72c162540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:24.581 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:24.570+0000 7fa731f95640 1 --2- 172.21.15.102:0/4119542780 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa72c0adcc0 0x7fa72c162540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:24.581 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:24.570+0000 7fa731f95640 1 -- 172.21.15.102:0/4119542780 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa72c0cf2d0 msgr2=0x7fa72c14ac80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:24.581 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:24.570+0000 7fa731f95640 1 --2- 172.21.15.102:0/4119542780 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa72c0cf2d0 0x7fa72c14ac80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:24.581 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:24.570+0000 7fa731f95640 1 -- 172.21.15.102:0/4119542780 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa724009b30 con 0x7fa72c1615c0 2023-11-13T11:29:24.581 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:24.570+0000 7fa730f93640 1 --2- 172.21.15.102:0/4119542780 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa72c0cf2d0 0x7fa72c14ac80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-13T11:29:24.582 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:24.570+0000 7fa731f95640 1 --2- 172.21.15.102:0/4119542780 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa72c1615c0 0x7fa72c163c50 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fa7240195e0 tx=0x7fa724019770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-13T11:29:24.582 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:24.570+0000 7fa721ffb640 1 -- 172.21.15.102:0/4119542780 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7240b8670 con 0x7fa72c1615c0 2023-11-13T11:29:24.582 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:24.570+0000 7fa721ffb640 1 -- 172.21.15.102:0/4119542780 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa7240b8830 con 0x7fa72c1615c0 2023-11-13T11:29:24.582 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:24.570+0000 7fa7339f8640 1 -- 172.21.15.102:0/4119542780 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa72c162b20 con 0x7fa72c1615c0 2023-11-13T11:29:24.582 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:24.570+0000 7fa721ffb640 1 -- 172.21.15.102:0/4119542780 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7240b8be0 con 0x7fa72c1615c0 2023-11-13T11:29:24.583 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:24.570+0000 7fa7339f8640 1 -- 172.21.15.102:0/4119542780 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa72c1630e0 con 0x7fa72c1615c0 2023-11-13T11:29:24.584 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:24.570+0000 7fa7339f8640 1 -- 172.21.15.102:0/4119542780 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa72c067640 con 0x7fa72c1615c0 2023-11-13T11:29:24.584 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:24.574+0000 7fa721ffb640 1 -- 172.21.15.102:0/4119542780 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fa7240b8d40 con 0x7fa72c1615c0 2023-11-13T11:29:24.584 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:24.574+0000 7fa721ffb640 1 --2- 172.21.15.102:0/4119542780 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7fa7100664a0 0x7fa710068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:24.584 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:24.574+0000 7fa721ffb640 1 -- 172.21.15.102:0/4119542780 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa72411ef30 con 0x7fa72c1615c0 2023-11-13T11:29:24.585 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:24.574+0000 7fa731794640 1 --2- 172.21.15.102:0/4119542780 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7fa7100664a0 0x7fa710068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:24.585 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:24.574+0000 7fa731794640 1 --2- 172.21.15.102:0/4119542780 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7fa7100664a0 0x7fa710068960 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fa728007fd0 tx=0x7fa728009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-13T11:29:24.585 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:24.578+0000 7fa721ffb640 1 -- 172.21.15.102:0/4119542780 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fa7240ec300 con 0x7fa72c1615c0 2023-11-13T11:29:24.734 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:24.726+0000 7fa7339f8640 1 -- 172.21.15.102:0/4119542780 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fa72c14bbc0 con 0x7fa72c1615c0 2023-11-13T11:29:24.735 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:24.730+0000 7fa721ffb640 1 -- 172.21.15.102:0/4119542780 <== mon.0 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v22) v1 ==== 93+0+10 (secure 0 0 0) 0x7fa7240ef920 con 0x7fa72c1615c0 2023-11-13T11:29:24.735 INFO:teuthology.orchestra.run.smithi102.stdout:pg_num: 1 2023-11-13T11:29:24.737 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:24.730+0000 7fa7339f8640 1 -- 172.21.15.102:0/4119542780 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7fa7100664a0 msgr2=0x7fa710068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:24.737 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:24.730+0000 7fa7339f8640 1 --2- 172.21.15.102:0/4119542780 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7fa7100664a0 0x7fa710068960 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fa728007fd0 tx=0x7fa728009040 comp rx=0 tx=0).stop 2023-11-13T11:29:24.737 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:24.730+0000 7fa7339f8640 1 -- 172.21.15.102:0/4119542780 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa72c1615c0 msgr2=0x7fa72c163c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:24.738 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:24.730+0000 7fa7339f8640 1 --2- 172.21.15.102:0/4119542780 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa72c1615c0 0x7fa72c163c50 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fa7240195e0 tx=0x7fa724019770 comp rx=0 tx=0).stop 2023-11-13T11:29:24.738 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:24.730+0000 7fa7339f8640 1 -- 172.21.15.102:0/4119542780 shutdown_connections 2023-11-13T11:29:24.738 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:24.730+0000 7fa7339f8640 1 --2- 172.21.15.102:0/4119542780 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7fa7100664a0 0x7fa710068960 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:24.738 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:24.730+0000 7fa7339f8640 1 --2- 172.21.15.102:0/4119542780 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa72c1615c0 0x7fa72c163c50 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:24.739 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:24.730+0000 7fa7339f8640 1 --2- 172.21.15.102:0/4119542780 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa72c0cf2d0 0x7fa72c14ac80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:24.739 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:24.730+0000 7fa7339f8640 1 --2- 172.21.15.102:0/4119542780 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa72c0adcc0 0x7fa72c162540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:24.739 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:24.730+0000 7fa7339f8640 1 -- 172.21.15.102:0/4119542780 >> 172.21.15.102:0/4119542780 conn(0x7fa72c06a410 msgr2=0x7fa72c15c7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-13T11:29:24.739 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:24.730+0000 7fa7339f8640 1 -- 172.21.15.102:0/4119542780 shutdown_connections 2023-11-13T11:29:24.740 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:24.730+0000 7fa7339f8640 1 -- 172.21.15.102:0/4119542780 wait complete. 2023-11-13T11:29:24.755 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-13T11:29:24.895 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:24.890+0000 7f6d3ddc1640 1 Processor -- start 2023-11-13T11:29:24.896 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:24.890+0000 7f6d3ddc1640 1 -- start start 2023-11-13T11:29:24.897 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:24.890+0000 7f6d3ddc1640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f6d380cf2d0 0x7f6d3806fc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:24.898 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:24.890+0000 7f6d3ddc1640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f6d380711c0 0x7f6d380b3520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:24.898 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:24.890+0000 7f6d3ddc1640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6d380b21f0 con 0x7f6d38159b30 2023-11-13T11:29:24.898 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:24.890+0000 7f6d3ddc1640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6d38071670 con 0x7f6d380cf2d0 2023-11-13T11:29:24.898 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:24.890+0000 7f6d3ddc1640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6d380b2440 con 0x7f6d380711c0 2023-11-13T11:29:24.899 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:24.890+0000 7f6d2ffff640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f6d380cf2d0 0x7f6d3806fc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:24.899 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:24.890+0000 7f6d2ffff640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f6d380cf2d0 0x7f6d3806fc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:50688/0 (socket says 172.21.15.102:50688) 2023-11-13T11:29:24.899 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:24.890+0000 7f6d2ffff640 1 -- 172.21.15.102:0/2962257252 learned_addr learned my addr 172.21.15.102:0/2962257252 (peer_addr_for_me v2:172.21.15.102:0/0) 2023-11-13T11:29:24.899 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:24.890+0000 7f6d37fff640 1 --2- 172.21.15.102:0/2962257252 >> v2:172.21.15.154:3300/0 conn(0x7f6d380711c0 0x7f6d380b3520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:24.899 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:24.890+0000 7f6d2ffff640 1 -- 172.21.15.102:0/2962257252 >> v2:172.21.15.154:3300/0 conn(0x7f6d380711c0 msgr2=0x7f6d380b3520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-13T11:29:24.900 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:24.890+0000 7f6d2ffff640 1 --2- 172.21.15.102:0/2962257252 >> v2:172.21.15.154:3300/0 conn(0x7f6d380711c0 0x7f6d380b3520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:24.900 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:24.890+0000 7f6d2ffff640 1 -- 172.21.15.102:0/2962257252 >> v1:172.21.15.154:6789/0 conn(0x7f6d38159b30 legacy=0x7f6d380cebc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:24.900 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:24.890+0000 7f6d2ffff640 1 -- 172.21.15.102:0/2962257252 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d380b2720 con 0x7f6d380cf2d0 2023-11-13T11:29:24.901 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:24.894+0000 7f6d2ffff640 1 --2- 172.21.15.102:0/2962257252 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6d380cf2d0 0x7f6d3806fc80 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f6d380cb410 tx=0x7f6d2001c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dbfe67f5c6c06142 server_cookie=0 in_seq=0 out_seq=0 2023-11-13T11:29:24.901 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:24.894+0000 7f6d36ffd640 1 -- 172.21.15.102:0/2962257252 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d200aa430 con 0x7f6d380cf2d0 2023-11-13T11:29:24.902 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:24.894+0000 7f6d36ffd640 1 -- 172.21.15.102:0/2962257252 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d200aa590 con 0x7f6d380cf2d0 2023-11-13T11:29:24.902 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:24.894+0000 7f6d36ffd640 1 -- 172.21.15.102:0/2962257252 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d200aa920 con 0x7f6d380cf2d0 2023-11-13T11:29:24.902 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:24.894+0000 7f6d3ddc1640 1 -- 172.21.15.102:0/2962257252 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6d380cf2d0 msgr2=0x7f6d3806fc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:24.902 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:24.894+0000 7f6d3ddc1640 1 --2- 172.21.15.102:0/2962257252 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6d380cf2d0 0x7f6d3806fc80 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f6d380cb410 tx=0x7f6d2001c4d0 comp rx=0 tx=0).stop 2023-11-13T11:29:24.902 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:24.894+0000 7f6d3ddc1640 1 -- 172.21.15.102:0/2962257252 shutdown_connections 2023-11-13T11:29:24.903 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:24.894+0000 7f6d3ddc1640 1 --2- 172.21.15.102:0/2962257252 >> v2:172.21.15.154:3300/0 conn(0x7f6d380711c0 0x7f6d380b3520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:24.903 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:24.894+0000 7f6d3ddc1640 1 --2- 172.21.15.102:0/2962257252 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6d380cf2d0 0x7f6d3806fc80 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:24.903 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:24.894+0000 7f6d3ddc1640 1 -- 172.21.15.102:0/2962257252 >> 172.21.15.102:0/2962257252 conn(0x7f6d3806a410 msgr2=0x7f6d3806a820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-13T11:29:24.903 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:24.894+0000 7f6d3ddc1640 1 -- 172.21.15.102:0/2962257252 shutdown_connections 2023-11-13T11:29:24.904 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:24.894+0000 7f6d3ddc1640 1 -- 172.21.15.102:0/2962257252 wait complete. 2023-11-13T11:29:24.906 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:24.898+0000 7f6d3ddc1640 1 Processor -- start 2023-11-13T11:29:24.906 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:24.898+0000 7f6d3ddc1640 1 -- start start 2023-11-13T11:29:24.906 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:24.898+0000 7f6d3ddc1640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6d380711c0 0x7f6d3815ce50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:24.906 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:24.898+0000 7f6d3ddc1640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6d380cf2d0 0x7f6d38144470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:24.906 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:24.898+0000 7f6d3ddc1640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6d38159b30 0x7f6d3815ad80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:24.907 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:24.898+0000 7f6d3ddc1640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d3815d390 con 0x7f6d380cf2d0 2023-11-13T11:29:24.907 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:24.898+0000 7f6d3ddc1640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d38154930 con 0x7f6d380711c0 2023-11-13T11:29:24.907 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:24.898+0000 7f6d3ddc1640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6d381449b0 con 0x7f6d38159b30 2023-11-13T11:29:24.908 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:24.898+0000 7f6d2ffff640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6d380cf2d0 0x7f6d38144470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:24.908 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:24.898+0000 7f6d2ffff640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6d380cf2d0 0x7f6d38144470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:50694/0 (socket says 172.21.15.102:50694) 2023-11-13T11:29:24.908 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:24.898+0000 7f6d2ffff640 1 -- 172.21.15.102:0/556192124 learned_addr learned my addr 172.21.15.102:0/556192124 (peer_addr_for_me v2:172.21.15.102:0/0) 2023-11-13T11:29:24.908 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:24.898+0000 7f6d377fe640 1 --2- 172.21.15.102:0/556192124 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6d380711c0 0x7f6d3815ce50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:24.909 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:24.898+0000 7f6d37fff640 1 --2- 172.21.15.102:0/556192124 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6d38159b30 0x7f6d3815ad80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:24.909 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:24.898+0000 7f6d2ffff640 1 -- 172.21.15.102:0/556192124 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6d38159b30 msgr2=0x7f6d3815ad80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:24.909 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:24.898+0000 7f6d2ffff640 1 --2- 172.21.15.102:0/556192124 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6d38159b30 0x7f6d3815ad80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:24.909 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:24.898+0000 7f6d2ffff640 1 -- 172.21.15.102:0/556192124 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6d380711c0 msgr2=0x7f6d3815ce50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:24.909 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:24.898+0000 7f6d2ffff640 1 --2- 172.21.15.102:0/556192124 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6d380711c0 0x7f6d3815ce50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:24.910 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:24.898+0000 7f6d2ffff640 1 -- 172.21.15.102:0/556192124 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d200094d0 con 0x7f6d380cf2d0 2023-11-13T11:29:24.910 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:24.898+0000 7f6d2ffff640 1 --2- 172.21.15.102:0/556192124 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6d380cf2d0 0x7f6d38144470 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f6d200190e0 tx=0x7f6d2001ad10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-13T11:29:24.910 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:24.898+0000 7f6d34ff9640 1 -- 172.21.15.102:0/556192124 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d200aa430 con 0x7f6d380cf2d0 2023-11-13T11:29:24.910 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:24.898+0000 7f6d34ff9640 1 -- 172.21.15.102:0/556192124 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d200b3800 con 0x7f6d380cf2d0 2023-11-13T11:29:24.910 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:24.898+0000 7f6d34ff9640 1 -- 172.21.15.102:0/556192124 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d200b3b90 con 0x7f6d380cf2d0 2023-11-13T11:29:24.911 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:24.898+0000 7f6d3ddc1640 1 -- 172.21.15.102:0/556192124 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6d38151d70 con 0x7f6d380cf2d0 2023-11-13T11:29:24.911 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:24.898+0000 7f6d3ddc1640 1 -- 172.21.15.102:0/556192124 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6d38152330 con 0x7f6d380cf2d0 2023-11-13T11:29:24.912 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:24.902+0000 7f6d3ddc1640 1 -- 172.21.15.102:0/556192124 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6d38067640 con 0x7f6d380cf2d0 2023-11-13T11:29:24.912 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:24.902+0000 7f6d34ff9640 1 -- 172.21.15.102:0/556192124 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f6d200b3cf0 con 0x7f6d380cf2d0 2023-11-13T11:29:24.912 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:24.902+0000 7f6d34ff9640 1 --2- 172.21.15.102:0/556192124 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f6d18066470 0x7f6d18068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:24.912 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:24.902+0000 7f6d34ff9640 1 -- 172.21.15.102:0/556192124 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f6d2011e400 con 0x7f6d380cf2d0 2023-11-13T11:29:24.913 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:24.902+0000 7f6d377fe640 1 --2- 172.21.15.102:0/556192124 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f6d18066470 0x7f6d18068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:24.913 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:24.902+0000 7f6d377fe640 1 --2- 172.21.15.102:0/556192124 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f6d18066470 0x7f6d18068930 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f6d28007fd0 tx=0x7f6d28009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-13T11:29:24.913 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:24.906+0000 7f6d34ff9640 1 -- 172.21.15.102:0/556192124 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f6d200eb920 con 0x7f6d380cf2d0 2023-11-13T11:29:25.063 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:25.058+0000 7f6d3ddc1640 1 -- 172.21.15.102:0/556192124 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f6d38154aa0 con 0x7f6d380cf2d0 2023-11-13T11:29:25.063 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:25.058+0000 7f6d34ff9640 1 -- 172.21.15.102:0/556192124 <== mon.0 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v22) v1 ==== 104+0+11 (secure 0 0 0) 0x7f6d200eef40 con 0x7f6d380cf2d0 2023-11-13T11:29:25.064 INFO:teuthology.orchestra.run.smithi102.stdout:pg_num: 32 2023-11-13T11:29:25.065 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:25.058+0000 7f6d3ddc1640 1 -- 172.21.15.102:0/556192124 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f6d18066470 msgr2=0x7f6d18068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:25.065 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:25.058+0000 7f6d3ddc1640 1 --2- 172.21.15.102:0/556192124 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f6d18066470 0x7f6d18068930 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f6d28007fd0 tx=0x7f6d28009040 comp rx=0 tx=0).stop 2023-11-13T11:29:25.066 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:25.058+0000 7f6d3ddc1640 1 -- 172.21.15.102:0/556192124 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6d380cf2d0 msgr2=0x7f6d38144470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:25.066 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:25.058+0000 7f6d3ddc1640 1 --2- 172.21.15.102:0/556192124 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6d380cf2d0 0x7f6d38144470 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f6d200190e0 tx=0x7f6d2001ad10 comp rx=0 tx=0).stop 2023-11-13T11:29:25.066 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:25.058+0000 7f6d3ddc1640 1 -- 172.21.15.102:0/556192124 shutdown_connections 2023-11-13T11:29:25.066 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:25.058+0000 7f6d3ddc1640 1 --2- 172.21.15.102:0/556192124 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6d38159b30 0x7f6d3815ad80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:25.066 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:25.058+0000 7f6d3ddc1640 1 --2- 172.21.15.102:0/556192124 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f6d18066470 0x7f6d18068930 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:25.067 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:25.058+0000 7f6d3ddc1640 1 --2- 172.21.15.102:0/556192124 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6d380cf2d0 0x7f6d38144470 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:25.067 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:25.058+0000 7f6d3ddc1640 1 --2- 172.21.15.102:0/556192124 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6d380711c0 0x7f6d3815ce50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:25.067 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:25.058+0000 7f6d3ddc1640 1 -- 172.21.15.102:0/556192124 >> 172.21.15.102:0/556192124 conn(0x7f6d3806a410 msgr2=0x7f6d380ac8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-13T11:29:25.067 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:25.058+0000 7f6d3ddc1640 1 -- 172.21.15.102:0/556192124 shutdown_connections 2023-11-13T11:29:25.067 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:25.058+0000 7f6d3ddc1640 1 -- 172.21.15.102:0/556192124 wait complete. 2023-11-13T11:29:25.084 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-13T11:29:25.226 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:25.218+0000 7ff83c846640 1 Processor -- start 2023-11-13T11:29:25.226 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:25.218+0000 7ff83c846640 1 -- start start 2023-11-13T11:29:25.227 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:25.222+0000 7ff83c846640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff83815d0b0 0x7ff8380cebc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:25.227 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:25.222+0000 7ff83c846640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7ff8380b1920 0x7ff8380cf100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:25.228 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:25.222+0000 7ff83c846640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff83806d130 con 0x7ff838071620 2023-11-13T11:29:25.228 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:25.222+0000 7ff83c846640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff838070030 con 0x7ff8380b1920 2023-11-13T11:29:25.228 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:25.222+0000 7ff83c846640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff838070310 con 0x7ff83815d0b0 2023-11-13T11:29:25.229 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:25.222+0000 7ff83659c640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff83815d0b0 0x7ff8380cebc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:25.229 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:25.222+0000 7ff82dd9b640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7ff8380b1920 0x7ff8380cf100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:25.229 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:25.222+0000 7ff836d9d640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7ff838071620 0x7ff8380ac8a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.102:53248/0 (socket says 172.21.15.102:53248) 2023-11-13T11:29:25.230 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:25.222+0000 7ff836d9d640 1 -- 172.21.15.102:0/1755820095 learned_addr learned my addr 172.21.15.102:0/1755820095 (peer_addr_for_me v1:172.21.15.102:0/0) 2023-11-13T11:29:25.230 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:25.222+0000 7ff83659c640 1 -- 172.21.15.102:0/1755820095 >> v2:172.21.15.154:3300/0 conn(0x7ff8380b1920 msgr2=0x7ff8380cf100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-13T11:29:25.230 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:25.222+0000 7ff83659c640 1 --2- 172.21.15.102:0/1755820095 >> v2:172.21.15.154:3300/0 conn(0x7ff8380b1920 0x7ff8380cf100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:25.230 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:25.222+0000 7ff83659c640 1 -- 172.21.15.102:0/1755820095 >> v1:172.21.15.154:6789/0 conn(0x7ff838071620 legacy=0x7ff8380ac8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:25.230 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:25.222+0000 7ff835d9b640 1 -- 172.21.15.102:0/1755820095 <== mon.1 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1157415139 0 0) 0x7ff83806d130 con 0x7ff838071620 2023-11-13T11:29:25.231 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:25.222+0000 7ff83659c640 1 -- 172.21.15.102:0/1755820095 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8380705f0 con 0x7ff83815d0b0 2023-11-13T11:29:25.231 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:25.226+0000 7ff83659c640 1 --2- 172.21.15.102:0/1755820095 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff83815d0b0 0x7ff8380cebc0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7ff828009d90 tx=0x7ff82801f130 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fcc6d39b4fc592df server_cookie=0 in_seq=0 out_seq=0 2023-11-13T11:29:25.231 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:25.226+0000 7ff835d9b640 1 -- 172.21.15.102:0/1755820095 <== mon.2 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8280af600 con 0x7ff83815d0b0 2023-11-13T11:29:25.232 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:25.226+0000 7ff835d9b640 1 -- 172.21.15.102:0/1755820095 <== mon.2 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff8280ab050 con 0x7ff83815d0b0 2023-11-13T11:29:25.232 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:25.226+0000 7ff835d9b640 1 -- 172.21.15.102:0/1755820095 <== mon.2 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8280af980 con 0x7ff83815d0b0 2023-11-13T11:29:25.233 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:25.226+0000 7ff83c846640 1 -- 172.21.15.102:0/1755820095 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff83815d0b0 msgr2=0x7ff8380cebc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:25.233 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:25.226+0000 7ff83c846640 1 --2- 172.21.15.102:0/1755820095 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff83815d0b0 0x7ff8380cebc0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7ff828009d90 tx=0x7ff82801f130 comp rx=0 tx=0).stop 2023-11-13T11:29:25.233 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:25.226+0000 7ff83c846640 1 -- 172.21.15.102:0/1755820095 shutdown_connections 2023-11-13T11:29:25.233 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:25.226+0000 7ff83c846640 1 --2- 172.21.15.102:0/1755820095 >> v2:172.21.15.154:3300/0 conn(0x7ff8380b1920 0x7ff8380cf100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:25.234 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:25.226+0000 7ff83c846640 1 --2- 172.21.15.102:0/1755820095 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff83815d0b0 0x7ff8380cebc0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:25.234 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:25.226+0000 7ff83c846640 1 -- 172.21.15.102:0/1755820095 >> 172.21.15.102:0/1755820095 conn(0x7ff83806a410 msgr2=0x7ff83806a820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-13T11:29:25.234 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:25.226+0000 7ff83c846640 1 -- 172.21.15.102:0/1755820095 shutdown_connections 2023-11-13T11:29:25.234 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:25.226+0000 7ff83c846640 1 -- 172.21.15.102:0/1755820095 wait complete. 2023-11-13T11:29:25.237 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:25.226+0000 7ff83c846640 1 Processor -- start 2023-11-13T11:29:25.237 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:25.230+0000 7ff83c846640 1 -- start start 2023-11-13T11:29:25.237 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:25.230+0000 7ff83c846640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff838071620 0x7ff8381564e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:25.237 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:25.230+0000 7ff83c846640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff8380b1920 0x7ff838153aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:25.238 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:25.230+0000 7ff83c846640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff83815d0b0 0x7ff8380cc5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:25.238 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:25.230+0000 7ff83c846640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff838155170 con 0x7ff83815d0b0 2023-11-13T11:29:25.238 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:25.230+0000 7ff83c846640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff838156a20 con 0x7ff838071620 2023-11-13T11:29:25.238 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:25.230+0000 7ff83c846640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff838155590 con 0x7ff8380b1920 2023-11-13T11:29:25.238 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:25.230+0000 7ff836d9d640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff83815d0b0 0x7ff8380cc5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:25.239 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:25.230+0000 7ff83659c640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff838071620 0x7ff8381564e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:25.239 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:25.230+0000 7ff836d9d640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff83815d0b0 0x7ff8380cc5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:50708/0 (socket says 172.21.15.102:50708) 2023-11-13T11:29:25.239 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:25.230+0000 7ff836d9d640 1 -- 172.21.15.102:0/2335985918 learned_addr learned my addr 172.21.15.102:0/2335985918 (peer_addr_for_me v2:172.21.15.102:0/0) 2023-11-13T11:29:25.239 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:25.230+0000 7ff82dd9b640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff8380b1920 0x7ff838153aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:25.240 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:25.230+0000 7ff836d9d640 1 -- 172.21.15.102:0/2335985918 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff8380b1920 msgr2=0x7ff838153aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:25.240 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:25.230+0000 7ff836d9d640 1 --2- 172.21.15.102:0/2335985918 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff8380b1920 0x7ff838153aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:25.240 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:25.230+0000 7ff836d9d640 1 -- 172.21.15.102:0/2335985918 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff838071620 msgr2=0x7ff8381564e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:25.240 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:25.230+0000 7ff836d9d640 1 --2- 172.21.15.102:0/2335985918 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff838071620 0x7ff8381564e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:25.240 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:25.230+0000 7ff836d9d640 1 -- 172.21.15.102:0/2335985918 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff828009a70 con 0x7ff83815d0b0 2023-11-13T11:29:25.241 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:25.230+0000 7ff82dd9b640 1 --2- 172.21.15.102:0/2335985918 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff8380b1920 0x7ff838153aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-13T11:29:25.241 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:25.230+0000 7ff836d9d640 1 --2- 172.21.15.102:0/2335985918 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff83815d0b0 0x7ff8380cc5e0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7ff83000c450 tx=0x7ff83000c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-13T11:29:25.241 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:25.230+0000 7ff82f7fe640 1 -- 172.21.15.102:0/2335985918 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8300074e0 con 0x7ff83815d0b0 2023-11-13T11:29:25.241 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:25.230+0000 7ff82f7fe640 1 -- 172.21.15.102:0/2335985918 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff830007640 con 0x7ff83815d0b0 2023-11-13T11:29:25.241 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:25.230+0000 7ff82f7fe640 1 -- 172.21.15.102:0/2335985918 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff830004a30 con 0x7ff83815d0b0 2023-11-13T11:29:25.242 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:25.230+0000 7ff83c846640 1 -- 172.21.15.102:0/2335985918 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff8381544f0 con 0x7ff83815d0b0 2023-11-13T11:29:25.242 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:25.230+0000 7ff83c846640 1 -- 172.21.15.102:0/2335985918 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff838154ab0 con 0x7ff83815d0b0 2023-11-13T11:29:25.243 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:25.230+0000 7ff83c846640 1 -- 172.21.15.102:0/2335985918 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff838067640 con 0x7ff83815d0b0 2023-11-13T11:29:25.243 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:25.234+0000 7ff82f7fe640 1 -- 172.21.15.102:0/2335985918 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7ff830004b90 con 0x7ff83815d0b0 2023-11-13T11:29:25.243 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:25.234+0000 7ff82f7fe640 1 --2- 172.21.15.102:0/2335985918 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7ff818066470 0x7ff818068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:25.244 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:25.234+0000 7ff82f7fe640 1 -- 172.21.15.102:0/2335985918 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff830083b40 con 0x7ff83815d0b0 2023-11-13T11:29:25.244 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:25.234+0000 7ff83659c640 1 --2- 172.21.15.102:0/2335985918 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7ff818066470 0x7ff818068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:25.244 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:25.234+0000 7ff83659c640 1 --2- 172.21.15.102:0/2335985918 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7ff818066470 0x7ff818068930 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7ff8280b1000 tx=0x7ff8280aa000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-13T11:29:25.244 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:25.238+0000 7ff82f7fe640 1 -- 172.21.15.102:0/2335985918 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7ff830051060 con 0x7ff83815d0b0 2023-11-13T11:29:25.393 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:25.386+0000 7ff83c846640 1 -- 172.21.15.102:0/2335985918 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7ff838068520 con 0x7ff83815d0b0 2023-11-13T11:29:25.393 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:25.386+0000 7ff82f7fe640 1 -- 172.21.15.102:0/2335985918 <== mon.0 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v22) v1 ==== 100+0+11 (secure 0 0 0) 0x7ff830054680 con 0x7ff83815d0b0 2023-11-13T11:29:25.394 INFO:teuthology.orchestra.run.smithi102.stdout:pg_num: 64 2023-11-13T11:29:25.395 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:25.390+0000 7ff83c846640 1 -- 172.21.15.102:0/2335985918 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7ff818066470 msgr2=0x7ff818068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:25.395 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:25.390+0000 7ff83c846640 1 --2- 172.21.15.102:0/2335985918 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7ff818066470 0x7ff818068930 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7ff8280b1000 tx=0x7ff8280aa000 comp rx=0 tx=0).stop 2023-11-13T11:29:25.396 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:25.390+0000 7ff83c846640 1 -- 172.21.15.102:0/2335985918 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff83815d0b0 msgr2=0x7ff8380cc5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:25.396 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:25.390+0000 7ff83c846640 1 --2- 172.21.15.102:0/2335985918 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff83815d0b0 0x7ff8380cc5e0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7ff83000c450 tx=0x7ff83000c910 comp rx=0 tx=0).stop 2023-11-13T11:29:25.396 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:25.390+0000 7ff83c846640 1 -- 172.21.15.102:0/2335985918 shutdown_connections 2023-11-13T11:29:25.396 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:25.390+0000 7ff83c846640 1 --2- 172.21.15.102:0/2335985918 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7ff818066470 0x7ff818068930 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:25.396 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:25.390+0000 7ff83c846640 1 --2- 172.21.15.102:0/2335985918 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff83815d0b0 0x7ff8380cc5e0 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:25.397 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:25.390+0000 7ff83c846640 1 --2- 172.21.15.102:0/2335985918 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff8380b1920 0x7ff838153aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:25.397 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:25.390+0000 7ff83c846640 1 --2- 172.21.15.102:0/2335985918 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff838071620 0x7ff8381564e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:25.397 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:25.390+0000 7ff83c846640 1 -- 172.21.15.102:0/2335985918 >> 172.21.15.102:0/2335985918 conn(0x7ff83806a410 msgr2=0x7ff8380af730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-13T11:29:25.397 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:25.390+0000 7ff83c846640 1 -- 172.21.15.102:0/2335985918 shutdown_connections 2023-11-13T11:29:25.397 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:25.390+0000 7ff83c846640 1 -- 172.21.15.102:0/2335985918 wait complete. 2023-11-13T11:29:25.427 INFO:tasks.cephfs_test_runner:Starting test: test_generic (tasks.cephfs.tests_from_xfstests_dev.TestXFSTestsDev) 2023-11-13T11:29:25.428 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-13T11:29:25.566 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:25.558+0000 7fa268d2a640 1 Processor -- start 2023-11-13T11:29:25.567 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:25.558+0000 7fa268d2a640 1 -- start start 2023-11-13T11:29:25.568 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:25.562+0000 7fa268d2a640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7fa2640cae80 0x7fa264159420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:25.568 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:25.562+0000 7fa268d2a640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa26406c270 0x7fa26406d8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:25.569 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:25.562+0000 7fa268d2a640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fa2640b1b70 0x7fa2640b2000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:25.569 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:25.562+0000 7fa268d2a640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa264159960 con 0x7fa2640cae80 2023-11-13T11:29:25.569 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:25.562+0000 7fa268d2a640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa26406dde0 con 0x7fa2640b1b70 2023-11-13T11:29:25.569 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:25.562+0000 7fa268d2a640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa26406c800 con 0x7fa26406c270 2023-11-13T11:29:25.569 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:25.562+0000 7fa26259c640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7fa2640cae80 0x7fa264159420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:25.570 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:25.562+0000 7fa26259c640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7fa2640cae80 0x7fa264159420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:50718/0 (socket says 172.21.15.102:50718) 2023-11-13T11:29:25.570 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:25.562+0000 7fa26259c640 1 -- 172.21.15.102:0/4052334607 learned_addr learned my addr 172.21.15.102:0/4052334607 (peer_addr_for_me v2:172.21.15.102:0/0) 2023-11-13T11:29:25.570 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:25.562+0000 7fa261d9b640 1 --2- 172.21.15.102:0/4052334607 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa26406c270 0x7fa26406d8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:25.570 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:25.562+0000 7fa262d9d640 1 --2- 172.21.15.102:0/4052334607 >> v2:172.21.15.154:3300/0 conn(0x7fa2640b1b70 0x7fa2640b2000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:25.571 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:25.562+0000 7fa26259c640 1 -- 172.21.15.102:0/4052334607 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa26406c270 msgr2=0x7fa26406d8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-13T11:29:25.571 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:25.562+0000 7fa26259c640 1 --2- 172.21.15.102:0/4052334607 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa26406c270 0x7fa26406d8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:25.571 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:25.562+0000 7fa26259c640 1 -- 172.21.15.102:0/4052334607 >> v2:172.21.15.154:3300/0 conn(0x7fa2640b1b70 msgr2=0x7fa2640b2000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-13T11:29:25.571 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:25.562+0000 7fa26259c640 1 --2- 172.21.15.102:0/4052334607 >> v2:172.21.15.154:3300/0 conn(0x7fa2640b1b70 0x7fa2640b2000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:25.571 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:25.562+0000 7fa26259c640 1 -- 172.21.15.102:0/4052334607 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa26406cae0 con 0x7fa2640cae80 2023-11-13T11:29:25.572 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:25.566+0000 7fa26259c640 1 --2- 172.21.15.102:0/4052334607 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa2640cae80 0x7fa264159420 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fa26415e1a0 tx=0x7fa25401ecf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8257da0521f7e5b0 server_cookie=0 in_seq=0 out_seq=0 2023-11-13T11:29:25.573 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:25.566+0000 7fa26159a640 1 -- 172.21.15.102:0/4052334607 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2540a89b0 con 0x7fa2640cae80 2023-11-13T11:29:25.573 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:25.566+0000 7fa26159a640 1 -- 172.21.15.102:0/4052334607 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa2540a8b10 con 0x7fa2640cae80 2023-11-13T11:29:25.573 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:25.566+0000 7fa26159a640 1 -- 172.21.15.102:0/4052334607 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2540a8ea0 con 0x7fa2640cae80 2023-11-13T11:29:25.573 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:25.566+0000 7fa268d2a640 1 -- 172.21.15.102:0/4052334607 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa2640cae80 msgr2=0x7fa264159420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:25.573 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:25.566+0000 7fa268d2a640 1 --2- 172.21.15.102:0/4052334607 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa2640cae80 0x7fa264159420 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fa26415e1a0 tx=0x7fa25401ecf0 comp rx=0 tx=0).stop 2023-11-13T11:29:25.574 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:25.566+0000 7fa268d2a640 1 -- 172.21.15.102:0/4052334607 shutdown_connections 2023-11-13T11:29:25.574 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:25.566+0000 7fa268d2a640 1 --2- 172.21.15.102:0/4052334607 >> v2:172.21.15.154:3300/0 conn(0x7fa2640b1b70 0x7fa2640b2000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:25.574 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:25.566+0000 7fa268d2a640 1 --2- 172.21.15.102:0/4052334607 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa26406c270 0x7fa26406d8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:25.574 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:25.566+0000 7fa268d2a640 1 --2- 172.21.15.102:0/4052334607 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa2640cae80 0x7fa264159420 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:25.574 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:25.566+0000 7fa268d2a640 1 -- 172.21.15.102:0/4052334607 >> 172.21.15.102:0/4052334607 conn(0x7fa2640b0870 msgr2=0x7fa2640b0c80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-13T11:29:25.575 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:25.566+0000 7fa268d2a640 1 -- 172.21.15.102:0/4052334607 shutdown_connections 2023-11-13T11:29:25.575 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:25.566+0000 7fa268d2a640 1 -- 172.21.15.102:0/4052334607 wait complete. 2023-11-13T11:29:25.577 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:25.566+0000 7fa268d2a640 1 Processor -- start 2023-11-13T11:29:25.577 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:25.566+0000 7fa268d2a640 1 -- start start 2023-11-13T11:29:25.577 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:25.570+0000 7fa268d2a640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa26406c270 0x7fa26413b360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:25.577 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:25.570+0000 7fa268d2a640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa2640b1b70 0x7fa264154330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:25.578 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:25.570+0000 7fa268d2a640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa2640cae80 0x7fa2641e6290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:25.578 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:25.570+0000 7fa268d2a640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa26413c010 con 0x7fa26406c270 2023-11-13T11:29:25.578 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:25.570+0000 7fa268d2a640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa26413b8a0 con 0x7fa2640cae80 2023-11-13T11:29:25.578 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:25.570+0000 7fa268d2a640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa264155340 con 0x7fa2640b1b70 2023-11-13T11:29:25.578 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:25.570+0000 7fa26259c640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa26406c270 0x7fa26413b360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:25.579 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:25.570+0000 7fa26259c640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa26406c270 0x7fa26413b360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:50722/0 (socket says 172.21.15.102:50722) 2023-11-13T11:29:25.579 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:25.570+0000 7fa26259c640 1 -- 172.21.15.102:0/3883219796 learned_addr learned my addr 172.21.15.102:0/3883219796 (peer_addr_for_me v2:172.21.15.102:0/0) 2023-11-13T11:29:25.579 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:25.570+0000 7fa262d9d640 1 --2- 172.21.15.102:0/3883219796 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa2640cae80 0x7fa2641e6290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:25.579 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:25.570+0000 7fa261d9b640 1 --2- 172.21.15.102:0/3883219796 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa2640b1b70 0x7fa264154330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:25.579 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:25.570+0000 7fa26259c640 1 -- 172.21.15.102:0/3883219796 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa2640b1b70 msgr2=0x7fa264154330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:25.580 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:25.570+0000 7fa26259c640 1 --2- 172.21.15.102:0/3883219796 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa2640b1b70 0x7fa264154330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:25.580 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:25.570+0000 7fa26259c640 1 -- 172.21.15.102:0/3883219796 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa2640cae80 msgr2=0x7fa2641e6290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:25.580 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:25.570+0000 7fa26259c640 1 --2- 172.21.15.102:0/3883219796 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa2640cae80 0x7fa2641e6290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:25.580 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:25.570+0000 7fa26259c640 1 -- 172.21.15.102:0/3883219796 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2540094d0 con 0x7fa26406c270 2023-11-13T11:29:25.580 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:25.570+0000 7fa262d9d640 1 --2- 172.21.15.102:0/3883219796 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa2640cae80 0x7fa2641e6290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-13T11:29:25.581 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:25.570+0000 7fa26259c640 1 --2- 172.21.15.102:0/3883219796 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa26406c270 0x7fa26413b360 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fa25401d3a0 tx=0x7fa25401ba90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-13T11:29:25.581 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:25.570+0000 7fa252ffd640 1 -- 172.21.15.102:0/3883219796 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2540ba600 con 0x7fa26406c270 2023-11-13T11:29:25.581 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:25.570+0000 7fa252ffd640 1 -- 172.21.15.102:0/3883219796 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa2540ba760 con 0x7fa26406c270 2023-11-13T11:29:25.581 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:25.570+0000 7fa252ffd640 1 -- 172.21.15.102:0/3883219796 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2540bab10 con 0x7fa26406c270 2023-11-13T11:29:25.581 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:25.570+0000 7fa268d2a640 1 -- 172.21.15.102:0/3883219796 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa26413bc70 con 0x7fa26406c270 2023-11-13T11:29:25.581 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:25.570+0000 7fa268d2a640 1 -- 172.21.15.102:0/3883219796 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa264155060 con 0x7fa26406c270 2023-11-13T11:29:25.582 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:25.570+0000 7fa268d2a640 1 -- 172.21.15.102:0/3883219796 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa26413c150 con 0x7fa26406c270 2023-11-13T11:29:25.583 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:25.574+0000 7fa252ffd640 1 -- 172.21.15.102:0/3883219796 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fa2540bac70 con 0x7fa26406c270 2023-11-13T11:29:25.583 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:25.574+0000 7fa252ffd640 1 --2- 172.21.15.102:0/3883219796 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7fa244066470 0x7fa244068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:25.583 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:25.574+0000 7fa252ffd640 1 -- 172.21.15.102:0/3883219796 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa254122340 con 0x7fa26406c270 2023-11-13T11:29:25.583 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:25.574+0000 7fa261d9b640 1 --2- 172.21.15.102:0/3883219796 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7fa244066470 0x7fa244068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:25.583 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:25.574+0000 7fa261d9b640 1 --2- 172.21.15.102:0/3883219796 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7fa244066470 0x7fa244068930 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fa264071550 tx=0x7fa258009190 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-13T11:29:25.584 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:25.578+0000 7fa252ffd640 1 -- 172.21.15.102:0/3883219796 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fa26413c150 con 0x7fa26406c270 2023-11-13T11:29:25.736 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:25.730+0000 7fa268d2a640 1 -- 172.21.15.102:0/3883219796 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa264068520 con 0x7fa26406c270 2023-11-13T11:29:25.737 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:25.730+0000 7fa252ffd640 1 -- 172.21.15.102:0/3883219796 <== mon.0 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+16545 (secure 0 0 0) 0x7fa2540ef850 con 0x7fa26406c270 2023-11-13T11:29:25.737 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T11:29:25.737 INFO:teuthology.orchestra.run.smithi102.stdout:{"epoch":22,"fsid":"97b3eb2b-7ccf-4aae-8d92-bff986c671ea","created":"2023-11-13T11:28:31.836724+0000","modified":"2023-11-13T11:28:58.608314+0000","last_up_change":"2023-11-13T11:28:44.876638+0000","last_in_change":"2023-11-13T11:28:35.312740+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-13T11:28:44.981356+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-13T11:28:55.958525+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-13T11:28:56.394264+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"bdefaa17-fcca-4c86-aa40-27dc33a789af","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6800","nonce":53303834},{"type":"v1","addr":"172.21.15.102:6801","nonce":53303834}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6802","nonce":53303834},{"type":"v1","addr":"172.21.15.102:6803","nonce":53303834}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6806","nonce":53303834},{"type":"v1","addr":"172.21.15.102:6807","nonce":53303834}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6804","nonce":53303834},{"type":"v1","addr":"172.21.15.102:6805","nonce":53303834}]},"public_addr":"172.21.15.102:6801/53303834","cluster_addr":"172.21.15.102:6803/53303834","heartbeat_back_addr":"172.21.15.102:6807/53303834","heartbeat_front_addr":"172.21.15.102:6805/53303834","state":["exists","up"]},{"osd":1,"uuid":"f0033196-dec9-4ae9-945e-6aeef6dbb47f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6808","nonce":1732708348},{"type":"v1","addr":"172.21.15.102:6809","nonce":1732708348}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6811","nonce":1732708348},{"type":"v1","addr":"172.21.15.102:6813","nonce":1732708348}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6818","nonce":1732708348},{"type":"v1","addr":"172.21.15.102:6820","nonce":1732708348}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6815","nonce":1732708348},{"type":"v1","addr":"172.21.15.102:6817","nonce":1732708348}]},"public_addr":"172.21.15.102:6809/1732708348","cluster_addr":"172.21.15.102:6813/1732708348","heartbeat_back_addr":"172.21.15.102:6820/1732708348","heartbeat_front_addr":"172.21.15.102:6817/1732708348","state":["exists","up"]},{"osd":2,"uuid":"496b0834-351e-4ec2-a714-86ed0c0ff4fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6810","nonce":1825475150},{"type":"v1","addr":"172.21.15.102:6812","nonce":1825475150}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6814","nonce":1825475150},{"type":"v1","addr":"172.21.15.102:6816","nonce":1825475150}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6822","nonce":1825475150},{"type":"v1","addr":"172.21.15.102:6823","nonce":1825475150}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6819","nonce":1825475150},{"type":"v1","addr":"172.21.15.102:6821","nonce":1825475150}]},"public_addr":"172.21.15.102:6812/1825475150","cluster_addr":"172.21.15.102:6816/1825475150","heartbeat_back_addr":"172.21.15.102:6823/1825475150","heartbeat_front_addr":"172.21.15.102:6821/1825475150","state":["exists","up"]},{"osd":3,"uuid":"3ba6cc41-e0a0-4273-86cb-90000c06a55a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6824","nonce":4149355528},{"type":"v1","addr":"172.21.15.102:6825","nonce":4149355528}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6826","nonce":4149355528},{"type":"v1","addr":"172.21.15.102:6827","nonce":4149355528}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6830","nonce":4149355528},{"type":"v1","addr":"172.21.15.102:6831","nonce":4149355528}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6828","nonce":4149355528},{"type":"v1","addr":"172.21.15.102:6829","nonce":4149355528}]},"public_addr":"172.21.15.102:6825/4149355528","cluster_addr":"172.21.15.102:6827/4149355528","heartbeat_back_addr":"172.21.15.102:6831/4149355528","heartbeat_front_addr":"172.21.15.102:6829/4149355528","state":["exists","up"]},{"osd":4,"uuid":"16e797d8-e6e7-4140-95c3-b85283c42a2a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6808","nonce":4028899241},{"type":"v1","addr":"172.21.15.154:6809","nonce":4028899241}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6810","nonce":4028899241},{"type":"v1","addr":"172.21.15.154:6811","nonce":4028899241}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6814","nonce":4028899241},{"type":"v1","addr":"172.21.15.154:6815","nonce":4028899241}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6812","nonce":4028899241},{"type":"v1","addr":"172.21.15.154:6813","nonce":4028899241}]},"public_addr":"172.21.15.154:6809/4028899241","cluster_addr":"172.21.15.154:6811/4028899241","heartbeat_back_addr":"172.21.15.154:6815/4028899241","heartbeat_front_addr":"172.21.15.154:6813/4028899241","state":["exists","up"]},{"osd":5,"uuid":"d6ab225c-1b55-450a-89a9-abe5c3f8d6af","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":3562396827},{"type":"v1","addr":"172.21.15.154:6801","nonce":3562396827}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":3562396827},{"type":"v1","addr":"172.21.15.154:6803","nonce":3562396827}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6806","nonce":3562396827},{"type":"v1","addr":"172.21.15.154:6807","nonce":3562396827}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6804","nonce":3562396827},{"type":"v1","addr":"172.21.15.154:6805","nonce":3562396827}]},"public_addr":"172.21.15.154:6801/3562396827","cluster_addr":"172.21.15.154:6803/3562396827","heartbeat_back_addr":"172.21.15.154:6807/3562396827","heartbeat_front_addr":"172.21.15.154:6805/3562396827","state":["exists","up"]},{"osd":6,"uuid":"96f905ac-491c-4662-8e2b-5bb8e929ab9d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6816","nonce":2933728751},{"type":"v1","addr":"172.21.15.154:6817","nonce":2933728751}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6818","nonce":2933728751},{"type":"v1","addr":"172.21.15.154:6819","nonce":2933728751}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6822","nonce":2933728751},{"type":"v1","addr":"172.21.15.154:6823","nonce":2933728751}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6820","nonce":2933728751},{"type":"v1","addr":"172.21.15.154:6821","nonce":2933728751}]},"public_addr":"172.21.15.154:6817/2933728751","cluster_addr":"172.21.15.154:6819/2933728751","heartbeat_back_addr":"172.21.15.154:6823/2933728751","heartbeat_front_addr":"172.21.15.154:6821/2933728751","state":["exists","up"]},{"osd":7,"uuid":"07012d3b-3ab4-40df-a471-93caed22e2dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6824","nonce":1753500785},{"type":"v1","addr":"172.21.15.154:6825","nonce":1753500785}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6826","nonce":1753500785},{"type":"v1","addr":"172.21.15.154:6827","nonce":1753500785}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6830","nonce":1753500785},{"type":"v1","addr":"172.21.15.154:6831","nonce":1753500785}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6828","nonce":1753500785},{"type":"v1","addr":"172.21.15.154:6829","nonce":1753500785}]},"public_addr":"172.21.15.154:6825/1753500785","cluster_addr":"172.21.15.154:6827/1753500785","heartbeat_back_addr":"172.21.15.154:6831/1753500785","heartbeat_front_addr":"172.21.15.154:6829/1753500785","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-13T11:28:40.978603+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-13T11:28:41.200985+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-13T11:28:41.222815+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-13T11:28:41.202162+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-13T11:28:40.925911+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-13T11:28:41.087725+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-13T11:28:41.072208+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-13T11:28:40.875257+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-13T11:29:25.739 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:25.734+0000 7fa268d2a640 1 -- 172.21.15.102:0/3883219796 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7fa244066470 msgr2=0x7fa244068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:25.739 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:25.734+0000 7fa268d2a640 1 --2- 172.21.15.102:0/3883219796 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7fa244066470 0x7fa244068930 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fa264071550 tx=0x7fa258009190 comp rx=0 tx=0).stop 2023-11-13T11:29:25.739 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:25.734+0000 7fa268d2a640 1 -- 172.21.15.102:0/3883219796 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa26406c270 msgr2=0x7fa26413b360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:25.740 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:25.734+0000 7fa268d2a640 1 --2- 172.21.15.102:0/3883219796 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa26406c270 0x7fa26413b360 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fa25401d3a0 tx=0x7fa25401ba90 comp rx=0 tx=0).stop 2023-11-13T11:29:25.740 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:25.734+0000 7fa268d2a640 1 -- 172.21.15.102:0/3883219796 shutdown_connections 2023-11-13T11:29:25.740 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:25.734+0000 7fa268d2a640 1 --2- 172.21.15.102:0/3883219796 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa2640cae80 0x7fa2641e6290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:25.740 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:25.734+0000 7fa268d2a640 1 --2- 172.21.15.102:0/3883219796 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa2640b1b70 0x7fa264154330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:25.740 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:25.734+0000 7fa268d2a640 1 --2- 172.21.15.102:0/3883219796 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7fa244066470 0x7fa244068930 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:25.741 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:25.734+0000 7fa268d2a640 1 --2- 172.21.15.102:0/3883219796 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa26406c270 0x7fa26413b360 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:25.741 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:25.734+0000 7fa268d2a640 1 -- 172.21.15.102:0/3883219796 >> 172.21.15.102:0/3883219796 conn(0x7fa2640b0870 msgr2=0x7fa264158580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-13T11:29:25.741 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:25.734+0000 7fa268d2a640 1 -- 172.21.15.102:0/3883219796 shutdown_connections 2023-11-13T11:29:25.741 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:25.734+0000 7fa268d2a640 1 -- 172.21.15.102:0/3883219796 wait complete. 2023-11-13T11:29:25.759 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-13T11:28:44.981356+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-13T11:28:55.958525+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-11-13T11:28:56.394264+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-13T11:29:25.760 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-13T11:29:25.901 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:25.894+0000 7f5773ad6640 1 Processor -- start 2023-11-13T11:29:25.901 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:25.894+0000 7f5773ad6640 1 -- start start 2023-11-13T11:29:25.902 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:25.894+0000 7f5773ad6640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f576c0cf2d0 0x7f576c06fc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:25.903 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:25.894+0000 7f5773ad6640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f576c0711c0 0x7f576c0b3520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:25.903 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:25.894+0000 7f5773ad6640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f576c0b21f0 con 0x7f576c159b30 2023-11-13T11:29:25.903 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:25.894+0000 7f5773ad6640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f576c071670 con 0x7f576c0cf2d0 2023-11-13T11:29:25.903 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:25.894+0000 7f5773ad6640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f576c0b2440 con 0x7f576c0711c0 2023-11-13T11:29:25.904 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:25.894+0000 7f5771071640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f576c0cf2d0 0x7f576c06fc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:25.904 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:25.894+0000 7f5771071640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f576c0cf2d0 0x7f576c06fc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:50728/0 (socket says 172.21.15.102:50728) 2023-11-13T11:29:25.904 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:25.894+0000 7f5771071640 1 -- 172.21.15.102:0/757872244 learned_addr learned my addr 172.21.15.102:0/757872244 (peer_addr_for_me v2:172.21.15.102:0/0) 2023-11-13T11:29:25.904 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:25.898+0000 7f5772073640 1 --2- 172.21.15.102:0/757872244 >> v2:172.21.15.154:3300/0 conn(0x7f576c0711c0 0x7f576c0b3520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:25.904 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:25.898+0000 7f5771071640 1 -- 172.21.15.102:0/757872244 >> v2:172.21.15.154:3300/0 conn(0x7f576c0711c0 msgr2=0x7f576c0b3520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-13T11:29:25.904 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:25.898+0000 7f5771071640 1 --2- 172.21.15.102:0/757872244 >> v2:172.21.15.154:3300/0 conn(0x7f576c0711c0 0x7f576c0b3520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:25.905 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:25.898+0000 7f5771071640 1 -- 172.21.15.102:0/757872244 >> v1:172.21.15.154:6789/0 conn(0x7f576c159b30 legacy=0x7f576c0cebc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-13T11:29:25.905 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:25.898+0000 7f5771071640 1 -- 172.21.15.102:0/757872244 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f576c0b2720 con 0x7f576c0cf2d0 2023-11-13T11:29:25.906 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:25.898+0000 7f5771071640 1 --2- 172.21.15.102:0/757872244 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f576c0cf2d0 0x7f576c06fc80 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f576c0cb410 tx=0x7f575c01c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2315f491607f8c33 server_cookie=0 in_seq=0 out_seq=0 2023-11-13T11:29:25.906 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:25.898+0000 7f5770870640 1 -- 172.21.15.102:0/757872244 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f575c0aa5f0 con 0x7f576c0cf2d0 2023-11-13T11:29:25.906 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:25.898+0000 7f5770870640 1 -- 172.21.15.102:0/757872244 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f575c0aa750 con 0x7f576c0cf2d0 2023-11-13T11:29:25.906 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:25.898+0000 7f5770870640 1 -- 172.21.15.102:0/757872244 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f575c0aaae0 con 0x7f576c0cf2d0 2023-11-13T11:29:25.907 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:25.898+0000 7f5773ad6640 1 -- 172.21.15.102:0/757872244 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f576c0cf2d0 msgr2=0x7f576c06fc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:25.908 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:25.898+0000 7f5773ad6640 1 --2- 172.21.15.102:0/757872244 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f576c0cf2d0 0x7f576c06fc80 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f576c0cb410 tx=0x7f575c01c490 comp rx=0 tx=0).stop 2023-11-13T11:29:25.908 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:25.902+0000 7f5773ad6640 1 -- 172.21.15.102:0/757872244 shutdown_connections 2023-11-13T11:29:25.908 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:25.902+0000 7f5773ad6640 1 --2- 172.21.15.102:0/757872244 >> v2:172.21.15.154:3300/0 conn(0x7f576c0711c0 0x7f576c0b3520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:25.908 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:25.902+0000 7f5773ad6640 1 --2- 172.21.15.102:0/757872244 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f576c0cf2d0 0x7f576c06fc80 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:25.908 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:25.902+0000 7f5773ad6640 1 -- 172.21.15.102:0/757872244 >> 172.21.15.102:0/757872244 conn(0x7f576c06a410 msgr2=0x7f576c06a820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-13T11:29:25.909 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:25.902+0000 7f5773ad6640 1 -- 172.21.15.102:0/757872244 shutdown_connections 2023-11-13T11:29:25.909 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:25.902+0000 7f5773ad6640 1 -- 172.21.15.102:0/757872244 wait complete. 2023-11-13T11:29:25.911 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:25.902+0000 7f5773ad6640 1 Processor -- start 2023-11-13T11:29:25.911 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:25.902+0000 7f5773ad6640 1 -- start start 2023-11-13T11:29:25.911 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:25.902+0000 7f5773ad6640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f576c0711c0 0x7f576c0acb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:25.911 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:25.902+0000 7f5773ad6640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f576c0cf2d0 0x7f576c15c440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:25.912 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:25.902+0000 7f5773ad6640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f576c159b30 0x7f576c146020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:25.912 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:25.902+0000 7f5773ad6640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f576c14e3b0 con 0x7f576c0cf2d0 2023-11-13T11:29:25.912 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:25.902+0000 7f5773ad6640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f576c15ce40 con 0x7f576c159b30 2023-11-13T11:29:25.912 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:25.902+0000 7f5773ad6640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f576c15d120 con 0x7f576c0711c0 2023-11-13T11:29:25.912 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:25.902+0000 7f5771071640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f576c0cf2d0 0x7f576c15c440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:25.913 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:25.902+0000 7f5771071640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f576c0cf2d0 0x7f576c15c440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:50736/0 (socket says 172.21.15.102:50736) 2023-11-13T11:29:25.913 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:25.902+0000 7f5771071640 1 -- 172.21.15.102:0/617237592 learned_addr learned my addr 172.21.15.102:0/617237592 (peer_addr_for_me v2:172.21.15.102:0/0) 2023-11-13T11:29:25.913 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:25.902+0000 7f5771872640 1 --2- 172.21.15.102:0/617237592 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f576c0711c0 0x7f576c0acb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:25.913 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:25.902+0000 7f5772073640 1 --2- 172.21.15.102:0/617237592 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f576c159b30 0x7f576c146020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:25.913 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:25.902+0000 7f5771071640 1 -- 172.21.15.102:0/617237592 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f576c0711c0 msgr2=0x7f576c0acb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:25.914 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:25.902+0000 7f5771071640 1 --2- 172.21.15.102:0/617237592 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f576c0711c0 0x7f576c0acb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:25.914 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:25.902+0000 7f5771071640 1 -- 172.21.15.102:0/617237592 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f576c159b30 msgr2=0x7f576c146020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:25.914 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:25.902+0000 7f5771071640 1 --2- 172.21.15.102:0/617237592 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f576c159b30 0x7f576c146020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:25.914 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:25.902+0000 7f5771071640 1 -- 172.21.15.102:0/617237592 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f575c0094d0 con 0x7f576c0cf2d0 2023-11-13T11:29:25.914 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:25.902+0000 7f5771071640 1 --2- 172.21.15.102:0/617237592 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f576c0cf2d0 0x7f576c15c440 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f575c01a0c0 tx=0x7f575c01acd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-13T11:29:25.915 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:25.906+0000 7f57627fc640 1 -- 172.21.15.102:0/617237592 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f575c0aa5f0 con 0x7f576c0cf2d0 2023-11-13T11:29:25.915 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:25.906+0000 7f57627fc640 1 -- 172.21.15.102:0/617237592 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f575c0b3800 con 0x7f576c0cf2d0 2023-11-13T11:29:25.915 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:25.906+0000 7f57627fc640 1 -- 172.21.15.102:0/617237592 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f575c0b3bb0 con 0x7f576c0cf2d0 2023-11-13T11:29:25.915 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:25.906+0000 7f5773ad6640 1 -- 172.21.15.102:0/617237592 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f576c14dd60 con 0x7f576c0cf2d0 2023-11-13T11:29:25.915 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:25.906+0000 7f5773ad6640 1 -- 172.21.15.102:0/617237592 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f576c152fa0 con 0x7f576c0cf2d0 2023-11-13T11:29:25.916 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:25.906+0000 7f5773ad6640 1 -- 172.21.15.102:0/617237592 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f576c067640 con 0x7f576c0cf2d0 2023-11-13T11:29:25.917 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:25.906+0000 7f57627fc640 1 -- 172.21.15.102:0/617237592 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f575c0b3d10 con 0x7f576c0cf2d0 2023-11-13T11:29:25.917 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:25.906+0000 7f57627fc640 1 --2- 172.21.15.102:0/617237592 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f5750066470 0x7f5750068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:25.917 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:25.906+0000 7f57627fc640 1 -- 172.21.15.102:0/617237592 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f575c0a7070 con 0x7f576c0cf2d0 2023-11-13T11:29:25.917 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:25.906+0000 7f5771872640 1 --2- 172.21.15.102:0/617237592 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f5750066470 0x7f5750068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:25.917 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:25.906+0000 7f5771872640 1 --2- 172.21.15.102:0/617237592 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f5750066470 0x7f5750068930 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f576c152de0 tx=0x7f5768008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-13T11:29:25.918 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:25.910+0000 7f57627fc640 1 -- 172.21.15.102:0/617237592 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f575c0ebe20 con 0x7f576c0cf2d0 2023-11-13T11:29:26.067 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:26.062+0000 7f5773ad6640 1 -- 172.21.15.102:0/617237592 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f576c0ce450 con 0x7f576c0cf2d0 2023-11-13T11:29:26.067 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:26.062+0000 7f57627fc640 1 -- 172.21.15.102:0/617237592 <== mon.0 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v22) v1 ==== 93+0+10 (secure 0 0 0) 0x7f575c0ef440 con 0x7f576c0cf2d0 2023-11-13T11:29:26.068 INFO:teuthology.orchestra.run.smithi102.stdout:pg_num: 1 2023-11-13T11:29:26.069 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:26.062+0000 7f5773ad6640 1 -- 172.21.15.102:0/617237592 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f5750066470 msgr2=0x7f5750068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:26.069 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:26.062+0000 7f5773ad6640 1 --2- 172.21.15.102:0/617237592 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f5750066470 0x7f5750068930 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f576c152de0 tx=0x7f5768008040 comp rx=0 tx=0).stop 2023-11-13T11:29:26.069 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:26.062+0000 7f5773ad6640 1 -- 172.21.15.102:0/617237592 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f576c0cf2d0 msgr2=0x7f576c15c440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:26.070 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:26.062+0000 7f5773ad6640 1 --2- 172.21.15.102:0/617237592 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f576c0cf2d0 0x7f576c15c440 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f575c01a0c0 tx=0x7f575c01acd0 comp rx=0 tx=0).stop 2023-11-13T11:29:26.070 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:26.062+0000 7f5773ad6640 1 -- 172.21.15.102:0/617237592 shutdown_connections 2023-11-13T11:29:26.070 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:26.062+0000 7f5773ad6640 1 --2- 172.21.15.102:0/617237592 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f576c159b30 0x7f576c146020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:26.070 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:26.062+0000 7f5773ad6640 1 --2- 172.21.15.102:0/617237592 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f5750066470 0x7f5750068930 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:26.070 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:26.062+0000 7f5773ad6640 1 --2- 172.21.15.102:0/617237592 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f576c0cf2d0 0x7f576c15c440 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:26.071 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:26.062+0000 7f5773ad6640 1 --2- 172.21.15.102:0/617237592 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f576c0711c0 0x7f576c0acb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:26.071 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:26.062+0000 7f5773ad6640 1 -- 172.21.15.102:0/617237592 >> 172.21.15.102:0/617237592 conn(0x7f576c06a410 msgr2=0x7f576c0b0e40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-13T11:29:26.071 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:26.062+0000 7f5773ad6640 1 -- 172.21.15.102:0/617237592 shutdown_connections 2023-11-13T11:29:26.071 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:26.062+0000 7f5773ad6640 1 -- 172.21.15.102:0/617237592 wait complete. 2023-11-13T11:29:26.088 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-13T11:29:26.229 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:26.222+0000 7fec29a46640 1 Processor -- start 2023-11-13T11:29:26.230 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:26.222+0000 7fec29a46640 1 -- start start 2023-11-13T11:29:26.230 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:26.222+0000 7fec29a46640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fec2415d0b0 0x7fec240cebc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:26.231 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:26.222+0000 7fec29a46640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7fec24071620 0x7fec240cf100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:26.231 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:26.222+0000 7fec29a46640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fec2406d130 con 0x7fec240b1920 2023-11-13T11:29:26.231 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:26.222+0000 7fec29a46640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fec24070030 con 0x7fec24071620 2023-11-13T11:29:26.231 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:26.222+0000 7fec29a46640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fec24070310 con 0x7fec2415d0b0 2023-11-13T11:29:26.232 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:26.226+0000 7fec237fe640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7fec24071620 0x7fec240cf100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:26.232 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:26.226+0000 7fec227fc640 1 --1- >> v1:172.21.15.102:6789/0 conn(0x7fec240b1920 0x7fec240ac8a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.102:6789/0 says I am v1:172.21.15.102:36740/0 (socket says 172.21.15.102:36740) 2023-11-13T11:29:26.232 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:26.226+0000 7fec227fc640 1 -- 172.21.15.102:0/101873847 learned_addr learned my addr 172.21.15.102:0/101873847 (peer_addr_for_me v1:172.21.15.102:0/0) 2023-11-13T11:29:26.233 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:26.226+0000 7fec22ffd640 1 --2- 172.21.15.102:0/101873847 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fec2415d0b0 0x7fec240cebc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:26.233 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:26.226+0000 7fec237fe640 1 -- 172.21.15.102:0/101873847 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fec2415d0b0 msgr2=0x7fec240cebc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-13T11:29:26.233 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:26.226+0000 7fec237fe640 1 --2- 172.21.15.102:0/101873847 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fec2415d0b0 0x7fec240cebc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:26.233 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:26.226+0000 7fec237fe640 1 -- 172.21.15.102:0/101873847 >> v1:172.21.15.102:6789/0 conn(0x7fec240b1920 legacy=0x7fec240ac8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:26.233 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:26.226+0000 7fec237fe640 1 -- 172.21.15.102:0/101873847 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec240705f0 con 0x7fec24071620 2023-11-13T11:29:26.234 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:26.226+0000 7fec21ffb640 1 -- 172.21.15.102:0/101873847 <== mon.0 v1:172.21.15.102:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1691699642 0 0) 0x7fec2406d130 con 0x7fec240b1920 2023-11-13T11:29:26.235 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:26.226+0000 7fec237fe640 1 --2- 172.21.15.102:0/101873847 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fec24071620 0x7fec240cf100 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fec1c0097c0 tx=0x7fec1c01ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4692ed7695fd96be server_cookie=0 in_seq=0 out_seq=0 2023-11-13T11:29:26.236 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:26.226+0000 7fec21ffb640 1 -- 172.21.15.102:0/101873847 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec1c0a8970 con 0x7fec24071620 2023-11-13T11:29:26.236 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:26.226+0000 7fec21ffb640 1 -- 172.21.15.102:0/101873847 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec1c0a8ad0 con 0x7fec24071620 2023-11-13T11:29:26.236 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:26.226+0000 7fec21ffb640 1 -- 172.21.15.102:0/101873847 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec1c0a8e60 con 0x7fec24071620 2023-11-13T11:29:26.236 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:26.230+0000 7fec29a46640 1 -- 172.21.15.102:0/101873847 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fec24071620 msgr2=0x7fec240cf100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:26.237 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:26.230+0000 7fec29a46640 1 --2- 172.21.15.102:0/101873847 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fec24071620 0x7fec240cf100 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fec1c0097c0 tx=0x7fec1c01ec70 comp rx=0 tx=0).stop 2023-11-13T11:29:26.237 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:26.230+0000 7fec29a46640 1 -- 172.21.15.102:0/101873847 shutdown_connections 2023-11-13T11:29:26.237 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:26.230+0000 7fec29a46640 1 --2- 172.21.15.102:0/101873847 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fec24071620 0x7fec240cf100 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:26.237 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:26.230+0000 7fec29a46640 1 --2- 172.21.15.102:0/101873847 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fec2415d0b0 0x7fec240cebc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:26.237 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:26.230+0000 7fec29a46640 1 -- 172.21.15.102:0/101873847 >> 172.21.15.102:0/101873847 conn(0x7fec2406a410 msgr2=0x7fec2406a820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-13T11:29:26.238 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:26.230+0000 7fec29a46640 1 -- 172.21.15.102:0/101873847 shutdown_connections 2023-11-13T11:29:26.238 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:26.230+0000 7fec29a46640 1 -- 172.21.15.102:0/101873847 wait complete. 2023-11-13T11:29:26.240 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:26.230+0000 7fec29a46640 1 Processor -- start 2023-11-13T11:29:26.240 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:26.230+0000 7fec29a46640 1 -- start start 2023-11-13T11:29:26.240 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:26.230+0000 7fec29a46640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fec24071620 0x7fec241473c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:26.240 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:26.230+0000 7fec29a46640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fec240b1920 0x7fec240cb660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:26.241 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:26.230+0000 7fec29a46640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fec2415d0b0 0x7fec241560d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:26.241 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:26.230+0000 7fec29a46640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec240cc0a0 con 0x7fec2415d0b0 2023-11-13T11:29:26.241 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:26.230+0000 7fec29a46640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec240cc380 con 0x7fec240b1920 2023-11-13T11:29:26.241 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:26.230+0000 7fec29a46640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fec240cc660 con 0x7fec24071620 2023-11-13T11:29:26.242 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:26.230+0000 7fec237fe640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fec2415d0b0 0x7fec241560d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:26.242 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:26.230+0000 7fec237fe640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fec2415d0b0 0x7fec241560d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:50750/0 (socket says 172.21.15.102:50750) 2023-11-13T11:29:26.242 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:26.230+0000 7fec237fe640 1 -- 172.21.15.102:0/349638976 learned_addr learned my addr 172.21.15.102:0/349638976 (peer_addr_for_me v2:172.21.15.102:0/0) 2023-11-13T11:29:26.242 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:26.230+0000 7fec22ffd640 1 --2- 172.21.15.102:0/349638976 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fec24071620 0x7fec241473c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:26.242 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:26.234+0000 7fec227fc640 1 --2- 172.21.15.102:0/349638976 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fec240b1920 0x7fec240cb660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:26.243 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:26.234+0000 7fec237fe640 1 -- 172.21.15.102:0/349638976 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fec24071620 msgr2=0x7fec241473c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:26.243 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:26.234+0000 7fec237fe640 1 --2- 172.21.15.102:0/349638976 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fec24071620 0x7fec241473c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:26.243 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:26.234+0000 7fec237fe640 1 -- 172.21.15.102:0/349638976 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fec240b1920 msgr2=0x7fec240cb660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:26.243 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:26.234+0000 7fec237fe640 1 --2- 172.21.15.102:0/349638976 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fec240b1920 0x7fec240cb660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:26.243 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:26.234+0000 7fec237fe640 1 -- 172.21.15.102:0/349638976 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec1c009420 con 0x7fec2415d0b0 2023-11-13T11:29:26.244 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:26.234+0000 7fec237fe640 1 --2- 172.21.15.102:0/349638976 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fec2415d0b0 0x7fec241560d0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fec1c01c8a0 tx=0x7fec1c01ba10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-13T11:29:26.244 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:26.234+0000 7fec0bfff640 1 -- 172.21.15.102:0/349638976 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec1c0b9630 con 0x7fec2415d0b0 2023-11-13T11:29:26.244 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:26.234+0000 7fec0bfff640 1 -- 172.21.15.102:0/349638976 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec1c0b9790 con 0x7fec2415d0b0 2023-11-13T11:29:26.244 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:26.234+0000 7fec29a46640 1 -- 172.21.15.102:0/349638976 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fec240cc940 con 0x7fec2415d0b0 2023-11-13T11:29:26.244 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:26.234+0000 7fec0bfff640 1 -- 172.21.15.102:0/349638976 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec1c0b9b40 con 0x7fec2415d0b0 2023-11-13T11:29:26.245 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:26.234+0000 7fec29a46640 1 -- 172.21.15.102:0/349638976 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fec240ccf00 con 0x7fec2415d0b0 2023-11-13T11:29:26.246 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:26.234+0000 7fec29a46640 1 -- 172.21.15.102:0/349638976 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fec24067640 con 0x7fec2415d0b0 2023-11-13T11:29:26.246 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:26.234+0000 7fec0bfff640 1 -- 172.21.15.102:0/349638976 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fec1c0b7040 con 0x7fec2415d0b0 2023-11-13T11:29:26.246 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:26.238+0000 7fec0bfff640 1 --2- 172.21.15.102:0/349638976 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7fec10066470 0x7fec10068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:26.247 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:26.238+0000 7fec0bfff640 1 -- 172.21.15.102:0/349638976 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fec1c121fa0 con 0x7fec2415d0b0 2023-11-13T11:29:26.247 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:26.238+0000 7fec22ffd640 1 --2- 172.21.15.102:0/349638976 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7fec10066470 0x7fec10068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:26.247 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:26.238+0000 7fec22ffd640 1 --2- 172.21.15.102:0/349638976 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7fec10066470 0x7fec10068930 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fec14003fd0 tx=0x7fec140039a0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-13T11:29:26.247 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:26.242+0000 7fec0bfff640 1 -- 172.21.15.102:0/349638976 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fec1c0ef2f0 con 0x7fec2415d0b0 2023-11-13T11:29:26.399 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:26.394+0000 7fec29a46640 1 -- 172.21.15.102:0/349638976 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fec240cd0f0 con 0x7fec2415d0b0 2023-11-13T11:29:26.485 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:26.394+0000 7fec0bfff640 1 -- 172.21.15.102:0/349638976 <== mon.0 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v22) v1 ==== 104+0+11 (secure 0 0 0) 0x7fec1c0b5070 con 0x7fec2415d0b0 2023-11-13T11:29:26.485 INFO:teuthology.orchestra.run.smithi102.stdout:pg_num: 32 2023-11-13T11:29:26.487 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:26.394+0000 7fec29a46640 1 -- 172.21.15.102:0/349638976 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7fec10066470 msgr2=0x7fec10068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:26.487 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:26.394+0000 7fec29a46640 1 --2- 172.21.15.102:0/349638976 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7fec10066470 0x7fec10068930 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fec14003fd0 tx=0x7fec140039a0 comp rx=0 tx=0).stop 2023-11-13T11:29:26.487 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:26.394+0000 7fec29a46640 1 -- 172.21.15.102:0/349638976 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fec2415d0b0 msgr2=0x7fec241560d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:26.488 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:26.394+0000 7fec29a46640 1 --2- 172.21.15.102:0/349638976 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fec2415d0b0 0x7fec241560d0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fec1c01c8a0 tx=0x7fec1c01ba10 comp rx=0 tx=0).stop 2023-11-13T11:29:26.488 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:26.394+0000 7fec29a46640 1 -- 172.21.15.102:0/349638976 shutdown_connections 2023-11-13T11:29:26.488 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:26.394+0000 7fec29a46640 1 --2- 172.21.15.102:0/349638976 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7fec10066470 0x7fec10068930 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:26.488 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:26.394+0000 7fec29a46640 1 --2- 172.21.15.102:0/349638976 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fec2415d0b0 0x7fec241560d0 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:26.488 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:26.394+0000 7fec29a46640 1 --2- 172.21.15.102:0/349638976 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fec240b1920 0x7fec240cb660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:26.489 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:26.394+0000 7fec29a46640 1 --2- 172.21.15.102:0/349638976 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fec24071620 0x7fec241473c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:26.489 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:26.394+0000 7fec29a46640 1 -- 172.21.15.102:0/349638976 >> 172.21.15.102:0/349638976 conn(0x7fec2406a410 msgr2=0x7fec2415b930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-13T11:29:26.489 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:26.394+0000 7fec29a46640 1 -- 172.21.15.102:0/349638976 shutdown_connections 2023-11-13T11:29:26.489 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:26.394+0000 7fec29a46640 1 -- 172.21.15.102:0/349638976 wait complete. 2023-11-13T11:29:26.489 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-13T11:29:26.630 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:26.622+0000 7f5feb59e640 1 Processor -- start 2023-11-13T11:29:26.630 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:26.622+0000 7f5feb59e640 1 -- start start 2023-11-13T11:29:26.634 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:26.626+0000 7f5feb59e640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f5fec0cfc80 0x7f5fec0cd750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:26.634 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:26.626+0000 7f5feb59e640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5fec0d3800 con 0x7f5fec0b3660 2023-11-13T11:29:26.634 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:26.626+0000 7f5feb59e640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5fec0d0ac0 con 0x7f5fec0d1120 2023-11-13T11:29:26.635 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:26.626+0000 7f5feb59e640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5fec0d3ae0 con 0x7f5fec0cfc80 2023-11-13T11:29:26.635 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:26.626+0000 7f5fe1d9b640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f5fec0cfc80 0x7f5fec0cd750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:26.635 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:26.626+0000 7f5fead9d640 1 --1- >> v1:172.21.15.102:6789/0 conn(0x7f5fec0b3660 0x7f5fec0cdc90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.102:6789/0 says I am v1:172.21.15.102:36756/0 (socket says 172.21.15.102:36756) 2023-11-13T11:29:26.635 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:26.626+0000 7f5fead9d640 1 -- 172.21.15.102:0/2727115670 learned_addr learned my addr 172.21.15.102:0/2727115670 (peer_addr_for_me v1:172.21.15.102:0/0) 2023-11-13T11:29:26.635 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:26.626+0000 7f5fe9d9b640 1 -- 172.21.15.102:0/2727115670 <== mon.0 v1:172.21.15.102:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1261031406 0 0) 0x7f5fec0d3800 con 0x7f5fec0b3660 2023-11-13T11:29:26.636 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:26.626+0000 7f5fe1d9b640 1 -- 172.21.15.102:0/2727115670 >> v1:172.21.15.154:6789/0 conn(0x7f5fec0d1120 legacy=0x7f5fec0d1500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:26.636 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:26.626+0000 7f5fe1d9b640 1 -- 172.21.15.102:0/2727115670 >> v1:172.21.15.102:6789/0 conn(0x7f5fec0b3660 legacy=0x7f5fec0cdc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:26.636 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:26.626+0000 7f5fe1d9b640 1 -- 172.21.15.102:0/2727115670 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5fec0b1b10 con 0x7f5fec0cfc80 2023-11-13T11:29:26.639 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:26.626+0000 7f5fe1d9b640 1 --2- 172.21.15.102:0/2727115670 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5fec0cfc80 0x7f5fec0cd750 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f5fd40097c0 tx=0x7f5fd401c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6bd0ec2d9341447d server_cookie=0 in_seq=0 out_seq=0 2023-11-13T11:29:26.640 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:26.630+0000 7f5fe9d9b640 1 -- 172.21.15.102:0/2727115670 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fd40ab600 con 0x7f5fec0cfc80 2023-11-13T11:29:26.640 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:26.630+0000 7f5fe9d9b640 1 -- 172.21.15.102:0/2727115670 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5fd40a7050 con 0x7f5fec0cfc80 2023-11-13T11:29:26.640 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:26.630+0000 7f5fe9d9b640 1 -- 172.21.15.102:0/2727115670 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fd40ab980 con 0x7f5fec0cfc80 2023-11-13T11:29:26.640 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:26.630+0000 7f5feb59e640 1 -- 172.21.15.102:0/2727115670 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5fec0cfc80 msgr2=0x7f5fec0cd750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:26.641 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:26.630+0000 7f5feb59e640 1 --2- 172.21.15.102:0/2727115670 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5fec0cfc80 0x7f5fec0cd750 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f5fd40097c0 tx=0x7f5fd401c480 comp rx=0 tx=0).stop 2023-11-13T11:29:26.641 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:26.630+0000 7f5feb59e640 1 -- 172.21.15.102:0/2727115670 shutdown_connections 2023-11-13T11:29:26.641 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:26.630+0000 7f5feb59e640 1 --2- 172.21.15.102:0/2727115670 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5fec0cfc80 0x7f5fec0cd750 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:26.641 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:26.630+0000 7f5feb59e640 1 -- 172.21.15.102:0/2727115670 >> 172.21.15.102:0/2727115670 conn(0x7f5fec0d2b40 msgr2=0x7f5fec0d2f50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-13T11:29:26.641 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:26.630+0000 7f5feb59e640 1 -- 172.21.15.102:0/2727115670 shutdown_connections 2023-11-13T11:29:26.642 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:26.630+0000 7f5feb59e640 1 -- 172.21.15.102:0/2727115670 wait complete. 2023-11-13T11:29:26.642 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:26.630+0000 7f5feb59e640 1 Processor -- start 2023-11-13T11:29:26.642 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:26.630+0000 7f5feb59e640 1 -- start start 2023-11-13T11:29:26.642 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:26.630+0000 7f5feb59e640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5fec0b3660 0x7f5fec15aae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:26.642 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:26.630+0000 7f5feb59e640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5fec0cfc80 0x7f5fec14e6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:26.643 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:26.630+0000 7f5feb59e640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5fec0d1120 0x7f5fec15b6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:26.643 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:26.630+0000 7f5feb59e640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5fec0d0ea0 con 0x7f5fec0cfc80 2023-11-13T11:29:26.643 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:26.630+0000 7f5feb59e640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5fec0b7c00 con 0x7f5fec0b3660 2023-11-13T11:29:26.643 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:26.630+0000 7f5feb59e640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5fec15a070 con 0x7f5fec0d1120 2023-11-13T11:29:26.643 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:26.630+0000 7f5fe1d9b640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5fec0cfc80 0x7f5fec14e6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:26.644 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:26.630+0000 7f5fe1d9b640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5fec0cfc80 0x7f5fec14e6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:50770/0 (socket says 172.21.15.102:50770) 2023-11-13T11:29:26.644 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:26.630+0000 7f5fe1d9b640 1 -- 172.21.15.102:0/486744230 learned_addr learned my addr 172.21.15.102:0/486744230 (peer_addr_for_me v2:172.21.15.102:0/0) 2023-11-13T11:29:26.644 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:26.630+0000 7f5fea59c640 1 --2- 172.21.15.102:0/486744230 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5fec0b3660 0x7f5fec15aae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:26.644 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:26.634+0000 7f5fead9d640 1 --2- 172.21.15.102:0/486744230 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5fec0d1120 0x7f5fec15b6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:26.644 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:26.634+0000 7f5fe1d9b640 1 -- 172.21.15.102:0/486744230 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5fec0d1120 msgr2=0x7f5fec15b6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:26.645 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:26.634+0000 7f5fe1d9b640 1 --2- 172.21.15.102:0/486744230 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5fec0d1120 0x7f5fec15b6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:26.645 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:26.634+0000 7f5fe1d9b640 1 -- 172.21.15.102:0/486744230 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5fec0b3660 msgr2=0x7f5fec15aae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:26.645 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:26.634+0000 7f5fe1d9b640 1 --2- 172.21.15.102:0/486744230 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5fec0b3660 0x7f5fec15aae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:26.645 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:26.634+0000 7f5fe1d9b640 1 -- 172.21.15.102:0/486744230 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5fd4009420 con 0x7f5fec0cfc80 2023-11-13T11:29:26.645 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:26.634+0000 7f5fea59c640 1 --2- 172.21.15.102:0/486744230 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5fec0b3660 0x7f5fec15aae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-13T11:29:26.646 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:26.634+0000 7f5fead9d640 1 --2- 172.21.15.102:0/486744230 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5fec0d1120 0x7f5fec15b6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-13T11:29:26.646 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:26.634+0000 7f5fe1d9b640 1 --2- 172.21.15.102:0/486744230 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5fec0cfc80 0x7f5fec14e6b0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f5fd40ae040 tx=0x7f5fd4019220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-13T11:29:26.646 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:26.634+0000 7f5fe37fe640 1 -- 172.21.15.102:0/486744230 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fd40b4840 con 0x7f5fec0cfc80 2023-11-13T11:29:26.646 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:26.634+0000 7f5fe37fe640 1 -- 172.21.15.102:0/486744230 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5fec0cebb0 con 0x7f5fec0cfc80 2023-11-13T11:29:26.646 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:26.634+0000 7f5feb59e640 1 -- 172.21.15.102:0/486744230 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5fec15b020 con 0x7f5fec0cfc80 2023-11-13T11:29:26.647 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:26.634+0000 7f5fe37fe640 1 -- 172.21.15.102:0/486744230 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fd40b4be0 con 0x7f5fec0cfc80 2023-11-13T11:29:26.647 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:26.634+0000 7f5feb59e640 1 -- 172.21.15.102:0/486744230 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5fec15c270 con 0x7f5fec0cfc80 2023-11-13T11:29:26.648 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:26.634+0000 7f5feb59e640 1 -- 172.21.15.102:0/486744230 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5fec068520 con 0x7f5fec0cfc80 2023-11-13T11:29:26.648 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:26.634+0000 7f5fe37fe640 1 -- 172.21.15.102:0/486744230 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f5fd40b2040 con 0x7f5fec0cfc80 2023-11-13T11:29:26.648 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:26.634+0000 7f5fe37fe640 1 --2- 172.21.15.102:0/486744230 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f5fcc066470 0x7f5fcc068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:26.649 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:26.634+0000 7f5fe37fe640 1 -- 172.21.15.102:0/486744230 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f5fd411e140 con 0x7f5fec0cfc80 2023-11-13T11:29:26.649 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:26.634+0000 7f5fea59c640 1 --2- 172.21.15.102:0/486744230 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f5fcc066470 0x7f5fcc068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:26.649 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:26.638+0000 7f5fea59c640 1 --2- 172.21.15.102:0/486744230 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f5fcc066470 0x7f5fcc068930 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f5fdc0012f0 tx=0x7f5fdc009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-13T11:29:26.649 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:26.638+0000 7f5fe37fe640 1 -- 172.21.15.102:0/486744230 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f5fd40eb520 con 0x7f5fec0cfc80 2023-11-13T11:29:26.795 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:26.790+0000 7f5feb59e640 1 -- 172.21.15.102:0/486744230 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f5fec0b0a90 con 0x7f5fec0cfc80 2023-11-13T11:29:26.795 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:26.790+0000 7f5fe37fe640 1 -- 172.21.15.102:0/486744230 <== mon.0 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v22) v1 ==== 100+0+11 (secure 0 0 0) 0x7f5fd40eeb40 con 0x7f5fec0cfc80 2023-11-13T11:29:26.796 INFO:teuthology.orchestra.run.smithi102.stdout:pg_num: 64 2023-11-13T11:29:26.797 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:26.790+0000 7f5feb59e640 1 -- 172.21.15.102:0/486744230 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f5fcc066470 msgr2=0x7f5fcc068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:26.797 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:26.790+0000 7f5feb59e640 1 --2- 172.21.15.102:0/486744230 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f5fcc066470 0x7f5fcc068930 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f5fdc0012f0 tx=0x7f5fdc009040 comp rx=0 tx=0).stop 2023-11-13T11:29:26.798 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:26.790+0000 7f5feb59e640 1 -- 172.21.15.102:0/486744230 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5fec0cfc80 msgr2=0x7f5fec14e6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:26.798 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:26.790+0000 7f5feb59e640 1 --2- 172.21.15.102:0/486744230 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5fec0cfc80 0x7f5fec14e6b0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f5fd40ae040 tx=0x7f5fd4019220 comp rx=0 tx=0).stop 2023-11-13T11:29:26.798 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:26.790+0000 7f5feb59e640 1 -- 172.21.15.102:0/486744230 shutdown_connections 2023-11-13T11:29:26.798 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:26.790+0000 7f5feb59e640 1 --2- 172.21.15.102:0/486744230 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5fec0d1120 0x7f5fec15b6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:26.798 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:26.790+0000 7f5feb59e640 1 --2- 172.21.15.102:0/486744230 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f5fcc066470 0x7f5fcc068930 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:26.799 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:26.790+0000 7f5feb59e640 1 --2- 172.21.15.102:0/486744230 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5fec0cfc80 0x7f5fec14e6b0 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:26.799 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:26.790+0000 7f5feb59e640 1 --2- 172.21.15.102:0/486744230 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5fec0b3660 0x7f5fec15aae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:26.799 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:26.790+0000 7f5feb59e640 1 -- 172.21.15.102:0/486744230 >> 172.21.15.102:0/486744230 conn(0x7f5fec0d2b40 msgr2=0x7f5fec0af960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-13T11:29:26.800 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:26.790+0000 7f5feb59e640 1 -- 172.21.15.102:0/486744230 shutdown_connections 2023-11-13T11:29:26.800 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:26.790+0000 7f5feb59e640 1 -- 172.21.15.102:0/486744230 wait complete. 2023-11-13T11:29:26.816 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.tests_from_xfstests_dev.TestXFSTestsDev.test_generic' 2023-11-13T11:29:26.955 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:26.950+0000 7f8222d6f640 1 Processor -- start 2023-11-13T11:29:26.956 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:26.950+0000 7f8222d6f640 1 -- start start 2023-11-13T11:29:26.956 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:26.950+0000 7f8222d6f640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f821c15d060 0x7f821c0d08c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:26.957 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:26.950+0000 7f8222d6f640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f821c0b27f0 con 0x7f821c0d3810 2023-11-13T11:29:26.957 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:26.950+0000 7f8222d6f640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f821c0ce340 con 0x7f821c0d17b0 2023-11-13T11:29:26.957 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:26.950+0000 7f8222d6f640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f821c0cebe0 con 0x7f821c15d060 2023-11-13T11:29:26.957 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:26.950+0000 7f8221d6d640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f821c15d060 0x7f821c0d08c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:26.958 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:26.950+0000 7f822156c640 1 --1- >> v1:172.21.15.102:6789/0 conn(0x7f821c0d3810 0x7f821c0d10a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.102:6789/0 says I am v1:172.21.15.102:36770/0 (socket says 172.21.15.102:36770) 2023-11-13T11:29:26.958 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:26.950+0000 7f822156c640 1 -- 172.21.15.102:0/1293483705 learned_addr learned my addr 172.21.15.102:0/1293483705 (peer_addr_for_me v1:172.21.15.102:0/0) 2023-11-13T11:29:26.958 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:26.950+0000 7f8221d6d640 1 -- 172.21.15.102:0/1293483705 >> v1:172.21.15.154:6789/0 conn(0x7f821c0d17b0 legacy=0x7f821c0b2cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-13T11:29:26.959 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:26.950+0000 7f8221d6d640 1 -- 172.21.15.102:0/1293483705 >> v1:172.21.15.102:6789/0 conn(0x7f821c0d3810 legacy=0x7f821c0d10a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:26.959 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:26.950+0000 7f8221d6d640 1 -- 172.21.15.102:0/1293483705 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f821c0ce620 con 0x7f821c15d060 2023-11-13T11:29:26.959 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:26.950+0000 7f8220d6b640 1 -- 172.21.15.102:0/1293483705 <== mon.0 v1:172.21.15.102:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1711864091 0 0) 0x7f821c0b27f0 con 0x7f821c0d3810 2023-11-13T11:29:26.960 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:26.954+0000 7f8221d6d640 1 --2- 172.21.15.102:0/1293483705 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f821c15d060 0x7f821c0d08c0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f82180097c0 tx=0x7f821801c440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1c6b1c898690fb0c server_cookie=0 in_seq=0 out_seq=0 2023-11-13T11:29:26.960 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:26.954+0000 7f8220d6b640 1 -- 172.21.15.102:0/1293483705 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82180ab620 con 0x7f821c15d060 2023-11-13T11:29:26.961 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:26.954+0000 7f8220d6b640 1 -- 172.21.15.102:0/1293483705 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f82180ab780 con 0x7f821c15d060 2023-11-13T11:29:26.961 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:26.954+0000 7f8220d6b640 1 -- 172.21.15.102:0/1293483705 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82180abb10 con 0x7f821c15d060 2023-11-13T11:29:26.962 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:26.954+0000 7f8222d6f640 1 -- 172.21.15.102:0/1293483705 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f821c15d060 msgr2=0x7f821c0d08c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:26.962 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:26.954+0000 7f8222d6f640 1 --2- 172.21.15.102:0/1293483705 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f821c15d060 0x7f821c0d08c0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f82180097c0 tx=0x7f821801c440 comp rx=0 tx=0).stop 2023-11-13T11:29:26.962 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:26.954+0000 7f8222d6f640 1 -- 172.21.15.102:0/1293483705 shutdown_connections 2023-11-13T11:29:26.962 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:26.954+0000 7f8222d6f640 1 --2- 172.21.15.102:0/1293483705 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f821c15d060 0x7f821c0d08c0 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:26.963 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:26.954+0000 7f8222d6f640 1 -- 172.21.15.102:0/1293483705 >> 172.21.15.102:0/1293483705 conn(0x7f821c0d2cf0 msgr2=0x7f821c0d3100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-13T11:29:26.963 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:26.954+0000 7f8222d6f640 1 -- 172.21.15.102:0/1293483705 shutdown_connections 2023-11-13T11:29:26.963 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:26.954+0000 7f8222d6f640 1 -- 172.21.15.102:0/1293483705 wait complete. 2023-11-13T11:29:26.965 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:26.958+0000 7f8222d6f640 1 Processor -- start 2023-11-13T11:29:26.965 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:26.958+0000 7f8222d6f640 1 -- start start 2023-11-13T11:29:26.966 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:26.958+0000 7f8222d6f640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f821c0d17b0 0x7f821c0b7d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:26.966 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:26.958+0000 7f8222d6f640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f821c0d3810 0x7f821c0b8250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:26.966 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:26.958+0000 7f8222d6f640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f821c15d060 0x7f821c157d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:26.966 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:26.958+0000 7f8222d6f640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f821c0c9e60 con 0x7f821c0d3810 2023-11-13T11:29:26.966 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:26.958+0000 7f8222d6f640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f821c0ca100 con 0x7f821c15d060 2023-11-13T11:29:26.967 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:26.958+0000 7f8222d6f640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f821c0ca3e0 con 0x7f821c0d17b0 2023-11-13T11:29:26.967 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:26.958+0000 7f822156c640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f821c0d3810 0x7f821c0b8250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:26.967 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:26.958+0000 7f822156c640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f821c0d3810 0x7f821c0b8250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:50790/0 (socket says 172.21.15.102:50790) 2023-11-13T11:29:26.967 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:26.958+0000 7f822156c640 1 -- 172.21.15.102:0/342179335 learned_addr learned my addr 172.21.15.102:0/342179335 (peer_addr_for_me v2:172.21.15.102:0/0) 2023-11-13T11:29:26.967 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:26.958+0000 7f822256e640 1 --2- 172.21.15.102:0/342179335 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f821c15d060 0x7f821c157d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:26.968 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:26.958+0000 7f8221d6d640 1 --2- 172.21.15.102:0/342179335 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f821c0d17b0 0x7f821c0b7d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:26.968 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:26.958+0000 7f822156c640 1 -- 172.21.15.102:0/342179335 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f821c0d17b0 msgr2=0x7f821c0b7d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:26.968 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:26.958+0000 7f822156c640 1 --2- 172.21.15.102:0/342179335 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f821c0d17b0 0x7f821c0b7d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:26.968 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:26.958+0000 7f822156c640 1 -- 172.21.15.102:0/342179335 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f821c15d060 msgr2=0x7f821c157d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:26.968 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:26.958+0000 7f822156c640 1 --2- 172.21.15.102:0/342179335 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f821c15d060 0x7f821c157d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:26.969 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:26.958+0000 7f822156c640 1 -- 172.21.15.102:0/342179335 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8218009420 con 0x7f821c0d3810 2023-11-13T11:29:26.969 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:26.958+0000 7f822256e640 1 --2- 172.21.15.102:0/342179335 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f821c15d060 0x7f821c157d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-13T11:29:26.969 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:26.958+0000 7f822156c640 1 --2- 172.21.15.102:0/342179335 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f821c0d3810 0x7f821c0b8250 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f820c00c480 tx=0x7f820c00c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-13T11:29:26.969 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:26.958+0000 7f82127fc640 1 -- 172.21.15.102:0/342179335 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f820c0074e0 con 0x7f821c0d3810 2023-11-13T11:29:26.969 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:26.958+0000 7f82127fc640 1 -- 172.21.15.102:0/342179335 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f820c007660 con 0x7f821c0d3810 2023-11-13T11:29:26.969 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:26.958+0000 7f82127fc640 1 -- 172.21.15.102:0/342179335 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f820c004a30 con 0x7f821c0d3810 2023-11-13T11:29:26.970 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:26.958+0000 7f8222d6f640 1 -- 172.21.15.102:0/342179335 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f821c0ca6c0 con 0x7f821c0d3810 2023-11-13T11:29:26.970 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:26.958+0000 7f8222d6f640 1 -- 172.21.15.102:0/342179335 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f821c06c090 con 0x7f821c0d3810 2023-11-13T11:29:26.971 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:26.958+0000 7f8222d6f640 1 -- 172.21.15.102:0/342179335 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f821c068520 con 0x7f821c0d3810 2023-11-13T11:29:26.971 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:26.962+0000 7f82127fc640 1 -- 172.21.15.102:0/342179335 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f820c004b90 con 0x7f821c0d3810 2023-11-13T11:29:26.971 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:26.962+0000 7f82127fc640 1 --2- 172.21.15.102:0/342179335 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f8200066470 0x7f8200068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:26.971 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:26.962+0000 7f82127fc640 1 -- 172.21.15.102:0/342179335 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f820c082ff0 con 0x7f821c0d3810 2023-11-13T11:29:26.972 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:26.962+0000 7f8221d6d640 1 --2- 172.21.15.102:0/342179335 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f8200066470 0x7f8200068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:26.972 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:26.962+0000 7f8221d6d640 1 --2- 172.21.15.102:0/342179335 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f8200066470 0x7f8200068930 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f82180af000 tx=0x7f82180a7000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-13T11:29:26.972 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:26.966+0000 7f82127fc640 1 -- 172.21.15.102:0/342179335 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f820c053fa0 con 0x7f821c0d3810 2023-11-13T11:29:27.178 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:27.170+0000 7f8222d6f640 1 -- 172.21.15.102:0/342179335 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.tests_from_xfstests_dev.TestXFSTestsDev.test_generic"]} v 0) v1 -- 0x7f821c0c6260 con 0x7f821c0d3810 2023-11-13T11:29:27.654 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:27.646+0000 7f82127fc640 1 -- 172.21.15.102:0/342179335 <== mon.0 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.tests_from_xfstests_dev.TestXFSTestsDev.test_generic"]}]=0 v54) v1 ==== 147+0+0 (secure 0 0 0) 0x7f820c0180d0 con 0x7f821c0d3810 2023-11-13T11:29:27.658 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:27.650+0000 7f8222d6f640 1 -- 172.21.15.102:0/342179335 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f8200066470 msgr2=0x7f8200068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:27.658 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:27.650+0000 7f8222d6f640 1 --2- 172.21.15.102:0/342179335 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f8200066470 0x7f8200068930 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f82180af000 tx=0x7f82180a7000 comp rx=0 tx=0).stop 2023-11-13T11:29:27.658 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:27.650+0000 7f8222d6f640 1 -- 172.21.15.102:0/342179335 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f821c0d3810 msgr2=0x7f821c0b8250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:27.659 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:27.650+0000 7f8222d6f640 1 --2- 172.21.15.102:0/342179335 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f821c0d3810 0x7f821c0b8250 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f820c00c480 tx=0x7f820c00c940 comp rx=0 tx=0).stop 2023-11-13T11:29:27.659 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:27.650+0000 7f8222d6f640 1 -- 172.21.15.102:0/342179335 shutdown_connections 2023-11-13T11:29:27.659 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:27.650+0000 7f8222d6f640 1 --2- 172.21.15.102:0/342179335 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f821c15d060 0x7f821c157d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:27.659 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:27.650+0000 7f8222d6f640 1 --2- 172.21.15.102:0/342179335 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f8200066470 0x7f8200068930 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:27.659 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:27.650+0000 7f8222d6f640 1 --2- 172.21.15.102:0/342179335 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f821c0d3810 0x7f821c0b8250 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:27.660 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:27.650+0000 7f8222d6f640 1 --2- 172.21.15.102:0/342179335 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f821c0d17b0 0x7f821c0b7d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:27.660 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:27.650+0000 7f8222d6f640 1 -- 172.21.15.102:0/342179335 >> 172.21.15.102:0/342179335 conn(0x7f821c0d2cf0 msgr2=0x7f821c0b0460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-13T11:29:27.660 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:27.650+0000 7f8222d6f640 1 -- 172.21.15.102:0/342179335 shutdown_connections 2023-11-13T11:29:27.660 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:27.650+0000 7f8222d6f640 1 -- 172.21.15.102:0/342179335 wait complete. 2023-11-13T11:29:27.678 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-11-13T11:29:27.821 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:27.814+0000 7f78de11c640 1 Processor -- start 2023-11-13T11:29:27.821 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:27.814+0000 7f78de11c640 1 -- start start 2023-11-13T11:29:27.823 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:27.814+0000 7f78de11c640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f78d81553c0 0x7f78d80cebc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:27.823 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:27.814+0000 7f78de11c640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f78d806c800 0x7f78d80cf100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:27.823 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:27.814+0000 7f78de11c640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f78d815bed0 con 0x7f78d815b3b0 2023-11-13T11:29:27.823 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:27.814+0000 7f78de11c640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f78d806c3e0 con 0x7f78d806c800 2023-11-13T11:29:27.824 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:27.814+0000 7f78de11c640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f78d815c150 con 0x7f78d81553c0 2023-11-13T11:29:27.824 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:27.814+0000 7f78d7fff640 1 --1- >> v1:172.21.15.102:6789/0 conn(0x7f78d815b3b0 0x7f78d815b7c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.102:6789/0 says I am v1:172.21.15.102:36116/0 (socket says 172.21.15.102:36116) 2023-11-13T11:29:27.824 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:27.814+0000 7f78d7fff640 1 -- 172.21.15.102:0/4102084119 learned_addr learned my addr 172.21.15.102:0/4102084119 (peer_addr_for_me v1:172.21.15.102:0/0) 2023-11-13T11:29:27.824 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:27.814+0000 7f78d6ffd640 1 --2- 172.21.15.102:0/4102084119 >> v2:172.21.15.102:3300/0 conn(0x7f78d806c800 0x7f78d80cf100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:27.824 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:27.818+0000 7f78d77fe640 1 --2- 172.21.15.102:0/4102084119 >> v2:172.21.15.154:3300/0 conn(0x7f78d81553c0 0x7f78d80cebc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:27.825 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:27.818+0000 7f78d67fc640 1 -- 172.21.15.102:0/4102084119 <== mon.0 v1:172.21.15.102:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 171244843 0 0) 0x7f78d815bed0 con 0x7f78d815b3b0 2023-11-13T11:29:27.825 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:27.818+0000 7f78d67fc640 1 -- 172.21.15.102:0/4102084119 --> v1:172.21.15.102:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f78c0003530 con 0x7f78d815b3b0 2023-11-13T11:29:27.825 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:27.818+0000 7f78d6ffd640 1 -- 172.21.15.102:0/4102084119 >> v2:172.21.15.154:3300/0 conn(0x7f78d81553c0 msgr2=0x7f78d80cebc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-13T11:29:27.825 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:27.818+0000 7f78d6ffd640 1 --2- 172.21.15.102:0/4102084119 >> v2:172.21.15.154:3300/0 conn(0x7f78d81553c0 0x7f78d80cebc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:27.825 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:27.818+0000 7f78d6ffd640 1 -- 172.21.15.102:0/4102084119 >> v1:172.21.15.102:6789/0 conn(0x7f78d815b3b0 legacy=0x7f78d815b7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:27.826 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:27.818+0000 7f78d6ffd640 1 -- 172.21.15.102:0/4102084119 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78d806bd20 con 0x7f78d806c800 2023-11-13T11:29:27.826 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:27.818+0000 7f78d77fe640 1 --2- 172.21.15.102:0/4102084119 >> v2:172.21.15.154:3300/0 conn(0x7f78d81553c0 0x7f78d80cebc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-13T11:29:27.827 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:27.818+0000 7f78d6ffd640 1 --2- 172.21.15.102:0/4102084119 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f78d806c800 0x7f78d80cf100 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f78d80675f0 tx=0x7f78cc01c3d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d2bc003b9e79ec59 server_cookie=0 in_seq=0 out_seq=0 2023-11-13T11:29:27.827 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:27.818+0000 7f78d67fc640 1 -- 172.21.15.102:0/4102084119 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78cc0ab600 con 0x7f78d806c800 2023-11-13T11:29:27.828 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:27.818+0000 7f78d67fc640 1 -- 172.21.15.102:0/4102084119 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f78cc0a7050 con 0x7f78d806c800 2023-11-13T11:29:27.828 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:27.818+0000 7f78d67fc640 1 -- 172.21.15.102:0/4102084119 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78cc0ab980 con 0x7f78d806c800 2023-11-13T11:29:27.828 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:27.818+0000 7f78de11c640 1 -- 172.21.15.102:0/4102084119 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f78d806c800 msgr2=0x7f78d80cf100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:27.828 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:27.818+0000 7f78de11c640 1 --2- 172.21.15.102:0/4102084119 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f78d806c800 0x7f78d80cf100 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f78d80675f0 tx=0x7f78cc01c3d0 comp rx=0 tx=0).stop 2023-11-13T11:29:27.828 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:27.822+0000 7f78de11c640 1 -- 172.21.15.102:0/4102084119 shutdown_connections 2023-11-13T11:29:27.829 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:27.822+0000 7f78de11c640 1 --2- 172.21.15.102:0/4102084119 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f78d806c800 0x7f78d80cf100 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:27.829 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:27.822+0000 7f78de11c640 1 --2- 172.21.15.102:0/4102084119 >> v2:172.21.15.154:3300/0 conn(0x7f78d81553c0 0x7f78d80cebc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:27.829 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:27.822+0000 7f78de11c640 1 -- 172.21.15.102:0/4102084119 >> 172.21.15.102:0/4102084119 conn(0x7f78d806a410 msgr2=0x7f78d806a820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-13T11:29:27.829 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:27.822+0000 7f78de11c640 1 -- 172.21.15.102:0/4102084119 shutdown_connections 2023-11-13T11:29:27.830 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:27.822+0000 7f78de11c640 1 -- 172.21.15.102:0/4102084119 wait complete. 2023-11-13T11:29:27.832 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:27.822+0000 7f78de11c640 1 Processor -- start 2023-11-13T11:29:27.832 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:27.822+0000 7f78de11c640 1 -- start start 2023-11-13T11:29:27.832 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:27.822+0000 7f78de11c640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f78d806c800 0x7f78d80cd6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:27.832 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:27.822+0000 7f78de11c640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f78d81553c0 0x7f78d8138f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:27.833 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:27.822+0000 7f78de11c640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f78d815b3b0 0x7f78d8139490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:27.833 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:27.822+0000 7f78de11c640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78d813a860 con 0x7f78d81553c0 2023-11-13T11:29:27.833 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:27.822+0000 7f78de11c640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78d81399d0 con 0x7f78d815b3b0 2023-11-13T11:29:27.833 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:27.822+0000 7f78de11c640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f78d8139c20 con 0x7f78d806c800 2023-11-13T11:29:27.834 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:27.822+0000 7f78d6ffd640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f78d81553c0 0x7f78d8138f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:27.834 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:27.822+0000 7f78d6ffd640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f78d81553c0 0x7f78d8138f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:48084/0 (socket says 172.21.15.102:48084) 2023-11-13T11:29:27.834 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:27.822+0000 7f78d6ffd640 1 -- 172.21.15.102:0/2391567303 learned_addr learned my addr 172.21.15.102:0/2391567303 (peer_addr_for_me v2:172.21.15.102:0/0) 2023-11-13T11:29:27.834 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:27.822+0000 7f78d6ffd640 1 -- 172.21.15.102:0/2391567303 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f78d806c800 msgr2=0x7f78d80cd6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:27.835 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:27.822+0000 7f78d6ffd640 1 --2- 172.21.15.102:0/2391567303 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f78d806c800 0x7f78d80cd6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:27.835 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:27.822+0000 7f78d6ffd640 1 -- 172.21.15.102:0/2391567303 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f78d815b3b0 msgr2=0x7f78d8139490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:27.835 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:27.822+0000 7f78d6ffd640 1 --2- 172.21.15.102:0/2391567303 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f78d815b3b0 0x7f78d8139490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:27.835 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:27.822+0000 7f78d6ffd640 1 -- 172.21.15.102:0/2391567303 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78cc009420 con 0x7f78d81553c0 2023-11-13T11:29:27.835 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:27.822+0000 7f78d6ffd640 1 --2- 172.21.15.102:0/2391567303 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f78d81553c0 0x7f78d8138f50 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f78cc0ae040 tx=0x7f78cc019170 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-13T11:29:27.836 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:27.822+0000 7f78bffff640 1 -- 172.21.15.102:0/2391567303 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78cc0b4410 con 0x7f78d81553c0 2023-11-13T11:29:27.836 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:27.826+0000 7f78bffff640 1 -- 172.21.15.102:0/2391567303 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f78cc0b4590 con 0x7f78d81553c0 2023-11-13T11:29:27.836 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:27.826+0000 7f78bffff640 1 -- 172.21.15.102:0/2391567303 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78cc0b4940 con 0x7f78d81553c0 2023-11-13T11:29:27.836 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:27.826+0000 7f78de11c640 1 -- 172.21.15.102:0/2391567303 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f78d8139ec0 con 0x7f78d81553c0 2023-11-13T11:29:27.836 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:27.826+0000 7f78de11c640 1 -- 172.21.15.102:0/2391567303 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f78d813a480 con 0x7f78d81553c0 2023-11-13T11:29:27.837 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:27.826+0000 7f78de11c640 1 -- 172.21.15.102:0/2391567303 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f78d813a9a0 con 0x7f78d81553c0 2023-11-13T11:29:27.838 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:27.826+0000 7f78bffff640 1 -- 172.21.15.102:0/2391567303 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f78cc0b2040 con 0x7f78d81553c0 2023-11-13T11:29:27.838 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:27.826+0000 7f78bffff640 1 --2- 172.21.15.102:0/2391567303 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f78c4066470 0x7f78c4068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:27.838 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:27.826+0000 7f78bffff640 1 -- 172.21.15.102:0/2391567303 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f78cc11dd60 con 0x7f78d81553c0 2023-11-13T11:29:27.838 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:27.826+0000 7f78d77fe640 1 --2- 172.21.15.102:0/2391567303 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f78c4066470 0x7f78c4068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:27.839 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:27.830+0000 7f78d77fe640 1 --2- 172.21.15.102:0/2391567303 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f78c4066470 0x7f78c4068930 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f78c8006f10 tx=0x7f78c8008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-13T11:29:27.839 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:27.830+0000 7f78bffff640 1 -- 172.21.15.102:0/2391567303 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f78d813a9a0 con 0x7f78d81553c0 2023-11-13T11:29:27.988 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:27.982+0000 7f78de11c640 1 -- 172.21.15.102:0/2391567303 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f78d813a9a0 con 0x7f78d81553c0 2023-11-13T11:29:27.991 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:27.986+0000 7f78bffff640 1 -- 172.21.15.102:0/2391567303 <== mon.0 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v10)=0 v10) v1 ==== 122+0+0 (secure 0 0 0) 0x7f78d813a9a0 con 0x7f78d81553c0 2023-11-13T11:29:27.994 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:27.986+0000 7f78de11c640 1 -- 172.21.15.102:0/2391567303 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f78c4066470 msgr2=0x7f78c4068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:27.994 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:27.986+0000 7f78de11c640 1 --2- 172.21.15.102:0/2391567303 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f78c4066470 0x7f78c4068930 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f78c8006f10 tx=0x7f78c8008040 comp rx=0 tx=0).stop 2023-11-13T11:29:27.994 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:27.986+0000 7f78de11c640 1 -- 172.21.15.102:0/2391567303 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f78d81553c0 msgr2=0x7f78d8138f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:27.995 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:27.986+0000 7f78de11c640 1 --2- 172.21.15.102:0/2391567303 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f78d81553c0 0x7f78d8138f50 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f78cc0ae040 tx=0x7f78cc019170 comp rx=0 tx=0).stop 2023-11-13T11:29:27.995 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:27.986+0000 7f78de11c640 1 -- 172.21.15.102:0/2391567303 shutdown_connections 2023-11-13T11:29:27.995 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:27.986+0000 7f78de11c640 1 --2- 172.21.15.102:0/2391567303 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f78d815b3b0 0x7f78d8139490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:27.996 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:27.986+0000 7f78de11c640 1 --2- 172.21.15.102:0/2391567303 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f78c4066470 0x7f78c4068930 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:27.996 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:27.986+0000 7f78de11c640 1 --2- 172.21.15.102:0/2391567303 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f78d81553c0 0x7f78d8138f50 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:27.996 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:27.986+0000 7f78de11c640 1 --2- 172.21.15.102:0/2391567303 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f78d806c800 0x7f78d80cd6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:27.997 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:27.986+0000 7f78de11c640 1 -- 172.21.15.102:0/2391567303 >> 172.21.15.102:0/2391567303 conn(0x7f78d806a410 msgr2=0x7f78d8154620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-13T11:29:27.997 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:27.986+0000 7f78de11c640 1 -- 172.21.15.102:0/2391567303 shutdown_connections 2023-11-13T11:29:27.998 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:27.986+0000 7f78de11c640 1 -- 172.21.15.102:0/2391567303 wait complete. 2023-11-13T11:29:28.014 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-11-13T11:29:28.015 DEBUG:teuthology.orchestra.run.smithi102:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-11-13T11:29:28.129 DEBUG:teuthology.orchestra.run.smithi154:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-11-13T11:29:28.182 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-11-13T11:29:28.183 DEBUG:teuthology.orchestra.run.smithi102:> set -ex 2023-11-13T11:29:28.183 DEBUG:teuthology.orchestra.run.smithi102:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-13T11:29:28.193 DEBUG:teuthology.orchestra.run.smithi102:> set -ex 2023-11-13T11:29:28.193 DEBUG:teuthology.orchestra.run.smithi102:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-13T11:29:28.247 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-13T11:29:28.432 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:28.426+0000 7effbada1640 1 Processor -- start 2023-11-13T11:29:28.432 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:28.426+0000 7effbada1640 1 -- start start 2023-11-13T11:29:28.433 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:28.426+0000 7effbada1640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7effb40cfeb0 0x7effb40d38f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:28.434 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:28.426+0000 7effbada1640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7effb40d1380 0x7effb40b30b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:28.434 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:28.426+0000 7effbada1640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7effb40b2660 con 0x7effb415d290 2023-11-13T11:29:28.434 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:28.426+0000 7effbada1640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7effb40d18b0 con 0x7effb40cfeb0 2023-11-13T11:29:28.435 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:28.426+0000 7effbada1640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7effb40d1b90 con 0x7effb40d1380 2023-11-13T11:29:28.435 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:28.426+0000 7effabfff640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7effb40cfeb0 0x7effb40d38f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:28.435 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:28.426+0000 7effabfff640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7effb40cfeb0 0x7effb40d38f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:48088/0 (socket says 172.21.15.102:48088) 2023-11-13T11:29:28.435 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:28.426+0000 7effabfff640 1 -- 172.21.15.102:0/4236717444 learned_addr learned my addr 172.21.15.102:0/4236717444 (peer_addr_for_me v2:172.21.15.102:0/0) 2023-11-13T11:29:28.436 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:28.426+0000 7effb933e640 1 --2- 172.21.15.102:0/4236717444 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7effb40d1380 0x7effb40b30b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:28.436 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:28.426+0000 7effabfff640 1 -- 172.21.15.102:0/4236717444 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7effb40d1380 msgr2=0x7effb40b30b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-13T11:29:28.436 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:28.426+0000 7effabfff640 1 --2- 172.21.15.102:0/4236717444 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7effb40d1380 0x7effb40b30b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:28.437 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:28.426+0000 7effabfff640 1 -- 172.21.15.102:0/4236717444 >> v1:172.21.15.154:6789/0 conn(0x7effb415d290 legacy=0x7effb40cf7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:28.437 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:28.426+0000 7effabfff640 1 -- 172.21.15.102:0/4236717444 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7effb40b28b0 con 0x7effb40cfeb0 2023-11-13T11:29:28.438 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:28.430+0000 7effabfff640 1 --2- 172.21.15.102:0/4236717444 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7effb40cfeb0 0x7effb40d38f0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7effa4009870 tx=0x7effa401c540 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a4770c5df5c06310 server_cookie=0 in_seq=0 out_seq=0 2023-11-13T11:29:28.439 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:28.430+0000 7effab7fe640 1 -- 172.21.15.102:0/4236717444 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effa40ab650 con 0x7effb40cfeb0 2023-11-13T11:29:28.439 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:28.430+0000 7effab7fe640 1 -- 172.21.15.102:0/4236717444 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7effa40ab7b0 con 0x7effb40cfeb0 2023-11-13T11:29:28.439 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:28.430+0000 7effab7fe640 1 -- 172.21.15.102:0/4236717444 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effa40abb40 con 0x7effb40cfeb0 2023-11-13T11:29:28.440 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:28.430+0000 7effbada1640 1 -- 172.21.15.102:0/4236717444 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7effb40cfeb0 msgr2=0x7effb40d38f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:28.440 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:28.430+0000 7effbada1640 1 --2- 172.21.15.102:0/4236717444 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7effb40cfeb0 0x7effb40d38f0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7effa4009870 tx=0x7effa401c540 comp rx=0 tx=0).stop 2023-11-13T11:29:28.440 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:28.430+0000 7effbada1640 1 -- 172.21.15.102:0/4236717444 shutdown_connections 2023-11-13T11:29:28.440 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:28.430+0000 7effbada1640 1 --2- 172.21.15.102:0/4236717444 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7effb40d1380 0x7effb40b30b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:28.441 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:28.430+0000 7effbada1640 1 --2- 172.21.15.102:0/4236717444 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7effb40cfeb0 0x7effb40d38f0 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:28.441 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:28.430+0000 7effbada1640 1 -- 172.21.15.102:0/4236717444 >> 172.21.15.102:0/4236717444 conn(0x7effb40d2dd0 msgr2=0x7effb40d31e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-13T11:29:28.441 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:28.430+0000 7effbada1640 1 -- 172.21.15.102:0/4236717444 shutdown_connections 2023-11-13T11:29:28.441 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:28.430+0000 7effbada1640 1 -- 172.21.15.102:0/4236717444 wait complete. 2023-11-13T11:29:28.444 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:28.434+0000 7effbada1640 1 Processor -- start 2023-11-13T11:29:28.444 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:28.434+0000 7effbada1640 1 -- start start 2023-11-13T11:29:28.444 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:28.434+0000 7effbada1640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7effb40cfeb0 0x7effb40cafb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:28.444 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:28.434+0000 7effbada1640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7effb40d1380 0x7effb4153110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:28.445 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:28.434+0000 7effbada1640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7effb415d290 0x7effb415aa90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:28.445 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:28.434+0000 7effbada1640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7effb41589f0 con 0x7effb40d1380 2023-11-13T11:29:28.445 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:28.434+0000 7effbada1640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7effb4158cd0 con 0x7effb40cfeb0 2023-11-13T11:29:28.445 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:28.434+0000 7effbada1640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7effb4158fb0 con 0x7effb415d290 2023-11-13T11:29:28.446 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:28.434+0000 7effabfff640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7effb40d1380 0x7effb4153110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:28.446 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:28.434+0000 7effabfff640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7effb40d1380 0x7effb4153110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:48092/0 (socket says 172.21.15.102:48092) 2023-11-13T11:29:28.446 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:28.434+0000 7effabfff640 1 -- 172.21.15.102:0/158245613 learned_addr learned my addr 172.21.15.102:0/158245613 (peer_addr_for_me v2:172.21.15.102:0/0) 2023-11-13T11:29:28.446 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:28.434+0000 7effb933e640 1 --2- 172.21.15.102:0/158245613 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7effb415d290 0x7effb415aa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:28.446 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:28.434+0000 7effb8b3d640 1 --2- 172.21.15.102:0/158245613 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7effb40cfeb0 0x7effb40cafb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:28.447 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:28.434+0000 7effabfff640 1 -- 172.21.15.102:0/158245613 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7effb415d290 msgr2=0x7effb415aa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:28.447 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:28.434+0000 7effabfff640 1 --2- 172.21.15.102:0/158245613 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7effb415d290 0x7effb415aa90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:28.447 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:28.434+0000 7effabfff640 1 -- 172.21.15.102:0/158245613 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7effb40cfeb0 msgr2=0x7effb40cafb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:28.447 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:28.434+0000 7effabfff640 1 --2- 172.21.15.102:0/158245613 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7effb40cfeb0 0x7effb40cafb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:28.447 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:28.434+0000 7effabfff640 1 -- 172.21.15.102:0/158245613 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7effa40094d0 con 0x7effb40d1380 2023-11-13T11:29:28.448 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:28.434+0000 7effabfff640 1 --2- 172.21.15.102:0/158245613 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7effb40d1380 0x7effb4153110 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7effa401a170 tx=0x7effa401ad80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-13T11:29:28.448 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:28.434+0000 7effa97fa640 1 -- 172.21.15.102:0/158245613 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effa40b4800 con 0x7effb40d1380 2023-11-13T11:29:28.448 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:28.434+0000 7effa97fa640 1 -- 172.21.15.102:0/158245613 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7effa40b4960 con 0x7effb40d1380 2023-11-13T11:29:28.448 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:28.434+0000 7effa97fa640 1 -- 172.21.15.102:0/158245613 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effa40b4d10 con 0x7effb40d1380 2023-11-13T11:29:28.448 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:28.434+0000 7effbada1640 1 -- 172.21.15.102:0/158245613 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7effb4159290 con 0x7effb40d1380 2023-11-13T11:29:28.449 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:28.434+0000 7effbada1640 1 -- 172.21.15.102:0/158245613 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7effb40cb6c0 con 0x7effb40d1380 2023-11-13T11:29:28.449 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:28.438+0000 7effbada1640 1 -- 172.21.15.102:0/158245613 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7effb4159480 con 0x7effb40d1380 2023-11-13T11:29:28.449 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:28.438+0000 7effa97fa640 1 -- 172.21.15.102:0/158245613 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7effa40b3380 con 0x7effb40d1380 2023-11-13T11:29:28.450 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:28.438+0000 7effa97fa640 1 --2- 172.21.15.102:0/158245613 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7effa0066470 0x7effa0068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:28.450 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:28.438+0000 7effa97fa640 1 -- 172.21.15.102:0/158245613 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7effa411e670 con 0x7effb40d1380 2023-11-13T11:29:28.450 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:28.438+0000 7effb8b3d640 1 --2- 172.21.15.102:0/158245613 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7effa0066470 0x7effa0068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:28.450 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:28.438+0000 7effb8b3d640 1 --2- 172.21.15.102:0/158245613 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7effa0066470 0x7effa0068930 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7effb40ca5a0 tx=0x7effb0009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-13T11:29:28.451 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:28.442+0000 7effa97fa640 1 -- 172.21.15.102:0/158245613 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7effa40ebb90 con 0x7effb40d1380 2023-11-13T11:29:28.600 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:28.594+0000 7effbada1640 1 -- 172.21.15.102:0/158245613 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7effb4068520 con 0x7effb40d1380 2023-11-13T11:29:28.600 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:28.594+0000 7effa97fa640 1 -- 172.21.15.102:0/158245613 <== mon.0 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+16545 (secure 0 0 0) 0x7effa40ef1b0 con 0x7effb40d1380 2023-11-13T11:29:28.601 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T11:29:28.601 INFO:teuthology.orchestra.run.smithi102.stdout:{"epoch":22,"fsid":"97b3eb2b-7ccf-4aae-8d92-bff986c671ea","created":"2023-11-13T11:28:31.836724+0000","modified":"2023-11-13T11:28:58.608314+0000","last_up_change":"2023-11-13T11:28:44.876638+0000","last_in_change":"2023-11-13T11:28:35.312740+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-13T11:28:44.981356+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-13T11:28:55.958525+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-13T11:28:56.394264+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"bdefaa17-fcca-4c86-aa40-27dc33a789af","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6800","nonce":53303834},{"type":"v1","addr":"172.21.15.102:6801","nonce":53303834}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6802","nonce":53303834},{"type":"v1","addr":"172.21.15.102:6803","nonce":53303834}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6806","nonce":53303834},{"type":"v1","addr":"172.21.15.102:6807","nonce":53303834}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6804","nonce":53303834},{"type":"v1","addr":"172.21.15.102:6805","nonce":53303834}]},"public_addr":"172.21.15.102:6801/53303834","cluster_addr":"172.21.15.102:6803/53303834","heartbeat_back_addr":"172.21.15.102:6807/53303834","heartbeat_front_addr":"172.21.15.102:6805/53303834","state":["exists","up"]},{"osd":1,"uuid":"f0033196-dec9-4ae9-945e-6aeef6dbb47f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6808","nonce":1732708348},{"type":"v1","addr":"172.21.15.102:6809","nonce":1732708348}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6811","nonce":1732708348},{"type":"v1","addr":"172.21.15.102:6813","nonce":1732708348}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6818","nonce":1732708348},{"type":"v1","addr":"172.21.15.102:6820","nonce":1732708348}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6815","nonce":1732708348},{"type":"v1","addr":"172.21.15.102:6817","nonce":1732708348}]},"public_addr":"172.21.15.102:6809/1732708348","cluster_addr":"172.21.15.102:6813/1732708348","heartbeat_back_addr":"172.21.15.102:6820/1732708348","heartbeat_front_addr":"172.21.15.102:6817/1732708348","state":["exists","up"]},{"osd":2,"uuid":"496b0834-351e-4ec2-a714-86ed0c0ff4fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6810","nonce":1825475150},{"type":"v1","addr":"172.21.15.102:6812","nonce":1825475150}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6814","nonce":1825475150},{"type":"v1","addr":"172.21.15.102:6816","nonce":1825475150}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6822","nonce":1825475150},{"type":"v1","addr":"172.21.15.102:6823","nonce":1825475150}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6819","nonce":1825475150},{"type":"v1","addr":"172.21.15.102:6821","nonce":1825475150}]},"public_addr":"172.21.15.102:6812/1825475150","cluster_addr":"172.21.15.102:6816/1825475150","heartbeat_back_addr":"172.21.15.102:6823/1825475150","heartbeat_front_addr":"172.21.15.102:6821/1825475150","state":["exists","up"]},{"osd":3,"uuid":"3ba6cc41-e0a0-4273-86cb-90000c06a55a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6824","nonce":4149355528},{"type":"v1","addr":"172.21.15.102:6825","nonce":4149355528}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6826","nonce":4149355528},{"type":"v1","addr":"172.21.15.102:6827","nonce":4149355528}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6830","nonce":4149355528},{"type":"v1","addr":"172.21.15.102:6831","nonce":4149355528}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6828","nonce":4149355528},{"type":"v1","addr":"172.21.15.102:6829","nonce":4149355528}]},"public_addr":"172.21.15.102:6825/4149355528","cluster_addr":"172.21.15.102:6827/4149355528","heartbeat_back_addr":"172.21.15.102:6831/4149355528","heartbeat_front_addr":"172.21.15.102:6829/4149355528","state":["exists","up"]},{"osd":4,"uuid":"16e797d8-e6e7-4140-95c3-b85283c42a2a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6808","nonce":4028899241},{"type":"v1","addr":"172.21.15.154:6809","nonce":4028899241}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6810","nonce":4028899241},{"type":"v1","addr":"172.21.15.154:6811","nonce":4028899241}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6814","nonce":4028899241},{"type":"v1","addr":"172.21.15.154:6815","nonce":4028899241}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6812","nonce":4028899241},{"type":"v1","addr":"172.21.15.154:6813","nonce":4028899241}]},"public_addr":"172.21.15.154:6809/4028899241","cluster_addr":"172.21.15.154:6811/4028899241","heartbeat_back_addr":"172.21.15.154:6815/4028899241","heartbeat_front_addr":"172.21.15.154:6813/4028899241","state":["exists","up"]},{"osd":5,"uuid":"d6ab225c-1b55-450a-89a9-abe5c3f8d6af","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":3562396827},{"type":"v1","addr":"172.21.15.154:6801","nonce":3562396827}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":3562396827},{"type":"v1","addr":"172.21.15.154:6803","nonce":3562396827}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6806","nonce":3562396827},{"type":"v1","addr":"172.21.15.154:6807","nonce":3562396827}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6804","nonce":3562396827},{"type":"v1","addr":"172.21.15.154:6805","nonce":3562396827}]},"public_addr":"172.21.15.154:6801/3562396827","cluster_addr":"172.21.15.154:6803/3562396827","heartbeat_back_addr":"172.21.15.154:6807/3562396827","heartbeat_front_addr":"172.21.15.154:6805/3562396827","state":["exists","up"]},{"osd":6,"uuid":"96f905ac-491c-4662-8e2b-5bb8e929ab9d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6816","nonce":2933728751},{"type":"v1","addr":"172.21.15.154:6817","nonce":2933728751}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6818","nonce":2933728751},{"type":"v1","addr":"172.21.15.154:6819","nonce":2933728751}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6822","nonce":2933728751},{"type":"v1","addr":"172.21.15.154:6823","nonce":2933728751}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6820","nonce":2933728751},{"type":"v1","addr":"172.21.15.154:6821","nonce":2933728751}]},"public_addr":"172.21.15.154:6817/2933728751","cluster_addr":"172.21.15.154:6819/2933728751","heartbeat_back_addr":"172.21.15.154:6823/2933728751","heartbeat_front_addr":"172.21.15.154:6821/2933728751","state":["exists","up"]},{"osd":7,"uuid":"07012d3b-3ab4-40df-a471-93caed22e2dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6824","nonce":1753500785},{"type":"v1","addr":"172.21.15.154:6825","nonce":1753500785}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6826","nonce":1753500785},{"type":"v1","addr":"172.21.15.154:6827","nonce":1753500785}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6830","nonce":1753500785},{"type":"v1","addr":"172.21.15.154:6831","nonce":1753500785}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6828","nonce":1753500785},{"type":"v1","addr":"172.21.15.154:6829","nonce":1753500785}]},"public_addr":"172.21.15.154:6825/1753500785","cluster_addr":"172.21.15.154:6827/1753500785","heartbeat_back_addr":"172.21.15.154:6831/1753500785","heartbeat_front_addr":"172.21.15.154:6829/1753500785","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-13T11:28:40.978603+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-13T11:28:41.200985+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-13T11:28:41.222815+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-13T11:28:41.202162+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-13T11:28:40.925911+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-13T11:28:41.087725+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-13T11:28:41.072208+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-13T11:28:40.875257+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-13T11:29:28.602 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:28.594+0000 7effbada1640 1 -- 172.21.15.102:0/158245613 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7effa0066470 msgr2=0x7effa0068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:28.602 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:28.594+0000 7effbada1640 1 --2- 172.21.15.102:0/158245613 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7effa0066470 0x7effa0068930 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7effb40ca5a0 tx=0x7effb0009040 comp rx=0 tx=0).stop 2023-11-13T11:29:28.602 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:28.594+0000 7effbada1640 1 -- 172.21.15.102:0/158245613 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7effb40d1380 msgr2=0x7effb4153110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:28.602 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:28.594+0000 7effbada1640 1 --2- 172.21.15.102:0/158245613 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7effb40d1380 0x7effb4153110 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7effa401a170 tx=0x7effa401ad80 comp rx=0 tx=0).stop 2023-11-13T11:29:28.603 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:28.594+0000 7effbada1640 1 -- 172.21.15.102:0/158245613 shutdown_connections 2023-11-13T11:29:28.603 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:28.594+0000 7effbada1640 1 --2- 172.21.15.102:0/158245613 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7effb415d290 0x7effb415aa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:28.603 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:28.594+0000 7effbada1640 1 --2- 172.21.15.102:0/158245613 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7effa0066470 0x7effa0068930 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:28.604 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:28.594+0000 7effbada1640 1 --2- 172.21.15.102:0/158245613 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7effb40d1380 0x7effb4153110 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:28.604 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:28.594+0000 7effbada1640 1 --2- 172.21.15.102:0/158245613 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7effb40cfeb0 0x7effb40cafb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:28.604 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:28.594+0000 7effbada1640 1 -- 172.21.15.102:0/158245613 >> 172.21.15.102:0/158245613 conn(0x7effb40d2dd0 msgr2=0x7effb406c350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-13T11:29:28.604 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:28.594+0000 7effbada1640 1 -- 172.21.15.102:0/158245613 shutdown_connections 2023-11-13T11:29:28.604 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:28.594+0000 7effbada1640 1 -- 172.21.15.102:0/158245613 wait complete. 2023-11-13T11:29:28.622 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-13T11:28:44.981356+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-13T11:28:55.958525+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-11-13T11:28:56.394264+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-13T11:29:28.622 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-13T11:29:28.763 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:28.758+0000 7f197c5a1640 1 Processor -- start 2023-11-13T11:29:28.763 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:28.758+0000 7f197c5a1640 1 -- start start 2023-11-13T11:29:28.765 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:28.758+0000 7f197c5a1640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f19741553c0 0x7f19740cebc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:28.765 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:28.758+0000 7f197c5a1640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f197415bac0 0x7f19740cf100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:28.765 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:28.758+0000 7f197c5a1640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f197415bf10 con 0x7f197406c800 2023-11-13T11:29:28.765 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:28.758+0000 7f197c5a1640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f197406c3e0 con 0x7f19741553c0 2023-11-13T11:29:28.765 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:28.758+0000 7f197c5a1640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f197415c150 con 0x7f197415bac0 2023-11-13T11:29:28.766 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:28.758+0000 7f197a33d640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f19741553c0 0x7f19740cebc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:28.766 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:28.758+0000 7f197a33d640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f19741553c0 0x7f19740cebc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:48102/0 (socket says 172.21.15.102:48102) 2023-11-13T11:29:28.766 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:28.758+0000 7f197a33d640 1 -- 172.21.15.102:0/2932950747 learned_addr learned my addr 172.21.15.102:0/2932950747 (peer_addr_for_me v2:172.21.15.102:0/0) 2023-11-13T11:29:28.766 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:28.758+0000 7f197ab3e640 1 --2- 172.21.15.102:0/2932950747 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f197415bac0 0x7f19740cf100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:28.767 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:28.758+0000 7f197a33d640 1 -- 172.21.15.102:0/2932950747 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f197415bac0 msgr2=0x7f19740cf100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-13T11:29:28.767 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:28.758+0000 7f197a33d640 1 --2- 172.21.15.102:0/2932950747 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f197415bac0 0x7f19740cf100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:28.767 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:28.758+0000 7f197a33d640 1 -- 172.21.15.102:0/2932950747 >> v1:172.21.15.154:6789/0 conn(0x7f197406c800 legacy=0x7f197415b3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:28.767 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:28.758+0000 7f197a33d640 1 -- 172.21.15.102:0/2932950747 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f197406bd20 con 0x7f19741553c0 2023-11-13T11:29:28.767 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:28.758+0000 7f197ab3e640 1 --2- 172.21.15.102:0/2932950747 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f197415bac0 0x7f19740cf100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-13T11:29:28.769 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:28.762+0000 7f197a33d640 1 --2- 172.21.15.102:0/2932950747 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f19741553c0 0x7f19740cebc0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f1970009870 tx=0x7f197001c4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bdf8119edabc4503 server_cookie=0 in_seq=0 out_seq=0 2023-11-13T11:29:28.769 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:28.762+0000 7f197933b640 1 -- 172.21.15.102:0/2932950747 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19700ab610 con 0x7f19741553c0 2023-11-13T11:29:28.770 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:28.762+0000 7f197933b640 1 -- 172.21.15.102:0/2932950747 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f19700ab770 con 0x7f19741553c0 2023-11-13T11:29:28.770 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:28.762+0000 7f197933b640 1 -- 172.21.15.102:0/2932950747 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19700abb00 con 0x7f19741553c0 2023-11-13T11:29:28.771 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:28.762+0000 7f197c5a1640 1 -- 172.21.15.102:0/2932950747 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f19741553c0 msgr2=0x7f19740cebc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:28.771 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:28.762+0000 7f197c5a1640 1 --2- 172.21.15.102:0/2932950747 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f19741553c0 0x7f19740cebc0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f1970009870 tx=0x7f197001c4b0 comp rx=0 tx=0).stop 2023-11-13T11:29:28.771 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:28.762+0000 7f197c5a1640 1 -- 172.21.15.102:0/2932950747 shutdown_connections 2023-11-13T11:29:28.771 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:28.762+0000 7f197c5a1640 1 --2- 172.21.15.102:0/2932950747 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f197415bac0 0x7f19740cf100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:28.771 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:28.762+0000 7f197c5a1640 1 --2- 172.21.15.102:0/2932950747 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f19741553c0 0x7f19740cebc0 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:28.772 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:28.762+0000 7f197c5a1640 1 -- 172.21.15.102:0/2932950747 >> 172.21.15.102:0/2932950747 conn(0x7f197406a410 msgr2=0x7f197406a820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-13T11:29:28.772 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:28.762+0000 7f197c5a1640 1 -- 172.21.15.102:0/2932950747 shutdown_connections 2023-11-13T11:29:28.772 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:28.762+0000 7f197c5a1640 1 -- 172.21.15.102:0/2932950747 wait complete. 2023-11-13T11:29:28.775 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:28.762+0000 7f197c5a1640 1 Processor -- start 2023-11-13T11:29:28.775 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:28.766+0000 7f197c5a1640 1 -- start start 2023-11-13T11:29:28.775 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:28.766+0000 7f197c5a1640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f197406c800 0x7f19740b1ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:28.775 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:28.766+0000 7f197c5a1640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f19741553c0 0x7f19740cd160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:28.776 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:28.766+0000 7f197c5a1640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f197415bac0 0x7f1974141fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:28.776 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:28.766+0000 7f197c5a1640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1974155a70 con 0x7f19741553c0 2023-11-13T11:29:28.776 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:28.766+0000 7f197c5a1640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1974155cc0 con 0x7f197415bac0 2023-11-13T11:29:28.776 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:28.766+0000 7f197c5a1640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1974155fa0 con 0x7f197406c800 2023-11-13T11:29:28.776 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:28.766+0000 7f1979b3c640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f19741553c0 0x7f19740cd160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:28.777 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:28.766+0000 7f1979b3c640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f19741553c0 0x7f19740cd160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:48110/0 (socket says 172.21.15.102:48110) 2023-11-13T11:29:28.777 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:28.766+0000 7f1979b3c640 1 -- 172.21.15.102:0/266837320 learned_addr learned my addr 172.21.15.102:0/266837320 (peer_addr_for_me v2:172.21.15.102:0/0) 2023-11-13T11:29:28.777 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:28.766+0000 7f197a33d640 1 --2- 172.21.15.102:0/266837320 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f197406c800 0x7f19740b1ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:28.777 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:28.766+0000 7f197ab3e640 1 --2- 172.21.15.102:0/266837320 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f197415bac0 0x7f1974141fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:28.778 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:28.766+0000 7f1979b3c640 1 -- 172.21.15.102:0/266837320 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f197406c800 msgr2=0x7f19740b1ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:28.778 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:28.766+0000 7f1979b3c640 1 --2- 172.21.15.102:0/266837320 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f197406c800 0x7f19740b1ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:28.778 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:28.766+0000 7f1979b3c640 1 -- 172.21.15.102:0/266837320 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f197415bac0 msgr2=0x7f1974141fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:28.778 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:28.766+0000 7f1979b3c640 1 --2- 172.21.15.102:0/266837320 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f197415bac0 0x7f1974141fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:28.778 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:28.766+0000 7f1979b3c640 1 -- 172.21.15.102:0/266837320 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19700094d0 con 0x7f19741553c0 2023-11-13T11:29:28.779 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:28.766+0000 7f1979b3c640 1 --2- 172.21.15.102:0/266837320 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f19741553c0 0x7f19740cd160 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f196400c3c0 tx=0x7f196400c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-13T11:29:28.779 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:28.766+0000 7f196affd640 1 -- 172.21.15.102:0/266837320 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19640052d0 con 0x7f19741553c0 2023-11-13T11:29:28.779 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:28.766+0000 7f196affd640 1 -- 172.21.15.102:0/266837320 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1964005430 con 0x7f19741553c0 2023-11-13T11:29:28.779 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:28.766+0000 7f197c5a1640 1 -- 172.21.15.102:0/266837320 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1974156280 con 0x7f19741553c0 2023-11-13T11:29:28.779 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:28.766+0000 7f196affd640 1 -- 172.21.15.102:0/266837320 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1964003840 con 0x7f19741553c0 2023-11-13T11:29:28.780 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:28.766+0000 7f197c5a1640 1 -- 172.21.15.102:0/266837320 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1974156840 con 0x7f19741553c0 2023-11-13T11:29:28.780 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:28.766+0000 7f197c5a1640 1 -- 172.21.15.102:0/266837320 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1974067640 con 0x7f19741553c0 2023-11-13T11:29:28.780 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:28.770+0000 7f196affd640 1 -- 172.21.15.102:0/266837320 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f19640039a0 con 0x7f19741553c0 2023-11-13T11:29:28.781 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:28.770+0000 7f196affd640 1 --2- 172.21.15.102:0/266837320 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f1958066470 0x7f1958068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:28.782 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:28.770+0000 7f196affd640 1 -- 172.21.15.102:0/266837320 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f1964083110 con 0x7f19741553c0 2023-11-13T11:29:28.782 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:28.770+0000 7f197a33d640 1 --2- 172.21.15.102:0/266837320 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f1958066470 0x7f1958068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:28.782 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:28.770+0000 7f197a33d640 1 --2- 172.21.15.102:0/266837320 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f1958066470 0x7f1958068930 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f19700af000 tx=0x7f19700b6040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-13T11:29:28.783 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:28.774+0000 7f196affd640 1 -- 172.21.15.102:0/266837320 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f19640506b0 con 0x7f19741553c0 2023-11-13T11:29:28.929 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:28.922+0000 7f197c5a1640 1 -- 172.21.15.102:0/266837320 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f197415bf10 con 0x7f19741553c0 2023-11-13T11:29:28.930 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:28.922+0000 7f196affd640 1 -- 172.21.15.102:0/266837320 <== mon.0 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v22) v1 ==== 93+0+10 (secure 0 0 0) 0x7f197415bf10 con 0x7f19741553c0 2023-11-13T11:29:28.930 INFO:teuthology.orchestra.run.smithi102.stdout:pg_num: 1 2023-11-13T11:29:28.932 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:28.926+0000 7f197c5a1640 1 -- 172.21.15.102:0/266837320 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f1958066470 msgr2=0x7f1958068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:28.932 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:28.926+0000 7f197c5a1640 1 --2- 172.21.15.102:0/266837320 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f1958066470 0x7f1958068930 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f19700af000 tx=0x7f19700b6040 comp rx=0 tx=0).stop 2023-11-13T11:29:28.932 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:28.926+0000 7f197c5a1640 1 -- 172.21.15.102:0/266837320 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f19741553c0 msgr2=0x7f19740cd160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:28.933 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:28.926+0000 7f197c5a1640 1 --2- 172.21.15.102:0/266837320 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f19741553c0 0x7f19740cd160 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f196400c3c0 tx=0x7f196400c880 comp rx=0 tx=0).stop 2023-11-13T11:29:28.933 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:28.926+0000 7f197c5a1640 1 -- 172.21.15.102:0/266837320 shutdown_connections 2023-11-13T11:29:28.933 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:28.926+0000 7f197c5a1640 1 --2- 172.21.15.102:0/266837320 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f197415bac0 0x7f1974141fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:28.933 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:28.926+0000 7f197c5a1640 1 --2- 172.21.15.102:0/266837320 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f1958066470 0x7f1958068930 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:28.933 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:28.926+0000 7f197c5a1640 1 --2- 172.21.15.102:0/266837320 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f19741553c0 0x7f19740cd160 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:28.934 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:28.926+0000 7f197c5a1640 1 --2- 172.21.15.102:0/266837320 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f197406c800 0x7f19740b1ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:28.934 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:28.926+0000 7f197c5a1640 1 -- 172.21.15.102:0/266837320 >> 172.21.15.102:0/266837320 conn(0x7f197406a410 msgr2=0x7f19740afd10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-13T11:29:28.934 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:28.926+0000 7f197c5a1640 1 -- 172.21.15.102:0/266837320 shutdown_connections 2023-11-13T11:29:28.934 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:28.926+0000 7f197c5a1640 1 -- 172.21.15.102:0/266837320 wait complete. 2023-11-13T11:29:28.951 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-13T11:29:29.094 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:29.086+0000 7f015678d640 1 Processor -- start 2023-11-13T11:29:29.095 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:29.086+0000 7f015678d640 1 -- start start 2023-11-13T11:29:29.096 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:29.090+0000 7f015678d640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f01500d0690 0x7f015006a240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:29.096 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:29.090+0000 7f015678d640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f015015d3e0 con 0x7f015015d000 2023-11-13T11:29:29.096 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:29.090+0000 7f015678d640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f01500cfa80 con 0x7f015006ccb0 2023-11-13T11:29:29.097 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:29.090+0000 7f015678d640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f01500ae610 con 0x7f01500d0690 2023-11-13T11:29:29.097 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:29.090+0000 7f0154d2a640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f01500d0690 0x7f015006a240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:29.097 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:29.090+0000 7f0154d2a640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f01500d0690 0x7f015006a240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:48112/0 (socket says 172.21.15.102:48112) 2023-11-13T11:29:29.097 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:29.090+0000 7f0154d2a640 1 -- 172.21.15.102:0/159904782 learned_addr learned my addr 172.21.15.102:0/159904782 (peer_addr_for_me v2:172.21.15.102:0/0) 2023-11-13T11:29:29.097 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:29.090+0000 7f014ffff640 1 --1- 172.21.15.102:0/159904782 >> v1:172.21.15.102:6789/0 conn(0x7f015015d000 0x7f015006e540 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.102:6789/0 says I am v1:172.21.15.102:36130/0 (socket says 172.21.15.102:36130) 2023-11-13T11:29:29.098 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:29.090+0000 7f0154d2a640 1 -- 172.21.15.102:0/159904782 >> v1:172.21.15.154:6789/0 conn(0x7f015006ccb0 legacy=0x7f01500cff80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:29.098 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:29.090+0000 7f0154d2a640 1 -- 172.21.15.102:0/159904782 >> v1:172.21.15.102:6789/0 conn(0x7f015015d000 legacy=0x7f015006e540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:29.098 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:29.090+0000 7f0154d2a640 1 -- 172.21.15.102:0/159904782 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01500ae970 con 0x7f01500d0690 2023-11-13T11:29:29.099 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:29.094+0000 7f0154d2a640 1 --2- 172.21.15.102:0/159904782 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f01500d0690 0x7f015006a240 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f0148009e50 tx=0x7f014801c980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8624649d6603c185 server_cookie=0 in_seq=0 out_seq=0 2023-11-13T11:29:29.099 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:29.094+0000 7f014effd640 1 -- 172.21.15.102:0/159904782 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01480a5860 con 0x7f01500d0690 2023-11-13T11:29:29.099 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:29.094+0000 7f014effd640 1 -- 172.21.15.102:0/159904782 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f01480a59c0 con 0x7f01500d0690 2023-11-13T11:29:29.100 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:29.094+0000 7f014effd640 1 -- 172.21.15.102:0/159904782 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01480a5d50 con 0x7f01500d0690 2023-11-13T11:29:29.101 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:29.094+0000 7f015678d640 1 -- 172.21.15.102:0/159904782 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f01500d0690 msgr2=0x7f015006a240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:29.101 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:29.094+0000 7f015678d640 1 --2- 172.21.15.102:0/159904782 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f01500d0690 0x7f015006a240 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f0148009e50 tx=0x7f014801c980 comp rx=0 tx=0).stop 2023-11-13T11:29:29.101 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:29.094+0000 7f015678d640 1 -- 172.21.15.102:0/159904782 shutdown_connections 2023-11-13T11:29:29.101 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:29.094+0000 7f015678d640 1 --2- 172.21.15.102:0/159904782 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f01500d0690 0x7f015006a240 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:29.101 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:29.094+0000 7f015678d640 1 -- 172.21.15.102:0/159904782 >> 172.21.15.102:0/159904782 conn(0x7f015006b350 msgr2=0x7f015006b760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-13T11:29:29.102 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:29.094+0000 7f015678d640 1 -- 172.21.15.102:0/159904782 shutdown_connections 2023-11-13T11:29:29.102 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:29.094+0000 7f015678d640 1 -- 172.21.15.102:0/159904782 wait complete. 2023-11-13T11:29:29.105 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:29.094+0000 7f015678d640 1 Processor -- start 2023-11-13T11:29:29.105 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:29.094+0000 7f015678d640 1 -- start start 2023-11-13T11:29:29.105 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:29.098+0000 7f015678d640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f015006ccb0 0x7f015014be20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:29.105 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:29.098+0000 7f015678d640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f01500d0690 0x7f0150150810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:29.105 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:29.098+0000 7f015678d640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f015015d000 0x7f015014d900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:29.106 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:29.098+0000 7f015678d640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f015014c360 con 0x7f01500d0690 2023-11-13T11:29:29.106 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:29.098+0000 7f015678d640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0150151340 con 0x7f015015d000 2023-11-13T11:29:29.106 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:29.098+0000 7f015678d640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0150151620 con 0x7f015006ccb0 2023-11-13T11:29:29.106 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:29.098+0000 7f014f7fe640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f01500d0690 0x7f0150150810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:29.107 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:29.098+0000 7f014f7fe640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f01500d0690 0x7f0150150810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:48122/0 (socket says 172.21.15.102:48122) 2023-11-13T11:29:29.107 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:29.098+0000 7f014f7fe640 1 -- 172.21.15.102:0/4057886589 learned_addr learned my addr 172.21.15.102:0/4057886589 (peer_addr_for_me v2:172.21.15.102:0/0) 2023-11-13T11:29:29.107 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:29.098+0000 7f014ffff640 1 --2- 172.21.15.102:0/4057886589 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f015006ccb0 0x7f015014be20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:29.107 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:29.098+0000 7f0154d2a640 1 --2- 172.21.15.102:0/4057886589 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f015015d000 0x7f015014d900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:29.107 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:29.098+0000 7f014f7fe640 1 -- 172.21.15.102:0/4057886589 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f015006ccb0 msgr2=0x7f015014be20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:29.108 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:29.098+0000 7f014f7fe640 1 --2- 172.21.15.102:0/4057886589 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f015006ccb0 0x7f015014be20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:29.108 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:29.098+0000 7f014f7fe640 1 -- 172.21.15.102:0/4057886589 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f015015d000 msgr2=0x7f015014d900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:29.108 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:29.098+0000 7f014f7fe640 1 --2- 172.21.15.102:0/4057886589 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f015015d000 0x7f015014d900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:29.108 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:29.098+0000 7f014f7fe640 1 -- 172.21.15.102:0/4057886589 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0148009b30 con 0x7f01500d0690 2023-11-13T11:29:29.109 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:29.098+0000 7f0154d2a640 1 --2- 172.21.15.102:0/4057886589 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f015015d000 0x7f015014d900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-13T11:29:29.109 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:29.098+0000 7f014f7fe640 1 --2- 172.21.15.102:0/4057886589 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f01500d0690 0x7f0150150810 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f014400c500 tx=0x7f014400c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-13T11:29:29.109 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:29.098+0000 7f014cff9640 1 -- 172.21.15.102:0/4057886589 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0144005220 con 0x7f01500d0690 2023-11-13T11:29:29.109 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:29.098+0000 7f014cff9640 1 -- 172.21.15.102:0/4057886589 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0144005380 con 0x7f01500d0690 2023-11-13T11:29:29.109 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:29.098+0000 7f014cff9640 1 -- 172.21.15.102:0/4057886589 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0144007270 con 0x7f01500d0690 2023-11-13T11:29:29.110 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:29.098+0000 7f015678d640 1 -- 172.21.15.102:0/4057886589 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f015006d4d0 con 0x7f01500d0690 2023-11-13T11:29:29.110 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:29.098+0000 7f015678d640 1 -- 172.21.15.102:0/4057886589 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0150151be0 con 0x7f01500d0690 2023-11-13T11:29:29.111 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:29.098+0000 7f015678d640 1 -- 172.21.15.102:0/4057886589 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0150067640 con 0x7f01500d0690 2023-11-13T11:29:29.111 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:29.098+0000 7f014cff9640 1 -- 172.21.15.102:0/4057886589 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f01440073d0 con 0x7f01500d0690 2023-11-13T11:29:29.112 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:29.102+0000 7f014cff9640 1 --2- 172.21.15.102:0/4057886589 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f013c066470 0x7f013c068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:29.112 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:29.102+0000 7f014cff9640 1 -- 172.21.15.102:0/4057886589 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f0144083780 con 0x7f01500d0690 2023-11-13T11:29:29.112 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:29.102+0000 7f014ffff640 1 --2- 172.21.15.102:0/4057886589 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f013c066470 0x7f013c068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:29.112 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:29.102+0000 7f014ffff640 1 --2- 172.21.15.102:0/4057886589 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f013c066470 0x7f013c068930 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f0140000f70 tx=0x7f0140007e50 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-13T11:29:29.113 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:29.106+0000 7f014cff9640 1 -- 172.21.15.102:0/4057886589 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f0144050b70 con 0x7f01500d0690 2023-11-13T11:29:29.258 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:29.250+0000 7f015678d640 1 -- 172.21.15.102:0/4057886589 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f0150068520 con 0x7f01500d0690 2023-11-13T11:29:29.259 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:29.254+0000 7f014cff9640 1 -- 172.21.15.102:0/4057886589 <== mon.0 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v22) v1 ==== 104+0+11 (secure 0 0 0) 0x7f0144054190 con 0x7f01500d0690 2023-11-13T11:29:29.259 INFO:teuthology.orchestra.run.smithi102.stdout:pg_num: 32 2023-11-13T11:29:29.261 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:29.254+0000 7f015678d640 1 -- 172.21.15.102:0/4057886589 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f013c066470 msgr2=0x7f013c068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:29.261 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:29.254+0000 7f015678d640 1 --2- 172.21.15.102:0/4057886589 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f013c066470 0x7f013c068930 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f0140000f70 tx=0x7f0140007e50 comp rx=0 tx=0).stop 2023-11-13T11:29:29.261 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:29.254+0000 7f015678d640 1 -- 172.21.15.102:0/4057886589 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f01500d0690 msgr2=0x7f0150150810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:29.262 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:29.254+0000 7f015678d640 1 --2- 172.21.15.102:0/4057886589 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f01500d0690 0x7f0150150810 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f014400c500 tx=0x7f014400c9c0 comp rx=0 tx=0).stop 2023-11-13T11:29:29.262 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:29.254+0000 7f015678d640 1 -- 172.21.15.102:0/4057886589 shutdown_connections 2023-11-13T11:29:29.262 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:29.254+0000 7f015678d640 1 --2- 172.21.15.102:0/4057886589 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f015015d000 0x7f015014d900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:29.262 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:29.254+0000 7f015678d640 1 --2- 172.21.15.102:0/4057886589 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f013c066470 0x7f013c068930 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:29.262 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:29.254+0000 7f015678d640 1 --2- 172.21.15.102:0/4057886589 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f01500d0690 0x7f0150150810 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:29.263 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:29.254+0000 7f015678d640 1 --2- 172.21.15.102:0/4057886589 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f015006ccb0 0x7f015014be20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:29.263 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:29.254+0000 7f015678d640 1 -- 172.21.15.102:0/4057886589 >> 172.21.15.102:0/4057886589 conn(0x7f015006b350 msgr2=0x7f015006b730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-13T11:29:29.263 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:29.254+0000 7f015678d640 1 -- 172.21.15.102:0/4057886589 shutdown_connections 2023-11-13T11:29:29.263 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:29.254+0000 7f015678d640 1 -- 172.21.15.102:0/4057886589 wait complete. 2023-11-13T11:29:29.280 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-13T11:29:29.420 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:29.414+0000 7fa8e270e640 1 Processor -- start 2023-11-13T11:29:29.421 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:29.414+0000 7fa8e270e640 1 -- start start 2023-11-13T11:29:29.422 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:29.414+0000 7fa8e270e640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7fa8dc159420 0x7fa8dc0b3580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:29.422 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:29.414+0000 7fa8e270e640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fa8dc070320 0x7fa8dc06c160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:29.422 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:29.414+0000 7fa8e270e640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa8dc0b2af0 con 0x7fa8dc0ce320 2023-11-13T11:29:29.423 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:29.414+0000 7fa8e270e640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa8dc0b2dd0 con 0x7fa8dc159420 2023-11-13T11:29:29.423 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:29.414+0000 7fa8e270e640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa8dc0b30b0 con 0x7fa8dc070320 2023-11-13T11:29:29.423 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:29.414+0000 7fa8dbfff640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7fa8dc159420 0x7fa8dc0b3580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:29.423 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:29.414+0000 7fa8dbfff640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7fa8dc159420 0x7fa8dc0b3580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:48130/0 (socket says 172.21.15.102:48130) 2023-11-13T11:29:29.423 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:29.414+0000 7fa8dbfff640 1 -- 172.21.15.102:0/3317083847 learned_addr learned my addr 172.21.15.102:0/3317083847 (peer_addr_for_me v2:172.21.15.102:0/0) 2023-11-13T11:29:29.424 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:29.414+0000 7fa8e0cab640 1 --2- 172.21.15.102:0/3317083847 >> v2:172.21.15.154:3300/0 conn(0x7fa8dc070320 0x7fa8dc06c160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:29.424 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:29.418+0000 7fa8dbfff640 1 -- 172.21.15.102:0/3317083847 >> v2:172.21.15.154:3300/0 conn(0x7fa8dc070320 msgr2=0x7fa8dc06c160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-13T11:29:29.424 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:29.418+0000 7fa8dbfff640 1 --2- 172.21.15.102:0/3317083847 >> v2:172.21.15.154:3300/0 conn(0x7fa8dc070320 0x7fa8dc06c160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:29.425 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:29.418+0000 7fa8dbfff640 1 -- 172.21.15.102:0/3317083847 >> v1:172.21.15.154:6789/0 conn(0x7fa8dc0ce320 legacy=0x7fa8dc06fc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:29.425 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:29.418+0000 7fa8dbfff640 1 -- 172.21.15.102:0/3317083847 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8dc06bc40 con 0x7fa8dc159420 2023-11-13T11:29:29.426 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:29.418+0000 7fa8dbfff640 1 --2- 172.21.15.102:0/3317083847 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa8dc159420 0x7fa8dc0b3580 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fa8dc071d10 tx=0x7fa8cc01d8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ed65f4a2cbabe5c4 server_cookie=0 in_seq=0 out_seq=0 2023-11-13T11:29:29.427 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:29.418+0000 7fa8daffd640 1 -- 172.21.15.102:0/3317083847 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8cc0a6730 con 0x7fa8dc159420 2023-11-13T11:29:29.427 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:29.418+0000 7fa8daffd640 1 -- 172.21.15.102:0/3317083847 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa8cc0a6890 con 0x7fa8dc159420 2023-11-13T11:29:29.428 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:29.418+0000 7fa8daffd640 1 -- 172.21.15.102:0/3317083847 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8cc0a6c20 con 0x7fa8dc159420 2023-11-13T11:29:29.428 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:29.422+0000 7fa8e270e640 1 -- 172.21.15.102:0/3317083847 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa8dc159420 msgr2=0x7fa8dc0b3580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:29.428 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:29.422+0000 7fa8e270e640 1 --2- 172.21.15.102:0/3317083847 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa8dc159420 0x7fa8dc0b3580 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fa8dc071d10 tx=0x7fa8cc01d8d0 comp rx=0 tx=0).stop 2023-11-13T11:29:29.428 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:29.422+0000 7fa8e270e640 1 -- 172.21.15.102:0/3317083847 shutdown_connections 2023-11-13T11:29:29.428 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:29.422+0000 7fa8e270e640 1 --2- 172.21.15.102:0/3317083847 >> v2:172.21.15.154:3300/0 conn(0x7fa8dc070320 0x7fa8dc06c160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:29.429 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:29.422+0000 7fa8e270e640 1 --2- 172.21.15.102:0/3317083847 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa8dc159420 0x7fa8dc0b3580 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:29.429 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:29.422+0000 7fa8e270e640 1 -- 172.21.15.102:0/3317083847 >> 172.21.15.102:0/3317083847 conn(0x7fa8dc06a410 msgr2=0x7fa8dc06a820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-13T11:29:29.429 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:29.422+0000 7fa8e270e640 1 -- 172.21.15.102:0/3317083847 shutdown_connections 2023-11-13T11:29:29.429 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:29.422+0000 7fa8e270e640 1 -- 172.21.15.102:0/3317083847 wait complete. 2023-11-13T11:29:29.432 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:29.422+0000 7fa8e270e640 1 Processor -- start 2023-11-13T11:29:29.432 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:29.422+0000 7fa8e270e640 1 -- start start 2023-11-13T11:29:29.432 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:29.422+0000 7fa8e270e640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa8dc070320 0x7fa8dc15f0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:29.432 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:29.422+0000 7fa8e270e640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa8dc0ce320 0x7fa8dc153e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:29.433 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:29.422+0000 7fa8e270e640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa8dc159420 0x7fa8dc163830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:29.433 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:29.422+0000 7fa8e270e640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8dc160b90 con 0x7fa8dc070320 2023-11-13T11:29:29.433 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:29.422+0000 7fa8e270e640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8dc15f620 con 0x7fa8dc0ce320 2023-11-13T11:29:29.433 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:29.422+0000 7fa8e270e640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8dc15e320 con 0x7fa8dc159420 2023-11-13T11:29:29.433 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:29.422+0000 7fa8dbfff640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa8dc070320 0x7fa8dc15f0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:29.434 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:29.422+0000 7fa8dbfff640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa8dc070320 0x7fa8dc15f0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:48132/0 (socket says 172.21.15.102:48132) 2023-11-13T11:29:29.434 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:29.422+0000 7fa8dbfff640 1 -- 172.21.15.102:0/1506137530 learned_addr learned my addr 172.21.15.102:0/1506137530 (peer_addr_for_me v2:172.21.15.102:0/0) 2023-11-13T11:29:29.435 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:29.422+0000 7fa8e0cab640 1 --2- 172.21.15.102:0/1506137530 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa8dc159420 0x7fa8dc163830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:29.435 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:29.422+0000 7fa8db7fe640 1 --2- 172.21.15.102:0/1506137530 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa8dc0ce320 0x7fa8dc153e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:29.435 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:29.422+0000 7fa8dbfff640 1 -- 172.21.15.102:0/1506137530 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa8dc159420 msgr2=0x7fa8dc163830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:29.436 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:29.422+0000 7fa8dbfff640 1 --2- 172.21.15.102:0/1506137530 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa8dc159420 0x7fa8dc163830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:29.436 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:29.422+0000 7fa8dbfff640 1 -- 172.21.15.102:0/1506137530 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa8dc0ce320 msgr2=0x7fa8dc153e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:29.436 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:29.422+0000 7fa8dbfff640 1 --2- 172.21.15.102:0/1506137530 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa8dc0ce320 0x7fa8dc153e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:29.436 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:29.422+0000 7fa8dbfff640 1 -- 172.21.15.102:0/1506137530 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8cc00a670 con 0x7fa8dc070320 2023-11-13T11:29:29.436 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:29.426+0000 7fa8dbfff640 1 --2- 172.21.15.102:0/1506137530 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa8dc070320 0x7fa8dc15f0e0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fa8cc00a1c0 tx=0x7fa8cc01a670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-13T11:29:29.437 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:29.426+0000 7fa8d8ff9640 1 -- 172.21.15.102:0/1506137530 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8cc0ae850 con 0x7fa8dc070320 2023-11-13T11:29:29.437 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:29.426+0000 7fa8d8ff9640 1 -- 172.21.15.102:0/1506137530 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa8cc0ae9b0 con 0x7fa8dc070320 2023-11-13T11:29:29.437 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:29.426+0000 7fa8d8ff9640 1 -- 172.21.15.102:0/1506137530 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8cc0aed60 con 0x7fa8dc070320 2023-11-13T11:29:29.437 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:29.426+0000 7fa8e270e640 1 -- 172.21.15.102:0/1506137530 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa8dc15e600 con 0x7fa8dc070320 2023-11-13T11:29:29.437 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:29.426+0000 7fa8e270e640 1 -- 172.21.15.102:0/1506137530 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa8dc15ebc0 con 0x7fa8dc070320 2023-11-13T11:29:29.438 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:29.426+0000 7fa8e270e640 1 -- 172.21.15.102:0/1506137530 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa8dc067640 con 0x7fa8dc070320 2023-11-13T11:29:29.439 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:29.426+0000 7fa8d8ff9640 1 -- 172.21.15.102:0/1506137530 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fa8cc0b9480 con 0x7fa8dc070320 2023-11-13T11:29:29.439 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:29.426+0000 7fa8d8ff9640 1 --2- 172.21.15.102:0/1506137530 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7fa8c8066470 0x7fa8c8068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:29.439 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:29.426+0000 7fa8d8ff9640 1 -- 172.21.15.102:0/1506137530 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa8cc11ec60 con 0x7fa8dc070320 2023-11-13T11:29:29.439 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:29.426+0000 7fa8db7fe640 1 --2- 172.21.15.102:0/1506137530 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7fa8c8066470 0x7fa8c8068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:29.439 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:29.430+0000 7fa8db7fe640 1 --2- 172.21.15.102:0/1506137530 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7fa8c8066470 0x7fa8c8068930 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fa8dc15cae0 tx=0x7fa8d0009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-13T11:29:29.440 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:29.430+0000 7fa8d8ff9640 1 -- 172.21.15.102:0/1506137530 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fa8cc0ec040 con 0x7fa8dc070320 2023-11-13T11:29:29.585 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:29.578+0000 7fa8e270e640 1 -- 172.21.15.102:0/1506137530 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fa8dc068520 con 0x7fa8dc070320 2023-11-13T11:29:29.586 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:29.578+0000 7fa8d8ff9640 1 -- 172.21.15.102:0/1506137530 <== mon.0 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v22) v1 ==== 100+0+11 (secure 0 0 0) 0x7fa8cc0b30a0 con 0x7fa8dc070320 2023-11-13T11:29:29.586 INFO:teuthology.orchestra.run.smithi102.stdout:pg_num: 64 2023-11-13T11:29:29.588 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:29.582+0000 7fa8e270e640 1 -- 172.21.15.102:0/1506137530 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7fa8c8066470 msgr2=0x7fa8c8068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:29.588 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:29.582+0000 7fa8e270e640 1 --2- 172.21.15.102:0/1506137530 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7fa8c8066470 0x7fa8c8068930 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fa8dc15cae0 tx=0x7fa8d0009040 comp rx=0 tx=0).stop 2023-11-13T11:29:29.589 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:29.582+0000 7fa8e270e640 1 -- 172.21.15.102:0/1506137530 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa8dc070320 msgr2=0x7fa8dc15f0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:29.589 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:29.582+0000 7fa8e270e640 1 --2- 172.21.15.102:0/1506137530 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa8dc070320 0x7fa8dc15f0e0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fa8cc00a1c0 tx=0x7fa8cc01a670 comp rx=0 tx=0).stop 2023-11-13T11:29:29.589 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:29.582+0000 7fa8e270e640 1 -- 172.21.15.102:0/1506137530 shutdown_connections 2023-11-13T11:29:29.589 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:29.582+0000 7fa8e270e640 1 --2- 172.21.15.102:0/1506137530 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa8dc159420 0x7fa8dc163830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:29.590 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:29.582+0000 7fa8e270e640 1 --2- 172.21.15.102:0/1506137530 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa8dc0ce320 0x7fa8dc153e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:29.590 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:29.582+0000 7fa8e270e640 1 --2- 172.21.15.102:0/1506137530 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7fa8c8066470 0x7fa8c8068930 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:29.590 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:29.582+0000 7fa8e270e640 1 --2- 172.21.15.102:0/1506137530 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa8dc070320 0x7fa8dc15f0e0 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:29.591 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:29.582+0000 7fa8e270e640 1 -- 172.21.15.102:0/1506137530 >> 172.21.15.102:0/1506137530 conn(0x7fa8dc06a410 msgr2=0x7fa8dc155210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-13T11:29:29.591 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:29.582+0000 7fa8e270e640 1 -- 172.21.15.102:0/1506137530 shutdown_connections 2023-11-13T11:29:29.591 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:29.582+0000 7fa8e270e640 1 -- 172.21.15.102:0/1506137530 wait complete. 2023-11-13T11:29:29.608 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-11-13T11:29:29.750 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:29.742+0000 7f7cb9c6b640 1 Processor -- start 2023-11-13T11:29:29.751 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:29.742+0000 7f7cb9c6b640 1 -- start start 2023-11-13T11:29:29.755 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:29.746+0000 7f7cb9c6b640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7cb406caa0 0x7f7cb415e3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:29.755 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:29.746+0000 7f7cb9c6b640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7cb415e910 con 0x7f7cb4140540 2023-11-13T11:29:29.756 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:29.746+0000 7f7cb9c6b640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7cb4140920 con 0x7f7cb4071900 2023-11-13T11:29:29.756 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:29.746+0000 7f7cb9c6b640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7cb40ccc50 con 0x7f7cb406caa0 2023-11-13T11:29:29.756 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:29.746+0000 7f7cb37fe640 1 --1- >> v1:172.21.15.102:6789/0 conn(0x7f7cb4140540 0x7f7cb40711f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.102:6789/0 says I am v1:172.21.15.102:36132/0 (socket says 172.21.15.102:36132) 2023-11-13T11:29:29.756 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:29.746+0000 7f7cb37fe640 1 -- 172.21.15.102:0/2579186174 learned_addr learned my addr 172.21.15.102:0/2579186174 (peer_addr_for_me v1:172.21.15.102:0/0) 2023-11-13T11:29:29.756 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:29.746+0000 7f7cb27fc640 1 -- 172.21.15.102:0/2579186174 <== mon.0 v1:172.21.15.102:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2721681803 0 0) 0x7f7ca4001120 con 0x7f7cb4140540 2023-11-13T11:29:29.757 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:29.746+0000 7f7cb27fc640 1 -- 172.21.15.102:0/2579186174 --> v1:172.21.15.102:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7c9c005740 con 0x7f7cb4140540 2023-11-13T11:29:29.757 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:29.746+0000 7f7cb3fff640 1 --2- 172.21.15.102:0/2579186174 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7cb406caa0 0x7f7cb415e3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:29.757 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:29.746+0000 7f7cb27fc640 1 -- 172.21.15.102:0/2579186174 <== mon.0 v1:172.21.15.102:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3945981970 0 0) 0x7f7c9c005740 con 0x7f7cb4140540 2023-11-13T11:29:29.758 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:29.746+0000 7f7cb27fc640 1 -- 172.21.15.102:0/2579186174 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7cb406caa0 msgr2=0x7f7cb415e3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-13T11:29:29.758 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:29.746+0000 7f7cb27fc640 1 --2- 172.21.15.102:0/2579186174 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7cb406caa0 0x7f7cb415e3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:29.758 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:29.746+0000 7f7cb27fc640 1 -- 172.21.15.102:0/2579186174 >> v1:172.21.15.154:6789/0 conn(0x7f7cb4071900 legacy=0x7f7cb40b1c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:29.759 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:29.746+0000 7f7cb27fc640 1 -- 172.21.15.102:0/2579186174 --> v1:172.21.15.102:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7cb406cfc0 con 0x7f7cb4140540 2023-11-13T11:29:29.759 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:29.746+0000 7f7cb27fc640 1 -- 172.21.15.102:0/2579186174 <== mon.0 v1:172.21.15.102:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 895381068 0 0) 0x7f7ca4001810 con 0x7f7cb4140540 2023-11-13T11:29:29.759 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:29.746+0000 7f7cb3fff640 1 --2- 172.21.15.102:0/2579186174 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7cb406caa0 0x7f7cb415e3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-13T11:29:29.759 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:29.746+0000 7f7cb27fc640 1 -- 172.21.15.102:0/2579186174 >> v1:172.21.15.102:6789/0 conn(0x7f7cb4140540 legacy=0x7f7cb40711f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:29.759 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:29.746+0000 7f7cb27fc640 1 --2- 172.21.15.102:0/2579186174 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7cb406caa0 0x7f7c9c005bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:29.760 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:29.746+0000 7f7cb27fc640 1 --2- 172.21.15.102:0/2579186174 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7c9c0061b0 0x7f7c9c0069e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:29.760 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:29.746+0000 7f7cb27fc640 1 --2- 172.21.15.102:0/2579186174 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7c9c006f20 0x7f7c9c0073a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:29.760 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:29.746+0000 7f7cb27fc640 1 -- 172.21.15.102:0/2579186174 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7cb40ccc50 con 0x7f7c9c006f20 2023-11-13T11:29:29.760 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:29.746+0000 7f7cb27fc640 1 -- 172.21.15.102:0/2579186174 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c9c00dd00 con 0x7f7c9c0061b0 2023-11-13T11:29:29.760 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:29.746+0000 7f7cb27fc640 1 -- 172.21.15.102:0/2579186174 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c9c00dec0 con 0x7f7cb406caa0 2023-11-13T11:29:29.761 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:29.746+0000 7f7cb3fff640 1 --2- 172.21.15.102:0/2579186174 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7c9c006f20 0x7f7c9c0073a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:29.761 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:29.746+0000 7f7cb37fe640 1 --2- 172.21.15.102:0/2579186174 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7cb406caa0 0x7f7c9c005bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:29.761 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:29.746+0000 7f7cb2ffd640 1 --2- 172.21.15.102:0/2579186174 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7c9c0061b0 0x7f7c9c0069e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:29.762 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:29.746+0000 7f7cb3fff640 1 -- 172.21.15.102:0/2579186174 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7cb406caa0 msgr2=0x7f7c9c005bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-13T11:29:29.762 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:29.746+0000 7f7cb3fff640 1 --2- 172.21.15.102:0/2579186174 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7cb406caa0 0x7f7c9c005bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:29.762 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:29.746+0000 7f7cb3fff640 1 -- 172.21.15.102:0/2579186174 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7c9c0061b0 msgr2=0x7f7c9c0069e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-13T11:29:29.763 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:29.746+0000 7f7cb3fff640 1 --2- 172.21.15.102:0/2579186174 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7c9c0061b0 0x7f7c9c0069e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:29.763 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:29.746+0000 7f7cb3fff640 1 -- 172.21.15.102:0/2579186174 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c9c005740 con 0x7f7c9c006f20 2023-11-13T11:29:29.763 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:29.746+0000 7f7cb2ffd640 1 --2- 172.21.15.102:0/2579186174 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7c9c0061b0 0x7f7c9c0069e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-13T11:29:29.768 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:29.750+0000 7f7cb3fff640 1 --2- 172.21.15.102:0/2579186174 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7c9c006f20 0x7f7c9c0073a0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f7cac0073b0 tx=0x7f7cac01ce80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=712115bba1b0f6fc server_cookie=0 in_seq=0 out_seq=0 2023-11-13T11:29:29.769 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:29.750+0000 7f7cb27fc640 1 -- 172.21.15.102:0/2579186174 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7cac0a5d80 con 0x7f7c9c006f20 2023-11-13T11:29:29.769 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:29.750+0000 7f7cb27fc640 1 -- 172.21.15.102:0/2579186174 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7cac0ad440 con 0x7f7c9c006f20 2023-11-13T11:29:29.769 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:29.750+0000 7f7cb27fc640 1 -- 172.21.15.102:0/2579186174 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7cac0ad7b0 con 0x7f7c9c006f20 2023-11-13T11:29:29.770 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:29.750+0000 7f7cb9c6b640 1 -- 172.21.15.102:0/2579186174 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7c9c006f20 msgr2=0x7f7c9c0073a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:29.770 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:29.750+0000 7f7cb9c6b640 1 --2- 172.21.15.102:0/2579186174 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7c9c006f20 0x7f7c9c0073a0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f7cac0073b0 tx=0x7f7cac01ce80 comp rx=0 tx=0).stop 2023-11-13T11:29:29.770 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:29.750+0000 7f7cb3fff640 1 -- 172.21.15.102:0/2579186174 reap_dead start 2023-11-13T11:29:29.771 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:29.750+0000 7f7cb9c6b640 1 -- 172.21.15.102:0/2579186174 shutdown_connections 2023-11-13T11:29:29.771 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:29.750+0000 7f7cb9c6b640 1 -- 172.21.15.102:0/2579186174 >> 172.21.15.102:0/2579186174 conn(0x7f7cb40b0870 msgr2=0x7f7cb40b0c80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-13T11:29:29.771 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:29.750+0000 7f7cb9c6b640 1 -- 172.21.15.102:0/2579186174 shutdown_connections 2023-11-13T11:29:29.772 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:29.750+0000 7f7cb9c6b640 1 -- 172.21.15.102:0/2579186174 wait complete. 2023-11-13T11:29:29.772 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:29.754+0000 7f7cb9c6b640 1 Processor -- start 2023-11-13T11:29:29.772 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:29.754+0000 7f7cb9c6b640 1 -- start start 2023-11-13T11:29:29.773 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:29.754+0000 7f7cb9c6b640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7c9c006f20 0x7f7cb4159cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:29.773 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:29.754+0000 7f7cb9c6b640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7cb41e7eb0 0x7f7cb41e8970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:29.773 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:29.754+0000 7f7cb9c6b640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7cb415b6e0 0x7f7cb415bb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:29.773 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:29.754+0000 7f7cb9c6b640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7cb41e8eb0 con 0x7f7c9c006f20 2023-11-13T11:29:29.774 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:29.754+0000 7f7cb9c6b640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7cb41e8310 con 0x7f7cb41e7eb0 2023-11-13T11:29:29.774 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:29.754+0000 7f7cb9c6b640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7cb415c560 con 0x7f7cb415b6e0 2023-11-13T11:29:29.774 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:29.754+0000 7f7cb37fe640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7c9c006f20 0x7f7cb4159cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:29.775 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:29.754+0000 7f7cb37fe640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7c9c006f20 0x7f7cb4159cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:48152/0 (socket says 172.21.15.102:48152) 2023-11-13T11:29:29.775 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:29.754+0000 7f7cb37fe640 1 -- 172.21.15.102:0/3639096784 learned_addr learned my addr 172.21.15.102:0/3639096784 (peer_addr_for_me v2:172.21.15.102:0/0) 2023-11-13T11:29:29.775 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:29.754+0000 7f7cb2ffd640 1 --2- 172.21.15.102:0/3639096784 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7cb41e7eb0 0x7f7cb41e8970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:29.776 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:29.754+0000 7f7cb3fff640 1 --2- 172.21.15.102:0/3639096784 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7cb415b6e0 0x7f7cb415bb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:29.776 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:29.754+0000 7f7cb37fe640 1 -- 172.21.15.102:0/3639096784 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7cb415b6e0 msgr2=0x7f7cb415bb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:29.777 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:29.754+0000 7f7cb37fe640 1 --2- 172.21.15.102:0/3639096784 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7cb415b6e0 0x7f7cb415bb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:29.777 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:29.754+0000 7f7cb37fe640 1 -- 172.21.15.102:0/3639096784 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7cb41e7eb0 msgr2=0x7f7cb41e8970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:29.777 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:29.754+0000 7f7cb37fe640 1 --2- 172.21.15.102:0/3639096784 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7cb41e7eb0 0x7f7cb41e8970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:29.778 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:29.754+0000 7f7cb37fe640 1 -- 172.21.15.102:0/3639096784 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7cb415c840 con 0x7f7c9c006f20 2023-11-13T11:29:29.778 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:29.754+0000 7f7cb37fe640 1 --2- 172.21.15.102:0/3639096784 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7c9c006f20 0x7f7cb4159cd0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f7ca4007310 tx=0x7f7ca40077d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-13T11:29:29.778 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:29.754+0000 7f7c9bfff640 1 -- 172.21.15.102:0/3639096784 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ca400f960 con 0x7f7c9c006f20 2023-11-13T11:29:29.779 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:29.754+0000 7f7c9bfff640 1 -- 172.21.15.102:0/3639096784 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ca400fb00 con 0x7f7c9c006f20 2023-11-13T11:29:29.779 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:29.754+0000 7f7cb9c6b640 1 -- 172.21.15.102:0/3639096784 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7cb415cb20 con 0x7f7c9c006f20 2023-11-13T11:29:29.780 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:29.754+0000 7f7c9bfff640 1 -- 172.21.15.102:0/3639096784 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ca400feb0 con 0x7f7c9c006f20 2023-11-13T11:29:29.780 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:29.754+0000 7f7cb9c6b640 1 -- 172.21.15.102:0/3639096784 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7cb415c0a0 con 0x7f7c9c006f20 2023-11-13T11:29:29.780 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:29.754+0000 7f7cb9c6b640 1 -- 172.21.15.102:0/3639096784 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7cb415c2c0 con 0x7f7c9c006f20 2023-11-13T11:29:29.781 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:29.758+0000 7f7c9bfff640 1 -- 172.21.15.102:0/3639096784 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f7ca401d460 con 0x7f7c9c006f20 2023-11-13T11:29:29.781 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:29.758+0000 7f7c9bfff640 1 --2- 172.21.15.102:0/3639096784 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f7ca0066470 0x7f7ca0068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:29.781 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:29.758+0000 7f7c9bfff640 1 -- 172.21.15.102:0/3639096784 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f7ca4083fc0 con 0x7f7c9c006f20 2023-11-13T11:29:29.782 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:29.758+0000 7f7cb2ffd640 1 --2- 172.21.15.102:0/3639096784 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f7ca0066470 0x7f7ca0068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:29.782 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:29.758+0000 7f7cb2ffd640 1 --2- 172.21.15.102:0/3639096784 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f7ca0066470 0x7f7ca0068930 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f7cb40cb310 tx=0x7f7ca8009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-13T11:29:29.782 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:29.762+0000 7f7c9bfff640 1 -- 172.21.15.102:0/3639096784 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f7ca4054ec0 con 0x7f7c9c006f20 2023-11-13T11:29:29.930 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:29.922+0000 7f7cb9c6b640 1 -- 172.21.15.102:0/3639096784 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f7cb415e910 con 0x7f7c9c006f20 2023-11-13T11:29:29.931 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:29.922+0000 7f7c9bfff640 1 -- 172.21.15.102:0/3639096784 <== mon.0 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v22) v1 ==== 80+0+0 (secure 0 0 0) 0x7f7cb415e910 con 0x7f7c9c006f20 2023-11-13T11:29:29.931 INFO:teuthology.orchestra.run.smithi102.stderr:listed 0 entries 2023-11-13T11:29:29.933 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:29.926+0000 7f7cb9c6b640 1 -- 172.21.15.102:0/3639096784 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f7ca0066470 msgr2=0x7f7ca0068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:29.933 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:29.926+0000 7f7cb9c6b640 1 --2- 172.21.15.102:0/3639096784 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f7ca0066470 0x7f7ca0068930 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f7cb40cb310 tx=0x7f7ca8009040 comp rx=0 tx=0).stop 2023-11-13T11:29:29.933 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:29.926+0000 7f7cb9c6b640 1 -- 172.21.15.102:0/3639096784 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7c9c006f20 msgr2=0x7f7cb4159cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:29.933 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:29.926+0000 7f7cb9c6b640 1 --2- 172.21.15.102:0/3639096784 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7c9c006f20 0x7f7cb4159cd0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f7ca4007310 tx=0x7f7ca40077d0 comp rx=0 tx=0).stop 2023-11-13T11:29:29.933 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:29.926+0000 7f7cb9c6b640 1 -- 172.21.15.102:0/3639096784 shutdown_connections 2023-11-13T11:29:29.934 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:29.926+0000 7f7cb9c6b640 1 --2- 172.21.15.102:0/3639096784 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7cb415b6e0 0x7f7cb415bb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:29.934 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:29.926+0000 7f7cb9c6b640 1 --2- 172.21.15.102:0/3639096784 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7cb41e7eb0 0x7f7cb41e8970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:29.934 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:29.926+0000 7f7cb9c6b640 1 --2- 172.21.15.102:0/3639096784 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f7ca0066470 0x7f7ca0068930 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:29.934 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:29.926+0000 7f7cb9c6b640 1 --2- 172.21.15.102:0/3639096784 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7c9c006f20 0x7f7cb4159cd0 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:29.934 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:29.926+0000 7f7cb9c6b640 1 -- 172.21.15.102:0/3639096784 >> 172.21.15.102:0/3639096784 conn(0x7f7cb40b0870 msgr2=0x7f7cb413dfc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-13T11:29:29.935 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:29.926+0000 7f7cb9c6b640 1 -- 172.21.15.102:0/3639096784 shutdown_connections 2023-11-13T11:29:29.935 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:29.926+0000 7f7cb9c6b640 1 -- 172.21.15.102:0/3639096784 wait complete. 2023-11-13T11:29:29.952 DEBUG:teuthology.orchestra.run.smithi102:> set -ex 2023-11-13T11:29:29.952 DEBUG:teuthology.orchestra.run.smithi102:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-13T11:29:29.962 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-13T11:29:30.142 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:30.134+0000 7f22b9a79640 1 Processor -- start 2023-11-13T11:29:30.143 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:30.134+0000 7f22b9a79640 1 -- start start 2023-11-13T11:29:30.144 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:30.138+0000 7f22b9a79640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f22b406dc70 0x7f22b406ba90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:30.144 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:30.138+0000 7f22b9a79640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f22b413e530 con 0x7f22b413df40 2023-11-13T11:29:30.144 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:30.138+0000 7f22b9a79640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f22b415f290 con 0x7f22b406bfd0 2023-11-13T11:29:30.145 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:30.138+0000 7f22b9a79640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f22b406c480 con 0x7f22b406dc70 2023-11-13T11:29:30.145 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:30.138+0000 7f22b37fe640 1 --1- >> v1:172.21.15.102:6789/0 conn(0x7f22b413df40 0x7f22b415e990 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.102:6789/0 says I am v1:172.21.15.102:36136/0 (socket says 172.21.15.102:36136) 2023-11-13T11:29:30.145 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:30.138+0000 7f22b37fe640 1 -- 172.21.15.102:0/2352859707 learned_addr learned my addr 172.21.15.102:0/2352859707 (peer_addr_for_me v1:172.21.15.102:0/0) 2023-11-13T11:29:30.145 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:30.138+0000 7f22b2ffd640 1 --2- 172.21.15.102:0/2352859707 >> v2:172.21.15.102:3300/0 conn(0x7f22b406dc70 0x7f22b406ba90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:30.146 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:30.138+0000 7f22b2ffd640 1 -- 172.21.15.102:0/2352859707 >> v1:172.21.15.154:6789/0 conn(0x7f22b406bfd0 legacy=0x7f22b413f6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-13T11:29:30.146 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:30.138+0000 7f22b2ffd640 1 -- 172.21.15.102:0/2352859707 >> v1:172.21.15.102:6789/0 conn(0x7f22b413df40 legacy=0x7f22b415e990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:30.146 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:30.138+0000 7f22b2ffd640 1 -- 172.21.15.102:0/2352859707 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22b415f570 con 0x7f22b406dc70 2023-11-13T11:29:30.147 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:30.142+0000 7f22b2ffd640 1 --2- 172.21.15.102:0/2352859707 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f22b406dc70 0x7f22b406ba90 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f22a80097c0 tx=0x7f22a801c440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=230fe67ac589f62c server_cookie=0 in_seq=0 out_seq=0 2023-11-13T11:29:30.148 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:30.142+0000 7f22b27fc640 1 -- 172.21.15.102:0/2352859707 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22a80ab600 con 0x7f22b406dc70 2023-11-13T11:29:30.148 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:30.142+0000 7f22b27fc640 1 -- 172.21.15.102:0/2352859707 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f22a80a7050 con 0x7f22b406dc70 2023-11-13T11:29:30.148 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:30.142+0000 7f22b27fc640 1 -- 172.21.15.102:0/2352859707 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22a80ab980 con 0x7f22b406dc70 2023-11-13T11:29:30.149 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:30.142+0000 7f22b9a79640 1 -- 172.21.15.102:0/2352859707 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f22b406dc70 msgr2=0x7f22b406ba90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:30.149 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:30.142+0000 7f22b9a79640 1 --2- 172.21.15.102:0/2352859707 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f22b406dc70 0x7f22b406ba90 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f22a80097c0 tx=0x7f22a801c440 comp rx=0 tx=0).stop 2023-11-13T11:29:30.149 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:30.142+0000 7f22b9a79640 1 -- 172.21.15.102:0/2352859707 shutdown_connections 2023-11-13T11:29:30.150 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:30.142+0000 7f22b9a79640 1 --2- 172.21.15.102:0/2352859707 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f22b406dc70 0x7f22b406ba90 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:30.150 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:30.142+0000 7f22b9a79640 1 -- 172.21.15.102:0/2352859707 >> 172.21.15.102:0/2352859707 conn(0x7f22b40b0870 msgr2=0x7f22b40b0c80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-13T11:29:30.150 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:30.142+0000 7f22b9a79640 1 -- 172.21.15.102:0/2352859707 shutdown_connections 2023-11-13T11:29:30.150 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:30.142+0000 7f22b9a79640 1 -- 172.21.15.102:0/2352859707 wait complete. 2023-11-13T11:29:30.152 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:30.142+0000 7f22b9a79640 1 Processor -- start 2023-11-13T11:29:30.153 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:30.142+0000 7f22b9a79640 1 -- start start 2023-11-13T11:29:30.153 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:30.146+0000 7f22b9a79640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f22b406bfd0 0x7f22b4142d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:30.153 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:30.146+0000 7f22b9a79640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f22b406dc70 0x7f22b40ac8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:30.153 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:30.146+0000 7f22b9a79640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f22b413df40 0x7f22b40acde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:30.154 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:30.146+0000 7f22b9a79640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22b40b3cf0 con 0x7f22b406bfd0 2023-11-13T11:29:30.154 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:30.146+0000 7f22b9a79640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22b4133fc0 con 0x7f22b406dc70 2023-11-13T11:29:30.154 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:30.146+0000 7f22b9a79640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f22b41333f0 con 0x7f22b413df40 2023-11-13T11:29:30.154 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:30.146+0000 7f22b37fe640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f22b406bfd0 0x7f22b4142d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:30.154 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:30.146+0000 7f22b37fe640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f22b406bfd0 0x7f22b4142d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:48182/0 (socket says 172.21.15.102:48182) 2023-11-13T11:29:30.155 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:30.146+0000 7f22b37fe640 1 -- 172.21.15.102:0/926409972 learned_addr learned my addr 172.21.15.102:0/926409972 (peer_addr_for_me v2:172.21.15.102:0/0) 2023-11-13T11:29:30.155 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:30.146+0000 7f22b2ffd640 1 --2- 172.21.15.102:0/926409972 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f22b406dc70 0x7f22b40ac8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:30.155 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:30.146+0000 7f22b3fff640 1 --2- 172.21.15.102:0/926409972 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f22b413df40 0x7f22b40acde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:30.155 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:30.146+0000 7f22b37fe640 1 -- 172.21.15.102:0/926409972 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f22b413df40 msgr2=0x7f22b40acde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:30.155 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:30.146+0000 7f22b37fe640 1 --2- 172.21.15.102:0/926409972 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f22b413df40 0x7f22b40acde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:30.156 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:30.146+0000 7f22b37fe640 1 -- 172.21.15.102:0/926409972 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f22b406dc70 msgr2=0x7f22b40ac8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:30.156 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:30.146+0000 7f22b37fe640 1 --2- 172.21.15.102:0/926409972 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f22b406dc70 0x7f22b40ac8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:30.156 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:30.146+0000 7f22b37fe640 1 -- 172.21.15.102:0/926409972 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22a8009420 con 0x7f22b406bfd0 2023-11-13T11:29:30.156 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:30.146+0000 7f22b2ffd640 1 --2- 172.21.15.102:0/926409972 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f22b406dc70 0x7f22b40ac8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-13T11:29:30.156 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:30.146+0000 7f22b37fe640 1 --2- 172.21.15.102:0/926409972 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f22b406bfd0 0x7f22b4142d40 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f22a400c400 tx=0x7f22a400c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-13T11:29:30.156 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:30.146+0000 7f229bfff640 1 -- 172.21.15.102:0/926409972 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22a4005cf0 con 0x7f22b406bfd0 2023-11-13T11:29:30.157 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:30.146+0000 7f229bfff640 1 -- 172.21.15.102:0/926409972 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f22a4005e50 con 0x7f22b406bfd0 2023-11-13T11:29:30.157 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:30.146+0000 7f229bfff640 1 -- 172.21.15.102:0/926409972 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22a40072d0 con 0x7f22b406bfd0 2023-11-13T11:29:30.157 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:30.146+0000 7f22b9a79640 1 -- 172.21.15.102:0/926409972 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f22b4133690 con 0x7f22b406bfd0 2023-11-13T11:29:30.157 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:30.146+0000 7f22b9a79640 1 -- 172.21.15.102:0/926409972 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f22b4133c50 con 0x7f22b406bfd0 2023-11-13T11:29:30.158 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:30.146+0000 7f22b9a79640 1 -- 172.21.15.102:0/926409972 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f22b4068520 con 0x7f22b406bfd0 2023-11-13T11:29:30.159 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:30.146+0000 7f229bfff640 1 -- 172.21.15.102:0/926409972 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f22a4007430 con 0x7f22b406bfd0 2023-11-13T11:29:30.159 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:30.150+0000 7f229bfff640 1 --2- 172.21.15.102:0/926409972 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f22a0066470 0x7f22a0068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:30.159 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:30.150+0000 7f229bfff640 1 -- 172.21.15.102:0/926409972 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f22a40833e0 con 0x7f22b406bfd0 2023-11-13T11:29:30.159 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:30.150+0000 7f22b2ffd640 1 --2- 172.21.15.102:0/926409972 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f22a0066470 0x7f22a0068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:30.159 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:30.150+0000 7f22b2ffd640 1 --2- 172.21.15.102:0/926409972 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f22a0066470 0x7f22a0068930 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f22a80ad000 tx=0x7f22a8008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-13T11:29:30.160 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:30.154+0000 7f229bfff640 1 -- 172.21.15.102:0/926409972 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f22a4050870 con 0x7f22b406bfd0 2023-11-13T11:29:30.309 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:30.302+0000 7f22b9a79640 1 -- 172.21.15.102:0/926409972 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f22b41355b0 con 0x7f22b406bfd0 2023-11-13T11:29:30.310 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:30.302+0000 7f229bfff640 1 -- 172.21.15.102:0/926409972 <== mon.0 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+16545 (secure 0 0 0) 0x7f22a4053e90 con 0x7f22b406bfd0 2023-11-13T11:29:30.310 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T11:29:30.311 INFO:teuthology.orchestra.run.smithi102.stdout:{"epoch":22,"fsid":"97b3eb2b-7ccf-4aae-8d92-bff986c671ea","created":"2023-11-13T11:28:31.836724+0000","modified":"2023-11-13T11:28:58.608314+0000","last_up_change":"2023-11-13T11:28:44.876638+0000","last_in_change":"2023-11-13T11:28:35.312740+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-13T11:28:44.981356+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-13T11:28:55.958525+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-13T11:28:56.394264+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"bdefaa17-fcca-4c86-aa40-27dc33a789af","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6800","nonce":53303834},{"type":"v1","addr":"172.21.15.102:6801","nonce":53303834}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6802","nonce":53303834},{"type":"v1","addr":"172.21.15.102:6803","nonce":53303834}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6806","nonce":53303834},{"type":"v1","addr":"172.21.15.102:6807","nonce":53303834}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6804","nonce":53303834},{"type":"v1","addr":"172.21.15.102:6805","nonce":53303834}]},"public_addr":"172.21.15.102:6801/53303834","cluster_addr":"172.21.15.102:6803/53303834","heartbeat_back_addr":"172.21.15.102:6807/53303834","heartbeat_front_addr":"172.21.15.102:6805/53303834","state":["exists","up"]},{"osd":1,"uuid":"f0033196-dec9-4ae9-945e-6aeef6dbb47f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6808","nonce":1732708348},{"type":"v1","addr":"172.21.15.102:6809","nonce":1732708348}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6811","nonce":1732708348},{"type":"v1","addr":"172.21.15.102:6813","nonce":1732708348}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6818","nonce":1732708348},{"type":"v1","addr":"172.21.15.102:6820","nonce":1732708348}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6815","nonce":1732708348},{"type":"v1","addr":"172.21.15.102:6817","nonce":1732708348}]},"public_addr":"172.21.15.102:6809/1732708348","cluster_addr":"172.21.15.102:6813/1732708348","heartbeat_back_addr":"172.21.15.102:6820/1732708348","heartbeat_front_addr":"172.21.15.102:6817/1732708348","state":["exists","up"]},{"osd":2,"uuid":"496b0834-351e-4ec2-a714-86ed0c0ff4fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6810","nonce":1825475150},{"type":"v1","addr":"172.21.15.102:6812","nonce":1825475150}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6814","nonce":1825475150},{"type":"v1","addr":"172.21.15.102:6816","nonce":1825475150}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6822","nonce":1825475150},{"type":"v1","addr":"172.21.15.102:6823","nonce":1825475150}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6819","nonce":1825475150},{"type":"v1","addr":"172.21.15.102:6821","nonce":1825475150}]},"public_addr":"172.21.15.102:6812/1825475150","cluster_addr":"172.21.15.102:6816/1825475150","heartbeat_back_addr":"172.21.15.102:6823/1825475150","heartbeat_front_addr":"172.21.15.102:6821/1825475150","state":["exists","up"]},{"osd":3,"uuid":"3ba6cc41-e0a0-4273-86cb-90000c06a55a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6824","nonce":4149355528},{"type":"v1","addr":"172.21.15.102:6825","nonce":4149355528}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6826","nonce":4149355528},{"type":"v1","addr":"172.21.15.102:6827","nonce":4149355528}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6830","nonce":4149355528},{"type":"v1","addr":"172.21.15.102:6831","nonce":4149355528}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6828","nonce":4149355528},{"type":"v1","addr":"172.21.15.102:6829","nonce":4149355528}]},"public_addr":"172.21.15.102:6825/4149355528","cluster_addr":"172.21.15.102:6827/4149355528","heartbeat_back_addr":"172.21.15.102:6831/4149355528","heartbeat_front_addr":"172.21.15.102:6829/4149355528","state":["exists","up"]},{"osd":4,"uuid":"16e797d8-e6e7-4140-95c3-b85283c42a2a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6808","nonce":4028899241},{"type":"v1","addr":"172.21.15.154:6809","nonce":4028899241}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6810","nonce":4028899241},{"type":"v1","addr":"172.21.15.154:6811","nonce":4028899241}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6814","nonce":4028899241},{"type":"v1","addr":"172.21.15.154:6815","nonce":4028899241}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6812","nonce":4028899241},{"type":"v1","addr":"172.21.15.154:6813","nonce":4028899241}]},"public_addr":"172.21.15.154:6809/4028899241","cluster_addr":"172.21.15.154:6811/4028899241","heartbeat_back_addr":"172.21.15.154:6815/4028899241","heartbeat_front_addr":"172.21.15.154:6813/4028899241","state":["exists","up"]},{"osd":5,"uuid":"d6ab225c-1b55-450a-89a9-abe5c3f8d6af","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":3562396827},{"type":"v1","addr":"172.21.15.154:6801","nonce":3562396827}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":3562396827},{"type":"v1","addr":"172.21.15.154:6803","nonce":3562396827}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6806","nonce":3562396827},{"type":"v1","addr":"172.21.15.154:6807","nonce":3562396827}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6804","nonce":3562396827},{"type":"v1","addr":"172.21.15.154:6805","nonce":3562396827}]},"public_addr":"172.21.15.154:6801/3562396827","cluster_addr":"172.21.15.154:6803/3562396827","heartbeat_back_addr":"172.21.15.154:6807/3562396827","heartbeat_front_addr":"172.21.15.154:6805/3562396827","state":["exists","up"]},{"osd":6,"uuid":"96f905ac-491c-4662-8e2b-5bb8e929ab9d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6816","nonce":2933728751},{"type":"v1","addr":"172.21.15.154:6817","nonce":2933728751}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6818","nonce":2933728751},{"type":"v1","addr":"172.21.15.154:6819","nonce":2933728751}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6822","nonce":2933728751},{"type":"v1","addr":"172.21.15.154:6823","nonce":2933728751}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6820","nonce":2933728751},{"type":"v1","addr":"172.21.15.154:6821","nonce":2933728751}]},"public_addr":"172.21.15.154:6817/2933728751","cluster_addr":"172.21.15.154:6819/2933728751","heartbeat_back_addr":"172.21.15.154:6823/2933728751","heartbeat_front_addr":"172.21.15.154:6821/2933728751","state":["exists","up"]},{"osd":7,"uuid":"07012d3b-3ab4-40df-a471-93caed22e2dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6824","nonce":1753500785},{"type":"v1","addr":"172.21.15.154:6825","nonce":1753500785}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6826","nonce":1753500785},{"type":"v1","addr":"172.21.15.154:6827","nonce":1753500785}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6830","nonce":1753500785},{"type":"v1","addr":"172.21.15.154:6831","nonce":1753500785}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6828","nonce":1753500785},{"type":"v1","addr":"172.21.15.154:6829","nonce":1753500785}]},"public_addr":"172.21.15.154:6825/1753500785","cluster_addr":"172.21.15.154:6827/1753500785","heartbeat_back_addr":"172.21.15.154:6831/1753500785","heartbeat_front_addr":"172.21.15.154:6829/1753500785","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-13T11:28:40.978603+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-13T11:28:41.200985+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-13T11:28:41.222815+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-13T11:28:41.202162+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-13T11:28:40.925911+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-13T11:28:41.087725+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-13T11:28:41.072208+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-13T11:28:40.875257+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-13T11:29:30.312 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:30.306+0000 7f22b9a79640 1 -- 172.21.15.102:0/926409972 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f22a0066470 msgr2=0x7f22a0068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:30.312 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:30.306+0000 7f22b9a79640 1 --2- 172.21.15.102:0/926409972 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f22a0066470 0x7f22a0068930 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f22a80ad000 tx=0x7f22a8008040 comp rx=0 tx=0).stop 2023-11-13T11:29:30.312 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:30.306+0000 7f22b9a79640 1 -- 172.21.15.102:0/926409972 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f22b406bfd0 msgr2=0x7f22b4142d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:30.312 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:30.306+0000 7f22b9a79640 1 --2- 172.21.15.102:0/926409972 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f22b406bfd0 0x7f22b4142d40 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f22a400c400 tx=0x7f22a400c8c0 comp rx=0 tx=0).stop 2023-11-13T11:29:30.313 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:30.306+0000 7f22b9a79640 1 -- 172.21.15.102:0/926409972 shutdown_connections 2023-11-13T11:29:30.313 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:30.306+0000 7f22b9a79640 1 --2- 172.21.15.102:0/926409972 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f22b413df40 0x7f22b40acde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:30.313 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:30.306+0000 7f22b9a79640 1 --2- 172.21.15.102:0/926409972 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f22b406dc70 0x7f22b40ac8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:30.313 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:30.306+0000 7f22b9a79640 1 --2- 172.21.15.102:0/926409972 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f22a0066470 0x7f22a0068930 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:30.313 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:30.306+0000 7f22b9a79640 1 --2- 172.21.15.102:0/926409972 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f22b406bfd0 0x7f22b4142d40 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:30.314 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:30.306+0000 7f22b9a79640 1 -- 172.21.15.102:0/926409972 >> 172.21.15.102:0/926409972 conn(0x7f22b40b0870 msgr2=0x7f22b40707e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-13T11:29:30.314 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:30.306+0000 7f22b9a79640 1 -- 172.21.15.102:0/926409972 shutdown_connections 2023-11-13T11:29:30.314 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:30.306+0000 7f22b9a79640 1 -- 172.21.15.102:0/926409972 wait complete. 2023-11-13T11:29:30.332 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-13T11:28:44.981356+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-13T11:28:55.958525+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-11-13T11:28:56.394264+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-13T11:29:30.333 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-13T11:29:30.472 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:30.466+0000 7fdc2b8fe640 1 Processor -- start 2023-11-13T11:29:30.473 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:30.466+0000 7fdc2b8fe640 1 -- start start 2023-11-13T11:29:30.473 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:30.466+0000 7fdc2b8fe640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fdc2415d220 0x7fdc240d3910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:30.474 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:30.466+0000 7fdc2b8fe640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fdc240b3f60 0x7fdc240b2e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:30.474 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:30.466+0000 7fdc2b8fe640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdc240b3840 con 0x7fdc2415d600 2023-11-13T11:29:30.474 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:30.466+0000 7fdc2b8fe640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdc240cecb0 con 0x7fdc240b3f60 2023-11-13T11:29:30.474 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:30.466+0000 7fdc2b8fe640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdc240d0d00 con 0x7fdc2415d220 2023-11-13T11:29:30.475 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:30.466+0000 7fdc28e99640 1 --1- >> v1:172.21.15.102:6789/0 conn(0x7fdc2415d600 0x7fdc240b2750 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.102:6789/0 says I am v1:172.21.15.102:36142/0 (socket says 172.21.15.102:36142) 2023-11-13T11:29:30.475 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:30.466+0000 7fdc28e99640 1 -- 172.21.15.102:0/1221587463 learned_addr learned my addr 172.21.15.102:0/1221587463 (peer_addr_for_me v1:172.21.15.102:0/0) 2023-11-13T11:29:30.477 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:30.466+0000 7fdc2969a640 1 --2- 172.21.15.102:0/1221587463 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fdc2415d220 0x7fdc240d3910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:30.477 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:30.466+0000 7fdc29e9b640 1 --2- 172.21.15.102:0/1221587463 >> v2:172.21.15.154:3300/0 conn(0x7fdc240b3f60 0x7fdc240b2e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:30.477 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:30.466+0000 7fdc1bfff640 1 -- 172.21.15.102:0/1221587463 <== mon.0 v1:172.21.15.102:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3561448346 0 0) 0x7fdc240b3840 con 0x7fdc2415d600 2023-11-13T11:29:30.477 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:30.466+0000 7fdc1bfff640 1 -- 172.21.15.102:0/1221587463 --> v1:172.21.15.102:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdc10003530 con 0x7fdc2415d600 2023-11-13T11:29:30.478 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:30.470+0000 7fdc1bfff640 1 -- 172.21.15.102:0/1221587463 <== mon.0 v1:172.21.15.102:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1214444141 0 0) 0x7fdc10003530 con 0x7fdc2415d600 2023-11-13T11:29:30.478 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:30.470+0000 7fdc1bfff640 1 -- 172.21.15.102:0/1221587463 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fdc2415d220 msgr2=0x7fdc240d3910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-13T11:29:30.478 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:30.470+0000 7fdc1bfff640 1 --2- 172.21.15.102:0/1221587463 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fdc2415d220 0x7fdc240d3910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:30.478 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:30.470+0000 7fdc1bfff640 1 -- 172.21.15.102:0/1221587463 >> v2:172.21.15.154:3300/0 conn(0x7fdc240b3f60 msgr2=0x7fdc240b2e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-13T11:29:30.478 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:30.470+0000 7fdc1bfff640 1 --2- 172.21.15.102:0/1221587463 >> v2:172.21.15.154:3300/0 conn(0x7fdc240b3f60 0x7fdc240b2e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:30.479 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:30.470+0000 7fdc1bfff640 1 -- 172.21.15.102:0/1221587463 --> v1:172.21.15.102:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc240d0fe0 con 0x7fdc2415d600 2023-11-13T11:29:30.479 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:30.470+0000 7fdc1bfff640 1 -- 172.21.15.102:0/1221587463 <== mon.0 v1:172.21.15.102:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 895381068 0 0) 0x7fdc14001680 con 0x7fdc2415d600 2023-11-13T11:29:30.479 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:30.470+0000 7fdc1bfff640 1 -- 172.21.15.102:0/1221587463 >> v1:172.21.15.102:6789/0 conn(0x7fdc2415d600 legacy=0x7fdc240b2750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:30.479 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:30.470+0000 7fdc1bfff640 1 --2- 172.21.15.102:0/1221587463 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fdc2415d220 0x7fdc10003980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:30.479 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:30.470+0000 7fdc1bfff640 1 --2- 172.21.15.102:0/1221587463 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fdc10003f00 0x7fdc100047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:30.480 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:30.470+0000 7fdc1bfff640 1 --2- 172.21.15.102:0/1221587463 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdc10004d10 0x7fdc10005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:30.480 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:30.470+0000 7fdc1bfff640 1 -- 172.21.15.102:0/1221587463 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc240cecb0 con 0x7fdc10003f00 2023-11-13T11:29:30.480 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:30.470+0000 7fdc1bfff640 1 -- 172.21.15.102:0/1221587463 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc240d0d00 con 0x7fdc10004d10 2023-11-13T11:29:30.480 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:30.470+0000 7fdc1bfff640 1 -- 172.21.15.102:0/1221587463 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdc1000ba70 con 0x7fdc2415d220 2023-11-13T11:29:30.480 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:30.470+0000 7fdc28e99640 1 --2- 172.21.15.102:0/1221587463 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fdc10003f00 0x7fdc100047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:30.481 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:30.470+0000 7fdc2969a640 1 --2- 172.21.15.102:0/1221587463 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fdc2415d220 0x7fdc10003980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:30.481 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:30.470+0000 7fdc29e9b640 1 --2- 172.21.15.102:0/1221587463 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdc10004d10 0x7fdc10005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:30.481 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:30.470+0000 7fdc28e99640 1 -- 172.21.15.102:0/1221587463 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fdc2415d220 msgr2=0x7fdc10003980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-13T11:29:30.481 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:30.470+0000 7fdc28e99640 1 --2- 172.21.15.102:0/1221587463 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fdc2415d220 0x7fdc10003980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:30.481 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:30.470+0000 7fdc28e99640 1 -- 172.21.15.102:0/1221587463 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdc10004d10 msgr2=0x7fdc10005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-13T11:29:30.482 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:30.470+0000 7fdc28e99640 1 --2- 172.21.15.102:0/1221587463 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdc10004d10 0x7fdc10005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:30.482 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:30.470+0000 7fdc28e99640 1 -- 172.21.15.102:0/1221587463 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc10003530 con 0x7fdc10003f00 2023-11-13T11:29:30.482 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:30.470+0000 7fdc29e9b640 1 --2- 172.21.15.102:0/1221587463 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdc10004d10 0x7fdc10005190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-13T11:29:30.485 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:30.470+0000 7fdc28e99640 1 --2- 172.21.15.102:0/1221587463 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fdc10003f00 0x7fdc100047d0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fdc1400c240 tx=0x7fdc1401cc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b34dd62f291cbbb2 server_cookie=0 in_seq=0 out_seq=0 2023-11-13T11:29:30.485 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:30.470+0000 7fdc1bfff640 1 -- 172.21.15.102:0/1221587463 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc140058e0 con 0x7fdc10003f00 2023-11-13T11:29:30.485 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:30.474+0000 7fdc1bfff640 1 -- 172.21.15.102:0/1221587463 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc14005a40 con 0x7fdc10003f00 2023-11-13T11:29:30.486 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:30.474+0000 7fdc1bfff640 1 -- 172.21.15.102:0/1221587463 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc14005e50 con 0x7fdc10003f00 2023-11-13T11:29:30.486 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:30.474+0000 7fdc2b8fe640 1 -- 172.21.15.102:0/1221587463 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fdc10003f00 msgr2=0x7fdc100047d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:30.486 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:30.474+0000 7fdc2b8fe640 1 --2- 172.21.15.102:0/1221587463 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fdc10003f00 0x7fdc100047d0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fdc1400c240 tx=0x7fdc1401cc30 comp rx=0 tx=0).stop 2023-11-13T11:29:30.486 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:30.474+0000 7fdc29e9b640 1 -- 172.21.15.102:0/1221587463 reap_dead start 2023-11-13T11:29:30.486 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:30.474+0000 7fdc2b8fe640 1 -- 172.21.15.102:0/1221587463 shutdown_connections 2023-11-13T11:29:30.487 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:30.474+0000 7fdc2b8fe640 1 -- 172.21.15.102:0/1221587463 >> 172.21.15.102:0/1221587463 conn(0x7fdc240d2df0 msgr2=0x7fdc240d3200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-13T11:29:30.487 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:30.474+0000 7fdc2b8fe640 1 -- 172.21.15.102:0/1221587463 shutdown_connections 2023-11-13T11:29:30.487 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:30.474+0000 7fdc2b8fe640 1 -- 172.21.15.102:0/1221587463 wait complete. 2023-11-13T11:29:30.487 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:30.474+0000 7fdc2b8fe640 1 Processor -- start 2023-11-13T11:29:30.487 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:30.474+0000 7fdc2b8fe640 1 -- start start 2023-11-13T11:29:30.488 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:30.474+0000 7fdc2b8fe640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdc240b6fb0 0x7fdc24149e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:30.488 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:30.474+0000 7fdc2b8fe640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fdc24158ed0 0x7fdc240cc6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:30.488 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:30.474+0000 7fdc2b8fe640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fdc240ccc10 0x7fdc240b5a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:30.488 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:30.474+0000 7fdc2b8fe640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc240cb400 con 0x7fdc240ccc10 2023-11-13T11:29:30.488 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:30.474+0000 7fdc2b8fe640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc240b7390 con 0x7fdc240b6fb0 2023-11-13T11:29:30.489 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:30.474+0000 7fdc2b8fe640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdc2415dc80 con 0x7fdc24158ed0 2023-11-13T11:29:30.489 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:30.474+0000 7fdc29e9b640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fdc240ccc10 0x7fdc240b5a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:30.489 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:30.474+0000 7fdc29e9b640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fdc240ccc10 0x7fdc240b5a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:48202/0 (socket says 172.21.15.102:48202) 2023-11-13T11:29:30.489 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:30.474+0000 7fdc29e9b640 1 -- 172.21.15.102:0/1651587438 learned_addr learned my addr 172.21.15.102:0/1651587438 (peer_addr_for_me v2:172.21.15.102:0/0) 2023-11-13T11:29:30.489 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:30.474+0000 7fdc2969a640 1 --2- 172.21.15.102:0/1651587438 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdc240b6fb0 0x7fdc24149e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:30.490 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:30.474+0000 7fdc28e99640 1 --2- 172.21.15.102:0/1651587438 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fdc24158ed0 0x7fdc240cc6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:30.490 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:30.478+0000 7fdc29e9b640 1 -- 172.21.15.102:0/1651587438 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fdc24158ed0 msgr2=0x7fdc240cc6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:30.490 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:30.478+0000 7fdc29e9b640 1 --2- 172.21.15.102:0/1651587438 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fdc24158ed0 0x7fdc240cc6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:30.490 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:30.478+0000 7fdc29e9b640 1 -- 172.21.15.102:0/1651587438 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdc240b6fb0 msgr2=0x7fdc24149e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:30.490 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:30.478+0000 7fdc29e9b640 1 --2- 172.21.15.102:0/1651587438 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdc240b6fb0 0x7fdc24149e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:30.491 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:30.478+0000 7fdc29e9b640 1 -- 172.21.15.102:0/1651587438 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc240cb630 con 0x7fdc240ccc10 2023-11-13T11:29:30.491 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:30.478+0000 7fdc28e99640 1 --2- 172.21.15.102:0/1651587438 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fdc24158ed0 0x7fdc240cc6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-13T11:29:30.491 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:30.478+0000 7fdc29e9b640 1 --2- 172.21.15.102:0/1651587438 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fdc240ccc10 0x7fdc240b5a10 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fdc24160f20 tx=0x7fdc1c010590 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-13T11:29:30.491 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:30.478+0000 7fdc19ffb640 1 -- 172.21.15.102:0/1651587438 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc1c01b070 con 0x7fdc240ccc10 2023-11-13T11:29:30.491 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:30.478+0000 7fdc19ffb640 1 -- 172.21.15.102:0/1651587438 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc1c00f040 con 0x7fdc240ccc10 2023-11-13T11:29:30.492 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:30.478+0000 7fdc19ffb640 1 -- 172.21.15.102:0/1651587438 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc1c00e050 con 0x7fdc240ccc10 2023-11-13T11:29:30.492 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:30.478+0000 7fdc2b8fe640 1 -- 172.21.15.102:0/1651587438 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdc240cb910 con 0x7fdc240ccc10 2023-11-13T11:29:30.492 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:30.478+0000 7fdc2b8fe640 1 -- 172.21.15.102:0/1651587438 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdc240cbed0 con 0x7fdc240ccc10 2023-11-13T11:29:30.492 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:30.478+0000 7fdc2b8fe640 1 -- 172.21.15.102:0/1651587438 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdc2415ddf0 con 0x7fdc240ccc10 2023-11-13T11:29:30.492 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:30.478+0000 7fdc19ffb640 1 -- 172.21.15.102:0/1651587438 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fdc1c015440 con 0x7fdc240ccc10 2023-11-13T11:29:30.493 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:30.478+0000 7fdc19ffb640 1 --2- 172.21.15.102:0/1651587438 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7fdc08066470 0x7fdc08068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:30.493 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:30.482+0000 7fdc19ffb640 1 -- 172.21.15.102:0/1651587438 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fdc1c084250 con 0x7fdc240ccc10 2023-11-13T11:29:30.494 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:30.482+0000 7fdc2969a640 1 --2- 172.21.15.102:0/1651587438 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7fdc08066470 0x7fdc08068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:30.494 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:30.482+0000 7fdc2969a640 1 --2- 172.21.15.102:0/1651587438 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7fdc08066470 0x7fdc08068930 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fdc20009b00 tx=0x7fdc20009190 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-13T11:29:30.494 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:30.482+0000 7fdc19ffb640 1 -- 172.21.15.102:0/1651587438 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fdc1c0516c0 con 0x7fdc240ccc10 2023-11-13T11:29:30.640 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:30.634+0000 7fdc2b8fe640 1 -- 172.21.15.102:0/1651587438 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fdc24068520 con 0x7fdc240ccc10 2023-11-13T11:29:30.641 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:30.634+0000 7fdc19ffb640 1 -- 172.21.15.102:0/1651587438 <== mon.0 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v22) v1 ==== 93+0+10 (secure 0 0 0) 0x7fdc1c054ce0 con 0x7fdc240ccc10 2023-11-13T11:29:30.641 INFO:teuthology.orchestra.run.smithi102.stdout:pg_num: 1 2023-11-13T11:29:30.642 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:30.634+0000 7fdc2b8fe640 1 -- 172.21.15.102:0/1651587438 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7fdc08066470 msgr2=0x7fdc08068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:30.643 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:30.634+0000 7fdc2b8fe640 1 --2- 172.21.15.102:0/1651587438 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7fdc08066470 0x7fdc08068930 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fdc20009b00 tx=0x7fdc20009190 comp rx=0 tx=0).stop 2023-11-13T11:29:30.643 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:30.634+0000 7fdc2b8fe640 1 -- 172.21.15.102:0/1651587438 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fdc240ccc10 msgr2=0x7fdc240b5a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:30.643 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:30.634+0000 7fdc2b8fe640 1 --2- 172.21.15.102:0/1651587438 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fdc240ccc10 0x7fdc240b5a10 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fdc24160f20 tx=0x7fdc1c010590 comp rx=0 tx=0).stop 2023-11-13T11:29:30.643 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:30.634+0000 7fdc2b8fe640 1 -- 172.21.15.102:0/1651587438 shutdown_connections 2023-11-13T11:29:30.643 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:30.634+0000 7fdc2b8fe640 1 --2- 172.21.15.102:0/1651587438 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7fdc08066470 0x7fdc08068930 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:30.644 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:30.634+0000 7fdc2b8fe640 1 --2- 172.21.15.102:0/1651587438 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fdc240ccc10 0x7fdc240b5a10 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:30.644 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:30.634+0000 7fdc2b8fe640 1 --2- 172.21.15.102:0/1651587438 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fdc24158ed0 0x7fdc240cc6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:30.644 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:30.634+0000 7fdc2b8fe640 1 --2- 172.21.15.102:0/1651587438 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdc240b6fb0 0x7fdc24149e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:30.644 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:30.634+0000 7fdc2b8fe640 1 -- 172.21.15.102:0/1651587438 >> 172.21.15.102:0/1651587438 conn(0x7fdc240d2df0 msgr2=0x7fdc2406c220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-13T11:29:30.644 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:30.634+0000 7fdc2b8fe640 1 -- 172.21.15.102:0/1651587438 shutdown_connections 2023-11-13T11:29:30.644 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:30.634+0000 7fdc2b8fe640 1 -- 172.21.15.102:0/1651587438 wait complete. 2023-11-13T11:29:30.662 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-13T11:29:30.802 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:30.794+0000 7f36c7ac9640 1 Processor -- start 2023-11-13T11:29:30.803 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:30.794+0000 7f36c7ac9640 1 -- start start 2023-11-13T11:29:30.804 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:30.798+0000 7f36c7ac9640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f36c0159b30 0x7f36c006fc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:30.804 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:30.798+0000 7f36c7ac9640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f36c00cf2d0 0x7f36c00b3520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:30.804 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:30.798+0000 7f36c7ac9640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f36c0071620 con 0x7f36c00711c0 2023-11-13T11:29:30.804 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:30.798+0000 7f36c7ac9640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f36c00b21f0 con 0x7f36c00cf2d0 2023-11-13T11:29:30.805 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:30.798+0000 7f36c7ac9640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f36c00b2440 con 0x7f36c0159b30 2023-11-13T11:29:30.805 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:30.798+0000 7f36c5064640 1 --1- >> v1:172.21.15.102:6789/0 conn(0x7f36c00711c0 0x7f36c00cebc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.102:6789/0 says I am v1:172.21.15.102:36152/0 (socket says 172.21.15.102:36152) 2023-11-13T11:29:30.805 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:30.798+0000 7f36c5064640 1 -- 172.21.15.102:0/1147059510 learned_addr learned my addr 172.21.15.102:0/1147059510 (peer_addr_for_me v1:172.21.15.102:0/0) 2023-11-13T11:29:30.805 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:30.798+0000 7f36c6066640 1 --2- 172.21.15.102:0/1147059510 >> v2:172.21.15.102:3300/0 conn(0x7f36c00cf2d0 0x7f36c00b3520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:30.806 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:30.798+0000 7f36c5865640 1 --2- 172.21.15.102:0/1147059510 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f36c0159b30 0x7f36c006fc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:30.806 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:30.798+0000 7f36c4863640 1 -- 172.21.15.102:0/1147059510 <== mon.0 v1:172.21.15.102:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1034125329 0 0) 0x7f36b0001120 con 0x7f36c00711c0 2023-11-13T11:29:30.806 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:30.798+0000 7f36c6066640 1 -- 172.21.15.102:0/1147059510 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f36c0159b30 msgr2=0x7f36c006fc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-13T11:29:30.807 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:30.798+0000 7f36c6066640 1 --2- 172.21.15.102:0/1147059510 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f36c0159b30 0x7f36c006fc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:30.807 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:30.798+0000 7f36c6066640 1 -- 172.21.15.102:0/1147059510 >> v1:172.21.15.102:6789/0 conn(0x7f36c00711c0 legacy=0x7f36c00cebc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:30.807 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:30.798+0000 7f36c6066640 1 -- 172.21.15.102:0/1147059510 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36c00b2720 con 0x7f36c00cf2d0 2023-11-13T11:29:30.807 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:30.798+0000 7f36c5865640 1 --2- 172.21.15.102:0/1147059510 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f36c0159b30 0x7f36c006fc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-13T11:29:30.809 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:30.802+0000 7f36c6066640 1 --2- 172.21.15.102:0/1147059510 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f36c00cf2d0 0x7f36c00b3520 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f36b8009d90 tx=0x7f36b801c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b2651589cb409c12 server_cookie=0 in_seq=0 out_seq=0 2023-11-13T11:29:30.809 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:30.802+0000 7f36c4863640 1 -- 172.21.15.102:0/1147059510 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36b80a59e0 con 0x7f36c00cf2d0 2023-11-13T11:29:30.809 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:30.802+0000 7f36c4863640 1 -- 172.21.15.102:0/1147059510 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f36b80a5b40 con 0x7f36c00cf2d0 2023-11-13T11:29:30.809 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:30.802+0000 7f36c4863640 1 -- 172.21.15.102:0/1147059510 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36b80ad440 con 0x7f36c00cf2d0 2023-11-13T11:29:30.810 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:30.802+0000 7f36c7ac9640 1 -- 172.21.15.102:0/1147059510 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f36c00cf2d0 msgr2=0x7f36c00b3520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:30.810 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:30.802+0000 7f36c7ac9640 1 --2- 172.21.15.102:0/1147059510 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f36c00cf2d0 0x7f36c00b3520 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f36b8009d90 tx=0x7f36b801c920 comp rx=0 tx=0).stop 2023-11-13T11:29:30.810 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:30.802+0000 7f36c7ac9640 1 -- 172.21.15.102:0/1147059510 shutdown_connections 2023-11-13T11:29:30.810 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:30.802+0000 7f36c7ac9640 1 --2- 172.21.15.102:0/1147059510 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f36c00cf2d0 0x7f36c00b3520 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:30.810 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:30.802+0000 7f36c7ac9640 1 --2- 172.21.15.102:0/1147059510 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f36c0159b30 0x7f36c006fc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:30.811 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:30.802+0000 7f36c7ac9640 1 -- 172.21.15.102:0/1147059510 >> 172.21.15.102:0/1147059510 conn(0x7f36c006a410 msgr2=0x7f36c006a820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-13T11:29:30.811 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:30.802+0000 7f36c7ac9640 1 -- 172.21.15.102:0/1147059510 shutdown_connections 2023-11-13T11:29:30.811 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:30.802+0000 7f36c7ac9640 1 -- 172.21.15.102:0/1147059510 wait complete. 2023-11-13T11:29:30.813 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:30.802+0000 7f36c7ac9640 1 Processor -- start 2023-11-13T11:29:30.813 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:30.802+0000 7f36c7ac9640 1 -- start start 2023-11-13T11:29:30.813 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:30.806+0000 7f36c7ac9640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f36c00711c0 0x7f36c01557f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:30.813 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:30.806+0000 7f36c7ac9640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f36c00cf2d0 0x7f36c01422b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:30.814 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:30.806+0000 7f36c7ac9640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f36c0159b30 0x7f36c00ac8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:30.814 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:30.806+0000 7f36c7ac9640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36c0155360 con 0x7f36c00cf2d0 2023-11-13T11:29:30.814 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:30.806+0000 7f36c7ac9640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36c014ea80 con 0x7f36c00711c0 2023-11-13T11:29:30.814 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:30.806+0000 7f36c7ac9640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f36c01f6810 con 0x7f36c0159b30 2023-11-13T11:29:30.814 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:30.806+0000 7f36c5064640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f36c00cf2d0 0x7f36c01422b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:30.815 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:30.806+0000 7f36c5064640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f36c00cf2d0 0x7f36c01422b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:48218/0 (socket says 172.21.15.102:48218) 2023-11-13T11:29:30.815 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:30.806+0000 7f36c5064640 1 -- 172.21.15.102:0/256015046 learned_addr learned my addr 172.21.15.102:0/256015046 (peer_addr_for_me v2:172.21.15.102:0/0) 2023-11-13T11:29:30.815 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:30.806+0000 7f36c5064640 1 -- 172.21.15.102:0/256015046 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f36c0159b30 msgr2=0x7f36c00ac8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:30.815 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:30.806+0000 7f36c5064640 1 --2- 172.21.15.102:0/256015046 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f36c0159b30 0x7f36c00ac8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:30.815 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:30.806+0000 7f36c5064640 1 -- 172.21.15.102:0/256015046 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f36c00711c0 msgr2=0x7f36c01557f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:30.816 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:30.806+0000 7f36c5064640 1 --2- 172.21.15.102:0/256015046 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f36c00711c0 0x7f36c01557f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:30.816 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:30.806+0000 7f36c5064640 1 -- 172.21.15.102:0/256015046 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36b8009a70 con 0x7f36c00cf2d0 2023-11-13T11:29:30.816 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:30.806+0000 7f36c5064640 1 --2- 172.21.15.102:0/256015046 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f36c00cf2d0 0x7f36c01422b0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f36b000c780 tx=0x7f36b000cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-13T11:29:30.816 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:30.806+0000 7f36b67fc640 1 -- 172.21.15.102:0/256015046 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36b00072d0 con 0x7f36c00cf2d0 2023-11-13T11:29:30.816 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:30.806+0000 7f36b67fc640 1 -- 172.21.15.102:0/256015046 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f36b0007430 con 0x7f36c00cf2d0 2023-11-13T11:29:30.817 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:30.806+0000 7f36c7ac9640 1 -- 172.21.15.102:0/256015046 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f36c01f6530 con 0x7f36c00cf2d0 2023-11-13T11:29:30.817 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:30.806+0000 7f36b67fc640 1 -- 172.21.15.102:0/256015046 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36b00047f0 con 0x7f36c00cf2d0 2023-11-13T11:29:30.817 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:30.806+0000 7f36c7ac9640 1 -- 172.21.15.102:0/256015046 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f36c0154ff0 con 0x7f36c00cf2d0 2023-11-13T11:29:30.817 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:30.806+0000 7f36c7ac9640 1 -- 172.21.15.102:0/256015046 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f36c0067640 con 0x7f36c00cf2d0 2023-11-13T11:29:30.818 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:30.806+0000 7f36b67fc640 1 -- 172.21.15.102:0/256015046 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f36b0004950 con 0x7f36c00cf2d0 2023-11-13T11:29:30.818 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:30.810+0000 7f36b67fc640 1 --2- 172.21.15.102:0/256015046 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f36a4066470 0x7f36a4068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:30.818 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:30.810+0000 7f36b67fc640 1 -- 172.21.15.102:0/256015046 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f36b00832d0 con 0x7f36c00cf2d0 2023-11-13T11:29:30.819 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:30.810+0000 7f36c5865640 1 --2- 172.21.15.102:0/256015046 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f36a4066470 0x7f36a4068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:30.819 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:30.810+0000 7f36c5865640 1 --2- 172.21.15.102:0/256015046 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f36a4066470 0x7f36a4068930 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f36bc00a890 tx=0x7f36bc008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-13T11:29:30.819 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:30.814+0000 7f36b67fc640 1 -- 172.21.15.102:0/256015046 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f36b00506b0 con 0x7f36c00cf2d0 2023-11-13T11:29:30.970 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:30.962+0000 7f36c7ac9640 1 -- 172.21.15.102:0/256015046 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f36c0071620 con 0x7f36c00cf2d0 2023-11-13T11:29:30.971 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:30.966+0000 7f36b67fc640 1 -- 172.21.15.102:0/256015046 <== mon.0 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v22) v1 ==== 104+0+11 (secure 0 0 0) 0x7f36c0071620 con 0x7f36c00cf2d0 2023-11-13T11:29:30.972 INFO:teuthology.orchestra.run.smithi102.stdout:pg_num: 32 2023-11-13T11:29:30.973 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:30.966+0000 7f36c7ac9640 1 -- 172.21.15.102:0/256015046 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f36a4066470 msgr2=0x7f36a4068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:30.974 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:30.966+0000 7f36c7ac9640 1 --2- 172.21.15.102:0/256015046 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f36a4066470 0x7f36a4068930 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f36bc00a890 tx=0x7f36bc008040 comp rx=0 tx=0).stop 2023-11-13T11:29:30.974 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:30.966+0000 7f36c7ac9640 1 -- 172.21.15.102:0/256015046 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f36c00cf2d0 msgr2=0x7f36c01422b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:30.974 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:30.966+0000 7f36c7ac9640 1 --2- 172.21.15.102:0/256015046 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f36c00cf2d0 0x7f36c01422b0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f36b000c780 tx=0x7f36b000cc40 comp rx=0 tx=0).stop 2023-11-13T11:29:30.974 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:30.966+0000 7f36c7ac9640 1 -- 172.21.15.102:0/256015046 shutdown_connections 2023-11-13T11:29:30.975 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:30.966+0000 7f36c7ac9640 1 --2- 172.21.15.102:0/256015046 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f36c0159b30 0x7f36c00ac8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:30.975 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:30.966+0000 7f36c7ac9640 1 --2- 172.21.15.102:0/256015046 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f36a4066470 0x7f36a4068930 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:30.975 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:30.966+0000 7f36c7ac9640 1 --2- 172.21.15.102:0/256015046 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f36c00cf2d0 0x7f36c01422b0 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:30.975 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:30.966+0000 7f36c7ac9640 1 --2- 172.21.15.102:0/256015046 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f36c00711c0 0x7f36c01557f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:30.975 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:30.966+0000 7f36c7ac9640 1 -- 172.21.15.102:0/256015046 >> 172.21.15.102:0/256015046 conn(0x7f36c006a410 msgr2=0x7f36c0156870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-13T11:29:30.976 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:30.966+0000 7f36c7ac9640 1 -- 172.21.15.102:0/256015046 shutdown_connections 2023-11-13T11:29:30.976 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:30.966+0000 7f36c7ac9640 1 -- 172.21.15.102:0/256015046 wait complete. 2023-11-13T11:29:30.992 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-13T11:29:31.133 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:31.126+0000 7f2ab35df640 1 Processor -- start 2023-11-13T11:29:31.133 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:31.126+0000 7f2ab35df640 1 -- start start 2023-11-13T11:29:31.136 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:31.126+0000 7f2ab35df640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f2aac15d000 0x7f2aac06e540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:31.136 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:31.126+0000 7f2ab35df640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2aac06ccb0 0x7f2aac06d110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:31.137 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:31.126+0000 7f2ab35df640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f2aac0cff80 0x7f2aac0d03f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:31.137 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:31.126+0000 7f2ab35df640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2aac0ae610 con 0x7f2aac0cff80 2023-11-13T11:29:31.138 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:31.126+0000 7f2ab35df640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2aac0d0930 con 0x7f2aac15d000 2023-11-13T11:29:31.138 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:31.126+0000 7f2ab35df640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2aac15d3e0 con 0x7f2aac06ccb0 2023-11-13T11:29:31.139 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:31.126+0000 7f2ab1b7c640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f2aac0cff80 0x7f2aac0d03f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:31.139 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:31.126+0000 7f2ab1b7c640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f2aac0cff80 0x7f2aac0d03f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:48232/0 (socket says 172.21.15.102:48232) 2023-11-13T11:29:31.139 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:31.126+0000 7f2ab1b7c640 1 -- 172.21.15.102:0/2077527290 learned_addr learned my addr 172.21.15.102:0/2077527290 (peer_addr_for_me v2:172.21.15.102:0/0) 2023-11-13T11:29:31.139 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:31.130+0000 7f2ab1b7c640 1 -- 172.21.15.102:0/2077527290 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2aac06ccb0 msgr2=0x7f2aac06d110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-13T11:29:31.140 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:31.130+0000 7f2ab1b7c640 1 --2- 172.21.15.102:0/2077527290 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2aac06ccb0 0x7f2aac06d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:31.140 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:31.130+0000 7f2ab1b7c640 1 -- 172.21.15.102:0/2077527290 >> v2:172.21.15.154:3300/0 conn(0x7f2aac15d000 msgr2=0x7f2aac06e540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-13T11:29:31.140 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:31.130+0000 7f2ab1b7c640 1 --2- 172.21.15.102:0/2077527290 >> v2:172.21.15.154:3300/0 conn(0x7f2aac15d000 0x7f2aac06e540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:31.140 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:31.130+0000 7f2ab1b7c640 1 -- 172.21.15.102:0/2077527290 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2aac0cfa80 con 0x7f2aac0cff80 2023-11-13T11:29:31.144 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:31.130+0000 7f2ab1b7c640 1 --2- 172.21.15.102:0/2077527290 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2aac0cff80 0x7f2aac0d03f0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f2aac0d0aa0 tx=0x7f2aa401c9d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4ac2665b16937a96 server_cookie=0 in_seq=0 out_seq=0 2023-11-13T11:29:31.144 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:31.130+0000 7f2aa3fff640 1 -- 172.21.15.102:0/2077527290 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2aa40a5870 con 0x7f2aac0cff80 2023-11-13T11:29:31.144 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:31.130+0000 7f2aa3fff640 1 -- 172.21.15.102:0/2077527290 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2aa40a59d0 con 0x7f2aac0cff80 2023-11-13T11:29:31.144 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:31.130+0000 7f2aa3fff640 1 -- 172.21.15.102:0/2077527290 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2aa40a5d60 con 0x7f2aac0cff80 2023-11-13T11:29:31.145 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:31.130+0000 7f2ab35df640 1 -- 172.21.15.102:0/2077527290 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2aac0cff80 msgr2=0x7f2aac0d03f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:31.145 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:31.130+0000 7f2ab35df640 1 --2- 172.21.15.102:0/2077527290 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2aac0cff80 0x7f2aac0d03f0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f2aac0d0aa0 tx=0x7f2aa401c9d0 comp rx=0 tx=0).stop 2023-11-13T11:29:31.145 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:31.130+0000 7f2ab35df640 1 -- 172.21.15.102:0/2077527290 shutdown_connections 2023-11-13T11:29:31.145 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:31.130+0000 7f2ab35df640 1 --2- 172.21.15.102:0/2077527290 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2aac0cff80 0x7f2aac0d03f0 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:31.146 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:31.130+0000 7f2ab35df640 1 --2- 172.21.15.102:0/2077527290 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2aac06ccb0 0x7f2aac06d110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:31.146 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:31.130+0000 7f2ab35df640 1 --2- 172.21.15.102:0/2077527290 >> v2:172.21.15.154:3300/0 conn(0x7f2aac15d000 0x7f2aac06e540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:31.146 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:31.130+0000 7f2ab35df640 1 -- 172.21.15.102:0/2077527290 >> 172.21.15.102:0/2077527290 conn(0x7f2aac06b350 msgr2=0x7f2aac06b760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-13T11:29:31.146 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:31.134+0000 7f2ab35df640 1 -- 172.21.15.102:0/2077527290 shutdown_connections 2023-11-13T11:29:31.146 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:31.134+0000 7f2ab35df640 1 -- 172.21.15.102:0/2077527290 wait complete. 2023-11-13T11:29:31.147 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:31.134+0000 7f2ab35df640 1 Processor -- start 2023-11-13T11:29:31.147 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:31.134+0000 7f2ab35df640 1 -- start start 2023-11-13T11:29:31.147 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:31.134+0000 7f2ab35df640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2aac06ccb0 0x7f2aac0b18e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:31.147 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:31.134+0000 7f2ab35df640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2aac0cff80 0x7f2aac157480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:31.148 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:31.134+0000 7f2ab35df640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2aac15d000 0x7f2aac1579c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:31.148 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:31.134+0000 7f2ab35df640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2aac15d920 con 0x7f2aac06ccb0 2023-11-13T11:29:31.148 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:31.134+0000 7f2ab35df640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2aac1580d0 con 0x7f2aac15d000 2023-11-13T11:29:31.148 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:31.134+0000 7f2ab35df640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2aac1583b0 con 0x7f2aac0cff80 2023-11-13T11:29:31.148 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:31.134+0000 7f2ab137b640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2aac06ccb0 0x7f2aac0b18e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:31.149 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:31.134+0000 7f2ab137b640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2aac06ccb0 0x7f2aac0b18e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:48248/0 (socket says 172.21.15.102:48248) 2023-11-13T11:29:31.149 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:31.134+0000 7f2ab137b640 1 -- 172.21.15.102:0/2951816775 learned_addr learned my addr 172.21.15.102:0/2951816775 (peer_addr_for_me v2:172.21.15.102:0/0) 2023-11-13T11:29:31.149 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:31.134+0000 7f2ab1b7c640 1 --2- 172.21.15.102:0/2951816775 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2aac15d000 0x7f2aac1579c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:31.149 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:31.134+0000 7f2ab0b7a640 1 --2- 172.21.15.102:0/2951816775 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2aac0cff80 0x7f2aac157480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:31.149 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:31.134+0000 7f2ab137b640 1 -- 172.21.15.102:0/2951816775 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2aac0cff80 msgr2=0x7f2aac157480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:31.150 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:31.134+0000 7f2ab137b640 1 --2- 172.21.15.102:0/2951816775 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2aac0cff80 0x7f2aac157480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:31.150 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:31.134+0000 7f2ab137b640 1 -- 172.21.15.102:0/2951816775 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2aac15d000 msgr2=0x7f2aac1579c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:31.150 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:31.134+0000 7f2ab137b640 1 --2- 172.21.15.102:0/2951816775 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2aac15d000 0x7f2aac1579c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:31.150 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:31.134+0000 7f2ab137b640 1 -- 172.21.15.102:0/2951816775 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2aa4009b30 con 0x7f2aac06ccb0 2023-11-13T11:29:31.151 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:31.134+0000 7f2ab137b640 1 --2- 172.21.15.102:0/2951816775 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2aac06ccb0 0x7f2aac0b18e0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f2aa800b550 tx=0x7f2aa800ba10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-13T11:29:31.151 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:31.134+0000 7f2aa1ffb640 1 -- 172.21.15.102:0/2951816775 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2aa8010870 con 0x7f2aac06ccb0 2023-11-13T11:29:31.151 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:31.134+0000 7f2aa1ffb640 1 -- 172.21.15.102:0/2951816775 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2aa80109f0 con 0x7f2aac06ccb0 2023-11-13T11:29:31.151 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:31.134+0000 7f2aa1ffb640 1 -- 172.21.15.102:0/2951816775 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2aa8010da0 con 0x7f2aac06ccb0 2023-11-13T11:29:31.152 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:31.138+0000 7f2ab35df640 1 -- 172.21.15.102:0/2951816775 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2aac158690 con 0x7f2aac06ccb0 2023-11-13T11:29:31.152 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:31.138+0000 7f2ab35df640 1 -- 172.21.15.102:0/2951816775 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2aac158c50 con 0x7f2aac06ccb0 2023-11-13T11:29:31.152 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:31.138+0000 7f2ab35df640 1 -- 172.21.15.102:0/2951816775 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2aac067640 con 0x7f2aac06ccb0 2023-11-13T11:29:31.153 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:31.138+0000 7f2aa1ffb640 1 -- 172.21.15.102:0/2951816775 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f2aa800f3c0 con 0x7f2aac06ccb0 2023-11-13T11:29:31.153 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:31.138+0000 7f2aa1ffb640 1 --2- 172.21.15.102:0/2951816775 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f2a90066470 0x7f2a90068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:31.154 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:31.138+0000 7f2aa1ffb640 1 -- 172.21.15.102:0/2951816775 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f2aa8083f80 con 0x7f2aac06ccb0 2023-11-13T11:29:31.154 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:31.138+0000 7f2ab0b7a640 1 --2- 172.21.15.102:0/2951816775 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f2a90066470 0x7f2a90068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:31.154 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:31.138+0000 7f2ab0b7a640 1 --2- 172.21.15.102:0/2951816775 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f2a90066470 0x7f2a90068930 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f2a9c006fd0 tx=0x7f2a9c008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-13T11:29:31.154 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:31.142+0000 7f2aa1ffb640 1 -- 172.21.15.102:0/2951816775 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f2aa8051360 con 0x7f2aac06ccb0 2023-11-13T11:29:31.297 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:31.290+0000 7f2ab35df640 1 -- 172.21.15.102:0/2951816775 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f2aac158e40 con 0x7f2aac06ccb0 2023-11-13T11:29:31.298 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:31.290+0000 7f2aa1ffb640 1 -- 172.21.15.102:0/2951816775 <== mon.0 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v22) v1 ==== 100+0+11 (secure 0 0 0) 0x7f2aa8054980 con 0x7f2aac06ccb0 2023-11-13T11:29:31.299 INFO:teuthology.orchestra.run.smithi102.stdout:pg_num: 64 2023-11-13T11:29:31.300 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:31.294+0000 7f2ab35df640 1 -- 172.21.15.102:0/2951816775 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f2a90066470 msgr2=0x7f2a90068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:31.300 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:31.294+0000 7f2ab35df640 1 --2- 172.21.15.102:0/2951816775 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f2a90066470 0x7f2a90068930 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f2a9c006fd0 tx=0x7f2a9c008040 comp rx=0 tx=0).stop 2023-11-13T11:29:31.300 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:31.294+0000 7f2ab35df640 1 -- 172.21.15.102:0/2951816775 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2aac06ccb0 msgr2=0x7f2aac0b18e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:31.301 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:31.294+0000 7f2ab35df640 1 --2- 172.21.15.102:0/2951816775 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2aac06ccb0 0x7f2aac0b18e0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f2aa800b550 tx=0x7f2aa800ba10 comp rx=0 tx=0).stop 2023-11-13T11:29:31.301 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:31.294+0000 7f2ab35df640 1 -- 172.21.15.102:0/2951816775 shutdown_connections 2023-11-13T11:29:31.301 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:31.294+0000 7f2ab35df640 1 --2- 172.21.15.102:0/2951816775 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2aac15d000 0x7f2aac1579c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:31.301 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:31.294+0000 7f2ab35df640 1 --2- 172.21.15.102:0/2951816775 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2aac0cff80 0x7f2aac157480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:31.301 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:31.294+0000 7f2ab35df640 1 --2- 172.21.15.102:0/2951816775 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f2a90066470 0x7f2a90068930 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:31.302 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:31.294+0000 7f2ab35df640 1 --2- 172.21.15.102:0/2951816775 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2aac06ccb0 0x7f2aac0b18e0 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:31.302 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:31.294+0000 7f2ab35df640 1 -- 172.21.15.102:0/2951816775 >> 172.21.15.102:0/2951816775 conn(0x7f2aac06b350 msgr2=0x7f2aac160ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-13T11:29:31.302 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:31.294+0000 7f2ab35df640 1 -- 172.21.15.102:0/2951816775 shutdown_connections 2023-11-13T11:29:31.302 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:31.294+0000 7f2ab35df640 1 -- 172.21.15.102:0/2951816775 wait complete. 2023-11-13T11:29:31.319 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-11-13T11:29:31.459 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:31.454+0000 7fc1c4479640 1 Processor -- start 2023-11-13T11:29:31.459 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:31.454+0000 7fc1c4479640 1 -- start start 2023-11-13T11:29:31.461 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:31.454+0000 7fc1c4479640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fc1bc06a4a0 0x7fc1bc0aec50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:31.461 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:31.454+0000 7fc1c4479640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc1bc06a880 0x7fc1bc0af190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:31.461 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:31.454+0000 7fc1c4479640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc1bc0b2fc0 con 0x7fc1bc15c960 2023-11-13T11:29:31.462 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:31.454+0000 7fc1c4479640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc1bc15d4e0 con 0x7fc1bc06a4a0 2023-11-13T11:29:31.462 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:31.454+0000 7fc1c4479640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc1bc06d8a0 con 0x7fc1bc06a880 2023-11-13T11:29:31.462 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:31.454+0000 7fc1c2a16640 1 --1- >> v1:172.21.15.102:6789/0 conn(0x7fc1bc15c960 0x7fc1bc15cdd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.102:6789/0 says I am v1:172.21.15.102:36162/0 (socket says 172.21.15.102:36162) 2023-11-13T11:29:31.462 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:31.454+0000 7fc1c2a16640 1 -- 172.21.15.102:0/4272363094 learned_addr learned my addr 172.21.15.102:0/4272363094 (peer_addr_for_me v1:172.21.15.102:0/0) 2023-11-13T11:29:31.462 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:31.454+0000 7fc1c2215640 1 --2- 172.21.15.102:0/4272363094 >> v2:172.21.15.154:3300/0 conn(0x7fc1bc06a4a0 0x7fc1bc0aec50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:31.463 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:31.454+0000 7fc1c1a14640 1 --2- 172.21.15.102:0/4272363094 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc1bc06a880 0x7fc1bc0af190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:31.463 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:31.454+0000 7fc1c1213640 1 -- 172.21.15.102:0/4272363094 <== mon.0 v1:172.21.15.102:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 731394116 0 0) 0x7fc1bc0b2fc0 con 0x7fc1bc15c960 2023-11-13T11:29:31.463 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:31.454+0000 7fc1c1213640 1 -- 172.21.15.102:0/4272363094 --> v1:172.21.15.102:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc1a8003530 con 0x7fc1bc15c960 2023-11-13T11:29:31.463 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:31.454+0000 7fc1c2215640 1 -- 172.21.15.102:0/4272363094 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc1bc06a880 msgr2=0x7fc1bc0af190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-13T11:29:31.464 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:31.454+0000 7fc1c2215640 1 --2- 172.21.15.102:0/4272363094 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc1bc06a880 0x7fc1bc0af190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:31.464 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:31.454+0000 7fc1c2215640 1 -- 172.21.15.102:0/4272363094 >> v1:172.21.15.102:6789/0 conn(0x7fc1bc15c960 legacy=0x7fc1bc15cdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:31.464 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:31.454+0000 7fc1c2215640 1 -- 172.21.15.102:0/4272363094 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1bc15d6f0 con 0x7fc1bc06a4a0 2023-11-13T11:29:31.466 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:31.458+0000 7fc1c2215640 1 --2- 172.21.15.102:0/4272363094 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc1bc06a4a0 0x7fc1bc0aec50 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fc1b80097c0 tx=0x7fc1b801c3f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=958035e2d2a52183 server_cookie=0 in_seq=0 out_seq=0 2023-11-13T11:29:31.466 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:31.458+0000 7fc1c1213640 1 -- 172.21.15.102:0/4272363094 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1b80ab600 con 0x7fc1bc06a4a0 2023-11-13T11:29:31.466 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:31.458+0000 7fc1c1213640 1 -- 172.21.15.102:0/4272363094 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc1b80a7050 con 0x7fc1bc06a4a0 2023-11-13T11:29:31.467 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:31.458+0000 7fc1c1213640 1 -- 172.21.15.102:0/4272363094 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1b80ab960 con 0x7fc1bc06a4a0 2023-11-13T11:29:31.467 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:31.458+0000 7fc1c4479640 1 -- 172.21.15.102:0/4272363094 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc1bc06a4a0 msgr2=0x7fc1bc0aec50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:31.467 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:31.458+0000 7fc1c4479640 1 --2- 172.21.15.102:0/4272363094 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc1bc06a4a0 0x7fc1bc0aec50 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fc1b80097c0 tx=0x7fc1b801c3f0 comp rx=0 tx=0).stop 2023-11-13T11:29:31.467 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:31.458+0000 7fc1c4479640 1 -- 172.21.15.102:0/4272363094 shutdown_connections 2023-11-13T11:29:31.467 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:31.458+0000 7fc1c4479640 1 --2- 172.21.15.102:0/4272363094 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc1bc06a880 0x7fc1bc0af190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:31.468 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:31.458+0000 7fc1c4479640 1 --2- 172.21.15.102:0/4272363094 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc1bc06a4a0 0x7fc1bc0aec50 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:31.468 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:31.458+0000 7fc1c4479640 1 -- 172.21.15.102:0/4272363094 >> 172.21.15.102:0/4272363094 conn(0x7fc1bc06b350 msgr2=0x7fc1bc06b760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-13T11:29:31.468 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:31.458+0000 7fc1c4479640 1 -- 172.21.15.102:0/4272363094 shutdown_connections 2023-11-13T11:29:31.468 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:31.458+0000 7fc1c4479640 1 -- 172.21.15.102:0/4272363094 wait complete. 2023-11-13T11:29:31.470 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:31.462+0000 7fc1c4479640 1 Processor -- start 2023-11-13T11:29:31.470 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:31.462+0000 7fc1c4479640 1 -- start start 2023-11-13T11:29:31.471 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:31.462+0000 7fc1c4479640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc1bc06a4a0 0x7fc1bc06e3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:31.471 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:31.462+0000 7fc1c4479640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc1bc06a880 0x7fc1bc161bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:31.471 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:31.462+0000 7fc1c4479640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc1bc15c960 0x7fc1bc15a480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:31.471 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:31.462+0000 7fc1c4479640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1bc15a9c0 con 0x7fc1bc06a880 2023-11-13T11:29:31.471 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:31.462+0000 7fc1c4479640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1bc156450 con 0x7fc1bc06a4a0 2023-11-13T11:29:31.472 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:31.462+0000 7fc1c4479640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc1bc15aba0 con 0x7fc1bc15c960 2023-11-13T11:29:31.472 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:31.462+0000 7fc1c1a14640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc1bc06a880 0x7fc1bc161bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:31.472 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:31.462+0000 7fc1c1a14640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc1bc06a880 0x7fc1bc161bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:48250/0 (socket says 172.21.15.102:48250) 2023-11-13T11:29:31.472 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:31.462+0000 7fc1c1a14640 1 -- 172.21.15.102:0/1856242972 learned_addr learned my addr 172.21.15.102:0/1856242972 (peer_addr_for_me v2:172.21.15.102:0/0) 2023-11-13T11:29:31.473 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:31.462+0000 7fc1c1a14640 1 -- 172.21.15.102:0/1856242972 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc1bc15c960 msgr2=0x7fc1bc15a480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:31.473 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:31.462+0000 7fc1c2a16640 1 --2- 172.21.15.102:0/1856242972 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc1bc15c960 0x7fc1bc15a480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:31.473 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:31.462+0000 7fc1c2215640 1 --2- 172.21.15.102:0/1856242972 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc1bc06a4a0 0x7fc1bc06e3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:31.473 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:31.462+0000 7fc1c1a14640 1 --2- 172.21.15.102:0/1856242972 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc1bc15c960 0x7fc1bc15a480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:31.473 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:31.462+0000 7fc1c1a14640 1 -- 172.21.15.102:0/1856242972 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc1bc06a4a0 msgr2=0x7fc1bc06e3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:31.474 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:31.462+0000 7fc1c1a14640 1 --2- 172.21.15.102:0/1856242972 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc1bc06a4a0 0x7fc1bc06e3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:31.474 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:31.462+0000 7fc1c1a14640 1 -- 172.21.15.102:0/1856242972 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1b8009420 con 0x7fc1bc06a880 2023-11-13T11:29:31.474 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:31.462+0000 7fc1c2a16640 1 --2- 172.21.15.102:0/1856242972 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc1bc15c960 0x7fc1bc15a480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-13T11:29:31.474 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:31.462+0000 7fc1c2215640 1 --2- 172.21.15.102:0/1856242972 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc1bc06a4a0 0x7fc1bc06e3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-13T11:29:31.475 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:31.462+0000 7fc1c1a14640 1 --2- 172.21.15.102:0/1856242972 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc1bc06a880 0x7fc1bc161bc0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fc1ac00e930 tx=0x7fc1ac00edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-13T11:29:31.475 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:31.462+0000 7fc1b2ffd640 1 -- 172.21.15.102:0/1856242972 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1ac009690 con 0x7fc1bc06a880 2023-11-13T11:29:31.475 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:31.462+0000 7fc1b2ffd640 1 -- 172.21.15.102:0/1856242972 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc1ac00ca00 con 0x7fc1bc06a880 2023-11-13T11:29:31.475 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:31.462+0000 7fc1b2ffd640 1 -- 172.21.15.102:0/1856242972 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1ac00cd70 con 0x7fc1bc06a880 2023-11-13T11:29:31.475 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:31.462+0000 7fc1c4479640 1 -- 172.21.15.102:0/1856242972 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc1bc15ae80 con 0x7fc1bc06a880 2023-11-13T11:29:31.476 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:31.462+0000 7fc1c4479640 1 -- 172.21.15.102:0/1856242972 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc1bc15b440 con 0x7fc1bc06a880 2023-11-13T11:29:31.477 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:31.466+0000 7fc1c4479640 1 -- 172.21.15.102:0/1856242972 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc1bc067680 con 0x7fc1bc06a880 2023-11-13T11:29:31.477 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:31.466+0000 7fc1b2ffd640 1 -- 172.21.15.102:0/1856242972 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fc1ac013470 con 0x7fc1bc06a880 2023-11-13T11:29:31.477 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:31.466+0000 7fc1b2ffd640 1 --2- 172.21.15.102:0/1856242972 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7fc1a00664a0 0x7fc1a0068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:31.477 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:31.466+0000 7fc1b2ffd640 1 -- 172.21.15.102:0/1856242972 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc1ac0841c0 con 0x7fc1bc06a880 2023-11-13T11:29:31.477 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:31.466+0000 7fc1c2215640 1 --2- 172.21.15.102:0/1856242972 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7fc1a00664a0 0x7fc1a0068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:31.478 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:31.466+0000 7fc1c2215640 1 --2- 172.21.15.102:0/1856242972 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7fc1a00664a0 0x7fc1a0068960 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fc1b80ad000 tx=0x7fc1b80a6000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-13T11:29:31.478 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:31.470+0000 7fc1b2ffd640 1 -- 172.21.15.102:0/1856242972 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fc1ac051660 con 0x7fc1bc06a880 2023-11-13T11:29:31.640 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:31.634+0000 7fc1c4479640 1 -- 172.21.15.102:0/1856242972 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fc1bc156610 con 0x7fc1bc06a880 2023-11-13T11:29:31.640 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:31.634+0000 7fc1b2ffd640 1 -- 172.21.15.102:0/1856242972 <== mon.0 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v22) v1 ==== 80+0+0 (secure 0 0 0) 0x7fc1ac054c80 con 0x7fc1bc06a880 2023-11-13T11:29:31.641 INFO:teuthology.orchestra.run.smithi102.stderr:listed 0 entries 2023-11-13T11:29:31.642 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:31.634+0000 7fc1c4479640 1 -- 172.21.15.102:0/1856242972 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7fc1a00664a0 msgr2=0x7fc1a0068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:31.643 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:31.634+0000 7fc1c4479640 1 --2- 172.21.15.102:0/1856242972 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7fc1a00664a0 0x7fc1a0068960 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fc1b80ad000 tx=0x7fc1b80a6000 comp rx=0 tx=0).stop 2023-11-13T11:29:31.643 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:31.634+0000 7fc1c4479640 1 -- 172.21.15.102:0/1856242972 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc1bc06a880 msgr2=0x7fc1bc161bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:31.643 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:31.634+0000 7fc1c4479640 1 --2- 172.21.15.102:0/1856242972 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc1bc06a880 0x7fc1bc161bc0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fc1ac00e930 tx=0x7fc1ac00edf0 comp rx=0 tx=0).stop 2023-11-13T11:29:31.643 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:31.634+0000 7fc1c4479640 1 -- 172.21.15.102:0/1856242972 shutdown_connections 2023-11-13T11:29:31.643 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:31.634+0000 7fc1c4479640 1 --2- 172.21.15.102:0/1856242972 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc1bc15c960 0x7fc1bc15a480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:31.644 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:31.634+0000 7fc1c4479640 1 --2- 172.21.15.102:0/1856242972 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7fc1a00664a0 0x7fc1a0068960 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:31.644 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:31.634+0000 7fc1c4479640 1 --2- 172.21.15.102:0/1856242972 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc1bc06a880 0x7fc1bc161bc0 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:31.644 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:31.634+0000 7fc1c4479640 1 --2- 172.21.15.102:0/1856242972 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc1bc06a4a0 0x7fc1bc06e3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:31.644 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:31.634+0000 7fc1c4479640 1 -- 172.21.15.102:0/1856242972 >> 172.21.15.102:0/1856242972 conn(0x7fc1bc06b350 msgr2=0x7fc1bc0b1800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-13T11:29:31.645 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:31.634+0000 7fc1c4479640 1 -- 172.21.15.102:0/1856242972 shutdown_connections 2023-11-13T11:29:31.645 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:31.634+0000 7fc1c4479640 1 -- 172.21.15.102:0/1856242972 wait complete. 2023-11-13T11:29:31.661 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi102.front.sepia.ceph.com... 2023-11-13T11:29:31.662 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-13T11:29:31.662 DEBUG:teuthology.orchestra.run.smithi102:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2023-11-13T11:29:31.700 INFO:teuthology.orchestra.run:waiting for 300 2023-11-13T11:29:31.701 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi102.front.sepia.ceph.com 2023-11-13T11:29:31.701 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-13T11:29:31.701 DEBUG:teuthology.orchestra.run.smithi102:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-11-13T11:29:31.773 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2023-11-13T11:29:31.774 DEBUG:teuthology.orchestra.run.smithi154:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-13T11:29:31.784 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2023-11-13T11:29:31.784 DEBUG:teuthology.orchestra.run.smithi154:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-13T11:29:31.836 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-13T11:29:31.973 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:31.966+0000 7f9a4759e640 1 Processor -- start 2023-11-13T11:29:31.974 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:31.966+0000 7f9a4759e640 1 -- start start 2023-11-13T11:29:31.976 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:31.966+0000 7f9a4759e640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f9a48143500 0x7f9a4815aa80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:31.976 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:31.966+0000 7f9a4759e640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f9a4806cbf0 0x7f9a4806d0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:31.976 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:31.966+0000 7f9a4759e640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9a4815d5f0 0x7f9a4815da40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:31.976 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:31.966+0000 7f9a4759e640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9a4806d5e0 con 0x7f9a48143500 2023-11-13T11:29:31.976 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:31.966+0000 7f9a4759e640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9a4815afc0 con 0x7f9a4806cbf0 2023-11-13T11:29:31.977 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:31.966+0000 7f9a4759e640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a480b38e0 con 0x7f9a4815d5f0 2023-11-13T11:29:31.977 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:31.966+0000 7f9a4659c640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f9a48143500 0x7f9a4815aa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:31.977 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:31.966+0000 7f9a4659c640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f9a48143500 0x7f9a4815aa80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:48254/0 (socket says 172.21.15.102:48254) 2023-11-13T11:29:31.977 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:31.966+0000 7f9a4659c640 1 -- 172.21.15.102:0/3877802999 learned_addr learned my addr 172.21.15.102:0/3877802999 (peer_addr_for_me v2:172.21.15.102:0/0) 2023-11-13T11:29:31.978 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:31.970+0000 7f9a46d9d640 1 --2- 172.21.15.102:0/3877802999 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9a4815d5f0 0x7f9a4815da40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:31.978 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:31.970+0000 7f9a3dd9b640 1 --2- 172.21.15.102:0/3877802999 >> v2:172.21.15.154:3300/0 conn(0x7f9a4806cbf0 0x7f9a4806d0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:31.978 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:31.970+0000 7f9a4659c640 1 -- 172.21.15.102:0/3877802999 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9a4815d5f0 msgr2=0x7f9a4815da40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-13T11:29:31.978 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:31.970+0000 7f9a4659c640 1 --2- 172.21.15.102:0/3877802999 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9a4815d5f0 0x7f9a4815da40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:31.978 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:31.970+0000 7f9a4659c640 1 -- 172.21.15.102:0/3877802999 >> v2:172.21.15.154:3300/0 conn(0x7f9a4806cbf0 msgr2=0x7f9a4806d0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-13T11:29:31.979 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:31.970+0000 7f9a4659c640 1 --2- 172.21.15.102:0/3877802999 >> v2:172.21.15.154:3300/0 conn(0x7f9a4806cbf0 0x7f9a4806d0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:31.979 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:31.970+0000 7f9a4659c640 1 -- 172.21.15.102:0/3877802999 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a480710e0 con 0x7f9a48143500 2023-11-13T11:29:31.979 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:31.970+0000 7f9a3dd9b640 1 --2- 172.21.15.102:0/3877802999 >> v2:172.21.15.154:3300/0 conn(0x7f9a4806cbf0 0x7f9a4806d0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-13T11:29:31.979 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:31.970+0000 7f9a46d9d640 1 --2- 172.21.15.102:0/3877802999 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9a4815d5f0 0x7f9a4815da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-13T11:29:31.983 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:31.970+0000 7f9a4659c640 1 --2- 172.21.15.102:0/3877802999 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9a48143500 0x7f9a4815aa80 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f9a480b0620 tx=0x7f9a3801e6e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=777c26ab11ae713c server_cookie=0 in_seq=0 out_seq=0 2023-11-13T11:29:31.984 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:31.970+0000 7f9a45d9b640 1 -- 172.21.15.102:0/3877802999 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a380a8670 con 0x7f9a48143500 2023-11-13T11:29:31.984 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:31.970+0000 7f9a45d9b640 1 -- 172.21.15.102:0/3877802999 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a380a87d0 con 0x7f9a48143500 2023-11-13T11:29:31.984 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:31.970+0000 7f9a45d9b640 1 -- 172.21.15.102:0/3877802999 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a380a8b60 con 0x7f9a48143500 2023-11-13T11:29:31.984 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:31.974+0000 7f9a4759e640 1 -- 172.21.15.102:0/3877802999 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9a48143500 msgr2=0x7f9a4815aa80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:31.985 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:31.974+0000 7f9a4759e640 1 --2- 172.21.15.102:0/3877802999 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9a48143500 0x7f9a4815aa80 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f9a480b0620 tx=0x7f9a3801e6e0 comp rx=0 tx=0).stop 2023-11-13T11:29:31.985 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:31.974+0000 7f9a4759e640 1 -- 172.21.15.102:0/3877802999 shutdown_connections 2023-11-13T11:29:31.985 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:31.974+0000 7f9a4759e640 1 --2- 172.21.15.102:0/3877802999 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9a4815d5f0 0x7f9a4815da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:31.985 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:31.974+0000 7f9a4759e640 1 --2- 172.21.15.102:0/3877802999 >> v2:172.21.15.154:3300/0 conn(0x7f9a4806cbf0 0x7f9a4806d0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:31.986 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:31.974+0000 7f9a4759e640 1 --2- 172.21.15.102:0/3877802999 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9a48143500 0x7f9a4815aa80 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:31.986 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:31.974+0000 7f9a4759e640 1 -- 172.21.15.102:0/3877802999 >> 172.21.15.102:0/3877802999 conn(0x7f9a480b0690 msgr2=0x7f9a480b0aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-13T11:29:31.986 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:31.974+0000 7f9a4759e640 1 -- 172.21.15.102:0/3877802999 shutdown_connections 2023-11-13T11:29:31.987 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:31.974+0000 7f9a4759e640 1 -- 172.21.15.102:0/3877802999 wait complete. 2023-11-13T11:29:31.987 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:31.974+0000 7f9a4759e640 1 Processor -- start 2023-11-13T11:29:31.987 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:31.974+0000 7f9a4759e640 1 -- start start 2023-11-13T11:29:31.987 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:31.974+0000 7f9a4759e640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9a4806cbf0 0x7f9a48141ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:31.988 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:31.974+0000 7f9a4759e640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9a4815d5f0 0x7f9a4813e040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:31.988 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:31.974+0000 7f9a4759e640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9a48158730 0x7f9a4813eb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:31.988 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:31.974+0000 7f9a4759e640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a4813dbb0 con 0x7f9a4806cbf0 2023-11-13T11:29:31.988 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:31.974+0000 7f9a4759e640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a4813f060 con 0x7f9a4815d5f0 2023-11-13T11:29:31.989 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:31.974+0000 7f9a4759e640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a48158bc0 con 0x7f9a48158730 2023-11-13T11:29:31.989 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:31.974+0000 7f9a4659c640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9a4806cbf0 0x7f9a48141ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:31.989 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:31.974+0000 7f9a4659c640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9a4806cbf0 0x7f9a48141ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:48260/0 (socket says 172.21.15.102:48260) 2023-11-13T11:29:31.989 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:31.974+0000 7f9a4659c640 1 -- 172.21.15.102:0/2580083815 learned_addr learned my addr 172.21.15.102:0/2580083815 (peer_addr_for_me v2:172.21.15.102:0/0) 2023-11-13T11:29:31.990 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:31.974+0000 7f9a46d9d640 1 --2- 172.21.15.102:0/2580083815 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9a48158730 0x7f9a4813eb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:31.990 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:31.974+0000 7f9a3dd9b640 1 --2- 172.21.15.102:0/2580083815 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9a4815d5f0 0x7f9a4813e040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:31.990 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:31.978+0000 7f9a4659c640 1 -- 172.21.15.102:0/2580083815 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9a48158730 msgr2=0x7f9a4813eb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:31.990 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:31.978+0000 7f9a4659c640 1 --2- 172.21.15.102:0/2580083815 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9a48158730 0x7f9a4813eb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:31.991 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:31.978+0000 7f9a4659c640 1 -- 172.21.15.102:0/2580083815 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9a4815d5f0 msgr2=0x7f9a4813e040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:31.991 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:31.978+0000 7f9a4659c640 1 --2- 172.21.15.102:0/2580083815 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9a4815d5f0 0x7f9a4813e040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:31.991 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:31.978+0000 7f9a4659c640 1 -- 172.21.15.102:0/2580083815 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a380094d0 con 0x7f9a4806cbf0 2023-11-13T11:29:31.991 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:31.978+0000 7f9a4659c640 1 --2- 172.21.15.102:0/2580083815 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9a4806cbf0 0x7f9a48141ff0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f9a38024c90 tx=0x7f9a3801b480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-13T11:29:31.992 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:31.978+0000 7f9a3f7fe640 1 -- 172.21.15.102:0/2580083815 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a380b3860 con 0x7f9a4806cbf0 2023-11-13T11:29:31.992 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:31.978+0000 7f9a3f7fe640 1 -- 172.21.15.102:0/2580083815 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a380b39c0 con 0x7f9a4806cbf0 2023-11-13T11:29:31.992 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:31.978+0000 7f9a4759e640 1 -- 172.21.15.102:0/2580083815 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9a481425d0 con 0x7f9a4806cbf0 2023-11-13T11:29:31.992 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:31.978+0000 7f9a3f7fe640 1 -- 172.21.15.102:0/2580083815 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a380b3d70 con 0x7f9a4806cbf0 2023-11-13T11:29:31.992 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:31.978+0000 7f9a4759e640 1 -- 172.21.15.102:0/2580083815 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9a4813d560 con 0x7f9a4806cbf0 2023-11-13T11:29:31.994 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:31.978+0000 7f9a4759e640 1 -- 172.21.15.102:0/2580083815 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9a48068520 con 0x7f9a4806cbf0 2023-11-13T11:29:31.994 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:31.978+0000 7f9a3f7fe640 1 -- 172.21.15.102:0/2580083815 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f9a380a9450 con 0x7f9a4806cbf0 2023-11-13T11:29:31.994 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:31.978+0000 7f9a3f7fe640 1 --2- 172.21.15.102:0/2580083815 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f9a28066470 0x7f9a28068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:31.994 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:31.978+0000 7f9a3f7fe640 1 -- 172.21.15.102:0/2580083815 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f9a3811e620 con 0x7f9a4806cbf0 2023-11-13T11:29:31.995 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:31.978+0000 7f9a3dd9b640 1 --2- 172.21.15.102:0/2580083815 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f9a28066470 0x7f9a28068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:31.995 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:31.982+0000 7f9a3dd9b640 1 --2- 172.21.15.102:0/2580083815 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f9a28066470 0x7f9a28068930 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f9a480ce2f0 tx=0x7f9a300079c0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-13T11:29:31.995 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:31.982+0000 7f9a3f7fe640 1 -- 172.21.15.102:0/2580083815 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f9a380ebbe0 con 0x7f9a4806cbf0 2023-11-13T11:29:32.140 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:32.134+0000 7f9a4759e640 1 -- 172.21.15.102:0/2580083815 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f9a48159da0 con 0x7f9a4806cbf0 2023-11-13T11:29:32.141 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:32.134+0000 7f9a3f7fe640 1 -- 172.21.15.102:0/2580083815 <== mon.0 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+16545 (secure 0 0 0) 0x7f9a380ef200 con 0x7f9a4806cbf0 2023-11-13T11:29:32.142 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T11:29:32.142 INFO:teuthology.orchestra.run.smithi102.stdout:{"epoch":22,"fsid":"97b3eb2b-7ccf-4aae-8d92-bff986c671ea","created":"2023-11-13T11:28:31.836724+0000","modified":"2023-11-13T11:28:58.608314+0000","last_up_change":"2023-11-13T11:28:44.876638+0000","last_in_change":"2023-11-13T11:28:35.312740+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-13T11:28:44.981356+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-13T11:28:55.958525+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-13T11:28:56.394264+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"bdefaa17-fcca-4c86-aa40-27dc33a789af","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6800","nonce":53303834},{"type":"v1","addr":"172.21.15.102:6801","nonce":53303834}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6802","nonce":53303834},{"type":"v1","addr":"172.21.15.102:6803","nonce":53303834}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6806","nonce":53303834},{"type":"v1","addr":"172.21.15.102:6807","nonce":53303834}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6804","nonce":53303834},{"type":"v1","addr":"172.21.15.102:6805","nonce":53303834}]},"public_addr":"172.21.15.102:6801/53303834","cluster_addr":"172.21.15.102:6803/53303834","heartbeat_back_addr":"172.21.15.102:6807/53303834","heartbeat_front_addr":"172.21.15.102:6805/53303834","state":["exists","up"]},{"osd":1,"uuid":"f0033196-dec9-4ae9-945e-6aeef6dbb47f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6808","nonce":1732708348},{"type":"v1","addr":"172.21.15.102:6809","nonce":1732708348}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6811","nonce":1732708348},{"type":"v1","addr":"172.21.15.102:6813","nonce":1732708348}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6818","nonce":1732708348},{"type":"v1","addr":"172.21.15.102:6820","nonce":1732708348}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6815","nonce":1732708348},{"type":"v1","addr":"172.21.15.102:6817","nonce":1732708348}]},"public_addr":"172.21.15.102:6809/1732708348","cluster_addr":"172.21.15.102:6813/1732708348","heartbeat_back_addr":"172.21.15.102:6820/1732708348","heartbeat_front_addr":"172.21.15.102:6817/1732708348","state":["exists","up"]},{"osd":2,"uuid":"496b0834-351e-4ec2-a714-86ed0c0ff4fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6810","nonce":1825475150},{"type":"v1","addr":"172.21.15.102:6812","nonce":1825475150}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6814","nonce":1825475150},{"type":"v1","addr":"172.21.15.102:6816","nonce":1825475150}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6822","nonce":1825475150},{"type":"v1","addr":"172.21.15.102:6823","nonce":1825475150}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6819","nonce":1825475150},{"type":"v1","addr":"172.21.15.102:6821","nonce":1825475150}]},"public_addr":"172.21.15.102:6812/1825475150","cluster_addr":"172.21.15.102:6816/1825475150","heartbeat_back_addr":"172.21.15.102:6823/1825475150","heartbeat_front_addr":"172.21.15.102:6821/1825475150","state":["exists","up"]},{"osd":3,"uuid":"3ba6cc41-e0a0-4273-86cb-90000c06a55a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6824","nonce":4149355528},{"type":"v1","addr":"172.21.15.102:6825","nonce":4149355528}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6826","nonce":4149355528},{"type":"v1","addr":"172.21.15.102:6827","nonce":4149355528}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6830","nonce":4149355528},{"type":"v1","addr":"172.21.15.102:6831","nonce":4149355528}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6828","nonce":4149355528},{"type":"v1","addr":"172.21.15.102:6829","nonce":4149355528}]},"public_addr":"172.21.15.102:6825/4149355528","cluster_addr":"172.21.15.102:6827/4149355528","heartbeat_back_addr":"172.21.15.102:6831/4149355528","heartbeat_front_addr":"172.21.15.102:6829/4149355528","state":["exists","up"]},{"osd":4,"uuid":"16e797d8-e6e7-4140-95c3-b85283c42a2a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6808","nonce":4028899241},{"type":"v1","addr":"172.21.15.154:6809","nonce":4028899241}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6810","nonce":4028899241},{"type":"v1","addr":"172.21.15.154:6811","nonce":4028899241}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6814","nonce":4028899241},{"type":"v1","addr":"172.21.15.154:6815","nonce":4028899241}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6812","nonce":4028899241},{"type":"v1","addr":"172.21.15.154:6813","nonce":4028899241}]},"public_addr":"172.21.15.154:6809/4028899241","cluster_addr":"172.21.15.154:6811/4028899241","heartbeat_back_addr":"172.21.15.154:6815/4028899241","heartbeat_front_addr":"172.21.15.154:6813/4028899241","state":["exists","up"]},{"osd":5,"uuid":"d6ab225c-1b55-450a-89a9-abe5c3f8d6af","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":3562396827},{"type":"v1","addr":"172.21.15.154:6801","nonce":3562396827}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":3562396827},{"type":"v1","addr":"172.21.15.154:6803","nonce":3562396827}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6806","nonce":3562396827},{"type":"v1","addr":"172.21.15.154:6807","nonce":3562396827}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6804","nonce":3562396827},{"type":"v1","addr":"172.21.15.154:6805","nonce":3562396827}]},"public_addr":"172.21.15.154:6801/3562396827","cluster_addr":"172.21.15.154:6803/3562396827","heartbeat_back_addr":"172.21.15.154:6807/3562396827","heartbeat_front_addr":"172.21.15.154:6805/3562396827","state":["exists","up"]},{"osd":6,"uuid":"96f905ac-491c-4662-8e2b-5bb8e929ab9d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6816","nonce":2933728751},{"type":"v1","addr":"172.21.15.154:6817","nonce":2933728751}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6818","nonce":2933728751},{"type":"v1","addr":"172.21.15.154:6819","nonce":2933728751}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6822","nonce":2933728751},{"type":"v1","addr":"172.21.15.154:6823","nonce":2933728751}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6820","nonce":2933728751},{"type":"v1","addr":"172.21.15.154:6821","nonce":2933728751}]},"public_addr":"172.21.15.154:6817/2933728751","cluster_addr":"172.21.15.154:6819/2933728751","heartbeat_back_addr":"172.21.15.154:6823/2933728751","heartbeat_front_addr":"172.21.15.154:6821/2933728751","state":["exists","up"]},{"osd":7,"uuid":"07012d3b-3ab4-40df-a471-93caed22e2dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6824","nonce":1753500785},{"type":"v1","addr":"172.21.15.154:6825","nonce":1753500785}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6826","nonce":1753500785},{"type":"v1","addr":"172.21.15.154:6827","nonce":1753500785}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6830","nonce":1753500785},{"type":"v1","addr":"172.21.15.154:6831","nonce":1753500785}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6828","nonce":1753500785},{"type":"v1","addr":"172.21.15.154:6829","nonce":1753500785}]},"public_addr":"172.21.15.154:6825/1753500785","cluster_addr":"172.21.15.154:6827/1753500785","heartbeat_back_addr":"172.21.15.154:6831/1753500785","heartbeat_front_addr":"172.21.15.154:6829/1753500785","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-13T11:28:40.978603+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-13T11:28:41.200985+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-13T11:28:41.222815+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-13T11:28:41.202162+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-13T11:28:40.925911+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-13T11:28:41.087725+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-13T11:28:41.072208+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-13T11:28:40.875257+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-13T11:29:32.143 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:32.138+0000 7f9a4759e640 1 -- 172.21.15.102:0/2580083815 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f9a28066470 msgr2=0x7f9a28068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:32.144 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:32.138+0000 7f9a4759e640 1 --2- 172.21.15.102:0/2580083815 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f9a28066470 0x7f9a28068930 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f9a480ce2f0 tx=0x7f9a300079c0 comp rx=0 tx=0).stop 2023-11-13T11:29:32.144 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:32.138+0000 7f9a4759e640 1 -- 172.21.15.102:0/2580083815 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9a4806cbf0 msgr2=0x7f9a48141ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:32.144 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:32.138+0000 7f9a4759e640 1 --2- 172.21.15.102:0/2580083815 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9a4806cbf0 0x7f9a48141ff0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f9a38024c90 tx=0x7f9a3801b480 comp rx=0 tx=0).stop 2023-11-13T11:29:32.144 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:32.138+0000 7f9a4759e640 1 -- 172.21.15.102:0/2580083815 shutdown_connections 2023-11-13T11:29:32.144 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:32.138+0000 7f9a4759e640 1 --2- 172.21.15.102:0/2580083815 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9a48158730 0x7f9a4813eb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:32.145 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:32.138+0000 7f9a4759e640 1 --2- 172.21.15.102:0/2580083815 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9a4815d5f0 0x7f9a4813e040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:32.145 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:32.138+0000 7f9a4759e640 1 --2- 172.21.15.102:0/2580083815 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f9a28066470 0x7f9a28068930 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:32.145 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:32.138+0000 7f9a4759e640 1 --2- 172.21.15.102:0/2580083815 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9a4806cbf0 0x7f9a48141ff0 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:32.145 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:32.138+0000 7f9a4759e640 1 -- 172.21.15.102:0/2580083815 >> 172.21.15.102:0/2580083815 conn(0x7f9a480b0690 msgr2=0x7f9a48162c30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-13T11:29:32.145 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:32.138+0000 7f9a4759e640 1 -- 172.21.15.102:0/2580083815 shutdown_connections 2023-11-13T11:29:32.146 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:32.138+0000 7f9a4759e640 1 -- 172.21.15.102:0/2580083815 wait complete. 2023-11-13T11:29:32.163 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-13T11:28:44.981356+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-13T11:28:55.958525+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-11-13T11:28:56.394264+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-13T11:29:32.164 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-13T11:29:32.305 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:32.298+0000 7f64beee4640 1 Processor -- start 2023-11-13T11:29:32.306 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:32.298+0000 7f64beee4640 1 -- start start 2023-11-13T11:29:32.307 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:32.298+0000 7f64beee4640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f64b815d3e0 0x7f64b80b1ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:32.307 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:32.302+0000 7f64beee4640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f64b80b28b0 0x7f64b80b2d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:32.307 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:32.302+0000 7f64beee4640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f64b80b3670 con 0x7f64b80b2360 2023-11-13T11:29:32.307 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:32.302+0000 7f64beee4640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f64b80b21e0 con 0x7f64b80b28b0 2023-11-13T11:29:32.307 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:32.302+0000 7f64beee4640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f64b80b3240 con 0x7f64b815d3e0 2023-11-13T11:29:32.308 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:32.302+0000 7f64bcc80640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f64b815d3e0 0x7f64b80b1ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:32.309 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:32.302+0000 7f64bcc80640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f64b815d3e0 0x7f64b80b1ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.102:60030/0 (socket says 172.21.15.102:60030) 2023-11-13T11:29:32.309 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:32.302+0000 7f64bcc80640 1 -- 172.21.15.102:0/628156503 learned_addr learned my addr 172.21.15.102:0/628156503 (peer_addr_for_me v2:172.21.15.102:0/0) 2023-11-13T11:29:32.309 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:32.302+0000 7f64bd481640 1 --2- 172.21.15.102:0/628156503 >> v2:172.21.15.154:3300/0 conn(0x7f64b80b28b0 0x7f64b80b2d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:32.309 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:32.302+0000 7f64bcc80640 1 -- 172.21.15.102:0/628156503 >> v2:172.21.15.154:3300/0 conn(0x7f64b80b28b0 msgr2=0x7f64b80b2d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-13T11:29:32.309 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:32.302+0000 7f64bcc80640 1 --2- 172.21.15.102:0/628156503 >> v2:172.21.15.154:3300/0 conn(0x7f64b80b28b0 0x7f64b80b2d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:32.310 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:32.302+0000 7f64bcc80640 1 -- 172.21.15.102:0/628156503 >> v1:172.21.15.154:6789/0 conn(0x7f64b80b2360 legacy=0x7f64b8071690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:32.310 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:32.302+0000 7f64bcc80640 1 -- 172.21.15.102:0/628156503 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64b8071200 con 0x7f64b815d3e0 2023-11-13T11:29:32.310 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:32.302+0000 7f64bcc80640 1 --2- 172.21.15.102:0/628156503 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f64b815d3e0 0x7f64b80b1ca0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f64b4009870 tx=0x7f64b401c540 comp rx=0 tx=0).ready entity=mon.2 client_cookie=60262cee540871aa server_cookie=0 in_seq=0 out_seq=0 2023-11-13T11:29:32.311 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:32.306+0000 7f64af7fe640 1 -- 172.21.15.102:0/628156503 <== mon.2 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64b40ab600 con 0x7f64b815d3e0 2023-11-13T11:29:32.311 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:32.306+0000 7f64af7fe640 1 -- 172.21.15.102:0/628156503 <== mon.2 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f64b40a7050 con 0x7f64b815d3e0 2023-11-13T11:29:32.311 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:32.306+0000 7f64af7fe640 1 -- 172.21.15.102:0/628156503 <== mon.2 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64b40ab980 con 0x7f64b815d3e0 2023-11-13T11:29:32.312 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:32.306+0000 7f64beee4640 1 -- 172.21.15.102:0/628156503 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f64b815d3e0 msgr2=0x7f64b80b1ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:32.312 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:32.306+0000 7f64beee4640 1 --2- 172.21.15.102:0/628156503 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f64b815d3e0 0x7f64b80b1ca0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f64b4009870 tx=0x7f64b401c540 comp rx=0 tx=0).stop 2023-11-13T11:29:32.313 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:32.306+0000 7f64beee4640 1 -- 172.21.15.102:0/628156503 shutdown_connections 2023-11-13T11:29:32.313 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:32.306+0000 7f64beee4640 1 --2- 172.21.15.102:0/628156503 >> v2:172.21.15.154:3300/0 conn(0x7f64b80b28b0 0x7f64b80b2d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:32.313 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:32.306+0000 7f64beee4640 1 --2- 172.21.15.102:0/628156503 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f64b815d3e0 0x7f64b80b1ca0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:32.313 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:32.306+0000 7f64beee4640 1 -- 172.21.15.102:0/628156503 >> 172.21.15.102:0/628156503 conn(0x7f64b80b0690 msgr2=0x7f64b80b0aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-13T11:29:32.313 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:32.306+0000 7f64beee4640 1 -- 172.21.15.102:0/628156503 shutdown_connections 2023-11-13T11:29:32.314 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:32.306+0000 7f64beee4640 1 -- 172.21.15.102:0/628156503 wait complete. 2023-11-13T11:29:32.316 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:32.306+0000 7f64beee4640 1 Processor -- start 2023-11-13T11:29:32.316 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:32.306+0000 7f64beee4640 1 -- start start 2023-11-13T11:29:32.316 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:32.306+0000 7f64beee4640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f64b80b2360 0x7f64b814cfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:32.317 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:32.306+0000 7f64beee4640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f64b80b28b0 0x7f64b81f6280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:32.317 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:32.310+0000 7f64beee4640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f64b815d3e0 0x7f64b814fcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:32.317 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:32.310+0000 7f64beee4640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64b81f67c0 con 0x7f64b815d3e0 2023-11-13T11:29:32.317 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:32.310+0000 7f64beee4640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64b814ca00 con 0x7f64b80b2360 2023-11-13T11:29:32.318 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:32.310+0000 7f64beee4640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f64b81505c0 con 0x7f64b80b28b0 2023-11-13T11:29:32.318 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:32.310+0000 7f64bd481640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f64b815d3e0 0x7f64b814fcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:32.318 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:32.310+0000 7f64bd481640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f64b815d3e0 0x7f64b814fcc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:48268/0 (socket says 172.21.15.102:48268) 2023-11-13T11:29:32.318 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:32.310+0000 7f64bd481640 1 -- 172.21.15.102:0/2324898095 learned_addr learned my addr 172.21.15.102:0/2324898095 (peer_addr_for_me v2:172.21.15.102:0/0) 2023-11-13T11:29:32.318 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:32.310+0000 7f64bcc80640 1 --2- 172.21.15.102:0/2324898095 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f64b80b2360 0x7f64b814cfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:32.319 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:32.310+0000 7f64affff640 1 --2- 172.21.15.102:0/2324898095 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f64b80b28b0 0x7f64b81f6280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:32.319 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:32.310+0000 7f64bd481640 1 -- 172.21.15.102:0/2324898095 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f64b80b28b0 msgr2=0x7f64b81f6280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:32.319 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:32.310+0000 7f64bd481640 1 --2- 172.21.15.102:0/2324898095 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f64b80b28b0 0x7f64b81f6280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:32.319 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:32.310+0000 7f64bd481640 1 -- 172.21.15.102:0/2324898095 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f64b80b2360 msgr2=0x7f64b814cfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:32.319 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:32.310+0000 7f64bd481640 1 --2- 172.21.15.102:0/2324898095 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f64b80b2360 0x7f64b814cfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:32.320 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:32.310+0000 7f64bd481640 1 -- 172.21.15.102:0/2324898095 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64b40094d0 con 0x7f64b815d3e0 2023-11-13T11:29:32.320 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:32.310+0000 7f64bd481640 1 --2- 172.21.15.102:0/2324898095 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f64b815d3e0 0x7f64b814fcc0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f64b000efc0 tx=0x7f64b000c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-13T11:29:32.320 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:32.310+0000 7f64ad7fa640 1 -- 172.21.15.102:0/2324898095 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64b0009b10 con 0x7f64b815d3e0 2023-11-13T11:29:32.320 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:32.310+0000 7f64ad7fa640 1 -- 172.21.15.102:0/2324898095 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f64b000f040 con 0x7f64b815d3e0 2023-11-13T11:29:32.320 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:32.310+0000 7f64beee4640 1 -- 172.21.15.102:0/2324898095 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f64b81508a0 con 0x7f64b815d3e0 2023-11-13T11:29:32.321 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:32.310+0000 7f64ad7fa640 1 -- 172.21.15.102:0/2324898095 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64b00146c0 con 0x7f64b815d3e0 2023-11-13T11:29:32.321 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:32.310+0000 7f64beee4640 1 -- 172.21.15.102:0/2324898095 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f64b814cce0 con 0x7f64b815d3e0 2023-11-13T11:29:32.322 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:32.310+0000 7f64beee4640 1 -- 172.21.15.102:0/2324898095 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f64b8067640 con 0x7f64b815d3e0 2023-11-13T11:29:32.322 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:32.310+0000 7f64ad7fa640 1 -- 172.21.15.102:0/2324898095 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f64b0014820 con 0x7f64b815d3e0 2023-11-13T11:29:32.323 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:32.314+0000 7f64ad7fa640 1 --2- 172.21.15.102:0/2324898095 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f64a4066470 0x7f64a4068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:32.323 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:32.314+0000 7f64ad7fa640 1 -- 172.21.15.102:0/2324898095 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f64b0084b60 con 0x7f64b815d3e0 2023-11-13T11:29:32.323 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:32.314+0000 7f64bcc80640 1 --2- 172.21.15.102:0/2324898095 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f64a4066470 0x7f64a4068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:32.323 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:32.314+0000 7f64bcc80640 1 --2- 172.21.15.102:0/2324898095 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f64a4066470 0x7f64a4068930 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f64b806e090 tx=0x7f64b40a6000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-13T11:29:32.324 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:32.318+0000 7f64ad7fa640 1 -- 172.21.15.102:0/2324898095 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f64b0052080 con 0x7f64b815d3e0 2023-11-13T11:29:32.473 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:32.466+0000 7f64beee4640 1 -- 172.21.15.102:0/2324898095 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f64b815cf30 con 0x7f64b815d3e0 2023-11-13T11:29:32.474 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:32.466+0000 7f64ad7fa640 1 -- 172.21.15.102:0/2324898095 <== mon.0 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v22) v1 ==== 93+0+10 (secure 0 0 0) 0x7f64b00180a0 con 0x7f64b815d3e0 2023-11-13T11:29:32.474 INFO:teuthology.orchestra.run.smithi102.stdout:pg_num: 1 2023-11-13T11:29:32.476 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:32.470+0000 7f64beee4640 1 -- 172.21.15.102:0/2324898095 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f64a4066470 msgr2=0x7f64a4068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:32.476 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:32.470+0000 7f64beee4640 1 --2- 172.21.15.102:0/2324898095 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f64a4066470 0x7f64a4068930 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f64b806e090 tx=0x7f64b40a6000 comp rx=0 tx=0).stop 2023-11-13T11:29:32.476 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:32.470+0000 7f64beee4640 1 -- 172.21.15.102:0/2324898095 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f64b815d3e0 msgr2=0x7f64b814fcc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:32.476 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:32.470+0000 7f64beee4640 1 --2- 172.21.15.102:0/2324898095 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f64b815d3e0 0x7f64b814fcc0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f64b000efc0 tx=0x7f64b000c490 comp rx=0 tx=0).stop 2023-11-13T11:29:32.477 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:32.470+0000 7f64beee4640 1 -- 172.21.15.102:0/2324898095 shutdown_connections 2023-11-13T11:29:32.477 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:32.470+0000 7f64beee4640 1 --2- 172.21.15.102:0/2324898095 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f64a4066470 0x7f64a4068930 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:32.477 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:32.470+0000 7f64beee4640 1 --2- 172.21.15.102:0/2324898095 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f64b815d3e0 0x7f64b814fcc0 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:32.477 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:32.470+0000 7f64beee4640 1 --2- 172.21.15.102:0/2324898095 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f64b80b28b0 0x7f64b81f6280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:32.477 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:32.470+0000 7f64beee4640 1 --2- 172.21.15.102:0/2324898095 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f64b80b2360 0x7f64b814cfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:32.478 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:32.470+0000 7f64beee4640 1 -- 172.21.15.102:0/2324898095 >> 172.21.15.102:0/2324898095 conn(0x7f64b80b0690 msgr2=0x7f64b806ce10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-13T11:29:32.478 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:32.470+0000 7f64beee4640 1 -- 172.21.15.102:0/2324898095 shutdown_connections 2023-11-13T11:29:32.478 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:32.470+0000 7f64beee4640 1 -- 172.21.15.102:0/2324898095 wait complete. 2023-11-13T11:29:32.495 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-13T11:29:32.635 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:32.630+0000 7fbd771f5640 1 Processor -- start 2023-11-13T11:29:32.636 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:32.630+0000 7fbd771f5640 1 -- start start 2023-11-13T11:29:32.637 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:32.630+0000 7fbd771f5640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fbd701553c0 0x7fbd700cebc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:32.637 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:32.630+0000 7fbd771f5640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7fbd7006c800 0x7fbd700cf100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:32.637 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:32.630+0000 7fbd771f5640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbd7015bed0 con 0x7fbd7015b3b0 2023-11-13T11:29:32.637 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:32.630+0000 7fbd771f5640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbd7006c3e0 con 0x7fbd7006c800 2023-11-13T11:29:32.638 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:32.630+0000 7fbd771f5640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbd7015c150 con 0x7fbd701553c0 2023-11-13T11:29:32.638 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:32.630+0000 7fbd6ffff640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7fbd7006c800 0x7fbd700cf100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:32.638 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:32.630+0000 7fbd75792640 1 --1- >> v1:172.21.15.102:6789/0 conn(0x7fbd7015b3b0 0x7fbd7015b7c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.102:6789/0 says I am v1:172.21.15.102:36170/0 (socket says 172.21.15.102:36170) 2023-11-13T11:29:32.638 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:32.630+0000 7fbd75792640 1 -- 172.21.15.102:0/4271287705 learned_addr learned my addr 172.21.15.102:0/4271287705 (peer_addr_for_me v1:172.21.15.102:0/0) 2023-11-13T11:29:32.638 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:32.630+0000 7fbd74f91640 1 --2- 172.21.15.102:0/4271287705 >> v2:172.21.15.154:3300/0 conn(0x7fbd701553c0 0x7fbd700cebc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:32.639 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:32.630+0000 7fbd6ffff640 1 -- 172.21.15.102:0/4271287705 >> v2:172.21.15.154:3300/0 conn(0x7fbd701553c0 msgr2=0x7fbd700cebc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-13T11:29:32.639 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:32.630+0000 7fbd6ffff640 1 --2- 172.21.15.102:0/4271287705 >> v2:172.21.15.154:3300/0 conn(0x7fbd701553c0 0x7fbd700cebc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:32.640 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:32.630+0000 7fbd6ffff640 1 -- 172.21.15.102:0/4271287705 >> v1:172.21.15.102:6789/0 conn(0x7fbd7015b3b0 legacy=0x7fbd7015b7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:32.640 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:32.630+0000 7fbd6ffff640 1 -- 172.21.15.102:0/4271287705 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd7006bd20 con 0x7fbd7006c800 2023-11-13T11:29:32.640 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:32.630+0000 7fbd6f7fe640 1 -- 172.21.15.102:0/4271287705 <== mon.0 v1:172.21.15.102:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1564414583 0 0) 0x7fbd7015bed0 con 0x7fbd7015b3b0 2023-11-13T11:29:32.640 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:32.630+0000 7fbd74f91640 1 --2- 172.21.15.102:0/4271287705 >> v2:172.21.15.154:3300/0 conn(0x7fbd701553c0 0x7fbd700cebc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-13T11:29:32.641 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:32.634+0000 7fbd6ffff640 1 --2- 172.21.15.102:0/4271287705 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fbd7006c800 0x7fbd700cf100 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fbd700675f0 tx=0x7fbd5c01c3d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=58453c7071f26b29 server_cookie=0 in_seq=0 out_seq=0 2023-11-13T11:29:32.641 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:32.634+0000 7fbd6f7fe640 1 -- 172.21.15.102:0/4271287705 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd5c0ab600 con 0x7fbd7006c800 2023-11-13T11:29:32.642 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:32.634+0000 7fbd6f7fe640 1 -- 172.21.15.102:0/4271287705 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd5c0a7050 con 0x7fbd7006c800 2023-11-13T11:29:32.642 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:32.634+0000 7fbd6f7fe640 1 -- 172.21.15.102:0/4271287705 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd5c0ab980 con 0x7fbd7006c800 2023-11-13T11:29:32.642 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:32.634+0000 7fbd771f5640 1 -- 172.21.15.102:0/4271287705 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fbd7006c800 msgr2=0x7fbd700cf100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:32.642 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:32.634+0000 7fbd771f5640 1 --2- 172.21.15.102:0/4271287705 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fbd7006c800 0x7fbd700cf100 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fbd700675f0 tx=0x7fbd5c01c3d0 comp rx=0 tx=0).stop 2023-11-13T11:29:32.642 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:32.634+0000 7fbd771f5640 1 -- 172.21.15.102:0/4271287705 shutdown_connections 2023-11-13T11:29:32.643 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:32.634+0000 7fbd771f5640 1 --2- 172.21.15.102:0/4271287705 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fbd7006c800 0x7fbd700cf100 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:32.643 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:32.634+0000 7fbd771f5640 1 --2- 172.21.15.102:0/4271287705 >> v2:172.21.15.154:3300/0 conn(0x7fbd701553c0 0x7fbd700cebc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:32.643 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:32.634+0000 7fbd771f5640 1 -- 172.21.15.102:0/4271287705 >> 172.21.15.102:0/4271287705 conn(0x7fbd7006a410 msgr2=0x7fbd7006a820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-13T11:29:32.643 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:32.634+0000 7fbd771f5640 1 -- 172.21.15.102:0/4271287705 shutdown_connections 2023-11-13T11:29:32.644 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:32.634+0000 7fbd771f5640 1 -- 172.21.15.102:0/4271287705 wait complete. 2023-11-13T11:29:32.646 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:32.638+0000 7fbd771f5640 1 Processor -- start 2023-11-13T11:29:32.646 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:32.638+0000 7fbd771f5640 1 -- start start 2023-11-13T11:29:32.647 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:32.638+0000 7fbd771f5640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fbd7006c800 0x7fbd701f62d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:32.647 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:32.638+0000 7fbd771f5640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbd701553c0 0x7fbd700ac8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:32.647 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:32.638+0000 7fbd771f5640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fbd7015b3b0 0x7fbd700acde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:32.647 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:32.638+0000 7fbd771f5640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd7015ad10 con 0x7fbd7006c800 2023-11-13T11:29:32.647 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:32.638+0000 7fbd771f5640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd70156ac0 con 0x7fbd701553c0 2023-11-13T11:29:32.648 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:32.638+0000 7fbd771f5640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd700b21f0 con 0x7fbd7015b3b0 2023-11-13T11:29:32.648 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:32.638+0000 7fbd74f91640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fbd7006c800 0x7fbd701f62d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:32.648 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:32.638+0000 7fbd74f91640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fbd7006c800 0x7fbd701f62d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:48282/0 (socket says 172.21.15.102:48282) 2023-11-13T11:29:32.648 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:32.638+0000 7fbd74f91640 1 -- 172.21.15.102:0/3552679837 learned_addr learned my addr 172.21.15.102:0/3552679837 (peer_addr_for_me v2:172.21.15.102:0/0) 2023-11-13T11:29:32.648 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:32.638+0000 7fbd75792640 1 --2- 172.21.15.102:0/3552679837 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fbd7015b3b0 0x7fbd700acde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:32.649 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:32.638+0000 7fbd6ffff640 1 --2- 172.21.15.102:0/3552679837 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbd701553c0 0x7fbd700ac8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:32.649 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:32.638+0000 7fbd74f91640 1 -- 172.21.15.102:0/3552679837 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fbd7015b3b0 msgr2=0x7fbd700acde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:32.649 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:32.638+0000 7fbd74f91640 1 --2- 172.21.15.102:0/3552679837 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fbd7015b3b0 0x7fbd700acde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:32.649 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:32.638+0000 7fbd74f91640 1 -- 172.21.15.102:0/3552679837 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbd701553c0 msgr2=0x7fbd700ac8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:32.649 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:32.638+0000 7fbd74f91640 1 --2- 172.21.15.102:0/3552679837 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbd701553c0 0x7fbd700ac8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:32.650 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:32.638+0000 7fbd74f91640 1 -- 172.21.15.102:0/3552679837 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd5c009420 con 0x7fbd7006c800 2023-11-13T11:29:32.650 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:32.638+0000 7fbd6ffff640 1 --2- 172.21.15.102:0/3552679837 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbd701553c0 0x7fbd700ac8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-13T11:29:32.650 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:32.638+0000 7fbd74f91640 1 --2- 172.21.15.102:0/3552679837 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fbd7006c800 0x7fbd701f62d0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fbd6400d830 tx=0x7fbd6400dcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-13T11:29:32.650 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:32.638+0000 7fbd6d7fa640 1 -- 172.21.15.102:0/3552679837 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd640096c0 con 0x7fbd7006c800 2023-11-13T11:29:32.650 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:32.638+0000 7fbd6d7fa640 1 -- 172.21.15.102:0/3552679837 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd64009820 con 0x7fbd7006c800 2023-11-13T11:29:32.651 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:32.638+0000 7fbd6d7fa640 1 -- 172.21.15.102:0/3552679837 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd64009bd0 con 0x7fbd7006c800 2023-11-13T11:29:32.651 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:32.638+0000 7fbd771f5640 1 -- 172.21.15.102:0/3552679837 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbd701f6810 con 0x7fbd7006c800 2023-11-13T11:29:32.651 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:32.638+0000 7fbd771f5640 1 -- 172.21.15.102:0/3552679837 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbd700b1ba0 con 0x7fbd7006c800 2023-11-13T11:29:32.652 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:32.642+0000 7fbd771f5640 1 -- 172.21.15.102:0/3552679837 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbd70067640 con 0x7fbd7006c800 2023-11-13T11:29:32.652 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:32.642+0000 7fbd6d7fa640 1 -- 172.21.15.102:0/3552679837 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fbd64014410 con 0x7fbd7006c800 2023-11-13T11:29:32.653 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:32.642+0000 7fbd6d7fa640 1 --2- 172.21.15.102:0/3552679837 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7fbd54066470 0x7fbd54068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:32.653 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:32.642+0000 7fbd6d7fa640 1 -- 172.21.15.102:0/3552679837 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fbd64084830 con 0x7fbd7006c800 2023-11-13T11:29:32.653 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:32.642+0000 7fbd6ffff640 1 --2- 172.21.15.102:0/3552679837 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7fbd54066470 0x7fbd54068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:32.653 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:32.642+0000 7fbd6ffff640 1 --2- 172.21.15.102:0/3552679837 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7fbd54066470 0x7fbd54068930 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fbd5c0ad000 tx=0x7fbd5c008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-13T11:29:32.653 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:32.646+0000 7fbd6d7fa640 1 -- 172.21.15.102:0/3552679837 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fbd64051c10 con 0x7fbd7006c800 2023-11-13T11:29:32.802 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:32.794+0000 7fbd771f5640 1 -- 172.21.15.102:0/3552679837 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fbd70068520 con 0x7fbd7006c800 2023-11-13T11:29:32.803 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:32.794+0000 7fbd6d7fa640 1 -- 172.21.15.102:0/3552679837 <== mon.0 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v22) v1 ==== 104+0+11 (secure 0 0 0) 0x7fbd64055230 con 0x7fbd7006c800 2023-11-13T11:29:32.803 INFO:teuthology.orchestra.run.smithi102.stdout:pg_num: 32 2023-11-13T11:29:32.805 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:32.798+0000 7fbd771f5640 1 -- 172.21.15.102:0/3552679837 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7fbd54066470 msgr2=0x7fbd54068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:32.805 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:32.798+0000 7fbd771f5640 1 --2- 172.21.15.102:0/3552679837 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7fbd54066470 0x7fbd54068930 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fbd5c0ad000 tx=0x7fbd5c008040 comp rx=0 tx=0).stop 2023-11-13T11:29:32.805 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:32.798+0000 7fbd771f5640 1 -- 172.21.15.102:0/3552679837 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fbd7006c800 msgr2=0x7fbd701f62d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:32.805 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:32.798+0000 7fbd771f5640 1 --2- 172.21.15.102:0/3552679837 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fbd7006c800 0x7fbd701f62d0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fbd6400d830 tx=0x7fbd6400dcf0 comp rx=0 tx=0).stop 2023-11-13T11:29:32.805 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:32.798+0000 7fbd771f5640 1 -- 172.21.15.102:0/3552679837 shutdown_connections 2023-11-13T11:29:32.806 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:32.798+0000 7fbd771f5640 1 --2- 172.21.15.102:0/3552679837 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fbd7015b3b0 0x7fbd700acde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:32.806 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:32.798+0000 7fbd771f5640 1 --2- 172.21.15.102:0/3552679837 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbd701553c0 0x7fbd700ac8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:32.806 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:32.798+0000 7fbd771f5640 1 --2- 172.21.15.102:0/3552679837 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7fbd54066470 0x7fbd54068930 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:32.806 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:32.798+0000 7fbd771f5640 1 --2- 172.21.15.102:0/3552679837 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fbd7006c800 0x7fbd701f62d0 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:32.807 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:32.798+0000 7fbd771f5640 1 -- 172.21.15.102:0/3552679837 >> 172.21.15.102:0/3552679837 conn(0x7fbd7006a410 msgr2=0x7fbd700ceb90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-13T11:29:32.807 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:32.798+0000 7fbd771f5640 1 -- 172.21.15.102:0/3552679837 shutdown_connections 2023-11-13T11:29:32.807 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:32.798+0000 7fbd771f5640 1 -- 172.21.15.102:0/3552679837 wait complete. 2023-11-13T11:29:32.824 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-13T11:29:32.966 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:32.958+0000 7fc758f2a640 1 Processor -- start 2023-11-13T11:29:32.966 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:32.958+0000 7fc758f2a640 1 -- start start 2023-11-13T11:29:32.968 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:32.962+0000 7fc758f2a640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc7541553c0 0x7fc7540cebc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:32.968 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:32.962+0000 7fc758f2a640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7fc75415bac0 0x7fc7540cf100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:32.968 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:32.962+0000 7fc758f2a640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc75415c150 con 0x7fc75406c800 2023-11-13T11:29:32.968 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:32.962+0000 7fc758f2a640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc75406c3e0 con 0x7fc75415bac0 2023-11-13T11:29:32.969 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:32.962+0000 7fc758f2a640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc75415bf30 con 0x7fc7541553c0 2023-11-13T11:29:32.969 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:32.962+0000 7fc752d9d640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7fc75415bac0 0x7fc7540cf100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:32.969 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:32.962+0000 7fc752d9d640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7fc75415bac0 0x7fc7540cf100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:48284/0 (socket says 172.21.15.102:48284) 2023-11-13T11:29:32.969 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:32.962+0000 7fc75259c640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc7541553c0 0x7fc7540cebc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:32.969 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:32.962+0000 7fc752d9d640 1 -- 172.21.15.102:0/1548891832 learned_addr learned my addr 172.21.15.102:0/1548891832 (peer_addr_for_me v2:172.21.15.102:0/0) 2023-11-13T11:29:32.969 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:32.962+0000 7fc751d9b640 1 --1- 172.21.15.102:0/1548891832 >> v1:172.21.15.154:6789/0 conn(0x7fc75406c800 0x7fc75415b3b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.102:45078/0 (socket says 172.21.15.102:45078) 2023-11-13T11:29:32.970 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:32.962+0000 7fc752d9d640 1 -- 172.21.15.102:0/1548891832 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc7541553c0 msgr2=0x7fc7540cebc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-13T11:29:32.971 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:32.962+0000 7fc752d9d640 1 --2- 172.21.15.102:0/1548891832 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc7541553c0 0x7fc7540cebc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:32.971 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:32.962+0000 7fc752d9d640 1 -- 172.21.15.102:0/1548891832 >> v1:172.21.15.154:6789/0 conn(0x7fc75406c800 legacy=0x7fc75415b3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:32.971 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:32.962+0000 7fc752d9d640 1 -- 172.21.15.102:0/1548891832 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc75406bd20 con 0x7fc75415bac0 2023-11-13T11:29:32.972 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:32.966+0000 7fc752d9d640 1 --2- 172.21.15.102:0/1548891832 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc75415bac0 0x7fc7540cf100 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fc74c009e80 tx=0x7fc74c01c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a46f8dd59dd5f613 server_cookie=0 in_seq=0 out_seq=0 2023-11-13T11:29:32.972 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:32.966+0000 7fc75159a640 1 -- 172.21.15.102:0/1548891832 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc74c0a5780 con 0x7fc75415bac0 2023-11-13T11:29:32.973 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:32.966+0000 7fc75159a640 1 -- 172.21.15.102:0/1548891832 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc74c0a58e0 con 0x7fc75415bac0 2023-11-13T11:29:32.973 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:32.966+0000 7fc75159a640 1 -- 172.21.15.102:0/1548891832 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc74c0a5c70 con 0x7fc75415bac0 2023-11-13T11:29:32.973 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:32.966+0000 7fc758f2a640 1 -- 172.21.15.102:0/1548891832 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc75415bac0 msgr2=0x7fc7540cf100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:32.973 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:32.966+0000 7fc758f2a640 1 --2- 172.21.15.102:0/1548891832 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc75415bac0 0x7fc7540cf100 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fc74c009e80 tx=0x7fc74c01c960 comp rx=0 tx=0).stop 2023-11-13T11:29:32.973 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:32.966+0000 7fc758f2a640 1 -- 172.21.15.102:0/1548891832 shutdown_connections 2023-11-13T11:29:32.973 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:32.966+0000 7fc758f2a640 1 --2- 172.21.15.102:0/1548891832 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc75415bac0 0x7fc7540cf100 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:32.974 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:32.966+0000 7fc758f2a640 1 --2- 172.21.15.102:0/1548891832 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc7541553c0 0x7fc7540cebc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:32.974 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:32.966+0000 7fc758f2a640 1 -- 172.21.15.102:0/1548891832 >> 172.21.15.102:0/1548891832 conn(0x7fc75406a410 msgr2=0x7fc75406a820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-13T11:29:32.975 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:32.966+0000 7fc758f2a640 1 -- 172.21.15.102:0/1548891832 shutdown_connections 2023-11-13T11:29:32.975 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:32.966+0000 7fc758f2a640 1 -- 172.21.15.102:0/1548891832 wait complete. 2023-11-13T11:29:32.977 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:32.966+0000 7fc758f2a640 1 Processor -- start 2023-11-13T11:29:32.977 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:32.966+0000 7fc758f2a640 1 -- start start 2023-11-13T11:29:32.978 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:32.970+0000 7fc758f2a640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc75406c800 0x7fc7540ac600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:32.978 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:32.970+0000 7fc758f2a640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc7541553c0 0x7fc7541463b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:32.978 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:32.970+0000 7fc758f2a640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc75415bac0 0x7fc7540a9660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:32.978 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:32.970+0000 7fc758f2a640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7540aab30 con 0x7fc75415bac0 2023-11-13T11:29:32.978 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:32.970+0000 7fc758f2a640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7540a9f20 con 0x7fc75406c800 2023-11-13T11:29:32.979 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:32.970+0000 7fc758f2a640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc7540aa200 con 0x7fc7541553c0 2023-11-13T11:29:32.979 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:32.970+0000 7fc752d9d640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc75415bac0 0x7fc7540a9660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:32.979 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:32.970+0000 7fc752d9d640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc75415bac0 0x7fc7540a9660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:48292/0 (socket says 172.21.15.102:48292) 2023-11-13T11:29:32.979 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:32.970+0000 7fc752d9d640 1 -- 172.21.15.102:0/445736127 learned_addr learned my addr 172.21.15.102:0/445736127 (peer_addr_for_me v2:172.21.15.102:0/0) 2023-11-13T11:29:32.979 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:32.970+0000 7fc75259c640 1 --2- 172.21.15.102:0/445736127 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc75406c800 0x7fc7540ac600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:32.980 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:32.970+0000 7fc751d9b640 1 --2- 172.21.15.102:0/445736127 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc7541553c0 0x7fc7541463b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:32.980 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:32.970+0000 7fc752d9d640 1 -- 172.21.15.102:0/445736127 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc7541553c0 msgr2=0x7fc7541463b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:32.980 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:32.970+0000 7fc752d9d640 1 --2- 172.21.15.102:0/445736127 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc7541553c0 0x7fc7541463b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:32.980 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:32.970+0000 7fc752d9d640 1 -- 172.21.15.102:0/445736127 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc75406c800 msgr2=0x7fc7540ac600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:32.980 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:32.970+0000 7fc752d9d640 1 --2- 172.21.15.102:0/445736127 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc75406c800 0x7fc7540ac600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:32.981 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:32.970+0000 7fc752d9d640 1 -- 172.21.15.102:0/445736127 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc74c009b30 con 0x7fc75415bac0 2023-11-13T11:29:32.981 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:32.970+0000 7fc752d9d640 1 --2- 172.21.15.102:0/445736127 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc75415bac0 0x7fc7540a9660 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fc74c0af040 tx=0x7fc74c019700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-13T11:29:32.981 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:32.970+0000 7fc742ffd640 1 -- 172.21.15.102:0/445736127 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc74c0b8670 con 0x7fc75415bac0 2023-11-13T11:29:32.981 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:32.970+0000 7fc742ffd640 1 -- 172.21.15.102:0/445736127 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc74c0b87f0 con 0x7fc75415bac0 2023-11-13T11:29:32.981 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:32.970+0000 7fc758f2a640 1 -- 172.21.15.102:0/445736127 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc7540aa4e0 con 0x7fc75415bac0 2023-11-13T11:29:32.982 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:32.970+0000 7fc742ffd640 1 -- 172.21.15.102:0/445736127 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc74c0b8ba0 con 0x7fc75415bac0 2023-11-13T11:29:32.982 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:32.970+0000 7fc758f2a640 1 -- 172.21.15.102:0/445736127 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc7541468f0 con 0x7fc75415bac0 2023-11-13T11:29:32.983 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:32.970+0000 7fc758f2a640 1 -- 172.21.15.102:0/445736127 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc7540aace0 con 0x7fc75415bac0 2023-11-13T11:29:32.983 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:32.974+0000 7fc742ffd640 1 -- 172.21.15.102:0/445736127 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fc74c0b8d00 con 0x7fc75415bac0 2023-11-13T11:29:32.983 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:32.974+0000 7fc742ffd640 1 --2- 172.21.15.102:0/445736127 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7fc734066470 0x7fc734068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:32.983 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:32.974+0000 7fc742ffd640 1 -- 172.21.15.102:0/445736127 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc74c11efc0 con 0x7fc75415bac0 2023-11-13T11:29:32.984 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:32.974+0000 7fc75259c640 1 --2- 172.21.15.102:0/445736127 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7fc734066470 0x7fc734068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:32.984 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:32.974+0000 7fc75259c640 1 --2- 172.21.15.102:0/445736127 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7fc734066470 0x7fc734068930 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fc74400df60 tx=0x7fc74400f040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-13T11:29:32.985 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:32.978+0000 7fc742ffd640 1 -- 172.21.15.102:0/445736127 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fc7540aace0 con 0x7fc75415bac0 2023-11-13T11:29:33.134 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:33.126+0000 7fc758f2a640 1 -- 172.21.15.102:0/445736127 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fc754067640 con 0x7fc75415bac0 2023-11-13T11:29:33.135 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:33.126+0000 7fc742ffd640 1 -- 172.21.15.102:0/445736127 <== mon.0 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v22) v1 ==== 100+0+11 (secure 0 0 0) 0x7fc74c0ec310 con 0x7fc75415bac0 2023-11-13T11:29:33.135 INFO:teuthology.orchestra.run.smithi102.stdout:pg_num: 64 2023-11-13T11:29:33.137 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:33.130+0000 7fc758f2a640 1 -- 172.21.15.102:0/445736127 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7fc734066470 msgr2=0x7fc734068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:33.137 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:33.130+0000 7fc758f2a640 1 --2- 172.21.15.102:0/445736127 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7fc734066470 0x7fc734068930 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fc74400df60 tx=0x7fc74400f040 comp rx=0 tx=0).stop 2023-11-13T11:29:33.137 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:33.130+0000 7fc758f2a640 1 -- 172.21.15.102:0/445736127 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc75415bac0 msgr2=0x7fc7540a9660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:33.137 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:33.130+0000 7fc758f2a640 1 --2- 172.21.15.102:0/445736127 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc75415bac0 0x7fc7540a9660 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fc74c0af040 tx=0x7fc74c019700 comp rx=0 tx=0).stop 2023-11-13T11:29:33.137 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:33.130+0000 7fc758f2a640 1 -- 172.21.15.102:0/445736127 shutdown_connections 2023-11-13T11:29:33.138 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:33.130+0000 7fc758f2a640 1 --2- 172.21.15.102:0/445736127 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7fc734066470 0x7fc734068930 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:33.138 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:33.130+0000 7fc758f2a640 1 --2- 172.21.15.102:0/445736127 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc75415bac0 0x7fc7540a9660 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:33.138 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:33.130+0000 7fc758f2a640 1 --2- 172.21.15.102:0/445736127 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc7541553c0 0x7fc7541463b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:33.138 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:33.130+0000 7fc758f2a640 1 --2- 172.21.15.102:0/445736127 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc75406c800 0x7fc7540ac600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:33.138 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:33.130+0000 7fc758f2a640 1 -- 172.21.15.102:0/445736127 >> 172.21.15.102:0/445736127 conn(0x7fc75406a410 msgr2=0x7fc754071540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-13T11:29:33.139 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:33.130+0000 7fc758f2a640 1 -- 172.21.15.102:0/445736127 shutdown_connections 2023-11-13T11:29:33.139 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:33.130+0000 7fc758f2a640 1 -- 172.21.15.102:0/445736127 wait complete. 2023-11-13T11:29:33.156 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-11-13T11:29:33.295 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:33.286+0000 7f5ab306b640 1 Processor -- start 2023-11-13T11:29:33.295 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:33.290+0000 7f5ab306b640 1 -- start start 2023-11-13T11:29:33.296 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:33.290+0000 7f5ab306b640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f5aac0cd960 0x7f5aac0b1b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:33.296 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:33.290+0000 7f5ab306b640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5aac06c800 con 0x7f5aac159420 2023-11-13T11:29:33.297 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:33.290+0000 7f5ab306b640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5aac06cae0 con 0x7f5aac0cae80 2023-11-13T11:29:33.297 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:33.290+0000 7f5ab306b640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5aac06cdc0 con 0x7f5aac0cd960 2023-11-13T11:29:33.297 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:33.290+0000 7f5ab0e07640 1 --1- >> v1:172.21.15.102:6789/0 conn(0x7f5aac159420 0x7f5aac06d8a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.102:6789/0 says I am v1:172.21.15.102:36186/0 (socket says 172.21.15.102:36186) 2023-11-13T11:29:33.297 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:33.290+0000 7f5ab0e07640 1 -- 172.21.15.102:0/785393834 learned_addr learned my addr 172.21.15.102:0/785393834 (peer_addr_for_me v1:172.21.15.102:0/0) 2023-11-13T11:29:33.298 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:33.290+0000 7f5ab1608640 1 --2- 172.21.15.102:0/785393834 >> v2:172.21.15.154:3300/0 conn(0x7f5aac0cd960 0x7f5aac0b1b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:33.299 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:33.290+0000 7f5aab7fe640 1 -- 172.21.15.102:0/785393834 <== mon.0 v1:172.21.15.102:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2997874088 0 0) 0x7f5aac06c800 con 0x7f5aac159420 2023-11-13T11:29:33.299 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:33.290+0000 7f5aab7fe640 1 -- 172.21.15.102:0/785393834 --> v1:172.21.15.102:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5a9c005740 con 0x7f5aac159420 2023-11-13T11:29:33.299 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:33.290+0000 7f5aab7fe640 1 -- 172.21.15.102:0/785393834 <== mon.0 v1:172.21.15.102:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2751665593 0 0) 0x7f5a9c005740 con 0x7f5aac159420 2023-11-13T11:29:33.299 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:33.290+0000 7f5ab1608640 1 -- 172.21.15.102:0/785393834 >> v1:172.21.15.154:6789/0 conn(0x7f5aac0cae80 legacy=0x7f5aac0cd250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:33.300 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:33.290+0000 7f5ab1608640 1 -- 172.21.15.102:0/785393834 >> v1:172.21.15.102:6789/0 conn(0x7f5aac159420 legacy=0x7f5aac06d8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:33.300 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:33.290+0000 7f5ab1608640 1 -- 172.21.15.102:0/785393834 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5aac06d0a0 con 0x7f5aac0cd960 2023-11-13T11:29:33.301 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:33.294+0000 7f5ab1608640 1 --2- 172.21.15.102:0/785393834 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5aac0cd960 0x7f5aac0b1b70 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f5aa4009dc0 tx=0x7f5aa401f040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=993fc540ee61b087 server_cookie=0 in_seq=0 out_seq=0 2023-11-13T11:29:33.301 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:33.294+0000 7f5aab7fe640 1 -- 172.21.15.102:0/785393834 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5aa0001680 con 0x7f5aac0cd960 2023-11-13T11:29:33.302 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:33.294+0000 7f5aab7fe640 1 -- 172.21.15.102:0/785393834 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5aa40a8c10 con 0x7f5aac0cd960 2023-11-13T11:29:33.302 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:33.294+0000 7f5aab7fe640 1 -- 172.21.15.102:0/785393834 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5aa40b0440 con 0x7f5aac0cd960 2023-11-13T11:29:33.302 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:33.294+0000 7f5ab306b640 1 -- 172.21.15.102:0/785393834 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5aac0cd960 msgr2=0x7f5aac0b1b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:33.303 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:33.294+0000 7f5ab306b640 1 --2- 172.21.15.102:0/785393834 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5aac0cd960 0x7f5aac0b1b70 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f5aa4009dc0 tx=0x7f5aa401f040 comp rx=0 tx=0).stop 2023-11-13T11:29:33.303 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:33.294+0000 7f5ab306b640 1 -- 172.21.15.102:0/785393834 shutdown_connections 2023-11-13T11:29:33.303 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:33.294+0000 7f5ab306b640 1 --2- 172.21.15.102:0/785393834 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5aac0cd960 0x7f5aac0b1b70 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:33.304 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:33.294+0000 7f5ab306b640 1 -- 172.21.15.102:0/785393834 >> 172.21.15.102:0/785393834 conn(0x7f5aac0b0870 msgr2=0x7f5aac0b0c80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-13T11:29:33.304 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:33.294+0000 7f5ab306b640 1 -- 172.21.15.102:0/785393834 shutdown_connections 2023-11-13T11:29:33.304 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:33.294+0000 7f5ab306b640 1 -- 172.21.15.102:0/785393834 wait complete. 2023-11-13T11:29:33.306 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:33.298+0000 7f5ab306b640 1 Processor -- start 2023-11-13T11:29:33.307 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:33.298+0000 7f5ab306b640 1 -- start start 2023-11-13T11:29:33.307 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:33.298+0000 7f5ab306b640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5aac0cae80 0x7f5aac151020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:33.307 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:33.298+0000 7f5ab306b640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5aac0cd960 0x7f5aac0af2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:33.308 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:33.298+0000 7f5ab306b640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5aac159420 0x7f5aac0af820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:33.308 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:33.298+0000 7f5ab306b640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5aac14ffc0 con 0x7f5aac0cd960 2023-11-13T11:29:33.308 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:33.298+0000 7f5ab306b640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5aac150260 con 0x7f5aac159420 2023-11-13T11:29:33.308 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:33.298+0000 7f5ab306b640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5aac150540 con 0x7f5aac0cae80 2023-11-13T11:29:33.308 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:33.298+0000 7f5aabfff640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5aac0cd960 0x7f5aac0af2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:33.309 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:33.298+0000 7f5aabfff640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5aac0cd960 0x7f5aac0af2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:48306/0 (socket says 172.21.15.102:48306) 2023-11-13T11:29:33.309 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:33.298+0000 7f5aabfff640 1 -- 172.21.15.102:0/979103313 learned_addr learned my addr 172.21.15.102:0/979103313 (peer_addr_for_me v2:172.21.15.102:0/0) 2023-11-13T11:29:33.309 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:33.298+0000 7f5aabfff640 1 -- 172.21.15.102:0/979103313 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5aac0cae80 msgr2=0x7f5aac151020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:33.310 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:33.298+0000 7f5aabfff640 1 --2- 172.21.15.102:0/979103313 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5aac0cae80 0x7f5aac151020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:33.310 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:33.298+0000 7f5aabfff640 1 -- 172.21.15.102:0/979103313 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5aac159420 msgr2=0x7f5aac0af820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:33.310 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:33.298+0000 7f5aabfff640 1 --2- 172.21.15.102:0/979103313 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5aac159420 0x7f5aac0af820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:33.310 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:33.298+0000 7f5aabfff640 1 -- 172.21.15.102:0/979103313 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5aa4009a70 con 0x7f5aac0cd960 2023-11-13T11:29:33.311 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:33.298+0000 7f5aabfff640 1 --2- 172.21.15.102:0/979103313 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5aac0cd960 0x7f5aac0af2e0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f5a9800c500 tx=0x7f5a9800c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-13T11:29:33.311 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:33.298+0000 7f5aa97fa640 1 -- 172.21.15.102:0/979103313 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a98005220 con 0x7f5aac0cd960 2023-11-13T11:29:33.311 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:33.298+0000 7f5aa97fa640 1 -- 172.21.15.102:0/979103313 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a98005380 con 0x7f5aac0cd960 2023-11-13T11:29:33.311 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:33.298+0000 7f5ab306b640 1 -- 172.21.15.102:0/979103313 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5aac150820 con 0x7f5aac0cd960 2023-11-13T11:29:33.312 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:33.298+0000 7f5aa97fa640 1 -- 172.21.15.102:0/979103313 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a98007270 con 0x7f5aac0cd960 2023-11-13T11:29:33.312 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:33.298+0000 7f5ab306b640 1 -- 172.21.15.102:0/979103313 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5aac151560 con 0x7f5aac0cd960 2023-11-13T11:29:33.312 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:33.298+0000 7f5ab306b640 1 -- 172.21.15.102:0/979103313 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5aac0b3ec0 con 0x7f5aac0cd960 2023-11-13T11:29:33.313 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:33.302+0000 7f5aa97fa640 1 -- 172.21.15.102:0/979103313 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f5a980073d0 con 0x7f5aac0cd960 2023-11-13T11:29:33.314 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:33.302+0000 7f5aa97fa640 1 --2- 172.21.15.102:0/979103313 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f5a90066470 0x7f5a90068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:33.314 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:33.302+0000 7f5aa97fa640 1 -- 172.21.15.102:0/979103313 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f5a98083800 con 0x7f5aac0cd960 2023-11-13T11:29:33.314 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:33.302+0000 7f5ab0e07640 1 --2- 172.21.15.102:0/979103313 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f5a90066470 0x7f5a90068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:33.314 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:33.302+0000 7f5ab0e07640 1 --2- 172.21.15.102:0/979103313 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f5a90066470 0x7f5a90068930 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f5aa0000c10 tx=0x7f5aa00011b0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-13T11:29:33.315 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:33.306+0000 7f5aa97fa640 1 -- 172.21.15.102:0/979103313 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f5a98050bf0 con 0x7f5aac0cd960 2023-11-13T11:29:33.473 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:33.466+0000 7f5ab306b640 1 -- 172.21.15.102:0/979103313 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f5aac068520 con 0x7f5aac0cd960 2023-11-13T11:29:33.473 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:33.466+0000 7f5aa97fa640 1 -- 172.21.15.102:0/979103313 <== mon.0 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v22) v1 ==== 80+0+0 (secure 0 0 0) 0x7f5a98054210 con 0x7f5aac0cd960 2023-11-13T11:29:33.473 INFO:teuthology.orchestra.run.smithi102.stderr:listed 0 entries 2023-11-13T11:29:33.475 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:33.470+0000 7f5ab306b640 1 -- 172.21.15.102:0/979103313 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f5a90066470 msgr2=0x7f5a90068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:33.475 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:33.470+0000 7f5ab306b640 1 --2- 172.21.15.102:0/979103313 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f5a90066470 0x7f5a90068930 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f5aa0000c10 tx=0x7f5aa00011b0 comp rx=0 tx=0).stop 2023-11-13T11:29:33.476 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:33.470+0000 7f5ab306b640 1 -- 172.21.15.102:0/979103313 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5aac0cd960 msgr2=0x7f5aac0af2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:33.476 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:33.470+0000 7f5ab306b640 1 --2- 172.21.15.102:0/979103313 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5aac0cd960 0x7f5aac0af2e0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f5a9800c500 tx=0x7f5a9800c9c0 comp rx=0 tx=0).stop 2023-11-13T11:29:33.476 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:33.470+0000 7f5ab306b640 1 -- 172.21.15.102:0/979103313 shutdown_connections 2023-11-13T11:29:33.476 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:33.470+0000 7f5ab306b640 1 --2- 172.21.15.102:0/979103313 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5aac159420 0x7f5aac0af820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:33.477 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:33.470+0000 7f5ab306b640 1 --2- 172.21.15.102:0/979103313 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f5a90066470 0x7f5a90068930 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:33.477 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:33.470+0000 7f5ab306b640 1 --2- 172.21.15.102:0/979103313 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5aac0cd960 0x7f5aac0af2e0 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:33.477 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:33.470+0000 7f5ab306b640 1 --2- 172.21.15.102:0/979103313 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5aac0cae80 0x7f5aac151020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:33.477 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:33.470+0000 7f5ab306b640 1 -- 172.21.15.102:0/979103313 >> 172.21.15.102:0/979103313 conn(0x7f5aac0b0870 msgr2=0x7f5aac155880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-13T11:29:33.477 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:33.470+0000 7f5ab306b640 1 -- 172.21.15.102:0/979103313 shutdown_connections 2023-11-13T11:29:33.478 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:33.470+0000 7f5ab306b640 1 -- 172.21.15.102:0/979103313 wait complete. 2023-11-13T11:29:33.494 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2023-11-13T11:29:33.495 DEBUG:teuthology.orchestra.run.smithi154:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-13T11:29:33.506 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-13T11:29:33.643 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:33.638+0000 7f04bb294640 1 Processor -- start 2023-11-13T11:29:33.644 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:33.638+0000 7f04bb294640 1 -- start start 2023-11-13T11:29:33.645 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:33.638+0000 7f04bb294640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f04b4140540 0x7f04b415e3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:33.645 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:33.638+0000 7f04bb294640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f04b4071900 0x7f04b40b1c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:33.645 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:33.638+0000 7f04bb294640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f04b415e910 con 0x7f04b406caa0 2023-11-13T11:29:33.646 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:33.638+0000 7f04bb294640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f04b4140920 con 0x7f04b4140540 2023-11-13T11:29:33.646 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:33.638+0000 7f04bb294640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f04b40ccc50 con 0x7f04b4071900 2023-11-13T11:29:33.646 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:33.638+0000 7f04b9030640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f04b4140540 0x7f04b415e3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:33.646 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:33.638+0000 7f04b9030640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f04b4140540 0x7f04b415e3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:48310/0 (socket says 172.21.15.102:48310) 2023-11-13T11:29:33.646 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:33.638+0000 7f04b9030640 1 -- 172.21.15.102:0/399216914 learned_addr learned my addr 172.21.15.102:0/399216914 (peer_addr_for_me v2:172.21.15.102:0/0) 2023-11-13T11:29:33.647 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:33.638+0000 7f04b9030640 1 -- 172.21.15.102:0/399216914 >> v2:172.21.15.154:3300/0 conn(0x7f04b4071900 msgr2=0x7f04b40b1c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-13T11:29:33.647 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:33.638+0000 7f04b9030640 1 --2- 172.21.15.102:0/399216914 >> v2:172.21.15.154:3300/0 conn(0x7f04b4071900 0x7f04b40b1c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:33.648 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:33.638+0000 7f04b9030640 1 -- 172.21.15.102:0/399216914 >> v1:172.21.15.154:6789/0 conn(0x7f04b406caa0 legacy=0x7f04b40711f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-13T11:29:33.648 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:33.638+0000 7f04b9030640 1 -- 172.21.15.102:0/399216914 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04b406cfc0 con 0x7f04b4140540 2023-11-13T11:29:33.648 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:33.642+0000 7f04b9030640 1 --2- 172.21.15.102:0/399216914 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f04b4140540 0x7f04b415e3d0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f04b40cb560 tx=0x7f04b001c4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8561869f7616dcf7 server_cookie=0 in_seq=0 out_seq=0 2023-11-13T11:29:33.649 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:33.642+0000 7f04abfff640 1 -- 172.21.15.102:0/399216914 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04b00aa610 con 0x7f04b4140540 2023-11-13T11:29:33.649 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:33.642+0000 7f04abfff640 1 -- 172.21.15.102:0/399216914 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f04b00a6040 con 0x7f04b4140540 2023-11-13T11:29:33.649 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:33.642+0000 7f04abfff640 1 -- 172.21.15.102:0/399216914 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04b00aa990 con 0x7f04b4140540 2023-11-13T11:29:33.650 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:33.642+0000 7f04bb294640 1 -- 172.21.15.102:0/399216914 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f04b4140540 msgr2=0x7f04b415e3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:33.650 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:33.642+0000 7f04bb294640 1 --2- 172.21.15.102:0/399216914 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f04b4140540 0x7f04b415e3d0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f04b40cb560 tx=0x7f04b001c4b0 comp rx=0 tx=0).stop 2023-11-13T11:29:33.651 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:33.642+0000 7f04bb294640 1 -- 172.21.15.102:0/399216914 shutdown_connections 2023-11-13T11:29:33.651 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:33.642+0000 7f04bb294640 1 --2- 172.21.15.102:0/399216914 >> v2:172.21.15.154:3300/0 conn(0x7f04b4071900 0x7f04b40b1c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:33.651 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:33.642+0000 7f04bb294640 1 --2- 172.21.15.102:0/399216914 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f04b4140540 0x7f04b415e3d0 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:33.651 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:33.642+0000 7f04bb294640 1 -- 172.21.15.102:0/399216914 >> 172.21.15.102:0/399216914 conn(0x7f04b40b0870 msgr2=0x7f04b40b0c80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-13T11:29:33.651 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:33.642+0000 7f04bb294640 1 -- 172.21.15.102:0/399216914 shutdown_connections 2023-11-13T11:29:33.652 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:33.642+0000 7f04bb294640 1 -- 172.21.15.102:0/399216914 wait complete. 2023-11-13T11:29:33.657 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:33.646+0000 7f04bb294640 1 Processor -- start 2023-11-13T11:29:33.657 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:33.646+0000 7f04bb294640 1 -- start start 2023-11-13T11:29:33.657 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:33.646+0000 7f04bb294640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f04b406caa0 0x7f04b415c150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:33.658 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:33.646+0000 7f04bb294640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f04b4071900 0x7f04b4152650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:33.658 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:33.646+0000 7f04bb294640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f04b4140540 0x7f04b4152b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:33.659 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:33.646+0000 7f04bb294640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04b4156340 con 0x7f04b4140540 2023-11-13T11:29:33.659 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:33.646+0000 7f04bb294640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04b4153230 con 0x7f04b4071900 2023-11-13T11:29:33.659 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:33.646+0000 7f04bb294640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f04b4153510 con 0x7f04b406caa0 2023-11-13T11:29:33.660 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:33.646+0000 7f04b9831640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f04b4140540 0x7f04b4152b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:33.660 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:33.646+0000 7f04b9831640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f04b4140540 0x7f04b4152b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:48312/0 (socket says 172.21.15.102:48312) 2023-11-13T11:29:33.660 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:33.646+0000 7f04b9831640 1 -- 172.21.15.102:0/800203198 learned_addr learned my addr 172.21.15.102:0/800203198 (peer_addr_for_me v2:172.21.15.102:0/0) 2023-11-13T11:29:33.662 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:33.646+0000 7f04b9030640 1 --2- 172.21.15.102:0/800203198 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f04b406caa0 0x7f04b415c150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:33.662 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:33.646+0000 7f04b882f640 1 --2- 172.21.15.102:0/800203198 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f04b4071900 0x7f04b4152650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:33.662 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:33.646+0000 7f04b9831640 1 -- 172.21.15.102:0/800203198 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f04b406caa0 msgr2=0x7f04b415c150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:33.662 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:33.646+0000 7f04b9831640 1 --2- 172.21.15.102:0/800203198 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f04b406caa0 0x7f04b415c150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:33.663 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:33.646+0000 7f04b9831640 1 -- 172.21.15.102:0/800203198 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f04b4071900 msgr2=0x7f04b4152650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:33.663 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:33.646+0000 7f04b9831640 1 --2- 172.21.15.102:0/800203198 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f04b4071900 0x7f04b4152650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:33.663 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:33.646+0000 7f04b9831640 1 -- 172.21.15.102:0/800203198 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04b00094d0 con 0x7f04b4140540 2023-11-13T11:29:33.664 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:33.646+0000 7f04b9030640 1 --2- 172.21.15.102:0/800203198 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f04b406caa0 0x7f04b415c150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-13T11:29:33.664 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:33.646+0000 7f04b9831640 1 --2- 172.21.15.102:0/800203198 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f04b4140540 0x7f04b4152b90 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f04ac00b9e0 tx=0x7f04ac00bea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-13T11:29:33.664 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:33.646+0000 7f04a9ffb640 1 -- 172.21.15.102:0/800203198 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04ac00cb20 con 0x7f04b4140540 2023-11-13T11:29:33.664 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:33.646+0000 7f04a9ffb640 1 -- 172.21.15.102:0/800203198 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f04ac00cc80 con 0x7f04b4140540 2023-11-13T11:29:33.664 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:33.646+0000 7f04a9ffb640 1 -- 172.21.15.102:0/800203198 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04ac014680 con 0x7f04b4140540 2023-11-13T11:29:33.664 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:33.646+0000 7f04bb294640 1 -- 172.21.15.102:0/800203198 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f04b41537f0 con 0x7f04b4140540 2023-11-13T11:29:33.665 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:33.646+0000 7f04bb294640 1 -- 172.21.15.102:0/800203198 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f04b4153db0 con 0x7f04b4140540 2023-11-13T11:29:33.665 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:33.650+0000 7f04bb294640 1 -- 172.21.15.102:0/800203198 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f04b4153fd0 con 0x7f04b4140540 2023-11-13T11:29:33.665 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:33.650+0000 7f04a9ffb640 1 -- 172.21.15.102:0/800203198 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f04ac01d3b0 con 0x7f04b4140540 2023-11-13T11:29:33.665 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:33.650+0000 7f04a9ffb640 1 --2- 172.21.15.102:0/800203198 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f0498066470 0x7f0498068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:33.665 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:33.650+0000 7f04a9ffb640 1 -- 172.21.15.102:0/800203198 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f04ac083e30 con 0x7f04b4140540 2023-11-13T11:29:33.666 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:33.650+0000 7f04b9030640 1 --2- 172.21.15.102:0/800203198 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f0498066470 0x7f0498068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:33.666 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:33.650+0000 7f04b9030640 1 --2- 172.21.15.102:0/800203198 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f0498066470 0x7f0498068930 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f04b00ae000 tx=0x7f04b00a7000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-13T11:29:33.667 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:33.654+0000 7f04a9ffb640 1 -- 172.21.15.102:0/800203198 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f04ac051210 con 0x7f04b4140540 2023-11-13T11:29:33.814 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:33.806+0000 7f04bb294640 1 -- 172.21.15.102:0/800203198 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f04b4068520 con 0x7f04b4140540 2023-11-13T11:29:33.815 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:33.810+0000 7f04a9ffb640 1 -- 172.21.15.102:0/800203198 <== mon.0 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+16545 (secure 0 0 0) 0x7f04ac019090 con 0x7f04b4140540 2023-11-13T11:29:33.815 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T11:29:33.816 INFO:teuthology.orchestra.run.smithi102.stdout:{"epoch":22,"fsid":"97b3eb2b-7ccf-4aae-8d92-bff986c671ea","created":"2023-11-13T11:28:31.836724+0000","modified":"2023-11-13T11:28:58.608314+0000","last_up_change":"2023-11-13T11:28:44.876638+0000","last_in_change":"2023-11-13T11:28:35.312740+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-13T11:28:44.981356+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-13T11:28:55.958525+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-13T11:28:56.394264+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"bdefaa17-fcca-4c86-aa40-27dc33a789af","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6800","nonce":53303834},{"type":"v1","addr":"172.21.15.102:6801","nonce":53303834}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6802","nonce":53303834},{"type":"v1","addr":"172.21.15.102:6803","nonce":53303834}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6806","nonce":53303834},{"type":"v1","addr":"172.21.15.102:6807","nonce":53303834}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6804","nonce":53303834},{"type":"v1","addr":"172.21.15.102:6805","nonce":53303834}]},"public_addr":"172.21.15.102:6801/53303834","cluster_addr":"172.21.15.102:6803/53303834","heartbeat_back_addr":"172.21.15.102:6807/53303834","heartbeat_front_addr":"172.21.15.102:6805/53303834","state":["exists","up"]},{"osd":1,"uuid":"f0033196-dec9-4ae9-945e-6aeef6dbb47f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6808","nonce":1732708348},{"type":"v1","addr":"172.21.15.102:6809","nonce":1732708348}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6811","nonce":1732708348},{"type":"v1","addr":"172.21.15.102:6813","nonce":1732708348}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6818","nonce":1732708348},{"type":"v1","addr":"172.21.15.102:6820","nonce":1732708348}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6815","nonce":1732708348},{"type":"v1","addr":"172.21.15.102:6817","nonce":1732708348}]},"public_addr":"172.21.15.102:6809/1732708348","cluster_addr":"172.21.15.102:6813/1732708348","heartbeat_back_addr":"172.21.15.102:6820/1732708348","heartbeat_front_addr":"172.21.15.102:6817/1732708348","state":["exists","up"]},{"osd":2,"uuid":"496b0834-351e-4ec2-a714-86ed0c0ff4fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6810","nonce":1825475150},{"type":"v1","addr":"172.21.15.102:6812","nonce":1825475150}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6814","nonce":1825475150},{"type":"v1","addr":"172.21.15.102:6816","nonce":1825475150}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6822","nonce":1825475150},{"type":"v1","addr":"172.21.15.102:6823","nonce":1825475150}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6819","nonce":1825475150},{"type":"v1","addr":"172.21.15.102:6821","nonce":1825475150}]},"public_addr":"172.21.15.102:6812/1825475150","cluster_addr":"172.21.15.102:6816/1825475150","heartbeat_back_addr":"172.21.15.102:6823/1825475150","heartbeat_front_addr":"172.21.15.102:6821/1825475150","state":["exists","up"]},{"osd":3,"uuid":"3ba6cc41-e0a0-4273-86cb-90000c06a55a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6824","nonce":4149355528},{"type":"v1","addr":"172.21.15.102:6825","nonce":4149355528}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6826","nonce":4149355528},{"type":"v1","addr":"172.21.15.102:6827","nonce":4149355528}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6830","nonce":4149355528},{"type":"v1","addr":"172.21.15.102:6831","nonce":4149355528}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6828","nonce":4149355528},{"type":"v1","addr":"172.21.15.102:6829","nonce":4149355528}]},"public_addr":"172.21.15.102:6825/4149355528","cluster_addr":"172.21.15.102:6827/4149355528","heartbeat_back_addr":"172.21.15.102:6831/4149355528","heartbeat_front_addr":"172.21.15.102:6829/4149355528","state":["exists","up"]},{"osd":4,"uuid":"16e797d8-e6e7-4140-95c3-b85283c42a2a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6808","nonce":4028899241},{"type":"v1","addr":"172.21.15.154:6809","nonce":4028899241}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6810","nonce":4028899241},{"type":"v1","addr":"172.21.15.154:6811","nonce":4028899241}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6814","nonce":4028899241},{"type":"v1","addr":"172.21.15.154:6815","nonce":4028899241}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6812","nonce":4028899241},{"type":"v1","addr":"172.21.15.154:6813","nonce":4028899241}]},"public_addr":"172.21.15.154:6809/4028899241","cluster_addr":"172.21.15.154:6811/4028899241","heartbeat_back_addr":"172.21.15.154:6815/4028899241","heartbeat_front_addr":"172.21.15.154:6813/4028899241","state":["exists","up"]},{"osd":5,"uuid":"d6ab225c-1b55-450a-89a9-abe5c3f8d6af","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":3562396827},{"type":"v1","addr":"172.21.15.154:6801","nonce":3562396827}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":3562396827},{"type":"v1","addr":"172.21.15.154:6803","nonce":3562396827}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6806","nonce":3562396827},{"type":"v1","addr":"172.21.15.154:6807","nonce":3562396827}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6804","nonce":3562396827},{"type":"v1","addr":"172.21.15.154:6805","nonce":3562396827}]},"public_addr":"172.21.15.154:6801/3562396827","cluster_addr":"172.21.15.154:6803/3562396827","heartbeat_back_addr":"172.21.15.154:6807/3562396827","heartbeat_front_addr":"172.21.15.154:6805/3562396827","state":["exists","up"]},{"osd":6,"uuid":"96f905ac-491c-4662-8e2b-5bb8e929ab9d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6816","nonce":2933728751},{"type":"v1","addr":"172.21.15.154:6817","nonce":2933728751}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6818","nonce":2933728751},{"type":"v1","addr":"172.21.15.154:6819","nonce":2933728751}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6822","nonce":2933728751},{"type":"v1","addr":"172.21.15.154:6823","nonce":2933728751}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6820","nonce":2933728751},{"type":"v1","addr":"172.21.15.154:6821","nonce":2933728751}]},"public_addr":"172.21.15.154:6817/2933728751","cluster_addr":"172.21.15.154:6819/2933728751","heartbeat_back_addr":"172.21.15.154:6823/2933728751","heartbeat_front_addr":"172.21.15.154:6821/2933728751","state":["exists","up"]},{"osd":7,"uuid":"07012d3b-3ab4-40df-a471-93caed22e2dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6824","nonce":1753500785},{"type":"v1","addr":"172.21.15.154:6825","nonce":1753500785}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6826","nonce":1753500785},{"type":"v1","addr":"172.21.15.154:6827","nonce":1753500785}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6830","nonce":1753500785},{"type":"v1","addr":"172.21.15.154:6831","nonce":1753500785}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6828","nonce":1753500785},{"type":"v1","addr":"172.21.15.154:6829","nonce":1753500785}]},"public_addr":"172.21.15.154:6825/1753500785","cluster_addr":"172.21.15.154:6827/1753500785","heartbeat_back_addr":"172.21.15.154:6831/1753500785","heartbeat_front_addr":"172.21.15.154:6829/1753500785","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-13T11:28:40.978603+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-13T11:28:41.200985+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-13T11:28:41.222815+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-13T11:28:41.202162+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-13T11:28:40.925911+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-13T11:28:41.087725+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-13T11:28:41.072208+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-13T11:28:40.875257+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-13T11:29:33.817 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:33.810+0000 7f04bb294640 1 -- 172.21.15.102:0/800203198 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f0498066470 msgr2=0x7f0498068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:33.818 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:33.810+0000 7f04bb294640 1 --2- 172.21.15.102:0/800203198 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f0498066470 0x7f0498068930 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f04b00ae000 tx=0x7f04b00a7000 comp rx=0 tx=0).stop 2023-11-13T11:29:33.818 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:33.810+0000 7f04bb294640 1 -- 172.21.15.102:0/800203198 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f04b4140540 msgr2=0x7f04b4152b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:33.818 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:33.810+0000 7f04bb294640 1 --2- 172.21.15.102:0/800203198 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f04b4140540 0x7f04b4152b90 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f04ac00b9e0 tx=0x7f04ac00bea0 comp rx=0 tx=0).stop 2023-11-13T11:29:33.818 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:33.810+0000 7f04bb294640 1 -- 172.21.15.102:0/800203198 shutdown_connections 2023-11-13T11:29:33.819 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:33.810+0000 7f04bb294640 1 --2- 172.21.15.102:0/800203198 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f0498066470 0x7f0498068930 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:33.819 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:33.810+0000 7f04bb294640 1 --2- 172.21.15.102:0/800203198 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f04b4140540 0x7f04b4152b90 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:33.821 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:33.810+0000 7f04bb294640 1 --2- 172.21.15.102:0/800203198 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f04b4071900 0x7f04b4152650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:33.821 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:33.810+0000 7f04bb294640 1 --2- 172.21.15.102:0/800203198 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f04b406caa0 0x7f04b415c150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:33.822 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:33.810+0000 7f04bb294640 1 -- 172.21.15.102:0/800203198 >> 172.21.15.102:0/800203198 conn(0x7f04b40b0870 msgr2=0x7f04b415cf10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-13T11:29:33.822 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:33.810+0000 7f04bb294640 1 -- 172.21.15.102:0/800203198 shutdown_connections 2023-11-13T11:29:33.822 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:33.810+0000 7f04bb294640 1 -- 172.21.15.102:0/800203198 wait complete. 2023-11-13T11:29:33.836 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-13T11:28:44.981356+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-13T11:28:55.958525+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-11-13T11:28:56.394264+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-13T11:29:33.837 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-13T11:29:33.977 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:33.970+0000 7f2cea98d640 1 Processor -- start 2023-11-13T11:29:33.977 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:33.970+0000 7f2cea98d640 1 -- start start 2023-11-13T11:29:33.978 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:33.970+0000 7f2cea98d640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2ce4159b30 0x7f2ce406fc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:33.979 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:33.970+0000 7f2cea98d640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f2ce40711c0 0x7f2ce40b3520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:33.979 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:33.970+0000 7f2cea98d640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2ce4071620 con 0x7f2ce40cebc0 2023-11-13T11:29:33.979 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:33.970+0000 7f2cea98d640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2ce40b21f0 con 0x7f2ce40711c0 2023-11-13T11:29:33.979 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:33.970+0000 7f2cea98d640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ce40b2440 con 0x7f2ce4159b30 2023-11-13T11:29:33.979 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:33.970+0000 7f2ce37fe640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f2ce40711c0 0x7f2ce40b3520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:33.980 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:33.974+0000 7f2ce8f2a640 1 --1- >> v1:172.21.15.102:6789/0 conn(0x7f2ce40cebc0 0x7f2ce40cbe90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.102:6789/0 says I am v1:172.21.15.102:36190/0 (socket says 172.21.15.102:36190) 2023-11-13T11:29:33.980 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:33.974+0000 7f2ce8f2a640 1 -- 172.21.15.102:0/2326547466 learned_addr learned my addr 172.21.15.102:0/2326547466 (peer_addr_for_me v1:172.21.15.102:0/0) 2023-11-13T11:29:33.980 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:33.974+0000 7f2ce3fff640 1 --2- 172.21.15.102:0/2326547466 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2ce4159b30 0x7f2ce406fc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:33.981 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:33.974+0000 7f2ce37fe640 1 -- 172.21.15.102:0/2326547466 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2ce4159b30 msgr2=0x7f2ce406fc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-13T11:29:33.981 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:33.974+0000 7f2ce37fe640 1 --2- 172.21.15.102:0/2326547466 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2ce4159b30 0x7f2ce406fc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:33.981 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:33.974+0000 7f2ce37fe640 1 -- 172.21.15.102:0/2326547466 >> v1:172.21.15.102:6789/0 conn(0x7f2ce40cebc0 legacy=0x7f2ce40cbe90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:33.981 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:33.974+0000 7f2ce37fe640 1 -- 172.21.15.102:0/2326547466 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ce40b2720 con 0x7f2ce40711c0 2023-11-13T11:29:33.982 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:33.974+0000 7f2ce2ffd640 1 -- 172.21.15.102:0/2326547466 <== mon.0 v1:172.21.15.102:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3899269705 0 0) 0x7f2cdc0014a0 con 0x7f2ce40cebc0 2023-11-13T11:29:33.983 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:33.974+0000 7f2ce37fe640 1 --2- 172.21.15.102:0/2326547466 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2ce40711c0 0x7f2ce40b3520 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f2cd80097c0 tx=0x7f2cd801c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e5da25df1273cd5e server_cookie=0 in_seq=0 out_seq=0 2023-11-13T11:29:33.983 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:33.974+0000 7f2ce2ffd640 1 -- 172.21.15.102:0/2326547466 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cd80ac620 con 0x7f2ce40711c0 2023-11-13T11:29:33.983 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:33.974+0000 7f2ce2ffd640 1 -- 172.21.15.102:0/2326547466 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2cd80ac780 con 0x7f2ce40711c0 2023-11-13T11:29:33.983 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:33.974+0000 7f2ce2ffd640 1 -- 172.21.15.102:0/2326547466 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cd80acb10 con 0x7f2ce40711c0 2023-11-13T11:29:33.983 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:33.978+0000 7f2cea98d640 1 -- 172.21.15.102:0/2326547466 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2ce40711c0 msgr2=0x7f2ce40b3520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:33.984 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:33.978+0000 7f2cea98d640 1 --2- 172.21.15.102:0/2326547466 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2ce40711c0 0x7f2ce40b3520 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f2cd80097c0 tx=0x7f2cd801c450 comp rx=0 tx=0).stop 2023-11-13T11:29:33.984 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:33.978+0000 7f2cea98d640 1 -- 172.21.15.102:0/2326547466 shutdown_connections 2023-11-13T11:29:33.984 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:33.978+0000 7f2cea98d640 1 --2- 172.21.15.102:0/2326547466 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2ce40711c0 0x7f2ce40b3520 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:33.984 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:33.978+0000 7f2cea98d640 1 --2- 172.21.15.102:0/2326547466 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2ce4159b30 0x7f2ce406fc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:33.984 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:33.978+0000 7f2cea98d640 1 -- 172.21.15.102:0/2326547466 >> 172.21.15.102:0/2326547466 conn(0x7f2ce406a410 msgr2=0x7f2ce406a820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-13T11:29:33.985 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:33.978+0000 7f2cea98d640 1 -- 172.21.15.102:0/2326547466 shutdown_connections 2023-11-13T11:29:33.985 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:33.978+0000 7f2cea98d640 1 -- 172.21.15.102:0/2326547466 wait complete. 2023-11-13T11:29:33.987 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:33.978+0000 7f2cea98d640 1 Processor -- start 2023-11-13T11:29:33.987 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:33.978+0000 7f2cea98d640 1 -- start start 2023-11-13T11:29:33.987 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:33.978+0000 7f2cea98d640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2ce40711c0 0x7f2ce4145630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:33.988 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:33.978+0000 7f2cea98d640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2ce40cebc0 0x7f2ce4143480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:33.988 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:33.978+0000 7f2cea98d640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2ce4159b30 0x7f2ce4143bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:33.988 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:33.978+0000 7f2cea98d640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ce4144e50 con 0x7f2ce40711c0 2023-11-13T11:29:33.988 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:33.978+0000 7f2cea98d640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ce4145b70 con 0x7f2ce40cebc0 2023-11-13T11:29:33.988 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:33.978+0000 7f2cea98d640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ce41439c0 con 0x7f2ce4159b30 2023-11-13T11:29:33.989 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:33.978+0000 7f2ce3fff640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2ce40711c0 0x7f2ce4145630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:33.989 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:33.978+0000 7f2ce3fff640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2ce40711c0 0x7f2ce4145630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:48330/0 (socket says 172.21.15.102:48330) 2023-11-13T11:29:33.989 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:33.978+0000 7f2ce3fff640 1 -- 172.21.15.102:0/724366796 learned_addr learned my addr 172.21.15.102:0/724366796 (peer_addr_for_me v2:172.21.15.102:0/0) 2023-11-13T11:29:33.989 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:33.978+0000 7f2ce37fe640 1 --2- 172.21.15.102:0/724366796 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2ce40cebc0 0x7f2ce4143480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:33.989 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:33.978+0000 7f2ce8f2a640 1 --2- 172.21.15.102:0/724366796 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2ce4159b30 0x7f2ce4143bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:33.990 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:33.978+0000 7f2ce3fff640 1 -- 172.21.15.102:0/724366796 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2ce4159b30 msgr2=0x7f2ce4143bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:33.990 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:33.978+0000 7f2ce3fff640 1 --2- 172.21.15.102:0/724366796 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2ce4159b30 0x7f2ce4143bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:33.990 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:33.978+0000 7f2ce3fff640 1 -- 172.21.15.102:0/724366796 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2ce40cebc0 msgr2=0x7f2ce4143480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:33.990 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:33.978+0000 7f2ce3fff640 1 --2- 172.21.15.102:0/724366796 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2ce40cebc0 0x7f2ce4143480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:33.990 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:33.978+0000 7f2ce3fff640 1 -- 172.21.15.102:0/724366796 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2cd8009420 con 0x7f2ce40711c0 2023-11-13T11:29:33.991 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:33.982+0000 7f2ce3fff640 1 --2- 172.21.15.102:0/724366796 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2ce40711c0 0x7f2ce4145630 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f2cd400e8a0 tx=0x7f2cd400eca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-13T11:29:33.991 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:33.982+0000 7f2ce0ff9640 1 -- 172.21.15.102:0/724366796 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cd4009510 con 0x7f2ce40711c0 2023-11-13T11:29:33.991 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:33.982+0000 7f2ce0ff9640 1 -- 172.21.15.102:0/724366796 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2cd400c940 con 0x7f2ce40711c0 2023-11-13T11:29:33.991 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:33.982+0000 7f2cea98d640 1 -- 172.21.15.102:0/724366796 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2ce40ae100 con 0x7f2ce40711c0 2023-11-13T11:29:33.991 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:33.982+0000 7f2ce0ff9640 1 -- 172.21.15.102:0/724366796 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cd400ccb0 con 0x7f2ce40711c0 2023-11-13T11:29:33.991 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:33.982+0000 7f2cea98d640 1 -- 172.21.15.102:0/724366796 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2ce40ae940 con 0x7f2ce40711c0 2023-11-13T11:29:33.993 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:33.982+0000 7f2cea98d640 1 -- 172.21.15.102:0/724366796 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2ce4067640 con 0x7f2ce40711c0 2023-11-13T11:29:33.993 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:33.982+0000 7f2ce0ff9640 1 -- 172.21.15.102:0/724366796 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f2cd4013470 con 0x7f2ce40711c0 2023-11-13T11:29:33.993 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:33.982+0000 7f2ce0ff9640 1 --2- 172.21.15.102:0/724366796 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f2cd0066470 0x7f2cd0068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:33.993 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:33.982+0000 7f2ce0ff9640 1 -- 172.21.15.102:0/724366796 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f2cd4083f00 con 0x7f2ce40711c0 2023-11-13T11:29:33.994 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:33.982+0000 7f2ce37fe640 1 --2- 172.21.15.102:0/724366796 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f2cd0066470 0x7f2cd0068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:33.994 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:33.986+0000 7f2ce37fe640 1 --2- 172.21.15.102:0/724366796 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f2cd0066470 0x7f2cd0068930 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f2cd80ae000 tx=0x7f2cd8008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-13T11:29:33.994 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:33.986+0000 7f2ce0ff9640 1 -- 172.21.15.102:0/724366796 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f2cd4051410 con 0x7f2ce40711c0 2023-11-13T11:29:34.145 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:34.138+0000 7f2cea98d640 1 -- 172.21.15.102:0/724366796 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f2ce4068520 con 0x7f2ce40711c0 2023-11-13T11:29:34.145 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:34.138+0000 7f2ce0ff9640 1 -- 172.21.15.102:0/724366796 <== mon.0 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v22) v1 ==== 93+0+10 (secure 0 0 0) 0x7f2cd4017020 con 0x7f2ce40711c0 2023-11-13T11:29:34.146 INFO:teuthology.orchestra.run.smithi102.stdout:pg_num: 1 2023-11-13T11:29:34.147 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:34.138+0000 7f2cea98d640 1 -- 172.21.15.102:0/724366796 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f2cd0066470 msgr2=0x7f2cd0068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:34.148 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:34.138+0000 7f2cea98d640 1 --2- 172.21.15.102:0/724366796 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f2cd0066470 0x7f2cd0068930 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f2cd80ae000 tx=0x7f2cd8008040 comp rx=0 tx=0).stop 2023-11-13T11:29:34.148 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:34.138+0000 7f2cea98d640 1 -- 172.21.15.102:0/724366796 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2ce40711c0 msgr2=0x7f2ce4145630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:34.148 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:34.138+0000 7f2cea98d640 1 --2- 172.21.15.102:0/724366796 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2ce40711c0 0x7f2ce4145630 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f2cd400e8a0 tx=0x7f2cd400eca0 comp rx=0 tx=0).stop 2023-11-13T11:29:34.149 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:34.138+0000 7f2cea98d640 1 -- 172.21.15.102:0/724366796 shutdown_connections 2023-11-13T11:29:34.149 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:34.138+0000 7f2cea98d640 1 --2- 172.21.15.102:0/724366796 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2ce4159b30 0x7f2ce4143bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:34.150 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:34.138+0000 7f2cea98d640 1 --2- 172.21.15.102:0/724366796 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2ce40cebc0 0x7f2ce4143480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:34.150 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:34.138+0000 7f2cea98d640 1 --2- 172.21.15.102:0/724366796 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f2cd0066470 0x7f2cd0068930 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:34.150 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:34.138+0000 7f2cea98d640 1 --2- 172.21.15.102:0/724366796 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2ce40711c0 0x7f2ce4145630 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:34.150 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:34.138+0000 7f2cea98d640 1 -- 172.21.15.102:0/724366796 >> 172.21.15.102:0/724366796 conn(0x7f2ce406a410 msgr2=0x7f2ce41534e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-13T11:29:34.151 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:34.138+0000 7f2cea98d640 1 -- 172.21.15.102:0/724366796 shutdown_connections 2023-11-13T11:29:34.151 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:34.138+0000 7f2cea98d640 1 -- 172.21.15.102:0/724366796 wait complete. 2023-11-13T11:29:34.166 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-13T11:29:34.306 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:34.298+0000 7fde564c9640 1 Processor -- start 2023-11-13T11:29:34.306 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:34.298+0000 7fde564c9640 1 -- start start 2023-11-13T11:29:34.308 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:34.302+0000 7fde564c9640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7fde50159b30 0x7fde5006fc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:34.308 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:34.302+0000 7fde564c9640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fde500711c0 0x7fde500b3520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:34.309 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:34.302+0000 7fde564c9640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fde50071620 con 0x7fde500cebc0 2023-11-13T11:29:34.309 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:34.302+0000 7fde564c9640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fde500b21f0 con 0x7fde50159b30 2023-11-13T11:29:34.309 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:34.302+0000 7fde564c9640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fde500b2440 con 0x7fde500711c0 2023-11-13T11:29:34.309 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:34.302+0000 7fde4ffff640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7fde50159b30 0x7fde5006fc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:34.309 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:34.302+0000 7fde4ffff640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7fde50159b30 0x7fde5006fc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:48342/0 (socket says 172.21.15.102:48342) 2023-11-13T11:29:34.310 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:34.302+0000 7fde4ffff640 1 -- 172.21.15.102:0/1024938726 learned_addr learned my addr 172.21.15.102:0/1024938726 (peer_addr_for_me v2:172.21.15.102:0/0) 2023-11-13T11:29:34.310 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:34.302+0000 7fde54a66640 1 --1- >> v1:172.21.15.102:6789/0 conn(0x7fde500cebc0 0x7fde500cbe90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.102:6789/0 says I am v1:172.21.15.102:36202/0 (socket says 172.21.15.102:36202) 2023-11-13T11:29:34.310 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:34.302+0000 7fde4f7fe640 1 --2- 172.21.15.102:0/1024938726 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fde500711c0 0x7fde500b3520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:34.310 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:34.302+0000 7fde4ffff640 1 -- 172.21.15.102:0/1024938726 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fde500711c0 msgr2=0x7fde500b3520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-13T11:29:34.310 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:34.302+0000 7fde4ffff640 1 --2- 172.21.15.102:0/1024938726 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fde500711c0 0x7fde500b3520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:34.311 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:34.302+0000 7fde4ffff640 1 -- 172.21.15.102:0/1024938726 >> v1:172.21.15.102:6789/0 conn(0x7fde500cebc0 legacy=0x7fde500cbe90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:34.311 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:34.302+0000 7fde4ffff640 1 -- 172.21.15.102:0/1024938726 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde500b2720 con 0x7fde50159b30 2023-11-13T11:29:34.313 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:34.306+0000 7fde4ffff640 1 --2- 172.21.15.102:0/1024938726 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fde50159b30 0x7fde5006fc80 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fde40009870 tx=0x7fde4001c510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bb01f8d390e8f4a6 server_cookie=0 in_seq=0 out_seq=0 2023-11-13T11:29:34.313 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:34.306+0000 7fde4effd640 1 -- 172.21.15.102:0/1024938726 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde400ab680 con 0x7fde50159b30 2023-11-13T11:29:34.313 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:34.306+0000 7fde4effd640 1 -- 172.21.15.102:0/1024938726 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde400ab7e0 con 0x7fde50159b30 2023-11-13T11:29:34.314 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:34.306+0000 7fde4effd640 1 -- 172.21.15.102:0/1024938726 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde400abb70 con 0x7fde50159b30 2023-11-13T11:29:34.314 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:34.306+0000 7fde564c9640 1 -- 172.21.15.102:0/1024938726 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fde50159b30 msgr2=0x7fde5006fc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:34.314 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:34.306+0000 7fde564c9640 1 --2- 172.21.15.102:0/1024938726 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fde50159b30 0x7fde5006fc80 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fde40009870 tx=0x7fde4001c510 comp rx=0 tx=0).stop 2023-11-13T11:29:34.314 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:34.306+0000 7fde564c9640 1 -- 172.21.15.102:0/1024938726 shutdown_connections 2023-11-13T11:29:34.314 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:34.306+0000 7fde564c9640 1 --2- 172.21.15.102:0/1024938726 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fde500711c0 0x7fde500b3520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:34.315 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:34.306+0000 7fde564c9640 1 --2- 172.21.15.102:0/1024938726 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fde50159b30 0x7fde5006fc80 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:34.315 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:34.306+0000 7fde564c9640 1 -- 172.21.15.102:0/1024938726 >> 172.21.15.102:0/1024938726 conn(0x7fde5006a410 msgr2=0x7fde5006a820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-13T11:29:34.315 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:34.306+0000 7fde564c9640 1 -- 172.21.15.102:0/1024938726 shutdown_connections 2023-11-13T11:29:34.315 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:34.306+0000 7fde564c9640 1 -- 172.21.15.102:0/1024938726 wait complete. 2023-11-13T11:29:34.319 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:34.306+0000 7fde564c9640 1 Processor -- start 2023-11-13T11:29:34.319 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:34.306+0000 7fde564c9640 1 -- start start 2023-11-13T11:29:34.319 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:34.310+0000 7fde564c9640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fde500711c0 0x7fde5015acd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:34.319 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:34.310+0000 7fde564c9640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fde500cebc0 0x7fde501520f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:34.320 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:34.310+0000 7fde564c9640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fde50159b30 0x7fde5015c970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:34.320 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:34.310+0000 7fde564c9640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde5015c550 con 0x7fde500cebc0 2023-11-13T11:29:34.320 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:34.310+0000 7fde564c9640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde5015b5f0 con 0x7fde50159b30 2023-11-13T11:29:34.321 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:34.310+0000 7fde564c9640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fde5015b8d0 con 0x7fde500711c0 2023-11-13T11:29:34.321 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:34.310+0000 7fde4f7fe640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fde500cebc0 0x7fde501520f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:34.321 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:34.310+0000 7fde4f7fe640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fde500cebc0 0x7fde501520f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:48356/0 (socket says 172.21.15.102:48356) 2023-11-13T11:29:34.321 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:34.310+0000 7fde4f7fe640 1 -- 172.21.15.102:0/3197493592 learned_addr learned my addr 172.21.15.102:0/3197493592 (peer_addr_for_me v2:172.21.15.102:0/0) 2023-11-13T11:29:34.322 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:34.310+0000 7fde4ffff640 1 --2- 172.21.15.102:0/3197493592 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fde500711c0 0x7fde5015acd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:34.322 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:34.310+0000 7fde54a66640 1 --2- 172.21.15.102:0/3197493592 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fde50159b30 0x7fde5015c970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:34.322 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:34.310+0000 7fde4f7fe640 1 -- 172.21.15.102:0/3197493592 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fde500711c0 msgr2=0x7fde5015acd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:34.322 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:34.310+0000 7fde4f7fe640 1 --2- 172.21.15.102:0/3197493592 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fde500711c0 0x7fde5015acd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:34.323 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:34.310+0000 7fde4f7fe640 1 -- 172.21.15.102:0/3197493592 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fde50159b30 msgr2=0x7fde5015c970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:34.323 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:34.310+0000 7fde4f7fe640 1 --2- 172.21.15.102:0/3197493592 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fde50159b30 0x7fde5015c970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:34.323 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:34.310+0000 7fde4f7fe640 1 -- 172.21.15.102:0/3197493592 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde400094d0 con 0x7fde500cebc0 2023-11-13T11:29:34.323 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:34.310+0000 7fde54a66640 1 --2- 172.21.15.102:0/3197493592 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fde50159b30 0x7fde5015c970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-13T11:29:34.323 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:34.310+0000 7fde4f7fe640 1 --2- 172.21.15.102:0/3197493592 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fde500cebc0 0x7fde501520f0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fde4400d7d0 tx=0x7fde4400dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-13T11:29:34.324 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:34.310+0000 7fde4cff9640 1 -- 172.21.15.102:0/3197493592 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde44018070 con 0x7fde500cebc0 2023-11-13T11:29:34.324 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:34.310+0000 7fde4cff9640 1 -- 172.21.15.102:0/3197493592 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde44004020 con 0x7fde500cebc0 2023-11-13T11:29:34.324 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:34.310+0000 7fde4cff9640 1 -- 172.21.15.102:0/3197493592 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde440041d0 con 0x7fde500cebc0 2023-11-13T11:29:34.324 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:34.310+0000 7fde564c9640 1 -- 172.21.15.102:0/3197493592 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fde5015bbb0 con 0x7fde500cebc0 2023-11-13T11:29:34.325 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:34.310+0000 7fde564c9640 1 -- 172.21.15.102:0/3197493592 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fde5015c170 con 0x7fde500cebc0 2023-11-13T11:29:34.325 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:34.310+0000 7fde564c9640 1 -- 172.21.15.102:0/3197493592 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fde50067640 con 0x7fde500cebc0 2023-11-13T11:29:34.325 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:34.310+0000 7fde4cff9640 1 -- 172.21.15.102:0/3197493592 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fde44004330 con 0x7fde500cebc0 2023-11-13T11:29:34.325 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:34.314+0000 7fde4cff9640 1 --2- 172.21.15.102:0/3197493592 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7fde3c066470 0x7fde3c068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:34.325 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:34.314+0000 7fde4cff9640 1 -- 172.21.15.102:0/3197493592 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fde44083da0 con 0x7fde500cebc0 2023-11-13T11:29:34.326 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:34.314+0000 7fde4ffff640 1 --2- 172.21.15.102:0/3197493592 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7fde3c066470 0x7fde3c068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:34.326 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:34.314+0000 7fde4ffff640 1 --2- 172.21.15.102:0/3197493592 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7fde3c066470 0x7fde3c068930 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fde400af000 tx=0x7fde400a7000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-13T11:29:34.326 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:34.318+0000 7fde4cff9640 1 -- 172.21.15.102:0/3197493592 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fde44051190 con 0x7fde500cebc0 2023-11-13T11:29:34.475 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:34.470+0000 7fde564c9640 1 -- 172.21.15.102:0/3197493592 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fde50068520 con 0x7fde500cebc0 2023-11-13T11:29:34.475 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:34.470+0000 7fde4cff9640 1 -- 172.21.15.102:0/3197493592 <== mon.0 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v22) v1 ==== 104+0+11 (secure 0 0 0) 0x7fde440547b0 con 0x7fde500cebc0 2023-11-13T11:29:34.476 INFO:teuthology.orchestra.run.smithi102.stdout:pg_num: 32 2023-11-13T11:29:34.477 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:34.470+0000 7fde564c9640 1 -- 172.21.15.102:0/3197493592 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7fde3c066470 msgr2=0x7fde3c068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:34.477 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:34.470+0000 7fde564c9640 1 --2- 172.21.15.102:0/3197493592 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7fde3c066470 0x7fde3c068930 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fde400af000 tx=0x7fde400a7000 comp rx=0 tx=0).stop 2023-11-13T11:29:34.478 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:34.470+0000 7fde564c9640 1 -- 172.21.15.102:0/3197493592 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fde500cebc0 msgr2=0x7fde501520f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:34.478 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:34.470+0000 7fde564c9640 1 --2- 172.21.15.102:0/3197493592 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fde500cebc0 0x7fde501520f0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fde4400d7d0 tx=0x7fde4400dc90 comp rx=0 tx=0).stop 2023-11-13T11:29:34.478 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:34.470+0000 7fde564c9640 1 -- 172.21.15.102:0/3197493592 shutdown_connections 2023-11-13T11:29:34.478 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:34.470+0000 7fde564c9640 1 --2- 172.21.15.102:0/3197493592 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fde50159b30 0x7fde5015c970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:34.478 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:34.470+0000 7fde564c9640 1 --2- 172.21.15.102:0/3197493592 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7fde3c066470 0x7fde3c068930 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:34.479 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:34.470+0000 7fde564c9640 1 --2- 172.21.15.102:0/3197493592 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fde500cebc0 0x7fde501520f0 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:34.479 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:34.470+0000 7fde564c9640 1 --2- 172.21.15.102:0/3197493592 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fde500711c0 0x7fde5015acd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:34.479 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:34.470+0000 7fde564c9640 1 -- 172.21.15.102:0/3197493592 >> 172.21.15.102:0/3197493592 conn(0x7fde5006a410 msgr2=0x7fde5006a7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-13T11:29:34.479 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:34.470+0000 7fde564c9640 1 -- 172.21.15.102:0/3197493592 shutdown_connections 2023-11-13T11:29:34.480 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:34.470+0000 7fde564c9640 1 -- 172.21.15.102:0/3197493592 wait complete. 2023-11-13T11:29:34.496 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-13T11:29:34.637 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:34.630+0000 7f3e1c8e3640 1 Processor -- start 2023-11-13T11:29:34.638 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:34.630+0000 7f3e1c8e3640 1 -- start start 2023-11-13T11:29:34.639 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:34.630+0000 7f3e1c8e3640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f3e180cf2d0 0x7f3e1806fc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:34.639 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:34.630+0000 7f3e1c8e3640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3e180711c0 0x7f3e180b3520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:34.639 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:34.630+0000 7f3e1c8e3640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3e180b21f0 con 0x7f3e18159b30 2023-11-13T11:29:34.640 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:34.630+0000 7f3e1c8e3640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3e18071670 con 0x7f3e180cf2d0 2023-11-13T11:29:34.640 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:34.630+0000 7f3e1c8e3640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3e180b2440 con 0x7f3e180711c0 2023-11-13T11:29:34.640 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:34.634+0000 7f3e0dd9b640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f3e180cf2d0 0x7f3e1806fc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:34.640 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:34.634+0000 7f3e0dd9b640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f3e180cf2d0 0x7f3e1806fc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:48364/0 (socket says 172.21.15.102:48364) 2023-11-13T11:29:34.640 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:34.634+0000 7f3e0dd9b640 1 -- 172.21.15.102:0/2234612639 learned_addr learned my addr 172.21.15.102:0/2234612639 (peer_addr_for_me v2:172.21.15.102:0/0) 2023-11-13T11:29:34.641 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:34.634+0000 7f3e16d9d640 1 --2- 172.21.15.102:0/2234612639 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3e180711c0 0x7f3e180b3520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:34.641 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:34.634+0000 7f3e0dd9b640 1 -- 172.21.15.102:0/2234612639 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3e180711c0 msgr2=0x7f3e180b3520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-13T11:29:34.641 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:34.634+0000 7f3e0dd9b640 1 --2- 172.21.15.102:0/2234612639 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3e180711c0 0x7f3e180b3520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:34.641 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:34.634+0000 7f3e0dd9b640 1 -- 172.21.15.102:0/2234612639 >> v1:172.21.15.154:6789/0 conn(0x7f3e18159b30 legacy=0x7f3e180cebc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:34.642 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:34.634+0000 7f3e0dd9b640 1 -- 172.21.15.102:0/2234612639 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e180b2720 con 0x7f3e180cf2d0 2023-11-13T11:29:34.643 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:34.634+0000 7f3e0dd9b640 1 --2- 172.21.15.102:0/2234612639 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3e180cf2d0 0x7f3e1806fc80 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f3e00009870 tx=0x7f3e0001c510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e28ee3389b98590 server_cookie=0 in_seq=0 out_seq=0 2023-11-13T11:29:34.643 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:34.634+0000 7f3e15d9b640 1 -- 172.21.15.102:0/2234612639 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e000aa670 con 0x7f3e180cf2d0 2023-11-13T11:29:34.643 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:34.634+0000 7f3e15d9b640 1 -- 172.21.15.102:0/2234612639 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e000aa7d0 con 0x7f3e180cf2d0 2023-11-13T11:29:34.644 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:34.634+0000 7f3e15d9b640 1 -- 172.21.15.102:0/2234612639 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e000aab60 con 0x7f3e180cf2d0 2023-11-13T11:29:34.644 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:34.638+0000 7f3e1c8e3640 1 -- 172.21.15.102:0/2234612639 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3e180cf2d0 msgr2=0x7f3e1806fc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:34.644 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:34.638+0000 7f3e1c8e3640 1 --2- 172.21.15.102:0/2234612639 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3e180cf2d0 0x7f3e1806fc80 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f3e00009870 tx=0x7f3e0001c510 comp rx=0 tx=0).stop 2023-11-13T11:29:34.644 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:34.638+0000 7f3e1c8e3640 1 -- 172.21.15.102:0/2234612639 shutdown_connections 2023-11-13T11:29:34.644 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:34.638+0000 7f3e1c8e3640 1 --2- 172.21.15.102:0/2234612639 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3e180711c0 0x7f3e180b3520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:34.645 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:34.638+0000 7f3e1c8e3640 1 --2- 172.21.15.102:0/2234612639 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3e180cf2d0 0x7f3e1806fc80 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:34.645 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:34.638+0000 7f3e1c8e3640 1 -- 172.21.15.102:0/2234612639 >> 172.21.15.102:0/2234612639 conn(0x7f3e1806a410 msgr2=0x7f3e1806a820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-13T11:29:34.645 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:34.638+0000 7f3e1c8e3640 1 -- 172.21.15.102:0/2234612639 shutdown_connections 2023-11-13T11:29:34.645 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:34.638+0000 7f3e1c8e3640 1 -- 172.21.15.102:0/2234612639 wait complete. 2023-11-13T11:29:34.648 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:34.638+0000 7f3e1c8e3640 1 Processor -- start 2023-11-13T11:29:34.648 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:34.638+0000 7f3e1c8e3640 1 -- start start 2023-11-13T11:29:34.648 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:34.638+0000 7f3e1c8e3640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3e180711c0 0x7f3e180ae000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:34.648 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:34.638+0000 7f3e1c8e3640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3e180cf2d0 0x7f3e18146b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:34.649 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:34.638+0000 7f3e1c8e3640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3e18159b30 0x7f3e1806bba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:34.649 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:34.638+0000 7f3e1c8e3640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e180b0070 con 0x7f3e180cf2d0 2023-11-13T11:29:34.649 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:34.638+0000 7f3e1c8e3640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e180ae6e0 con 0x7f3e18159b30 2023-11-13T11:29:34.649 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:34.638+0000 7f3e1c8e3640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3e180ae9c0 con 0x7f3e180711c0 2023-11-13T11:29:34.649 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:34.638+0000 7f3e0dd9b640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3e180cf2d0 0x7f3e18146b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:34.650 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:34.638+0000 7f3e0dd9b640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3e180cf2d0 0x7f3e18146b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:48366/0 (socket says 172.21.15.102:48366) 2023-11-13T11:29:34.650 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:34.638+0000 7f3e0dd9b640 1 -- 172.21.15.102:0/3256949415 learned_addr learned my addr 172.21.15.102:0/3256949415 (peer_addr_for_me v2:172.21.15.102:0/0) 2023-11-13T11:29:34.650 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:34.638+0000 7f3e1659c640 1 --2- 172.21.15.102:0/3256949415 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3e180711c0 0x7f3e180ae000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:34.650 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:34.642+0000 7f3e16d9d640 1 --2- 172.21.15.102:0/3256949415 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3e18159b30 0x7f3e1806bba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:34.650 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:34.642+0000 7f3e0dd9b640 1 -- 172.21.15.102:0/3256949415 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3e180711c0 msgr2=0x7f3e180ae000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:34.650 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:34.642+0000 7f3e0dd9b640 1 --2- 172.21.15.102:0/3256949415 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3e180711c0 0x7f3e180ae000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:34.651 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:34.642+0000 7f3e0dd9b640 1 -- 172.21.15.102:0/3256949415 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3e18159b30 msgr2=0x7f3e1806bba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:34.651 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:34.642+0000 7f3e0dd9b640 1 --2- 172.21.15.102:0/3256949415 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3e18159b30 0x7f3e1806bba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:34.651 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:34.642+0000 7f3e0dd9b640 1 -- 172.21.15.102:0/3256949415 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e000094d0 con 0x7f3e180cf2d0 2023-11-13T11:29:34.651 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:34.642+0000 7f3e0dd9b640 1 --2- 172.21.15.102:0/3256949415 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3e180cf2d0 0x7f3e18146b50 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f3e000ac040 tx=0x7f3e0001ad50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-13T11:29:34.651 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:34.642+0000 7f3e0f7fe640 1 -- 172.21.15.102:0/3256949415 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e000b3800 con 0x7f3e180cf2d0 2023-11-13T11:29:34.652 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:34.642+0000 7f3e0f7fe640 1 -- 172.21.15.102:0/3256949415 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e000b3980 con 0x7f3e180cf2d0 2023-11-13T11:29:34.652 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:34.642+0000 7f3e0f7fe640 1 -- 172.21.15.102:0/3256949415 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e000b3d30 con 0x7f3e180cf2d0 2023-11-13T11:29:34.652 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:34.642+0000 7f3e1c8e3640 1 -- 172.21.15.102:0/3256949415 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3e180aeca0 con 0x7f3e180cf2d0 2023-11-13T11:29:34.652 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:34.642+0000 7f3e1c8e3640 1 -- 172.21.15.102:0/3256949415 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3e180af260 con 0x7f3e180cf2d0 2023-11-13T11:29:34.653 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:34.642+0000 7f3e1c8e3640 1 -- 172.21.15.102:0/3256949415 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3e18067640 con 0x7f3e180cf2d0 2023-11-13T11:29:34.653 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:34.642+0000 7f3e0f7fe640 1 -- 172.21.15.102:0/3256949415 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f3e000b2380 con 0x7f3e180cf2d0 2023-11-13T11:29:34.654 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:34.642+0000 7f3e0f7fe640 1 --2- 172.21.15.102:0/3256949415 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f3df8066470 0x7f3df8068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:34.654 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:34.646+0000 7f3e0f7fe640 1 -- 172.21.15.102:0/3256949415 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f3e0011e6c0 con 0x7f3e180cf2d0 2023-11-13T11:29:34.654 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:34.646+0000 7f3e1659c640 1 --2- 172.21.15.102:0/3256949415 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f3df8066470 0x7f3df8068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:34.654 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:34.646+0000 7f3e1659c640 1 --2- 172.21.15.102:0/3256949415 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f3df8066470 0x7f3df8068930 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f3e080012f0 tx=0x7f3e08009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-13T11:29:34.655 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:34.646+0000 7f3e0f7fe640 1 -- 172.21.15.102:0/3256949415 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f3e000ebbf0 con 0x7f3e180cf2d0 2023-11-13T11:29:34.806 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:34.798+0000 7f3e1c8e3640 1 -- 172.21.15.102:0/3256949415 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f3e180af450 con 0x7f3e180cf2d0 2023-11-13T11:29:34.806 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:34.798+0000 7f3e0f7fe640 1 -- 172.21.15.102:0/3256949415 <== mon.0 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v22) v1 ==== 100+0+11 (secure 0 0 0) 0x7f3e000ef210 con 0x7f3e180cf2d0 2023-11-13T11:29:34.807 INFO:teuthology.orchestra.run.smithi102.stdout:pg_num: 64 2023-11-13T11:29:34.808 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:34.802+0000 7f3e1c8e3640 1 -- 172.21.15.102:0/3256949415 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f3df8066470 msgr2=0x7f3df8068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:34.808 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:34.802+0000 7f3e1c8e3640 1 --2- 172.21.15.102:0/3256949415 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f3df8066470 0x7f3df8068930 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f3e080012f0 tx=0x7f3e08009040 comp rx=0 tx=0).stop 2023-11-13T11:29:34.808 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:34.802+0000 7f3e1c8e3640 1 -- 172.21.15.102:0/3256949415 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3e180cf2d0 msgr2=0x7f3e18146b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:34.809 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:34.802+0000 7f3e1c8e3640 1 --2- 172.21.15.102:0/3256949415 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3e180cf2d0 0x7f3e18146b50 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f3e000ac040 tx=0x7f3e0001ad50 comp rx=0 tx=0).stop 2023-11-13T11:29:34.809 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:34.802+0000 7f3e1c8e3640 1 -- 172.21.15.102:0/3256949415 shutdown_connections 2023-11-13T11:29:34.809 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:34.802+0000 7f3e1c8e3640 1 --2- 172.21.15.102:0/3256949415 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3e18159b30 0x7f3e1806bba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:34.809 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:34.802+0000 7f3e1c8e3640 1 --2- 172.21.15.102:0/3256949415 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f3df8066470 0x7f3df8068930 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:34.809 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:34.802+0000 7f3e1c8e3640 1 --2- 172.21.15.102:0/3256949415 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3e180cf2d0 0x7f3e18146b50 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:34.810 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:34.802+0000 7f3e1c8e3640 1 --2- 172.21.15.102:0/3256949415 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3e180711c0 0x7f3e180ae000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:34.810 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:34.802+0000 7f3e1c8e3640 1 -- 172.21.15.102:0/3256949415 >> 172.21.15.102:0/3256949415 conn(0x7f3e1806a410 msgr2=0x7f3e181589d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-13T11:29:34.810 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:34.802+0000 7f3e1c8e3640 1 -- 172.21.15.102:0/3256949415 shutdown_connections 2023-11-13T11:29:34.810 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:34.802+0000 7f3e1c8e3640 1 -- 172.21.15.102:0/3256949415 wait complete. 2023-11-13T11:29:34.827 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-11-13T11:29:34.968 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:34.962+0000 7f916d45a640 1 Processor -- start 2023-11-13T11:29:34.969 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:34.962+0000 7f916d45a640 1 -- start start 2023-11-13T11:29:34.970 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:34.962+0000 7f916d45a640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f91681606e0 0x7f91680c69b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:34.970 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:34.962+0000 7f916d45a640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f91680cf490 0x7f91680cf920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:34.970 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:34.962+0000 7f916d45a640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f91680d1440 con 0x7f91680d0c40 2023-11-13T11:29:34.971 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:34.962+0000 7f916d45a640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f91680cfe60 con 0x7f91680cf490 2023-11-13T11:29:34.971 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:34.962+0000 7f916d45a640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f91680cdb10 con 0x7f91681606e0 2023-11-13T11:29:34.971 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:34.962+0000 7f9166ffd640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f91681606e0 0x7f91680c69b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:34.971 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:34.962+0000 7f91677fe640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f91680cf490 0x7f91680cf920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:34.971 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:34.962+0000 7f9166ffd640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f91681606e0 0x7f91680c69b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.102:60164/0 (socket says 172.21.15.102:60164) 2023-11-13T11:29:34.972 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:34.962+0000 7f9166ffd640 1 -- 172.21.15.102:0/90897983 learned_addr learned my addr 172.21.15.102:0/90897983 (peer_addr_for_me v2:172.21.15.102:0/0) 2023-11-13T11:29:34.972 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:34.962+0000 7f915e7fc640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f91680d0c40 0x7f91680b3e20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.102:45114/0 (socket says 172.21.15.102:45114) 2023-11-13T11:29:34.972 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:34.962+0000 7f9166ffd640 1 -- 172.21.15.102:0/90897983 >> v2:172.21.15.154:3300/0 conn(0x7f91680cf490 msgr2=0x7f91680cf920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-13T11:29:34.972 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:34.962+0000 7f9166ffd640 1 --2- 172.21.15.102:0/90897983 >> v2:172.21.15.154:3300/0 conn(0x7f91680cf490 0x7f91680cf920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:34.973 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:34.962+0000 7f9166ffd640 1 -- 172.21.15.102:0/90897983 >> v1:172.21.15.154:6789/0 conn(0x7f91680d0c40 legacy=0x7f91680b3e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:34.973 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:34.962+0000 7f9166ffd640 1 -- 172.21.15.102:0/90897983 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91680d1690 con 0x7f91681606e0 2023-11-13T11:29:34.973 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:34.962+0000 7f91667fc640 1 -- 172.21.15.102:0/90897983 <== mon.1 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1854109988 0 0) 0x7f91680d1440 con 0x7f91680d0c40 2023-11-13T11:29:34.973 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:34.962+0000 7f91677fe640 1 --2- 172.21.15.102:0/90897983 >> v2:172.21.15.154:3300/0 conn(0x7f91680cf490 0x7f91680cf920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-13T11:29:34.974 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:34.966+0000 7f9166ffd640 1 --2- 172.21.15.102:0/90897983 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f91681606e0 0x7f91680c69b0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f9150009870 tx=0x7f915001c480 comp rx=0 tx=0).ready entity=mon.2 client_cookie=43c138fbf604b8f1 server_cookie=0 in_seq=0 out_seq=0 2023-11-13T11:29:34.975 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:34.966+0000 7f91667fc640 1 -- 172.21.15.102:0/90897983 <== mon.2 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91500a6040 con 0x7f91681606e0 2023-11-13T11:29:34.975 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:34.966+0000 7f91667fc640 1 -- 172.21.15.102:0/90897983 <== mon.2 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f91500aa600 con 0x7f91681606e0 2023-11-13T11:29:34.975 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:34.966+0000 7f91667fc640 1 -- 172.21.15.102:0/90897983 <== mon.2 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91500aa990 con 0x7f91681606e0 2023-11-13T11:29:34.975 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:34.966+0000 7f916d45a640 1 -- 172.21.15.102:0/90897983 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f91681606e0 msgr2=0x7f91680c69b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:34.975 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:34.966+0000 7f916d45a640 1 --2- 172.21.15.102:0/90897983 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f91681606e0 0x7f91680c69b0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f9150009870 tx=0x7f915001c480 comp rx=0 tx=0).stop 2023-11-13T11:29:34.976 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:34.966+0000 7f916d45a640 1 -- 172.21.15.102:0/90897983 shutdown_connections 2023-11-13T11:29:34.976 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:34.966+0000 7f916d45a640 1 --2- 172.21.15.102:0/90897983 >> v2:172.21.15.154:3300/0 conn(0x7f91680cf490 0x7f91680cf920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:34.976 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:34.966+0000 7f916d45a640 1 --2- 172.21.15.102:0/90897983 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f91681606e0 0x7f91680c69b0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:34.977 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:34.966+0000 7f916d45a640 1 -- 172.21.15.102:0/90897983 >> 172.21.15.102:0/90897983 conn(0x7f916809c130 msgr2=0x7f91680d2e60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-13T11:29:34.977 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:34.966+0000 7f916d45a640 1 -- 172.21.15.102:0/90897983 shutdown_connections 2023-11-13T11:29:34.977 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:34.966+0000 7f916d45a640 1 -- 172.21.15.102:0/90897983 wait complete. 2023-11-13T11:29:34.979 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:34.970+0000 7f916d45a640 1 Processor -- start 2023-11-13T11:29:34.979 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:34.970+0000 7f916d45a640 1 -- start start 2023-11-13T11:29:34.979 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:34.970+0000 7f916d45a640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f91680cf490 0x7f9168154d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:34.980 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:34.970+0000 7f916d45a640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f91680d0c40 0x7f9168147af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:34.980 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:34.970+0000 7f916d45a640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f91681606e0 0x7f916806b8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:34.980 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:34.970+0000 7f916d45a640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9168156940 con 0x7f91680d0c40 2023-11-13T11:29:34.980 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:34.970+0000 7f916d45a640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9168156c20 con 0x7f91681606e0 2023-11-13T11:29:34.980 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:34.970+0000 7f916d45a640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9168156f00 con 0x7f91680cf490 2023-11-13T11:29:34.981 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:34.970+0000 7f915e7fc640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f91680d0c40 0x7f9168147af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:34.981 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:34.970+0000 7f915e7fc640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f91680d0c40 0x7f9168147af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:48376/0 (socket says 172.21.15.102:48376) 2023-11-13T11:29:34.981 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:34.970+0000 7f915e7fc640 1 -- 172.21.15.102:0/2095918986 learned_addr learned my addr 172.21.15.102:0/2095918986 (peer_addr_for_me v2:172.21.15.102:0/0) 2023-11-13T11:29:34.981 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:34.970+0000 7f91677fe640 1 --2- 172.21.15.102:0/2095918986 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f91681606e0 0x7f916806b8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:34.981 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:34.970+0000 7f9166ffd640 1 --2- 172.21.15.102:0/2095918986 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f91680cf490 0x7f9168154d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:34.982 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:34.970+0000 7f915e7fc640 1 -- 172.21.15.102:0/2095918986 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f91680cf490 msgr2=0x7f9168154d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:34.982 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:34.970+0000 7f915e7fc640 1 --2- 172.21.15.102:0/2095918986 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f91680cf490 0x7f9168154d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:34.982 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:34.970+0000 7f915e7fc640 1 -- 172.21.15.102:0/2095918986 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f91681606e0 msgr2=0x7f916806b8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:34.982 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:34.970+0000 7f915e7fc640 1 --2- 172.21.15.102:0/2095918986 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f91681606e0 0x7f916806b8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:34.982 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:34.970+0000 7f915e7fc640 1 -- 172.21.15.102:0/2095918986 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9160009a70 con 0x7f91680d0c40 2023-11-13T11:29:34.983 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:34.970+0000 7f915e7fc640 1 --2- 172.21.15.102:0/2095918986 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f91680d0c40 0x7f9168147af0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f91580011f0 tx=0x7f915800c9b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-13T11:29:34.983 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:34.970+0000 7f915ffff640 1 -- 172.21.15.102:0/2095918986 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91580074e0 con 0x7f91680d0c40 2023-11-13T11:29:34.983 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:34.970+0000 7f915ffff640 1 -- 172.21.15.102:0/2095918986 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9158007640 con 0x7f91680d0c40 2023-11-13T11:29:34.983 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:34.970+0000 7f916d45a640 1 -- 172.21.15.102:0/2095918986 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f91500094d0 con 0x7f91680d0c40 2023-11-13T11:29:34.983 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:34.970+0000 7f915ffff640 1 -- 172.21.15.102:0/2095918986 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9158004a10 con 0x7f91680d0c40 2023-11-13T11:29:34.984 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:34.970+0000 7f916d45a640 1 -- 172.21.15.102:0/2095918986 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f916814e510 con 0x7f91680d0c40 2023-11-13T11:29:34.984 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:34.974+0000 7f916d45a640 1 -- 172.21.15.102:0/2095918986 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f916814e730 con 0x7f91680d0c40 2023-11-13T11:29:34.985 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:34.974+0000 7f915ffff640 1 -- 172.21.15.102:0/2095918986 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f9158004b70 con 0x7f91680d0c40 2023-11-13T11:29:34.985 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:34.974+0000 7f915ffff640 1 --2- 172.21.15.102:0/2095918986 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f91480664a0 0x7f9148068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:34.985 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:34.974+0000 7f915ffff640 1 -- 172.21.15.102:0/2095918986 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f9158083370 con 0x7f91680d0c40 2023-11-13T11:29:34.985 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:34.974+0000 7f9166ffd640 1 --2- 172.21.15.102:0/2095918986 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f91480664a0 0x7f9148068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:34.986 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:34.974+0000 7f9166ffd640 1 --2- 172.21.15.102:0/2095918986 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f91480664a0 0x7f9148068960 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f91500ae000 tx=0x7f91500a7000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-13T11:29:34.986 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:34.978+0000 7f915ffff640 1 -- 172.21.15.102:0/2095918986 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f91580507e0 con 0x7f91680d0c40 2023-11-13T11:29:35.147 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:35.138+0000 7f916d45a640 1 -- 172.21.15.102:0/2095918986 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f9168068520 con 0x7f91680d0c40 2023-11-13T11:29:35.147 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:35.138+0000 7f915ffff640 1 -- 172.21.15.102:0/2095918986 <== mon.0 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v22) v1 ==== 80+0+0 (secure 0 0 0) 0x7f9158053e00 con 0x7f91680d0c40 2023-11-13T11:29:35.147 INFO:teuthology.orchestra.run.smithi102.stderr:listed 0 entries 2023-11-13T11:29:35.148 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:35.142+0000 7f916d45a640 1 -- 172.21.15.102:0/2095918986 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f91480664a0 msgr2=0x7f9148068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:35.149 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:35.142+0000 7f916d45a640 1 --2- 172.21.15.102:0/2095918986 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f91480664a0 0x7f9148068960 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f91500ae000 tx=0x7f91500a7000 comp rx=0 tx=0).stop 2023-11-13T11:29:35.149 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:35.142+0000 7f916d45a640 1 -- 172.21.15.102:0/2095918986 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f91680d0c40 msgr2=0x7f9168147af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:35.149 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:35.142+0000 7f916d45a640 1 --2- 172.21.15.102:0/2095918986 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f91680d0c40 0x7f9168147af0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f91580011f0 tx=0x7f915800c9b0 comp rx=0 tx=0).stop 2023-11-13T11:29:35.149 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:35.142+0000 7f916d45a640 1 -- 172.21.15.102:0/2095918986 shutdown_connections 2023-11-13T11:29:35.150 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:35.142+0000 7f916d45a640 1 --2- 172.21.15.102:0/2095918986 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f91681606e0 0x7f916806b8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:35.150 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:35.142+0000 7f916d45a640 1 --2- 172.21.15.102:0/2095918986 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f91480664a0 0x7f9148068960 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:35.150 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:35.142+0000 7f916d45a640 1 --2- 172.21.15.102:0/2095918986 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f91680d0c40 0x7f9168147af0 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:35.150 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:35.142+0000 7f916d45a640 1 --2- 172.21.15.102:0/2095918986 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f91680cf490 0x7f9168154d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:35.150 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:35.142+0000 7f916d45a640 1 -- 172.21.15.102:0/2095918986 >> 172.21.15.102:0/2095918986 conn(0x7f916809c130 msgr2=0x7f91680c7960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-13T11:29:35.151 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:35.142+0000 7f916d45a640 1 -- 172.21.15.102:0/2095918986 shutdown_connections 2023-11-13T11:29:35.151 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:35.142+0000 7f916d45a640 1 -- 172.21.15.102:0/2095918986 wait complete. 2023-11-13T11:29:35.168 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi154.front.sepia.ceph.com... 2023-11-13T11:29:35.168 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-13T11:29:35.169 DEBUG:teuthology.orchestra.run.smithi154:> sudo fusermount -u /home/ubuntu/cephtest/mnt.1 2023-11-13T11:29:35.203 INFO:teuthology.orchestra.run:waiting for 300 2023-11-13T11:29:35.203 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi154.front.sepia.ceph.com 2023-11-13T11:29:35.204 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-13T11:29:35.204 DEBUG:teuthology.orchestra.run.smithi154:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-11-13T11:29:35.262 DEBUG:teuthology.orchestra.run.smithi102:> set -ex 2023-11-13T11:29:35.263 DEBUG:teuthology.orchestra.run.smithi102:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-13T11:29:35.273 DEBUG:teuthology.orchestra.run.smithi102:> set -ex 2023-11-13T11:29:35.273 DEBUG:teuthology.orchestra.run.smithi102:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-13T11:29:35.327 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-13T11:29:35.508 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:35.502+0000 7f0dd8879640 1 Processor -- start 2023-11-13T11:29:35.508 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:35.502+0000 7f0dd8879640 1 -- start start 2023-11-13T11:29:35.509 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:35.502+0000 7f0dd8879640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f0dd4140540 0x7f0dd415e3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:35.509 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:35.502+0000 7f0dd8879640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0dd415e910 con 0x7f0dd406caa0 2023-11-13T11:29:35.509 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:35.502+0000 7f0dd8879640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0dd4140920 con 0x7f0dd4071900 2023-11-13T11:29:35.510 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:35.502+0000 7f0dd8879640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0dd40ccc50 con 0x7f0dd4140540 2023-11-13T11:29:35.510 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:35.502+0000 7f0dcbfff640 1 --1- >> v1:172.21.15.102:6789/0 conn(0x7f0dd406caa0 0x7f0dd40711f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.102:6789/0 says I am v1:172.21.15.102:36208/0 (socket says 172.21.15.102:36208) 2023-11-13T11:29:35.510 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:35.502+0000 7f0dcbfff640 1 -- 172.21.15.102:0/2637469369 learned_addr learned my addr 172.21.15.102:0/2637469369 (peer_addr_for_me v1:172.21.15.102:0/0) 2023-11-13T11:29:35.512 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:35.502+0000 7f0dd1d9b640 1 -- 172.21.15.102:0/2637469369 <== mon.0 v1:172.21.15.102:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 121511495 0 0) 0x7f0dbc001120 con 0x7f0dd406caa0 2023-11-13T11:29:35.512 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:35.502+0000 7f0dd1d9b640 1 -- 172.21.15.102:0/2637469369 --> v1:172.21.15.102:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0dc0003530 con 0x7f0dd406caa0 2023-11-13T11:29:35.513 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:35.502+0000 7f0dd259c640 1 --2- 172.21.15.102:0/2637469369 >> v2:172.21.15.154:3300/0 conn(0x7f0dd4140540 0x7f0dd415e3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:35.513 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:35.502+0000 7f0dd1d9b640 1 -- 172.21.15.102:0/2637469369 <== mon.0 v1:172.21.15.102:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2864001499 0 0) 0x7f0dc0003530 con 0x7f0dd406caa0 2023-11-13T11:29:35.513 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:35.502+0000 7f0dd1d9b640 1 -- 172.21.15.102:0/2637469369 >> v2:172.21.15.154:3300/0 conn(0x7f0dd4140540 msgr2=0x7f0dd415e3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-13T11:29:35.513 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:35.502+0000 7f0dd1d9b640 1 --2- 172.21.15.102:0/2637469369 >> v2:172.21.15.154:3300/0 conn(0x7f0dd4140540 0x7f0dd415e3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:35.513 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:35.502+0000 7f0dd1d9b640 1 -- 172.21.15.102:0/2637469369 >> v1:172.21.15.154:6789/0 conn(0x7f0dd4071900 legacy=0x7f0dd40b1c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:35.514 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:35.502+0000 7f0dd1d9b640 1 -- 172.21.15.102:0/2637469369 --> v1:172.21.15.102:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0dd406cfc0 con 0x7f0dd406caa0 2023-11-13T11:29:35.514 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:35.502+0000 7f0dd1d9b640 1 -- 172.21.15.102:0/2637469369 <== mon.0 v1:172.21.15.102:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 895381068 0 0) 0x7f0dbc001810 con 0x7f0dd406caa0 2023-11-13T11:29:35.514 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:35.502+0000 7f0dd1d9b640 1 -- 172.21.15.102:0/2637469369 >> v1:172.21.15.102:6789/0 conn(0x7f0dd406caa0 legacy=0x7f0dd40711f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:35.514 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:35.502+0000 7f0dd1d9b640 1 --2- 172.21.15.102:0/2637469369 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0dc0003980 0x7f0dc0003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:35.514 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:35.502+0000 7f0dd1d9b640 1 --2- 172.21.15.102:0/2637469369 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0dc00047d0 0x7f0dc0004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:35.515 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:35.502+0000 7f0dd1d9b640 1 --2- 172.21.15.102:0/2637469369 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0dc0005190 0x7f0dc000b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:35.515 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:35.502+0000 7f0dd1d9b640 1 -- 172.21.15.102:0/2637469369 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0dd40ccc50 con 0x7f0dc0005190 2023-11-13T11:29:35.515 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:35.502+0000 7f0dd1d9b640 1 -- 172.21.15.102:0/2637469369 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0dc000c030 con 0x7f0dc00047d0 2023-11-13T11:29:35.515 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:35.502+0000 7f0dd1d9b640 1 -- 172.21.15.102:0/2637469369 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0dc000c1f0 con 0x7f0dc0003980 2023-11-13T11:29:35.515 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:35.502+0000 7f0dd2d9d640 1 --2- 172.21.15.102:0/2637469369 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0dc0005190 0x7f0dc000b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:35.516 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:35.506+0000 7f0dcbfff640 1 --2- 172.21.15.102:0/2637469369 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0dc00047d0 0x7f0dc0004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:35.516 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:35.506+0000 7f0dd259c640 1 --2- 172.21.15.102:0/2637469369 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0dc0003980 0x7f0dc0003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:35.516 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:35.506+0000 7f0dd2d9d640 1 -- 172.21.15.102:0/2637469369 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0dc0003980 msgr2=0x7f0dc0003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-13T11:29:35.516 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:35.506+0000 7f0dd2d9d640 1 --2- 172.21.15.102:0/2637469369 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0dc0003980 0x7f0dc0003da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:35.517 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:35.506+0000 7f0dd2d9d640 1 -- 172.21.15.102:0/2637469369 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0dc00047d0 msgr2=0x7f0dc0004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-13T11:29:35.517 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:35.506+0000 7f0dd2d9d640 1 --2- 172.21.15.102:0/2637469369 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0dc00047d0 0x7f0dc0004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:35.518 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:35.506+0000 7f0dd2d9d640 1 -- 172.21.15.102:0/2637469369 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0dc0003530 con 0x7f0dc0005190 2023-11-13T11:29:35.520 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:35.506+0000 7f0dd2d9d640 1 -- 172.21.15.102:0/2637469369 reap_dead start 2023-11-13T11:29:35.521 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:35.506+0000 7f0dd2d9d640 1 --2- 172.21.15.102:0/2637469369 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0dc0005190 0x7f0dc000b990 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f0dd40cb1c0 tx=0x7f0dcc01c700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=25fa560994646580 server_cookie=0 in_seq=0 out_seq=0 2023-11-13T11:29:35.521 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:35.506+0000 7f0dd1d9b640 1 -- 172.21.15.102:0/2637469369 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0dcc003b80 con 0x7f0dc0005190 2023-11-13T11:29:35.521 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:35.506+0000 7f0dd1d9b640 1 -- 172.21.15.102:0/2637469369 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0dcc003ce0 con 0x7f0dc0005190 2023-11-13T11:29:35.521 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:35.506+0000 7f0dd1d9b640 1 -- 172.21.15.102:0/2637469369 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0dcc005310 con 0x7f0dc0005190 2023-11-13T11:29:35.521 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:35.510+0000 7f0dd8879640 1 -- 172.21.15.102:0/2637469369 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0dc0005190 msgr2=0x7f0dc000b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:35.522 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:35.510+0000 7f0dd8879640 1 --2- 172.21.15.102:0/2637469369 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0dc0005190 0x7f0dc000b990 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f0dd40cb1c0 tx=0x7f0dcc01c700 comp rx=0 tx=0).stop 2023-11-13T11:29:35.522 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:35.510+0000 7f0dd8879640 1 -- 172.21.15.102:0/2637469369 shutdown_connections 2023-11-13T11:29:35.522 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:35.510+0000 7f0dd8879640 1 --2- 172.21.15.102:0/2637469369 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0dc0005190 0x7f0dc000b990 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:35.522 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:35.510+0000 7f0dd8879640 1 -- 172.21.15.102:0/2637469369 >> 172.21.15.102:0/2637469369 conn(0x7f0dd40b0870 msgr2=0x7f0dd40b0c80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-13T11:29:35.523 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:35.510+0000 7f0dd8879640 1 -- 172.21.15.102:0/2637469369 shutdown_connections 2023-11-13T11:29:35.523 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:35.510+0000 7f0dd8879640 1 -- 172.21.15.102:0/2637469369 wait complete. 2023-11-13T11:29:35.523 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:35.510+0000 7f0dd8879640 1 Processor -- start 2023-11-13T11:29:35.523 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:35.510+0000 7f0dd8879640 1 -- start start 2023-11-13T11:29:35.523 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:35.510+0000 7f0dd8879640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0dc0005190 0x7f0dd4155a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:35.524 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:35.510+0000 7f0dd8879640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0dd413f3f0 0x7f0dd41f3df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:35.524 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:35.510+0000 7f0dd8879640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0dd40b2290 0x7f0dd4156930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:35.524 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:35.510+0000 7f0dd8879640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0dd40aced0 con 0x7f0dd413f3f0 2023-11-13T11:29:35.524 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:35.510+0000 7f0dd8879640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0dd40ac8a0 con 0x7f0dd40b2290 2023-11-13T11:29:35.524 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:35.510+0000 7f0dd8879640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0dd41f4330 con 0x7f0dc0005190 2023-11-13T11:29:35.525 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:35.510+0000 7f0dcbfff640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0dd413f3f0 0x7f0dd41f3df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:35.525 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:35.510+0000 7f0dcbfff640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0dd413f3f0 0x7f0dd41f3df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:48382/0 (socket says 172.21.15.102:48382) 2023-11-13T11:29:35.525 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:35.510+0000 7f0dcbfff640 1 -- 172.21.15.102:0/543508415 learned_addr learned my addr 172.21.15.102:0/543508415 (peer_addr_for_me v2:172.21.15.102:0/0) 2023-11-13T11:29:35.525 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:35.510+0000 7f0dcbfff640 1 -- 172.21.15.102:0/543508415 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0dc0005190 msgr2=0x7f0dd4155a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:35.525 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:35.510+0000 7f0dcbfff640 1 --2- 172.21.15.102:0/543508415 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0dc0005190 0x7f0dd4155a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:35.526 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:35.510+0000 7f0dcbfff640 1 -- 172.21.15.102:0/543508415 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0dd40b2290 msgr2=0x7f0dd4156930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:35.526 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:35.510+0000 7f0dcbfff640 1 --2- 172.21.15.102:0/543508415 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0dd40b2290 0x7f0dd4156930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:35.526 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:35.510+0000 7f0dcbfff640 1 -- 172.21.15.102:0/543508415 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0dd40b2a70 con 0x7f0dd413f3f0 2023-11-13T11:29:35.528 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:35.510+0000 7f0dcbfff640 1 --2- 172.21.15.102:0/543508415 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0dd413f3f0 0x7f0dd41f3df0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f0dbc007090 tx=0x7f0dbc007550 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-13T11:29:35.529 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:35.514+0000 7f0dcaffd640 1 -- 172.21.15.102:0/543508415 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0dbc0077a0 con 0x7f0dd413f3f0 2023-11-13T11:29:35.529 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:35.514+0000 7f0dcaffd640 1 -- 172.21.15.102:0/543508415 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0dbc00f9c0 con 0x7f0dd413f3f0 2023-11-13T11:29:35.529 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:35.514+0000 7f0dcaffd640 1 -- 172.21.15.102:0/543508415 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0dbc00fd70 con 0x7f0dd413f3f0 2023-11-13T11:29:35.529 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:35.514+0000 7f0dd8879640 1 -- 172.21.15.102:0/543508415 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0dd40b2d50 con 0x7f0dd413f3f0 2023-11-13T11:29:35.530 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:35.514+0000 7f0dd8879640 1 -- 172.21.15.102:0/543508415 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0dd413f870 con 0x7f0dd413f3f0 2023-11-13T11:29:35.530 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:35.514+0000 7f0dd8879640 1 -- 172.21.15.102:0/543508415 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0dd40ad010 con 0x7f0dd413f3f0 2023-11-13T11:29:35.531 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:35.514+0000 7f0dcaffd640 1 -- 172.21.15.102:0/543508415 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f0dbc01d360 con 0x7f0dd413f3f0 2023-11-13T11:29:35.531 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:35.514+0000 7f0dcaffd640 1 --2- 172.21.15.102:0/543508415 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f0db4066470 0x7f0db4068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:35.532 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:35.514+0000 7f0dcaffd640 1 -- 172.21.15.102:0/543508415 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f0dbc083550 con 0x7f0dd413f3f0 2023-11-13T11:29:35.532 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:35.514+0000 7f0dd259c640 1 --2- 172.21.15.102:0/543508415 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f0db4066470 0x7f0db4068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:35.533 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:35.514+0000 7f0dd259c640 1 --2- 172.21.15.102:0/543508415 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f0db4066470 0x7f0db4068930 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f0dd40b3b50 tx=0x7f0dc4009340 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-13T11:29:35.533 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:35.518+0000 7f0dcaffd640 1 -- 172.21.15.102:0/543508415 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f0dd40ad010 con 0x7f0dd413f3f0 2023-11-13T11:29:35.676 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:35.670+0000 7f0dd8879640 1 -- 172.21.15.102:0/543508415 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0dd415e910 con 0x7f0dd413f3f0 2023-11-13T11:29:35.677 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:35.670+0000 7f0dcaffd640 1 -- 172.21.15.102:0/543508415 <== mon.0 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+16545 (secure 0 0 0) 0x7f0dd415e910 con 0x7f0dd413f3f0 2023-11-13T11:29:35.678 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T11:29:35.678 INFO:teuthology.orchestra.run.smithi102.stdout:{"epoch":22,"fsid":"97b3eb2b-7ccf-4aae-8d92-bff986c671ea","created":"2023-11-13T11:28:31.836724+0000","modified":"2023-11-13T11:28:58.608314+0000","last_up_change":"2023-11-13T11:28:44.876638+0000","last_in_change":"2023-11-13T11:28:35.312740+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-13T11:28:44.981356+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-13T11:28:55.958525+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-13T11:28:56.394264+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"bdefaa17-fcca-4c86-aa40-27dc33a789af","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6800","nonce":53303834},{"type":"v1","addr":"172.21.15.102:6801","nonce":53303834}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6802","nonce":53303834},{"type":"v1","addr":"172.21.15.102:6803","nonce":53303834}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6806","nonce":53303834},{"type":"v1","addr":"172.21.15.102:6807","nonce":53303834}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6804","nonce":53303834},{"type":"v1","addr":"172.21.15.102:6805","nonce":53303834}]},"public_addr":"172.21.15.102:6801/53303834","cluster_addr":"172.21.15.102:6803/53303834","heartbeat_back_addr":"172.21.15.102:6807/53303834","heartbeat_front_addr":"172.21.15.102:6805/53303834","state":["exists","up"]},{"osd":1,"uuid":"f0033196-dec9-4ae9-945e-6aeef6dbb47f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6808","nonce":1732708348},{"type":"v1","addr":"172.21.15.102:6809","nonce":1732708348}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6811","nonce":1732708348},{"type":"v1","addr":"172.21.15.102:6813","nonce":1732708348}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6818","nonce":1732708348},{"type":"v1","addr":"172.21.15.102:6820","nonce":1732708348}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6815","nonce":1732708348},{"type":"v1","addr":"172.21.15.102:6817","nonce":1732708348}]},"public_addr":"172.21.15.102:6809/1732708348","cluster_addr":"172.21.15.102:6813/1732708348","heartbeat_back_addr":"172.21.15.102:6820/1732708348","heartbeat_front_addr":"172.21.15.102:6817/1732708348","state":["exists","up"]},{"osd":2,"uuid":"496b0834-351e-4ec2-a714-86ed0c0ff4fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6810","nonce":1825475150},{"type":"v1","addr":"172.21.15.102:6812","nonce":1825475150}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6814","nonce":1825475150},{"type":"v1","addr":"172.21.15.102:6816","nonce":1825475150}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6822","nonce":1825475150},{"type":"v1","addr":"172.21.15.102:6823","nonce":1825475150}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6819","nonce":1825475150},{"type":"v1","addr":"172.21.15.102:6821","nonce":1825475150}]},"public_addr":"172.21.15.102:6812/1825475150","cluster_addr":"172.21.15.102:6816/1825475150","heartbeat_back_addr":"172.21.15.102:6823/1825475150","heartbeat_front_addr":"172.21.15.102:6821/1825475150","state":["exists","up"]},{"osd":3,"uuid":"3ba6cc41-e0a0-4273-86cb-90000c06a55a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6824","nonce":4149355528},{"type":"v1","addr":"172.21.15.102:6825","nonce":4149355528}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6826","nonce":4149355528},{"type":"v1","addr":"172.21.15.102:6827","nonce":4149355528}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6830","nonce":4149355528},{"type":"v1","addr":"172.21.15.102:6831","nonce":4149355528}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6828","nonce":4149355528},{"type":"v1","addr":"172.21.15.102:6829","nonce":4149355528}]},"public_addr":"172.21.15.102:6825/4149355528","cluster_addr":"172.21.15.102:6827/4149355528","heartbeat_back_addr":"172.21.15.102:6831/4149355528","heartbeat_front_addr":"172.21.15.102:6829/4149355528","state":["exists","up"]},{"osd":4,"uuid":"16e797d8-e6e7-4140-95c3-b85283c42a2a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6808","nonce":4028899241},{"type":"v1","addr":"172.21.15.154:6809","nonce":4028899241}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6810","nonce":4028899241},{"type":"v1","addr":"172.21.15.154:6811","nonce":4028899241}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6814","nonce":4028899241},{"type":"v1","addr":"172.21.15.154:6815","nonce":4028899241}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6812","nonce":4028899241},{"type":"v1","addr":"172.21.15.154:6813","nonce":4028899241}]},"public_addr":"172.21.15.154:6809/4028899241","cluster_addr":"172.21.15.154:6811/4028899241","heartbeat_back_addr":"172.21.15.154:6815/4028899241","heartbeat_front_addr":"172.21.15.154:6813/4028899241","state":["exists","up"]},{"osd":5,"uuid":"d6ab225c-1b55-450a-89a9-abe5c3f8d6af","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":3562396827},{"type":"v1","addr":"172.21.15.154:6801","nonce":3562396827}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":3562396827},{"type":"v1","addr":"172.21.15.154:6803","nonce":3562396827}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6806","nonce":3562396827},{"type":"v1","addr":"172.21.15.154:6807","nonce":3562396827}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6804","nonce":3562396827},{"type":"v1","addr":"172.21.15.154:6805","nonce":3562396827}]},"public_addr":"172.21.15.154:6801/3562396827","cluster_addr":"172.21.15.154:6803/3562396827","heartbeat_back_addr":"172.21.15.154:6807/3562396827","heartbeat_front_addr":"172.21.15.154:6805/3562396827","state":["exists","up"]},{"osd":6,"uuid":"96f905ac-491c-4662-8e2b-5bb8e929ab9d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6816","nonce":2933728751},{"type":"v1","addr":"172.21.15.154:6817","nonce":2933728751}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6818","nonce":2933728751},{"type":"v1","addr":"172.21.15.154:6819","nonce":2933728751}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6822","nonce":2933728751},{"type":"v1","addr":"172.21.15.154:6823","nonce":2933728751}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6820","nonce":2933728751},{"type":"v1","addr":"172.21.15.154:6821","nonce":2933728751}]},"public_addr":"172.21.15.154:6817/2933728751","cluster_addr":"172.21.15.154:6819/2933728751","heartbeat_back_addr":"172.21.15.154:6823/2933728751","heartbeat_front_addr":"172.21.15.154:6821/2933728751","state":["exists","up"]},{"osd":7,"uuid":"07012d3b-3ab4-40df-a471-93caed22e2dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6824","nonce":1753500785},{"type":"v1","addr":"172.21.15.154:6825","nonce":1753500785}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6826","nonce":1753500785},{"type":"v1","addr":"172.21.15.154:6827","nonce":1753500785}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6830","nonce":1753500785},{"type":"v1","addr":"172.21.15.154:6831","nonce":1753500785}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6828","nonce":1753500785},{"type":"v1","addr":"172.21.15.154:6829","nonce":1753500785}]},"public_addr":"172.21.15.154:6825/1753500785","cluster_addr":"172.21.15.154:6827/1753500785","heartbeat_back_addr":"172.21.15.154:6831/1753500785","heartbeat_front_addr":"172.21.15.154:6829/1753500785","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-13T11:28:40.978603+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-13T11:28:41.200985+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-13T11:28:41.222815+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-13T11:28:41.202162+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-13T11:28:40.925911+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-13T11:28:41.087725+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-13T11:28:41.072208+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-13T11:28:40.875257+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-13T11:29:35.680 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:35.674+0000 7f0dd8879640 1 -- 172.21.15.102:0/543508415 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f0db4066470 msgr2=0x7f0db4068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:35.680 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:35.674+0000 7f0dd8879640 1 --2- 172.21.15.102:0/543508415 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f0db4066470 0x7f0db4068930 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f0dd40b3b50 tx=0x7f0dc4009340 comp rx=0 tx=0).stop 2023-11-13T11:29:35.680 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:35.674+0000 7f0dd8879640 1 -- 172.21.15.102:0/543508415 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0dd413f3f0 msgr2=0x7f0dd41f3df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:35.680 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:35.674+0000 7f0dd8879640 1 --2- 172.21.15.102:0/543508415 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0dd413f3f0 0x7f0dd41f3df0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f0dbc007090 tx=0x7f0dbc007550 comp rx=0 tx=0).stop 2023-11-13T11:29:35.681 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:35.674+0000 7f0dd8879640 1 -- 172.21.15.102:0/543508415 shutdown_connections 2023-11-13T11:29:35.681 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:35.674+0000 7f0dd8879640 1 --2- 172.21.15.102:0/543508415 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0dd40b2290 0x7f0dd4156930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:35.681 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:35.674+0000 7f0dd8879640 1 --2- 172.21.15.102:0/543508415 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f0db4066470 0x7f0db4068930 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:35.681 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:35.674+0000 7f0dd8879640 1 --2- 172.21.15.102:0/543508415 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0dd413f3f0 0x7f0dd41f3df0 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:35.681 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:35.674+0000 7f0dd8879640 1 --2- 172.21.15.102:0/543508415 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0dc0005190 0x7f0dd4155a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:35.682 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:35.674+0000 7f0dd8879640 1 -- 172.21.15.102:0/543508415 >> 172.21.15.102:0/543508415 conn(0x7f0dd40b0870 msgr2=0x7f0dd4151100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-13T11:29:35.682 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:35.674+0000 7f0dd8879640 1 -- 172.21.15.102:0/543508415 shutdown_connections 2023-11-13T11:29:35.682 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:35.674+0000 7f0dd8879640 1 -- 172.21.15.102:0/543508415 wait complete. 2023-11-13T11:29:35.700 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-13T11:28:44.981356+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-13T11:28:55.958525+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-11-13T11:28:56.394264+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-13T11:29:35.701 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-13T11:29:35.843 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:35.838+0000 7f4905501640 1 Processor -- start 2023-11-13T11:29:35.843 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:35.838+0000 7f4905501640 1 -- start start 2023-11-13T11:29:35.846 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:35.838+0000 7f4905501640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4900070320 0x7f49000b3580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:35.846 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:35.838+0000 7f4905501640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f49000ce320 0x7f490006c160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:35.847 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:35.838+0000 7f4905501640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f49000b2af0 con 0x7f4900159420 2023-11-13T11:29:35.847 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:35.838+0000 7f4905501640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f49000b2dd0 con 0x7f49000ce320 2023-11-13T11:29:35.847 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:35.838+0000 7f4905501640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f49000b30b0 con 0x7f4900070320 2023-11-13T11:29:35.847 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:35.838+0000 7f48feffd640 1 --1- >> v1:172.21.15.102:6789/0 conn(0x7f4900159420 0x7f490006fc10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.102:6789/0 says I am v1:172.21.15.102:36210/0 (socket says 172.21.15.102:36210) 2023-11-13T11:29:35.848 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:35.838+0000 7f48feffd640 1 -- 172.21.15.102:0/2421000323 learned_addr learned my addr 172.21.15.102:0/2421000323 (peer_addr_for_me v1:172.21.15.102:0/0) 2023-11-13T11:29:35.848 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:35.838+0000 7f48ff7fe640 1 --2- 172.21.15.102:0/2421000323 >> v2:172.21.15.154:3300/0 conn(0x7f49000ce320 0x7f490006c160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:35.848 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:35.838+0000 7f48fe7fc640 1 --2- 172.21.15.102:0/2421000323 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4900070320 0x7f49000b3580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:35.848 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:35.838+0000 7f48fdffb640 1 -- 172.21.15.102:0/2421000323 <== mon.0 v1:172.21.15.102:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2368259799 0 0) 0x7f49000b2af0 con 0x7f4900159420 2023-11-13T11:29:35.849 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:35.838+0000 7f48fdffb640 1 -- 172.21.15.102:0/2421000323 --> v1:172.21.15.102:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f48e8003530 con 0x7f4900159420 2023-11-13T11:29:35.850 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:35.838+0000 7f48fdffb640 1 -- 172.21.15.102:0/2421000323 <== mon.0 v1:172.21.15.102:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 811518511 0 0) 0x7f48e8003530 con 0x7f4900159420 2023-11-13T11:29:35.850 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:35.838+0000 7f48fdffb640 1 -- 172.21.15.102:0/2421000323 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4900070320 msgr2=0x7f49000b3580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-13T11:29:35.850 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:35.838+0000 7f48fdffb640 1 --2- 172.21.15.102:0/2421000323 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4900070320 0x7f49000b3580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:35.851 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:35.838+0000 7f48fdffb640 1 -- 172.21.15.102:0/2421000323 >> v2:172.21.15.154:3300/0 conn(0x7f49000ce320 msgr2=0x7f490006c160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-13T11:29:35.852 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:35.838+0000 7f48fdffb640 1 --2- 172.21.15.102:0/2421000323 >> v2:172.21.15.154:3300/0 conn(0x7f49000ce320 0x7f490006c160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:35.852 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:35.838+0000 7f48fdffb640 1 -- 172.21.15.102:0/2421000323 --> v1:172.21.15.102:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f490006bc40 con 0x7f4900159420 2023-11-13T11:29:35.852 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:35.838+0000 7f48fdffb640 1 -- 172.21.15.102:0/2421000323 <== mon.0 v1:172.21.15.102:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 895381068 0 0) 0x7f48f0001680 con 0x7f4900159420 2023-11-13T11:29:35.852 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:35.838+0000 7f48fdffb640 1 -- 172.21.15.102:0/2421000323 >> v1:172.21.15.102:6789/0 conn(0x7f4900159420 legacy=0x7f490006fc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:35.853 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:35.838+0000 7f48fdffb640 1 --2- 172.21.15.102:0/2421000323 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f48e80039b0 0x7f48e8003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:35.853 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:35.838+0000 7f48fdffb640 1 --2- 172.21.15.102:0/2421000323 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f48e80047d0 0x7f48e8004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:35.853 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:35.838+0000 7f48fdffb640 1 --2- 172.21.15.102:0/2421000323 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4900070320 0x7f48e8005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:35.853 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:35.838+0000 7f48fdffb640 1 -- 172.21.15.102:0/2421000323 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49000b2dd0 con 0x7f48e80047d0 2023-11-13T11:29:35.853 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:35.838+0000 7f48fdffb640 1 -- 172.21.15.102:0/2421000323 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49000b30b0 con 0x7f48e80039b0 2023-11-13T11:29:35.854 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:35.838+0000 7f48fdffb640 1 -- 172.21.15.102:0/2421000323 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f48e800b990 con 0x7f4900070320 2023-11-13T11:29:35.854 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:35.838+0000 7f48fe7fc640 1 --2- 172.21.15.102:0/2421000323 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f48e80047d0 0x7f48e8004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:35.854 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:35.838+0000 7f48feffd640 1 --2- 172.21.15.102:0/2421000323 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f48e80039b0 0x7f48e8003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:35.854 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:35.838+0000 7f48ff7fe640 1 --2- 172.21.15.102:0/2421000323 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4900070320 0x7f48e8005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:35.854 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:35.838+0000 7f48fe7fc640 1 -- 172.21.15.102:0/2421000323 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4900070320 msgr2=0x7f48e8005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-13T11:29:35.855 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:35.838+0000 7f48fe7fc640 1 --2- 172.21.15.102:0/2421000323 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4900070320 0x7f48e8005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:35.855 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:35.838+0000 7f48fe7fc640 1 -- 172.21.15.102:0/2421000323 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f48e80039b0 msgr2=0x7f48e8003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-13T11:29:35.855 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:35.838+0000 7f48fe7fc640 1 --2- 172.21.15.102:0/2421000323 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f48e80039b0 0x7f48e8003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:35.855 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:35.838+0000 7f48fe7fc640 1 -- 172.21.15.102:0/2421000323 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48e8003530 con 0x7f48e80047d0 2023-11-13T11:29:35.860 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:35.842+0000 7f48fe7fc640 1 --2- 172.21.15.102:0/2421000323 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f48e80047d0 0x7f48e8004c50 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f48f4009ae0 tx=0x7f48f401ca50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d405589985e592d7 server_cookie=0 in_seq=0 out_seq=0 2023-11-13T11:29:35.860 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:35.842+0000 7f48fdffb640 1 -- 172.21.15.102:0/2421000323 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48f40a6470 con 0x7f48e80047d0 2023-11-13T11:29:35.860 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:35.842+0000 7f48fdffb640 1 -- 172.21.15.102:0/2421000323 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f48f40a65d0 con 0x7f48e80047d0 2023-11-13T11:29:35.860 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:35.842+0000 7f48fdffb640 1 -- 172.21.15.102:0/2421000323 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48f40a6980 con 0x7f48e80047d0 2023-11-13T11:29:35.861 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:35.842+0000 7f4905501640 1 -- 172.21.15.102:0/2421000323 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f48e80047d0 msgr2=0x7f48e8004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:35.861 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:35.842+0000 7f4905501640 1 --2- 172.21.15.102:0/2421000323 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f48e80047d0 0x7f48e8004c50 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f48f4009ae0 tx=0x7f48f401ca50 comp rx=0 tx=0).stop 2023-11-13T11:29:35.861 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:35.842+0000 7f48ff7fe640 1 -- 172.21.15.102:0/2421000323 reap_dead start 2023-11-13T11:29:35.861 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:35.842+0000 7f4905501640 1 -- 172.21.15.102:0/2421000323 shutdown_connections 2023-11-13T11:29:35.861 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:35.842+0000 7f4905501640 1 -- 172.21.15.102:0/2421000323 >> 172.21.15.102:0/2421000323 conn(0x7f490006a410 msgr2=0x7f490006a820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-13T11:29:35.862 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:35.842+0000 7f4905501640 1 -- 172.21.15.102:0/2421000323 shutdown_connections 2023-11-13T11:29:35.862 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:35.842+0000 7f4905501640 1 -- 172.21.15.102:0/2421000323 wait complete. 2023-11-13T11:29:35.862 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:35.846+0000 7f4905501640 1 Processor -- start 2023-11-13T11:29:35.862 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:35.846+0000 7f4905501640 1 -- start start 2023-11-13T11:29:35.862 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:35.846+0000 7f4905501640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f48e80047d0 0x7f490014ecf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:35.863 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:35.846+0000 7f4905501640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4900147f50 0x7f490014d4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:35.863 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:35.846+0000 7f4905501640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f49001483d0 0x7f490014da00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:35.863 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:35.846+0000 7f4905501640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f490014f230 con 0x7f49001483d0 2023-11-13T11:29:35.863 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:35.846+0000 7f4905501640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4900150070 con 0x7f4900147f50 2023-11-13T11:29:35.863 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:35.846+0000 7f4905501640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f490014f460 con 0x7f48e80047d0 2023-11-13T11:29:35.863 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:35.846+0000 7f48ff7fe640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f49001483d0 0x7f490014da00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:35.864 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:35.846+0000 7f48ff7fe640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f49001483d0 0x7f490014da00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:48408/0 (socket says 172.21.15.102:48408) 2023-11-13T11:29:35.864 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:35.846+0000 7f48ff7fe640 1 -- 172.21.15.102:0/1633407595 learned_addr learned my addr 172.21.15.102:0/1633407595 (peer_addr_for_me v2:172.21.15.102:0/0) 2023-11-13T11:29:35.864 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:35.846+0000 7f48fe7fc640 1 --2- 172.21.15.102:0/1633407595 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4900147f50 0x7f490014d4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:35.864 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:35.846+0000 7f48feffd640 1 --2- 172.21.15.102:0/1633407595 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f48e80047d0 0x7f490014ecf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:35.865 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:35.846+0000 7f48ff7fe640 1 -- 172.21.15.102:0/1633407595 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f48e80047d0 msgr2=0x7f490014ecf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:35.865 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:35.846+0000 7f48ff7fe640 1 --2- 172.21.15.102:0/1633407595 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f48e80047d0 0x7f490014ecf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:35.865 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:35.846+0000 7f48ff7fe640 1 -- 172.21.15.102:0/1633407595 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4900147f50 msgr2=0x7f490014d4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:35.865 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:35.846+0000 7f48ff7fe640 1 --2- 172.21.15.102:0/1633407595 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4900147f50 0x7f490014d4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:35.865 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:35.846+0000 7f48ff7fe640 1 -- 172.21.15.102:0/1633407595 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4900070b50 con 0x7f49001483d0 2023-11-13T11:29:35.866 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:35.846+0000 7f48ff7fe640 1 --2- 172.21.15.102:0/1633407595 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f49001483d0 0x7f490014da00 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f49000b1b30 tx=0x7f48f800f580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-13T11:29:35.866 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:35.846+0000 7f48e77fe640 1 -- 172.21.15.102:0/1633407595 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48f800e040 con 0x7f49001483d0 2023-11-13T11:29:35.867 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:35.846+0000 7f48e77fe640 1 -- 172.21.15.102:0/1633407595 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f48f800f040 con 0x7f49001483d0 2023-11-13T11:29:35.867 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:35.846+0000 7f4905501640 1 -- 172.21.15.102:0/1633407595 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f490014f740 con 0x7f49001483d0 2023-11-13T11:29:35.868 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:35.846+0000 7f48e77fe640 1 -- 172.21.15.102:0/1633407595 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48f8015430 con 0x7f49001483d0 2023-11-13T11:29:35.868 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:35.846+0000 7f4905501640 1 -- 172.21.15.102:0/1633407595 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f490014fd00 con 0x7f49001483d0 2023-11-13T11:29:35.868 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:35.850+0000 7f4905501640 1 -- 172.21.15.102:0/1633407595 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4900067640 con 0x7f49001483d0 2023-11-13T11:29:35.869 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:35.850+0000 7f48e77fe640 1 -- 172.21.15.102:0/1633407595 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f48f8015590 con 0x7f49001483d0 2023-11-13T11:29:35.869 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:35.850+0000 7f48e77fe640 1 --2- 172.21.15.102:0/1633407595 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f48ec066470 0x7f48ec068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:35.869 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:35.850+0000 7f48e77fe640 1 -- 172.21.15.102:0/1633407595 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f48f80846b0 con 0x7f49001483d0 2023-11-13T11:29:35.869 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:35.850+0000 7f48feffd640 1 --2- 172.21.15.102:0/1633407595 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f48ec066470 0x7f48ec068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:35.869 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:35.850+0000 7f48feffd640 1 --2- 172.21.15.102:0/1633407595 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f48ec066470 0x7f48ec068930 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f48f0001060 tx=0x7f48f0009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-13T11:29:35.870 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:35.854+0000 7f48e77fe640 1 -- 172.21.15.102:0/1633407595 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f48f8051b30 con 0x7f49001483d0 2023-11-13T11:29:36.011 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:36.006+0000 7f4905501640 1 -- 172.21.15.102:0/1633407595 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f49001501e0 con 0x7f49001483d0 2023-11-13T11:29:36.012 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:36.006+0000 7f48e77fe640 1 -- 172.21.15.102:0/1633407595 <== mon.0 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v22) v1 ==== 93+0+10 (secure 0 0 0) 0x7f48f8055150 con 0x7f49001483d0 2023-11-13T11:29:36.012 INFO:teuthology.orchestra.run.smithi102.stdout:pg_num: 1 2023-11-13T11:29:36.013 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:36.006+0000 7f4905501640 1 -- 172.21.15.102:0/1633407595 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f48ec066470 msgr2=0x7f48ec068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:36.014 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:36.006+0000 7f4905501640 1 --2- 172.21.15.102:0/1633407595 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f48ec066470 0x7f48ec068930 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f48f0001060 tx=0x7f48f0009040 comp rx=0 tx=0).stop 2023-11-13T11:29:36.014 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:36.006+0000 7f4905501640 1 -- 172.21.15.102:0/1633407595 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f49001483d0 msgr2=0x7f490014da00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:36.014 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:36.006+0000 7f4905501640 1 --2- 172.21.15.102:0/1633407595 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f49001483d0 0x7f490014da00 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f49000b1b30 tx=0x7f48f800f580 comp rx=0 tx=0).stop 2023-11-13T11:29:36.014 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:36.006+0000 7f4905501640 1 -- 172.21.15.102:0/1633407595 shutdown_connections 2023-11-13T11:29:36.015 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:36.006+0000 7f4905501640 1 --2- 172.21.15.102:0/1633407595 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f48ec066470 0x7f48ec068930 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:36.015 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:36.006+0000 7f4905501640 1 --2- 172.21.15.102:0/1633407595 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f49001483d0 0x7f490014da00 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:36.015 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:36.006+0000 7f4905501640 1 --2- 172.21.15.102:0/1633407595 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4900147f50 0x7f490014d4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:36.015 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:36.006+0000 7f4905501640 1 --2- 172.21.15.102:0/1633407595 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f48e80047d0 0x7f490014ecf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:36.015 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:36.006+0000 7f4905501640 1 -- 172.21.15.102:0/1633407595 >> 172.21.15.102:0/1633407595 conn(0x7f490006a410 msgr2=0x7f49000ad8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-13T11:29:36.016 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:36.006+0000 7f4905501640 1 -- 172.21.15.102:0/1633407595 shutdown_connections 2023-11-13T11:29:36.016 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:36.006+0000 7f4905501640 1 -- 172.21.15.102:0/1633407595 wait complete. 2023-11-13T11:29:36.033 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-13T11:29:36.174 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:36.166+0000 7f1cf68fe640 1 Processor -- start 2023-11-13T11:29:36.174 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:36.166+0000 7f1cf68fe640 1 -- start start 2023-11-13T11:29:36.175 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:36.170+0000 7f1cf68fe640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f1cf006fc80 0x7f1cf00711c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:36.176 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:36.170+0000 7f1cf68fe640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1cf00b21f0 con 0x7f1cf0159b30 2023-11-13T11:29:36.176 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:36.170+0000 7f1cf68fe640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1cf00b2440 con 0x7f1cf00cf2d0 2023-11-13T11:29:36.176 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:36.170+0000 7f1cf68fe640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1cf00b2720 con 0x7f1cf006fc80 2023-11-13T11:29:36.176 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:36.170+0000 7f1ceffff640 1 --1- >> v1:172.21.15.102:6789/0 conn(0x7f1cf0159b30 0x7f1cf00cebc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.102:6789/0 says I am v1:172.21.15.102:36224/0 (socket says 172.21.15.102:36224) 2023-11-13T11:29:36.177 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:36.170+0000 7f1ceffff640 1 -- 172.21.15.102:0/1426112872 learned_addr learned my addr 172.21.15.102:0/1426112872 (peer_addr_for_me v1:172.21.15.102:0/0) 2023-11-13T11:29:36.177 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:36.170+0000 7f1cf4e9b640 1 --2- 172.21.15.102:0/1426112872 >> v2:172.21.15.154:3300/0 conn(0x7f1cf006fc80 0x7f1cf00711c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:36.177 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:36.170+0000 7f1ceeffd640 1 -- 172.21.15.102:0/1426112872 <== mon.0 v1:172.21.15.102:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3098302879 0 0) 0x7f1cf00b21f0 con 0x7f1cf0159b30 2023-11-13T11:29:36.178 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:36.170+0000 7f1ceeffd640 1 -- 172.21.15.102:0/1426112872 --> v1:172.21.15.102:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1cd8003530 con 0x7f1cf0159b30 2023-11-13T11:29:36.178 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:36.170+0000 7f1ceeffd640 1 -- 172.21.15.102:0/1426112872 <== mon.0 v1:172.21.15.102:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1012803553 0 0) 0x7f1cd8003530 con 0x7f1cf0159b30 2023-11-13T11:29:36.178 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:36.170+0000 7f1cf4e9b640 1 -- 172.21.15.102:0/1426112872 >> v1:172.21.15.154:6789/0 conn(0x7f1cf00cf2d0 legacy=0x7f1cf00cbe90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:36.178 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:36.170+0000 7f1cf4e9b640 1 -- 172.21.15.102:0/1426112872 >> v1:172.21.15.102:6789/0 conn(0x7f1cf0159b30 legacy=0x7f1cf00cebc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:36.178 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:36.170+0000 7f1cf4e9b640 1 -- 172.21.15.102:0/1426112872 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1cf00b2d20 con 0x7f1cf006fc80 2023-11-13T11:29:36.179 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:36.174+0000 7f1cf4e9b640 1 --2- 172.21.15.102:0/1426112872 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1cf006fc80 0x7f1cf00711c0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f1ce8009dc0 tx=0x7f1ce801c820 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d8da8aa90423fec7 server_cookie=0 in_seq=0 out_seq=0 2023-11-13T11:29:36.180 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:36.174+0000 7f1ceeffd640 1 -- 172.21.15.102:0/1426112872 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ce0001680 con 0x7f1cf006fc80 2023-11-13T11:29:36.180 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:36.174+0000 7f1ceeffd640 1 -- 172.21.15.102:0/1426112872 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ce80a5630 con 0x7f1cf006fc80 2023-11-13T11:29:36.180 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:36.174+0000 7f1ceeffd640 1 -- 172.21.15.102:0/1426112872 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ce80a59c0 con 0x7f1cf006fc80 2023-11-13T11:29:36.181 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:36.174+0000 7f1cf68fe640 1 -- 172.21.15.102:0/1426112872 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1cf006fc80 msgr2=0x7f1cf00711c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:36.181 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:36.174+0000 7f1cf68fe640 1 --2- 172.21.15.102:0/1426112872 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1cf006fc80 0x7f1cf00711c0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f1ce8009dc0 tx=0x7f1ce801c820 comp rx=0 tx=0).stop 2023-11-13T11:29:36.181 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:36.174+0000 7f1cf68fe640 1 -- 172.21.15.102:0/1426112872 shutdown_connections 2023-11-13T11:29:36.181 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:36.174+0000 7f1cf68fe640 1 --2- 172.21.15.102:0/1426112872 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1cf006fc80 0x7f1cf00711c0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:36.182 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:36.174+0000 7f1cf68fe640 1 -- 172.21.15.102:0/1426112872 >> 172.21.15.102:0/1426112872 conn(0x7f1cf006a410 msgr2=0x7f1cf006a820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-13T11:29:36.182 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:36.174+0000 7f1cf68fe640 1 -- 172.21.15.102:0/1426112872 shutdown_connections 2023-11-13T11:29:36.182 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:36.174+0000 7f1cf68fe640 1 -- 172.21.15.102:0/1426112872 wait complete. 2023-11-13T11:29:36.184 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:36.174+0000 7f1cf68fe640 1 Processor -- start 2023-11-13T11:29:36.184 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:36.174+0000 7f1cf68fe640 1 -- start start 2023-11-13T11:29:36.184 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:36.178+0000 7f1cf68fe640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1cf006fc80 0x7f1cf0134bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:36.184 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:36.178+0000 7f1cf68fe640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1cf00cf2d0 0x7f1cf00cd120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:36.185 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:36.178+0000 7f1cf68fe640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1cf0159b30 0x7f1cf01459d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:36.185 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:36.178+0000 7f1cf68fe640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1cf00cd660 con 0x7f1cf0159b30 2023-11-13T11:29:36.185 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:36.178+0000 7f1cf68fe640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1cf0145f10 con 0x7f1cf00cf2d0 2023-11-13T11:29:36.185 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:36.178+0000 7f1cf68fe640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1cf00cd8c0 con 0x7f1cf006fc80 2023-11-13T11:29:36.185 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:36.178+0000 7f1cf4e9b640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1cf0159b30 0x7f1cf01459d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:36.186 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:36.178+0000 7f1cf4e9b640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1cf0159b30 0x7f1cf01459d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:48420/0 (socket says 172.21.15.102:48420) 2023-11-13T11:29:36.186 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:36.178+0000 7f1cf4e9b640 1 -- 172.21.15.102:0/4009842069 learned_addr learned my addr 172.21.15.102:0/4009842069 (peer_addr_for_me v2:172.21.15.102:0/0) 2023-11-13T11:29:36.186 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:36.178+0000 7f1ceffff640 1 --2- 172.21.15.102:0/4009842069 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1cf006fc80 0x7f1cf0134bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:36.186 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:36.178+0000 7f1cef7fe640 1 --2- 172.21.15.102:0/4009842069 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1cf00cf2d0 0x7f1cf00cd120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:36.186 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:36.178+0000 7f1cf4e9b640 1 -- 172.21.15.102:0/4009842069 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1cf006fc80 msgr2=0x7f1cf0134bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:36.187 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:36.178+0000 7f1cf4e9b640 1 --2- 172.21.15.102:0/4009842069 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1cf006fc80 0x7f1cf0134bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:36.187 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:36.178+0000 7f1cf4e9b640 1 -- 172.21.15.102:0/4009842069 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1cf00cf2d0 msgr2=0x7f1cf00cd120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:36.187 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:36.178+0000 7f1cf4e9b640 1 --2- 172.21.15.102:0/4009842069 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1cf00cf2d0 0x7f1cf00cd120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:36.187 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:36.178+0000 7f1cf4e9b640 1 -- 172.21.15.102:0/4009842069 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ce8009a70 con 0x7f1cf0159b30 2023-11-13T11:29:36.187 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:36.178+0000 7f1cf4e9b640 1 --2- 172.21.15.102:0/4009842069 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1cf0159b30 0x7f1cf01459d0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f1ce80b0040 tx=0x7f1ce80195c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-13T11:29:36.189 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:36.178+0000 7f1cecff9640 1 -- 172.21.15.102:0/4009842069 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ce8003ba0 con 0x7f1cf0159b30 2023-11-13T11:29:36.189 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:36.178+0000 7f1cecff9640 1 -- 172.21.15.102:0/4009842069 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ce8003d20 con 0x7f1cf0159b30 2023-11-13T11:29:36.189 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:36.178+0000 7f1cf68fe640 1 -- 172.21.15.102:0/4009842069 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1cf00cdba0 con 0x7f1cf0159b30 2023-11-13T11:29:36.189 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:36.178+0000 7f1cecff9640 1 -- 172.21.15.102:0/4009842069 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ce80ad890 con 0x7f1cf0159b30 2023-11-13T11:29:36.189 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:36.178+0000 7f1cf68fe640 1 -- 172.21.15.102:0/4009842069 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1cf00ce160 con 0x7f1cf0159b30 2023-11-13T11:29:36.190 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:36.178+0000 7f1cf68fe640 1 -- 172.21.15.102:0/4009842069 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1cf0067640 con 0x7f1cf0159b30 2023-11-13T11:29:36.190 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:36.178+0000 7f1cecff9640 1 -- 172.21.15.102:0/4009842069 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f1ce80b4050 con 0x7f1cf0159b30 2023-11-13T11:29:36.190 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:36.182+0000 7f1cecff9640 1 --2- 172.21.15.102:0/4009842069 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f1cdc066470 0x7f1cdc068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:36.190 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:36.182+0000 7f1cecff9640 1 -- 172.21.15.102:0/4009842069 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f1ce811ea30 con 0x7f1cf0159b30 2023-11-13T11:29:36.190 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:36.182+0000 7f1ceffff640 1 --2- 172.21.15.102:0/4009842069 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f1cdc066470 0x7f1cdc068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:36.191 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:36.182+0000 7f1ceffff640 1 --2- 172.21.15.102:0/4009842069 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f1cdc066470 0x7f1cdc068930 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f1ce0000f70 tx=0x7f1ce0009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-13T11:29:36.191 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:36.186+0000 7f1cecff9640 1 -- 172.21.15.102:0/4009842069 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f1ce80ebf40 con 0x7f1cf0159b30 2023-11-13T11:29:36.341 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:36.334+0000 7f1cf68fe640 1 -- 172.21.15.102:0/4009842069 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f1cf0068520 con 0x7f1cf0159b30 2023-11-13T11:29:36.341 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:36.334+0000 7f1cecff9640 1 -- 172.21.15.102:0/4009842069 <== mon.0 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v22) v1 ==== 104+0+11 (secure 0 0 0) 0x7f1ce8009450 con 0x7f1cf0159b30 2023-11-13T11:29:36.342 INFO:teuthology.orchestra.run.smithi102.stdout:pg_num: 32 2023-11-13T11:29:36.343 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:36.338+0000 7f1cf68fe640 1 -- 172.21.15.102:0/4009842069 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f1cdc066470 msgr2=0x7f1cdc068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:36.343 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:36.338+0000 7f1cf68fe640 1 --2- 172.21.15.102:0/4009842069 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f1cdc066470 0x7f1cdc068930 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f1ce0000f70 tx=0x7f1ce0009040 comp rx=0 tx=0).stop 2023-11-13T11:29:36.344 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:36.338+0000 7f1cf68fe640 1 -- 172.21.15.102:0/4009842069 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1cf0159b30 msgr2=0x7f1cf01459d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:36.344 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:36.338+0000 7f1cf68fe640 1 --2- 172.21.15.102:0/4009842069 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1cf0159b30 0x7f1cf01459d0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f1ce80b0040 tx=0x7f1ce80195c0 comp rx=0 tx=0).stop 2023-11-13T11:29:36.344 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:36.338+0000 7f1cf68fe640 1 -- 172.21.15.102:0/4009842069 shutdown_connections 2023-11-13T11:29:36.344 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:36.338+0000 7f1cf68fe640 1 --2- 172.21.15.102:0/4009842069 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f1cdc066470 0x7f1cdc068930 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:36.345 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:36.338+0000 7f1cf68fe640 1 --2- 172.21.15.102:0/4009842069 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1cf0159b30 0x7f1cf01459d0 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:36.345 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:36.338+0000 7f1cf68fe640 1 --2- 172.21.15.102:0/4009842069 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1cf00cf2d0 0x7f1cf00cd120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:36.345 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:36.338+0000 7f1cf68fe640 1 --2- 172.21.15.102:0/4009842069 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1cf006fc80 0x7f1cf0134bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:36.345 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:36.338+0000 7f1cf68fe640 1 -- 172.21.15.102:0/4009842069 >> 172.21.15.102:0/4009842069 conn(0x7f1cf006a410 msgr2=0x7f1cf01500a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-13T11:29:36.345 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:36.338+0000 7f1cf68fe640 1 -- 172.21.15.102:0/4009842069 shutdown_connections 2023-11-13T11:29:36.345 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:36.338+0000 7f1cf68fe640 1 -- 172.21.15.102:0/4009842069 wait complete. 2023-11-13T11:29:36.363 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-13T11:29:36.505 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:36.498+0000 7f9f3c805640 1 Processor -- start 2023-11-13T11:29:36.505 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:36.498+0000 7f9f3c805640 1 -- start start 2023-11-13T11:29:36.507 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:36.498+0000 7f9f3c805640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f9f38070320 0x7f9f380b3580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:36.507 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:36.498+0000 7f9f3c805640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9f380ce320 0x7f9f3806c160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:36.507 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:36.498+0000 7f9f3c805640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9f380b2af0 con 0x7f9f38159420 2023-11-13T11:29:36.507 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:36.498+0000 7f9f3c805640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9f380b2dd0 con 0x7f9f38070320 2023-11-13T11:29:36.507 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:36.498+0000 7f9f3c805640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f380b30b0 con 0x7f9f380ce320 2023-11-13T11:29:36.508 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:36.498+0000 7f9f2dd9b640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f9f38070320 0x7f9f380b3580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:36.508 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:36.498+0000 7f9f2dd9b640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f9f38070320 0x7f9f380b3580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:48428/0 (socket says 172.21.15.102:48428) 2023-11-13T11:29:36.508 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:36.498+0000 7f9f2dd9b640 1 -- 172.21.15.102:0/4137043501 learned_addr learned my addr 172.21.15.102:0/4137043501 (peer_addr_for_me v2:172.21.15.102:0/0) 2023-11-13T11:29:36.508 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:36.498+0000 7f9f36d9d640 1 --2- 172.21.15.102:0/4137043501 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9f380ce320 0x7f9f3806c160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:36.508 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:36.502+0000 7f9f2dd9b640 1 -- 172.21.15.102:0/4137043501 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9f380ce320 msgr2=0x7f9f3806c160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-13T11:29:36.509 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:36.502+0000 7f9f2dd9b640 1 --2- 172.21.15.102:0/4137043501 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9f380ce320 0x7f9f3806c160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:36.509 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:36.502+0000 7f9f2dd9b640 1 -- 172.21.15.102:0/4137043501 >> v1:172.21.15.154:6789/0 conn(0x7f9f38159420 legacy=0x7f9f3806fc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:36.509 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:36.502+0000 7f9f2dd9b640 1 -- 172.21.15.102:0/4137043501 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f3806bc40 con 0x7f9f38070320 2023-11-13T11:29:36.510 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:36.502+0000 7f9f2dd9b640 1 --2- 172.21.15.102:0/4137043501 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9f38070320 0x7f9f380b3580 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f9f20009870 tx=0x7f9f2001d650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8f189a81742f4c42 server_cookie=0 in_seq=0 out_seq=0 2023-11-13T11:29:36.510 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:36.502+0000 7f9f35d9b640 1 -- 172.21.15.102:0/4137043501 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f200ac5f0 con 0x7f9f38070320 2023-11-13T11:29:36.510 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:36.502+0000 7f9f35d9b640 1 -- 172.21.15.102:0/4137043501 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f200ac750 con 0x7f9f38070320 2023-11-13T11:29:36.510 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:36.502+0000 7f9f35d9b640 1 -- 172.21.15.102:0/4137043501 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f200acae0 con 0x7f9f38070320 2023-11-13T11:29:36.511 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:36.502+0000 7f9f3c805640 1 -- 172.21.15.102:0/4137043501 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9f38070320 msgr2=0x7f9f380b3580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:36.512 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:36.502+0000 7f9f3c805640 1 --2- 172.21.15.102:0/4137043501 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9f38070320 0x7f9f380b3580 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f9f20009870 tx=0x7f9f2001d650 comp rx=0 tx=0).stop 2023-11-13T11:29:36.512 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:36.506+0000 7f9f3c805640 1 -- 172.21.15.102:0/4137043501 shutdown_connections 2023-11-13T11:29:36.512 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:36.506+0000 7f9f3c805640 1 --2- 172.21.15.102:0/4137043501 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9f380ce320 0x7f9f3806c160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:36.512 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:36.506+0000 7f9f3c805640 1 --2- 172.21.15.102:0/4137043501 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9f38070320 0x7f9f380b3580 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:36.512 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:36.506+0000 7f9f3c805640 1 -- 172.21.15.102:0/4137043501 >> 172.21.15.102:0/4137043501 conn(0x7f9f3806a410 msgr2=0x7f9f3806a820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-13T11:29:36.513 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:36.506+0000 7f9f3c805640 1 -- 172.21.15.102:0/4137043501 shutdown_connections 2023-11-13T11:29:36.513 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:36.506+0000 7f9f3c805640 1 -- 172.21.15.102:0/4137043501 wait complete. 2023-11-13T11:29:36.515 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:36.506+0000 7f9f3c805640 1 Processor -- start 2023-11-13T11:29:36.515 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:36.506+0000 7f9f3c805640 1 -- start start 2023-11-13T11:29:36.516 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:36.506+0000 7f9f3c805640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9f38070320 0x7f9f381f8910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:36.516 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:36.506+0000 7f9f3c805640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9f380ce320 0x7f9f3813bff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:36.516 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:36.506+0000 7f9f3c805640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9f38159420 0x7f9f3815c1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:36.516 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:36.506+0000 7f9f3c805640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f3814f4a0 con 0x7f9f38159420 2023-11-13T11:29:36.516 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:36.506+0000 7f9f3c805640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f381f8e50 con 0x7f9f38070320 2023-11-13T11:29:36.517 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:36.506+0000 7f9f3c805640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f3814e5d0 con 0x7f9f380ce320 2023-11-13T11:29:36.517 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:36.506+0000 7f9f36d9d640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9f38159420 0x7f9f3815c1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:36.517 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:36.506+0000 7f9f36d9d640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9f38159420 0x7f9f3815c1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:48430/0 (socket says 172.21.15.102:48430) 2023-11-13T11:29:36.517 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:36.506+0000 7f9f36d9d640 1 -- 172.21.15.102:0/373433316 learned_addr learned my addr 172.21.15.102:0/373433316 (peer_addr_for_me v2:172.21.15.102:0/0) 2023-11-13T11:29:36.517 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:36.506+0000 7f9f2dd9b640 1 --2- 172.21.15.102:0/373433316 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9f380ce320 0x7f9f3813bff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:36.517 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:36.506+0000 7f9f3659c640 1 --2- 172.21.15.102:0/373433316 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9f38070320 0x7f9f381f8910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:36.518 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:36.506+0000 7f9f36d9d640 1 -- 172.21.15.102:0/373433316 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9f380ce320 msgr2=0x7f9f3813bff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:36.518 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:36.506+0000 7f9f36d9d640 1 --2- 172.21.15.102:0/373433316 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9f380ce320 0x7f9f3813bff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:36.518 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:36.506+0000 7f9f36d9d640 1 -- 172.21.15.102:0/373433316 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9f38070320 msgr2=0x7f9f381f8910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:36.518 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:36.506+0000 7f9f36d9d640 1 --2- 172.21.15.102:0/373433316 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9f38070320 0x7f9f381f8910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:36.519 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:36.506+0000 7f9f36d9d640 1 -- 172.21.15.102:0/373433316 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f200094d0 con 0x7f9f38159420 2023-11-13T11:29:36.519 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:36.510+0000 7f9f36d9d640 1 --2- 172.21.15.102:0/373433316 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9f38159420 0x7f9f3815c1e0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f9f30009dd0 tx=0x7f9f3000c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-13T11:29:36.519 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:36.510+0000 7f9f2f7fe640 1 -- 172.21.15.102:0/373433316 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f30014480 con 0x7f9f38159420 2023-11-13T11:29:36.519 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:36.510+0000 7f9f2f7fe640 1 -- 172.21.15.102:0/373433316 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f3000f040 con 0x7f9f38159420 2023-11-13T11:29:36.519 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:36.510+0000 7f9f2f7fe640 1 -- 172.21.15.102:0/373433316 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f30014840 con 0x7f9f38159420 2023-11-13T11:29:36.520 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:36.510+0000 7f9f3c805640 1 -- 172.21.15.102:0/373433316 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9f3814e820 con 0x7f9f38159420 2023-11-13T11:29:36.520 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:36.510+0000 7f9f3c805640 1 -- 172.21.15.102:0/373433316 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9f3814ede0 con 0x7f9f38159420 2023-11-13T11:29:36.521 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:36.510+0000 7f9f3c805640 1 -- 172.21.15.102:0/373433316 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9f3814f5e0 con 0x7f9f38159420 2023-11-13T11:29:36.522 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:36.510+0000 7f9f2f7fe640 1 -- 172.21.15.102:0/373433316 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f9f300149a0 con 0x7f9f38159420 2023-11-13T11:29:36.522 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:36.510+0000 7f9f2f7fe640 1 --2- 172.21.15.102:0/373433316 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f9f180664a0 0x7f9f18068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:36.522 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:36.510+0000 7f9f2f7fe640 1 -- 172.21.15.102:0/373433316 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f9f30084ab0 con 0x7f9f38159420 2023-11-13T11:29:36.522 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:36.510+0000 7f9f3659c640 1 --2- 172.21.15.102:0/373433316 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f9f180664a0 0x7f9f18068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:36.523 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:36.510+0000 7f9f3659c640 1 --2- 172.21.15.102:0/373433316 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f9f180664a0 0x7f9f18068960 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f9f280015b0 tx=0x7f9f28009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-13T11:29:36.524 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:36.514+0000 7f9f2f7fe640 1 -- 172.21.15.102:0/373433316 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f9f3814f5e0 con 0x7f9f38159420 2023-11-13T11:29:36.671 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:36.666+0000 7f9f3c805640 1 -- 172.21.15.102:0/373433316 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f9f3814f5e0 con 0x7f9f38159420 2023-11-13T11:29:36.672 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:36.666+0000 7f9f2f7fe640 1 -- 172.21.15.102:0/373433316 <== mon.0 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v22) v1 ==== 100+0+11 (secure 0 0 0) 0x7f9f30018020 con 0x7f9f38159420 2023-11-13T11:29:36.672 INFO:teuthology.orchestra.run.smithi102.stdout:pg_num: 64 2023-11-13T11:29:36.674 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:36.666+0000 7f9f3c805640 1 -- 172.21.15.102:0/373433316 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f9f180664a0 msgr2=0x7f9f18068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:36.674 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:36.666+0000 7f9f3c805640 1 --2- 172.21.15.102:0/373433316 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f9f180664a0 0x7f9f18068960 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f9f280015b0 tx=0x7f9f28009040 comp rx=0 tx=0).stop 2023-11-13T11:29:36.674 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:36.666+0000 7f9f3c805640 1 -- 172.21.15.102:0/373433316 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9f38159420 msgr2=0x7f9f3815c1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:36.675 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:36.666+0000 7f9f3c805640 1 --2- 172.21.15.102:0/373433316 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9f38159420 0x7f9f3815c1e0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f9f30009dd0 tx=0x7f9f3000c490 comp rx=0 tx=0).stop 2023-11-13T11:29:36.675 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:36.666+0000 7f9f3c805640 1 -- 172.21.15.102:0/373433316 shutdown_connections 2023-11-13T11:29:36.675 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:36.666+0000 7f9f3c805640 1 --2- 172.21.15.102:0/373433316 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f9f180664a0 0x7f9f18068960 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:36.675 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:36.666+0000 7f9f3c805640 1 --2- 172.21.15.102:0/373433316 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9f38159420 0x7f9f3815c1e0 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:36.675 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:36.666+0000 7f9f3c805640 1 --2- 172.21.15.102:0/373433316 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9f380ce320 0x7f9f3813bff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:36.676 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:36.666+0000 7f9f3c805640 1 --2- 172.21.15.102:0/373433316 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9f38070320 0x7f9f381f8910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:36.676 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:36.666+0000 7f9f3c805640 1 -- 172.21.15.102:0/373433316 >> 172.21.15.102:0/373433316 conn(0x7f9f3806a410 msgr2=0x7f9f38155620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-13T11:29:36.676 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:36.666+0000 7f9f3c805640 1 -- 172.21.15.102:0/373433316 shutdown_connections 2023-11-13T11:29:36.676 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:36.666+0000 7f9f3c805640 1 -- 172.21.15.102:0/373433316 wait complete. 2023-11-13T11:29:36.694 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-11-13T11:29:36.832 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:36.826+0000 7f3bf34ea640 1 Processor -- start 2023-11-13T11:29:36.833 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:36.826+0000 7f3bf34ea640 1 -- start start 2023-11-13T11:29:36.834 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:36.826+0000 7f3bf34ea640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f3bec0d0c40 0x7f3bec0c69b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:36.834 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:36.826+0000 7f3bf34ea640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f3bec0cf490 0x7f3bec0cf920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:36.834 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:36.826+0000 7f3bf34ea640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3bec0d1440 con 0x7f3bec1606e0 2023-11-13T11:29:36.834 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:36.826+0000 7f3bf34ea640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3bec0cfe60 con 0x7f3bec0d0c40 2023-11-13T11:29:36.835 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:36.826+0000 7f3bf34ea640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3bec0cdb10 con 0x7f3bec0cf490 2023-11-13T11:29:36.835 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:36.826+0000 7f3bf0a85640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f3bec0d0c40 0x7f3bec0c69b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:36.835 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:36.826+0000 7f3bf0a85640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f3bec0d0c40 0x7f3bec0c69b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:48432/0 (socket says 172.21.15.102:48432) 2023-11-13T11:29:36.835 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:36.826+0000 7f3bf0a85640 1 -- 172.21.15.102:0/2569664454 learned_addr learned my addr 172.21.15.102:0/2569664454 (peer_addr_for_me v2:172.21.15.102:0/0) 2023-11-13T11:29:36.835 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:36.826+0000 7f3bf1a87640 1 --2- 172.21.15.102:0/2569664454 >> v2:172.21.15.154:3300/0 conn(0x7f3bec0cf490 0x7f3bec0cf920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:36.836 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:36.826+0000 7f3bf0a85640 1 -- 172.21.15.102:0/2569664454 >> v2:172.21.15.154:3300/0 conn(0x7f3bec0cf490 msgr2=0x7f3bec0cf920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-13T11:29:36.836 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:36.826+0000 7f3bf0a85640 1 --2- 172.21.15.102:0/2569664454 >> v2:172.21.15.154:3300/0 conn(0x7f3bec0cf490 0x7f3bec0cf920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:36.836 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:36.826+0000 7f3bf0a85640 1 -- 172.21.15.102:0/2569664454 >> v1:172.21.15.154:6789/0 conn(0x7f3bec1606e0 legacy=0x7f3bec0b3e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:36.837 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:36.826+0000 7f3bf0a85640 1 -- 172.21.15.102:0/2569664454 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3bec0d1690 con 0x7f3bec0d0c40 2023-11-13T11:29:36.837 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:36.830+0000 7f3bf0a85640 1 --2- 172.21.15.102:0/2569664454 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3bec0d0c40 0x7f3bec0c69b0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f3bec08b230 tx=0x7f3bdc01c440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a68e88921518e83d server_cookie=0 in_seq=0 out_seq=0 2023-11-13T11:29:36.838 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:36.830+0000 7f3be3fff640 1 -- 172.21.15.102:0/2569664454 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bdc0ab660 con 0x7f3bec0d0c40 2023-11-13T11:29:36.838 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:36.830+0000 7f3be3fff640 1 -- 172.21.15.102:0/2569664454 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3bdc0ab7c0 con 0x7f3bec0d0c40 2023-11-13T11:29:36.838 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:36.830+0000 7f3be3fff640 1 -- 172.21.15.102:0/2569664454 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bdc0abb50 con 0x7f3bec0d0c40 2023-11-13T11:29:36.839 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:36.830+0000 7f3bf34ea640 1 -- 172.21.15.102:0/2569664454 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3bec0d0c40 msgr2=0x7f3bec0c69b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:36.839 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:36.830+0000 7f3bf34ea640 1 --2- 172.21.15.102:0/2569664454 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3bec0d0c40 0x7f3bec0c69b0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f3bec08b230 tx=0x7f3bdc01c440 comp rx=0 tx=0).stop 2023-11-13T11:29:36.839 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:36.830+0000 7f3bf34ea640 1 -- 172.21.15.102:0/2569664454 shutdown_connections 2023-11-13T11:29:36.840 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:36.830+0000 7f3bf34ea640 1 --2- 172.21.15.102:0/2569664454 >> v2:172.21.15.154:3300/0 conn(0x7f3bec0cf490 0x7f3bec0cf920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:36.840 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:36.830+0000 7f3bf34ea640 1 --2- 172.21.15.102:0/2569664454 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3bec0d0c40 0x7f3bec0c69b0 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:36.840 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:36.830+0000 7f3bf34ea640 1 -- 172.21.15.102:0/2569664454 >> 172.21.15.102:0/2569664454 conn(0x7f3bec09c130 msgr2=0x7f3bec0d2e60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-13T11:29:36.840 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:36.830+0000 7f3bf34ea640 1 -- 172.21.15.102:0/2569664454 shutdown_connections 2023-11-13T11:29:36.840 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:36.830+0000 7f3bf34ea640 1 -- 172.21.15.102:0/2569664454 wait complete. 2023-11-13T11:29:36.842 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:36.834+0000 7f3bf34ea640 1 Processor -- start 2023-11-13T11:29:36.843 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:36.834+0000 7f3bf34ea640 1 -- start start 2023-11-13T11:29:36.843 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:36.834+0000 7f3bf34ea640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3bec0cf490 0x7f3bec0cb980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:36.843 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:36.834+0000 7f3bf34ea640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3bec0d0c40 0x7f3bec157200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:36.843 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:36.834+0000 7f3bf34ea640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3bec1606e0 0x7f3bec0c81d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:36.844 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:36.834+0000 7f3bf34ea640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3bec1584e0 con 0x7f3bec0cf490 2023-11-13T11:29:36.844 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:36.834+0000 7f3bf34ea640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3bec0b5a80 con 0x7f3bec1606e0 2023-11-13T11:29:36.844 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:36.834+0000 7f3bf34ea640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3bec158730 con 0x7f3bec0d0c40 2023-11-13T11:29:36.844 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:36.834+0000 7f3bf1286640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3bec0cf490 0x7f3bec0cb980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:36.844 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:36.834+0000 7f3bf1286640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3bec0cf490 0x7f3bec0cb980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:48436/0 (socket says 172.21.15.102:48436) 2023-11-13T11:29:36.844 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:36.834+0000 7f3bf1286640 1 -- 172.21.15.102:0/79943887 learned_addr learned my addr 172.21.15.102:0/79943887 (peer_addr_for_me v2:172.21.15.102:0/0) 2023-11-13T11:29:36.845 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:36.834+0000 7f3bf1a87640 1 --2- 172.21.15.102:0/79943887 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3bec1606e0 0x7f3bec0c81d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:36.845 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:36.834+0000 7f3bf0a85640 1 --2- 172.21.15.102:0/79943887 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3bec0d0c40 0x7f3bec157200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:36.845 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:36.834+0000 7f3bf1286640 1 -- 172.21.15.102:0/79943887 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3bec0d0c40 msgr2=0x7f3bec157200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:36.845 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:36.834+0000 7f3bf1286640 1 --2- 172.21.15.102:0/79943887 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3bec0d0c40 0x7f3bec157200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:36.845 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:36.834+0000 7f3bf1286640 1 -- 172.21.15.102:0/79943887 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3bec1606e0 msgr2=0x7f3bec0c81d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:36.846 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:36.834+0000 7f3bf1286640 1 --2- 172.21.15.102:0/79943887 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3bec1606e0 0x7f3bec0c81d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:36.846 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:36.834+0000 7f3bf1286640 1 -- 172.21.15.102:0/79943887 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3bdc0094d0 con 0x7f3bec0cf490 2023-11-13T11:29:36.846 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:36.834+0000 7f3bf1286640 1 --2- 172.21.15.102:0/79943887 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3bec0cf490 0x7f3bec0cb980 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f3be800c3c0 tx=0x7f3be800c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-13T11:29:36.846 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:36.834+0000 7f3be1ffb640 1 -- 172.21.15.102:0/79943887 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3be80052d0 con 0x7f3bec0cf490 2023-11-13T11:29:36.846 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:36.834+0000 7f3be1ffb640 1 -- 172.21.15.102:0/79943887 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3be8005430 con 0x7f3bec0cf490 2023-11-13T11:29:36.847 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:36.834+0000 7f3be1ffb640 1 -- 172.21.15.102:0/79943887 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3be8003840 con 0x7f3bec0cf490 2023-11-13T11:29:36.847 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:36.834+0000 7f3bf34ea640 1 -- 172.21.15.102:0/79943887 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3bec158a10 con 0x7f3bec0cf490 2023-11-13T11:29:36.847 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:36.838+0000 7f3bf34ea640 1 -- 172.21.15.102:0/79943887 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3bec0cbec0 con 0x7f3bec0cf490 2023-11-13T11:29:36.848 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:36.838+0000 7f3bf34ea640 1 -- 172.21.15.102:0/79943887 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3bec0b5c40 con 0x7f3bec0cf490 2023-11-13T11:29:36.848 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:36.838+0000 7f3be1ffb640 1 -- 172.21.15.102:0/79943887 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f3be80039a0 con 0x7f3bec0cf490 2023-11-13T11:29:36.848 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:36.838+0000 7f3be1ffb640 1 --2- 172.21.15.102:0/79943887 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f3bd0066470 0x7f3bd0068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:36.849 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:36.838+0000 7f3be1ffb640 1 -- 172.21.15.102:0/79943887 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f3be8083330 con 0x7f3bec0cf490 2023-11-13T11:29:36.849 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:36.838+0000 7f3bf0a85640 1 --2- 172.21.15.102:0/79943887 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f3bd0066470 0x7f3bd0068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:36.849 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:36.838+0000 7f3bf0a85640 1 --2- 172.21.15.102:0/79943887 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f3bd0066470 0x7f3bd0068930 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f3bdc0af000 tx=0x7f3bdc0a7000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-13T11:29:36.850 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:36.842+0000 7f3be1ffb640 1 -- 172.21.15.102:0/79943887 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f3be8050840 con 0x7f3bec0cf490 2023-11-13T11:29:37.017 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:37.010+0000 7f3bf34ea640 1 -- 172.21.15.102:0/79943887 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f3bec068520 con 0x7f3bec0cf490 2023-11-13T11:29:37.017 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:37.010+0000 7f3be1ffb640 1 -- 172.21.15.102:0/79943887 <== mon.0 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v22) v1 ==== 80+0+0 (secure 0 0 0) 0x7f3be8053e60 con 0x7f3bec0cf490 2023-11-13T11:29:37.017 INFO:teuthology.orchestra.run.smithi102.stderr:listed 0 entries 2023-11-13T11:29:37.020 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:37.014+0000 7f3bf34ea640 1 -- 172.21.15.102:0/79943887 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f3bd0066470 msgr2=0x7f3bd0068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:37.020 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:37.014+0000 7f3bf34ea640 1 --2- 172.21.15.102:0/79943887 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f3bd0066470 0x7f3bd0068930 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f3bdc0af000 tx=0x7f3bdc0a7000 comp rx=0 tx=0).stop 2023-11-13T11:29:37.020 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:37.014+0000 7f3bf34ea640 1 -- 172.21.15.102:0/79943887 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3bec0cf490 msgr2=0x7f3bec0cb980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:37.020 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:37.014+0000 7f3bf34ea640 1 --2- 172.21.15.102:0/79943887 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3bec0cf490 0x7f3bec0cb980 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f3be800c3c0 tx=0x7f3be800c880 comp rx=0 tx=0).stop 2023-11-13T11:29:37.020 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:37.014+0000 7f3bf34ea640 1 -- 172.21.15.102:0/79943887 shutdown_connections 2023-11-13T11:29:37.021 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:37.014+0000 7f3bf34ea640 1 --2- 172.21.15.102:0/79943887 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3bec1606e0 0x7f3bec0c81d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:37.021 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:37.014+0000 7f3bf34ea640 1 --2- 172.21.15.102:0/79943887 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3bec0d0c40 0x7f3bec157200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:37.021 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:37.014+0000 7f3bf34ea640 1 --2- 172.21.15.102:0/79943887 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f3bd0066470 0x7f3bd0068930 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:37.021 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:37.014+0000 7f3bf34ea640 1 --2- 172.21.15.102:0/79943887 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3bec0cf490 0x7f3bec0cb980 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:37.021 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:37.014+0000 7f3bf34ea640 1 -- 172.21.15.102:0/79943887 >> 172.21.15.102:0/79943887 conn(0x7f3bec09c130 msgr2=0x7f3bec0b4760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-13T11:29:37.022 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:37.014+0000 7f3bf34ea640 1 -- 172.21.15.102:0/79943887 shutdown_connections 2023-11-13T11:29:37.022 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:37.014+0000 7f3bf34ea640 1 -- 172.21.15.102:0/79943887 wait complete. 2023-11-13T11:29:37.038 DEBUG:teuthology.orchestra.run.smithi102:> set -ex 2023-11-13T11:29:37.039 DEBUG:teuthology.orchestra.run.smithi102:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-13T11:29:37.049 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-13T11:29:37.227 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:37.218+0000 7ff758016640 1 Processor -- start 2023-11-13T11:29:37.227 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:37.222+0000 7ff758016640 1 -- start start 2023-11-13T11:29:37.228 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:37.222+0000 7ff758016640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff750160480 0x7ff7500cfe10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:37.228 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:37.222+0000 7ff758016640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7ff750160860 0x7ff7500d13b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:37.228 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:37.222+0000 7ff758016640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7ff7500d0bb0 0x7ff7500d18f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:37.229 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:37.222+0000 7ff758016640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff7500d1170 con 0x7ff7500d0bb0 2023-11-13T11:29:37.229 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:37.222+0000 7ff758016640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff7500b22f0 con 0x7ff750160860 2023-11-13T11:29:37.229 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:37.222+0000 7ff758016640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff7500b25d0 con 0x7ff750160480 2023-11-13T11:29:37.229 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:37.222+0000 7ff7565b3640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7ff7500d0bb0 0x7ff7500d18f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:37.229 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:37.222+0000 7ff7565b3640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7ff7500d0bb0 0x7ff7500d18f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:48444/0 (socket says 172.21.15.102:48444) 2023-11-13T11:29:37.230 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:37.222+0000 7ff7565b3640 1 -- 172.21.15.102:0/3635918190 learned_addr learned my addr 172.21.15.102:0/3635918190 (peer_addr_for_me v2:172.21.15.102:0/0) 2023-11-13T11:29:37.230 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:37.222+0000 7ff7555b1640 1 --2- 172.21.15.102:0/3635918190 >> v2:172.21.15.154:3300/0 conn(0x7ff750160860 0x7ff7500d13b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:37.231 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:37.222+0000 7ff7565b3640 1 -- 172.21.15.102:0/3635918190 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff750160480 msgr2=0x7ff7500cfe10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-13T11:29:37.231 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:37.222+0000 7ff7565b3640 1 --2- 172.21.15.102:0/3635918190 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff750160480 0x7ff7500cfe10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:37.231 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:37.222+0000 7ff7565b3640 1 -- 172.21.15.102:0/3635918190 >> v2:172.21.15.154:3300/0 conn(0x7ff750160860 msgr2=0x7ff7500d13b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-13T11:29:37.231 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:37.222+0000 7ff7565b3640 1 --2- 172.21.15.102:0/3635918190 >> v2:172.21.15.154:3300/0 conn(0x7ff750160860 0x7ff7500d13b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:37.232 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:37.222+0000 7ff7565b3640 1 -- 172.21.15.102:0/3635918190 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7500b28b0 con 0x7ff7500d0bb0 2023-11-13T11:29:37.232 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:37.222+0000 7ff7555b1640 1 --2- 172.21.15.102:0/3635918190 >> v2:172.21.15.154:3300/0 conn(0x7ff750160860 0x7ff7500d13b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-13T11:29:37.233 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:37.226+0000 7ff7565b3640 1 --2- 172.21.15.102:0/3635918190 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff7500d0bb0 0x7ff7500d18f0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7ff75008c7b0 tx=0x7ff74801c9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4e5b49035cc13c7c server_cookie=0 in_seq=0 out_seq=0 2023-11-13T11:29:37.233 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:37.226+0000 7ff754db0640 1 -- 172.21.15.102:0/3635918190 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7480a5740 con 0x7ff7500d0bb0 2023-11-13T11:29:37.234 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:37.226+0000 7ff754db0640 1 -- 172.21.15.102:0/3635918190 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff7480a58a0 con 0x7ff7500d0bb0 2023-11-13T11:29:37.234 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:37.226+0000 7ff754db0640 1 -- 172.21.15.102:0/3635918190 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7480a5c30 con 0x7ff7500d0bb0 2023-11-13T11:29:37.234 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:37.226+0000 7ff758016640 1 -- 172.21.15.102:0/3635918190 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff7500d0bb0 msgr2=0x7ff7500d18f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:37.234 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:37.226+0000 7ff758016640 1 --2- 172.21.15.102:0/3635918190 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff7500d0bb0 0x7ff7500d18f0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7ff75008c7b0 tx=0x7ff74801c9a0 comp rx=0 tx=0).stop 2023-11-13T11:29:37.235 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:37.226+0000 7ff758016640 1 -- 172.21.15.102:0/3635918190 shutdown_connections 2023-11-13T11:29:37.235 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:37.226+0000 7ff758016640 1 --2- 172.21.15.102:0/3635918190 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff7500d0bb0 0x7ff7500d18f0 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:37.235 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:37.226+0000 7ff758016640 1 --2- 172.21.15.102:0/3635918190 >> v2:172.21.15.154:3300/0 conn(0x7ff750160860 0x7ff7500d13b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:37.235 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:37.226+0000 7ff758016640 1 --2- 172.21.15.102:0/3635918190 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff750160480 0x7ff7500cfe10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:37.235 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:37.226+0000 7ff758016640 1 -- 172.21.15.102:0/3635918190 >> 172.21.15.102:0/3635918190 conn(0x7ff7500d2dd0 msgr2=0x7ff7500d31e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-13T11:29:37.236 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:37.226+0000 7ff758016640 1 -- 172.21.15.102:0/3635918190 shutdown_connections 2023-11-13T11:29:37.236 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:37.226+0000 7ff758016640 1 -- 172.21.15.102:0/3635918190 wait complete. 2023-11-13T11:29:37.238 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:37.226+0000 7ff758016640 1 Processor -- start 2023-11-13T11:29:37.239 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:37.226+0000 7ff758016640 1 -- start start 2023-11-13T11:29:37.239 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:37.230+0000 7ff758016640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff7500d0bb0 0x7ff7501556a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:37.239 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:37.230+0000 7ff758016640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff750160480 0x7ff750158210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:37.240 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:37.230+0000 7ff758016640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff750160860 0x7ff7500cb3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:37.240 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:37.230+0000 7ff758016640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7501572a0 con 0x7ff750160480 2023-11-13T11:29:37.240 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:37.230+0000 7ff758016640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff750156a00 con 0x7ff750160860 2023-11-13T11:29:37.240 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:37.230+0000 7ff758016640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff750156ce0 con 0x7ff7500d0bb0 2023-11-13T11:29:37.240 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:37.230+0000 7ff7555b1640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff750160480 0x7ff750158210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:37.241 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:37.230+0000 7ff7555b1640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff750160480 0x7ff750158210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:48448/0 (socket says 172.21.15.102:48448) 2023-11-13T11:29:37.242 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:37.230+0000 7ff7555b1640 1 -- 172.21.15.102:0/2449193907 learned_addr learned my addr 172.21.15.102:0/2449193907 (peer_addr_for_me v2:172.21.15.102:0/0) 2023-11-13T11:29:37.242 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:37.230+0000 7ff7565b3640 1 --2- 172.21.15.102:0/2449193907 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff750160860 0x7ff7500cb3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:37.244 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:37.230+0000 7ff755db2640 1 --2- 172.21.15.102:0/2449193907 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff7500d0bb0 0x7ff7501556a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:37.244 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:37.230+0000 7ff7555b1640 1 -- 172.21.15.102:0/2449193907 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff7500d0bb0 msgr2=0x7ff7501556a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:37.244 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:37.230+0000 7ff7555b1640 1 --2- 172.21.15.102:0/2449193907 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff7500d0bb0 0x7ff7501556a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:37.244 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:37.230+0000 7ff7555b1640 1 -- 172.21.15.102:0/2449193907 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff750160860 msgr2=0x7ff7500cb3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:37.245 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:37.230+0000 7ff7555b1640 1 --2- 172.21.15.102:0/2449193907 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff750160860 0x7ff7500cb3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:37.245 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:37.230+0000 7ff7555b1640 1 -- 172.21.15.102:0/2449193907 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff748009b30 con 0x7ff750160480 2023-11-13T11:29:37.245 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:37.230+0000 7ff7555b1640 1 --2- 172.21.15.102:0/2449193907 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff750160480 0x7ff750158210 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7ff74000c7f0 tx=0x7ff74000ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-13T11:29:37.246 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:37.230+0000 7ff7467fc640 1 -- 172.21.15.102:0/2449193907 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff740004220 con 0x7ff750160480 2023-11-13T11:29:37.246 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:37.230+0000 7ff7467fc640 1 -- 172.21.15.102:0/2449193907 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff740004380 con 0x7ff750160480 2023-11-13T11:29:37.246 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:37.230+0000 7ff7467fc640 1 -- 172.21.15.102:0/2449193907 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff740003840 con 0x7ff750160480 2023-11-13T11:29:37.246 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:37.230+0000 7ff758016640 1 -- 172.21.15.102:0/2449193907 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff750156fc0 con 0x7ff750160480 2023-11-13T11:29:37.247 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:37.230+0000 7ff758016640 1 -- 172.21.15.102:0/2449193907 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff750155be0 con 0x7ff750160480 2023-11-13T11:29:37.247 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:37.230+0000 7ff758016640 1 -- 172.21.15.102:0/2449193907 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff750158dc0 con 0x7ff750160480 2023-11-13T11:29:37.247 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:37.230+0000 7ff7467fc640 1 -- 172.21.15.102:0/2449193907 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7ff740003bb0 con 0x7ff750160480 2023-11-13T11:29:37.248 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:37.234+0000 7ff7467fc640 1 --2- 172.21.15.102:0/2449193907 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7ff734066470 0x7ff734068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:37.249 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:37.234+0000 7ff7467fc640 1 -- 172.21.15.102:0/2449193907 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff740083c70 con 0x7ff750160480 2023-11-13T11:29:37.249 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:37.234+0000 7ff755db2640 1 --2- 172.21.15.102:0/2449193907 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7ff734066470 0x7ff734068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:37.249 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:37.234+0000 7ff755db2640 1 --2- 172.21.15.102:0/2449193907 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7ff734066470 0x7ff734068930 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7ff75006be50 tx=0x7ff74c006f90 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-13T11:29:37.249 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:37.238+0000 7ff7467fc640 1 -- 172.21.15.102:0/2449193907 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7ff750158dc0 con 0x7ff750160480 2023-11-13T11:29:37.392 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:37.386+0000 7ff758016640 1 -- 172.21.15.102:0/2449193907 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff750158dc0 con 0x7ff750160480 2023-11-13T11:29:37.393 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:37.386+0000 7ff7467fc640 1 -- 172.21.15.102:0/2449193907 <== mon.0 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+16545 (secure 0 0 0) 0x7ff750158dc0 con 0x7ff750160480 2023-11-13T11:29:37.394 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T11:29:37.394 INFO:teuthology.orchestra.run.smithi102.stdout:{"epoch":22,"fsid":"97b3eb2b-7ccf-4aae-8d92-bff986c671ea","created":"2023-11-13T11:28:31.836724+0000","modified":"2023-11-13T11:28:58.608314+0000","last_up_change":"2023-11-13T11:28:44.876638+0000","last_in_change":"2023-11-13T11:28:35.312740+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-13T11:28:44.981356+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-13T11:28:55.958525+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-13T11:28:56.394264+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"bdefaa17-fcca-4c86-aa40-27dc33a789af","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6800","nonce":53303834},{"type":"v1","addr":"172.21.15.102:6801","nonce":53303834}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6802","nonce":53303834},{"type":"v1","addr":"172.21.15.102:6803","nonce":53303834}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6806","nonce":53303834},{"type":"v1","addr":"172.21.15.102:6807","nonce":53303834}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6804","nonce":53303834},{"type":"v1","addr":"172.21.15.102:6805","nonce":53303834}]},"public_addr":"172.21.15.102:6801/53303834","cluster_addr":"172.21.15.102:6803/53303834","heartbeat_back_addr":"172.21.15.102:6807/53303834","heartbeat_front_addr":"172.21.15.102:6805/53303834","state":["exists","up"]},{"osd":1,"uuid":"f0033196-dec9-4ae9-945e-6aeef6dbb47f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6808","nonce":1732708348},{"type":"v1","addr":"172.21.15.102:6809","nonce":1732708348}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6811","nonce":1732708348},{"type":"v1","addr":"172.21.15.102:6813","nonce":1732708348}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6818","nonce":1732708348},{"type":"v1","addr":"172.21.15.102:6820","nonce":1732708348}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6815","nonce":1732708348},{"type":"v1","addr":"172.21.15.102:6817","nonce":1732708348}]},"public_addr":"172.21.15.102:6809/1732708348","cluster_addr":"172.21.15.102:6813/1732708348","heartbeat_back_addr":"172.21.15.102:6820/1732708348","heartbeat_front_addr":"172.21.15.102:6817/1732708348","state":["exists","up"]},{"osd":2,"uuid":"496b0834-351e-4ec2-a714-86ed0c0ff4fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6810","nonce":1825475150},{"type":"v1","addr":"172.21.15.102:6812","nonce":1825475150}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6814","nonce":1825475150},{"type":"v1","addr":"172.21.15.102:6816","nonce":1825475150}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6822","nonce":1825475150},{"type":"v1","addr":"172.21.15.102:6823","nonce":1825475150}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6819","nonce":1825475150},{"type":"v1","addr":"172.21.15.102:6821","nonce":1825475150}]},"public_addr":"172.21.15.102:6812/1825475150","cluster_addr":"172.21.15.102:6816/1825475150","heartbeat_back_addr":"172.21.15.102:6823/1825475150","heartbeat_front_addr":"172.21.15.102:6821/1825475150","state":["exists","up"]},{"osd":3,"uuid":"3ba6cc41-e0a0-4273-86cb-90000c06a55a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6824","nonce":4149355528},{"type":"v1","addr":"172.21.15.102:6825","nonce":4149355528}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6826","nonce":4149355528},{"type":"v1","addr":"172.21.15.102:6827","nonce":4149355528}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6830","nonce":4149355528},{"type":"v1","addr":"172.21.15.102:6831","nonce":4149355528}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6828","nonce":4149355528},{"type":"v1","addr":"172.21.15.102:6829","nonce":4149355528}]},"public_addr":"172.21.15.102:6825/4149355528","cluster_addr":"172.21.15.102:6827/4149355528","heartbeat_back_addr":"172.21.15.102:6831/4149355528","heartbeat_front_addr":"172.21.15.102:6829/4149355528","state":["exists","up"]},{"osd":4,"uuid":"16e797d8-e6e7-4140-95c3-b85283c42a2a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6808","nonce":4028899241},{"type":"v1","addr":"172.21.15.154:6809","nonce":4028899241}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6810","nonce":4028899241},{"type":"v1","addr":"172.21.15.154:6811","nonce":4028899241}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6814","nonce":4028899241},{"type":"v1","addr":"172.21.15.154:6815","nonce":4028899241}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6812","nonce":4028899241},{"type":"v1","addr":"172.21.15.154:6813","nonce":4028899241}]},"public_addr":"172.21.15.154:6809/4028899241","cluster_addr":"172.21.15.154:6811/4028899241","heartbeat_back_addr":"172.21.15.154:6815/4028899241","heartbeat_front_addr":"172.21.15.154:6813/4028899241","state":["exists","up"]},{"osd":5,"uuid":"d6ab225c-1b55-450a-89a9-abe5c3f8d6af","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":3562396827},{"type":"v1","addr":"172.21.15.154:6801","nonce":3562396827}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":3562396827},{"type":"v1","addr":"172.21.15.154:6803","nonce":3562396827}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6806","nonce":3562396827},{"type":"v1","addr":"172.21.15.154:6807","nonce":3562396827}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6804","nonce":3562396827},{"type":"v1","addr":"172.21.15.154:6805","nonce":3562396827}]},"public_addr":"172.21.15.154:6801/3562396827","cluster_addr":"172.21.15.154:6803/3562396827","heartbeat_back_addr":"172.21.15.154:6807/3562396827","heartbeat_front_addr":"172.21.15.154:6805/3562396827","state":["exists","up"]},{"osd":6,"uuid":"96f905ac-491c-4662-8e2b-5bb8e929ab9d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6816","nonce":2933728751},{"type":"v1","addr":"172.21.15.154:6817","nonce":2933728751}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6818","nonce":2933728751},{"type":"v1","addr":"172.21.15.154:6819","nonce":2933728751}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6822","nonce":2933728751},{"type":"v1","addr":"172.21.15.154:6823","nonce":2933728751}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6820","nonce":2933728751},{"type":"v1","addr":"172.21.15.154:6821","nonce":2933728751}]},"public_addr":"172.21.15.154:6817/2933728751","cluster_addr":"172.21.15.154:6819/2933728751","heartbeat_back_addr":"172.21.15.154:6823/2933728751","heartbeat_front_addr":"172.21.15.154:6821/2933728751","state":["exists","up"]},{"osd":7,"uuid":"07012d3b-3ab4-40df-a471-93caed22e2dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6824","nonce":1753500785},{"type":"v1","addr":"172.21.15.154:6825","nonce":1753500785}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6826","nonce":1753500785},{"type":"v1","addr":"172.21.15.154:6827","nonce":1753500785}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6830","nonce":1753500785},{"type":"v1","addr":"172.21.15.154:6831","nonce":1753500785}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6828","nonce":1753500785},{"type":"v1","addr":"172.21.15.154:6829","nonce":1753500785}]},"public_addr":"172.21.15.154:6825/1753500785","cluster_addr":"172.21.15.154:6827/1753500785","heartbeat_back_addr":"172.21.15.154:6831/1753500785","heartbeat_front_addr":"172.21.15.154:6829/1753500785","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-13T11:28:40.978603+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-13T11:28:41.200985+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-13T11:28:41.222815+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-13T11:28:41.202162+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-13T11:28:40.925911+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-13T11:28:41.087725+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-13T11:28:41.072208+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-13T11:28:40.875257+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-13T11:29:37.395 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:37.390+0000 7ff758016640 1 -- 172.21.15.102:0/2449193907 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7ff734066470 msgr2=0x7ff734068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:37.396 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:37.390+0000 7ff758016640 1 --2- 172.21.15.102:0/2449193907 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7ff734066470 0x7ff734068930 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7ff75006be50 tx=0x7ff74c006f90 comp rx=0 tx=0).stop 2023-11-13T11:29:37.396 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:37.390+0000 7ff758016640 1 -- 172.21.15.102:0/2449193907 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff750160480 msgr2=0x7ff750158210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:37.396 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:37.390+0000 7ff758016640 1 --2- 172.21.15.102:0/2449193907 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff750160480 0x7ff750158210 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7ff74000c7f0 tx=0x7ff74000ccb0 comp rx=0 tx=0).stop 2023-11-13T11:29:37.396 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:37.390+0000 7ff758016640 1 -- 172.21.15.102:0/2449193907 shutdown_connections 2023-11-13T11:29:37.397 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:37.390+0000 7ff758016640 1 --2- 172.21.15.102:0/2449193907 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff750160860 0x7ff7500cb3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:37.397 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:37.390+0000 7ff758016640 1 --2- 172.21.15.102:0/2449193907 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7ff734066470 0x7ff734068930 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:37.397 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:37.390+0000 7ff758016640 1 --2- 172.21.15.102:0/2449193907 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff750160480 0x7ff750158210 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:37.397 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:37.390+0000 7ff758016640 1 --2- 172.21.15.102:0/2449193907 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff7500d0bb0 0x7ff7501556a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:37.397 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:37.390+0000 7ff758016640 1 -- 172.21.15.102:0/2449193907 >> 172.21.15.102:0/2449193907 conn(0x7ff7500d2dd0 msgr2=0x7ff75006c070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-13T11:29:37.398 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:37.390+0000 7ff758016640 1 -- 172.21.15.102:0/2449193907 shutdown_connections 2023-11-13T11:29:37.398 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:37.390+0000 7ff758016640 1 -- 172.21.15.102:0/2449193907 wait complete. 2023-11-13T11:29:37.415 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-13T11:28:44.981356+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-13T11:28:55.958525+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-11-13T11:28:56.394264+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-13T11:29:37.416 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-13T11:29:37.556 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:37.550+0000 7ff98c33e640 1 Processor -- start 2023-11-13T11:29:37.557 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:37.550+0000 7ff98c33e640 1 -- start start 2023-11-13T11:29:37.558 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:37.550+0000 7ff98c33e640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7ff98415d600 0x7ff9840b2e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:37.558 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:37.550+0000 7ff98c33e640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7ff9840b3f60 0x7ff9840d3910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:37.559 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:37.550+0000 7ff98c33e640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff9840b3840 con 0x7ff98415d220 2023-11-13T11:29:37.559 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:37.550+0000 7ff98c33e640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff9840cecb0 con 0x7ff98415d600 2023-11-13T11:29:37.559 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:37.550+0000 7ff98c33e640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff9840d0d00 con 0x7ff9840b3f60 2023-11-13T11:29:37.559 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:37.550+0000 7ff9898d9640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7ff98415d600 0x7ff9840b2e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:37.560 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:37.550+0000 7ff9898d9640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7ff98415d600 0x7ff9840b2e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:48460/0 (socket says 172.21.15.102:48460) 2023-11-13T11:29:37.560 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:37.550+0000 7ff9898d9640 1 -- 172.21.15.102:0/2686093686 learned_addr learned my addr 172.21.15.102:0/2686093686 (peer_addr_for_me v2:172.21.15.102:0/0) 2023-11-13T11:29:37.560 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:37.550+0000 7ff98a8db640 1 --2- 172.21.15.102:0/2686093686 >> v2:172.21.15.154:3300/0 conn(0x7ff9840b3f60 0x7ff9840d3910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:37.560 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:37.550+0000 7ff9898d9640 1 -- 172.21.15.102:0/2686093686 >> v2:172.21.15.154:3300/0 conn(0x7ff9840b3f60 msgr2=0x7ff9840d3910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-13T11:29:37.561 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:37.550+0000 7ff9898d9640 1 --2- 172.21.15.102:0/2686093686 >> v2:172.21.15.154:3300/0 conn(0x7ff9840b3f60 0x7ff9840d3910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:37.561 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:37.550+0000 7ff9898d9640 1 -- 172.21.15.102:0/2686093686 >> v1:172.21.15.154:6789/0 conn(0x7ff98415d220 legacy=0x7ff9840b2750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:37.561 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:37.550+0000 7ff9898d9640 1 -- 172.21.15.102:0/2686093686 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9840d0fe0 con 0x7ff98415d600 2023-11-13T11:29:37.563 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:37.554+0000 7ff9898d9640 1 --2- 172.21.15.102:0/2686093686 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff98415d600 0x7ff9840b2e60 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7ff9840cd670 tx=0x7ff97401c3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=80529c88ddfd6820 server_cookie=0 in_seq=0 out_seq=0 2023-11-13T11:29:37.563 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:37.554+0000 7ff9890d8640 1 -- 172.21.15.102:0/2686093686 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff974004230 con 0x7ff98415d600 2023-11-13T11:29:37.563 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:37.554+0000 7ff9890d8640 1 -- 172.21.15.102:0/2686093686 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff9740a7050 con 0x7ff98415d600 2023-11-13T11:29:37.564 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:37.554+0000 7ff9890d8640 1 -- 172.21.15.102:0/2686093686 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff974003620 con 0x7ff98415d600 2023-11-13T11:29:37.564 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:37.554+0000 7ff98c33e640 1 -- 172.21.15.102:0/2686093686 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff98415d600 msgr2=0x7ff9840b2e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:37.564 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:37.554+0000 7ff98c33e640 1 --2- 172.21.15.102:0/2686093686 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff98415d600 0x7ff9840b2e60 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7ff9840cd670 tx=0x7ff97401c3b0 comp rx=0 tx=0).stop 2023-11-13T11:29:37.564 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:37.554+0000 7ff98c33e640 1 -- 172.21.15.102:0/2686093686 shutdown_connections 2023-11-13T11:29:37.565 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:37.554+0000 7ff98c33e640 1 --2- 172.21.15.102:0/2686093686 >> v2:172.21.15.154:3300/0 conn(0x7ff9840b3f60 0x7ff9840d3910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:37.565 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:37.554+0000 7ff98c33e640 1 --2- 172.21.15.102:0/2686093686 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff98415d600 0x7ff9840b2e60 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:37.565 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:37.554+0000 7ff98c33e640 1 -- 172.21.15.102:0/2686093686 >> 172.21.15.102:0/2686093686 conn(0x7ff9840d2df0 msgr2=0x7ff9840d3200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-13T11:29:37.565 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:37.554+0000 7ff98c33e640 1 -- 172.21.15.102:0/2686093686 shutdown_connections 2023-11-13T11:29:37.566 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:37.554+0000 7ff98c33e640 1 -- 172.21.15.102:0/2686093686 wait complete. 2023-11-13T11:29:37.569 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:37.558+0000 7ff98c33e640 1 Processor -- start 2023-11-13T11:29:37.569 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:37.558+0000 7ff98c33e640 1 -- start start 2023-11-13T11:29:37.570 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:37.558+0000 7ff98c33e640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff9840b3f60 0x7ff98414a610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:37.570 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:37.558+0000 7ff98c33e640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff98415d220 0x7ff984154c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:37.570 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:37.558+0000 7ff98c33e640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff98415d600 0x7ff984157ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:37.571 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:37.558+0000 7ff98c33e640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff98414ab50 con 0x7ff9840b3f60 2023-11-13T11:29:37.571 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:37.558+0000 7ff98c33e640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff984153bb0 con 0x7ff98415d220 2023-11-13T11:29:37.571 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:37.558+0000 7ff98c33e640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff984153e90 con 0x7ff98415d600 2023-11-13T11:29:37.571 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:37.558+0000 7ff98a0da640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff9840b3f60 0x7ff98414a610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:37.572 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:37.558+0000 7ff98a0da640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff9840b3f60 0x7ff98414a610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:48464/0 (socket says 172.21.15.102:48464) 2023-11-13T11:29:37.572 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:37.558+0000 7ff98a0da640 1 -- 172.21.15.102:0/3317569690 learned_addr learned my addr 172.21.15.102:0/3317569690 (peer_addr_for_me v2:172.21.15.102:0/0) 2023-11-13T11:29:37.572 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:37.558+0000 7ff9898d9640 1 --2- 172.21.15.102:0/3317569690 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff98415d220 0x7ff984154c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:37.573 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:37.558+0000 7ff98a8db640 1 --2- 172.21.15.102:0/3317569690 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff98415d600 0x7ff984157ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:37.573 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:37.558+0000 7ff98a0da640 1 -- 172.21.15.102:0/3317569690 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff98415d600 msgr2=0x7ff984157ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:37.573 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:37.558+0000 7ff98a0da640 1 --2- 172.21.15.102:0/3317569690 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff98415d600 0x7ff984157ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:37.573 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:37.558+0000 7ff98a0da640 1 -- 172.21.15.102:0/3317569690 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff98415d220 msgr2=0x7ff984154c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:37.573 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:37.558+0000 7ff98a0da640 1 --2- 172.21.15.102:0/3317569690 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff98415d220 0x7ff984154c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:37.574 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:37.558+0000 7ff98a0da640 1 -- 172.21.15.102:0/3317569690 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9740094d0 con 0x7ff9840b3f60 2023-11-13T11:29:37.574 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:37.558+0000 7ff98a0da640 1 --2- 172.21.15.102:0/3317569690 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff9840b3f60 0x7ff98414a610 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7ff98000c3c0 tx=0x7ff98000c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-13T11:29:37.574 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:37.558+0000 7ff97affd640 1 -- 172.21.15.102:0/3317569690 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9800052d0 con 0x7ff9840b3f60 2023-11-13T11:29:37.574 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:37.558+0000 7ff97affd640 1 -- 172.21.15.102:0/3317569690 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff980005430 con 0x7ff9840b3f60 2023-11-13T11:29:37.575 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:37.558+0000 7ff97affd640 1 -- 172.21.15.102:0/3317569690 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff980003840 con 0x7ff9840b3f60 2023-11-13T11:29:37.575 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:37.558+0000 7ff98c33e640 1 -- 172.21.15.102:0/3317569690 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff984154170 con 0x7ff9840b3f60 2023-11-13T11:29:37.575 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:37.558+0000 7ff98c33e640 1 -- 172.21.15.102:0/3317569690 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff984154730 con 0x7ff9840b3f60 2023-11-13T11:29:37.575 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:37.562+0000 7ff98c33e640 1 -- 172.21.15.102:0/3317569690 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff984154920 con 0x7ff9840b3f60 2023-11-13T11:29:37.575 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:37.562+0000 7ff97affd640 1 -- 172.21.15.102:0/3317569690 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7ff9800039a0 con 0x7ff9840b3f60 2023-11-13T11:29:37.576 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:37.562+0000 7ff97affd640 1 --2- 172.21.15.102:0/3317569690 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7ff9680664a0 0x7ff968068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:37.577 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:37.562+0000 7ff97affd640 1 -- 172.21.15.102:0/3317569690 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff980083290 con 0x7ff9840b3f60 2023-11-13T11:29:37.577 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:37.562+0000 7ff9898d9640 1 --2- 172.21.15.102:0/3317569690 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7ff9680664a0 0x7ff968068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:37.577 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:37.562+0000 7ff9898d9640 1 --2- 172.21.15.102:0/3317569690 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7ff9680664a0 0x7ff968068960 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7ff9740ad000 tx=0x7ff9740a6000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-13T11:29:37.577 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:37.566+0000 7ff97affd640 1 -- 172.21.15.102:0/3317569690 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7ff980050850 con 0x7ff9840b3f60 2023-11-13T11:29:37.732 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:37.726+0000 7ff98c33e640 1 -- 172.21.15.102:0/3317569690 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7ff984068520 con 0x7ff9840b3f60 2023-11-13T11:29:37.732 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:37.726+0000 7ff97affd640 1 -- 172.21.15.102:0/3317569690 <== mon.0 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v23) v1 ==== 93+0+10 (secure 0 0 0) 0x7ff980053e70 con 0x7ff9840b3f60 2023-11-13T11:29:37.733 INFO:teuthology.orchestra.run.smithi102.stdout:pg_num: 1 2023-11-13T11:29:37.734 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:37.726+0000 7ff98c33e640 1 -- 172.21.15.102:0/3317569690 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7ff9680664a0 msgr2=0x7ff968068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:37.735 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:37.726+0000 7ff98c33e640 1 --2- 172.21.15.102:0/3317569690 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7ff9680664a0 0x7ff968068960 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7ff9740ad000 tx=0x7ff9740a6000 comp rx=0 tx=0).stop 2023-11-13T11:29:37.735 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:37.726+0000 7ff98c33e640 1 -- 172.21.15.102:0/3317569690 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff9840b3f60 msgr2=0x7ff98414a610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:37.735 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:37.726+0000 7ff98c33e640 1 --2- 172.21.15.102:0/3317569690 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff9840b3f60 0x7ff98414a610 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7ff98000c3c0 tx=0x7ff98000c880 comp rx=0 tx=0).stop 2023-11-13T11:29:37.735 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:37.726+0000 7ff98c33e640 1 -- 172.21.15.102:0/3317569690 shutdown_connections 2023-11-13T11:29:37.736 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:37.726+0000 7ff98c33e640 1 --2- 172.21.15.102:0/3317569690 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff98415d600 0x7ff984157ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:37.736 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:37.726+0000 7ff98c33e640 1 --2- 172.21.15.102:0/3317569690 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff98415d220 0x7ff984154c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:37.736 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:37.726+0000 7ff98c33e640 1 --2- 172.21.15.102:0/3317569690 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7ff9680664a0 0x7ff968068960 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:37.736 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:37.726+0000 7ff98c33e640 1 --2- 172.21.15.102:0/3317569690 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff9840b3f60 0x7ff98414a610 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:37.736 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:37.726+0000 7ff98c33e640 1 -- 172.21.15.102:0/3317569690 >> 172.21.15.102:0/3317569690 conn(0x7ff9840d2df0 msgr2=0x7ff9840afb80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-13T11:29:37.737 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:37.726+0000 7ff98c33e640 1 -- 172.21.15.102:0/3317569690 shutdown_connections 2023-11-13T11:29:37.737 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:37.726+0000 7ff98c33e640 1 -- 172.21.15.102:0/3317569690 wait complete. 2023-11-13T11:29:37.754 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-13T11:29:37.894 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:37.886+0000 7f219cf65640 1 Processor -- start 2023-11-13T11:29:37.894 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:37.886+0000 7f219cf65640 1 -- start start 2023-11-13T11:29:37.897 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:37.890+0000 7f219cf65640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f219806ccb0 0x7f21980cff80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:37.897 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:37.890+0000 7f219cf65640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f219815d3e0 con 0x7f219815d000 2023-11-13T11:29:37.897 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:37.890+0000 7f219cf65640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f21980cfa80 con 0x7f219806d140 2023-11-13T11:29:37.898 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:37.890+0000 7f219cf65640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f21980ae610 con 0x7f219806ccb0 2023-11-13T11:29:37.898 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:37.890+0000 7f218ffff640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f219806ccb0 0x7f21980cff80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:37.898 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:37.890+0000 7f219659c640 1 --1- >> v1:172.21.15.102:6789/0 conn(0x7f219815d000 0x7f219806e540 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.102:6789/0 says I am v1:172.21.15.102:45864/0 (socket says 172.21.15.102:45864) 2023-11-13T11:29:37.898 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:37.890+0000 7f219659c640 1 -- 172.21.15.102:0/643049370 learned_addr learned my addr 172.21.15.102:0/643049370 (peer_addr_for_me v1:172.21.15.102:0/0) 2023-11-13T11:29:37.898 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:37.890+0000 7f218ffff640 1 -- 172.21.15.102:0/643049370 >> v1:172.21.15.154:6789/0 conn(0x7f219806d140 legacy=0x7f219806a240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-13T11:29:37.899 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:37.890+0000 7f2195d9b640 1 -- 172.21.15.102:0/643049370 <== mon.0 v1:172.21.15.102:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1586588925 0 0) 0x7f219815d3e0 con 0x7f219815d000 2023-11-13T11:29:37.899 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:37.890+0000 7f218ffff640 1 -- 172.21.15.102:0/643049370 >> v1:172.21.15.102:6789/0 conn(0x7f219815d000 legacy=0x7f219806e540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:37.899 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:37.890+0000 7f218ffff640 1 -- 172.21.15.102:0/643049370 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21980ae970 con 0x7f219806ccb0 2023-11-13T11:29:37.900 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:37.894+0000 7f218ffff640 1 --2- 172.21.15.102:0/643049370 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f219806ccb0 0x7f21980cff80 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f21800097c0 tx=0x7f218001c440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=adc826e527c52ca4 server_cookie=0 in_seq=0 out_seq=0 2023-11-13T11:29:37.901 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:37.894+0000 7f2195d9b640 1 -- 172.21.15.102:0/643049370 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21800ab660 con 0x7f219806ccb0 2023-11-13T11:29:37.901 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:37.894+0000 7f2195d9b640 1 -- 172.21.15.102:0/643049370 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f21800ab7c0 con 0x7f219806ccb0 2023-11-13T11:29:37.901 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:37.894+0000 7f2195d9b640 1 -- 172.21.15.102:0/643049370 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21800abb50 con 0x7f219806ccb0 2023-11-13T11:29:37.901 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:37.894+0000 7f219cf65640 1 -- 172.21.15.102:0/643049370 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f219806ccb0 msgr2=0x7f21980cff80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:37.901 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:37.894+0000 7f219cf65640 1 --2- 172.21.15.102:0/643049370 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f219806ccb0 0x7f21980cff80 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f21800097c0 tx=0x7f218001c440 comp rx=0 tx=0).stop 2023-11-13T11:29:37.902 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:37.894+0000 7f219cf65640 1 -- 172.21.15.102:0/643049370 shutdown_connections 2023-11-13T11:29:37.902 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:37.894+0000 7f219cf65640 1 --2- 172.21.15.102:0/643049370 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f219806ccb0 0x7f21980cff80 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:37.902 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:37.894+0000 7f219cf65640 1 -- 172.21.15.102:0/643049370 >> 172.21.15.102:0/643049370 conn(0x7f219806b350 msgr2=0x7f219806b760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-13T11:29:37.902 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:37.894+0000 7f219cf65640 1 -- 172.21.15.102:0/643049370 shutdown_connections 2023-11-13T11:29:37.902 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:37.894+0000 7f219cf65640 1 -- 172.21.15.102:0/643049370 wait complete. 2023-11-13T11:29:37.904 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:37.894+0000 7f219cf65640 1 Processor -- start 2023-11-13T11:29:37.905 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:37.894+0000 7f219cf65640 1 -- start start 2023-11-13T11:29:37.905 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:37.894+0000 7f219cf65640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f219806ccb0 0x7f219815e8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:37.905 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:37.894+0000 7f219cf65640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f219806d140 0x7f219815a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:37.905 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:37.894+0000 7f219cf65640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f219815d000 0x7f2198158290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:37.906 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:37.894+0000 7f219cf65640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2198155c20 con 0x7f219815d000 2023-11-13T11:29:37.906 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:37.894+0000 7f219cf65640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f219815a970 con 0x7f219806ccb0 2023-11-13T11:29:37.907 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:37.894+0000 7f219cf65640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f219815b420 con 0x7f219806d140 2023-11-13T11:29:37.907 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:37.898+0000 7f2196d9d640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f219815d000 0x7f2198158290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:37.907 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:37.898+0000 7f2196d9d640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f219815d000 0x7f2198158290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:45236/0 (socket says 172.21.15.102:45236) 2023-11-13T11:29:37.907 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:37.898+0000 7f2196d9d640 1 -- 172.21.15.102:0/202947075 learned_addr learned my addr 172.21.15.102:0/202947075 (peer_addr_for_me v2:172.21.15.102:0/0) 2023-11-13T11:29:37.907 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:37.898+0000 7f219659c640 1 --2- 172.21.15.102:0/202947075 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f219806ccb0 0x7f219815e8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:37.908 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:37.898+0000 7f218ffff640 1 --2- 172.21.15.102:0/202947075 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f219806d140 0x7f219815a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:37.908 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:37.898+0000 7f2196d9d640 1 -- 172.21.15.102:0/202947075 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f219806d140 msgr2=0x7f219815a430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:37.908 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:37.898+0000 7f2196d9d640 1 --2- 172.21.15.102:0/202947075 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f219806d140 0x7f219815a430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:37.908 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:37.898+0000 7f2196d9d640 1 -- 172.21.15.102:0/202947075 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f219806ccb0 msgr2=0x7f219815e8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:37.908 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:37.898+0000 7f2196d9d640 1 --2- 172.21.15.102:0/202947075 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f219806ccb0 0x7f219815e8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:37.908 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:37.898+0000 7f2196d9d640 1 -- 172.21.15.102:0/202947075 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2180009420 con 0x7f219815d000 2023-11-13T11:29:37.909 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:37.898+0000 7f2196d9d640 1 --2- 172.21.15.102:0/202947075 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f219815d000 0x7f2198158290 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f219000c780 tx=0x7f219000cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-13T11:29:37.909 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:37.898+0000 7f218effd640 1 -- 172.21.15.102:0/202947075 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2190003d90 con 0x7f219815d000 2023-11-13T11:29:37.909 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:37.898+0000 7f218effd640 1 -- 172.21.15.102:0/202947075 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f219000ce90 con 0x7f219815d000 2023-11-13T11:29:37.909 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:37.898+0000 7f219cf65640 1 -- 172.21.15.102:0/202947075 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f219815ab80 con 0x7f219815d000 2023-11-13T11:29:37.909 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:37.898+0000 7f218effd640 1 -- 172.21.15.102:0/202947075 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21900052b0 con 0x7f219815d000 2023-11-13T11:29:37.910 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:37.898+0000 7f219cf65640 1 -- 172.21.15.102:0/202947075 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f219815b140 con 0x7f219815d000 2023-11-13T11:29:37.910 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:37.898+0000 7f219cf65640 1 -- 172.21.15.102:0/202947075 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2198067640 con 0x7f219815d000 2023-11-13T11:29:37.911 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:37.898+0000 7f218effd640 1 -- 172.21.15.102:0/202947075 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f2190005410 con 0x7f219815d000 2023-11-13T11:29:37.911 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:37.902+0000 7f218effd640 1 --2- 172.21.15.102:0/202947075 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f2178066470 0x7f2178068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:37.911 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:37.902+0000 7f218effd640 1 -- 172.21.15.102:0/202947075 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5738+0+0 (secure 0 0 0) 0x7f2190083360 con 0x7f219815d000 2023-11-13T11:29:37.911 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:37.902+0000 7f219659c640 1 --2- 172.21.15.102:0/202947075 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f2178066470 0x7f2178068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:37.912 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:37.902+0000 7f219659c640 1 --2- 172.21.15.102:0/202947075 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f2178066470 0x7f2178068930 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f2188000f70 tx=0x7f2188007c10 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-13T11:29:37.912 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:37.906+0000 7f218effd640 1 -- 172.21.15.102:0/202947075 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f2190050720 con 0x7f219815d000 2023-11-13T11:29:38.059 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:38.054+0000 7f219cf65640 1 -- 172.21.15.102:0/202947075 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f2198068520 con 0x7f219815d000 2023-11-13T11:29:38.060 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:38.054+0000 7f218effd640 1 -- 172.21.15.102:0/202947075 <== mon.0 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v23) v1 ==== 104+0+11 (secure 0 0 0) 0x7f2190053d40 con 0x7f219815d000 2023-11-13T11:29:38.060 INFO:teuthology.orchestra.run.smithi102.stdout:pg_num: 32 2023-11-13T11:29:38.062 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:38.054+0000 7f219cf65640 1 -- 172.21.15.102:0/202947075 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f2178066470 msgr2=0x7f2178068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:38.062 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:38.054+0000 7f219cf65640 1 --2- 172.21.15.102:0/202947075 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f2178066470 0x7f2178068930 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f2188000f70 tx=0x7f2188007c10 comp rx=0 tx=0).stop 2023-11-13T11:29:38.062 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:38.054+0000 7f219cf65640 1 -- 172.21.15.102:0/202947075 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f219815d000 msgr2=0x7f2198158290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:38.062 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:38.054+0000 7f219cf65640 1 --2- 172.21.15.102:0/202947075 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f219815d000 0x7f2198158290 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f219000c780 tx=0x7f219000cc40 comp rx=0 tx=0).stop 2023-11-13T11:29:38.062 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:38.054+0000 7f219cf65640 1 -- 172.21.15.102:0/202947075 shutdown_connections 2023-11-13T11:29:38.063 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:38.054+0000 7f219cf65640 1 --2- 172.21.15.102:0/202947075 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f2178066470 0x7f2178068930 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:38.063 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:38.054+0000 7f219cf65640 1 --2- 172.21.15.102:0/202947075 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f219815d000 0x7f2198158290 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:38.063 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:38.054+0000 7f219cf65640 1 --2- 172.21.15.102:0/202947075 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f219806d140 0x7f219815a430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:38.063 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:38.054+0000 7f219cf65640 1 --2- 172.21.15.102:0/202947075 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f219806ccb0 0x7f219815e8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:38.063 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:38.054+0000 7f219cf65640 1 -- 172.21.15.102:0/202947075 >> 172.21.15.102:0/202947075 conn(0x7f219806b350 msgr2=0x7f219806b730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-13T11:29:38.064 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:38.054+0000 7f219cf65640 1 -- 172.21.15.102:0/202947075 shutdown_connections 2023-11-13T11:29:38.064 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:38.054+0000 7f219cf65640 1 -- 172.21.15.102:0/202947075 wait complete. 2023-11-13T11:29:38.081 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-13T11:29:38.223 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:38.218+0000 7fa6f29d1640 1 Processor -- start 2023-11-13T11:29:38.224 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:38.218+0000 7fa6f29d1640 1 -- start start 2023-11-13T11:29:38.225 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:38.218+0000 7fa6f29d1640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa6ec15d0c0 0x7fa6ec06a450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:38.225 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:38.218+0000 7fa6f29d1640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7fa6ec06b4b0 0x7fa6ec0cfd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:38.226 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:38.218+0000 7fa6f29d1640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa6ec0cefd0 con 0x7fa6ec0b02c0 2023-11-13T11:29:38.226 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:38.218+0000 7fa6f29d1640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa6ec06ba00 con 0x7fa6ec06b4b0 2023-11-13T11:29:38.226 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:38.218+0000 7fa6f29d1640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa6ec0cf220 con 0x7fa6ec15d0c0 2023-11-13T11:29:38.226 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:38.218+0000 7fa6eb7fe640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7fa6ec06b4b0 0x7fa6ec0cfd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:38.226 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:38.218+0000 7fa6f0f6e640 1 --1- >> v1:172.21.15.102:6789/0 conn(0x7fa6ec0b02c0 0x7fa6ec0b0770 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.102:6789/0 says I am v1:172.21.15.102:45880/0 (socket says 172.21.15.102:45880) 2023-11-13T11:29:38.227 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:38.218+0000 7fa6f0f6e640 1 -- 172.21.15.102:0/156790644 learned_addr learned my addr 172.21.15.102:0/156790644 (peer_addr_for_me v1:172.21.15.102:0/0) 2023-11-13T11:29:38.227 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:38.218+0000 7fa6ebfff640 1 --2- 172.21.15.102:0/156790644 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa6ec15d0c0 0x7fa6ec06a450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:38.227 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:38.218+0000 7fa6eb7fe640 1 -- 172.21.15.102:0/156790644 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa6ec15d0c0 msgr2=0x7fa6ec06a450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-13T11:29:38.227 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:38.218+0000 7fa6eb7fe640 1 --2- 172.21.15.102:0/156790644 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa6ec15d0c0 0x7fa6ec06a450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:38.227 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:38.218+0000 7fa6eb7fe640 1 -- 172.21.15.102:0/156790644 >> v1:172.21.15.102:6789/0 conn(0x7fa6ec0b02c0 legacy=0x7fa6ec0b0770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:38.228 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:38.218+0000 7fa6eb7fe640 1 -- 172.21.15.102:0/156790644 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6ec0cf500 con 0x7fa6ec06b4b0 2023-11-13T11:29:38.228 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:38.222+0000 7fa6eb7fe640 1 --2- 172.21.15.102:0/156790644 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa6ec06b4b0 0x7fa6ec0cfd00 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7fa6e00097c0 tx=0x7fa6e001c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ebd16c2e54e8d4f8 server_cookie=0 in_seq=0 out_seq=0 2023-11-13T11:29:38.229 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:38.222+0000 7fa6eaffd640 1 -- 172.21.15.102:0/156790644 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6e00a7070 con 0x7fa6ec06b4b0 2023-11-13T11:29:38.229 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:38.222+0000 7fa6eaffd640 1 -- 172.21.15.102:0/156790644 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa6e00ab430 con 0x7fa6ec06b4b0 2023-11-13T11:29:38.229 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:38.222+0000 7fa6eaffd640 1 -- 172.21.15.102:0/156790644 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6e00ab7c0 con 0x7fa6ec06b4b0 2023-11-13T11:29:38.230 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:38.222+0000 7fa6f29d1640 1 -- 172.21.15.102:0/156790644 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa6ec06b4b0 msgr2=0x7fa6ec0cfd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:38.230 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:38.222+0000 7fa6f29d1640 1 --2- 172.21.15.102:0/156790644 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa6ec06b4b0 0x7fa6ec0cfd00 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7fa6e00097c0 tx=0x7fa6e001c450 comp rx=0 tx=0).stop 2023-11-13T11:29:38.230 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:38.222+0000 7fa6f29d1640 1 -- 172.21.15.102:0/156790644 shutdown_connections 2023-11-13T11:29:38.230 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:38.222+0000 7fa6f29d1640 1 --2- 172.21.15.102:0/156790644 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa6ec06b4b0 0x7fa6ec0cfd00 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:38.231 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:38.222+0000 7fa6f29d1640 1 --2- 172.21.15.102:0/156790644 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa6ec15d0c0 0x7fa6ec06a450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:38.231 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:38.222+0000 7fa6f29d1640 1 -- 172.21.15.102:0/156790644 >> 172.21.15.102:0/156790644 conn(0x7fa6ec0709d0 msgr2=0x7fa6ec0b4120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-13T11:29:38.231 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:38.222+0000 7fa6f29d1640 1 -- 172.21.15.102:0/156790644 shutdown_connections 2023-11-13T11:29:38.231 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:38.222+0000 7fa6f29d1640 1 -- 172.21.15.102:0/156790644 wait complete. 2023-11-13T11:29:38.233 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:38.226+0000 7fa6f29d1640 1 Processor -- start 2023-11-13T11:29:38.234 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:38.226+0000 7fa6f29d1640 1 -- start start 2023-11-13T11:29:38.234 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:38.226+0000 7fa6f29d1640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa6ec06b4b0 0x7fa6ec0ad990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:38.234 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:38.226+0000 7fa6f29d1640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa6ec0b02c0 0x7fa6ec15d9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:38.235 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:38.226+0000 7fa6f29d1640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa6ec15d0c0 0x7fa6ec1531b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:38.235 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:38.226+0000 7fa6f29d1640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6ec15ec50 con 0x7fa6ec0b02c0 2023-11-13T11:29:38.235 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:38.226+0000 7fa6f29d1640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6ec1597c0 con 0x7fa6ec06b4b0 2023-11-13T11:29:38.235 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:38.226+0000 7fa6f29d1640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa6ec15e3b0 con 0x7fa6ec15d0c0 2023-11-13T11:29:38.235 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:38.226+0000 7fa6eb7fe640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa6ec0b02c0 0x7fa6ec15d9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:38.235 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:38.226+0000 7fa6eb7fe640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa6ec0b02c0 0x7fa6ec15d9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:45250/0 (socket says 172.21.15.102:45250) 2023-11-13T11:29:38.236 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:38.226+0000 7fa6eb7fe640 1 -- 172.21.15.102:0/3217601046 learned_addr learned my addr 172.21.15.102:0/3217601046 (peer_addr_for_me v2:172.21.15.102:0/0) 2023-11-13T11:29:38.236 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:38.226+0000 7fa6f0f6e640 1 --2- 172.21.15.102:0/3217601046 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa6ec15d0c0 0x7fa6ec1531b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:38.236 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:38.226+0000 7fa6ebfff640 1 --2- 172.21.15.102:0/3217601046 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa6ec06b4b0 0x7fa6ec0ad990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:38.236 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:38.226+0000 7fa6eb7fe640 1 -- 172.21.15.102:0/3217601046 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa6ec15d0c0 msgr2=0x7fa6ec1531b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:38.236 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:38.226+0000 7fa6eb7fe640 1 --2- 172.21.15.102:0/3217601046 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa6ec15d0c0 0x7fa6ec1531b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:38.237 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:38.226+0000 7fa6eb7fe640 1 -- 172.21.15.102:0/3217601046 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa6ec06b4b0 msgr2=0x7fa6ec0ad990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:38.237 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:38.226+0000 7fa6eb7fe640 1 --2- 172.21.15.102:0/3217601046 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa6ec06b4b0 0x7fa6ec0ad990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:38.237 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:38.226+0000 7fa6eb7fe640 1 -- 172.21.15.102:0/3217601046 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6e0009420 con 0x7fa6ec0b02c0 2023-11-13T11:29:38.237 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:38.226+0000 7fa6eb7fe640 1 --2- 172.21.15.102:0/3217601046 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa6ec0b02c0 0x7fa6ec15d9d0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7fa6e001a080 tx=0x7fa6e00191f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-13T11:29:38.237 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:38.226+0000 7fa6e8ff9640 1 -- 172.21.15.102:0/3217601046 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6e00b4800 con 0x7fa6ec0b02c0 2023-11-13T11:29:38.238 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:38.226+0000 7fa6e8ff9640 1 -- 172.21.15.102:0/3217601046 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa6e00b4980 con 0x7fa6ec0b02c0 2023-11-13T11:29:38.238 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:38.226+0000 7fa6f29d1640 1 -- 172.21.15.102:0/3217601046 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa6ec15e690 con 0x7fa6ec0b02c0 2023-11-13T11:29:38.238 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:38.226+0000 7fa6e8ff9640 1 -- 172.21.15.102:0/3217601046 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6e00b4d30 con 0x7fa6ec0b02c0 2023-11-13T11:29:38.238 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:38.226+0000 7fa6f29d1640 1 -- 172.21.15.102:0/3217601046 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa6ec0aded0 con 0x7fa6ec0b02c0 2023-11-13T11:29:38.239 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:38.226+0000 7fa6f29d1640 1 -- 172.21.15.102:0/3217601046 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa6ec1595e0 con 0x7fa6ec0b02c0 2023-11-13T11:29:38.239 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:38.230+0000 7fa6e8ff9640 1 -- 172.21.15.102:0/3217601046 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fa6e00c1460 con 0x7fa6ec0b02c0 2023-11-13T11:29:38.240 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:38.230+0000 7fa6e8ff9640 1 --2- 172.21.15.102:0/3217601046 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7fa6d8066470 0x7fa6d8068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:38.240 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:38.230+0000 7fa6e8ff9640 1 -- 172.21.15.102:0/3217601046 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5738+0+0 (secure 0 0 0) 0x7fa6e011e270 con 0x7fa6ec0b02c0 2023-11-13T11:29:38.240 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:38.230+0000 7fa6ebfff640 1 --2- 172.21.15.102:0/3217601046 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7fa6d8066470 0x7fa6d8068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:38.240 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:38.230+0000 7fa6ebfff640 1 --2- 172.21.15.102:0/3217601046 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7fa6d8066470 0x7fa6d8068930 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fa6ec160710 tx=0x7fa6dc008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-13T11:29:38.241 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:38.234+0000 7fa6e8ff9640 1 -- 172.21.15.102:0/3217601046 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fa6e00eb6c0 con 0x7fa6ec0b02c0 2023-11-13T11:29:38.388 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:38.382+0000 7fa6f29d1640 1 -- 172.21.15.102:0/3217601046 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fa6ec068520 con 0x7fa6ec0b02c0 2023-11-13T11:29:38.389 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:38.382+0000 7fa6e8ff9640 1 -- 172.21.15.102:0/3217601046 <== mon.0 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v23) v1 ==== 100+0+11 (secure 0 0 0) 0x7fa6e0006e20 con 0x7fa6ec0b02c0 2023-11-13T11:29:38.389 INFO:teuthology.orchestra.run.smithi102.stdout:pg_num: 64 2023-11-13T11:29:38.390 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:38.382+0000 7fa6f29d1640 1 -- 172.21.15.102:0/3217601046 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7fa6d8066470 msgr2=0x7fa6d8068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:38.391 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:38.382+0000 7fa6f29d1640 1 --2- 172.21.15.102:0/3217601046 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7fa6d8066470 0x7fa6d8068930 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fa6ec160710 tx=0x7fa6dc008040 comp rx=0 tx=0).stop 2023-11-13T11:29:38.391 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:38.382+0000 7fa6f29d1640 1 -- 172.21.15.102:0/3217601046 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa6ec0b02c0 msgr2=0x7fa6ec15d9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:38.391 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:38.382+0000 7fa6f29d1640 1 --2- 172.21.15.102:0/3217601046 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa6ec0b02c0 0x7fa6ec15d9d0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7fa6e001a080 tx=0x7fa6e00191f0 comp rx=0 tx=0).stop 2023-11-13T11:29:38.391 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:38.382+0000 7fa6f29d1640 1 -- 172.21.15.102:0/3217601046 shutdown_connections 2023-11-13T11:29:38.391 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:38.382+0000 7fa6f29d1640 1 --2- 172.21.15.102:0/3217601046 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa6ec15d0c0 0x7fa6ec1531b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:38.392 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:38.382+0000 7fa6f29d1640 1 --2- 172.21.15.102:0/3217601046 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7fa6d8066470 0x7fa6d8068930 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:38.392 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:38.382+0000 7fa6f29d1640 1 --2- 172.21.15.102:0/3217601046 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa6ec0b02c0 0x7fa6ec15d9d0 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:38.392 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:38.382+0000 7fa6f29d1640 1 --2- 172.21.15.102:0/3217601046 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa6ec06b4b0 0x7fa6ec0ad990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:38.392 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:38.382+0000 7fa6f29d1640 1 -- 172.21.15.102:0/3217601046 >> 172.21.15.102:0/3217601046 conn(0x7fa6ec0709d0 msgr2=0x7fa6ec0b0770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-13T11:29:38.392 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:38.382+0000 7fa6f29d1640 1 -- 172.21.15.102:0/3217601046 shutdown_connections 2023-11-13T11:29:38.393 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:38.382+0000 7fa6f29d1640 1 -- 172.21.15.102:0/3217601046 wait complete. 2023-11-13T11:29:38.410 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-11-13T11:29:38.549 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:38.542+0000 7ff56f701640 1 Processor -- start 2023-11-13T11:29:38.549 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:38.542+0000 7ff56f701640 1 -- start start 2023-11-13T11:29:38.551 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:38.542+0000 7ff56f701640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff5680d0c40 0x7ff5680c69b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:38.552 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:38.542+0000 7ff56f701640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7ff5680cf490 0x7ff5680cf920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:38.552 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:38.542+0000 7ff56f701640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff5680d1440 con 0x7ff5681606e0 2023-11-13T11:29:38.552 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:38.542+0000 7ff56f701640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff5680cfe60 con 0x7ff5680cf490 2023-11-13T11:29:38.552 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:38.542+0000 7ff56f701640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5680cdb10 con 0x7ff5680d0c40 2023-11-13T11:29:38.553 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:38.546+0000 7ff56dc9e640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7ff5680cf490 0x7ff5680cf920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:38.553 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:38.546+0000 7ff56dc9e640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7ff5680cf490 0x7ff5680cf920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:45252/0 (socket says 172.21.15.102:45252) 2023-11-13T11:29:38.553 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:38.546+0000 7ff56dc9e640 1 -- 172.21.15.102:0/4244500643 learned_addr learned my addr 172.21.15.102:0/4244500643 (peer_addr_for_me v2:172.21.15.102:0/0) 2023-11-13T11:29:38.553 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:38.546+0000 7ff56cc9c640 1 --2- 172.21.15.102:0/4244500643 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff5680d0c40 0x7ff5680c69b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:38.554 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:38.546+0000 7ff56dc9e640 1 -- 172.21.15.102:0/4244500643 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff5680d0c40 msgr2=0x7ff5680c69b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-13T11:29:38.554 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:38.546+0000 7ff56dc9e640 1 --2- 172.21.15.102:0/4244500643 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff5680d0c40 0x7ff5680c69b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:38.554 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:38.546+0000 7ff56dc9e640 1 -- 172.21.15.102:0/4244500643 >> v1:172.21.15.154:6789/0 conn(0x7ff5681606e0 legacy=0x7ff5680b3e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:38.554 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:38.546+0000 7ff56dc9e640 1 -- 172.21.15.102:0/4244500643 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5680d1690 con 0x7ff5680cf490 2023-11-13T11:29:38.556 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:38.546+0000 7ff56dc9e640 1 --2- 172.21.15.102:0/4244500643 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff5680cf490 0x7ff5680cf920 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7ff560009e50 tx=0x7ff56001c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=233d7cd1a6a5f081 server_cookie=0 in_seq=0 out_seq=0 2023-11-13T11:29:38.556 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:38.546+0000 7ff55ffff640 1 -- 172.21.15.102:0/4244500643 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5600a5830 con 0x7ff5680cf490 2023-11-13T11:29:38.556 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:38.546+0000 7ff55ffff640 1 -- 172.21.15.102:0/4244500643 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff5600a5990 con 0x7ff5680cf490 2023-11-13T11:29:38.557 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:38.546+0000 7ff55ffff640 1 -- 172.21.15.102:0/4244500643 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5600a5d20 con 0x7ff5680cf490 2023-11-13T11:29:38.557 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:38.550+0000 7ff56f701640 1 -- 172.21.15.102:0/4244500643 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff5680cf490 msgr2=0x7ff5680cf920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:38.557 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:38.550+0000 7ff56f701640 1 --2- 172.21.15.102:0/4244500643 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff5680cf490 0x7ff5680cf920 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7ff560009e50 tx=0x7ff56001c950 comp rx=0 tx=0).stop 2023-11-13T11:29:38.558 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:38.550+0000 7ff56f701640 1 -- 172.21.15.102:0/4244500643 shutdown_connections 2023-11-13T11:29:38.558 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:38.550+0000 7ff56f701640 1 --2- 172.21.15.102:0/4244500643 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff5680cf490 0x7ff5680cf920 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:38.558 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:38.550+0000 7ff56f701640 1 --2- 172.21.15.102:0/4244500643 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff5680d0c40 0x7ff5680c69b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:38.558 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:38.550+0000 7ff56f701640 1 -- 172.21.15.102:0/4244500643 >> 172.21.15.102:0/4244500643 conn(0x7ff56809c130 msgr2=0x7ff5680d2e60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-13T11:29:38.559 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:38.550+0000 7ff56f701640 1 -- 172.21.15.102:0/4244500643 shutdown_connections 2023-11-13T11:29:38.559 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:38.550+0000 7ff56f701640 1 -- 172.21.15.102:0/4244500643 wait complete. 2023-11-13T11:29:38.562 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:38.550+0000 7ff56f701640 1 Processor -- start 2023-11-13T11:29:38.563 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:38.550+0000 7ff56f701640 1 -- start start 2023-11-13T11:29:38.563 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:38.550+0000 7ff56f701640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff5680cf490 0x7ff5680cbb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:38.563 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:38.550+0000 7ff56f701640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff5680d0c40 0x7ff5680b7290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:38.563 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:38.550+0000 7ff56f701640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff5681606e0 0x7ff5680b5a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:38.564 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:38.550+0000 7ff56f701640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5680b5fc0 con 0x7ff5680cf490 2023-11-13T11:29:38.564 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:38.550+0000 7ff56f701640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5680b61f0 con 0x7ff5681606e0 2023-11-13T11:29:38.564 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:38.550+0000 7ff56f701640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5680b64d0 con 0x7ff5680d0c40 2023-11-13T11:29:38.564 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:38.550+0000 7ff56d49d640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff5680cf490 0x7ff5680cbb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:38.564 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:38.550+0000 7ff56d49d640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff5680cf490 0x7ff5680cbb50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:45260/0 (socket says 172.21.15.102:45260) 2023-11-13T11:29:38.565 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:38.550+0000 7ff56d49d640 1 -- 172.21.15.102:0/1811996974 learned_addr learned my addr 172.21.15.102:0/1811996974 (peer_addr_for_me v2:172.21.15.102:0/0) 2023-11-13T11:29:38.565 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:38.550+0000 7ff56dc9e640 1 --2- 172.21.15.102:0/1811996974 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff5681606e0 0x7ff5680b5a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:38.565 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:38.550+0000 7ff56cc9c640 1 --2- 172.21.15.102:0/1811996974 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff5680d0c40 0x7ff5680b7290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:38.565 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:38.550+0000 7ff56d49d640 1 -- 172.21.15.102:0/1811996974 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff5680d0c40 msgr2=0x7ff5680b7290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:38.565 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:38.550+0000 7ff56d49d640 1 --2- 172.21.15.102:0/1811996974 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff5680d0c40 0x7ff5680b7290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:38.566 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:38.550+0000 7ff56d49d640 1 -- 172.21.15.102:0/1811996974 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff5681606e0 msgr2=0x7ff5680b5a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:38.566 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:38.550+0000 7ff56d49d640 1 --2- 172.21.15.102:0/1811996974 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff5681606e0 0x7ff5680b5a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:38.566 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:38.550+0000 7ff56d49d640 1 -- 172.21.15.102:0/1811996974 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff560009b30 con 0x7ff5680cf490 2023-11-13T11:29:38.566 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:38.550+0000 7ff56d49d640 1 --2- 172.21.15.102:0/1811996974 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff5680cf490 0x7ff5680cbb50 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7ff56400c3c0 tx=0x7ff56400c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-13T11:29:38.566 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:38.554+0000 7ff55dffb640 1 -- 172.21.15.102:0/1811996974 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5640052d0 con 0x7ff5680cf490 2023-11-13T11:29:38.567 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:38.554+0000 7ff55dffb640 1 -- 172.21.15.102:0/1811996974 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff564005430 con 0x7ff5680cf490 2023-11-13T11:29:38.567 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:38.554+0000 7ff55dffb640 1 -- 172.21.15.102:0/1811996974 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff564003840 con 0x7ff5680cf490 2023-11-13T11:29:38.567 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:38.554+0000 7ff56f701640 1 -- 172.21.15.102:0/1811996974 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff5680b67b0 con 0x7ff5680cf490 2023-11-13T11:29:38.567 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:38.554+0000 7ff56f701640 1 -- 172.21.15.102:0/1811996974 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff5680b6d70 con 0x7ff5680cf490 2023-11-13T11:29:38.567 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:38.554+0000 7ff56f701640 1 -- 172.21.15.102:0/1811996974 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff5680b6f80 con 0x7ff5680cf490 2023-11-13T11:29:38.568 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:38.554+0000 7ff55dffb640 1 -- 172.21.15.102:0/1811996974 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7ff5640039a0 con 0x7ff5680cf490 2023-11-13T11:29:38.568 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:38.554+0000 7ff55dffb640 1 --2- 172.21.15.102:0/1811996974 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7ff54c066470 0x7ff54c068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:38.568 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:38.554+0000 7ff55dffb640 1 -- 172.21.15.102:0/1811996974 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5738+0+0 (secure 0 0 0) 0x7ff564083450 con 0x7ff5680cf490 2023-11-13T11:29:38.568 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:38.554+0000 7ff56cc9c640 1 --2- 172.21.15.102:0/1811996974 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7ff54c066470 0x7ff54c068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:38.568 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:38.554+0000 7ff56cc9c640 1 --2- 172.21.15.102:0/1811996974 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7ff54c066470 0x7ff54c068930 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7ff5680cdd00 tx=0x7ff558008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-13T11:29:38.570 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:38.558+0000 7ff55dffb640 1 -- 172.21.15.102:0/1811996974 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7ff564050820 con 0x7ff5680cf490 2023-11-13T11:29:38.730 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:38.722+0000 7ff56f701640 1 -- 172.21.15.102:0/1811996974 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7ff568068520 con 0x7ff5680cf490 2023-11-13T11:29:38.730 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:38.722+0000 7ff55dffb640 1 -- 172.21.15.102:0/1811996974 <== mon.0 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v24) v1 ==== 80+0+0 (secure 0 0 0) 0x7ff564053e40 con 0x7ff5680cf490 2023-11-13T11:29:38.730 INFO:teuthology.orchestra.run.smithi102.stderr:listed 0 entries 2023-11-13T11:29:38.733 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:38.726+0000 7ff56f701640 1 -- 172.21.15.102:0/1811996974 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7ff54c066470 msgr2=0x7ff54c068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:38.733 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:38.726+0000 7ff56f701640 1 --2- 172.21.15.102:0/1811996974 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7ff54c066470 0x7ff54c068930 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7ff5680cdd00 tx=0x7ff558008040 comp rx=0 tx=0).stop 2023-11-13T11:29:38.733 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:38.726+0000 7ff56f701640 1 -- 172.21.15.102:0/1811996974 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff5680cf490 msgr2=0x7ff5680cbb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:38.733 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:38.726+0000 7ff56f701640 1 --2- 172.21.15.102:0/1811996974 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff5680cf490 0x7ff5680cbb50 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7ff56400c3c0 tx=0x7ff56400c880 comp rx=0 tx=0).stop 2023-11-13T11:29:38.733 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:38.726+0000 7ff56f701640 1 -- 172.21.15.102:0/1811996974 shutdown_connections 2023-11-13T11:29:38.734 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:38.726+0000 7ff56f701640 1 --2- 172.21.15.102:0/1811996974 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff5681606e0 0x7ff5680b5a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:38.734 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:38.726+0000 7ff56f701640 1 --2- 172.21.15.102:0/1811996974 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff5680d0c40 0x7ff5680b7290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:38.734 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:38.726+0000 7ff56f701640 1 --2- 172.21.15.102:0/1811996974 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7ff54c066470 0x7ff54c068930 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:38.734 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:38.726+0000 7ff56f701640 1 --2- 172.21.15.102:0/1811996974 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff5680cf490 0x7ff5680cbb50 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:38.734 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:38.726+0000 7ff56f701640 1 -- 172.21.15.102:0/1811996974 >> 172.21.15.102:0/1811996974 conn(0x7ff56809c130 msgr2=0x7ff56815ee20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-13T11:29:38.735 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:38.726+0000 7ff56f701640 1 -- 172.21.15.102:0/1811996974 shutdown_connections 2023-11-13T11:29:38.735 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:38.726+0000 7ff56f701640 1 -- 172.21.15.102:0/1811996974 wait complete. 2023-11-13T11:29:38.751 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi102.front.sepia.ceph.com... 2023-11-13T11:29:38.751 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-13T11:29:38.753 DEBUG:teuthology.orchestra.run.smithi102:> sudo fusermount -u /home/ubuntu/cephtest/mnt.2 2023-11-13T11:29:38.774 INFO:teuthology.orchestra.run:waiting for 300 2023-11-13T11:29:38.775 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi102.front.sepia.ceph.com 2023-11-13T11:29:38.775 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-13T11:29:38.776 DEBUG:teuthology.orchestra.run.smithi102:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2023-11-13T11:29:38.828 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2023-11-13T11:29:38.828 DEBUG:teuthology.orchestra.run.smithi154:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-13T11:29:38.838 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2023-11-13T11:29:38.839 DEBUG:teuthology.orchestra.run.smithi154:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-13T11:29:38.888 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-13T11:29:39.027 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:39.022+0000 7f57e8dd0640 1 Processor -- start 2023-11-13T11:29:39.027 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:39.022+0000 7f57e8dd0640 1 -- start start 2023-11-13T11:29:39.029 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:39.022+0000 7f57e8dd0640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f57e415ce00 0x7f57e40cf340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:39.029 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:39.022+0000 7f57e8dd0640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f57e40d0940 0x7f57e40d1270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:39.029 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:39.022+0000 7f57e8dd0640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f57e40cfcb0 con 0x7f57e40d17b0 2023-11-13T11:29:39.030 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:39.022+0000 7f57e8dd0640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f57e40d1c60 con 0x7f57e40d0940 2023-11-13T11:29:39.030 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:39.022+0000 7f57e8dd0640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f57e40cff90 con 0x7f57e415ce00 2023-11-13T11:29:39.030 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:39.022+0000 7f57e2ffd640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f57e40d0940 0x7f57e40d1270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:39.030 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:39.022+0000 7f57e2ffd640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f57e40d0940 0x7f57e40d1270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:45276/0 (socket says 172.21.15.102:45276) 2023-11-13T11:29:39.030 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:39.022+0000 7f57e2ffd640 1 -- 172.21.15.102:0/187565744 learned_addr learned my addr 172.21.15.102:0/187565744 (peer_addr_for_me v2:172.21.15.102:0/0) 2023-11-13T11:29:39.031 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:39.022+0000 7f57e37fe640 1 --2- 172.21.15.102:0/187565744 >> v2:172.21.15.154:3300/0 conn(0x7f57e415ce00 0x7f57e40cf340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:39.031 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:39.022+0000 7f57e2ffd640 1 -- 172.21.15.102:0/187565744 >> v2:172.21.15.154:3300/0 conn(0x7f57e415ce00 msgr2=0x7f57e40cf340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-13T11:29:39.031 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:39.022+0000 7f57e2ffd640 1 --2- 172.21.15.102:0/187565744 >> v2:172.21.15.154:3300/0 conn(0x7f57e415ce00 0x7f57e40cf340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:39.031 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:39.022+0000 7f57e2ffd640 1 -- 172.21.15.102:0/187565744 >> v1:172.21.15.154:6789/0 conn(0x7f57e40d17b0 legacy=0x7f57e40cd7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-13T11:29:39.031 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:39.022+0000 7f57e2ffd640 1 -- 172.21.15.102:0/187565744 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57e40d0270 con 0x7f57e40d0940 2023-11-13T11:29:39.032 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:39.022+0000 7f57e37fe640 1 --2- 172.21.15.102:0/187565744 >> v2:172.21.15.154:3300/0 conn(0x7f57e415ce00 0x7f57e40cf340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-13T11:29:39.033 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:39.026+0000 7f57e2ffd640 1 --2- 172.21.15.102:0/187565744 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f57e40d0940 0x7f57e40d1270 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f57e408b8d0 tx=0x7f57d801c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f7120aa9a6afe2b6 server_cookie=0 in_seq=0 out_seq=0 2023-11-13T11:29:39.033 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:39.026+0000 7f57e27fc640 1 -- 172.21.15.102:0/187565744 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57d80aa430 con 0x7f57e40d0940 2023-11-13T11:29:39.033 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:39.026+0000 7f57e27fc640 1 -- 172.21.15.102:0/187565744 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f57d80aa590 con 0x7f57e40d0940 2023-11-13T11:29:39.033 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:39.026+0000 7f57e27fc640 1 -- 172.21.15.102:0/187565744 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57d80aa920 con 0x7f57e40d0940 2023-11-13T11:29:39.034 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:39.026+0000 7f57e8dd0640 1 -- 172.21.15.102:0/187565744 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f57e40d0940 msgr2=0x7f57e40d1270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:39.034 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:39.026+0000 7f57e8dd0640 1 --2- 172.21.15.102:0/187565744 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f57e40d0940 0x7f57e40d1270 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f57e408b8d0 tx=0x7f57d801c4d0 comp rx=0 tx=0).stop 2023-11-13T11:29:39.034 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:39.026+0000 7f57e8dd0640 1 -- 172.21.15.102:0/187565744 shutdown_connections 2023-11-13T11:29:39.034 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:39.026+0000 7f57e8dd0640 1 --2- 172.21.15.102:0/187565744 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f57e40d0940 0x7f57e40d1270 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:39.034 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:39.026+0000 7f57e8dd0640 1 --2- 172.21.15.102:0/187565744 >> v2:172.21.15.154:3300/0 conn(0x7f57e415ce00 0x7f57e40cf340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:39.035 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:39.026+0000 7f57e8dd0640 1 -- 172.21.15.102:0/187565744 >> 172.21.15.102:0/187565744 conn(0x7f57e409bf60 msgr2=0x7f57e40d2c90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-13T11:29:39.035 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:39.026+0000 7f57e8dd0640 1 -- 172.21.15.102:0/187565744 shutdown_connections 2023-11-13T11:29:39.035 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:39.026+0000 7f57e8dd0640 1 -- 172.21.15.102:0/187565744 wait complete. 2023-11-13T11:29:39.038 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:39.026+0000 7f57e8dd0640 1 Processor -- start 2023-11-13T11:29:39.038 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:39.030+0000 7f57e8dd0640 1 -- start start 2023-11-13T11:29:39.039 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:39.030+0000 7f57e8dd0640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f57e40d0940 0x7f57e414e1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:39.039 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:39.030+0000 7f57e8dd0640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f57e40d17b0 0x7f57e415c0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:39.039 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:39.030+0000 7f57e8dd0640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f57e415ce00 0x7f57e4151f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:39.039 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:39.030+0000 7f57e8dd0640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57e415f5c0 con 0x7f57e415ce00 2023-11-13T11:29:39.039 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:39.030+0000 7f57e8dd0640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57e4153b80 con 0x7f57e40d17b0 2023-11-13T11:29:39.040 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:39.030+0000 7f57e8dd0640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f57e415f000 con 0x7f57e40d0940 2023-11-13T11:29:39.040 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:39.030+0000 7f57e3fff640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f57e415ce00 0x7f57e4151f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:39.040 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:39.030+0000 7f57e37fe640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f57e40d0940 0x7f57e414e1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:39.040 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:39.030+0000 7f57e3fff640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f57e415ce00 0x7f57e4151f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:45292/0 (socket says 172.21.15.102:45292) 2023-11-13T11:29:39.040 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:39.030+0000 7f57e3fff640 1 -- 172.21.15.102:0/3591163457 learned_addr learned my addr 172.21.15.102:0/3591163457 (peer_addr_for_me v2:172.21.15.102:0/0) 2023-11-13T11:29:39.041 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:39.030+0000 7f57e2ffd640 1 --2- 172.21.15.102:0/3591163457 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f57e40d17b0 0x7f57e415c0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:39.041 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:39.030+0000 7f57e3fff640 1 -- 172.21.15.102:0/3591163457 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f57e40d0940 msgr2=0x7f57e414e1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:39.041 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:39.030+0000 7f57e3fff640 1 --2- 172.21.15.102:0/3591163457 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f57e40d0940 0x7f57e414e1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:39.041 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:39.030+0000 7f57e3fff640 1 -- 172.21.15.102:0/3591163457 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f57e40d17b0 msgr2=0x7f57e415c0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:39.041 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:39.030+0000 7f57e3fff640 1 --2- 172.21.15.102:0/3591163457 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f57e40d17b0 0x7f57e415c0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:39.042 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:39.030+0000 7f57e3fff640 1 -- 172.21.15.102:0/3591163457 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57d80094d0 con 0x7f57e415ce00 2023-11-13T11:29:39.042 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:39.030+0000 7f57e3fff640 1 --2- 172.21.15.102:0/3591163457 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f57e415ce00 0x7f57e4151f70 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f57dc00c770 tx=0x7f57dc00cc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-13T11:29:39.042 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:39.030+0000 7f57cbfff640 1 -- 172.21.15.102:0/3591163457 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57dc003b80 con 0x7f57e415ce00 2023-11-13T11:29:39.042 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:39.030+0000 7f57cbfff640 1 -- 172.21.15.102:0/3591163457 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f57dc003ce0 con 0x7f57e415ce00 2023-11-13T11:29:39.042 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:39.030+0000 7f57e8dd0640 1 -- 172.21.15.102:0/3591163457 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f57e415f2e0 con 0x7f57e415ce00 2023-11-13T11:29:39.043 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:39.030+0000 7f57cbfff640 1 -- 172.21.15.102:0/3591163457 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57dc00aa90 con 0x7f57e415ce00 2023-11-13T11:29:39.043 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:39.030+0000 7f57e8dd0640 1 -- 172.21.15.102:0/3591163457 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f57e414e6f0 con 0x7f57e415ce00 2023-11-13T11:29:39.043 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:39.030+0000 7f57e8dd0640 1 -- 172.21.15.102:0/3591163457 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f57e4067680 con 0x7f57e415ce00 2023-11-13T11:29:39.044 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:39.034+0000 7f57cbfff640 1 -- 172.21.15.102:0/3591163457 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f57dc00abf0 con 0x7f57e415ce00 2023-11-13T11:29:39.044 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:39.034+0000 7f57cbfff640 1 --2- 172.21.15.102:0/3591163457 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f57d0066470 0x7f57d0068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:39.045 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:39.034+0000 7f57cbfff640 1 -- 172.21.15.102:0/3591163457 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 5738+0+0 (secure 0 0 0) 0x7f57dc083bd0 con 0x7f57e415ce00 2023-11-13T11:29:39.045 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:39.034+0000 7f57e37fe640 1 --2- 172.21.15.102:0/3591163457 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f57d0066470 0x7f57d0068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:39.045 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:39.034+0000 7f57e37fe640 1 --2- 172.21.15.102:0/3591163457 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f57d0066470 0x7f57d0068930 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f57d4006e90 tx=0x7f57d4008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-13T11:29:39.045 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:39.038+0000 7f57cbfff640 1 -- 172.21.15.102:0/3591163457 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f57dc0510c0 con 0x7f57e415ce00 2023-11-13T11:29:39.196 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:39.190+0000 7f57e8dd0640 1 -- 172.21.15.102:0/3591163457 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f57e41539e0 con 0x7f57e415ce00 2023-11-13T11:29:39.196 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:39.190+0000 7f57cbfff640 1 -- 172.21.15.102:0/3591163457 <== mon.0 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+16594 (secure 0 0 0) 0x7f57e41539e0 con 0x7f57e415ce00 2023-11-13T11:29:39.197 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T11:29:39.197 INFO:teuthology.orchestra.run.smithi102.stdout:{"epoch":24,"fsid":"97b3eb2b-7ccf-4aae-8d92-bff986c671ea","created":"2023-11-13T11:28:31.836724+0000","modified":"2023-11-13T11:29:38.698982+0000","last_up_change":"2023-11-13T11:28:44.876638+0000","last_in_change":"2023-11-13T11:28:35.312740+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-13T11:28:44.981356+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-13T11:28:55.958525+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-13T11:28:56.394264+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"bdefaa17-fcca-4c86-aa40-27dc33a789af","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6800","nonce":53303834},{"type":"v1","addr":"172.21.15.102:6801","nonce":53303834}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6802","nonce":53303834},{"type":"v1","addr":"172.21.15.102:6803","nonce":53303834}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6806","nonce":53303834},{"type":"v1","addr":"172.21.15.102:6807","nonce":53303834}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6804","nonce":53303834},{"type":"v1","addr":"172.21.15.102:6805","nonce":53303834}]},"public_addr":"172.21.15.102:6801/53303834","cluster_addr":"172.21.15.102:6803/53303834","heartbeat_back_addr":"172.21.15.102:6807/53303834","heartbeat_front_addr":"172.21.15.102:6805/53303834","state":["exists","up"]},{"osd":1,"uuid":"f0033196-dec9-4ae9-945e-6aeef6dbb47f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6808","nonce":1732708348},{"type":"v1","addr":"172.21.15.102:6809","nonce":1732708348}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6811","nonce":1732708348},{"type":"v1","addr":"172.21.15.102:6813","nonce":1732708348}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6818","nonce":1732708348},{"type":"v1","addr":"172.21.15.102:6820","nonce":1732708348}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6815","nonce":1732708348},{"type":"v1","addr":"172.21.15.102:6817","nonce":1732708348}]},"public_addr":"172.21.15.102:6809/1732708348","cluster_addr":"172.21.15.102:6813/1732708348","heartbeat_back_addr":"172.21.15.102:6820/1732708348","heartbeat_front_addr":"172.21.15.102:6817/1732708348","state":["exists","up"]},{"osd":2,"uuid":"496b0834-351e-4ec2-a714-86ed0c0ff4fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6810","nonce":1825475150},{"type":"v1","addr":"172.21.15.102:6812","nonce":1825475150}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6814","nonce":1825475150},{"type":"v1","addr":"172.21.15.102:6816","nonce":1825475150}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6822","nonce":1825475150},{"type":"v1","addr":"172.21.15.102:6823","nonce":1825475150}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6819","nonce":1825475150},{"type":"v1","addr":"172.21.15.102:6821","nonce":1825475150}]},"public_addr":"172.21.15.102:6812/1825475150","cluster_addr":"172.21.15.102:6816/1825475150","heartbeat_back_addr":"172.21.15.102:6823/1825475150","heartbeat_front_addr":"172.21.15.102:6821/1825475150","state":["exists","up"]},{"osd":3,"uuid":"3ba6cc41-e0a0-4273-86cb-90000c06a55a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6824","nonce":4149355528},{"type":"v1","addr":"172.21.15.102:6825","nonce":4149355528}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6826","nonce":4149355528},{"type":"v1","addr":"172.21.15.102:6827","nonce":4149355528}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6830","nonce":4149355528},{"type":"v1","addr":"172.21.15.102:6831","nonce":4149355528}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6828","nonce":4149355528},{"type":"v1","addr":"172.21.15.102:6829","nonce":4149355528}]},"public_addr":"172.21.15.102:6825/4149355528","cluster_addr":"172.21.15.102:6827/4149355528","heartbeat_back_addr":"172.21.15.102:6831/4149355528","heartbeat_front_addr":"172.21.15.102:6829/4149355528","state":["exists","up"]},{"osd":4,"uuid":"16e797d8-e6e7-4140-95c3-b85283c42a2a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6808","nonce":4028899241},{"type":"v1","addr":"172.21.15.154:6809","nonce":4028899241}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6810","nonce":4028899241},{"type":"v1","addr":"172.21.15.154:6811","nonce":4028899241}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6814","nonce":4028899241},{"type":"v1","addr":"172.21.15.154:6815","nonce":4028899241}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6812","nonce":4028899241},{"type":"v1","addr":"172.21.15.154:6813","nonce":4028899241}]},"public_addr":"172.21.15.154:6809/4028899241","cluster_addr":"172.21.15.154:6811/4028899241","heartbeat_back_addr":"172.21.15.154:6815/4028899241","heartbeat_front_addr":"172.21.15.154:6813/4028899241","state":["exists","up"]},{"osd":5,"uuid":"d6ab225c-1b55-450a-89a9-abe5c3f8d6af","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":3562396827},{"type":"v1","addr":"172.21.15.154:6801","nonce":3562396827}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":3562396827},{"type":"v1","addr":"172.21.15.154:6803","nonce":3562396827}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6806","nonce":3562396827},{"type":"v1","addr":"172.21.15.154:6807","nonce":3562396827}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6804","nonce":3562396827},{"type":"v1","addr":"172.21.15.154:6805","nonce":3562396827}]},"public_addr":"172.21.15.154:6801/3562396827","cluster_addr":"172.21.15.154:6803/3562396827","heartbeat_back_addr":"172.21.15.154:6807/3562396827","heartbeat_front_addr":"172.21.15.154:6805/3562396827","state":["exists","up"]},{"osd":6,"uuid":"96f905ac-491c-4662-8e2b-5bb8e929ab9d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6816","nonce":2933728751},{"type":"v1","addr":"172.21.15.154:6817","nonce":2933728751}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6818","nonce":2933728751},{"type":"v1","addr":"172.21.15.154:6819","nonce":2933728751}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6822","nonce":2933728751},{"type":"v1","addr":"172.21.15.154:6823","nonce":2933728751}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6820","nonce":2933728751},{"type":"v1","addr":"172.21.15.154:6821","nonce":2933728751}]},"public_addr":"172.21.15.154:6817/2933728751","cluster_addr":"172.21.15.154:6819/2933728751","heartbeat_back_addr":"172.21.15.154:6823/2933728751","heartbeat_front_addr":"172.21.15.154:6821/2933728751","state":["exists","up"]},{"osd":7,"uuid":"07012d3b-3ab4-40df-a471-93caed22e2dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6824","nonce":1753500785},{"type":"v1","addr":"172.21.15.154:6825","nonce":1753500785}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6826","nonce":1753500785},{"type":"v1","addr":"172.21.15.154:6827","nonce":1753500785}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6830","nonce":1753500785},{"type":"v1","addr":"172.21.15.154:6831","nonce":1753500785}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6828","nonce":1753500785},{"type":"v1","addr":"172.21.15.154:6829","nonce":1753500785}]},"public_addr":"172.21.15.154:6825/1753500785","cluster_addr":"172.21.15.154:6827/1753500785","heartbeat_back_addr":"172.21.15.154:6831/1753500785","heartbeat_front_addr":"172.21.15.154:6829/1753500785","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-13T11:28:40.978603+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-13T11:28:41.200985+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-13T11:28:41.222815+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-13T11:28:41.202162+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-13T11:28:40.925911+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-13T11:28:41.087725+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-13T11:28:41.072208+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-13T11:28:40.875257+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.2c","mappings":[{"from":0,"to":7}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-13T11:29:39.198 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:39.190+0000 7f57e8dd0640 1 -- 172.21.15.102:0/3591163457 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f57d0066470 msgr2=0x7f57d0068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:39.199 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:39.190+0000 7f57e8dd0640 1 --2- 172.21.15.102:0/3591163457 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f57d0066470 0x7f57d0068930 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f57d4006e90 tx=0x7f57d4008040 comp rx=0 tx=0).stop 2023-11-13T11:29:39.199 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:39.190+0000 7f57e8dd0640 1 -- 172.21.15.102:0/3591163457 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f57e415ce00 msgr2=0x7f57e4151f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:39.199 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:39.190+0000 7f57e8dd0640 1 --2- 172.21.15.102:0/3591163457 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f57e415ce00 0x7f57e4151f70 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f57dc00c770 tx=0x7f57dc00cc30 comp rx=0 tx=0).stop 2023-11-13T11:29:39.199 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:39.190+0000 7f57e8dd0640 1 -- 172.21.15.102:0/3591163457 shutdown_connections 2023-11-13T11:29:39.200 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:39.190+0000 7f57e8dd0640 1 --2- 172.21.15.102:0/3591163457 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f57d0066470 0x7f57d0068930 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:39.200 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:39.190+0000 7f57e8dd0640 1 --2- 172.21.15.102:0/3591163457 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f57e415ce00 0x7f57e4151f70 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:39.200 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:39.190+0000 7f57e8dd0640 1 --2- 172.21.15.102:0/3591163457 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f57e40d17b0 0x7f57e415c0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:39.200 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:39.190+0000 7f57e8dd0640 1 --2- 172.21.15.102:0/3591163457 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f57e40d0940 0x7f57e414e1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:39.200 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:39.190+0000 7f57e8dd0640 1 -- 172.21.15.102:0/3591163457 >> 172.21.15.102:0/3591163457 conn(0x7f57e409bf60 msgr2=0x7f57e4156630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-13T11:29:39.201 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:39.190+0000 7f57e8dd0640 1 -- 172.21.15.102:0/3591163457 shutdown_connections 2023-11-13T11:29:39.201 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:39.190+0000 7f57e8dd0640 1 -- 172.21.15.102:0/3591163457 wait complete. 2023-11-13T11:29:39.218 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-13T11:28:44.981356+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-13T11:28:55.958525+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-11-13T11:28:56.394264+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-13T11:29:39.219 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-13T11:29:39.360 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:39.354+0000 7ffb85d2a640 1 Processor -- start 2023-11-13T11:29:39.360 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:39.354+0000 7ffb85d2a640 1 -- start start 2023-11-13T11:29:39.362 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:39.354+0000 7ffb85d2a640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7ffb8015d600 0x7ffb800b2e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:39.363 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:39.354+0000 7ffb85d2a640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ffb800b3f60 0x7ffb800d3910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:39.363 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:39.354+0000 7ffb85d2a640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffb800b3840 con 0x7ffb8015d220 2023-11-13T11:29:39.364 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:39.354+0000 7ffb85d2a640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffb800cecb0 con 0x7ffb8015d600 2023-11-13T11:29:39.364 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:39.354+0000 7ffb85d2a640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffb800d0d00 con 0x7ffb800b3f60 2023-11-13T11:29:39.364 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:39.354+0000 7ffb7ffff640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ffb800b3f60 0x7ffb800d3910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:39.365 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:39.354+0000 7ffb7effd640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7ffb8015d600 0x7ffb800b2e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:39.365 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:39.354+0000 7ffb7ffff640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ffb800b3f60 0x7ffb800d3910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.102:38482/0 (socket says 172.21.15.102:38482) 2023-11-13T11:29:39.365 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:39.354+0000 7ffb7ffff640 1 -- 172.21.15.102:0/752986543 learned_addr learned my addr 172.21.15.102:0/752986543 (peer_addr_for_me v2:172.21.15.102:0/0) 2023-11-13T11:29:39.366 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:39.354+0000 7ffb7ffff640 1 -- 172.21.15.102:0/752986543 >> v2:172.21.15.154:3300/0 conn(0x7ffb8015d600 msgr2=0x7ffb800b2e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-13T11:29:39.366 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:39.354+0000 7ffb7ffff640 1 --2- 172.21.15.102:0/752986543 >> v2:172.21.15.154:3300/0 conn(0x7ffb8015d600 0x7ffb800b2e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:39.366 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:39.354+0000 7ffb7ffff640 1 -- 172.21.15.102:0/752986543 >> v1:172.21.15.154:6789/0 conn(0x7ffb8015d220 legacy=0x7ffb800b2750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:39.366 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:39.354+0000 7ffb7ffff640 1 -- 172.21.15.102:0/752986543 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb800d0fe0 con 0x7ffb800b3f60 2023-11-13T11:29:39.367 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:39.354+0000 7ffb7effd640 1 --2- 172.21.15.102:0/752986543 >> v2:172.21.15.154:3300/0 conn(0x7ffb8015d600 0x7ffb800b2e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-13T11:29:39.371 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:39.358+0000 7ffb7ffff640 1 --2- 172.21.15.102:0/752986543 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ffb800b3f60 0x7ffb800d3910 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7ffb78009e50 tx=0x7ffb7801c8c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=895c47bd6d650db8 server_cookie=0 in_seq=0 out_seq=0 2023-11-13T11:29:39.372 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:39.358+0000 7ffb7e7fc640 1 -- 172.21.15.102:0/752986543 <== mon.2 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb780a5720 con 0x7ffb800b3f60 2023-11-13T11:29:39.373 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:39.358+0000 7ffb7e7fc640 1 -- 172.21.15.102:0/752986543 <== mon.2 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb780a5880 con 0x7ffb800b3f60 2023-11-13T11:29:39.373 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:39.358+0000 7ffb7e7fc640 1 -- 172.21.15.102:0/752986543 <== mon.2 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb780a5c10 con 0x7ffb800b3f60 2023-11-13T11:29:39.373 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:39.358+0000 7ffb85d2a640 1 -- 172.21.15.102:0/752986543 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ffb800b3f60 msgr2=0x7ffb800d3910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:39.374 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:39.358+0000 7ffb85d2a640 1 --2- 172.21.15.102:0/752986543 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ffb800b3f60 0x7ffb800d3910 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7ffb78009e50 tx=0x7ffb7801c8c0 comp rx=0 tx=0).stop 2023-11-13T11:29:39.374 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:39.358+0000 7ffb85d2a640 1 -- 172.21.15.102:0/752986543 shutdown_connections 2023-11-13T11:29:39.374 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:39.358+0000 7ffb85d2a640 1 --2- 172.21.15.102:0/752986543 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ffb800b3f60 0x7ffb800d3910 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:39.374 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:39.358+0000 7ffb85d2a640 1 --2- 172.21.15.102:0/752986543 >> v2:172.21.15.154:3300/0 conn(0x7ffb8015d600 0x7ffb800b2e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:39.375 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:39.358+0000 7ffb85d2a640 1 -- 172.21.15.102:0/752986543 >> 172.21.15.102:0/752986543 conn(0x7ffb800d2df0 msgr2=0x7ffb800d3200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-13T11:29:39.376 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:39.358+0000 7ffb85d2a640 1 -- 172.21.15.102:0/752986543 shutdown_connections 2023-11-13T11:29:39.376 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:39.358+0000 7ffb85d2a640 1 -- 172.21.15.102:0/752986543 wait complete. 2023-11-13T11:29:39.376 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:39.362+0000 7ffb85d2a640 1 Processor -- start 2023-11-13T11:29:39.377 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:39.362+0000 7ffb85d2a640 1 -- start start 2023-11-13T11:29:39.377 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:39.362+0000 7ffb85d2a640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ffb800b3f60 0x7ffb80153f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:39.377 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:39.362+0000 7ffb85d2a640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ffb8015d220 0x7ffb80160210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:39.377 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:39.362+0000 7ffb85d2a640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ffb8015d600 0x7ffb80157430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:39.377 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:39.362+0000 7ffb85d2a640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb8015e310 con 0x7ffb800b3f60 2023-11-13T11:29:39.378 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:39.362+0000 7ffb85d2a640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb800c8d90 con 0x7ffb8015d600 2023-11-13T11:29:39.378 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:39.362+0000 7ffb85d2a640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffb8015dd50 con 0x7ffb8015d220 2023-11-13T11:29:39.378 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:39.362+0000 7ffb7f7fe640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ffb800b3f60 0x7ffb80153f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:39.378 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:39.362+0000 7ffb7f7fe640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ffb800b3f60 0x7ffb80153f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:45302/0 (socket says 172.21.15.102:45302) 2023-11-13T11:29:39.378 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:39.362+0000 7ffb7f7fe640 1 -- 172.21.15.102:0/1833016307 learned_addr learned my addr 172.21.15.102:0/1833016307 (peer_addr_for_me v2:172.21.15.102:0/0) 2023-11-13T11:29:39.379 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:39.362+0000 7ffb7effd640 1 --2- 172.21.15.102:0/1833016307 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ffb8015d220 0x7ffb80160210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:39.379 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:39.362+0000 7ffb7ffff640 1 --2- 172.21.15.102:0/1833016307 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ffb8015d600 0x7ffb80157430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:39.379 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:39.362+0000 7ffb7f7fe640 1 -- 172.21.15.102:0/1833016307 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ffb8015d220 msgr2=0x7ffb80160210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:39.379 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:39.362+0000 7ffb7f7fe640 1 --2- 172.21.15.102:0/1833016307 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ffb8015d220 0x7ffb80160210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:39.380 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:39.362+0000 7ffb7f7fe640 1 -- 172.21.15.102:0/1833016307 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ffb8015d600 msgr2=0x7ffb80157430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:39.380 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:39.362+0000 7ffb7f7fe640 1 --2- 172.21.15.102:0/1833016307 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ffb8015d600 0x7ffb80157430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:39.381 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:39.362+0000 7ffb7f7fe640 1 -- 172.21.15.102:0/1833016307 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb74009420 con 0x7ffb800b3f60 2023-11-13T11:29:39.381 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:39.362+0000 7ffb7f7fe640 1 --2- 172.21.15.102:0/1833016307 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ffb800b3f60 0x7ffb80153f40 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7ffb7000c3c0 tx=0x7ffb7000c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-13T11:29:39.381 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:39.362+0000 7ffb67fff640 1 -- 172.21.15.102:0/1833016307 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb700052d0 con 0x7ffb800b3f60 2023-11-13T11:29:39.381 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:39.362+0000 7ffb67fff640 1 -- 172.21.15.102:0/1833016307 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb70005430 con 0x7ffb800b3f60 2023-11-13T11:29:39.381 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:39.362+0000 7ffb67fff640 1 -- 172.21.15.102:0/1833016307 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb70003840 con 0x7ffb800b3f60 2023-11-13T11:29:39.382 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:39.362+0000 7ffb85d2a640 1 -- 172.21.15.102:0/1833016307 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffb78009b30 con 0x7ffb800b3f60 2023-11-13T11:29:39.382 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:39.362+0000 7ffb85d2a640 1 -- 172.21.15.102:0/1833016307 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffb8015fa10 con 0x7ffb800b3f60 2023-11-13T11:29:39.382 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:39.366+0000 7ffb85d2a640 1 -- 172.21.15.102:0/1833016307 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffb80068520 con 0x7ffb800b3f60 2023-11-13T11:29:39.382 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:39.366+0000 7ffb67fff640 1 -- 172.21.15.102:0/1833016307 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7ffb700039a0 con 0x7ffb800b3f60 2023-11-13T11:29:39.384 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:39.366+0000 7ffb67fff640 1 --2- 172.21.15.102:0/1833016307 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7ffb6c066470 0x7ffb6c068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:39.385 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:39.366+0000 7ffb67fff640 1 -- 172.21.15.102:0/1833016307 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 5738+0+0 (secure 0 0 0) 0x7ffb70083340 con 0x7ffb800b3f60 2023-11-13T11:29:39.385 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:39.366+0000 7ffb7effd640 1 --2- 172.21.15.102:0/1833016307 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7ffb6c066470 0x7ffb6c068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:39.385 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:39.366+0000 7ffb7effd640 1 --2- 172.21.15.102:0/1833016307 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7ffb6c066470 0x7ffb6c068930 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7ffb80071940 tx=0x7ffb74009190 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-13T11:29:39.385 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:39.370+0000 7ffb67fff640 1 -- 172.21.15.102:0/1833016307 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7ffb70050850 con 0x7ffb800b3f60 2023-11-13T11:29:39.527 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:39.522+0000 7ffb85d2a640 1 -- 172.21.15.102:0/1833016307 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7ffb80156110 con 0x7ffb800b3f60 2023-11-13T11:29:39.528 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:39.522+0000 7ffb67fff640 1 -- 172.21.15.102:0/1833016307 <== mon.0 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v24) v1 ==== 93+0+10 (secure 0 0 0) 0x7ffb70053e70 con 0x7ffb800b3f60 2023-11-13T11:29:39.529 INFO:teuthology.orchestra.run.smithi102.stdout:pg_num: 1 2023-11-13T11:29:39.530 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:39.522+0000 7ffb85d2a640 1 -- 172.21.15.102:0/1833016307 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7ffb6c066470 msgr2=0x7ffb6c068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:39.530 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:39.522+0000 7ffb85d2a640 1 --2- 172.21.15.102:0/1833016307 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7ffb6c066470 0x7ffb6c068930 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7ffb80071940 tx=0x7ffb74009190 comp rx=0 tx=0).stop 2023-11-13T11:29:39.530 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:39.522+0000 7ffb85d2a640 1 -- 172.21.15.102:0/1833016307 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ffb800b3f60 msgr2=0x7ffb80153f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:39.530 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:39.522+0000 7ffb85d2a640 1 --2- 172.21.15.102:0/1833016307 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ffb800b3f60 0x7ffb80153f40 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7ffb7000c3c0 tx=0x7ffb7000c880 comp rx=0 tx=0).stop 2023-11-13T11:29:39.531 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:39.522+0000 7ffb85d2a640 1 -- 172.21.15.102:0/1833016307 shutdown_connections 2023-11-13T11:29:39.531 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:39.522+0000 7ffb85d2a640 1 --2- 172.21.15.102:0/1833016307 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ffb8015d600 0x7ffb80157430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:39.531 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:39.522+0000 7ffb85d2a640 1 --2- 172.21.15.102:0/1833016307 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ffb8015d220 0x7ffb80160210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:39.531 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:39.522+0000 7ffb85d2a640 1 --2- 172.21.15.102:0/1833016307 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7ffb6c066470 0x7ffb6c068930 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:39.531 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:39.522+0000 7ffb85d2a640 1 --2- 172.21.15.102:0/1833016307 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ffb800b3f60 0x7ffb80153f40 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:39.532 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:39.522+0000 7ffb85d2a640 1 -- 172.21.15.102:0/1833016307 >> 172.21.15.102:0/1833016307 conn(0x7ffb800d2df0 msgr2=0x7ffb8015c4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-13T11:29:39.532 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:39.522+0000 7ffb85d2a640 1 -- 172.21.15.102:0/1833016307 shutdown_connections 2023-11-13T11:29:39.532 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:39.522+0000 7ffb85d2a640 1 -- 172.21.15.102:0/1833016307 wait complete. 2023-11-13T11:29:39.548 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-13T11:29:39.689 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:39.682+0000 7f8856c32640 1 Processor -- start 2023-11-13T11:29:39.690 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:39.682+0000 7f8856c32640 1 -- start start 2023-11-13T11:29:39.691 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:39.682+0000 7f8856c32640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f88500cf2d0 0x7f885015b3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:39.691 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:39.682+0000 7f8856c32640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f885006c800 0x7f885015b8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:39.691 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:39.682+0000 7f8856c32640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f885015c150 con 0x7f88501553c0 2023-11-13T11:29:39.691 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:39.682+0000 7f8856c32640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f885006c3e0 con 0x7f885006c800 2023-11-13T11:29:39.691 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:39.682+0000 7f8856c32640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f885006bd20 con 0x7f88500cf2d0 2023-11-13T11:29:39.692 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:39.686+0000 7f88549ce640 1 --1- >> v1:172.21.15.102:6789/0 conn(0x7f88501553c0 0x7f88500cebc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.102:6789/0 says I am v1:172.21.15.102:45886/0 (socket says 172.21.15.102:45886) 2023-11-13T11:29:39.692 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:39.686+0000 7f88549ce640 1 -- 172.21.15.102:0/74928352 learned_addr learned my addr 172.21.15.102:0/74928352 (peer_addr_for_me v1:172.21.15.102:0/0) 2023-11-13T11:29:39.692 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:39.686+0000 7f88551cf640 1 --2- 172.21.15.102:0/74928352 >> v2:172.21.15.102:3300/0 conn(0x7f885006c800 0x7f885015b8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:39.693 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:39.686+0000 7f8847fff640 1 --2- 172.21.15.102:0/74928352 >> v2:172.21.15.154:3300/0 conn(0x7f88500cf2d0 0x7f885015b3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:39.693 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:39.686+0000 7f88477fe640 1 -- 172.21.15.102:0/74928352 <== mon.0 v1:172.21.15.102:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1548032226 0 0) 0x7f885015c150 con 0x7f88501553c0 2023-11-13T11:29:39.693 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:39.686+0000 7f88477fe640 1 -- 172.21.15.102:0/74928352 --> v1:172.21.15.102:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8838003530 con 0x7f88501553c0 2023-11-13T11:29:39.694 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:39.686+0000 7f88551cf640 1 -- 172.21.15.102:0/74928352 >> v2:172.21.15.154:3300/0 conn(0x7f88500cf2d0 msgr2=0x7f885015b3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-13T11:29:39.694 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:39.686+0000 7f88551cf640 1 --2- 172.21.15.102:0/74928352 >> v2:172.21.15.154:3300/0 conn(0x7f88500cf2d0 0x7f885015b3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:39.694 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:39.686+0000 7f88551cf640 1 -- 172.21.15.102:0/74928352 >> v1:172.21.15.102:6789/0 conn(0x7f88501553c0 legacy=0x7f88500cebc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:39.694 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:39.686+0000 7f88551cf640 1 -- 172.21.15.102:0/74928352 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f885006c000 con 0x7f885006c800 2023-11-13T11:29:39.695 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:39.686+0000 7f88551cf640 1 --2- 172.21.15.102:0/74928352 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f885006c800 0x7f885015b8f0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f88500cfa40 tx=0x7f884801c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ff5158f66e0db2c8 server_cookie=0 in_seq=0 out_seq=0 2023-11-13T11:29:39.696 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:39.686+0000 7f88477fe640 1 -- 172.21.15.102:0/74928352 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88480a58a0 con 0x7f885006c800 2023-11-13T11:29:39.696 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:39.686+0000 7f88477fe640 1 -- 172.21.15.102:0/74928352 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f88480a5a00 con 0x7f885006c800 2023-11-13T11:29:39.696 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:39.686+0000 7f88477fe640 1 -- 172.21.15.102:0/74928352 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88480a5d90 con 0x7f885006c800 2023-11-13T11:29:39.696 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:39.690+0000 7f8856c32640 1 -- 172.21.15.102:0/74928352 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f885006c800 msgr2=0x7f885015b8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:39.696 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:39.690+0000 7f8856c32640 1 --2- 172.21.15.102:0/74928352 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f885006c800 0x7f885015b8f0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f88500cfa40 tx=0x7f884801c880 comp rx=0 tx=0).stop 2023-11-13T11:29:39.697 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:39.690+0000 7f8856c32640 1 -- 172.21.15.102:0/74928352 shutdown_connections 2023-11-13T11:29:39.697 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:39.690+0000 7f8856c32640 1 --2- 172.21.15.102:0/74928352 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f885006c800 0x7f885015b8f0 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:39.697 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:39.690+0000 7f8856c32640 1 --2- 172.21.15.102:0/74928352 >> v2:172.21.15.154:3300/0 conn(0x7f88500cf2d0 0x7f885015b3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:39.697 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:39.690+0000 7f8856c32640 1 -- 172.21.15.102:0/74928352 >> 172.21.15.102:0/74928352 conn(0x7f885006a410 msgr2=0x7f885006a820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-13T11:29:39.697 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:39.690+0000 7f8856c32640 1 -- 172.21.15.102:0/74928352 shutdown_connections 2023-11-13T11:29:39.698 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:39.690+0000 7f8856c32640 1 -- 172.21.15.102:0/74928352 wait complete. 2023-11-13T11:29:39.701 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:39.690+0000 7f8856c32640 1 Processor -- start 2023-11-13T11:29:39.702 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:39.690+0000 7f8856c32640 1 -- start start 2023-11-13T11:29:39.702 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:39.690+0000 7f8856c32640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f885006c800 0x7f88500ae7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:39.703 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:39.690+0000 7f8856c32640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f88500cf2d0 0x7f88500aed10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:39.703 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:39.690+0000 7f8856c32640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f88501553c0 0x7f88500b2950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:39.703 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:39.690+0000 7f8856c32640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88500b24c0 con 0x7f885006c800 2023-11-13T11:29:39.703 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:39.690+0000 7f8856c32640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88500b18b0 con 0x7f88500cf2d0 2023-11-13T11:29:39.704 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:39.690+0000 7f8856c32640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88500b1b90 con 0x7f88501553c0 2023-11-13T11:29:39.705 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:39.690+0000 7f88549ce640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f885006c800 0x7f88500ae7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:39.706 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:39.690+0000 7f88549ce640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f885006c800 0x7f88500ae7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:45322/0 (socket says 172.21.15.102:45322) 2023-11-13T11:29:39.706 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:39.690+0000 7f88549ce640 1 -- 172.21.15.102:0/2219106763 learned_addr learned my addr 172.21.15.102:0/2219106763 (peer_addr_for_me v2:172.21.15.102:0/0) 2023-11-13T11:29:39.706 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:39.690+0000 7f8847fff640 1 --2- 172.21.15.102:0/2219106763 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f88500cf2d0 0x7f88500aed10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:39.706 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:39.690+0000 7f88551cf640 1 --2- 172.21.15.102:0/2219106763 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f88501553c0 0x7f88500b2950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:39.706 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:39.694+0000 7f88549ce640 1 -- 172.21.15.102:0/2219106763 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f88501553c0 msgr2=0x7f88500b2950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:39.707 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:39.694+0000 7f88549ce640 1 --2- 172.21.15.102:0/2219106763 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f88501553c0 0x7f88500b2950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:39.707 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:39.694+0000 7f88549ce640 1 -- 172.21.15.102:0/2219106763 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f88500cf2d0 msgr2=0x7f88500aed10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:39.707 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:39.694+0000 7f88549ce640 1 --2- 172.21.15.102:0/2219106763 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f88500cf2d0 0x7f88500aed10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:39.707 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:39.694+0000 7f88549ce640 1 -- 172.21.15.102:0/2219106763 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8848009a70 con 0x7f885006c800 2023-11-13T11:29:39.708 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:39.694+0000 7f88549ce640 1 --2- 172.21.15.102:0/2219106763 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f885006c800 0x7f88500ae7d0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f884c00c4d0 tx=0x7f884c00c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-13T11:29:39.708 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:39.694+0000 7f88457fa640 1 -- 172.21.15.102:0/2219106763 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f884c005cf0 con 0x7f885006c800 2023-11-13T11:29:39.708 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:39.694+0000 7f88457fa640 1 -- 172.21.15.102:0/2219106763 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f884c005e50 con 0x7f885006c800 2023-11-13T11:29:39.708 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:39.694+0000 7f8856c32640 1 -- 172.21.15.102:0/2219106763 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f88500b1e70 con 0x7f885006c800 2023-11-13T11:29:39.708 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:39.694+0000 7f88457fa640 1 -- 172.21.15.102:0/2219106763 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f884c007270 con 0x7f885006c800 2023-11-13T11:29:39.709 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:39.694+0000 7f8856c32640 1 -- 172.21.15.102:0/2219106763 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f885014c950 con 0x7f885006c800 2023-11-13T11:29:39.709 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:39.694+0000 7f8856c32640 1 -- 172.21.15.102:0/2219106763 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8850067640 con 0x7f885006c800 2023-11-13T11:29:39.709 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:39.694+0000 7f88457fa640 1 -- 172.21.15.102:0/2219106763 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f884c0073d0 con 0x7f885006c800 2023-11-13T11:29:39.710 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:39.694+0000 7f88457fa640 1 --2- 172.21.15.102:0/2219106763 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f883c066470 0x7f883c068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:39.710 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:39.694+0000 7f88457fa640 1 -- 172.21.15.102:0/2219106763 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 5738+0+0 (secure 0 0 0) 0x7f884c083370 con 0x7f885006c800 2023-11-13T11:29:39.710 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:39.694+0000 7f8847fff640 1 --2- 172.21.15.102:0/2219106763 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f883c066470 0x7f883c068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:39.711 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:39.698+0000 7f8847fff640 1 --2- 172.21.15.102:0/2219106763 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f883c066470 0x7f883c068930 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f885014c2b0 tx=0x7f8840008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-13T11:29:39.711 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:39.698+0000 7f88457fa640 1 -- 172.21.15.102:0/2219106763 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f884c050870 con 0x7f885006c800 2023-11-13T11:29:39.860 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:39.854+0000 7f8856c32640 1 -- 172.21.15.102:0/2219106763 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f8850068520 con 0x7f885006c800 2023-11-13T11:29:39.861 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:39.854+0000 7f88457fa640 1 -- 172.21.15.102:0/2219106763 <== mon.0 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v24) v1 ==== 104+0+11 (secure 0 0 0) 0x7f884c053e90 con 0x7f885006c800 2023-11-13T11:29:39.862 INFO:teuthology.orchestra.run.smithi102.stdout:pg_num: 32 2023-11-13T11:29:39.863 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:39.858+0000 7f8856c32640 1 -- 172.21.15.102:0/2219106763 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f883c066470 msgr2=0x7f883c068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:39.863 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:39.858+0000 7f8856c32640 1 --2- 172.21.15.102:0/2219106763 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f883c066470 0x7f883c068930 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f885014c2b0 tx=0x7f8840008040 comp rx=0 tx=0).stop 2023-11-13T11:29:39.863 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:39.858+0000 7f8856c32640 1 -- 172.21.15.102:0/2219106763 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f885006c800 msgr2=0x7f88500ae7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:39.864 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:39.858+0000 7f8856c32640 1 --2- 172.21.15.102:0/2219106763 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f885006c800 0x7f88500ae7d0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f884c00c4d0 tx=0x7f884c00c990 comp rx=0 tx=0).stop 2023-11-13T11:29:39.864 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:39.858+0000 7f8856c32640 1 -- 172.21.15.102:0/2219106763 shutdown_connections 2023-11-13T11:29:39.864 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:39.858+0000 7f8856c32640 1 --2- 172.21.15.102:0/2219106763 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f88501553c0 0x7f88500b2950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:39.864 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:39.858+0000 7f8856c32640 1 --2- 172.21.15.102:0/2219106763 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f88500cf2d0 0x7f88500aed10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:39.865 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:39.858+0000 7f8856c32640 1 --2- 172.21.15.102:0/2219106763 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f883c066470 0x7f883c068930 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:39.865 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:39.858+0000 7f8856c32640 1 --2- 172.21.15.102:0/2219106763 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f885006c800 0x7f88500ae7d0 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:39.865 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:39.858+0000 7f8856c32640 1 -- 172.21.15.102:0/2219106763 >> 172.21.15.102:0/2219106763 conn(0x7f885006a410 msgr2=0x7f885014f600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-13T11:29:39.865 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:39.858+0000 7f8856c32640 1 -- 172.21.15.102:0/2219106763 shutdown_connections 2023-11-13T11:29:39.866 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:39.858+0000 7f8856c32640 1 -- 172.21.15.102:0/2219106763 wait complete. 2023-11-13T11:29:39.883 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-13T11:29:40.028 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:40.022+0000 7f268145a640 1 Processor -- start 2023-11-13T11:29:40.028 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:40.022+0000 7f268145a640 1 -- start start 2023-11-13T11:29:40.030 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:40.022+0000 7f268145a640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f267c0d03b0 0x7f267c0ceea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:40.030 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:40.022+0000 7f268145a640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f267c0cf3e0 0x7f267c06e4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:40.030 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:40.022+0000 7f268145a640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f267c0cff20 con 0x7f267c15d2c0 2023-11-13T11:29:40.030 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:40.022+0000 7f268145a640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f267c06fc50 con 0x7f267c0d03b0 2023-11-13T11:29:40.030 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:40.022+0000 7f268145a640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f267c06f970 con 0x7f267c0cf3e0 2023-11-13T11:29:40.031 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:40.022+0000 7f26727fc640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f267c0d03b0 0x7f267c0ceea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:40.031 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:40.022+0000 7f26727fc640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f267c0d03b0 0x7f267c0ceea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:45336/0 (socket says 172.21.15.102:45336) 2023-11-13T11:29:40.031 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:40.022+0000 7f26727fc640 1 -- 172.21.15.102:0/2174193260 learned_addr learned my addr 172.21.15.102:0/2174193260 (peer_addr_for_me v2:172.21.15.102:0/0) 2023-11-13T11:29:40.031 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:40.022+0000 7f267b7fe640 1 --2- 172.21.15.102:0/2174193260 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f267c0cf3e0 0x7f267c06e4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:40.031 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:40.022+0000 7f26727fc640 1 -- 172.21.15.102:0/2174193260 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f267c0cf3e0 msgr2=0x7f267c06e4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-13T11:29:40.032 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:40.022+0000 7f26727fc640 1 --2- 172.21.15.102:0/2174193260 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f267c0cf3e0 0x7f267c06e4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:40.032 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:40.022+0000 7f26727fc640 1 -- 172.21.15.102:0/2174193260 >> v1:172.21.15.154:6789/0 conn(0x7f267c15d2c0 legacy=0x7f267c0ce790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:40.032 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:40.022+0000 7f26727fc640 1 -- 172.21.15.102:0/2174193260 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f267c0cf8d0 con 0x7f267c0d03b0 2023-11-13T11:29:40.034 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:40.026+0000 7f26727fc640 1 --2- 172.21.15.102:0/2174193260 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f267c0d03b0 0x7f267c0ceea0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f2664009e50 tx=0x7f266401ca10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ab3fea62356ca32d server_cookie=0 in_seq=0 out_seq=0 2023-11-13T11:29:40.034 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:40.026+0000 7f267a7fc640 1 -- 172.21.15.102:0/2174193260 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26640a57f0 con 0x7f267c0d03b0 2023-11-13T11:29:40.034 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:40.026+0000 7f267a7fc640 1 -- 172.21.15.102:0/2174193260 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f26640a5950 con 0x7f267c0d03b0 2023-11-13T11:29:40.034 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:40.026+0000 7f267a7fc640 1 -- 172.21.15.102:0/2174193260 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26640a5ce0 con 0x7f267c0d03b0 2023-11-13T11:29:40.035 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:40.026+0000 7f268145a640 1 -- 172.21.15.102:0/2174193260 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f267c0d03b0 msgr2=0x7f267c0ceea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:40.035 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:40.026+0000 7f268145a640 1 --2- 172.21.15.102:0/2174193260 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f267c0d03b0 0x7f267c0ceea0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f2664009e50 tx=0x7f266401ca10 comp rx=0 tx=0).stop 2023-11-13T11:29:40.035 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:40.026+0000 7f268145a640 1 -- 172.21.15.102:0/2174193260 shutdown_connections 2023-11-13T11:29:40.035 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:40.026+0000 7f268145a640 1 --2- 172.21.15.102:0/2174193260 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f267c0cf3e0 0x7f267c06e4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:40.035 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:40.026+0000 7f268145a640 1 --2- 172.21.15.102:0/2174193260 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f267c0d03b0 0x7f267c0ceea0 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:40.036 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:40.026+0000 7f268145a640 1 -- 172.21.15.102:0/2174193260 >> 172.21.15.102:0/2174193260 conn(0x7f267c0b27d0 msgr2=0x7f267c0b2bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-13T11:29:40.036 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:40.026+0000 7f268145a640 1 -- 172.21.15.102:0/2174193260 shutdown_connections 2023-11-13T11:29:40.036 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:40.026+0000 7f268145a640 1 -- 172.21.15.102:0/2174193260 wait complete. 2023-11-13T11:29:40.039 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:40.030+0000 7f268145a640 1 Processor -- start 2023-11-13T11:29:40.039 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:40.030+0000 7f268145a640 1 -- start start 2023-11-13T11:29:40.039 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:40.030+0000 7f268145a640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f267c0cf3e0 0x7f267c1600e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:40.039 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:40.030+0000 7f268145a640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f267c0d03b0 0x7f267c15ed10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:40.040 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:40.030+0000 7f268145a640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f267c15d2c0 0x7f267c152660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:40.040 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:40.030+0000 7f268145a640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f267c0b38c0 con 0x7f267c0cf3e0 2023-11-13T11:29:40.040 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:40.030+0000 7f268145a640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f267c0b6580 con 0x7f267c15d2c0 2023-11-13T11:29:40.040 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:40.030+0000 7f268145a640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f267c15f4f0 con 0x7f267c0d03b0 2023-11-13T11:29:40.040 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:40.030+0000 7f267affd640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f267c0cf3e0 0x7f267c1600e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:40.040 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:40.030+0000 7f267affd640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f267c0cf3e0 0x7f267c1600e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:45344/0 (socket says 172.21.15.102:45344) 2023-11-13T11:29:40.041 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:40.030+0000 7f267affd640 1 -- 172.21.15.102:0/3156272006 learned_addr learned my addr 172.21.15.102:0/3156272006 (peer_addr_for_me v2:172.21.15.102:0/0) 2023-11-13T11:29:40.041 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:40.030+0000 7f267b7fe640 1 --2- 172.21.15.102:0/3156272006 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f267c15d2c0 0x7f267c152660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:40.041 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:40.030+0000 7f26727fc640 1 --2- 172.21.15.102:0/3156272006 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f267c0d03b0 0x7f267c15ed10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:40.041 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:40.030+0000 7f267affd640 1 -- 172.21.15.102:0/3156272006 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f267c0d03b0 msgr2=0x7f267c15ed10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:40.041 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:40.030+0000 7f267affd640 1 --2- 172.21.15.102:0/3156272006 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f267c0d03b0 0x7f267c15ed10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:40.042 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:40.030+0000 7f267affd640 1 -- 172.21.15.102:0/3156272006 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f267c15d2c0 msgr2=0x7f267c152660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:40.042 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:40.030+0000 7f267affd640 1 --2- 172.21.15.102:0/3156272006 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f267c15d2c0 0x7f267c152660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:40.042 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:40.030+0000 7f267affd640 1 -- 172.21.15.102:0/3156272006 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2664009b30 con 0x7f267c0cf3e0 2023-11-13T11:29:40.042 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:40.030+0000 7f267affd640 1 --2- 172.21.15.102:0/3156272006 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f267c0cf3e0 0x7f267c1600e0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f266c00c500 tx=0x7f266c00c900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-13T11:29:40.042 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:40.030+0000 7f2673fff640 1 -- 172.21.15.102:0/3156272006 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f266c0052d0 con 0x7f267c0cf3e0 2023-11-13T11:29:40.043 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:40.030+0000 7f2673fff640 1 -- 172.21.15.102:0/3156272006 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f266c005430 con 0x7f267c0cf3e0 2023-11-13T11:29:40.043 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:40.030+0000 7f2673fff640 1 -- 172.21.15.102:0/3156272006 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f266c003840 con 0x7f267c0cf3e0 2023-11-13T11:29:40.043 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:40.030+0000 7f268145a640 1 -- 172.21.15.102:0/3156272006 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f267c15d7d0 con 0x7f267c0cf3e0 2023-11-13T11:29:40.043 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:40.030+0000 7f268145a640 1 -- 172.21.15.102:0/3156272006 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f267c15f2a0 con 0x7f267c0cf3e0 2023-11-13T11:29:40.043 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:40.030+0000 7f268145a640 1 -- 172.21.15.102:0/3156272006 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f267c068520 con 0x7f267c0cf3e0 2023-11-13T11:29:40.044 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:40.034+0000 7f2673fff640 1 -- 172.21.15.102:0/3156272006 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f266c0039a0 con 0x7f267c0cf3e0 2023-11-13T11:29:40.045 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:40.034+0000 7f2673fff640 1 --2- 172.21.15.102:0/3156272006 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f265c066470 0x7f265c068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:40.045 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:40.034+0000 7f2673fff640 1 -- 172.21.15.102:0/3156272006 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 5738+0+0 (secure 0 0 0) 0x7f266c083350 con 0x7f267c0cf3e0 2023-11-13T11:29:40.045 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:40.034+0000 7f26727fc640 1 --2- 172.21.15.102:0/3156272006 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f265c066470 0x7f265c068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:40.045 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:40.034+0000 7f26727fc640 1 --2- 172.21.15.102:0/3156272006 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f265c066470 0x7f265c068930 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f26640ae000 tx=0x7f26640a7070 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-13T11:29:40.045 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:40.038+0000 7f2673fff640 1 -- 172.21.15.102:0/3156272006 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f266c050850 con 0x7f267c0cf3e0 2023-11-13T11:29:40.194 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:40.186+0000 7f268145a640 1 -- 172.21.15.102:0/3156272006 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f267c0b2590 con 0x7f267c0cf3e0 2023-11-13T11:29:40.195 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:40.190+0000 7f2673fff640 1 -- 172.21.15.102:0/3156272006 <== mon.0 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v24) v1 ==== 100+0+11 (secure 0 0 0) 0x7f266c053e70 con 0x7f267c0cf3e0 2023-11-13T11:29:40.195 INFO:teuthology.orchestra.run.smithi102.stdout:pg_num: 64 2023-11-13T11:29:40.197 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:40.190+0000 7f268145a640 1 -- 172.21.15.102:0/3156272006 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f265c066470 msgr2=0x7f265c068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:40.197 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:40.190+0000 7f268145a640 1 --2- 172.21.15.102:0/3156272006 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f265c066470 0x7f265c068930 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f26640ae000 tx=0x7f26640a7070 comp rx=0 tx=0).stop 2023-11-13T11:29:40.198 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:40.190+0000 7f268145a640 1 -- 172.21.15.102:0/3156272006 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f267c0cf3e0 msgr2=0x7f267c1600e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:40.198 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:40.190+0000 7f268145a640 1 --2- 172.21.15.102:0/3156272006 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f267c0cf3e0 0x7f267c1600e0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f266c00c500 tx=0x7f266c00c900 comp rx=0 tx=0).stop 2023-11-13T11:29:40.198 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:40.190+0000 7f268145a640 1 -- 172.21.15.102:0/3156272006 shutdown_connections 2023-11-13T11:29:40.198 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:40.190+0000 7f268145a640 1 --2- 172.21.15.102:0/3156272006 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f267c15d2c0 0x7f267c152660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:40.199 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:40.190+0000 7f268145a640 1 --2- 172.21.15.102:0/3156272006 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f267c0d03b0 0x7f267c15ed10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:40.199 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:40.190+0000 7f268145a640 1 --2- 172.21.15.102:0/3156272006 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f265c066470 0x7f265c068930 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:40.199 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:40.190+0000 7f268145a640 1 --2- 172.21.15.102:0/3156272006 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f267c0cf3e0 0x7f267c1600e0 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:40.200 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:40.190+0000 7f268145a640 1 -- 172.21.15.102:0/3156272006 >> 172.21.15.102:0/3156272006 conn(0x7f267c0b27d0 msgr2=0x7f267c0afac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-13T11:29:40.200 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:40.190+0000 7f268145a640 1 -- 172.21.15.102:0/3156272006 shutdown_connections 2023-11-13T11:29:40.200 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:40.190+0000 7f268145a640 1 -- 172.21.15.102:0/3156272006 wait complete. 2023-11-13T11:29:40.216 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-11-13T11:29:40.356 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:40.350+0000 7faa99348640 1 Processor -- start 2023-11-13T11:29:40.356 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:40.350+0000 7faa99348640 1 -- start start 2023-11-13T11:29:40.358 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:40.350+0000 7faa99348640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7faa94157310 0x7faa9406a240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:40.358 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:40.350+0000 7faa99348640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7faa9406a780 0x7faa940ae8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:40.358 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:40.350+0000 7faa99348640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faa941576f0 con 0x7faa9415ded0 2023-11-13T11:29:40.359 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:40.350+0000 7faa99348640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faa9406af00 con 0x7faa94157310 2023-11-13T11:29:40.359 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:40.350+0000 7faa99348640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faa9415da40 con 0x7faa9406a780 2023-11-13T11:29:40.359 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:40.350+0000 7faa93fff640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7faa94157310 0x7faa9406a240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:40.359 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:40.350+0000 7faa93fff640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7faa94157310 0x7faa9406a240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:45350/0 (socket says 172.21.15.102:45350) 2023-11-13T11:29:40.359 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:40.350+0000 7faa93fff640 1 -- 172.21.15.102:0/3945652530 learned_addr learned my addr 172.21.15.102:0/3945652530 (peer_addr_for_me v2:172.21.15.102:0/0) 2023-11-13T11:29:40.360 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:40.350+0000 7faa98b47640 1 --1- >> v1:172.21.15.102:6789/0 conn(0x7faa9415ded0 0x7faa94160840 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.102:6789/0 says I am v1:172.21.15.102:45902/0 (socket says 172.21.15.102:45902) 2023-11-13T11:29:40.360 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:40.350+0000 7faa937fe640 1 --2- 172.21.15.102:0/3945652530 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7faa9406a780 0x7faa940ae8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:40.360 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:40.350+0000 7faa93fff640 1 -- 172.21.15.102:0/3945652530 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7faa9406a780 msgr2=0x7faa940ae8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-13T11:29:40.360 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:40.350+0000 7faa93fff640 1 --2- 172.21.15.102:0/3945652530 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7faa9406a780 0x7faa940ae8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:40.361 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:40.350+0000 7faa93fff640 1 -- 172.21.15.102:0/3945652530 >> v1:172.21.15.102:6789/0 conn(0x7faa9415ded0 legacy=0x7faa94160840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:40.361 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:40.350+0000 7faa93fff640 1 -- 172.21.15.102:0/3945652530 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa9406ac20 con 0x7faa94157310 2023-11-13T11:29:40.362 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:40.354+0000 7faa93fff640 1 --2- 172.21.15.102:0/3945652530 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7faa94157310 0x7faa9406a240 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7faa84009870 tx=0x7faa8401c540 comp rx=0 tx=0).ready entity=mon.0 client_cookie=15ca8772efdb583f server_cookie=0 in_seq=0 out_seq=0 2023-11-13T11:29:40.362 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:40.354+0000 7faa92ffd640 1 -- 172.21.15.102:0/3945652530 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa840ab600 con 0x7faa94157310 2023-11-13T11:29:40.363 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:40.354+0000 7faa92ffd640 1 -- 172.21.15.102:0/3945652530 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa840a7050 con 0x7faa94157310 2023-11-13T11:29:40.363 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:40.354+0000 7faa92ffd640 1 -- 172.21.15.102:0/3945652530 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa840ab980 con 0x7faa94157310 2023-11-13T11:29:40.363 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:40.354+0000 7faa99348640 1 -- 172.21.15.102:0/3945652530 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7faa94157310 msgr2=0x7faa9406a240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:40.363 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:40.354+0000 7faa99348640 1 --2- 172.21.15.102:0/3945652530 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7faa94157310 0x7faa9406a240 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7faa84009870 tx=0x7faa8401c540 comp rx=0 tx=0).stop 2023-11-13T11:29:40.363 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:40.354+0000 7faa99348640 1 -- 172.21.15.102:0/3945652530 shutdown_connections 2023-11-13T11:29:40.364 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:40.354+0000 7faa99348640 1 --2- 172.21.15.102:0/3945652530 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7faa9406a780 0x7faa940ae8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:40.364 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:40.354+0000 7faa99348640 1 --2- 172.21.15.102:0/3945652530 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7faa94157310 0x7faa9406a240 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:40.364 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:40.354+0000 7faa99348640 1 -- 172.21.15.102:0/3945652530 >> 172.21.15.102:0/3945652530 conn(0x7faa940b16a0 msgr2=0x7faa940b1ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-13T11:29:40.364 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:40.354+0000 7faa99348640 1 -- 172.21.15.102:0/3945652530 shutdown_connections 2023-11-13T11:29:40.364 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:40.354+0000 7faa99348640 1 -- 172.21.15.102:0/3945652530 wait complete. 2023-11-13T11:29:40.366 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:40.358+0000 7faa99348640 1 Processor -- start 2023-11-13T11:29:40.367 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:40.358+0000 7faa99348640 1 -- start start 2023-11-13T11:29:40.367 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:40.358+0000 7faa99348640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7faa9406a780 0x7faa941462c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:40.367 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:40.358+0000 7faa99348640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7faa94157310 0x7faa9414d760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:40.367 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:40.358+0000 7faa99348640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7faa9415ded0 0x7faa94155ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:40.368 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:40.358+0000 7faa99348640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa940cd1c0 con 0x7faa9406a780 2023-11-13T11:29:40.368 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:40.358+0000 7faa99348640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa940cd4a0 con 0x7faa94157310 2023-11-13T11:29:40.368 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:40.358+0000 7faa99348640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faa940cd780 con 0x7faa9415ded0 2023-11-13T11:29:40.368 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:40.358+0000 7faa93fff640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7faa9406a780 0x7faa941462c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:40.368 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:40.358+0000 7faa93fff640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7faa9406a780 0x7faa941462c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:45366/0 (socket says 172.21.15.102:45366) 2023-11-13T11:29:40.368 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:40.358+0000 7faa93fff640 1 -- 172.21.15.102:0/2004637429 learned_addr learned my addr 172.21.15.102:0/2004637429 (peer_addr_for_me v2:172.21.15.102:0/0) 2023-11-13T11:29:40.369 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:40.358+0000 7faa937fe640 1 --2- 172.21.15.102:0/2004637429 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7faa94157310 0x7faa9414d760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:40.369 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:40.358+0000 7faa98b47640 1 --2- 172.21.15.102:0/2004637429 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7faa9415ded0 0x7faa94155ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:40.369 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:40.358+0000 7faa93fff640 1 -- 172.21.15.102:0/2004637429 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7faa9415ded0 msgr2=0x7faa94155ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:40.369 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:40.358+0000 7faa93fff640 1 --2- 172.21.15.102:0/2004637429 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7faa9415ded0 0x7faa94155ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:40.369 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:40.358+0000 7faa93fff640 1 -- 172.21.15.102:0/2004637429 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7faa94157310 msgr2=0x7faa9414d760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:40.370 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:40.358+0000 7faa93fff640 1 --2- 172.21.15.102:0/2004637429 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7faa94157310 0x7faa9414d760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:40.370 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:40.358+0000 7faa93fff640 1 -- 172.21.15.102:0/2004637429 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa840094d0 con 0x7faa9406a780 2023-11-13T11:29:40.370 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:40.358+0000 7faa937fe640 1 --2- 172.21.15.102:0/2004637429 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7faa94157310 0x7faa9414d760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-13T11:29:40.370 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:40.358+0000 7faa93fff640 1 --2- 172.21.15.102:0/2004637429 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7faa9406a780 0x7faa941462c0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7faa8401abf0 tx=0x7faa840192e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-13T11:29:40.370 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:40.358+0000 7faa90ff9640 1 -- 172.21.15.102:0/2004637429 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa840b6640 con 0x7faa9406a780 2023-11-13T11:29:40.371 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:40.358+0000 7faa90ff9640 1 -- 172.21.15.102:0/2004637429 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa840b67a0 con 0x7faa9406a780 2023-11-13T11:29:40.371 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:40.358+0000 7faa90ff9640 1 -- 172.21.15.102:0/2004637429 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa840b6b30 con 0x7faa9406a780 2023-11-13T11:29:40.371 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:40.358+0000 7faa99348640 1 -- 172.21.15.102:0/2004637429 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faa940cda60 con 0x7faa9406a780 2023-11-13T11:29:40.371 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:40.358+0000 7faa99348640 1 -- 172.21.15.102:0/2004637429 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faa940affb0 con 0x7faa9406a780 2023-11-13T11:29:40.372 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:40.362+0000 7faa99348640 1 -- 172.21.15.102:0/2004637429 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faa940cdc50 con 0x7faa9406a780 2023-11-13T11:29:40.372 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:40.362+0000 7faa90ff9640 1 -- 172.21.15.102:0/2004637429 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7faa840b2040 con 0x7faa9406a780 2023-11-13T11:29:40.373 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:40.362+0000 7faa90ff9640 1 --2- 172.21.15.102:0/2004637429 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7faa80066470 0x7faa80068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:40.373 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:40.362+0000 7faa90ff9640 1 -- 172.21.15.102:0/2004637429 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 5738+0+0 (secure 0 0 0) 0x7faa8411dec0 con 0x7faa9406a780 2023-11-13T11:29:40.373 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:40.362+0000 7faa937fe640 1 --2- 172.21.15.102:0/2004637429 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7faa80066470 0x7faa80068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:40.373 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:40.362+0000 7faa937fe640 1 --2- 172.21.15.102:0/2004637429 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7faa80066470 0x7faa80068930 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7faa94160d30 tx=0x7faa88008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-13T11:29:40.374 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:40.366+0000 7faa90ff9640 1 -- 172.21.15.102:0/2004637429 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7faa840eb310 con 0x7faa9406a780 2023-11-13T11:29:40.533 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:40.526+0000 7faa99348640 1 -- 172.21.15.102:0/2004637429 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7faa940cd300 con 0x7faa9406a780 2023-11-13T11:29:40.534 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:40.526+0000 7faa90ff9640 1 -- 172.21.15.102:0/2004637429 <== mon.0 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v24) v1 ==== 80+0+0 (secure 0 0 0) 0x7faa940cd300 con 0x7faa9406a780 2023-11-13T11:29:40.534 INFO:teuthology.orchestra.run.smithi102.stderr:listed 0 entries 2023-11-13T11:29:40.536 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:40.530+0000 7faa99348640 1 -- 172.21.15.102:0/2004637429 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7faa80066470 msgr2=0x7faa80068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:40.536 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:40.530+0000 7faa99348640 1 --2- 172.21.15.102:0/2004637429 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7faa80066470 0x7faa80068930 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7faa94160d30 tx=0x7faa88008040 comp rx=0 tx=0).stop 2023-11-13T11:29:40.536 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:40.530+0000 7faa99348640 1 -- 172.21.15.102:0/2004637429 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7faa9406a780 msgr2=0x7faa941462c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:40.536 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:40.530+0000 7faa99348640 1 --2- 172.21.15.102:0/2004637429 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7faa9406a780 0x7faa941462c0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7faa8401abf0 tx=0x7faa840192e0 comp rx=0 tx=0).stop 2023-11-13T11:29:40.537 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:40.530+0000 7faa99348640 1 -- 172.21.15.102:0/2004637429 shutdown_connections 2023-11-13T11:29:40.537 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:40.530+0000 7faa99348640 1 --2- 172.21.15.102:0/2004637429 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7faa9415ded0 0x7faa94155ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:40.537 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:40.530+0000 7faa99348640 1 --2- 172.21.15.102:0/2004637429 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7faa94157310 0x7faa9414d760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:40.537 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:40.530+0000 7faa99348640 1 --2- 172.21.15.102:0/2004637429 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7faa80066470 0x7faa80068930 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:40.537 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:40.530+0000 7faa99348640 1 --2- 172.21.15.102:0/2004637429 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7faa9406a780 0x7faa941462c0 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:40.538 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:40.530+0000 7faa99348640 1 -- 172.21.15.102:0/2004637429 >> 172.21.15.102:0/2004637429 conn(0x7faa940b16a0 msgr2=0x7faa9406e290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-13T11:29:40.538 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:40.530+0000 7faa99348640 1 -- 172.21.15.102:0/2004637429 shutdown_connections 2023-11-13T11:29:40.538 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:40.530+0000 7faa99348640 1 -- 172.21.15.102:0/2004637429 wait complete. 2023-11-13T11:29:40.555 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2023-11-13T11:29:40.556 DEBUG:teuthology.orchestra.run.smithi154:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-13T11:29:40.567 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-13T11:29:40.704 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:40.698+0000 7f9136ac9640 1 Processor -- start 2023-11-13T11:29:40.704 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:40.698+0000 7f9136ac9640 1 -- start start 2023-11-13T11:29:40.706 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:40.698+0000 7f9136ac9640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f91301606e0 0x7f91300c69b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:40.706 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:40.698+0000 7f9136ac9640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f91300d0c40 0x7f91300b3e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:40.706 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:40.698+0000 7f9136ac9640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f91300d1440 con 0x7f91300cf490 2023-11-13T11:29:40.706 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:40.698+0000 7f9136ac9640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f91300cdb10 con 0x7f91301606e0 2023-11-13T11:29:40.707 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:40.698+0000 7f9136ac9640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f91300d1690 con 0x7f91300d0c40 2023-11-13T11:29:40.707 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:40.698+0000 7f9134865640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f91301606e0 0x7f91300c69b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:40.707 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:40.698+0000 7f9134865640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f91301606e0 0x7f91300c69b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:45380/0 (socket says 172.21.15.102:45380) 2023-11-13T11:29:40.707 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:40.698+0000 7f9134865640 1 -- 172.21.15.102:0/3476899327 learned_addr learned my addr 172.21.15.102:0/3476899327 (peer_addr_for_me v2:172.21.15.102:0/0) 2023-11-13T11:29:40.707 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:40.698+0000 7f9135066640 1 --1- >> v1:172.21.15.102:6789/0 conn(0x7f91300cf490 0x7f91300cdfc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.102:6789/0 says I am v1:172.21.15.102:45914/0 (socket says 172.21.15.102:45914) 2023-11-13T11:29:40.708 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:40.698+0000 7f9134865640 1 -- 172.21.15.102:0/3476899327 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f91300d0c40 msgr2=0x7f91300b3e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-13T11:29:40.708 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:40.698+0000 7f9127fff640 1 --2- 172.21.15.102:0/3476899327 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f91300d0c40 0x7f91300b3e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:40.708 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:40.698+0000 7f9134865640 1 --2- 172.21.15.102:0/3476899327 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f91300d0c40 0x7f91300b3e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:40.708 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:40.698+0000 7f9134865640 1 -- 172.21.15.102:0/3476899327 >> v1:172.21.15.102:6789/0 conn(0x7f91300cf490 legacy=0x7f91300cdfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:40.709 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:40.698+0000 7f9134865640 1 -- 172.21.15.102:0/3476899327 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91300d1970 con 0x7f91301606e0 2023-11-13T11:29:40.709 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:40.698+0000 7f9127fff640 1 --2- 172.21.15.102:0/3476899327 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f91300d0c40 0x7f91300b3e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-13T11:29:40.709 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:40.698+0000 7f91277fe640 1 -- 172.21.15.102:0/3476899327 <== mon.0 v1:172.21.15.102:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 990505955 0 0) 0x7f91300d1440 con 0x7f91300cf490 2023-11-13T11:29:40.710 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:40.702+0000 7f9134865640 1 --2- 172.21.15.102:0/3476899327 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f91301606e0 0x7f91300c69b0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f912c009870 tx=0x7f912c01c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c353c6cad4f46ee1 server_cookie=0 in_seq=0 out_seq=0 2023-11-13T11:29:40.710 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:40.702+0000 7f91277fe640 1 -- 172.21.15.102:0/3476899327 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f912c0ad680 con 0x7f91301606e0 2023-11-13T11:29:40.711 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:40.702+0000 7f91277fe640 1 -- 172.21.15.102:0/3476899327 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f912c0ad7e0 con 0x7f91301606e0 2023-11-13T11:29:40.711 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:40.702+0000 7f91277fe640 1 -- 172.21.15.102:0/3476899327 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f912c0adb70 con 0x7f91301606e0 2023-11-13T11:29:40.711 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:40.702+0000 7f9136ac9640 1 -- 172.21.15.102:0/3476899327 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f91301606e0 msgr2=0x7f91300c69b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:40.711 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:40.702+0000 7f9136ac9640 1 --2- 172.21.15.102:0/3476899327 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f91301606e0 0x7f91300c69b0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f912c009870 tx=0x7f912c01c450 comp rx=0 tx=0).stop 2023-11-13T11:29:40.711 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:40.702+0000 7f9136ac9640 1 -- 172.21.15.102:0/3476899327 shutdown_connections 2023-11-13T11:29:40.712 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:40.702+0000 7f9136ac9640 1 --2- 172.21.15.102:0/3476899327 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f91300d0c40 0x7f91300b3e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:40.712 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:40.702+0000 7f9136ac9640 1 --2- 172.21.15.102:0/3476899327 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f91301606e0 0x7f91300c69b0 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:40.712 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:40.702+0000 7f9136ac9640 1 -- 172.21.15.102:0/3476899327 >> 172.21.15.102:0/3476899327 conn(0x7f913009c130 msgr2=0x7f91300d2e60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-13T11:29:40.712 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:40.702+0000 7f9136ac9640 1 -- 172.21.15.102:0/3476899327 shutdown_connections 2023-11-13T11:29:40.712 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:40.702+0000 7f9136ac9640 1 -- 172.21.15.102:0/3476899327 wait complete. 2023-11-13T11:29:40.714 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:40.706+0000 7f9136ac9640 1 Processor -- start 2023-11-13T11:29:40.715 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:40.706+0000 7f9136ac9640 1 -- start start 2023-11-13T11:29:40.715 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:40.706+0000 7f9136ac9640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f91300cf490 0x7f9130152ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:40.715 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:40.706+0000 7f9136ac9640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f91300d0c40 0x7f91300b0430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:40.715 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:40.706+0000 7f9136ac9640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f91301606e0 0x7f91300b12e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:40.715 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:40.706+0000 7f9136ac9640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91300b29f0 con 0x7f91300d0c40 2023-11-13T11:29:40.716 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:40.706+0000 7f9136ac9640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91301533e0 con 0x7f91301606e0 2023-11-13T11:29:40.716 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:40.706+0000 7f9136ac9640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f91300b0e80 con 0x7f91300cf490 2023-11-13T11:29:40.716 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:40.706+0000 7f9127fff640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f91300d0c40 0x7f91300b0430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:40.716 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:40.706+0000 7f9127fff640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f91300d0c40 0x7f91300b0430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:45386/0 (socket says 172.21.15.102:45386) 2023-11-13T11:29:40.716 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:40.706+0000 7f9127fff640 1 -- 172.21.15.102:0/274542984 learned_addr learned my addr 172.21.15.102:0/274542984 (peer_addr_for_me v2:172.21.15.102:0/0) 2023-11-13T11:29:40.717 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:40.706+0000 7f9127fff640 1 -- 172.21.15.102:0/274542984 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f91300cf490 msgr2=0x7f9130152ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:40.717 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:40.706+0000 7f9127fff640 1 --2- 172.21.15.102:0/274542984 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f91300cf490 0x7f9130152ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:40.717 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:40.706+0000 7f9127fff640 1 -- 172.21.15.102:0/274542984 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f91301606e0 msgr2=0x7f91300b12e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:40.717 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:40.706+0000 7f9127fff640 1 --2- 172.21.15.102:0/274542984 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f91301606e0 0x7f91300b12e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:40.717 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:40.706+0000 7f9127fff640 1 -- 172.21.15.102:0/274542984 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f912c0094d0 con 0x7f91300d0c40 2023-11-13T11:29:40.718 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:40.706+0000 7f9127fff640 1 --2- 172.21.15.102:0/274542984 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f91300d0c40 0x7f91300b0430 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f912000c820 tx=0x7f912000cce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-13T11:29:40.718 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:40.706+0000 7f91257fa640 1 -- 172.21.15.102:0/274542984 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9120007a30 con 0x7f91300d0c40 2023-11-13T11:29:40.718 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:40.706+0000 7f91257fa640 1 -- 172.21.15.102:0/274542984 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9120007b90 con 0x7f91300d0c40 2023-11-13T11:29:40.718 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:40.706+0000 7f91257fa640 1 -- 172.21.15.102:0/274542984 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f912000ce10 con 0x7f91300d0c40 2023-11-13T11:29:40.718 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:40.706+0000 7f9136ac9640 1 -- 172.21.15.102:0/274542984 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9130156ca0 con 0x7f91300d0c40 2023-11-13T11:29:40.719 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:40.706+0000 7f9136ac9640 1 -- 172.21.15.102:0/274542984 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9130157260 con 0x7f91300d0c40 2023-11-13T11:29:40.719 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:40.706+0000 7f9136ac9640 1 -- 172.21.15.102:0/274542984 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9130068520 con 0x7f91300d0c40 2023-11-13T11:29:40.720 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:40.710+0000 7f91257fa640 1 -- 172.21.15.102:0/274542984 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f91200113f0 con 0x7f91300d0c40 2023-11-13T11:29:40.720 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:40.710+0000 7f91257fa640 1 --2- 172.21.15.102:0/274542984 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f911c066470 0x7f911c068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:40.721 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:40.710+0000 7f91257fa640 1 -- 172.21.15.102:0/274542984 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 5738+0+0 (secure 0 0 0) 0x7f9120083f60 con 0x7f91300d0c40 2023-11-13T11:29:40.721 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:40.710+0000 7f9134865640 1 --2- 172.21.15.102:0/274542984 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f911c066470 0x7f911c068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:40.721 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:40.710+0000 7f9134865640 1 --2- 172.21.15.102:0/274542984 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f911c066470 0x7f911c068930 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f912c0af000 tx=0x7f912c008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-13T11:29:40.721 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:40.714+0000 7f91257fa640 1 -- 172.21.15.102:0/274542984 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f91200513c0 con 0x7f91300d0c40 2023-11-13T11:29:40.871 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:40.866+0000 7f9136ac9640 1 -- 172.21.15.102:0/274542984 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f91300d0410 con 0x7f91300d0c40 2023-11-13T11:29:40.872 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:40.866+0000 7f91257fa640 1 -- 172.21.15.102:0/274542984 <== mon.0 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+16594 (secure 0 0 0) 0x7f91200549e0 con 0x7f91300d0c40 2023-11-13T11:29:40.872 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T11:29:40.873 INFO:teuthology.orchestra.run.smithi102.stdout:{"epoch":24,"fsid":"97b3eb2b-7ccf-4aae-8d92-bff986c671ea","created":"2023-11-13T11:28:31.836724+0000","modified":"2023-11-13T11:29:38.698982+0000","last_up_change":"2023-11-13T11:28:44.876638+0000","last_in_change":"2023-11-13T11:28:35.312740+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-13T11:28:44.981356+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-13T11:28:55.958525+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-13T11:28:56.394264+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"bdefaa17-fcca-4c86-aa40-27dc33a789af","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6800","nonce":53303834},{"type":"v1","addr":"172.21.15.102:6801","nonce":53303834}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6802","nonce":53303834},{"type":"v1","addr":"172.21.15.102:6803","nonce":53303834}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6806","nonce":53303834},{"type":"v1","addr":"172.21.15.102:6807","nonce":53303834}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6804","nonce":53303834},{"type":"v1","addr":"172.21.15.102:6805","nonce":53303834}]},"public_addr":"172.21.15.102:6801/53303834","cluster_addr":"172.21.15.102:6803/53303834","heartbeat_back_addr":"172.21.15.102:6807/53303834","heartbeat_front_addr":"172.21.15.102:6805/53303834","state":["exists","up"]},{"osd":1,"uuid":"f0033196-dec9-4ae9-945e-6aeef6dbb47f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6808","nonce":1732708348},{"type":"v1","addr":"172.21.15.102:6809","nonce":1732708348}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6811","nonce":1732708348},{"type":"v1","addr":"172.21.15.102:6813","nonce":1732708348}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6818","nonce":1732708348},{"type":"v1","addr":"172.21.15.102:6820","nonce":1732708348}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6815","nonce":1732708348},{"type":"v1","addr":"172.21.15.102:6817","nonce":1732708348}]},"public_addr":"172.21.15.102:6809/1732708348","cluster_addr":"172.21.15.102:6813/1732708348","heartbeat_back_addr":"172.21.15.102:6820/1732708348","heartbeat_front_addr":"172.21.15.102:6817/1732708348","state":["exists","up"]},{"osd":2,"uuid":"496b0834-351e-4ec2-a714-86ed0c0ff4fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6810","nonce":1825475150},{"type":"v1","addr":"172.21.15.102:6812","nonce":1825475150}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6814","nonce":1825475150},{"type":"v1","addr":"172.21.15.102:6816","nonce":1825475150}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6822","nonce":1825475150},{"type":"v1","addr":"172.21.15.102:6823","nonce":1825475150}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6819","nonce":1825475150},{"type":"v1","addr":"172.21.15.102:6821","nonce":1825475150}]},"public_addr":"172.21.15.102:6812/1825475150","cluster_addr":"172.21.15.102:6816/1825475150","heartbeat_back_addr":"172.21.15.102:6823/1825475150","heartbeat_front_addr":"172.21.15.102:6821/1825475150","state":["exists","up"]},{"osd":3,"uuid":"3ba6cc41-e0a0-4273-86cb-90000c06a55a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6824","nonce":4149355528},{"type":"v1","addr":"172.21.15.102:6825","nonce":4149355528}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6826","nonce":4149355528},{"type":"v1","addr":"172.21.15.102:6827","nonce":4149355528}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6830","nonce":4149355528},{"type":"v1","addr":"172.21.15.102:6831","nonce":4149355528}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6828","nonce":4149355528},{"type":"v1","addr":"172.21.15.102:6829","nonce":4149355528}]},"public_addr":"172.21.15.102:6825/4149355528","cluster_addr":"172.21.15.102:6827/4149355528","heartbeat_back_addr":"172.21.15.102:6831/4149355528","heartbeat_front_addr":"172.21.15.102:6829/4149355528","state":["exists","up"]},{"osd":4,"uuid":"16e797d8-e6e7-4140-95c3-b85283c42a2a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6808","nonce":4028899241},{"type":"v1","addr":"172.21.15.154:6809","nonce":4028899241}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6810","nonce":4028899241},{"type":"v1","addr":"172.21.15.154:6811","nonce":4028899241}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6814","nonce":4028899241},{"type":"v1","addr":"172.21.15.154:6815","nonce":4028899241}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6812","nonce":4028899241},{"type":"v1","addr":"172.21.15.154:6813","nonce":4028899241}]},"public_addr":"172.21.15.154:6809/4028899241","cluster_addr":"172.21.15.154:6811/4028899241","heartbeat_back_addr":"172.21.15.154:6815/4028899241","heartbeat_front_addr":"172.21.15.154:6813/4028899241","state":["exists","up"]},{"osd":5,"uuid":"d6ab225c-1b55-450a-89a9-abe5c3f8d6af","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":3562396827},{"type":"v1","addr":"172.21.15.154:6801","nonce":3562396827}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":3562396827},{"type":"v1","addr":"172.21.15.154:6803","nonce":3562396827}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6806","nonce":3562396827},{"type":"v1","addr":"172.21.15.154:6807","nonce":3562396827}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6804","nonce":3562396827},{"type":"v1","addr":"172.21.15.154:6805","nonce":3562396827}]},"public_addr":"172.21.15.154:6801/3562396827","cluster_addr":"172.21.15.154:6803/3562396827","heartbeat_back_addr":"172.21.15.154:6807/3562396827","heartbeat_front_addr":"172.21.15.154:6805/3562396827","state":["exists","up"]},{"osd":6,"uuid":"96f905ac-491c-4662-8e2b-5bb8e929ab9d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6816","nonce":2933728751},{"type":"v1","addr":"172.21.15.154:6817","nonce":2933728751}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6818","nonce":2933728751},{"type":"v1","addr":"172.21.15.154:6819","nonce":2933728751}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6822","nonce":2933728751},{"type":"v1","addr":"172.21.15.154:6823","nonce":2933728751}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6820","nonce":2933728751},{"type":"v1","addr":"172.21.15.154:6821","nonce":2933728751}]},"public_addr":"172.21.15.154:6817/2933728751","cluster_addr":"172.21.15.154:6819/2933728751","heartbeat_back_addr":"172.21.15.154:6823/2933728751","heartbeat_front_addr":"172.21.15.154:6821/2933728751","state":["exists","up"]},{"osd":7,"uuid":"07012d3b-3ab4-40df-a471-93caed22e2dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6824","nonce":1753500785},{"type":"v1","addr":"172.21.15.154:6825","nonce":1753500785}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6826","nonce":1753500785},{"type":"v1","addr":"172.21.15.154:6827","nonce":1753500785}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6830","nonce":1753500785},{"type":"v1","addr":"172.21.15.154:6831","nonce":1753500785}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6828","nonce":1753500785},{"type":"v1","addr":"172.21.15.154:6829","nonce":1753500785}]},"public_addr":"172.21.15.154:6825/1753500785","cluster_addr":"172.21.15.154:6827/1753500785","heartbeat_back_addr":"172.21.15.154:6831/1753500785","heartbeat_front_addr":"172.21.15.154:6829/1753500785","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-13T11:28:40.978603+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-13T11:28:41.200985+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-13T11:28:41.222815+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-13T11:28:41.202162+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-13T11:28:40.925911+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-13T11:28:41.087725+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-13T11:28:41.072208+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-13T11:28:40.875257+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.2c","mappings":[{"from":0,"to":7}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-13T11:29:40.874 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:40.866+0000 7f9136ac9640 1 -- 172.21.15.102:0/274542984 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f911c066470 msgr2=0x7f911c068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:40.875 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:40.866+0000 7f9136ac9640 1 --2- 172.21.15.102:0/274542984 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f911c066470 0x7f911c068930 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f912c0af000 tx=0x7f912c008040 comp rx=0 tx=0).stop 2023-11-13T11:29:40.875 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:40.866+0000 7f9136ac9640 1 -- 172.21.15.102:0/274542984 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f91300d0c40 msgr2=0x7f91300b0430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:40.875 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:40.866+0000 7f9136ac9640 1 --2- 172.21.15.102:0/274542984 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f91300d0c40 0x7f91300b0430 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f912000c820 tx=0x7f912000cce0 comp rx=0 tx=0).stop 2023-11-13T11:29:40.875 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:40.866+0000 7f9136ac9640 1 -- 172.21.15.102:0/274542984 shutdown_connections 2023-11-13T11:29:40.876 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:40.866+0000 7f9136ac9640 1 --2- 172.21.15.102:0/274542984 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f91301606e0 0x7f91300b12e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:40.876 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:40.866+0000 7f9136ac9640 1 --2- 172.21.15.102:0/274542984 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f911c066470 0x7f911c068930 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:40.876 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:40.866+0000 7f9136ac9640 1 --2- 172.21.15.102:0/274542984 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f91300d0c40 0x7f91300b0430 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:40.876 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:40.866+0000 7f9136ac9640 1 --2- 172.21.15.102:0/274542984 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f91300cf490 0x7f9130152ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:40.878 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:40.866+0000 7f9136ac9640 1 -- 172.21.15.102:0/274542984 >> 172.21.15.102:0/274542984 conn(0x7f913009c130 msgr2=0x7f913006c220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-13T11:29:40.878 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:40.866+0000 7f9136ac9640 1 -- 172.21.15.102:0/274542984 shutdown_connections 2023-11-13T11:29:40.878 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:40.866+0000 7f9136ac9640 1 -- 172.21.15.102:0/274542984 wait complete. 2023-11-13T11:29:40.893 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-13T11:28:44.981356+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-13T11:28:55.958525+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-11-13T11:28:56.394264+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-13T11:29:40.894 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-13T11:29:41.036 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:41.030+0000 7fad5e155640 1 Processor -- start 2023-11-13T11:29:41.036 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:41.030+0000 7fad5e155640 1 -- start start 2023-11-13T11:29:41.038 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:41.030+0000 7fad5e155640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fad580cf2d0 0x7fad5806fc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:41.038 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:41.030+0000 7fad5e155640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7fad580711c0 0x7fad580b3520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:41.038 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:41.030+0000 7fad5e155640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fad580b21f0 con 0x7fad58159b30 2023-11-13T11:29:41.039 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:41.030+0000 7fad5e155640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fad58071670 con 0x7fad580711c0 2023-11-13T11:29:41.039 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:41.030+0000 7fad5e155640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fad580b2440 con 0x7fad580cf2d0 2023-11-13T11:29:41.039 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:41.030+0000 7fad577fe640 1 --1- >> v1:172.21.15.102:6789/0 conn(0x7fad58159b30 0x7fad580cebc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.102:6789/0 says I am v1:172.21.15.102:45922/0 (socket says 172.21.15.102:45922) 2023-11-13T11:29:41.039 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:41.030+0000 7fad577fe640 1 -- 172.21.15.102:0/824403646 learned_addr learned my addr 172.21.15.102:0/824403646 (peer_addr_for_me v1:172.21.15.102:0/0) 2023-11-13T11:29:41.039 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:41.030+0000 7fad57fff640 1 --2- 172.21.15.102:0/824403646 >> v2:172.21.15.102:3300/0 conn(0x7fad580711c0 0x7fad580b3520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:41.040 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:41.030+0000 7fad56ffd640 1 --2- 172.21.15.102:0/824403646 >> v2:172.21.15.154:3300/0 conn(0x7fad580cf2d0 0x7fad5806fc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:41.040 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:41.030+0000 7fad57fff640 1 -- 172.21.15.102:0/824403646 >> v2:172.21.15.154:3300/0 conn(0x7fad580cf2d0 msgr2=0x7fad5806fc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-13T11:29:41.040 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:41.030+0000 7fad57fff640 1 --2- 172.21.15.102:0/824403646 >> v2:172.21.15.154:3300/0 conn(0x7fad580cf2d0 0x7fad5806fc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:41.041 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:41.030+0000 7fad57fff640 1 -- 172.21.15.102:0/824403646 >> v1:172.21.15.102:6789/0 conn(0x7fad58159b30 legacy=0x7fad580cebc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:41.041 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:41.030+0000 7fad57fff640 1 -- 172.21.15.102:0/824403646 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad580b2720 con 0x7fad580711c0 2023-11-13T11:29:41.041 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:41.030+0000 7fad567fc640 1 -- 172.21.15.102:0/824403646 <== mon.0 v1:172.21.15.102:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3303531778 0 0) 0x7fad580b21f0 con 0x7fad58159b30 2023-11-13T11:29:41.041 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:41.030+0000 7fad56ffd640 1 --2- 172.21.15.102:0/824403646 >> v2:172.21.15.154:3300/0 conn(0x7fad580cf2d0 0x7fad5806fc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-13T11:29:41.043 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:41.034+0000 7fad57fff640 1 --2- 172.21.15.102:0/824403646 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fad580711c0 0x7fad580b3520 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7fad58071820 tx=0x7fad5001c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=df50141707714ad9 server_cookie=0 in_seq=0 out_seq=0 2023-11-13T11:29:41.043 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:41.034+0000 7fad567fc640 1 -- 172.21.15.102:0/824403646 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad500a59a0 con 0x7fad580711c0 2023-11-13T11:29:41.044 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:41.034+0000 7fad567fc640 1 -- 172.21.15.102:0/824403646 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad500a5b00 con 0x7fad580711c0 2023-11-13T11:29:41.044 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:41.034+0000 7fad567fc640 1 -- 172.21.15.102:0/824403646 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad500a5e90 con 0x7fad580711c0 2023-11-13T11:29:41.044 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:41.034+0000 7fad5e155640 1 -- 172.21.15.102:0/824403646 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fad580711c0 msgr2=0x7fad580b3520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:41.045 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:41.034+0000 7fad5e155640 1 --2- 172.21.15.102:0/824403646 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fad580711c0 0x7fad580b3520 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7fad58071820 tx=0x7fad5001c8e0 comp rx=0 tx=0).stop 2023-11-13T11:29:41.045 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:41.034+0000 7fad5e155640 1 -- 172.21.15.102:0/824403646 shutdown_connections 2023-11-13T11:29:41.045 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:41.034+0000 7fad5e155640 1 --2- 172.21.15.102:0/824403646 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fad580711c0 0x7fad580b3520 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:41.045 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:41.034+0000 7fad5e155640 1 --2- 172.21.15.102:0/824403646 >> v2:172.21.15.154:3300/0 conn(0x7fad580cf2d0 0x7fad5806fc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:41.045 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:41.034+0000 7fad5e155640 1 -- 172.21.15.102:0/824403646 >> 172.21.15.102:0/824403646 conn(0x7fad5806a410 msgr2=0x7fad5806a820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-13T11:29:41.046 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:41.034+0000 7fad5e155640 1 -- 172.21.15.102:0/824403646 shutdown_connections 2023-11-13T11:29:41.046 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:41.034+0000 7fad5e155640 1 -- 172.21.15.102:0/824403646 wait complete. 2023-11-13T11:29:41.046 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:41.038+0000 7fad5e155640 1 Processor -- start 2023-11-13T11:29:41.046 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:41.038+0000 7fad5e155640 1 -- start start 2023-11-13T11:29:41.049 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:41.038+0000 7fad5e155640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fad580711c0 0x7fad5815a2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:41.050 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:41.038+0000 7fad5e155640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fad580cf2d0 0x7fad581f96f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:41.050 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:41.038+0000 7fad5e155640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fad58159b30 0x7fad581f9c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:41.050 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:41.038+0000 7fad5e155640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad5815c310 con 0x7fad580cf2d0 2023-11-13T11:29:41.051 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:41.038+0000 7fad5e155640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad58155620 con 0x7fad580711c0 2023-11-13T11:29:41.051 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:41.038+0000 7fad5e155640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad5815a9c0 con 0x7fad58159b30 2023-11-13T11:29:41.051 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:41.038+0000 7fad56ffd640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fad580cf2d0 0x7fad581f96f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:41.051 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:41.038+0000 7fad56ffd640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fad580cf2d0 0x7fad581f96f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:45394/0 (socket says 172.21.15.102:45394) 2023-11-13T11:29:41.052 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:41.038+0000 7fad56ffd640 1 -- 172.21.15.102:0/4136924181 learned_addr learned my addr 172.21.15.102:0/4136924181 (peer_addr_for_me v2:172.21.15.102:0/0) 2023-11-13T11:29:41.052 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:41.038+0000 7fad577fe640 1 --2- 172.21.15.102:0/4136924181 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fad580711c0 0x7fad5815a2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:41.052 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:41.038+0000 7fad57fff640 1 --2- 172.21.15.102:0/4136924181 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fad58159b30 0x7fad581f9c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:41.053 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:41.038+0000 7fad56ffd640 1 -- 172.21.15.102:0/4136924181 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fad58159b30 msgr2=0x7fad581f9c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:41.053 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:41.038+0000 7fad56ffd640 1 --2- 172.21.15.102:0/4136924181 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fad58159b30 0x7fad581f9c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:41.053 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:41.038+0000 7fad56ffd640 1 -- 172.21.15.102:0/4136924181 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fad580711c0 msgr2=0x7fad5815a2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:41.054 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:41.038+0000 7fad56ffd640 1 --2- 172.21.15.102:0/4136924181 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fad580711c0 0x7fad5815a2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:41.054 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:41.038+0000 7fad56ffd640 1 -- 172.21.15.102:0/4136924181 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad50009a70 con 0x7fad580cf2d0 2023-11-13T11:29:41.054 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:41.038+0000 7fad56ffd640 1 --2- 172.21.15.102:0/4136924181 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fad580cf2d0 0x7fad581f96f0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7fad4c00e730 tx=0x7fad4c00ebf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-13T11:29:41.055 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:41.038+0000 7fad3ffff640 1 -- 172.21.15.102:0/4136924181 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad4c00c8d0 con 0x7fad580cf2d0 2023-11-13T11:29:41.055 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:41.038+0000 7fad3ffff640 1 -- 172.21.15.102:0/4136924181 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad4c00ca30 con 0x7fad580cf2d0 2023-11-13T11:29:41.055 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:41.038+0000 7fad5e155640 1 -- 172.21.15.102:0/4136924181 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fad5815aca0 con 0x7fad580cf2d0 2023-11-13T11:29:41.055 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:41.038+0000 7fad3ffff640 1 -- 172.21.15.102:0/4136924181 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad4c00cde0 con 0x7fad580cf2d0 2023-11-13T11:29:41.056 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:41.038+0000 7fad5e155640 1 -- 172.21.15.102:0/4136924181 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fad5815b260 con 0x7fad580cf2d0 2023-11-13T11:29:41.056 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:41.038+0000 7fad5e155640 1 -- 172.21.15.102:0/4136924181 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fad58067640 con 0x7fad580cf2d0 2023-11-13T11:29:41.056 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:41.042+0000 7fad3ffff640 1 -- 172.21.15.102:0/4136924181 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fad4c013410 con 0x7fad580cf2d0 2023-11-13T11:29:41.056 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:41.042+0000 7fad3ffff640 1 --2- 172.21.15.102:0/4136924181 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7fad44066470 0x7fad44068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:41.057 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:41.042+0000 7fad3ffff640 1 -- 172.21.15.102:0/4136924181 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 5738+0+0 (secure 0 0 0) 0x7fad4c083da0 con 0x7fad580cf2d0 2023-11-13T11:29:41.057 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:41.042+0000 7fad577fe640 1 --2- 172.21.15.102:0/4136924181 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7fad44066470 0x7fad44068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:41.057 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:41.042+0000 7fad577fe640 1 --2- 172.21.15.102:0/4136924181 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7fad44066470 0x7fad44068930 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fad48000f70 tx=0x7fad48007c10 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-13T11:29:41.058 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:41.046+0000 7fad3ffff640 1 -- 172.21.15.102:0/4136924181 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fad4c0510d0 con 0x7fad580cf2d0 2023-11-13T11:29:41.200 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:41.194+0000 7fad5e155640 1 -- 172.21.15.102:0/4136924181 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fad58068520 con 0x7fad580cf2d0 2023-11-13T11:29:41.201 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:41.194+0000 7fad3ffff640 1 -- 172.21.15.102:0/4136924181 <== mon.0 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v24) v1 ==== 93+0+10 (secure 0 0 0) 0x7fad4c021020 con 0x7fad580cf2d0 2023-11-13T11:29:41.201 INFO:teuthology.orchestra.run.smithi102.stdout:pg_num: 1 2023-11-13T11:29:41.203 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:41.198+0000 7fad5e155640 1 -- 172.21.15.102:0/4136924181 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7fad44066470 msgr2=0x7fad44068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:41.203 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:41.198+0000 7fad5e155640 1 --2- 172.21.15.102:0/4136924181 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7fad44066470 0x7fad44068930 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fad48000f70 tx=0x7fad48007c10 comp rx=0 tx=0).stop 2023-11-13T11:29:41.205 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:41.198+0000 7fad5e155640 1 -- 172.21.15.102:0/4136924181 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fad580cf2d0 msgr2=0x7fad581f96f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:41.205 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:41.198+0000 7fad5e155640 1 --2- 172.21.15.102:0/4136924181 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fad580cf2d0 0x7fad581f96f0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7fad4c00e730 tx=0x7fad4c00ebf0 comp rx=0 tx=0).stop 2023-11-13T11:29:41.205 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:41.198+0000 7fad5e155640 1 -- 172.21.15.102:0/4136924181 shutdown_connections 2023-11-13T11:29:41.206 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:41.198+0000 7fad5e155640 1 --2- 172.21.15.102:0/4136924181 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fad58159b30 0x7fad581f9c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:41.206 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:41.198+0000 7fad5e155640 1 --2- 172.21.15.102:0/4136924181 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7fad44066470 0x7fad44068930 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:41.206 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:41.198+0000 7fad5e155640 1 --2- 172.21.15.102:0/4136924181 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fad580cf2d0 0x7fad581f96f0 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:41.206 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:41.198+0000 7fad5e155640 1 --2- 172.21.15.102:0/4136924181 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fad580711c0 0x7fad5815a2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:41.206 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:41.198+0000 7fad5e155640 1 -- 172.21.15.102:0/4136924181 >> 172.21.15.102:0/4136924181 conn(0x7fad5806a410 msgr2=0x7fad58158e50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-13T11:29:41.207 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:41.198+0000 7fad5e155640 1 -- 172.21.15.102:0/4136924181 shutdown_connections 2023-11-13T11:29:41.207 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:41.198+0000 7fad5e155640 1 -- 172.21.15.102:0/4136924181 wait complete. 2023-11-13T11:29:41.223 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-13T11:29:41.363 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:41.354+0000 7f2a99c05640 1 Processor -- start 2023-11-13T11:29:41.363 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:41.354+0000 7f2a99c05640 1 -- start start 2023-11-13T11:29:41.365 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:41.358+0000 7f2a99c05640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2a94159b30 0x7f2a9406fc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:41.365 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:41.358+0000 7f2a99c05640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f2a940711c0 0x7f2a940b3520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:41.365 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:41.358+0000 7f2a99c05640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f2a940cebc0 0x7f2a940cf020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:41.366 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:41.358+0000 7f2a99c05640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2a940cf560 con 0x7f2a940cebc0 2023-11-13T11:29:41.366 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:41.358+0000 7f2a99c05640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2a94071620 con 0x7f2a940711c0 2023-11-13T11:29:41.366 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:41.358+0000 7f2a99c05640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a940b21f0 con 0x7f2a94159b30 2023-11-13T11:29:41.367 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:41.358+0000 7f2a93fff640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f2a940cebc0 0x7f2a940cf020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:41.367 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:41.358+0000 7f2a937fe640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2a94159b30 0x7f2a9406fc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:41.367 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:41.358+0000 7f2a92ffd640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f2a940711c0 0x7f2a940b3520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:41.367 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:41.358+0000 7f2a93fff640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f2a940cebc0 0x7f2a940cf020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:45406/0 (socket says 172.21.15.102:45406) 2023-11-13T11:29:41.368 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:41.358+0000 7f2a937fe640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2a94159b30 0x7f2a9406fc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.102:38572/0 (socket says 172.21.15.102:38572) 2023-11-13T11:29:41.368 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:41.358+0000 7f2a93fff640 1 -- 172.21.15.102:0/2997157673 learned_addr learned my addr 172.21.15.102:0/2997157673 (peer_addr_for_me v2:172.21.15.102:0/0) 2023-11-13T11:29:41.368 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:41.358+0000 7f2a93fff640 1 -- 172.21.15.102:0/2997157673 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2a94159b30 msgr2=0x7f2a9406fc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-13T11:29:41.368 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:41.358+0000 7f2a93fff640 1 --2- 172.21.15.102:0/2997157673 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2a94159b30 0x7f2a9406fc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:41.369 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:41.358+0000 7f2a93fff640 1 -- 172.21.15.102:0/2997157673 >> v2:172.21.15.154:3300/0 conn(0x7f2a940711c0 msgr2=0x7f2a940b3520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-13T11:29:41.369 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:41.358+0000 7f2a93fff640 1 --2- 172.21.15.102:0/2997157673 >> v2:172.21.15.154:3300/0 conn(0x7f2a940711c0 0x7f2a940b3520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:41.369 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:41.358+0000 7f2a93fff640 1 -- 172.21.15.102:0/2997157673 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a940b2440 con 0x7f2a940cebc0 2023-11-13T11:29:41.376 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:41.362+0000 7f2a93fff640 1 --2- 172.21.15.102:0/2997157673 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2a940cebc0 0x7f2a940cf020 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f2a9406b150 tx=0x7f2a8c01eba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5a26ad8859fc6607 server_cookie=0 in_seq=0 out_seq=0 2023-11-13T11:29:41.377 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:41.362+0000 7f2a927fc640 1 -- 172.21.15.102:0/2997157673 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a8c00b2d0 con 0x7f2a940cebc0 2023-11-13T11:29:41.377 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:41.362+0000 7f2a927fc640 1 -- 172.21.15.102:0/2997157673 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a8c00b430 con 0x7f2a940cebc0 2023-11-13T11:29:41.377 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:41.362+0000 7f2a927fc640 1 -- 172.21.15.102:0/2997157673 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a8c0a7c50 con 0x7f2a940cebc0 2023-11-13T11:29:41.378 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:41.362+0000 7f2a99c05640 1 -- 172.21.15.102:0/2997157673 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2a940cebc0 msgr2=0x7f2a940cf020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:41.378 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:41.362+0000 7f2a99c05640 1 --2- 172.21.15.102:0/2997157673 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2a940cebc0 0x7f2a940cf020 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f2a9406b150 tx=0x7f2a8c01eba0 comp rx=0 tx=0).stop 2023-11-13T11:29:41.378 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:41.362+0000 7f2a99c05640 1 -- 172.21.15.102:0/2997157673 shutdown_connections 2023-11-13T11:29:41.379 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:41.362+0000 7f2a99c05640 1 --2- 172.21.15.102:0/2997157673 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2a940cebc0 0x7f2a940cf020 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:41.379 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:41.362+0000 7f2a99c05640 1 --2- 172.21.15.102:0/2997157673 >> v2:172.21.15.154:3300/0 conn(0x7f2a940711c0 0x7f2a940b3520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:41.379 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:41.362+0000 7f2a99c05640 1 --2- 172.21.15.102:0/2997157673 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2a94159b30 0x7f2a9406fc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:41.380 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:41.362+0000 7f2a99c05640 1 -- 172.21.15.102:0/2997157673 >> 172.21.15.102:0/2997157673 conn(0x7f2a9406a410 msgr2=0x7f2a9406a820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-13T11:29:41.380 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:41.362+0000 7f2a99c05640 1 -- 172.21.15.102:0/2997157673 shutdown_connections 2023-11-13T11:29:41.381 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:41.362+0000 7f2a99c05640 1 -- 172.21.15.102:0/2997157673 wait complete. 2023-11-13T11:29:41.381 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:41.362+0000 7f2a99c05640 1 Processor -- start 2023-11-13T11:29:41.381 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:41.362+0000 7f2a99c05640 1 -- start start 2023-11-13T11:29:41.382 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:41.366+0000 7f2a99c05640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2a940711c0 0x7f2a941f5120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:41.382 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:41.366+0000 7f2a99c05640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2a940cebc0 0x7f2a94141fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:41.382 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:41.366+0000 7f2a99c05640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2a94159b30 0x7f2a94142500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:41.383 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:41.366+0000 7f2a99c05640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a941405b0 con 0x7f2a940cebc0 2023-11-13T11:29:41.383 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:41.366+0000 7f2a99c05640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a9413fc70 con 0x7f2a940711c0 2023-11-13T11:29:41.383 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:41.366+0000 7f2a99c05640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a941f5660 con 0x7f2a94159b30 2023-11-13T11:29:41.383 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:41.366+0000 7f2a92ffd640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2a940cebc0 0x7f2a94141fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:41.384 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:41.366+0000 7f2a92ffd640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2a940cebc0 0x7f2a94141fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:45414/0 (socket says 172.21.15.102:45414) 2023-11-13T11:29:41.384 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:41.366+0000 7f2a92ffd640 1 -- 172.21.15.102:0/1905341519 learned_addr learned my addr 172.21.15.102:0/1905341519 (peer_addr_for_me v2:172.21.15.102:0/0) 2023-11-13T11:29:41.384 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:41.366+0000 7f2a93fff640 1 --2- 172.21.15.102:0/1905341519 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2a94159b30 0x7f2a94142500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:41.384 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:41.366+0000 7f2a937fe640 1 --2- 172.21.15.102:0/1905341519 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2a940711c0 0x7f2a941f5120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:41.385 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:41.366+0000 7f2a92ffd640 1 -- 172.21.15.102:0/1905341519 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2a94159b30 msgr2=0x7f2a94142500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:41.385 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:41.366+0000 7f2a92ffd640 1 --2- 172.21.15.102:0/1905341519 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2a94159b30 0x7f2a94142500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:41.385 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:41.366+0000 7f2a92ffd640 1 -- 172.21.15.102:0/1905341519 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2a940711c0 msgr2=0x7f2a941f5120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:41.385 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:41.366+0000 7f2a92ffd640 1 --2- 172.21.15.102:0/1905341519 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2a940711c0 0x7f2a941f5120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:41.386 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:41.366+0000 7f2a92ffd640 1 -- 172.21.15.102:0/1905341519 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a8c00bd40 con 0x7f2a940cebc0 2023-11-13T11:29:41.386 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:41.366+0000 7f2a92ffd640 1 --2- 172.21.15.102:0/1905341519 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2a940cebc0 0x7f2a94141fc0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f2a8800e9b0 tx=0x7f2a8800ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-13T11:29:41.386 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:41.366+0000 7f2a7bfff640 1 -- 172.21.15.102:0/1905341519 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a880096b0 con 0x7f2a940cebc0 2023-11-13T11:29:41.386 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:41.366+0000 7f2a7bfff640 1 -- 172.21.15.102:0/1905341519 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a8800c9a0 con 0x7f2a940cebc0 2023-11-13T11:29:41.386 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:41.366+0000 7f2a99c05640 1 -- 172.21.15.102:0/1905341519 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2a941462b0 con 0x7f2a940cebc0 2023-11-13T11:29:41.387 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:41.366+0000 7f2a7bfff640 1 -- 172.21.15.102:0/1905341519 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a8800cd30 con 0x7f2a940cebc0 2023-11-13T11:29:41.387 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:41.366+0000 7f2a99c05640 1 -- 172.21.15.102:0/1905341519 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2a94142af0 con 0x7f2a940cebc0 2023-11-13T11:29:41.387 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:41.366+0000 7f2a99c05640 1 -- 172.21.15.102:0/1905341519 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2a94067640 con 0x7f2a940cebc0 2023-11-13T11:29:41.387 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:41.370+0000 7f2a7bfff640 1 -- 172.21.15.102:0/1905341519 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f2a88013470 con 0x7f2a940cebc0 2023-11-13T11:29:41.388 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:41.370+0000 7f2a7bfff640 1 --2- 172.21.15.102:0/1905341519 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f2a80066470 0x7f2a80068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:41.388 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:41.370+0000 7f2a7bfff640 1 -- 172.21.15.102:0/1905341519 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 5738+0+0 (secure 0 0 0) 0x7f2a88084070 con 0x7f2a940cebc0 2023-11-13T11:29:41.388 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:41.370+0000 7f2a937fe640 1 --2- 172.21.15.102:0/1905341519 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f2a80066470 0x7f2a80068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:41.389 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:41.370+0000 7f2a937fe640 1 --2- 172.21.15.102:0/1905341519 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f2a80066470 0x7f2a80068930 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f2a84009a40 tx=0x7f2a84009190 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-13T11:29:41.389 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:41.374+0000 7f2a7bfff640 1 -- 172.21.15.102:0/1905341519 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f2a88051580 con 0x7f2a940cebc0 2023-11-13T11:29:41.529 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:41.522+0000 7f2a99c05640 1 -- 172.21.15.102:0/1905341519 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f2a94068520 con 0x7f2a940cebc0 2023-11-13T11:29:41.529 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:41.522+0000 7f2a7bfff640 1 -- 172.21.15.102:0/1905341519 <== mon.0 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v24) v1 ==== 104+0+11 (secure 0 0 0) 0x7f2a88054ba0 con 0x7f2a940cebc0 2023-11-13T11:29:41.530 INFO:teuthology.orchestra.run.smithi102.stdout:pg_num: 32 2023-11-13T11:29:41.531 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:41.522+0000 7f2a99c05640 1 -- 172.21.15.102:0/1905341519 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f2a80066470 msgr2=0x7f2a80068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:41.531 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:41.522+0000 7f2a99c05640 1 --2- 172.21.15.102:0/1905341519 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f2a80066470 0x7f2a80068930 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f2a84009a40 tx=0x7f2a84009190 comp rx=0 tx=0).stop 2023-11-13T11:29:41.531 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:41.522+0000 7f2a99c05640 1 -- 172.21.15.102:0/1905341519 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2a940cebc0 msgr2=0x7f2a94141fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:41.531 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:41.522+0000 7f2a99c05640 1 --2- 172.21.15.102:0/1905341519 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2a940cebc0 0x7f2a94141fc0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f2a8800e9b0 tx=0x7f2a8800ee70 comp rx=0 tx=0).stop 2023-11-13T11:29:41.532 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:41.522+0000 7f2a99c05640 1 -- 172.21.15.102:0/1905341519 shutdown_connections 2023-11-13T11:29:41.532 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:41.522+0000 7f2a99c05640 1 --2- 172.21.15.102:0/1905341519 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2a94159b30 0x7f2a94142500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:41.532 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:41.522+0000 7f2a99c05640 1 --2- 172.21.15.102:0/1905341519 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f2a80066470 0x7f2a80068930 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:41.532 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:41.522+0000 7f2a99c05640 1 --2- 172.21.15.102:0/1905341519 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2a940cebc0 0x7f2a94141fc0 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:41.533 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:41.522+0000 7f2a99c05640 1 --2- 172.21.15.102:0/1905341519 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2a940711c0 0x7f2a941f5120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:41.533 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:41.522+0000 7f2a99c05640 1 -- 172.21.15.102:0/1905341519 >> 172.21.15.102:0/1905341519 conn(0x7f2a9406a410 msgr2=0x7f2a94070820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-13T11:29:41.534 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:41.526+0000 7f2a99c05640 1 -- 172.21.15.102:0/1905341519 shutdown_connections 2023-11-13T11:29:41.535 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:41.526+0000 7f2a99c05640 1 -- 172.21.15.102:0/1905341519 wait complete. 2023-11-13T11:29:41.550 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-13T11:29:41.691 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:41.682+0000 7f7d3649c640 1 Processor -- start 2023-11-13T11:29:41.691 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:41.686+0000 7f7d3649c640 1 -- start start 2023-11-13T11:29:41.693 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:41.686+0000 7f7d3649c640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f7d301553c0 0x7f7d300cebc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:41.693 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:41.686+0000 7f7d3649c640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7d3015bac0 0x7f7d300cf100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:41.693 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:41.686+0000 7f7d3649c640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7d3015bf10 con 0x7f7d3006c800 2023-11-13T11:29:41.693 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:41.686+0000 7f7d3649c640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7d3006c3e0 con 0x7f7d301553c0 2023-11-13T11:29:41.693 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:41.686+0000 7f7d3649c640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7d3015c150 con 0x7f7d3015bac0 2023-11-13T11:29:41.694 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:41.686+0000 7f7d2ffff640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f7d301553c0 0x7f7d300cebc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:41.694 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:41.686+0000 7f7d2ffff640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f7d301553c0 0x7f7d300cebc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:45424/0 (socket says 172.21.15.102:45424) 2023-11-13T11:29:41.694 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:41.686+0000 7f7d2ffff640 1 -- 172.21.15.102:0/696227182 learned_addr learned my addr 172.21.15.102:0/696227182 (peer_addr_for_me v2:172.21.15.102:0/0) 2023-11-13T11:29:41.694 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:41.686+0000 7f7d34a39640 1 --2- 172.21.15.102:0/696227182 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7d3015bac0 0x7f7d300cf100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:41.695 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:41.686+0000 7f7d2ffff640 1 -- 172.21.15.102:0/696227182 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7d3015bac0 msgr2=0x7f7d300cf100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-13T11:29:41.695 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:41.686+0000 7f7d2ffff640 1 --2- 172.21.15.102:0/696227182 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7d3015bac0 0x7f7d300cf100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:41.695 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:41.686+0000 7f7d2ffff640 1 -- 172.21.15.102:0/696227182 >> v1:172.21.15.154:6789/0 conn(0x7f7d3006c800 legacy=0x7f7d3015b3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:41.696 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:41.686+0000 7f7d2ffff640 1 -- 172.21.15.102:0/696227182 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d3006bd20 con 0x7f7d301553c0 2023-11-13T11:29:41.697 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:41.690+0000 7f7d2ffff640 1 --2- 172.21.15.102:0/696227182 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7d301553c0 0x7f7d300cebc0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f7d20009870 tx=0x7f7d2001c4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=17c62556c462aa30 server_cookie=0 in_seq=0 out_seq=0 2023-11-13T11:29:41.697 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:41.690+0000 7f7d2effd640 1 -- 172.21.15.102:0/696227182 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d200ab610 con 0x7f7d301553c0 2023-11-13T11:29:41.697 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:41.690+0000 7f7d2effd640 1 -- 172.21.15.102:0/696227182 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d200ab770 con 0x7f7d301553c0 2023-11-13T11:29:41.697 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:41.690+0000 7f7d2effd640 1 -- 172.21.15.102:0/696227182 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d200abb00 con 0x7f7d301553c0 2023-11-13T11:29:41.698 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:41.690+0000 7f7d3649c640 1 -- 172.21.15.102:0/696227182 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7d301553c0 msgr2=0x7f7d300cebc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:41.698 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:41.690+0000 7f7d3649c640 1 --2- 172.21.15.102:0/696227182 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7d301553c0 0x7f7d300cebc0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f7d20009870 tx=0x7f7d2001c4b0 comp rx=0 tx=0).stop 2023-11-13T11:29:41.698 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:41.690+0000 7f7d3649c640 1 -- 172.21.15.102:0/696227182 shutdown_connections 2023-11-13T11:29:41.698 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:41.690+0000 7f7d3649c640 1 --2- 172.21.15.102:0/696227182 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7d3015bac0 0x7f7d300cf100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:41.698 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:41.690+0000 7f7d3649c640 1 --2- 172.21.15.102:0/696227182 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7d301553c0 0x7f7d300cebc0 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:41.699 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:41.690+0000 7f7d3649c640 1 -- 172.21.15.102:0/696227182 >> 172.21.15.102:0/696227182 conn(0x7f7d3006a410 msgr2=0x7f7d3006a820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-13T11:29:41.699 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:41.690+0000 7f7d3649c640 1 -- 172.21.15.102:0/696227182 shutdown_connections 2023-11-13T11:29:41.699 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:41.690+0000 7f7d3649c640 1 -- 172.21.15.102:0/696227182 wait complete. 2023-11-13T11:29:41.701 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:41.690+0000 7f7d3649c640 1 Processor -- start 2023-11-13T11:29:41.701 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:41.694+0000 7f7d3649c640 1 -- start start 2023-11-13T11:29:41.701 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:41.694+0000 7f7d3649c640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7d3006c800 0x7f7d300b2630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:41.702 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:41.694+0000 7f7d3649c640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7d301553c0 0x7f7d301574d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:41.702 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:41.694+0000 7f7d3649c640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7d3015bac0 0x7f7d3014e890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:41.702 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:41.694+0000 7f7d3649c640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d30155c10 con 0x7f7d3015bac0 2023-11-13T11:29:41.702 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:41.694+0000 7f7d3649c640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d30155ef0 con 0x7f7d301553c0 2023-11-13T11:29:41.702 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:41.694+0000 7f7d3649c640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7d301561d0 con 0x7f7d3006c800 2023-11-13T11:29:41.703 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:41.694+0000 7f7d34a39640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7d3015bac0 0x7f7d3014e890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:41.703 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:41.694+0000 7f7d34a39640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7d3015bac0 0x7f7d3014e890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:45428/0 (socket says 172.21.15.102:45428) 2023-11-13T11:29:41.703 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:41.694+0000 7f7d34a39640 1 -- 172.21.15.102:0/1379582386 learned_addr learned my addr 172.21.15.102:0/1379582386 (peer_addr_for_me v2:172.21.15.102:0/0) 2023-11-13T11:29:41.703 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:41.694+0000 7f7d2ffff640 1 --2- 172.21.15.102:0/1379582386 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7d3006c800 0x7f7d300b2630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:41.703 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:41.694+0000 7f7d2f7fe640 1 --2- 172.21.15.102:0/1379582386 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7d301553c0 0x7f7d301574d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:41.704 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:41.694+0000 7f7d34a39640 1 -- 172.21.15.102:0/1379582386 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7d3006c800 msgr2=0x7f7d300b2630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:41.704 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:41.694+0000 7f7d34a39640 1 --2- 172.21.15.102:0/1379582386 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7d3006c800 0x7f7d300b2630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:41.704 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:41.694+0000 7f7d34a39640 1 -- 172.21.15.102:0/1379582386 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7d301553c0 msgr2=0x7f7d301574d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:41.704 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:41.694+0000 7f7d34a39640 1 --2- 172.21.15.102:0/1379582386 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7d301553c0 0x7f7d301574d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:41.704 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:41.694+0000 7f7d34a39640 1 -- 172.21.15.102:0/1379582386 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d200094d0 con 0x7f7d3015bac0 2023-11-13T11:29:41.705 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:41.694+0000 7f7d2f7fe640 1 --2- 172.21.15.102:0/1379582386 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7d301553c0 0x7f7d301574d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-13T11:29:41.705 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:41.694+0000 7f7d34a39640 1 --2- 172.21.15.102:0/1379582386 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7d3015bac0 0x7f7d3014e890 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f7d28007e60 tx=0x7f7d2800e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-13T11:29:41.705 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:41.694+0000 7f7d2cff9640 1 -- 172.21.15.102:0/1379582386 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d28014420 con 0x7f7d3015bac0 2023-11-13T11:29:41.705 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:41.694+0000 7f7d2cff9640 1 -- 172.21.15.102:0/1379582386 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d280145a0 con 0x7f7d3015bac0 2023-11-13T11:29:41.705 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:41.694+0000 7f7d3649c640 1 -- 172.21.15.102:0/1379582386 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7d301564b0 con 0x7f7d3015bac0 2023-11-13T11:29:41.706 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:41.694+0000 7f7d2cff9640 1 -- 172.21.15.102:0/1379582386 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d28014950 con 0x7f7d3015bac0 2023-11-13T11:29:41.706 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:41.694+0000 7f7d3649c640 1 -- 172.21.15.102:0/1379582386 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7d301569d0 con 0x7f7d3015bac0 2023-11-13T11:29:41.707 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:41.694+0000 7f7d3649c640 1 -- 172.21.15.102:0/1379582386 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7d301566f0 con 0x7f7d3015bac0 2023-11-13T11:29:41.707 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:41.698+0000 7f7d2cff9640 1 -- 172.21.15.102:0/1379582386 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f7d28014ab0 con 0x7f7d3015bac0 2023-11-13T11:29:41.707 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:41.698+0000 7f7d2cff9640 1 --2- 172.21.15.102:0/1379582386 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f7d1c066470 0x7f7d1c068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:41.707 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:41.698+0000 7f7d2cff9640 1 -- 172.21.15.102:0/1379582386 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 5738+0+0 (secure 0 0 0) 0x7f7d280846f0 con 0x7f7d3015bac0 2023-11-13T11:29:41.708 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:41.698+0000 7f7d2ffff640 1 --2- 172.21.15.102:0/1379582386 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f7d1c066470 0x7f7d1c068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:41.708 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:41.698+0000 7f7d2ffff640 1 --2- 172.21.15.102:0/1379582386 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f7d1c066470 0x7f7d1c068930 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f7d200af000 tx=0x7f7d200b6040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-13T11:29:41.708 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:41.702+0000 7f7d2cff9640 1 -- 172.21.15.102:0/1379582386 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f7d301566f0 con 0x7f7d3015bac0 2023-11-13T11:29:41.862 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:41.854+0000 7f7d3649c640 1 -- 172.21.15.102:0/1379582386 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f7d30067640 con 0x7f7d3015bac0 2023-11-13T11:29:41.863 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:41.854+0000 7f7d2cff9640 1 -- 172.21.15.102:0/1379582386 <== mon.0 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v24) v1 ==== 100+0+11 (secure 0 0 0) 0x7f7d28051b30 con 0x7f7d3015bac0 2023-11-13T11:29:41.863 INFO:teuthology.orchestra.run.smithi102.stdout:pg_num: 64 2023-11-13T11:29:41.865 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:41.858+0000 7f7d3649c640 1 -- 172.21.15.102:0/1379582386 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f7d1c066470 msgr2=0x7f7d1c068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:41.865 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:41.858+0000 7f7d3649c640 1 --2- 172.21.15.102:0/1379582386 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f7d1c066470 0x7f7d1c068930 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f7d200af000 tx=0x7f7d200b6040 comp rx=0 tx=0).stop 2023-11-13T11:29:41.865 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:41.858+0000 7f7d3649c640 1 -- 172.21.15.102:0/1379582386 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7d3015bac0 msgr2=0x7f7d3014e890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:41.865 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:41.858+0000 7f7d3649c640 1 --2- 172.21.15.102:0/1379582386 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7d3015bac0 0x7f7d3014e890 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f7d28007e60 tx=0x7f7d2800e4b0 comp rx=0 tx=0).stop 2023-11-13T11:29:41.865 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:41.858+0000 7f7d3649c640 1 -- 172.21.15.102:0/1379582386 shutdown_connections 2023-11-13T11:29:41.866 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:41.858+0000 7f7d3649c640 1 --2- 172.21.15.102:0/1379582386 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f7d1c066470 0x7f7d1c068930 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:41.866 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:41.858+0000 7f7d3649c640 1 --2- 172.21.15.102:0/1379582386 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7d3015bac0 0x7f7d3014e890 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:41.866 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:41.858+0000 7f7d3649c640 1 --2- 172.21.15.102:0/1379582386 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7d301553c0 0x7f7d301574d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:41.866 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:41.858+0000 7f7d3649c640 1 --2- 172.21.15.102:0/1379582386 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7d3006c800 0x7f7d300b2630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:41.867 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:41.858+0000 7f7d3649c640 1 -- 172.21.15.102:0/1379582386 >> 172.21.15.102:0/1379582386 conn(0x7f7d3006a410 msgr2=0x7f7d300cec90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-13T11:29:41.867 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:41.858+0000 7f7d3649c640 1 -- 172.21.15.102:0/1379582386 shutdown_connections 2023-11-13T11:29:41.867 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:41.858+0000 7f7d3649c640 1 -- 172.21.15.102:0/1379582386 wait complete. 2023-11-13T11:29:41.884 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-11-13T11:29:42.024 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:42.018+0000 7fa650a94640 1 Processor -- start 2023-11-13T11:29:42.024 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:42.018+0000 7fa650a94640 1 -- start start 2023-11-13T11:29:42.027 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:42.018+0000 7fa650a94640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fa64c1606e0 0x7fa64c0c69b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:42.028 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:42.018+0000 7fa650a94640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa64c0d1440 con 0x7fa64c0cf490 2023-11-13T11:29:42.028 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:42.018+0000 7fa650a94640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa64c0cdb10 con 0x7fa64c0d0c40 2023-11-13T11:29:42.028 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:42.018+0000 7fa650a94640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa64c0d1690 con 0x7fa64c1606e0 2023-11-13T11:29:42.029 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:42.018+0000 7fa64ad9d640 1 --1- >> v1:172.21.15.102:6789/0 conn(0x7fa64c0cf490 0x7fa64c0cdfc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.102:6789/0 says I am v1:172.21.15.102:45932/0 (socket says 172.21.15.102:45932) 2023-11-13T11:29:42.029 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:42.018+0000 7fa64ad9d640 1 -- 172.21.15.102:0/2539090631 learned_addr learned my addr 172.21.15.102:0/2539090631 (peer_addr_for_me v1:172.21.15.102:0/0) 2023-11-13T11:29:42.029 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:42.018+0000 7fa64a59c640 1 --2- 172.21.15.102:0/2539090631 >> v2:172.21.15.154:3300/0 conn(0x7fa64c1606e0 0x7fa64c0c69b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:42.029 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:42.018+0000 7fa649d9b640 1 -- 172.21.15.102:0/2539090631 <== mon.0 v1:172.21.15.102:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3826306707 0 0) 0x7fa64c0d1440 con 0x7fa64c0cf490 2023-11-13T11:29:42.030 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:42.018+0000 7fa649d9b640 1 -- 172.21.15.102:0/2539090631 --> v1:172.21.15.102:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa638003530 con 0x7fa64c0cf490 2023-11-13T11:29:42.030 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:42.018+0000 7fa649d9b640 1 -- 172.21.15.102:0/2539090631 <== mon.0 v1:172.21.15.102:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3519477064 0 0) 0x7fa638003530 con 0x7fa64c0cf490 2023-11-13T11:29:42.030 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:42.018+0000 7fa649d9b640 1 -- 172.21.15.102:0/2539090631 >> v2:172.21.15.154:3300/0 conn(0x7fa64c1606e0 msgr2=0x7fa64c0c69b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-13T11:29:42.030 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:42.018+0000 7fa649d9b640 1 --2- 172.21.15.102:0/2539090631 >> v2:172.21.15.154:3300/0 conn(0x7fa64c1606e0 0x7fa64c0c69b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:42.031 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:42.018+0000 7fa649d9b640 1 -- 172.21.15.102:0/2539090631 >> v1:172.21.15.154:6789/0 conn(0x7fa64c0d0c40 legacy=0x7fa64c0b3e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:42.031 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:42.018+0000 7fa649d9b640 1 -- 172.21.15.102:0/2539090631 --> v1:172.21.15.102:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa64c0d1970 con 0x7fa64c0cf490 2023-11-13T11:29:42.032 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:42.018+0000 7fa649d9b640 1 -- 172.21.15.102:0/2539090631 <== mon.0 v1:172.21.15.102:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 895381068 0 0) 0x7fa644001a00 con 0x7fa64c0cf490 2023-11-13T11:29:42.033 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:42.018+0000 7fa649d9b640 1 -- 172.21.15.102:0/2539090631 >> v1:172.21.15.102:6789/0 conn(0x7fa64c0cf490 legacy=0x7fa64c0cdfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:42.033 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:42.018+0000 7fa649d9b640 1 --2- 172.21.15.102:0/2539090631 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa6380039d0 0x7fa638003df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:42.034 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:42.018+0000 7fa649d9b640 1 --2- 172.21.15.102:0/2539090631 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa6380047d0 0x7fa638004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:42.034 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:42.018+0000 7fa649d9b640 1 --2- 172.21.15.102:0/2539090631 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa6380051e0 0x7fa63800b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:42.034 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:42.018+0000 7fa649d9b640 1 -- 172.21.15.102:0/2539090631 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa64c0d1690 con 0x7fa6380051e0 2023-11-13T11:29:42.034 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:42.018+0000 7fa649d9b640 1 -- 172.21.15.102:0/2539090631 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa63800c130 con 0x7fa6380039d0 2023-11-13T11:29:42.035 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:42.018+0000 7fa649d9b640 1 -- 172.21.15.102:0/2539090631 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa63800c2f0 con 0x7fa6380047d0 2023-11-13T11:29:42.035 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:42.018+0000 7fa64ad9d640 1 --2- 172.21.15.102:0/2539090631 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa6380051e0 0x7fa63800b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:42.035 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:42.018+0000 7fa64a59c640 1 --2- 172.21.15.102:0/2539090631 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa6380039d0 0x7fa638003df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:42.035 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:42.018+0000 7fa641d9b640 1 --2- 172.21.15.102:0/2539090631 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa6380047d0 0x7fa638004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:42.036 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:42.018+0000 7fa64ad9d640 1 -- 172.21.15.102:0/2539090631 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa6380047d0 msgr2=0x7fa638004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-13T11:29:42.036 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:42.018+0000 7fa64ad9d640 1 --2- 172.21.15.102:0/2539090631 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa6380047d0 0x7fa638004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:42.036 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:42.018+0000 7fa64ad9d640 1 -- 172.21.15.102:0/2539090631 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa6380039d0 msgr2=0x7fa638003df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-13T11:29:42.037 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:42.018+0000 7fa64ad9d640 1 --2- 172.21.15.102:0/2539090631 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa6380039d0 0x7fa638003df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:42.037 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:42.018+0000 7fa64ad9d640 1 -- 172.21.15.102:0/2539090631 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa638003530 con 0x7fa6380051e0 2023-11-13T11:29:42.038 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:42.018+0000 7fa64a59c640 1 --2- 172.21.15.102:0/2539090631 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa6380039d0 0x7fa638003df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-13T11:29:42.043 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:42.022+0000 7fa64ad9d640 1 -- 172.21.15.102:0/2539090631 reap_dead start 2023-11-13T11:29:42.043 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:42.022+0000 7fa64ad9d640 1 --2- 172.21.15.102:0/2539090631 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa6380051e0 0x7fa63800b990 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7fa644002240 tx=0x7fa64401f980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=362c6ebde583f7ca server_cookie=0 in_seq=0 out_seq=0 2023-11-13T11:29:42.043 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:42.022+0000 7fa649d9b640 1 -- 172.21.15.102:0/2539090631 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6440b0070 con 0x7fa6380051e0 2023-11-13T11:29:42.044 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:42.022+0000 7fa649d9b640 1 -- 172.21.15.102:0/2539090631 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa6440ac430 con 0x7fa6380051e0 2023-11-13T11:29:42.044 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:42.022+0000 7fa649d9b640 1 -- 172.21.15.102:0/2539090631 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6440ac7e0 con 0x7fa6380051e0 2023-11-13T11:29:42.044 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:42.022+0000 7fa650a94640 1 -- 172.21.15.102:0/2539090631 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa6380051e0 msgr2=0x7fa63800b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:42.044 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:42.022+0000 7fa650a94640 1 --2- 172.21.15.102:0/2539090631 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa6380051e0 0x7fa63800b990 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7fa644002240 tx=0x7fa64401f980 comp rx=0 tx=0).stop 2023-11-13T11:29:42.045 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:42.022+0000 7fa650a94640 1 -- 172.21.15.102:0/2539090631 shutdown_connections 2023-11-13T11:29:42.045 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:42.022+0000 7fa650a94640 1 --2- 172.21.15.102:0/2539090631 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa6380051e0 0x7fa63800b990 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:42.045 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:42.022+0000 7fa650a94640 1 -- 172.21.15.102:0/2539090631 >> 172.21.15.102:0/2539090631 conn(0x7fa64c09c130 msgr2=0x7fa64c0d2e60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-13T11:29:42.045 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:42.022+0000 7fa650a94640 1 -- 172.21.15.102:0/2539090631 shutdown_connections 2023-11-13T11:29:42.045 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:42.022+0000 7fa650a94640 1 -- 172.21.15.102:0/2539090631 wait complete. 2023-11-13T11:29:42.046 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:42.026+0000 7fa650a94640 1 Processor -- start 2023-11-13T11:29:42.046 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:42.026+0000 7fa650a94640 1 -- start start 2023-11-13T11:29:42.046 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:42.026+0000 7fa650a94640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa6380051e0 0x7fa64c15e270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:42.046 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:42.026+0000 7fa650a94640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa64c15cc70 0x7fa64c15a580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:42.046 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:42.026+0000 7fa650a94640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa64c0b7f20 0x7fa64c0b83a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:42.047 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:42.026+0000 7fa650a94640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa64c0b88e0 con 0x7fa64c0b7f20 2023-11-13T11:29:42.047 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:42.026+0000 7fa650a94640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa64c15d1c0 con 0x7fa6380051e0 2023-11-13T11:29:42.047 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:42.026+0000 7fa650a94640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa64c15d4a0 con 0x7fa64c15cc70 2023-11-13T11:29:42.047 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:42.026+0000 7fa64ad9d640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa64c0b7f20 0x7fa64c0b83a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:42.047 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:42.026+0000 7fa64ad9d640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa64c0b7f20 0x7fa64c0b83a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:45440/0 (socket says 172.21.15.102:45440) 2023-11-13T11:29:42.048 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:42.026+0000 7fa64ad9d640 1 -- 172.21.15.102:0/540911093 learned_addr learned my addr 172.21.15.102:0/540911093 (peer_addr_for_me v2:172.21.15.102:0/0) 2023-11-13T11:29:42.048 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:42.026+0000 7fa641d9b640 1 --2- 172.21.15.102:0/540911093 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa64c15cc70 0x7fa64c15a580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:42.048 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:42.026+0000 7fa64a59c640 1 --2- 172.21.15.102:0/540911093 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa6380051e0 0x7fa64c15e270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:42.048 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:42.026+0000 7fa64ad9d640 1 -- 172.21.15.102:0/540911093 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa64c15cc70 msgr2=0x7fa64c15a580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:42.048 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:42.026+0000 7fa64ad9d640 1 --2- 172.21.15.102:0/540911093 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa64c15cc70 0x7fa64c15a580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:42.049 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:42.026+0000 7fa64ad9d640 1 -- 172.21.15.102:0/540911093 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa6380051e0 msgr2=0x7fa64c15e270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:42.049 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:42.026+0000 7fa64ad9d640 1 --2- 172.21.15.102:0/540911093 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa6380051e0 0x7fa64c15e270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:42.049 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:42.026+0000 7fa64ad9d640 1 -- 172.21.15.102:0/540911093 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa64c15d780 con 0x7fa64c0b7f20 2023-11-13T11:29:42.049 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:42.026+0000 7fa641d9b640 1 --2- 172.21.15.102:0/540911093 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa64c15cc70 0x7fa64c15a580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-13T11:29:42.049 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:42.026+0000 7fa64ad9d640 1 --2- 172.21.15.102:0/540911093 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa64c0b7f20 0x7fa64c0b83a0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7fa64401f7b0 tx=0x7fa638005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-13T11:29:42.050 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:42.026+0000 7fa6437fe640 1 -- 172.21.15.102:0/540911093 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6440b0040 con 0x7fa64c0b7f20 2023-11-13T11:29:42.050 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:42.030+0000 7fa6437fe640 1 -- 172.21.15.102:0/540911093 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa6440ac7a0 con 0x7fa64c0b7f20 2023-11-13T11:29:42.050 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:42.030+0000 7fa6437fe640 1 -- 172.21.15.102:0/540911093 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6440acb30 con 0x7fa64c0b7f20 2023-11-13T11:29:42.050 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:42.030+0000 7fa650a94640 1 -- 172.21.15.102:0/540911093 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa64c15da60 con 0x7fa64c0b7f20 2023-11-13T11:29:42.051 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:42.030+0000 7fa650a94640 1 -- 172.21.15.102:0/540911093 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa64c15aac0 con 0x7fa64c0b7f20 2023-11-13T11:29:42.051 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:42.030+0000 7fa650a94640 1 -- 172.21.15.102:0/540911093 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa64c068520 con 0x7fa64c0b7f20 2023-11-13T11:29:42.051 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:42.030+0000 7fa6437fe640 1 -- 172.21.15.102:0/540911093 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fa6440aa040 con 0x7fa64c0b7f20 2023-11-13T11:29:42.052 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:42.030+0000 7fa6437fe640 1 --2- 172.21.15.102:0/540911093 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7fa62c0664a0 0x7fa62c068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:42.052 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:42.030+0000 7fa6437fe640 1 -- 172.21.15.102:0/540911093 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 5738+0+0 (secure 0 0 0) 0x7fa644120c20 con 0x7fa64c0b7f20 2023-11-13T11:29:42.052 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:42.030+0000 7fa64a59c640 1 --2- 172.21.15.102:0/540911093 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7fa62c0664a0 0x7fa62c068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:42.052 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:42.030+0000 7fa64a59c640 1 --2- 172.21.15.102:0/540911093 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7fa62c0664a0 0x7fa62c068960 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fa63c009b60 tx=0x7fa63c009190 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-13T11:29:42.052 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:42.034+0000 7fa6437fe640 1 -- 172.21.15.102:0/540911093 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fa6440edfe0 con 0x7fa64c0b7f20 2023-11-13T11:29:42.201 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:42.194+0000 7fa650a94640 1 -- 172.21.15.102:0/540911093 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fa64c0d0410 con 0x7fa64c0b7f20 2023-11-13T11:29:42.201 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:42.194+0000 7fa6437fe640 1 -- 172.21.15.102:0/540911093 <== mon.0 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v24) v1 ==== 80+0+0 (secure 0 0 0) 0x7fa6440f1600 con 0x7fa64c0b7f20 2023-11-13T11:29:42.202 INFO:teuthology.orchestra.run.smithi102.stderr:listed 0 entries 2023-11-13T11:29:42.203 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:42.198+0000 7fa650a94640 1 -- 172.21.15.102:0/540911093 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7fa62c0664a0 msgr2=0x7fa62c068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:42.203 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:42.198+0000 7fa650a94640 1 --2- 172.21.15.102:0/540911093 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7fa62c0664a0 0x7fa62c068960 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fa63c009b60 tx=0x7fa63c009190 comp rx=0 tx=0).stop 2023-11-13T11:29:42.204 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:42.198+0000 7fa650a94640 1 -- 172.21.15.102:0/540911093 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa64c0b7f20 msgr2=0x7fa64c0b83a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:42.204 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:42.198+0000 7fa650a94640 1 --2- 172.21.15.102:0/540911093 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa64c0b7f20 0x7fa64c0b83a0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7fa64401f7b0 tx=0x7fa638005800 comp rx=0 tx=0).stop 2023-11-13T11:29:42.204 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:42.198+0000 7fa650a94640 1 -- 172.21.15.102:0/540911093 shutdown_connections 2023-11-13T11:29:42.204 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:42.198+0000 7fa650a94640 1 --2- 172.21.15.102:0/540911093 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7fa62c0664a0 0x7fa62c068960 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:42.204 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:42.198+0000 7fa650a94640 1 --2- 172.21.15.102:0/540911093 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa64c0b7f20 0x7fa64c0b83a0 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:42.205 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:42.198+0000 7fa650a94640 1 --2- 172.21.15.102:0/540911093 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa64c15cc70 0x7fa64c15a580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:42.205 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:42.198+0000 7fa650a94640 1 --2- 172.21.15.102:0/540911093 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa6380051e0 0x7fa64c15e270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:42.205 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:42.198+0000 7fa650a94640 1 -- 172.21.15.102:0/540911093 >> 172.21.15.102:0/540911093 conn(0x7fa64c09c130 msgr2=0x7fa64c0ce610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-13T11:29:42.205 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:42.198+0000 7fa650a94640 1 -- 172.21.15.102:0/540911093 shutdown_connections 2023-11-13T11:29:42.205 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:42.198+0000 7fa650a94640 1 -- 172.21.15.102:0/540911093 wait complete. 2023-11-13T11:29:42.222 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi154.front.sepia.ceph.com... 2023-11-13T11:29:42.223 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-13T11:29:42.223 DEBUG:teuthology.orchestra.run.smithi154:> sudo fusermount -u /home/ubuntu/cephtest/mnt.3 2023-11-13T11:29:42.247 INFO:teuthology.orchestra.run:waiting for 300 2023-11-13T11:29:42.248 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi154.front.sepia.ceph.com 2023-11-13T11:29:42.248 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-13T11:29:42.249 DEBUG:teuthology.orchestra.run.smithi154:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2023-11-13T11:29:42.306 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-11-13T11:29:42.307 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-13T11:29:42.444 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:42.438+0000 7fc97f205640 1 Processor -- start 2023-11-13T11:29:42.445 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:42.438+0000 7fc97f205640 1 -- start start 2023-11-13T11:29:42.447 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:42.438+0000 7fc97f205640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc9780cfba0 0x7fc9780c69b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:42.447 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:42.438+0000 7fc97f205640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc9780d1440 con 0x7fc9780d0c40 2023-11-13T11:29:42.448 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:42.438+0000 7fc97f205640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc9780cdb10 con 0x7fc9781606e0 2023-11-13T11:29:42.448 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:42.438+0000 7fc97f205640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc9780d1690 con 0x7fc9780cfba0 2023-11-13T11:29:42.448 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:42.438+0000 7fc96ffff640 1 --1- >> v1:172.21.15.102:6789/0 conn(0x7fc9780d0c40 0x7fc9780cf490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.102:6789/0 says I am v1:172.21.15.102:45948/0 (socket says 172.21.15.102:45948) 2023-11-13T11:29:42.448 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:42.438+0000 7fc96ffff640 1 -- 172.21.15.102:0/1258046180 learned_addr learned my addr 172.21.15.102:0/1258046180 (peer_addr_for_me v1:172.21.15.102:0/0) 2023-11-13T11:29:42.448 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:42.438+0000 7fc97d7a2640 1 --2- 172.21.15.102:0/1258046180 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc9780cfba0 0x7fc9780c69b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:42.449 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:42.438+0000 7fc96f7fe640 1 -- 172.21.15.102:0/1258046180 <== mon.0 v1:172.21.15.102:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1884995572 0 0) 0x7fc9780d1440 con 0x7fc9780d0c40 2023-11-13T11:29:42.449 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:42.438+0000 7fc96f7fe640 1 -- 172.21.15.102:0/1258046180 --> v1:172.21.15.102:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc960003530 con 0x7fc9780d0c40 2023-11-13T11:29:42.449 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:42.438+0000 7fc96f7fe640 1 -- 172.21.15.102:0/1258046180 <== mon.1 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3022705455 0 0) 0x7fc9780cdb10 con 0x7fc9781606e0 2023-11-13T11:29:42.449 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:42.438+0000 7fc96f7fe640 1 -- 172.21.15.102:0/1258046180 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc9780d1440 con 0x7fc9781606e0 2023-11-13T11:29:42.449 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:42.438+0000 7fc96f7fe640 1 -- 172.21.15.102:0/1258046180 <== mon.0 v1:172.21.15.102:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3578416255 0 0) 0x7fc960003530 con 0x7fc9780d0c40 2023-11-13T11:29:42.449 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:42.438+0000 7fc96f7fe640 1 -- 172.21.15.102:0/1258046180 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc9780cfba0 msgr2=0x7fc9780c69b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-13T11:29:42.450 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:42.438+0000 7fc96f7fe640 1 --2- 172.21.15.102:0/1258046180 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc9780cfba0 0x7fc9780c69b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:42.450 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:42.438+0000 7fc96f7fe640 1 -- 172.21.15.102:0/1258046180 >> v1:172.21.15.154:6789/0 conn(0x7fc9781606e0 legacy=0x7fc9780b3e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:42.450 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:42.438+0000 7fc96f7fe640 1 -- 172.21.15.102:0/1258046180 --> v1:172.21.15.102:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9780d1970 con 0x7fc9780d0c40 2023-11-13T11:29:42.451 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:42.438+0000 7fc96f7fe640 1 -- 172.21.15.102:0/1258046180 <== mon.0 v1:172.21.15.102:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 895381068 0 0) 0x7fc968001680 con 0x7fc9780d0c40 2023-11-13T11:29:42.451 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:42.438+0000 7fc96f7fe640 1 -- 172.21.15.102:0/1258046180 >> v1:172.21.15.102:6789/0 conn(0x7fc9780d0c40 legacy=0x7fc9780cf490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:42.451 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:42.438+0000 7fc96f7fe640 1 --2- 172.21.15.102:0/1258046180 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc960003b40 0x7fc960003f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:42.452 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:42.438+0000 7fc96f7fe640 1 --2- 172.21.15.102:0/1258046180 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc9600047d0 0x7fc960004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:42.452 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:42.438+0000 7fc96f7fe640 1 --2- 172.21.15.102:0/1258046180 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc9780cfba0 0x7fc9600051b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:42.452 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:42.438+0000 7fc96f7fe640 1 -- 172.21.15.102:0/1258046180 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9780d1690 con 0x7fc960003b40 2023-11-13T11:29:42.452 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:42.438+0000 7fc96f7fe640 1 -- 172.21.15.102:0/1258046180 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc96000bad0 con 0x7fc9600047d0 2023-11-13T11:29:42.453 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:42.438+0000 7fc96f7fe640 1 -- 172.21.15.102:0/1258046180 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc96000bc90 con 0x7fc9780cfba0 2023-11-13T11:29:42.453 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:42.438+0000 7fc97cfa1640 1 --2- 172.21.15.102:0/1258046180 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc960003b40 0x7fc960003f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:42.453 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:42.438+0000 7fc97d7a2640 1 --2- 172.21.15.102:0/1258046180 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc9780cfba0 0x7fc9600051b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:42.453 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:42.438+0000 7fc96ffff640 1 --2- 172.21.15.102:0/1258046180 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc9600047d0 0x7fc960004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:42.453 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:42.442+0000 7fc97cfa1640 1 -- 172.21.15.102:0/1258046180 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc9780cfba0 msgr2=0x7fc9600051b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-13T11:29:42.454 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:42.442+0000 7fc97cfa1640 1 --2- 172.21.15.102:0/1258046180 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc9780cfba0 0x7fc9600051b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:42.454 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:42.442+0000 7fc97cfa1640 1 -- 172.21.15.102:0/1258046180 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc9600047d0 msgr2=0x7fc960004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-13T11:29:42.454 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:42.442+0000 7fc97cfa1640 1 --2- 172.21.15.102:0/1258046180 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc9600047d0 0x7fc960004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:42.455 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:42.442+0000 7fc97cfa1640 1 -- 172.21.15.102:0/1258046180 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc960003530 con 0x7fc960003b40 2023-11-13T11:29:42.455 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:42.442+0000 7fc97d7a2640 1 --2- 172.21.15.102:0/1258046180 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc9780cfba0 0x7fc9600051b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-13T11:29:42.455 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:42.442+0000 7fc96ffff640 1 --2- 172.21.15.102:0/1258046180 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc9600047d0 0x7fc960004c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-13T11:29:42.458 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:42.442+0000 7fc97cfa1640 1 --2- 172.21.15.102:0/1258046180 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc960003b40 0x7fc960003f40 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7fc9740018d0 tx=0x7fc97401c560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5c862bbee72cc7b7 server_cookie=0 in_seq=0 out_seq=0 2023-11-13T11:29:42.459 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:42.442+0000 7fc96f7fe640 1 -- 172.21.15.102:0/1258046180 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9740052d0 con 0x7fc960003b40 2023-11-13T11:29:42.459 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:42.442+0000 7fc96f7fe640 1 -- 172.21.15.102:0/1258046180 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc974005450 con 0x7fc960003b40 2023-11-13T11:29:42.459 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:42.442+0000 7fc96f7fe640 1 -- 172.21.15.102:0/1258046180 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc974003840 con 0x7fc960003b40 2023-11-13T11:29:42.459 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:42.442+0000 7fc97f205640 1 -- 172.21.15.102:0/1258046180 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc960003b40 msgr2=0x7fc960003f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:42.459 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:42.442+0000 7fc97f205640 1 --2- 172.21.15.102:0/1258046180 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc960003b40 0x7fc960003f40 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7fc9740018d0 tx=0x7fc97401c560 comp rx=0 tx=0).stop 2023-11-13T11:29:42.460 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:42.442+0000 7fc97d7a2640 1 -- 172.21.15.102:0/1258046180 reap_dead start 2023-11-13T11:29:42.460 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:42.442+0000 7fc97f205640 1 -- 172.21.15.102:0/1258046180 shutdown_connections 2023-11-13T11:29:42.460 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:42.442+0000 7fc97f205640 1 -- 172.21.15.102:0/1258046180 >> 172.21.15.102:0/1258046180 conn(0x7fc97809c130 msgr2=0x7fc9780d2e60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-13T11:29:42.460 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:42.442+0000 7fc97f205640 1 -- 172.21.15.102:0/1258046180 shutdown_connections 2023-11-13T11:29:42.461 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:42.442+0000 7fc97f205640 1 -- 172.21.15.102:0/1258046180 wait complete. 2023-11-13T11:29:42.461 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:42.446+0000 7fc97f205640 1 Processor -- start 2023-11-13T11:29:42.461 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:42.446+0000 7fc97f205640 1 -- start start 2023-11-13T11:29:42.461 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:42.446+0000 7fc97f205640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc960003b40 0x7fc97809caa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:42.461 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:42.446+0000 7fc97f205640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc9780cc360 0x7fc97809e310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:42.462 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:42.446+0000 7fc97f205640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc9780cc7e0 0x7fc97809e850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:42.462 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:42.446+0000 7fc97f205640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9781564b0 con 0x7fc9780cc7e0 2023-11-13T11:29:42.462 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:42.446+0000 7fc97f205640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9780b1290 con 0x7fc9780cc360 2023-11-13T11:29:42.463 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:42.446+0000 7fc97f205640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc9780b0400 con 0x7fc960003b40 2023-11-13T11:29:42.463 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:42.446+0000 7fc97d7a2640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc9780cc7e0 0x7fc97809e850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:42.463 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:42.446+0000 7fc97d7a2640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc9780cc7e0 0x7fc97809e850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:45468/0 (socket says 172.21.15.102:45468) 2023-11-13T11:29:42.463 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:42.446+0000 7fc97d7a2640 1 -- 172.21.15.102:0/3562523231 learned_addr learned my addr 172.21.15.102:0/3562523231 (peer_addr_for_me v2:172.21.15.102:0/0) 2023-11-13T11:29:42.463 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:42.446+0000 7fc96ffff640 1 --2- 172.21.15.102:0/3562523231 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc9780cc360 0x7fc97809e310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:42.464 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:42.446+0000 7fc97d7a2640 1 -- 172.21.15.102:0/3562523231 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc960003b40 msgr2=0x7fc97809caa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:42.464 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:42.446+0000 7fc97d7a2640 1 --2- 172.21.15.102:0/3562523231 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc960003b40 0x7fc97809caa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:42.464 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:42.446+0000 7fc97d7a2640 1 -- 172.21.15.102:0/3562523231 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc9780cc360 msgr2=0x7fc97809e310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:42.465 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:42.446+0000 7fc97d7a2640 1 --2- 172.21.15.102:0/3562523231 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc9780cc360 0x7fc97809e310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:42.465 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:42.446+0000 7fc97d7a2640 1 -- 172.21.15.102:0/3562523231 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9780b0680 con 0x7fc9780cc7e0 2023-11-13T11:29:42.465 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:42.446+0000 7fc96ffff640 1 --2- 172.21.15.102:0/3562523231 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc9780cc360 0x7fc97809e310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-13T11:29:42.465 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:42.446+0000 7fc97d7a2640 1 --2- 172.21.15.102:0/3562523231 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc9780cc7e0 0x7fc97809e850 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7fc97809c5f0 tx=0x7fc970009f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-13T11:29:42.465 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:42.446+0000 7fc96d7fa640 1 -- 172.21.15.102:0/3562523231 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc97001b070 con 0x7fc9780cc7e0 2023-11-13T11:29:42.466 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:42.446+0000 7fc96d7fa640 1 -- 172.21.15.102:0/3562523231 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc97000f040 con 0x7fc9780cc7e0 2023-11-13T11:29:42.466 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:42.446+0000 7fc96d7fa640 1 -- 172.21.15.102:0/3562523231 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc97000e050 con 0x7fc9780cc7e0 2023-11-13T11:29:42.466 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:42.450+0000 7fc97f205640 1 -- 172.21.15.102:0/3562523231 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc9780b0960 con 0x7fc9780cc7e0 2023-11-13T11:29:42.466 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:42.450+0000 7fc97f205640 1 -- 172.21.15.102:0/3562523231 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc9780b0f20 con 0x7fc9780cc7e0 2023-11-13T11:29:42.466 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:42.450+0000 7fc97f205640 1 -- 172.21.15.102:0/3562523231 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc978068520 con 0x7fc9780cc7e0 2023-11-13T11:29:42.467 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:42.450+0000 7fc96d7fa640 1 -- 172.21.15.102:0/3562523231 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fc970015440 con 0x7fc9780cc7e0 2023-11-13T11:29:42.467 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:42.450+0000 7fc96d7fa640 1 --2- 172.21.15.102:0/3562523231 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7fc964066470 0x7fc964068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:42.467 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:42.450+0000 7fc96d7fa640 1 -- 172.21.15.102:0/3562523231 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 5738+0+0 (secure 0 0 0) 0x7fc9700843c0 con 0x7fc9780cc7e0 2023-11-13T11:29:42.467 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:42.450+0000 7fc97cfa1640 1 --2- 172.21.15.102:0/3562523231 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7fc964066470 0x7fc964068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:42.468 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:42.450+0000 7fc97cfa1640 1 --2- 172.21.15.102:0/3562523231 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7fc964066470 0x7fc964068930 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fc9740ad000 tx=0x7fc9740012e0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-13T11:29:42.468 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:42.454+0000 7fc96d7fa640 1 -- 172.21.15.102:0/3562523231 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fc970051820 con 0x7fc9780cc7e0 2023-11-13T11:29:42.641 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:42.634+0000 7fc97f205640 1 -- 172.21.15.102:0/3562523231 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc9780b13d0 con 0x7fc9780cc7e0 2023-11-13T11:29:42.641 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:42.634+0000 7fc96d7fa640 1 -- 172.21.15.102:0/3562523231 <== mon.0 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4913 (secure 0 0 0) 0x7fc9780b13d0 con 0x7fc9780cc7e0 2023-11-13T11:29:42.642 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T11:29:42.642 INFO:teuthology.orchestra.run.smithi102.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4226,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.102:6836/659983176","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6835","nonce":659983176},{"type":"v1","addr":"172.21.15.102:6836","nonce":659983176}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4270,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.102:6837/1874856825","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6834","nonce":1874856825},{"type":"v1","addr":"172.21.15.102:6837","nonce":1874856825}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4276,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6834/532911681","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6832","nonce":532911681},{"type":"v1","addr":"172.21.15.154:6834","nonce":532911681}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-13T11:28:57.401001+0000","modified":"2023-11-13T11:29:00.404631+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4279},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4279":{"gid":4279,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.154:6835/3766337294","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6833","nonce":3766337294},{"type":"v1","addr":"172.21.15.154:6835","nonce":3766337294}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-11-13T11:29:42.643 INFO:teuthology.orchestra.run.smithi102.stderr:dumped fsmap epoch 8 2023-11-13T11:29:42.643 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:42.638+0000 7fc97f205640 1 -- 172.21.15.102:0/3562523231 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7fc964066470 msgr2=0x7fc964068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:42.644 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:42.638+0000 7fc97f205640 1 --2- 172.21.15.102:0/3562523231 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7fc964066470 0x7fc964068930 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fc9740ad000 tx=0x7fc9740012e0 comp rx=0 tx=0).stop 2023-11-13T11:29:42.644 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:42.638+0000 7fc97f205640 1 -- 172.21.15.102:0/3562523231 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc9780cc7e0 msgr2=0x7fc97809e850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:42.644 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:42.638+0000 7fc97f205640 1 --2- 172.21.15.102:0/3562523231 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc9780cc7e0 0x7fc97809e850 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7fc97809c5f0 tx=0x7fc970009f90 comp rx=0 tx=0).stop 2023-11-13T11:29:42.644 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:42.638+0000 7fc97f205640 1 -- 172.21.15.102:0/3562523231 shutdown_connections 2023-11-13T11:29:42.644 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:42.638+0000 7fc97f205640 1 --2- 172.21.15.102:0/3562523231 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7fc964066470 0x7fc964068930 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:42.645 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:42.638+0000 7fc97f205640 1 --2- 172.21.15.102:0/3562523231 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc9780cc7e0 0x7fc97809e850 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:42.645 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:42.638+0000 7fc97f205640 1 --2- 172.21.15.102:0/3562523231 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc9780cc360 0x7fc97809e310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:42.645 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:42.638+0000 7fc97f205640 1 --2- 172.21.15.102:0/3562523231 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc960003b40 0x7fc97809caa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:42.645 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:42.638+0000 7fc97f205640 1 -- 172.21.15.102:0/3562523231 >> 172.21.15.102:0/3562523231 conn(0x7fc97809c130 msgr2=0x7fc97806c3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-13T11:29:42.645 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:42.638+0000 7fc97f205640 1 -- 172.21.15.102:0/3562523231 shutdown_connections 2023-11-13T11:29:42.646 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:42.638+0000 7fc97f205640 1 -- 172.21.15.102:0/3562523231 wait complete. 2023-11-13T11:29:42.664 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-13T11:29:42.802 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:42.794+0000 7f7c9ecfe640 1 Processor -- start 2023-11-13T11:29:42.802 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:42.794+0000 7f7c9ecfe640 1 -- start start 2023-11-13T11:29:42.803 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:42.798+0000 7f7c9ecfe640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7c98159420 0x7f7c9806d8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:42.804 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:42.798+0000 7f7c9ecfe640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f7c980cae80 0x7f7c980cd250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:42.804 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:42.798+0000 7f7c9ecfe640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7c9806dde0 con 0x7f7c9806c270 2023-11-13T11:29:42.804 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:42.798+0000 7f7c9ecfe640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7c9806c800 con 0x7f7c980cae80 2023-11-13T11:29:42.804 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:42.798+0000 7f7c9ecfe640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c9806cae0 con 0x7f7c98159420 2023-11-13T11:29:42.804 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:42.798+0000 7f7c8ffff640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f7c980cae80 0x7f7c980cd250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:42.805 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:42.798+0000 7f7c9ca9a640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7c98159420 0x7f7c9806d8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:42.805 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:42.798+0000 7f7c9d29b640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f7c9806c270 0x7f7c980b1b70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.102:59280/0 (socket says 172.21.15.102:59280) 2023-11-13T11:29:42.805 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:42.798+0000 7f7c9d29b640 1 -- 172.21.15.102:0/2483347931 learned_addr learned my addr 172.21.15.102:0/2483347931 (peer_addr_for_me v1:172.21.15.102:0/0) 2023-11-13T11:29:42.806 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:42.798+0000 7f7c8f7fe640 1 -- 172.21.15.102:0/2483347931 <== mon.1 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3587382175 0 0) 0x7f7c9806dde0 con 0x7f7c9806c270 2023-11-13T11:29:42.806 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:42.798+0000 7f7c8f7fe640 1 -- 172.21.15.102:0/2483347931 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7c80003530 con 0x7f7c9806c270 2023-11-13T11:29:42.806 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:42.798+0000 7f7c9ca9a640 1 -- 172.21.15.102:0/2483347931 >> v2:172.21.15.154:3300/0 conn(0x7f7c980cae80 msgr2=0x7f7c980cd250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-13T11:29:42.807 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:42.798+0000 7f7c9ca9a640 1 --2- 172.21.15.102:0/2483347931 >> v2:172.21.15.154:3300/0 conn(0x7f7c980cae80 0x7f7c980cd250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:42.807 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:42.798+0000 7f7c9ca9a640 1 -- 172.21.15.102:0/2483347931 >> v1:172.21.15.154:6789/0 conn(0x7f7c9806c270 legacy=0x7f7c980b1b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:42.807 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:42.798+0000 7f7c9ca9a640 1 -- 172.21.15.102:0/2483347931 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c9806cdc0 con 0x7f7c98159420 2023-11-13T11:29:42.807 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:42.798+0000 7f7c8ffff640 1 --2- 172.21.15.102:0/2483347931 >> v2:172.21.15.154:3300/0 conn(0x7f7c980cae80 0x7f7c980cd250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-13T11:29:42.808 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:42.802+0000 7f7c9ca9a640 1 --2- 172.21.15.102:0/2483347931 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7c98159420 0x7f7c9806d8a0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f7c940097c0 tx=0x7f7c9401ec70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=339068944d42f09e server_cookie=0 in_seq=0 out_seq=0 2023-11-13T11:29:42.809 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:42.802+0000 7f7c8f7fe640 1 -- 172.21.15.102:0/2483347931 <== mon.2 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c940a8970 con 0x7f7c98159420 2023-11-13T11:29:42.809 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:42.802+0000 7f7c8f7fe640 1 -- 172.21.15.102:0/2483347931 <== mon.2 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c940a8ad0 con 0x7f7c98159420 2023-11-13T11:29:42.809 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:42.802+0000 7f7c8f7fe640 1 -- 172.21.15.102:0/2483347931 <== mon.2 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c940a8e60 con 0x7f7c98159420 2023-11-13T11:29:42.810 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:42.802+0000 7f7c9ecfe640 1 -- 172.21.15.102:0/2483347931 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7c98159420 msgr2=0x7f7c9806d8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:42.810 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:42.802+0000 7f7c9ecfe640 1 --2- 172.21.15.102:0/2483347931 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7c98159420 0x7f7c9806d8a0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f7c940097c0 tx=0x7f7c9401ec70 comp rx=0 tx=0).stop 2023-11-13T11:29:42.810 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:42.802+0000 7f7c9ecfe640 1 -- 172.21.15.102:0/2483347931 shutdown_connections 2023-11-13T11:29:42.810 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:42.802+0000 7f7c9ecfe640 1 --2- 172.21.15.102:0/2483347931 >> v2:172.21.15.154:3300/0 conn(0x7f7c980cae80 0x7f7c980cd250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:42.810 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:42.802+0000 7f7c9ecfe640 1 --2- 172.21.15.102:0/2483347931 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7c98159420 0x7f7c9806d8a0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:42.811 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:42.802+0000 7f7c9ecfe640 1 -- 172.21.15.102:0/2483347931 >> 172.21.15.102:0/2483347931 conn(0x7f7c980b0870 msgr2=0x7f7c980b0c80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-13T11:29:42.811 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:42.802+0000 7f7c9ecfe640 1 -- 172.21.15.102:0/2483347931 shutdown_connections 2023-11-13T11:29:42.811 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:42.802+0000 7f7c9ecfe640 1 -- 172.21.15.102:0/2483347931 wait complete. 2023-11-13T11:29:42.813 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:42.802+0000 7f7c9ecfe640 1 Processor -- start 2023-11-13T11:29:42.813 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:42.802+0000 7f7c9ecfe640 1 -- start start 2023-11-13T11:29:42.813 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:42.806+0000 7f7c9ecfe640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7c9806c270 0x7f7c981470d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:42.814 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:42.806+0000 7f7c9ecfe640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7c980cae80 0x7f7c98142f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:42.814 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:42.806+0000 7f7c9ecfe640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7c98159420 0x7f7c98155910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:42.814 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:42.806+0000 7f7c9ecfe640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c98146d80 con 0x7f7c980cae80 2023-11-13T11:29:42.814 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:42.806+0000 7f7c9ecfe640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c981466a0 con 0x7f7c9806c270 2023-11-13T11:29:42.815 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:42.806+0000 7f7c9ecfe640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c98147610 con 0x7f7c98159420 2023-11-13T11:29:42.815 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:42.806+0000 7f7c8ffff640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7c980cae80 0x7f7c98142f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:42.815 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:42.806+0000 7f7c8ffff640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7c980cae80 0x7f7c98142f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:45474/0 (socket says 172.21.15.102:45474) 2023-11-13T11:29:42.815 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:42.806+0000 7f7c8ffff640 1 -- 172.21.15.102:0/2606971283 learned_addr learned my addr 172.21.15.102:0/2606971283 (peer_addr_for_me v2:172.21.15.102:0/0) 2023-11-13T11:29:42.815 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:42.806+0000 7f7c9ca9a640 1 --2- 172.21.15.102:0/2606971283 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7c9806c270 0x7f7c981470d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:42.816 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:42.806+0000 7f7c9d29b640 1 --2- 172.21.15.102:0/2606971283 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7c98159420 0x7f7c98155910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:42.816 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:42.806+0000 7f7c8ffff640 1 -- 172.21.15.102:0/2606971283 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7c98159420 msgr2=0x7f7c98155910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:42.816 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:42.806+0000 7f7c8ffff640 1 --2- 172.21.15.102:0/2606971283 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7c98159420 0x7f7c98155910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:42.816 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:42.806+0000 7f7c8ffff640 1 -- 172.21.15.102:0/2606971283 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7c9806c270 msgr2=0x7f7c981470d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:42.816 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:42.806+0000 7f7c8ffff640 1 --2- 172.21.15.102:0/2606971283 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7c9806c270 0x7f7c981470d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:42.817 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:42.806+0000 7f7c8ffff640 1 -- 172.21.15.102:0/2606971283 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c8800a5c0 con 0x7f7c980cae80 2023-11-13T11:29:42.817 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:42.806+0000 7f7c8ffff640 1 --2- 172.21.15.102:0/2606971283 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7c980cae80 0x7f7c98142f90 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f7c8800e980 tx=0x7f7c8800ee40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-13T11:29:42.817 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:42.806+0000 7f7c8d7fa640 1 -- 172.21.15.102:0/2606971283 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c8800cca0 con 0x7f7c980cae80 2023-11-13T11:29:42.817 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:42.806+0000 7f7c8d7fa640 1 -- 172.21.15.102:0/2606971283 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c8800ce00 con 0x7f7c980cae80 2023-11-13T11:29:42.818 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:42.806+0000 7f7c9ecfe640 1 -- 172.21.15.102:0/2606971283 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7c94009420 con 0x7f7c980cae80 2023-11-13T11:29:42.818 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:42.806+0000 7f7c8d7fa640 1 -- 172.21.15.102:0/2606971283 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c88011610 con 0x7f7c980cae80 2023-11-13T11:29:42.818 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:42.806+0000 7f7c9ecfe640 1 -- 172.21.15.102:0/2606971283 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7c98148350 con 0x7f7c980cae80 2023-11-13T11:29:42.818 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:42.806+0000 7f7c9ecfe640 1 -- 172.21.15.102:0/2606971283 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7c981490c0 con 0x7f7c980cae80 2023-11-13T11:29:42.820 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:42.806+0000 7f7c8d7fa640 1 -- 172.21.15.102:0/2606971283 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f7c88011770 con 0x7f7c980cae80 2023-11-13T11:29:42.820 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:42.810+0000 7f7c8d7fa640 1 --2- 172.21.15.102:0/2606971283 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f7c84066470 0x7f7c84068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:42.820 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:42.810+0000 7f7c8d7fa640 1 -- 172.21.15.102:0/2606971283 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 5738+0+0 (secure 0 0 0) 0x7f7c88083de0 con 0x7f7c980cae80 2023-11-13T11:29:42.820 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:42.810+0000 7f7c9ca9a640 1 --2- 172.21.15.102:0/2606971283 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f7c84066470 0x7f7c84068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:42.821 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:42.810+0000 7f7c9ca9a640 1 --2- 172.21.15.102:0/2606971283 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f7c84066470 0x7f7c84068930 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f7c940b2000 tx=0x7f7c940aa070 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-13T11:29:42.821 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:42.814+0000 7f7c8d7fa640 1 -- 172.21.15.102:0/2606971283 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f7c88051250 con 0x7f7c980cae80 2023-11-13T11:29:42.972 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:42.966+0000 7f7c9ecfe640 1 -- 172.21.15.102:0/2606971283 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7c98068520 con 0x7f7c980cae80 2023-11-13T11:29:42.973 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:42.966+0000 7f7c8d7fa640 1 -- 172.21.15.102:0/2606971283 <== mon.0 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+16594 (secure 0 0 0) 0x7f7c880810f0 con 0x7f7c980cae80 2023-11-13T11:29:42.973 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T11:29:42.974 INFO:teuthology.orchestra.run.smithi102.stdout:{"epoch":24,"fsid":"97b3eb2b-7ccf-4aae-8d92-bff986c671ea","created":"2023-11-13T11:28:31.836724+0000","modified":"2023-11-13T11:29:38.698982+0000","last_up_change":"2023-11-13T11:28:44.876638+0000","last_in_change":"2023-11-13T11:28:35.312740+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-13T11:28:44.981356+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-13T11:28:55.958525+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-13T11:28:56.394264+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"bdefaa17-fcca-4c86-aa40-27dc33a789af","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6800","nonce":53303834},{"type":"v1","addr":"172.21.15.102:6801","nonce":53303834}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6802","nonce":53303834},{"type":"v1","addr":"172.21.15.102:6803","nonce":53303834}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6806","nonce":53303834},{"type":"v1","addr":"172.21.15.102:6807","nonce":53303834}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6804","nonce":53303834},{"type":"v1","addr":"172.21.15.102:6805","nonce":53303834}]},"public_addr":"172.21.15.102:6801/53303834","cluster_addr":"172.21.15.102:6803/53303834","heartbeat_back_addr":"172.21.15.102:6807/53303834","heartbeat_front_addr":"172.21.15.102:6805/53303834","state":["exists","up"]},{"osd":1,"uuid":"f0033196-dec9-4ae9-945e-6aeef6dbb47f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6808","nonce":1732708348},{"type":"v1","addr":"172.21.15.102:6809","nonce":1732708348}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6811","nonce":1732708348},{"type":"v1","addr":"172.21.15.102:6813","nonce":1732708348}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6818","nonce":1732708348},{"type":"v1","addr":"172.21.15.102:6820","nonce":1732708348}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6815","nonce":1732708348},{"type":"v1","addr":"172.21.15.102:6817","nonce":1732708348}]},"public_addr":"172.21.15.102:6809/1732708348","cluster_addr":"172.21.15.102:6813/1732708348","heartbeat_back_addr":"172.21.15.102:6820/1732708348","heartbeat_front_addr":"172.21.15.102:6817/1732708348","state":["exists","up"]},{"osd":2,"uuid":"496b0834-351e-4ec2-a714-86ed0c0ff4fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6810","nonce":1825475150},{"type":"v1","addr":"172.21.15.102:6812","nonce":1825475150}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6814","nonce":1825475150},{"type":"v1","addr":"172.21.15.102:6816","nonce":1825475150}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6822","nonce":1825475150},{"type":"v1","addr":"172.21.15.102:6823","nonce":1825475150}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6819","nonce":1825475150},{"type":"v1","addr":"172.21.15.102:6821","nonce":1825475150}]},"public_addr":"172.21.15.102:6812/1825475150","cluster_addr":"172.21.15.102:6816/1825475150","heartbeat_back_addr":"172.21.15.102:6823/1825475150","heartbeat_front_addr":"172.21.15.102:6821/1825475150","state":["exists","up"]},{"osd":3,"uuid":"3ba6cc41-e0a0-4273-86cb-90000c06a55a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6824","nonce":4149355528},{"type":"v1","addr":"172.21.15.102:6825","nonce":4149355528}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6826","nonce":4149355528},{"type":"v1","addr":"172.21.15.102:6827","nonce":4149355528}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6830","nonce":4149355528},{"type":"v1","addr":"172.21.15.102:6831","nonce":4149355528}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6828","nonce":4149355528},{"type":"v1","addr":"172.21.15.102:6829","nonce":4149355528}]},"public_addr":"172.21.15.102:6825/4149355528","cluster_addr":"172.21.15.102:6827/4149355528","heartbeat_back_addr":"172.21.15.102:6831/4149355528","heartbeat_front_addr":"172.21.15.102:6829/4149355528","state":["exists","up"]},{"osd":4,"uuid":"16e797d8-e6e7-4140-95c3-b85283c42a2a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6808","nonce":4028899241},{"type":"v1","addr":"172.21.15.154:6809","nonce":4028899241}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6810","nonce":4028899241},{"type":"v1","addr":"172.21.15.154:6811","nonce":4028899241}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6814","nonce":4028899241},{"type":"v1","addr":"172.21.15.154:6815","nonce":4028899241}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6812","nonce":4028899241},{"type":"v1","addr":"172.21.15.154:6813","nonce":4028899241}]},"public_addr":"172.21.15.154:6809/4028899241","cluster_addr":"172.21.15.154:6811/4028899241","heartbeat_back_addr":"172.21.15.154:6815/4028899241","heartbeat_front_addr":"172.21.15.154:6813/4028899241","state":["exists","up"]},{"osd":5,"uuid":"d6ab225c-1b55-450a-89a9-abe5c3f8d6af","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":3562396827},{"type":"v1","addr":"172.21.15.154:6801","nonce":3562396827}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":3562396827},{"type":"v1","addr":"172.21.15.154:6803","nonce":3562396827}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6806","nonce":3562396827},{"type":"v1","addr":"172.21.15.154:6807","nonce":3562396827}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6804","nonce":3562396827},{"type":"v1","addr":"172.21.15.154:6805","nonce":3562396827}]},"public_addr":"172.21.15.154:6801/3562396827","cluster_addr":"172.21.15.154:6803/3562396827","heartbeat_back_addr":"172.21.15.154:6807/3562396827","heartbeat_front_addr":"172.21.15.154:6805/3562396827","state":["exists","up"]},{"osd":6,"uuid":"96f905ac-491c-4662-8e2b-5bb8e929ab9d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6816","nonce":2933728751},{"type":"v1","addr":"172.21.15.154:6817","nonce":2933728751}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6818","nonce":2933728751},{"type":"v1","addr":"172.21.15.154:6819","nonce":2933728751}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6822","nonce":2933728751},{"type":"v1","addr":"172.21.15.154:6823","nonce":2933728751}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6820","nonce":2933728751},{"type":"v1","addr":"172.21.15.154:6821","nonce":2933728751}]},"public_addr":"172.21.15.154:6817/2933728751","cluster_addr":"172.21.15.154:6819/2933728751","heartbeat_back_addr":"172.21.15.154:6823/2933728751","heartbeat_front_addr":"172.21.15.154:6821/2933728751","state":["exists","up"]},{"osd":7,"uuid":"07012d3b-3ab4-40df-a471-93caed22e2dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6824","nonce":1753500785},{"type":"v1","addr":"172.21.15.154:6825","nonce":1753500785}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6826","nonce":1753500785},{"type":"v1","addr":"172.21.15.154:6827","nonce":1753500785}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6830","nonce":1753500785},{"type":"v1","addr":"172.21.15.154:6831","nonce":1753500785}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6828","nonce":1753500785},{"type":"v1","addr":"172.21.15.154:6829","nonce":1753500785}]},"public_addr":"172.21.15.154:6825/1753500785","cluster_addr":"172.21.15.154:6827/1753500785","heartbeat_back_addr":"172.21.15.154:6831/1753500785","heartbeat_front_addr":"172.21.15.154:6829/1753500785","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-13T11:28:40.978603+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-13T11:28:41.200985+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-13T11:28:41.222815+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-13T11:28:41.202162+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-13T11:28:40.925911+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-13T11:28:41.087725+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-13T11:28:41.072208+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-13T11:28:40.875257+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.2c","mappings":[{"from":0,"to":7}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-13T11:29:42.975 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:42.970+0000 7f7c9ecfe640 1 -- 172.21.15.102:0/2606971283 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f7c84066470 msgr2=0x7f7c84068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:42.976 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:42.970+0000 7f7c9ecfe640 1 --2- 172.21.15.102:0/2606971283 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f7c84066470 0x7f7c84068930 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f7c940b2000 tx=0x7f7c940aa070 comp rx=0 tx=0).stop 2023-11-13T11:29:42.976 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:42.970+0000 7f7c9ecfe640 1 -- 172.21.15.102:0/2606971283 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7c980cae80 msgr2=0x7f7c98142f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:42.976 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:42.970+0000 7f7c9ecfe640 1 --2- 172.21.15.102:0/2606971283 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7c980cae80 0x7f7c98142f90 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f7c8800e980 tx=0x7f7c8800ee40 comp rx=0 tx=0).stop 2023-11-13T11:29:42.976 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:42.970+0000 7f7c9ecfe640 1 -- 172.21.15.102:0/2606971283 shutdown_connections 2023-11-13T11:29:42.976 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:42.970+0000 7f7c9ecfe640 1 --2- 172.21.15.102:0/2606971283 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7c98159420 0x7f7c98155910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:42.977 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:42.970+0000 7f7c9ecfe640 1 --2- 172.21.15.102:0/2606971283 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f7c84066470 0x7f7c84068930 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:42.977 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:42.970+0000 7f7c9ecfe640 1 --2- 172.21.15.102:0/2606971283 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7c980cae80 0x7f7c98142f90 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:42.977 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:42.970+0000 7f7c9ecfe640 1 --2- 172.21.15.102:0/2606971283 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7c9806c270 0x7f7c981470d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:42.977 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:42.970+0000 7f7c9ecfe640 1 -- 172.21.15.102:0/2606971283 >> 172.21.15.102:0/2606971283 conn(0x7f7c980b0870 msgr2=0x7f7c980ae8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-13T11:29:42.977 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:42.970+0000 7f7c9ecfe640 1 -- 172.21.15.102:0/2606971283 shutdown_connections 2023-11-13T11:29:42.978 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:42.970+0000 7f7c9ecfe640 1 -- 172.21.15.102:0/2606971283 wait complete. 2023-11-13T11:29:42.994 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-13T11:28:44.981356+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-13T11:28:55.958525+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-11-13T11:28:56.394264+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-13T11:29:42.996 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-13T11:29:43.137 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:43.130+0000 7fb80b3c4640 1 Processor -- start 2023-11-13T11:29:43.137 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:43.130+0000 7fb80b3c4640 1 -- start start 2023-11-13T11:29:43.139 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:43.130+0000 7fb80b3c4640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fb804159b30 0x7fb80406fc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:43.139 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:43.130+0000 7fb80b3c4640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7fb8040711c0 0x7fb8040b3520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:43.140 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:43.130+0000 7fb80b3c4640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb8040b21f0 con 0x7fb8040cebc0 2023-11-13T11:29:43.140 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:43.130+0000 7fb80b3c4640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb804071650 con 0x7fb8040711c0 2023-11-13T11:29:43.140 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:43.130+0000 7fb80b3c4640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb8040b2440 con 0x7fb804159b30 2023-11-13T11:29:43.140 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:43.130+0000 7fb80895f640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7fb8040711c0 0x7fb8040b3520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:43.141 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:43.130+0000 7fb809961640 1 --1- >> v1:172.21.15.102:6789/0 conn(0x7fb8040cebc0 0x7fb8040cbe90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.102:6789/0 says I am v1:172.21.15.102:45954/0 (socket says 172.21.15.102:45954) 2023-11-13T11:29:43.141 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:43.130+0000 7fb809961640 1 -- 172.21.15.102:0/1896875158 learned_addr learned my addr 172.21.15.102:0/1896875158 (peer_addr_for_me v1:172.21.15.102:0/0) 2023-11-13T11:29:43.141 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:43.130+0000 7fb80895f640 1 --2- 172.21.15.102:0/1896875158 >> v2:172.21.15.102:3300/0 conn(0x7fb8040711c0 0x7fb8040b3520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:45486/0 (socket says 172.21.15.102:45486) 2023-11-13T11:29:43.142 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:43.130+0000 7fb809160640 1 --2- 172.21.15.102:0/1896875158 >> v2:172.21.15.154:3300/0 conn(0x7fb804159b30 0x7fb80406fc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:43.142 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:43.130+0000 7fb80895f640 1 -- 172.21.15.102:0/1896875158 >> v2:172.21.15.154:3300/0 conn(0x7fb804159b30 msgr2=0x7fb80406fc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-13T11:29:43.142 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:43.130+0000 7fb80895f640 1 --2- 172.21.15.102:0/1896875158 >> v2:172.21.15.154:3300/0 conn(0x7fb804159b30 0x7fb80406fc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:43.143 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:43.130+0000 7fb80895f640 1 -- 172.21.15.102:0/1896875158 >> v1:172.21.15.102:6789/0 conn(0x7fb8040cebc0 legacy=0x7fb8040cbe90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:43.143 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:43.130+0000 7fb80895f640 1 -- 172.21.15.102:0/1896875158 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8040b2720 con 0x7fb8040711c0 2023-11-13T11:29:43.143 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:43.130+0000 7fb7fbfff640 1 -- 172.21.15.102:0/1896875158 <== mon.0 v1:172.21.15.102:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 772674092 0 0) 0x7fb8040b21f0 con 0x7fb8040cebc0 2023-11-13T11:29:43.148 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:43.134+0000 7fb80895f640 1 --2- 172.21.15.102:0/1896875158 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb8040711c0 0x7fb8040b3520 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7fb80406b120 tx=0x7fb7f401c430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fed4706d5ef45fae server_cookie=0 in_seq=0 out_seq=0 2023-11-13T11:29:43.148 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:43.134+0000 7fb7fbfff640 1 -- 172.21.15.102:0/1896875158 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7f40ac600 con 0x7fb8040711c0 2023-11-13T11:29:43.148 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:43.134+0000 7fb7fbfff640 1 -- 172.21.15.102:0/1896875158 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb7f40a8050 con 0x7fb8040711c0 2023-11-13T11:29:43.149 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:43.134+0000 7fb7fbfff640 1 -- 172.21.15.102:0/1896875158 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7f40ac980 con 0x7fb8040711c0 2023-11-13T11:29:43.149 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:43.134+0000 7fb80b3c4640 1 -- 172.21.15.102:0/1896875158 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb8040711c0 msgr2=0x7fb8040b3520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:43.149 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:43.134+0000 7fb80b3c4640 1 --2- 172.21.15.102:0/1896875158 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb8040711c0 0x7fb8040b3520 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7fb80406b120 tx=0x7fb7f401c430 comp rx=0 tx=0).stop 2023-11-13T11:29:43.149 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:43.134+0000 7fb80b3c4640 1 -- 172.21.15.102:0/1896875158 shutdown_connections 2023-11-13T11:29:43.150 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:43.134+0000 7fb80b3c4640 1 --2- 172.21.15.102:0/1896875158 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb8040711c0 0x7fb8040b3520 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:43.150 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:43.134+0000 7fb80b3c4640 1 --2- 172.21.15.102:0/1896875158 >> v2:172.21.15.154:3300/0 conn(0x7fb804159b30 0x7fb80406fc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:43.150 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:43.134+0000 7fb80b3c4640 1 -- 172.21.15.102:0/1896875158 >> 172.21.15.102:0/1896875158 conn(0x7fb80406a410 msgr2=0x7fb80406a820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-13T11:29:43.150 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:43.134+0000 7fb80b3c4640 1 -- 172.21.15.102:0/1896875158 shutdown_connections 2023-11-13T11:29:43.151 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:43.134+0000 7fb80b3c4640 1 -- 172.21.15.102:0/1896875158 wait complete. 2023-11-13T11:29:43.151 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:43.138+0000 7fb80b3c4640 1 Processor -- start 2023-11-13T11:29:43.151 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:43.138+0000 7fb80b3c4640 1 -- start start 2023-11-13T11:29:43.151 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:43.138+0000 7fb80b3c4640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb8040711c0 0x7fb804165840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:43.152 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:43.138+0000 7fb80b3c4640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb8040cebc0 0x7fb80414dc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:43.152 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:43.138+0000 7fb80b3c4640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb804159b30 0x7fb8041673c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:43.152 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:43.138+0000 7fb80b3c4640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb804145f90 con 0x7fb8040711c0 2023-11-13T11:29:43.152 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:43.138+0000 7fb80b3c4640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb80414e1d0 con 0x7fb804159b30 2023-11-13T11:29:43.152 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:43.138+0000 7fb80b3c4640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb804167900 con 0x7fb8040cebc0 2023-11-13T11:29:43.153 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:43.138+0000 7fb809160640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb8040711c0 0x7fb804165840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:43.153 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:43.138+0000 7fb809160640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb8040711c0 0x7fb804165840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:45500/0 (socket says 172.21.15.102:45500) 2023-11-13T11:29:43.153 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:43.138+0000 7fb809160640 1 -- 172.21.15.102:0/1315733205 learned_addr learned my addr 172.21.15.102:0/1315733205 (peer_addr_for_me v2:172.21.15.102:0/0) 2023-11-13T11:29:43.153 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:43.138+0000 7fb809961640 1 --2- 172.21.15.102:0/1315733205 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb804159b30 0x7fb8041673c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:43.154 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:43.138+0000 7fb80895f640 1 --2- 172.21.15.102:0/1315733205 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb8040cebc0 0x7fb80414dc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:43.154 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:43.138+0000 7fb809160640 1 -- 172.21.15.102:0/1315733205 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb8040cebc0 msgr2=0x7fb80414dc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:43.154 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:43.138+0000 7fb809160640 1 --2- 172.21.15.102:0/1315733205 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb8040cebc0 0x7fb80414dc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:43.154 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:43.138+0000 7fb809160640 1 -- 172.21.15.102:0/1315733205 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb804159b30 msgr2=0x7fb8041673c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:43.155 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:43.138+0000 7fb809160640 1 --2- 172.21.15.102:0/1315733205 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb804159b30 0x7fb8041673c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:43.155 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:43.138+0000 7fb809160640 1 -- 172.21.15.102:0/1315733205 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7f4009420 con 0x7fb8040711c0 2023-11-13T11:29:43.155 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:43.138+0000 7fb809160640 1 --2- 172.21.15.102:0/1315733205 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb8040711c0 0x7fb804165840 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7fb80000d5f0 tx=0x7fb80000dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-13T11:29:43.155 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:43.138+0000 7fb7f9ffb640 1 -- 172.21.15.102:0/1315733205 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8000125f0 con 0x7fb8040711c0 2023-11-13T11:29:43.155 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:43.138+0000 7fb7f9ffb640 1 -- 172.21.15.102:0/1315733205 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb800012750 con 0x7fb8040711c0 2023-11-13T11:29:43.156 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:43.138+0000 7fb7f9ffb640 1 -- 172.21.15.102:0/1315733205 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb800012ae0 con 0x7fb8040711c0 2023-11-13T11:29:43.156 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:43.138+0000 7fb80b3c4640 1 -- 172.21.15.102:0/1315733205 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb804165eb0 con 0x7fb8040711c0 2023-11-13T11:29:43.156 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:43.138+0000 7fb80b3c4640 1 -- 172.21.15.102:0/1315733205 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb804166470 con 0x7fb8040711c0 2023-11-13T11:29:43.156 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:43.142+0000 7fb80b3c4640 1 -- 172.21.15.102:0/1315733205 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb804067640 con 0x7fb8040711c0 2023-11-13T11:29:43.157 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:43.142+0000 7fb7f9ffb640 1 -- 172.21.15.102:0/1315733205 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fb800012c40 con 0x7fb8040711c0 2023-11-13T11:29:43.158 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:43.142+0000 7fb7f9ffb640 1 --2- 172.21.15.102:0/1315733205 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7fb7e8066470 0x7fb7e8068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:43.158 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:43.142+0000 7fb7f9ffb640 1 -- 172.21.15.102:0/1315733205 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 5738+0+0 (secure 0 0 0) 0x7fb800084440 con 0x7fb8040711c0 2023-11-13T11:29:43.158 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:43.142+0000 7fb80895f640 1 --2- 172.21.15.102:0/1315733205 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7fb7e8066470 0x7fb7e8068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:43.159 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:43.142+0000 7fb80895f640 1 --2- 172.21.15.102:0/1315733205 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7fb7e8066470 0x7fb7e8068930 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fb7f40ae000 tx=0x7fb7f4008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-13T11:29:43.159 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:43.146+0000 7fb7f9ffb640 1 -- 172.21.15.102:0/1315733205 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fb800051800 con 0x7fb8040711c0 2023-11-13T11:29:43.306 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:43.298+0000 7fb80b3c4640 1 -- 172.21.15.102:0/1315733205 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fb804068520 con 0x7fb8040711c0 2023-11-13T11:29:43.307 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:43.298+0000 7fb7f9ffb640 1 -- 172.21.15.102:0/1315733205 <== mon.0 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v24) v1 ==== 93+0+10 (secure 0 0 0) 0x7fb800007380 con 0x7fb8040711c0 2023-11-13T11:29:43.307 INFO:teuthology.orchestra.run.smithi102.stdout:pg_num: 1 2023-11-13T11:29:43.308 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:43.302+0000 7fb80b3c4640 1 -- 172.21.15.102:0/1315733205 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7fb7e8066470 msgr2=0x7fb7e8068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:43.309 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:43.302+0000 7fb80b3c4640 1 --2- 172.21.15.102:0/1315733205 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7fb7e8066470 0x7fb7e8068930 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fb7f40ae000 tx=0x7fb7f4008040 comp rx=0 tx=0).stop 2023-11-13T11:29:43.309 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:43.302+0000 7fb80b3c4640 1 -- 172.21.15.102:0/1315733205 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb8040711c0 msgr2=0x7fb804165840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:43.309 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:43.302+0000 7fb80b3c4640 1 --2- 172.21.15.102:0/1315733205 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb8040711c0 0x7fb804165840 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7fb80000d5f0 tx=0x7fb80000dab0 comp rx=0 tx=0).stop 2023-11-13T11:29:43.310 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:43.302+0000 7fb80b3c4640 1 -- 172.21.15.102:0/1315733205 shutdown_connections 2023-11-13T11:29:43.310 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:43.302+0000 7fb80b3c4640 1 --2- 172.21.15.102:0/1315733205 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb804159b30 0x7fb8041673c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:43.310 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:43.302+0000 7fb80b3c4640 1 --2- 172.21.15.102:0/1315733205 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb8040cebc0 0x7fb80414dc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:43.310 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:43.302+0000 7fb80b3c4640 1 --2- 172.21.15.102:0/1315733205 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7fb7e8066470 0x7fb7e8068930 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:43.311 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:43.302+0000 7fb80b3c4640 1 --2- 172.21.15.102:0/1315733205 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb8040711c0 0x7fb804165840 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:43.311 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:43.302+0000 7fb80b3c4640 1 -- 172.21.15.102:0/1315733205 >> 172.21.15.102:0/1315733205 conn(0x7fb80406a410 msgr2=0x7fb8040cd520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-13T11:29:43.311 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:43.302+0000 7fb80b3c4640 1 -- 172.21.15.102:0/1315733205 shutdown_connections 2023-11-13T11:29:43.311 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:43.302+0000 7fb80b3c4640 1 -- 172.21.15.102:0/1315733205 wait complete. 2023-11-13T11:29:43.328 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-13T11:29:43.469 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:43.462+0000 7fe3ca49c640 1 Processor -- start 2023-11-13T11:29:43.470 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:43.462+0000 7fe3ca49c640 1 -- start start 2023-11-13T11:29:43.471 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:43.462+0000 7fe3ca49c640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fe3c415d0c0 0x7fe3c406a450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:43.471 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:43.462+0000 7fe3ca49c640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe3c40b09d0 0x7fe3c40cfd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:43.471 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:43.462+0000 7fe3ca49c640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe3c40cefd0 con 0x7fe3c406b4b0 2023-11-13T11:29:43.471 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:43.462+0000 7fe3ca49c640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe3c406ba00 con 0x7fe3c415d0c0 2023-11-13T11:29:43.472 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:43.462+0000 7fe3ca49c640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe3c40cf220 con 0x7fe3c40b09d0 2023-11-13T11:29:43.472 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:43.466+0000 7fe3c3fff640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fe3c415d0c0 0x7fe3c406a450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:43.472 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:43.466+0000 7fe3c8a39640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe3c40b09d0 0x7fe3c40cfd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:43.472 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:43.466+0000 7fe3c37fe640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7fe3c406b4b0 0x7fe3c40b02c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.102:59292/0 (socket says 172.21.15.102:59292) 2023-11-13T11:29:43.472 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:43.466+0000 7fe3c37fe640 1 -- 172.21.15.102:0/3689384203 learned_addr learned my addr 172.21.15.102:0/3689384203 (peer_addr_for_me v1:172.21.15.102:0/0) 2023-11-13T11:29:43.473 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:43.466+0000 7fe3c8a39640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe3c40b09d0 0x7fe3c40cfd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.102:38690/0 (socket says 172.21.15.102:38690) 2023-11-13T11:29:43.473 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:43.466+0000 7fe3c8a39640 1 -- 172.21.15.102:0/3689384203 >> v2:172.21.15.154:3300/0 conn(0x7fe3c415d0c0 msgr2=0x7fe3c406a450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-13T11:29:43.474 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:43.466+0000 7fe3c8a39640 1 --2- 172.21.15.102:0/3689384203 >> v2:172.21.15.154:3300/0 conn(0x7fe3c415d0c0 0x7fe3c406a450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:43.474 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:43.466+0000 7fe3c8a39640 1 -- 172.21.15.102:0/3689384203 >> v1:172.21.15.154:6789/0 conn(0x7fe3c406b4b0 legacy=0x7fe3c40b02c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:43.474 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:43.466+0000 7fe3c8a39640 1 -- 172.21.15.102:0/3689384203 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3c40cf500 con 0x7fe3c40b09d0 2023-11-13T11:29:43.475 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:43.466+0000 7fe3c2ffd640 1 -- 172.21.15.102:0/3689384203 <== mon.1 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2677291035 0 0) 0x7fe3c40cefd0 con 0x7fe3c406b4b0 2023-11-13T11:29:43.477 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:43.466+0000 7fe3c8a39640 1 --2- 172.21.15.102:0/3689384203 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe3c40b09d0 0x7fe3c40cfd00 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fe3bc009d90 tx=0x7fe3bc01c890 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ebcccba6756cd5a3 server_cookie=0 in_seq=0 out_seq=0 2023-11-13T11:29:43.477 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:43.466+0000 7fe3c2ffd640 1 -- 172.21.15.102:0/3689384203 <== mon.2 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3bc0a5930 con 0x7fe3c40b09d0 2023-11-13T11:29:43.477 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:43.466+0000 7fe3c2ffd640 1 -- 172.21.15.102:0/3689384203 <== mon.2 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe3bc0a5a90 con 0x7fe3c40b09d0 2023-11-13T11:29:43.477 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:43.466+0000 7fe3c2ffd640 1 -- 172.21.15.102:0/3689384203 <== mon.2 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3bc0a5e20 con 0x7fe3c40b09d0 2023-11-13T11:29:43.478 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:43.470+0000 7fe3ca49c640 1 -- 172.21.15.102:0/3689384203 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe3c40b09d0 msgr2=0x7fe3c40cfd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:43.478 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:43.470+0000 7fe3ca49c640 1 --2- 172.21.15.102:0/3689384203 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe3c40b09d0 0x7fe3c40cfd00 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fe3bc009d90 tx=0x7fe3bc01c890 comp rx=0 tx=0).stop 2023-11-13T11:29:43.478 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:43.470+0000 7fe3ca49c640 1 -- 172.21.15.102:0/3689384203 shutdown_connections 2023-11-13T11:29:43.478 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:43.470+0000 7fe3ca49c640 1 --2- 172.21.15.102:0/3689384203 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe3c40b09d0 0x7fe3c40cfd00 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:43.478 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:43.470+0000 7fe3ca49c640 1 --2- 172.21.15.102:0/3689384203 >> v2:172.21.15.154:3300/0 conn(0x7fe3c415d0c0 0x7fe3c406a450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:43.479 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:43.470+0000 7fe3ca49c640 1 -- 172.21.15.102:0/3689384203 >> 172.21.15.102:0/3689384203 conn(0x7fe3c40709d0 msgr2=0x7fe3c40b4120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-13T11:29:43.479 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:43.470+0000 7fe3ca49c640 1 -- 172.21.15.102:0/3689384203 shutdown_connections 2023-11-13T11:29:43.480 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:43.470+0000 7fe3ca49c640 1 -- 172.21.15.102:0/3689384203 wait complete. 2023-11-13T11:29:43.480 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:43.470+0000 7fe3ca49c640 1 Processor -- start 2023-11-13T11:29:43.483 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:43.470+0000 7fe3ca49c640 1 -- start start 2023-11-13T11:29:43.484 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:43.470+0000 7fe3ca49c640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe3c406b4b0 0x7fe3c414bc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:43.484 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:43.470+0000 7fe3ca49c640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe3c40b09d0 0x7fe3c406c530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:43.486 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:43.470+0000 7fe3ca49c640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe3c415d0c0 0x7fe3c406ca70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:43.487 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:43.470+0000 7fe3ca49c640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3c415edd0 con 0x7fe3c40b09d0 2023-11-13T11:29:43.487 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:43.470+0000 7fe3ca49c640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3c4155480 con 0x7fe3c415d0c0 2023-11-13T11:29:43.487 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:43.470+0000 7fe3ca49c640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe3c4155760 con 0x7fe3c406b4b0 2023-11-13T11:29:43.489 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:43.470+0000 7fe3c37fe640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe3c40b09d0 0x7fe3c406c530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:43.490 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:43.470+0000 7fe3c37fe640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe3c40b09d0 0x7fe3c406c530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:45508/0 (socket says 172.21.15.102:45508) 2023-11-13T11:29:43.491 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:43.470+0000 7fe3c37fe640 1 -- 172.21.15.102:0/1831862935 learned_addr learned my addr 172.21.15.102:0/1831862935 (peer_addr_for_me v2:172.21.15.102:0/0) 2023-11-13T11:29:43.491 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:43.470+0000 7fe3c8a39640 1 --2- 172.21.15.102:0/1831862935 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe3c415d0c0 0x7fe3c406ca70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:43.491 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:43.470+0000 7fe3c3fff640 1 --2- 172.21.15.102:0/1831862935 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe3c406b4b0 0x7fe3c414bc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:43.491 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:43.474+0000 7fe3c37fe640 1 -- 172.21.15.102:0/1831862935 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe3c406b4b0 msgr2=0x7fe3c414bc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:43.492 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:43.474+0000 7fe3c37fe640 1 --2- 172.21.15.102:0/1831862935 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe3c406b4b0 0x7fe3c414bc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:43.492 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:43.474+0000 7fe3c37fe640 1 -- 172.21.15.102:0/1831862935 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe3c415d0c0 msgr2=0x7fe3c406ca70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:43.493 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:43.474+0000 7fe3c37fe640 1 --2- 172.21.15.102:0/1831862935 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe3c415d0c0 0x7fe3c406ca70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:43.493 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:43.474+0000 7fe3c37fe640 1 -- 172.21.15.102:0/1831862935 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3bc009a70 con 0x7fe3c40b09d0 2023-11-13T11:29:43.494 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:43.474+0000 7fe3c37fe640 1 --2- 172.21.15.102:0/1831862935 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe3c40b09d0 0x7fe3c406c530 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7fe3b80011f0 tx=0x7fe3b800c9b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-13T11:29:43.494 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:43.474+0000 7fe3c0ff9640 1 -- 172.21.15.102:0/1831862935 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3b80074e0 con 0x7fe3c40b09d0 2023-11-13T11:29:43.494 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:43.474+0000 7fe3c0ff9640 1 -- 172.21.15.102:0/1831862935 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe3b8007640 con 0x7fe3c40b09d0 2023-11-13T11:29:43.494 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:43.474+0000 7fe3c0ff9640 1 -- 172.21.15.102:0/1831862935 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3b8004a10 con 0x7fe3c40b09d0 2023-11-13T11:29:43.495 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:43.474+0000 7fe3ca49c640 1 -- 172.21.15.102:0/1831862935 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe3c4155a40 con 0x7fe3c40b09d0 2023-11-13T11:29:43.495 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:43.474+0000 7fe3ca49c640 1 -- 172.21.15.102:0/1831862935 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe3c4156000 con 0x7fe3c40b09d0 2023-11-13T11:29:43.495 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:43.474+0000 7fe3ca49c640 1 -- 172.21.15.102:0/1831862935 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe3c4156210 con 0x7fe3c40b09d0 2023-11-13T11:29:43.495 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:43.474+0000 7fe3c0ff9640 1 -- 172.21.15.102:0/1831862935 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fe3b8004b70 con 0x7fe3c40b09d0 2023-11-13T11:29:43.495 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:43.474+0000 7fe3c0ff9640 1 --2- 172.21.15.102:0/1831862935 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7fe3b0066470 0x7fe3b0068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:43.495 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:43.474+0000 7fe3c0ff9640 1 -- 172.21.15.102:0/1831862935 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 5738+0+0 (secure 0 0 0) 0x7fe3b8083040 con 0x7fe3c40b09d0 2023-11-13T11:29:43.496 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:43.474+0000 7fe3c3fff640 1 --2- 172.21.15.102:0/1831862935 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7fe3b0066470 0x7fe3b0068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:43.496 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:43.478+0000 7fe3c3fff640 1 --2- 172.21.15.102:0/1831862935 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7fe3b0066470 0x7fe3b0068930 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fe3b4009ac0 tx=0x7fe3b4009190 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-13T11:29:43.496 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:43.478+0000 7fe3c0ff9640 1 -- 172.21.15.102:0/1831862935 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fe3b80505e0 con 0x7fe3c40b09d0 2023-11-13T11:29:43.635 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:43.630+0000 7fe3ca49c640 1 -- 172.21.15.102:0/1831862935 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fe3c4068520 con 0x7fe3c40b09d0 2023-11-13T11:29:43.636 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:43.630+0000 7fe3c0ff9640 1 -- 172.21.15.102:0/1831862935 <== mon.0 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v24) v1 ==== 104+0+11 (secure 0 0 0) 0x7fe3b80180a0 con 0x7fe3c40b09d0 2023-11-13T11:29:43.636 INFO:teuthology.orchestra.run.smithi102.stdout:pg_num: 32 2023-11-13T11:29:43.638 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:43.630+0000 7fe3ca49c640 1 -- 172.21.15.102:0/1831862935 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7fe3b0066470 msgr2=0x7fe3b0068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:43.638 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:43.630+0000 7fe3ca49c640 1 --2- 172.21.15.102:0/1831862935 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7fe3b0066470 0x7fe3b0068930 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fe3b4009ac0 tx=0x7fe3b4009190 comp rx=0 tx=0).stop 2023-11-13T11:29:43.638 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:43.630+0000 7fe3ca49c640 1 -- 172.21.15.102:0/1831862935 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe3c40b09d0 msgr2=0x7fe3c406c530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:43.639 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:43.630+0000 7fe3ca49c640 1 --2- 172.21.15.102:0/1831862935 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe3c40b09d0 0x7fe3c406c530 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7fe3b80011f0 tx=0x7fe3b800c9b0 comp rx=0 tx=0).stop 2023-11-13T11:29:43.639 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:43.630+0000 7fe3ca49c640 1 -- 172.21.15.102:0/1831862935 shutdown_connections 2023-11-13T11:29:43.639 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:43.630+0000 7fe3ca49c640 1 --2- 172.21.15.102:0/1831862935 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe3c415d0c0 0x7fe3c406ca70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:43.639 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:43.630+0000 7fe3ca49c640 1 --2- 172.21.15.102:0/1831862935 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7fe3b0066470 0x7fe3b0068930 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:43.639 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:43.630+0000 7fe3ca49c640 1 --2- 172.21.15.102:0/1831862935 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe3c40b09d0 0x7fe3c406c530 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:43.640 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:43.630+0000 7fe3ca49c640 1 --2- 172.21.15.102:0/1831862935 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe3c406b4b0 0x7fe3c414bc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:43.640 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:43.630+0000 7fe3ca49c640 1 -- 172.21.15.102:0/1831862935 >> 172.21.15.102:0/1831862935 conn(0x7fe3c40709d0 msgr2=0x7fe3c4071880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-13T11:29:43.640 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:43.630+0000 7fe3ca49c640 1 -- 172.21.15.102:0/1831862935 shutdown_connections 2023-11-13T11:29:43.640 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:43.630+0000 7fe3ca49c640 1 -- 172.21.15.102:0/1831862935 wait complete. 2023-11-13T11:29:43.657 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-13T11:29:43.799 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:43.790+0000 7f5709e32640 1 Processor -- start 2023-11-13T11:29:43.799 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:43.790+0000 7f5709e32640 1 -- start start 2023-11-13T11:29:43.800 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:43.794+0000 7f5709e32640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f57040b2e40 0x7f5704071f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:43.800 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:43.794+0000 7f5709e32640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f57040730f0 0x7f57040ad050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:43.801 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:43.794+0000 7f5709e32640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f57040af940 con 0x7f5704159de0 2023-11-13T11:29:43.801 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:43.794+0000 7f5709e32640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f57040acbc0 con 0x7f57040b2e40 2023-11-13T11:29:43.801 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:43.794+0000 7f5709e32640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f57040ac890 con 0x7f57040730f0 2023-11-13T11:29:43.801 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:43.794+0000 7f5702ffd640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f57040b2e40 0x7f5704071f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:43.802 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:43.794+0000 7f5702ffd640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f57040b2e40 0x7f5704071f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:45514/0 (socket says 172.21.15.102:45514) 2023-11-13T11:29:43.802 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:43.794+0000 7f5702ffd640 1 -- 172.21.15.102:0/462827520 learned_addr learned my addr 172.21.15.102:0/462827520 (peer_addr_for_me v2:172.21.15.102:0/0) 2023-11-13T11:29:43.802 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:43.794+0000 7f5703fff640 1 --2- 172.21.15.102:0/462827520 >> v2:172.21.15.154:3300/0 conn(0x7f57040730f0 0x7f57040ad050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:43.802 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:43.794+0000 7f5702ffd640 1 -- 172.21.15.102:0/462827520 >> v2:172.21.15.154:3300/0 conn(0x7f57040730f0 msgr2=0x7f57040ad050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-13T11:29:43.802 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:43.794+0000 7f5702ffd640 1 --2- 172.21.15.102:0/462827520 >> v2:172.21.15.154:3300/0 conn(0x7f57040730f0 0x7f57040ad050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:43.803 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:43.794+0000 7f5702ffd640 1 -- 172.21.15.102:0/462827520 >> v1:172.21.15.154:6789/0 conn(0x7f5704159de0 legacy=0x7f5704071880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-13T11:29:43.803 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:43.794+0000 7f5702ffd640 1 -- 172.21.15.102:0/462827520 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57040afb90 con 0x7f57040b2e40 2023-11-13T11:29:43.804 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:43.798+0000 7f5702ffd640 1 --2- 172.21.15.102:0/462827520 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f57040b2e40 0x7f5704071f90 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f57040b4960 tx=0x7f56f801c430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=26f7d6de9698a316 server_cookie=0 in_seq=0 out_seq=0 2023-11-13T11:29:43.804 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:43.798+0000 7f57027fc640 1 -- 172.21.15.102:0/462827520 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56f80ab650 con 0x7f57040b2e40 2023-11-13T11:29:43.805 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:43.798+0000 7f57027fc640 1 -- 172.21.15.102:0/462827520 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f56f80ab7b0 con 0x7f57040b2e40 2023-11-13T11:29:43.805 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:43.798+0000 7f57027fc640 1 -- 172.21.15.102:0/462827520 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56f80abb40 con 0x7f57040b2e40 2023-11-13T11:29:43.805 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:43.798+0000 7f5709e32640 1 -- 172.21.15.102:0/462827520 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f57040b2e40 msgr2=0x7f5704071f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:43.805 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:43.798+0000 7f5709e32640 1 --2- 172.21.15.102:0/462827520 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f57040b2e40 0x7f5704071f90 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f57040b4960 tx=0x7f56f801c430 comp rx=0 tx=0).stop 2023-11-13T11:29:43.805 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:43.798+0000 7f5709e32640 1 -- 172.21.15.102:0/462827520 shutdown_connections 2023-11-13T11:29:43.806 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:43.798+0000 7f5709e32640 1 --2- 172.21.15.102:0/462827520 >> v2:172.21.15.154:3300/0 conn(0x7f57040730f0 0x7f57040ad050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:43.806 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:43.798+0000 7f5709e32640 1 --2- 172.21.15.102:0/462827520 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f57040b2e40 0x7f5704071f90 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:43.807 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:43.798+0000 7f5709e32640 1 -- 172.21.15.102:0/462827520 >> 172.21.15.102:0/462827520 conn(0x7f57040709d0 msgr2=0x7f57040b4120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-13T11:29:43.807 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:43.798+0000 7f5709e32640 1 -- 172.21.15.102:0/462827520 shutdown_connections 2023-11-13T11:29:43.807 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:43.798+0000 7f5709e32640 1 -- 172.21.15.102:0/462827520 wait complete. 2023-11-13T11:29:43.809 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:43.798+0000 7f5709e32640 1 Processor -- start 2023-11-13T11:29:43.809 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:43.798+0000 7f5709e32640 1 -- start start 2023-11-13T11:29:43.810 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:43.802+0000 7f5709e32640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f57040730f0 0x7f5704098040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:43.810 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:43.802+0000 7f5709e32640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f57040b2e40 0x7f570415a460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:43.810 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:43.802+0000 7f5709e32640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5704159de0 0x7f5704152570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:43.810 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:43.802+0000 7f5709e32640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57041520e0 con 0x7f57040b2e40 2023-11-13T11:29:43.811 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:43.802+0000 7f5709e32640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5704098580 con 0x7f57040730f0 2023-11-13T11:29:43.811 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:43.802+0000 7f5709e32640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f57041514d0 con 0x7f5704159de0 2023-11-13T11:29:43.811 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:43.802+0000 7f5702ffd640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f57040b2e40 0x7f570415a460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:43.811 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:43.802+0000 7f5702ffd640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f57040b2e40 0x7f570415a460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:45524/0 (socket says 172.21.15.102:45524) 2023-11-13T11:29:43.811 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:43.802+0000 7f5702ffd640 1 -- 172.21.15.102:0/3323142892 learned_addr learned my addr 172.21.15.102:0/3323142892 (peer_addr_for_me v2:172.21.15.102:0/0) 2023-11-13T11:29:43.812 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:43.802+0000 7f57037fe640 1 --2- 172.21.15.102:0/3323142892 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f57040730f0 0x7f5704098040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:43.812 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:43.802+0000 7f5703fff640 1 --2- 172.21.15.102:0/3323142892 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5704159de0 0x7f5704152570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:43.812 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:43.802+0000 7f5702ffd640 1 -- 172.21.15.102:0/3323142892 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5704159de0 msgr2=0x7f5704152570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:43.812 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:43.802+0000 7f5702ffd640 1 --2- 172.21.15.102:0/3323142892 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5704159de0 0x7f5704152570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:43.812 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:43.802+0000 7f5702ffd640 1 -- 172.21.15.102:0/3323142892 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f57040730f0 msgr2=0x7f5704098040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:43.813 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:43.802+0000 7f5702ffd640 1 --2- 172.21.15.102:0/3323142892 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f57040730f0 0x7f5704098040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:43.813 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:43.802+0000 7f5702ffd640 1 -- 172.21.15.102:0/3323142892 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56f80094d0 con 0x7f57040b2e40 2023-11-13T11:29:43.813 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:43.802+0000 7f5702ffd640 1 --2- 172.21.15.102:0/3323142892 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f57040b2e40 0x7f570415a460 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f56f80ad040 tx=0x7f56f801ac70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-13T11:29:43.813 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:43.802+0000 7f56ebfff640 1 -- 172.21.15.102:0/3323142892 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56f80b4800 con 0x7f57040b2e40 2023-11-13T11:29:43.813 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:43.802+0000 7f56ebfff640 1 -- 172.21.15.102:0/3323142892 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f56f80b4960 con 0x7f57040b2e40 2023-11-13T11:29:43.814 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:43.802+0000 7f5709e32640 1 -- 172.21.15.102:0/3323142892 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f57041517b0 con 0x7f57040b2e40 2023-11-13T11:29:43.814 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:43.802+0000 7f56ebfff640 1 -- 172.21.15.102:0/3323142892 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56f80b4cf0 con 0x7f57040b2e40 2023-11-13T11:29:43.814 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:43.802+0000 7f5709e32640 1 -- 172.21.15.102:0/3323142892 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5704151d70 con 0x7f57040b2e40 2023-11-13T11:29:43.814 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:43.802+0000 7f5709e32640 1 -- 172.21.15.102:0/3323142892 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5704152250 con 0x7f57040b2e40 2023-11-13T11:29:43.815 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:43.802+0000 7f56ebfff640 1 -- 172.21.15.102:0/3323142892 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f56f80c83a0 con 0x7f57040b2e40 2023-11-13T11:29:43.815 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:43.806+0000 7f56ebfff640 1 --2- 172.21.15.102:0/3323142892 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f56f0066470 0x7f56f0068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:43.815 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:43.806+0000 7f56ebfff640 1 -- 172.21.15.102:0/3323142892 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 5738+0+0 (secure 0 0 0) 0x7f56f811ea40 con 0x7f57040b2e40 2023-11-13T11:29:43.816 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:43.806+0000 7f57037fe640 1 --2- 172.21.15.102:0/3323142892 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f56f0066470 0x7f56f0068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:43.816 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:43.806+0000 7f57037fe640 1 --2- 172.21.15.102:0/3323142892 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f56f0066470 0x7f56f0068930 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f56f40098e0 tx=0x7f56f4009060 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-13T11:29:43.817 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:43.810+0000 7f56ebfff640 1 -- 172.21.15.102:0/3323142892 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f56f80ebf40 con 0x7f57040b2e40 2023-11-13T11:29:43.966 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:43.958+0000 7f5709e32640 1 -- 172.21.15.102:0/3323142892 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f5704068520 con 0x7f57040b2e40 2023-11-13T11:29:43.966 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:43.958+0000 7f56ebfff640 1 -- 172.21.15.102:0/3323142892 <== mon.0 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v24) v1 ==== 100+0+11 (secure 0 0 0) 0x7f56f80c4020 con 0x7f57040b2e40 2023-11-13T11:29:43.966 INFO:teuthology.orchestra.run.smithi102.stdout:pg_num: 64 2023-11-13T11:29:43.968 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:43.962+0000 7f5709e32640 1 -- 172.21.15.102:0/3323142892 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f56f0066470 msgr2=0x7f56f0068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:43.968 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:43.962+0000 7f5709e32640 1 --2- 172.21.15.102:0/3323142892 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f56f0066470 0x7f56f0068930 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f56f40098e0 tx=0x7f56f4009060 comp rx=0 tx=0).stop 2023-11-13T11:29:43.969 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:43.962+0000 7f5709e32640 1 -- 172.21.15.102:0/3323142892 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f57040b2e40 msgr2=0x7f570415a460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:43.969 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:43.962+0000 7f5709e32640 1 --2- 172.21.15.102:0/3323142892 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f57040b2e40 0x7f570415a460 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f56f80ad040 tx=0x7f56f801ac70 comp rx=0 tx=0).stop 2023-11-13T11:29:43.969 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:43.962+0000 7f5709e32640 1 -- 172.21.15.102:0/3323142892 shutdown_connections 2023-11-13T11:29:43.969 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:43.962+0000 7f5709e32640 1 --2- 172.21.15.102:0/3323142892 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5704159de0 0x7f5704152570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:43.969 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:43.962+0000 7f5709e32640 1 --2- 172.21.15.102:0/3323142892 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f56f0066470 0x7f56f0068930 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:43.970 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:43.962+0000 7f5709e32640 1 --2- 172.21.15.102:0/3323142892 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f57040b2e40 0x7f570415a460 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:43.970 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:43.962+0000 7f5709e32640 1 --2- 172.21.15.102:0/3323142892 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f57040730f0 0x7f5704098040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:43.970 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:43.962+0000 7f5709e32640 1 -- 172.21.15.102:0/3323142892 >> 172.21.15.102:0/3323142892 conn(0x7f57040709d0 msgr2=0x7f57041534c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-13T11:29:43.970 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:43.962+0000 7f5709e32640 1 -- 172.21.15.102:0/3323142892 shutdown_connections 2023-11-13T11:29:43.971 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:43.962+0000 7f5709e32640 1 -- 172.21.15.102:0/3323142892 wait complete. 2023-11-13T11:29:43.987 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-13T11:29:44.125 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:44.118+0000 7fb5c9d2a640 1 Processor -- start 2023-11-13T11:29:44.125 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:44.118+0000 7fb5c9d2a640 1 -- start start 2023-11-13T11:29:44.126 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:44.118+0000 7fb5c9d2a640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb5c413df40 0x7fb5c415e990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:44.126 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:44.118+0000 7fb5c9d2a640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fb5c406dc70 0x7fb5c406ba90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:44.126 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:44.118+0000 7fb5c9d2a640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb5c413e530 con 0x7fb5c406bfd0 2023-11-13T11:29:44.126 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:44.118+0000 7fb5c9d2a640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb5c406c460 con 0x7fb5c406dc70 2023-11-13T11:29:44.127 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:44.118+0000 7fb5c9d2a640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb5c415f290 con 0x7fb5c413df40 2023-11-13T11:29:44.127 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:44.118+0000 7fb5c37fe640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb5c413df40 0x7fb5c415e990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:44.128 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:44.118+0000 7fb5c2ffd640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fb5c406dc70 0x7fb5c406ba90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:44.128 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:44.118+0000 7fb5c3fff640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7fb5c406bfd0 0x7fb5c40cd260 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.102:59318/0 (socket says 172.21.15.102:59318) 2023-11-13T11:29:44.128 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:44.118+0000 7fb5c3fff640 1 -- 172.21.15.102:0/406537037 learned_addr learned my addr 172.21.15.102:0/406537037 (peer_addr_for_me v1:172.21.15.102:0/0) 2023-11-13T11:29:44.128 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:44.122+0000 7fb5c37fe640 1 -- 172.21.15.102:0/406537037 >> v2:172.21.15.154:3300/0 conn(0x7fb5c406dc70 msgr2=0x7fb5c406ba90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-13T11:29:44.128 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:44.122+0000 7fb5c37fe640 1 --2- 172.21.15.102:0/406537037 >> v2:172.21.15.154:3300/0 conn(0x7fb5c406dc70 0x7fb5c406ba90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:44.129 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:44.122+0000 7fb5c37fe640 1 -- 172.21.15.102:0/406537037 >> v1:172.21.15.154:6789/0 conn(0x7fb5c406bfd0 legacy=0x7fb5c40cd260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:44.129 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:44.122+0000 7fb5c37fe640 1 -- 172.21.15.102:0/406537037 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5c415f570 con 0x7fb5c413df40 2023-11-13T11:29:44.129 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:44.122+0000 7fb5c2ffd640 1 --2- 172.21.15.102:0/406537037 >> v2:172.21.15.154:3300/0 conn(0x7fb5c406dc70 0x7fb5c406ba90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-13T11:29:44.130 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:44.122+0000 7fb5c37fe640 1 --2- 172.21.15.102:0/406537037 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb5c413df40 0x7fb5c415e990 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fb5b40097c0 tx=0x7fb5b401c480 comp rx=0 tx=0).ready entity=mon.2 client_cookie=23e53ac22d54ea32 server_cookie=0 in_seq=0 out_seq=0 2023-11-13T11:29:44.130 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:44.122+0000 7fb5c27fc640 1 -- 172.21.15.102:0/406537037 <== mon.2 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5b40ab600 con 0x7fb5c413df40 2023-11-13T11:29:44.130 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:44.122+0000 7fb5c27fc640 1 -- 172.21.15.102:0/406537037 <== mon.2 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb5b40a7050 con 0x7fb5c413df40 2023-11-13T11:29:44.131 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:44.122+0000 7fb5c27fc640 1 -- 172.21.15.102:0/406537037 <== mon.2 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5b40ab980 con 0x7fb5c413df40 2023-11-13T11:29:44.131 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:44.122+0000 7fb5c9d2a640 1 -- 172.21.15.102:0/406537037 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb5c413df40 msgr2=0x7fb5c415e990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:44.132 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:44.122+0000 7fb5c9d2a640 1 --2- 172.21.15.102:0/406537037 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb5c413df40 0x7fb5c415e990 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fb5b40097c0 tx=0x7fb5b401c480 comp rx=0 tx=0).stop 2023-11-13T11:29:44.132 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:44.122+0000 7fb5c9d2a640 1 -- 172.21.15.102:0/406537037 shutdown_connections 2023-11-13T11:29:44.132 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:44.122+0000 7fb5c9d2a640 1 --2- 172.21.15.102:0/406537037 >> v2:172.21.15.154:3300/0 conn(0x7fb5c406dc70 0x7fb5c406ba90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:44.132 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:44.122+0000 7fb5c9d2a640 1 --2- 172.21.15.102:0/406537037 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb5c413df40 0x7fb5c415e990 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:44.133 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:44.122+0000 7fb5c9d2a640 1 -- 172.21.15.102:0/406537037 >> 172.21.15.102:0/406537037 conn(0x7fb5c40b0870 msgr2=0x7fb5c40b0c80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-13T11:29:44.133 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:44.122+0000 7fb5c9d2a640 1 -- 172.21.15.102:0/406537037 shutdown_connections 2023-11-13T11:29:44.133 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:44.126+0000 7fb5c9d2a640 1 -- 172.21.15.102:0/406537037 wait complete. 2023-11-13T11:29:44.135 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:44.126+0000 7fb5c9d2a640 1 Processor -- start 2023-11-13T11:29:44.136 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:44.126+0000 7fb5c9d2a640 1 -- start start 2023-11-13T11:29:44.136 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:44.126+0000 7fb5c9d2a640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb5c406bfd0 0x7fb5c40ad300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:44.136 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:44.126+0000 7fb5c9d2a640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb5c406dc70 0x7fb5c4156d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:44.136 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:44.126+0000 7fb5c9d2a640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb5c413df40 0x7fb5c41581e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:44.136 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:44.126+0000 7fb5c9d2a640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5c4159bd0 con 0x7fb5c413df40 2023-11-13T11:29:44.137 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:44.126+0000 7fb5c9d2a640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5c40b1fe0 con 0x7fb5c406dc70 2023-11-13T11:29:44.137 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:44.126+0000 7fb5c9d2a640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb5c40b22c0 con 0x7fb5c406bfd0 2023-11-13T11:29:44.137 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:44.126+0000 7fb5c3fff640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb5c413df40 0x7fb5c41581e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:44.137 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:44.126+0000 7fb5c3fff640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb5c413df40 0x7fb5c41581e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:45528/0 (socket says 172.21.15.102:45528) 2023-11-13T11:29:44.137 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:44.126+0000 7fb5c3fff640 1 -- 172.21.15.102:0/2776625949 learned_addr learned my addr 172.21.15.102:0/2776625949 (peer_addr_for_me v2:172.21.15.102:0/0) 2023-11-13T11:29:44.138 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:44.126+0000 7fb5c37fe640 1 --2- 172.21.15.102:0/2776625949 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb5c406bfd0 0x7fb5c40ad300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:44.138 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:44.126+0000 7fb5c2ffd640 1 --2- 172.21.15.102:0/2776625949 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb5c406dc70 0x7fb5c4156d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:44.138 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:44.126+0000 7fb5c2ffd640 1 -- 172.21.15.102:0/2776625949 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb5c406bfd0 msgr2=0x7fb5c40ad300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:44.138 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:44.126+0000 7fb5c2ffd640 1 --2- 172.21.15.102:0/2776625949 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb5c406bfd0 0x7fb5c40ad300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:44.138 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:44.126+0000 7fb5c2ffd640 1 -- 172.21.15.102:0/2776625949 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb5c413df40 msgr2=0x7fb5c41581e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:44.139 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:44.126+0000 7fb5c2ffd640 1 --2- 172.21.15.102:0/2776625949 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb5c413df40 0x7fb5c41581e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:44.139 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:44.126+0000 7fb5c2ffd640 1 -- 172.21.15.102:0/2776625949 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5b8009420 con 0x7fb5c406dc70 2023-11-13T11:29:44.139 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:44.126+0000 7fb5c3fff640 1 --2- 172.21.15.102:0/2776625949 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb5c413df40 0x7fb5c41581e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-13T11:29:44.139 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:44.130+0000 7fb5c2ffd640 1 --2- 172.21.15.102:0/2776625949 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb5c406dc70 0x7fb5c4156d00 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fb5b800e980 tx=0x7fb5b800ee40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-13T11:29:44.139 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:44.130+0000 7fb5abfff640 1 -- 172.21.15.102:0/2776625949 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5b800ca00 con 0x7fb5c406dc70 2023-11-13T11:29:44.139 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:44.130+0000 7fb5abfff640 1 -- 172.21.15.102:0/2776625949 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb5b800cb80 con 0x7fb5c406dc70 2023-11-13T11:29:44.140 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:44.130+0000 7fb5abfff640 1 -- 172.21.15.102:0/2776625949 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5b8013470 con 0x7fb5c406dc70 2023-11-13T11:29:44.140 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:44.130+0000 7fb5c9d2a640 1 -- 172.21.15.102:0/2776625949 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb5b4009420 con 0x7fb5c406dc70 2023-11-13T11:29:44.140 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:44.130+0000 7fb5c9d2a640 1 -- 172.21.15.102:0/2776625949 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb5c40b2880 con 0x7fb5c406dc70 2023-11-13T11:29:44.141 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:44.130+0000 7fb5c9d2a640 1 -- 172.21.15.102:0/2776625949 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb5c4068520 con 0x7fb5c406dc70 2023-11-13T11:29:44.141 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:44.130+0000 7fb5abfff640 1 -- 172.21.15.102:0/2776625949 <== mon.1 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fb5b8004020 con 0x7fb5c406dc70 2023-11-13T11:29:44.141 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:44.130+0000 7fb5abfff640 1 --2- 172.21.15.102:0/2776625949 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7fb5b0066470 0x7fb5b0068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:44.142 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:44.130+0000 7fb5abfff640 1 -- 172.21.15.102:0/2776625949 <== mon.1 v2:172.21.15.154:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 5738+0+0 (secure 0 0 0) 0x7fb5b80840a0 con 0x7fb5c406dc70 2023-11-13T11:29:44.142 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:44.130+0000 7fb5c37fe640 1 --2- 172.21.15.102:0/2776625949 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7fb5b0066470 0x7fb5b0068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:44.142 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:44.134+0000 7fb5c37fe640 1 --2- 172.21.15.102:0/2776625949 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7fb5b0066470 0x7fb5b0068930 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fb5b40ad000 tx=0x7fb5b40a6000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-13T11:29:44.142 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:44.134+0000 7fb5abfff640 1 -- 172.21.15.102:0/2776625949 <== mon.1 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fb5b8051590 con 0x7fb5c406dc70 2023-11-13T11:29:44.322 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:44.314+0000 7fb5c9d2a640 1 -- 172.21.15.102:0/2776625949 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb5c406d500 con 0x7fb5c406dc70 2023-11-13T11:29:44.323 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:44.318+0000 7fb5abfff640 1 -- 172.21.15.102:0/2776625949 <== mon.1 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4913 (secure 0 0 0) 0x7fb5b8009280 con 0x7fb5c406dc70 2023-11-13T11:29:44.323 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T11:29:44.323 INFO:teuthology.orchestra.run.smithi102.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4226,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.102:6836/659983176","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6835","nonce":659983176},{"type":"v1","addr":"172.21.15.102:6836","nonce":659983176}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4270,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.102:6837/1874856825","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6834","nonce":1874856825},{"type":"v1","addr":"172.21.15.102:6837","nonce":1874856825}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4276,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6834/532911681","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6832","nonce":532911681},{"type":"v1","addr":"172.21.15.154:6834","nonce":532911681}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-13T11:28:57.401001+0000","modified":"2023-11-13T11:29:00.404631+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4279},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4279":{"gid":4279,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.154:6835/3766337294","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6833","nonce":3766337294},{"type":"v1","addr":"172.21.15.154:6835","nonce":3766337294}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-11-13T11:29:44.324 INFO:teuthology.orchestra.run.smithi102.stderr:dumped fsmap epoch 8 2023-11-13T11:29:44.325 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:44.318+0000 7fb5c9d2a640 1 -- 172.21.15.102:0/2776625949 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7fb5b0066470 msgr2=0x7fb5b0068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:44.325 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:44.318+0000 7fb5c9d2a640 1 --2- 172.21.15.102:0/2776625949 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7fb5b0066470 0x7fb5b0068930 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fb5b40ad000 tx=0x7fb5b40a6000 comp rx=0 tx=0).stop 2023-11-13T11:29:44.325 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:44.318+0000 7fb5c9d2a640 1 -- 172.21.15.102:0/2776625949 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb5c406dc70 msgr2=0x7fb5c4156d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:44.326 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:44.318+0000 7fb5c9d2a640 1 --2- 172.21.15.102:0/2776625949 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb5c406dc70 0x7fb5c4156d00 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fb5b800e980 tx=0x7fb5b800ee40 comp rx=0 tx=0).stop 2023-11-13T11:29:44.326 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:44.318+0000 7fb5c9d2a640 1 -- 172.21.15.102:0/2776625949 shutdown_connections 2023-11-13T11:29:44.327 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:44.318+0000 7fb5c9d2a640 1 --2- 172.21.15.102:0/2776625949 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7fb5b0066470 0x7fb5b0068930 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:44.327 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:44.318+0000 7fb5c9d2a640 1 --2- 172.21.15.102:0/2776625949 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb5c413df40 0x7fb5c41581e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:44.327 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:44.318+0000 7fb5c9d2a640 1 --2- 172.21.15.102:0/2776625949 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb5c406dc70 0x7fb5c4156d00 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:44.327 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:44.318+0000 7fb5c9d2a640 1 --2- 172.21.15.102:0/2776625949 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb5c406bfd0 0x7fb5c40ad300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:44.327 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:44.318+0000 7fb5c9d2a640 1 -- 172.21.15.102:0/2776625949 >> 172.21.15.102:0/2776625949 conn(0x7fb5c40b0870 msgr2=0x7fb5c40af090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-13T11:29:44.328 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:44.318+0000 7fb5c9d2a640 1 -- 172.21.15.102:0/2776625949 shutdown_connections 2023-11-13T11:29:44.328 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:44.318+0000 7fb5c9d2a640 1 -- 172.21.15.102:0/2776625949 wait complete. 2023-11-13T11:29:44.344 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-13T11:29:44.484 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:44.474+0000 7f4d942fe640 1 Processor -- start 2023-11-13T11:29:44.484 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:44.474+0000 7f4d942fe640 1 -- start start 2023-11-13T11:29:44.485 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:44.478+0000 7f4d942fe640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4d8c143520 0x7f4d8c15b280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:44.485 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:44.478+0000 7f4d942fe640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f4d8c06ce40 0x7f4d8c06d2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:44.485 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:44.478+0000 7f4d942fe640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4d8c06d7e0 con 0x7f4d8c0b26f0 2023-11-13T11:29:44.485 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:44.478+0000 7f4d942fe640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4d8c0b3250 con 0x7f4d8c06ce40 2023-11-13T11:29:44.485 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:44.478+0000 7f4d942fe640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d8c0b3460 con 0x7f4d8c143520 2023-11-13T11:29:44.486 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:44.478+0000 7f4d91899640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f4d8c06ce40 0x7f4d8c06d2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:44.486 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:44.478+0000 7f4d91899640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f4d8c06ce40 0x7f4d8c06d2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:45532/0 (socket says 172.21.15.102:45532) 2023-11-13T11:29:44.486 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:44.478+0000 7f4d91899640 1 -- 172.21.15.102:0/174512038 learned_addr learned my addr 172.21.15.102:0/174512038 (peer_addr_for_me v2:172.21.15.102:0/0) 2023-11-13T11:29:44.486 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:44.478+0000 7f4d9289b640 1 --1- 172.21.15.102:0/174512038 >> v1:172.21.15.102:6789/0 conn(0x7f4d8c0b26f0 0x7f4d8c0b2b40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.102:6789/0 says I am v1:172.21.15.102:45958/0 (socket says 172.21.15.102:45958) 2023-11-13T11:29:44.486 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:44.478+0000 7f4d9209a640 1 --2- 172.21.15.102:0/174512038 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4d8c143520 0x7f4d8c15b280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:44.487 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:44.478+0000 7f4d91899640 1 -- 172.21.15.102:0/174512038 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4d8c143520 msgr2=0x7f4d8c15b280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-13T11:29:44.487 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:44.478+0000 7f4d91899640 1 --2- 172.21.15.102:0/174512038 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4d8c143520 0x7f4d8c15b280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:44.487 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:44.478+0000 7f4d91899640 1 -- 172.21.15.102:0/174512038 >> v1:172.21.15.102:6789/0 conn(0x7f4d8c0b26f0 legacy=0x7f4d8c0b2b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:44.487 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:44.478+0000 7f4d91899640 1 -- 172.21.15.102:0/174512038 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d8c143900 con 0x7f4d8c06ce40 2023-11-13T11:29:44.487 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:44.478+0000 7f4d91098640 1 -- 172.21.15.102:0/174512038 <== mon.0 v1:172.21.15.102:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4260831038 0 0) 0x7f4d8c06d7e0 con 0x7f4d8c0b26f0 2023-11-13T11:29:44.489 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:44.478+0000 7f4d91899640 1 --2- 172.21.15.102:0/174512038 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4d8c06ce40 0x7f4d8c06d2a0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f4d7c009870 tx=0x7f4d7c01c4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=82f51659c54a943e server_cookie=0 in_seq=0 out_seq=0 2023-11-13T11:29:44.490 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:44.482+0000 7f4d91098640 1 -- 172.21.15.102:0/174512038 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d7c0ac600 con 0x7f4d8c06ce40 2023-11-13T11:29:44.490 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:44.482+0000 7f4d91098640 1 -- 172.21.15.102:0/174512038 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d7c0a8050 con 0x7f4d8c06ce40 2023-11-13T11:29:44.490 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:44.482+0000 7f4d91098640 1 -- 172.21.15.102:0/174512038 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d7c0ac980 con 0x7f4d8c06ce40 2023-11-13T11:29:44.490 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:44.482+0000 7f4d942fe640 1 -- 172.21.15.102:0/174512038 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4d8c06ce40 msgr2=0x7f4d8c06d2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:44.491 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:44.482+0000 7f4d942fe640 1 --2- 172.21.15.102:0/174512038 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4d8c06ce40 0x7f4d8c06d2a0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f4d7c009870 tx=0x7f4d7c01c4b0 comp rx=0 tx=0).stop 2023-11-13T11:29:44.491 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:44.482+0000 7f4d942fe640 1 -- 172.21.15.102:0/174512038 shutdown_connections 2023-11-13T11:29:44.491 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:44.482+0000 7f4d942fe640 1 --2- 172.21.15.102:0/174512038 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4d8c06ce40 0x7f4d8c06d2a0 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:44.491 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:44.482+0000 7f4d942fe640 1 --2- 172.21.15.102:0/174512038 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4d8c143520 0x7f4d8c15b280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:44.491 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:44.482+0000 7f4d942fe640 1 -- 172.21.15.102:0/174512038 >> 172.21.15.102:0/174512038 conn(0x7f4d8c06a240 msgr2=0x7f4d8c06a650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-13T11:29:44.492 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:44.482+0000 7f4d942fe640 1 -- 172.21.15.102:0/174512038 shutdown_connections 2023-11-13T11:29:44.492 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:44.482+0000 7f4d942fe640 1 -- 172.21.15.102:0/174512038 wait complete. 2023-11-13T11:29:44.492 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:44.482+0000 7f4d942fe640 1 Processor -- start 2023-11-13T11:29:44.492 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:44.482+0000 7f4d942fe640 1 -- start start 2023-11-13T11:29:44.496 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:44.482+0000 7f4d942fe640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4d8c06ce40 0x7f4d8c138cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:44.496 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:44.482+0000 7f4d942fe640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4d8c0b26f0 0x7f4d8c1f87b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:44.496 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:44.482+0000 7f4d942fe640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4d8c143520 0x7f4d8c1f8cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:44.496 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:44.482+0000 7f4d942fe640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d8c1f9760 con 0x7f4d8c143520 2023-11-13T11:29:44.497 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:44.482+0000 7f4d942fe640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d8c1f9230 con 0x7f4d8c06ce40 2023-11-13T11:29:44.497 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:44.482+0000 7f4d942fe640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d8c141950 con 0x7f4d8c0b26f0 2023-11-13T11:29:44.497 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:44.486+0000 7f4d9289b640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4d8c143520 0x7f4d8c1f8cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:44.497 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:44.486+0000 7f4d91899640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4d8c0b26f0 0x7f4d8c1f87b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:44.498 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:44.486+0000 7f4d91899640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4d8c0b26f0 0x7f4d8c1f87b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.102:38740/0 (socket says 172.21.15.102:38740) 2023-11-13T11:29:44.498 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:44.486+0000 7f4d9289b640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4d8c143520 0x7f4d8c1f8cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:45542/0 (socket says 172.21.15.102:45542) 2023-11-13T11:29:44.499 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:44.486+0000 7f4d91899640 1 -- 172.21.15.102:0/1883413378 learned_addr learned my addr 172.21.15.102:0/1883413378 (peer_addr_for_me v2:172.21.15.102:0/0) 2023-11-13T11:29:44.499 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:44.486+0000 7f4d9209a640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4d8c06ce40 0x7f4d8c138cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:44.499 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:44.486+0000 7f4d9289b640 1 -- 172.21.15.102:0/1883413378 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4d8c0b26f0 msgr2=0x7f4d8c1f87b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:44.499 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:44.486+0000 7f4d9289b640 1 --2- 172.21.15.102:0/1883413378 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4d8c0b26f0 0x7f4d8c1f87b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:44.500 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:44.486+0000 7f4d9289b640 1 -- 172.21.15.102:0/1883413378 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4d8c06ce40 msgr2=0x7f4d8c138cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:44.500 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:44.486+0000 7f4d9289b640 1 --2- 172.21.15.102:0/1883413378 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4d8c06ce40 0x7f4d8c138cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:44.500 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:44.486+0000 7f4d9289b640 1 -- 172.21.15.102:0/1883413378 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d7c0094d0 con 0x7f4d8c143520 2023-11-13T11:29:44.500 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:44.486+0000 7f4d9289b640 1 --2- 172.21.15.102:0/1883413378 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4d8c143520 0x7f4d8c1f8cf0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f4d84002240 tx=0x7f4d8400cbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-13T11:29:44.501 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:44.486+0000 7f4d82ffd640 1 -- 172.21.15.102:0/1883413378 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d8400ce30 con 0x7f4d8c143520 2023-11-13T11:29:44.501 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:44.486+0000 7f4d82ffd640 1 -- 172.21.15.102:0/1883413378 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d8400a640 con 0x7f4d8c143520 2023-11-13T11:29:44.501 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:44.486+0000 7f4d82ffd640 1 -- 172.21.15.102:0/1883413378 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d8400a9f0 con 0x7f4d8c143520 2023-11-13T11:29:44.501 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:44.486+0000 7f4d942fe640 1 -- 172.21.15.102:0/1883413378 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4d8c1f9480 con 0x7f4d8c143520 2023-11-13T11:29:44.502 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:44.486+0000 7f4d942fe640 1 -- 172.21.15.102:0/1883413378 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4d8c1670d0 con 0x7f4d8c143520 2023-11-13T11:29:44.502 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:44.486+0000 7f4d942fe640 1 -- 172.21.15.102:0/1883413378 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4d8c1414d0 con 0x7f4d8c143520 2023-11-13T11:29:44.502 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:44.486+0000 7f4d82ffd640 1 -- 172.21.15.102:0/1883413378 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f4d8400ab50 con 0x7f4d8c143520 2023-11-13T11:29:44.503 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:44.486+0000 7f4d82ffd640 1 --2- 172.21.15.102:0/1883413378 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f4d70066470 0x7f4d70068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:44.503 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:44.486+0000 7f4d82ffd640 1 -- 172.21.15.102:0/1883413378 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 5738+0+0 (secure 0 0 0) 0x7f4d84083320 con 0x7f4d8c143520 2023-11-13T11:29:44.503 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:44.490+0000 7f4d9209a640 1 --2- 172.21.15.102:0/1883413378 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f4d70066470 0x7f4d70068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:44.503 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:44.490+0000 7f4d9209a640 1 --2- 172.21.15.102:0/1883413378 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f4d70066470 0x7f4d70068930 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f4d8c159f10 tx=0x7f4d88009190 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-13T11:29:44.506 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:44.490+0000 7f4d82ffd640 1 -- 172.21.15.102:0/1883413378 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f4d8c1414d0 con 0x7f4d8c143520 2023-11-13T11:29:44.648 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:44.642+0000 7f4d942fe640 1 -- 172.21.15.102:0/1883413378 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f4d8c1414d0 con 0x7f4d8c143520 2023-11-13T11:29:44.649 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:44.642+0000 7f4d82ffd640 1 -- 172.21.15.102:0/1883413378 <== mon.0 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+16594 (secure 0 0 0) 0x7f4d8c1414d0 con 0x7f4d8c143520 2023-11-13T11:29:44.649 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T11:29:44.649 INFO:teuthology.orchestra.run.smithi102.stdout:{"epoch":24,"fsid":"97b3eb2b-7ccf-4aae-8d92-bff986c671ea","created":"2023-11-13T11:28:31.836724+0000","modified":"2023-11-13T11:29:38.698982+0000","last_up_change":"2023-11-13T11:28:44.876638+0000","last_in_change":"2023-11-13T11:28:35.312740+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-13T11:28:44.981356+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-13T11:28:55.958525+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-13T11:28:56.394264+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"bdefaa17-fcca-4c86-aa40-27dc33a789af","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6800","nonce":53303834},{"type":"v1","addr":"172.21.15.102:6801","nonce":53303834}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6802","nonce":53303834},{"type":"v1","addr":"172.21.15.102:6803","nonce":53303834}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6806","nonce":53303834},{"type":"v1","addr":"172.21.15.102:6807","nonce":53303834}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6804","nonce":53303834},{"type":"v1","addr":"172.21.15.102:6805","nonce":53303834}]},"public_addr":"172.21.15.102:6801/53303834","cluster_addr":"172.21.15.102:6803/53303834","heartbeat_back_addr":"172.21.15.102:6807/53303834","heartbeat_front_addr":"172.21.15.102:6805/53303834","state":["exists","up"]},{"osd":1,"uuid":"f0033196-dec9-4ae9-945e-6aeef6dbb47f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6808","nonce":1732708348},{"type":"v1","addr":"172.21.15.102:6809","nonce":1732708348}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6811","nonce":1732708348},{"type":"v1","addr":"172.21.15.102:6813","nonce":1732708348}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6818","nonce":1732708348},{"type":"v1","addr":"172.21.15.102:6820","nonce":1732708348}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6815","nonce":1732708348},{"type":"v1","addr":"172.21.15.102:6817","nonce":1732708348}]},"public_addr":"172.21.15.102:6809/1732708348","cluster_addr":"172.21.15.102:6813/1732708348","heartbeat_back_addr":"172.21.15.102:6820/1732708348","heartbeat_front_addr":"172.21.15.102:6817/1732708348","state":["exists","up"]},{"osd":2,"uuid":"496b0834-351e-4ec2-a714-86ed0c0ff4fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6810","nonce":1825475150},{"type":"v1","addr":"172.21.15.102:6812","nonce":1825475150}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6814","nonce":1825475150},{"type":"v1","addr":"172.21.15.102:6816","nonce":1825475150}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6822","nonce":1825475150},{"type":"v1","addr":"172.21.15.102:6823","nonce":1825475150}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6819","nonce":1825475150},{"type":"v1","addr":"172.21.15.102:6821","nonce":1825475150}]},"public_addr":"172.21.15.102:6812/1825475150","cluster_addr":"172.21.15.102:6816/1825475150","heartbeat_back_addr":"172.21.15.102:6823/1825475150","heartbeat_front_addr":"172.21.15.102:6821/1825475150","state":["exists","up"]},{"osd":3,"uuid":"3ba6cc41-e0a0-4273-86cb-90000c06a55a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6824","nonce":4149355528},{"type":"v1","addr":"172.21.15.102:6825","nonce":4149355528}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6826","nonce":4149355528},{"type":"v1","addr":"172.21.15.102:6827","nonce":4149355528}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6830","nonce":4149355528},{"type":"v1","addr":"172.21.15.102:6831","nonce":4149355528}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6828","nonce":4149355528},{"type":"v1","addr":"172.21.15.102:6829","nonce":4149355528}]},"public_addr":"172.21.15.102:6825/4149355528","cluster_addr":"172.21.15.102:6827/4149355528","heartbeat_back_addr":"172.21.15.102:6831/4149355528","heartbeat_front_addr":"172.21.15.102:6829/4149355528","state":["exists","up"]},{"osd":4,"uuid":"16e797d8-e6e7-4140-95c3-b85283c42a2a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6808","nonce":4028899241},{"type":"v1","addr":"172.21.15.154:6809","nonce":4028899241}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6810","nonce":4028899241},{"type":"v1","addr":"172.21.15.154:6811","nonce":4028899241}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6814","nonce":4028899241},{"type":"v1","addr":"172.21.15.154:6815","nonce":4028899241}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6812","nonce":4028899241},{"type":"v1","addr":"172.21.15.154:6813","nonce":4028899241}]},"public_addr":"172.21.15.154:6809/4028899241","cluster_addr":"172.21.15.154:6811/4028899241","heartbeat_back_addr":"172.21.15.154:6815/4028899241","heartbeat_front_addr":"172.21.15.154:6813/4028899241","state":["exists","up"]},{"osd":5,"uuid":"d6ab225c-1b55-450a-89a9-abe5c3f8d6af","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":3562396827},{"type":"v1","addr":"172.21.15.154:6801","nonce":3562396827}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":3562396827},{"type":"v1","addr":"172.21.15.154:6803","nonce":3562396827}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6806","nonce":3562396827},{"type":"v1","addr":"172.21.15.154:6807","nonce":3562396827}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6804","nonce":3562396827},{"type":"v1","addr":"172.21.15.154:6805","nonce":3562396827}]},"public_addr":"172.21.15.154:6801/3562396827","cluster_addr":"172.21.15.154:6803/3562396827","heartbeat_back_addr":"172.21.15.154:6807/3562396827","heartbeat_front_addr":"172.21.15.154:6805/3562396827","state":["exists","up"]},{"osd":6,"uuid":"96f905ac-491c-4662-8e2b-5bb8e929ab9d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6816","nonce":2933728751},{"type":"v1","addr":"172.21.15.154:6817","nonce":2933728751}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6818","nonce":2933728751},{"type":"v1","addr":"172.21.15.154:6819","nonce":2933728751}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6822","nonce":2933728751},{"type":"v1","addr":"172.21.15.154:6823","nonce":2933728751}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6820","nonce":2933728751},{"type":"v1","addr":"172.21.15.154:6821","nonce":2933728751}]},"public_addr":"172.21.15.154:6817/2933728751","cluster_addr":"172.21.15.154:6819/2933728751","heartbeat_back_addr":"172.21.15.154:6823/2933728751","heartbeat_front_addr":"172.21.15.154:6821/2933728751","state":["exists","up"]},{"osd":7,"uuid":"07012d3b-3ab4-40df-a471-93caed22e2dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6824","nonce":1753500785},{"type":"v1","addr":"172.21.15.154:6825","nonce":1753500785}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6826","nonce":1753500785},{"type":"v1","addr":"172.21.15.154:6827","nonce":1753500785}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6830","nonce":1753500785},{"type":"v1","addr":"172.21.15.154:6831","nonce":1753500785}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6828","nonce":1753500785},{"type":"v1","addr":"172.21.15.154:6829","nonce":1753500785}]},"public_addr":"172.21.15.154:6825/1753500785","cluster_addr":"172.21.15.154:6827/1753500785","heartbeat_back_addr":"172.21.15.154:6831/1753500785","heartbeat_front_addr":"172.21.15.154:6829/1753500785","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-13T11:28:40.978603+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-13T11:28:41.200985+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-13T11:28:41.222815+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-13T11:28:41.202162+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-13T11:28:40.925911+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-13T11:28:41.087725+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-13T11:28:41.072208+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-13T11:28:40.875257+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.2c","mappings":[{"from":0,"to":7}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-13T11:29:44.651 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:44.642+0000 7f4d942fe640 1 -- 172.21.15.102:0/1883413378 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f4d70066470 msgr2=0x7f4d70068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:44.651 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:44.642+0000 7f4d942fe640 1 --2- 172.21.15.102:0/1883413378 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f4d70066470 0x7f4d70068930 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f4d8c159f10 tx=0x7f4d88009190 comp rx=0 tx=0).stop 2023-11-13T11:29:44.651 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:44.642+0000 7f4d942fe640 1 -- 172.21.15.102:0/1883413378 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4d8c143520 msgr2=0x7f4d8c1f8cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:44.652 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:44.642+0000 7f4d942fe640 1 --2- 172.21.15.102:0/1883413378 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4d8c143520 0x7f4d8c1f8cf0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f4d84002240 tx=0x7f4d8400cbe0 comp rx=0 tx=0).stop 2023-11-13T11:29:44.652 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:44.646+0000 7f4d942fe640 1 -- 172.21.15.102:0/1883413378 shutdown_connections 2023-11-13T11:29:44.652 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:44.646+0000 7f4d942fe640 1 --2- 172.21.15.102:0/1883413378 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f4d70066470 0x7f4d70068930 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:44.653 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:44.646+0000 7f4d942fe640 1 --2- 172.21.15.102:0/1883413378 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4d8c143520 0x7f4d8c1f8cf0 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:44.653 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:44.646+0000 7f4d942fe640 1 --2- 172.21.15.102:0/1883413378 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4d8c0b26f0 0x7f4d8c1f87b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:44.653 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:44.646+0000 7f4d942fe640 1 --2- 172.21.15.102:0/1883413378 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4d8c06ce40 0x7f4d8c138cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:44.653 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:44.646+0000 7f4d942fe640 1 -- 172.21.15.102:0/1883413378 >> 172.21.15.102:0/1883413378 conn(0x7f4d8c06a240 msgr2=0x7f4d8c06d240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-13T11:29:44.653 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:44.646+0000 7f4d942fe640 1 -- 172.21.15.102:0/1883413378 shutdown_connections 2023-11-13T11:29:44.654 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:44.646+0000 7f4d942fe640 1 -- 172.21.15.102:0/1883413378 wait complete. 2023-11-13T11:29:44.671 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-11-13T11:29:44.671 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-13T11:29:44.810 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:44.802+0000 7ff18b12e640 1 Processor -- start 2023-11-13T11:29:44.811 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:44.802+0000 7ff18b12e640 1 -- start start 2023-11-13T11:29:44.812 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:44.802+0000 7ff18b12e640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7ff18406c1a0 0x7ff1841406e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:44.812 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:44.802+0000 7ff18b12e640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff18413e530 con 0x7ff18406dc70 2023-11-13T11:29:44.812 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:44.802+0000 7ff18b12e640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff18415f290 con 0x7ff18413df40 2023-11-13T11:29:44.813 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:44.802+0000 7ff18b12e640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff18415f0a0 con 0x7ff18406c1a0 2023-11-13T11:29:44.813 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:44.806+0000 7ff1896cb640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7ff18406c1a0 0x7ff1841406e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:44.813 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:44.806+0000 7ff17bfff640 1 --1- >> v1:172.21.15.102:6789/0 conn(0x7ff18406dc70 0x7ff18406ba90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.102:6789/0 says I am v1:172.21.15.102:45968/0 (socket says 172.21.15.102:45968) 2023-11-13T11:29:44.813 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:44.806+0000 7ff17bfff640 1 -- 172.21.15.102:0/2931845988 learned_addr learned my addr 172.21.15.102:0/2931845988 (peer_addr_for_me v1:172.21.15.102:0/0) 2023-11-13T11:29:44.814 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:44.806+0000 7ff1896cb640 1 -- 172.21.15.102:0/2931845988 >> v1:172.21.15.154:6789/0 conn(0x7ff18413df40 legacy=0x7ff18415e990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:44.814 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:44.806+0000 7ff1896cb640 1 -- 172.21.15.102:0/2931845988 >> v1:172.21.15.102:6789/0 conn(0x7ff18406dc70 legacy=0x7ff18406ba90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:44.815 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:44.806+0000 7ff17b7fe640 1 -- 172.21.15.102:0/2931845988 <== mon.0 v1:172.21.15.102:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2426404744 0 0) 0x7ff18413e530 con 0x7ff18406dc70 2023-11-13T11:29:44.815 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:44.806+0000 7ff1896cb640 1 -- 172.21.15.102:0/2931845988 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff18415f570 con 0x7ff18406c1a0 2023-11-13T11:29:44.816 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:44.806+0000 7ff1896cb640 1 --2- 172.21.15.102:0/2931845988 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff18406c1a0 0x7ff1841406e0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7ff17c009d90 tx=0x7ff17c01c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=232e5b26640b725e server_cookie=0 in_seq=0 out_seq=0 2023-11-13T11:29:44.816 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:44.806+0000 7ff17b7fe640 1 -- 172.21.15.102:0/2931845988 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff17c0a5900 con 0x7ff18406c1a0 2023-11-13T11:29:44.816 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:44.806+0000 7ff17b7fe640 1 -- 172.21.15.102:0/2931845988 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff17c0a5a60 con 0x7ff18406c1a0 2023-11-13T11:29:44.817 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:44.806+0000 7ff17b7fe640 1 -- 172.21.15.102:0/2931845988 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff17c0a5df0 con 0x7ff18406c1a0 2023-11-13T11:29:44.817 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:44.810+0000 7ff18b12e640 1 -- 172.21.15.102:0/2931845988 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff18406c1a0 msgr2=0x7ff1841406e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:44.817 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:44.810+0000 7ff18b12e640 1 --2- 172.21.15.102:0/2931845988 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff18406c1a0 0x7ff1841406e0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7ff17c009d90 tx=0x7ff17c01c950 comp rx=0 tx=0).stop 2023-11-13T11:29:44.817 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:44.810+0000 7ff18b12e640 1 -- 172.21.15.102:0/2931845988 shutdown_connections 2023-11-13T11:29:44.818 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:44.810+0000 7ff18b12e640 1 --2- 172.21.15.102:0/2931845988 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff18406c1a0 0x7ff1841406e0 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:44.818 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:44.810+0000 7ff18b12e640 1 -- 172.21.15.102:0/2931845988 >> 172.21.15.102:0/2931845988 conn(0x7ff1840b0870 msgr2=0x7ff1840b0c80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-13T11:29:44.818 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:44.810+0000 7ff18b12e640 1 -- 172.21.15.102:0/2931845988 shutdown_connections 2023-11-13T11:29:44.818 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:44.810+0000 7ff18b12e640 1 -- 172.21.15.102:0/2931845988 wait complete. 2023-11-13T11:29:44.820 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:44.810+0000 7ff18b12e640 1 Processor -- start 2023-11-13T11:29:44.821 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:44.810+0000 7ff18b12e640 1 -- start start 2023-11-13T11:29:44.821 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:44.810+0000 7ff18b12e640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff18406c1a0 0x7ff18413bf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:44.821 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:44.810+0000 7ff18b12e640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff18406dc70 0x7ff184159c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:44.821 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:44.810+0000 7ff18b12e640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff18413df40 0x7ff18413f5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:44.821 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:44.810+0000 7ff18b12e640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff18413ba70 con 0x7ff18406dc70 2023-11-13T11:29:44.822 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:44.810+0000 7ff18b12e640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff184137f50 con 0x7ff18413df40 2023-11-13T11:29:44.822 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:44.810+0000 7ff18b12e640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff18413c440 con 0x7ff18406c1a0 2023-11-13T11:29:44.822 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:44.810+0000 7ff17bfff640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff18406dc70 0x7ff184159c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:44.822 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:44.810+0000 7ff17bfff640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff18406dc70 0x7ff184159c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:45554/0 (socket says 172.21.15.102:45554) 2023-11-13T11:29:44.822 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:44.810+0000 7ff17bfff640 1 -- 172.21.15.102:0/214143346 learned_addr learned my addr 172.21.15.102:0/214143346 (peer_addr_for_me v2:172.21.15.102:0/0) 2023-11-13T11:29:44.823 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:44.810+0000 7ff1896cb640 1 --2- 172.21.15.102:0/214143346 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff18413df40 0x7ff18413f5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:44.823 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:44.810+0000 7ff188eca640 1 --2- 172.21.15.102:0/214143346 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff18406c1a0 0x7ff18413bf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:44.823 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:44.810+0000 7ff17bfff640 1 -- 172.21.15.102:0/214143346 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff18406c1a0 msgr2=0x7ff18413bf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:44.823 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:44.810+0000 7ff17bfff640 1 --2- 172.21.15.102:0/214143346 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff18406c1a0 0x7ff18413bf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:44.823 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:44.810+0000 7ff17bfff640 1 -- 172.21.15.102:0/214143346 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff18413df40 msgr2=0x7ff18413f5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:44.824 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:44.810+0000 7ff17bfff640 1 --2- 172.21.15.102:0/214143346 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff18413df40 0x7ff18413f5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:44.824 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:44.810+0000 7ff17bfff640 1 -- 172.21.15.102:0/214143346 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff17c009a70 con 0x7ff18406dc70 2023-11-13T11:29:44.824 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:44.814+0000 7ff17bfff640 1 --2- 172.21.15.102:0/214143346 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff18406dc70 0x7ff184159c30 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7ff17400c4a0 tx=0x7ff17400c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-13T11:29:44.824 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:44.814+0000 7ff1797fa640 1 -- 172.21.15.102:0/214143346 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1740074e0 con 0x7ff18406dc70 2023-11-13T11:29:44.824 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:44.814+0000 7ff1797fa640 1 -- 172.21.15.102:0/214143346 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff174007640 con 0x7ff18406dc70 2023-11-13T11:29:44.825 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:44.814+0000 7ff1797fa640 1 -- 172.21.15.102:0/214143346 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff174004a30 con 0x7ff18406dc70 2023-11-13T11:29:44.825 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:44.814+0000 7ff18b12e640 1 -- 172.21.15.102:0/214143346 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff18413ae60 con 0x7ff18406dc70 2023-11-13T11:29:44.825 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:44.814+0000 7ff18b12e640 1 -- 172.21.15.102:0/214143346 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff18413b420 con 0x7ff18406dc70 2023-11-13T11:29:44.826 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:44.814+0000 7ff18b12e640 1 -- 172.21.15.102:0/214143346 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff18413bbe0 con 0x7ff18406dc70 2023-11-13T11:29:44.827 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:44.814+0000 7ff1797fa640 1 -- 172.21.15.102:0/214143346 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7ff174004b90 con 0x7ff18406dc70 2023-11-13T11:29:44.827 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:44.814+0000 7ff1797fa640 1 --2- 172.21.15.102:0/214143346 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7ff170066470 0x7ff170068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:44.827 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:44.814+0000 7ff1797fa640 1 -- 172.21.15.102:0/214143346 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 5738+0+0 (secure 0 0 0) 0x7ff174082fd0 con 0x7ff18406dc70 2023-11-13T11:29:44.827 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:44.814+0000 7ff188eca640 1 --2- 172.21.15.102:0/214143346 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7ff170066470 0x7ff170068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:44.828 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:44.814+0000 7ff188eca640 1 --2- 172.21.15.102:0/214143346 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7ff170066470 0x7ff170068930 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7ff1841448a0 tx=0x7ff180009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-13T11:29:44.828 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:44.818+0000 7ff1797fa640 1 -- 172.21.15.102:0/214143346 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7ff174050570 con 0x7ff18406dc70 2023-11-13T11:29:45.015 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:45.010+0000 7ff18b12e640 1 -- 172.21.15.102:0/214143346 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff184068520 con 0x7ff18406dc70 2023-11-13T11:29:45.016 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:45.010+0000 7ff1797fa640 1 -- 172.21.15.102:0/214143346 <== mon.0 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4913 (secure 0 0 0) 0x7ff174018020 con 0x7ff18406dc70 2023-11-13T11:29:45.016 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T11:29:45.016 INFO:teuthology.orchestra.run.smithi102.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4226,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.102:6836/659983176","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6835","nonce":659983176},{"type":"v1","addr":"172.21.15.102:6836","nonce":659983176}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4270,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.102:6837/1874856825","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6834","nonce":1874856825},{"type":"v1","addr":"172.21.15.102:6837","nonce":1874856825}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4276,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6834/532911681","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6832","nonce":532911681},{"type":"v1","addr":"172.21.15.154:6834","nonce":532911681}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-13T11:28:57.401001+0000","modified":"2023-11-13T11:29:00.404631+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4279},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4279":{"gid":4279,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.154:6835/3766337294","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6833","nonce":3766337294},{"type":"v1","addr":"172.21.15.154:6835","nonce":3766337294}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-11-13T11:29:45.017 INFO:teuthology.orchestra.run.smithi102.stderr:dumped fsmap epoch 8 2023-11-13T11:29:45.018 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:45.010+0000 7ff18b12e640 1 -- 172.21.15.102:0/214143346 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7ff170066470 msgr2=0x7ff170068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:45.018 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:45.010+0000 7ff18b12e640 1 --2- 172.21.15.102:0/214143346 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7ff170066470 0x7ff170068930 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7ff1841448a0 tx=0x7ff180009040 comp rx=0 tx=0).stop 2023-11-13T11:29:45.018 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:45.010+0000 7ff18b12e640 1 -- 172.21.15.102:0/214143346 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff18406dc70 msgr2=0x7ff184159c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:45.018 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:45.010+0000 7ff18b12e640 1 --2- 172.21.15.102:0/214143346 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff18406dc70 0x7ff184159c30 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7ff17400c4a0 tx=0x7ff17400c960 comp rx=0 tx=0).stop 2023-11-13T11:29:45.019 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:45.010+0000 7ff18b12e640 1 -- 172.21.15.102:0/214143346 shutdown_connections 2023-11-13T11:29:45.019 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:45.010+0000 7ff18b12e640 1 --2- 172.21.15.102:0/214143346 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff18413df40 0x7ff18413f5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:45.019 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:45.010+0000 7ff18b12e640 1 --2- 172.21.15.102:0/214143346 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7ff170066470 0x7ff170068930 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:45.019 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:45.010+0000 7ff18b12e640 1 --2- 172.21.15.102:0/214143346 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff18406dc70 0x7ff184159c30 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:45.019 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:45.010+0000 7ff18b12e640 1 --2- 172.21.15.102:0/214143346 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff18406c1a0 0x7ff18413bf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:45.019 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:45.010+0000 7ff18b12e640 1 -- 172.21.15.102:0/214143346 >> 172.21.15.102:0/214143346 conn(0x7ff1840b0870 msgr2=0x7ff184070d50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-13T11:29:45.020 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:45.010+0000 7ff18b12e640 1 -- 172.21.15.102:0/214143346 shutdown_connections 2023-11-13T11:29:45.020 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:45.010+0000 7ff18b12e640 1 -- 172.21.15.102:0/214143346 wait complete. 2023-11-13T11:29:45.037 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-13T11:29:45.176 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:45.170+0000 7fb013468640 1 Processor -- start 2023-11-13T11:29:45.177 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:45.170+0000 7fb013468640 1 -- start start 2023-11-13T11:29:45.178 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:45.170+0000 7fb013468640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb00c13df40 0x7fb00c15e990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:45.178 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:45.170+0000 7fb013468640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7fb00c06dc70 0x7fb00c06ba90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:45.179 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:45.170+0000 7fb013468640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb00c13e530 con 0x7fb00c06bfd0 2023-11-13T11:29:45.179 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:45.170+0000 7fb013468640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb00c06c460 con 0x7fb00c06dc70 2023-11-13T11:29:45.179 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:45.170+0000 7fb013468640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb00c15f290 con 0x7fb00c13df40 2023-11-13T11:29:45.179 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:45.170+0000 7fb011a05640 1 --1- >> v1:172.21.15.102:6789/0 conn(0x7fb00c06bfd0 0x7fb00c0cd260 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.102:6789/0 says I am v1:172.21.15.102:45982/0 (socket says 172.21.15.102:45982) 2023-11-13T11:29:45.179 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:45.170+0000 7fb011a05640 1 -- 172.21.15.102:0/3783115986 learned_addr learned my addr 172.21.15.102:0/3783115986 (peer_addr_for_me v1:172.21.15.102:0/0) 2023-11-13T11:29:45.180 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:45.170+0000 7fb010a03640 1 --2- 172.21.15.102:0/3783115986 >> v2:172.21.15.102:3300/0 conn(0x7fb00c06dc70 0x7fb00c06ba90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:45.180 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:45.170+0000 7fb011204640 1 --2- 172.21.15.102:0/3783115986 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb00c13df40 0x7fb00c15e990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:45.181 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:45.170+0000 7fb003fff640 1 -- 172.21.15.102:0/3783115986 <== mon.0 v1:172.21.15.102:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1006752032 0 0) 0x7fb00c13e530 con 0x7fb00c06bfd0 2023-11-13T11:29:45.181 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:45.170+0000 7fb003fff640 1 -- 172.21.15.102:0/3783115986 --> v1:172.21.15.102:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7faff8003530 con 0x7fb00c06bfd0 2023-11-13T11:29:45.181 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:45.170+0000 7fb010a03640 1 -- 172.21.15.102:0/3783115986 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb00c13df40 msgr2=0x7fb00c15e990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-13T11:29:45.181 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:45.170+0000 7fb010a03640 1 --2- 172.21.15.102:0/3783115986 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb00c13df40 0x7fb00c15e990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:45.181 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:45.170+0000 7fb010a03640 1 -- 172.21.15.102:0/3783115986 >> v1:172.21.15.102:6789/0 conn(0x7fb00c06bfd0 legacy=0x7fb00c0cd260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:45.182 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:45.174+0000 7fb010a03640 1 -- 172.21.15.102:0/3783115986 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb00c15f570 con 0x7fb00c06dc70 2023-11-13T11:29:45.183 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:45.174+0000 7fb010a03640 1 --2- 172.21.15.102:0/3783115986 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb00c06dc70 0x7fb00c06ba90 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7faffc0097c0 tx=0x7faffc01c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c3b25b04d624312 server_cookie=0 in_seq=0 out_seq=0 2023-11-13T11:29:45.183 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:45.174+0000 7fb003fff640 1 -- 172.21.15.102:0/3783115986 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faffc0ab600 con 0x7fb00c06dc70 2023-11-13T11:29:45.183 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:45.174+0000 7fb003fff640 1 -- 172.21.15.102:0/3783115986 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faffc0a7050 con 0x7fb00c06dc70 2023-11-13T11:29:45.183 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:45.174+0000 7fb003fff640 1 -- 172.21.15.102:0/3783115986 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faffc0ab980 con 0x7fb00c06dc70 2023-11-13T11:29:45.184 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:45.174+0000 7fb013468640 1 -- 172.21.15.102:0/3783115986 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb00c06dc70 msgr2=0x7fb00c06ba90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:45.184 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:45.174+0000 7fb013468640 1 --2- 172.21.15.102:0/3783115986 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb00c06dc70 0x7fb00c06ba90 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7faffc0097c0 tx=0x7faffc01c480 comp rx=0 tx=0).stop 2023-11-13T11:29:45.184 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:45.174+0000 7fb013468640 1 -- 172.21.15.102:0/3783115986 shutdown_connections 2023-11-13T11:29:45.184 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:45.174+0000 7fb013468640 1 --2- 172.21.15.102:0/3783115986 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb00c06dc70 0x7fb00c06ba90 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:45.185 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:45.174+0000 7fb013468640 1 --2- 172.21.15.102:0/3783115986 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb00c13df40 0x7fb00c15e990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:45.185 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:45.174+0000 7fb013468640 1 -- 172.21.15.102:0/3783115986 >> 172.21.15.102:0/3783115986 conn(0x7fb00c0b0870 msgr2=0x7fb00c0b0c80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-13T11:29:45.185 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:45.178+0000 7fb013468640 1 -- 172.21.15.102:0/3783115986 shutdown_connections 2023-11-13T11:29:45.185 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:45.178+0000 7fb013468640 1 -- 172.21.15.102:0/3783115986 wait complete. 2023-11-13T11:29:45.187 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:45.178+0000 7fb013468640 1 Processor -- start 2023-11-13T11:29:45.187 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:45.178+0000 7fb013468640 1 -- start start 2023-11-13T11:29:45.188 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:45.178+0000 7fb013468640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb00c06bfd0 0x7fb00c1f8a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:45.188 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:45.178+0000 7fb013468640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb00c06dc70 0x7fb00c1f5b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:45.188 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:45.178+0000 7fb013468640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb00c13df40 0x7fb00c15a3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:45.188 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:45.178+0000 7fb013468640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb00c1f60d0 con 0x7fb00c06bfd0 2023-11-13T11:29:45.188 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:45.178+0000 7fb013468640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb00c13e7a0 con 0x7fb00c06dc70 2023-11-13T11:29:45.189 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:45.178+0000 7fb013468640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb00c13ea80 con 0x7fb00c13df40 2023-11-13T11:29:45.189 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:45.178+0000 7fb011204640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb00c06bfd0 0x7fb00c1f8a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:45.189 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:45.178+0000 7fb011204640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb00c06bfd0 0x7fb00c1f8a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:45574/0 (socket says 172.21.15.102:45574) 2023-11-13T11:29:45.190 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:45.178+0000 7fb011204640 1 -- 172.21.15.102:0/2557765281 learned_addr learned my addr 172.21.15.102:0/2557765281 (peer_addr_for_me v2:172.21.15.102:0/0) 2023-11-13T11:29:45.190 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:45.178+0000 7fb010a03640 1 --2- 172.21.15.102:0/2557765281 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb00c06dc70 0x7fb00c1f5b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:45.190 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:45.178+0000 7fb011a05640 1 --2- 172.21.15.102:0/2557765281 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb00c13df40 0x7fb00c15a3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:45.190 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:45.178+0000 7fb011204640 1 -- 172.21.15.102:0/2557765281 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb00c13df40 msgr2=0x7fb00c15a3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:45.190 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:45.178+0000 7fb011204640 1 --2- 172.21.15.102:0/2557765281 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb00c13df40 0x7fb00c15a3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:45.191 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:45.178+0000 7fb011204640 1 -- 172.21.15.102:0/2557765281 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb00c06dc70 msgr2=0x7fb00c1f5b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:45.191 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:45.178+0000 7fb011204640 1 --2- 172.21.15.102:0/2557765281 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb00c06dc70 0x7fb00c1f5b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:45.191 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:45.178+0000 7fb011204640 1 -- 172.21.15.102:0/2557765281 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faffc009420 con 0x7fb00c06bfd0 2023-11-13T11:29:45.191 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:45.178+0000 7fb011a05640 1 --2- 172.21.15.102:0/2557765281 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb00c13df40 0x7fb00c15a3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-13T11:29:45.191 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:45.178+0000 7fb011204640 1 --2- 172.21.15.102:0/2557765281 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb00c06bfd0 0x7fb00c1f8a70 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7fb00800e870 tx=0x7fb00800ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-13T11:29:45.192 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:45.178+0000 7fb001ffb640 1 -- 172.21.15.102:0/2557765281 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb008009510 con 0x7fb00c06bfd0 2023-11-13T11:29:45.192 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:45.182+0000 7fb001ffb640 1 -- 172.21.15.102:0/2557765281 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb00800eec0 con 0x7fb00c06bfd0 2023-11-13T11:29:45.192 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:45.182+0000 7fb001ffb640 1 -- 172.21.15.102:0/2557765281 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb00800cb40 con 0x7fb00c06bfd0 2023-11-13T11:29:45.192 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:45.182+0000 7fb013468640 1 -- 172.21.15.102:0/2557765281 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb00c13ed60 con 0x7fb00c06bfd0 2023-11-13T11:29:45.192 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:45.182+0000 7fb013468640 1 -- 172.21.15.102:0/2557765281 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb00c13f320 con 0x7fb00c06bfd0 2023-11-13T11:29:45.193 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:45.182+0000 7fb013468640 1 -- 172.21.15.102:0/2557765281 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb00c13f4b0 con 0x7fb00c06bfd0 2023-11-13T11:29:45.194 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:45.182+0000 7fb001ffb640 1 -- 172.21.15.102:0/2557765281 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fb00800cca0 con 0x7fb00c06bfd0 2023-11-13T11:29:45.194 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:45.182+0000 7fb001ffb640 1 --2- 172.21.15.102:0/2557765281 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7faff0066470 0x7faff0068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:45.194 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:45.182+0000 7fb001ffb640 1 -- 172.21.15.102:0/2557765281 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 5738+0+0 (secure 0 0 0) 0x7fb008083fc0 con 0x7fb00c06bfd0 2023-11-13T11:29:45.194 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:45.182+0000 7fb010a03640 1 --2- 172.21.15.102:0/2557765281 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7faff0066470 0x7faff0068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:45.194 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:45.182+0000 7fb010a03640 1 --2- 172.21.15.102:0/2557765281 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7faff0066470 0x7faff0068930 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7faffc0ad000 tx=0x7faffc0a6000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-13T11:29:45.195 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:45.186+0000 7fb001ffb640 1 -- 172.21.15.102:0/2557765281 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fb008051430 con 0x7fb00c06bfd0 2023-11-13T11:29:45.374 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:45.366+0000 7fb013468640 1 -- 172.21.15.102:0/2557765281 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb00c068520 con 0x7fb00c06bfd0 2023-11-13T11:29:45.375 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:45.370+0000 7fb001ffb640 1 -- 172.21.15.102:0/2557765281 <== mon.0 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4913 (secure 0 0 0) 0x7fb008054a50 con 0x7fb00c06bfd0 2023-11-13T11:29:45.376 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T11:29:45.376 INFO:teuthology.orchestra.run.smithi102.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4226,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.102:6836/659983176","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6835","nonce":659983176},{"type":"v1","addr":"172.21.15.102:6836","nonce":659983176}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4270,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.102:6837/1874856825","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6834","nonce":1874856825},{"type":"v1","addr":"172.21.15.102:6837","nonce":1874856825}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4276,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6834/532911681","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6832","nonce":532911681},{"type":"v1","addr":"172.21.15.154:6834","nonce":532911681}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-13T11:28:57.401001+0000","modified":"2023-11-13T11:29:00.404631+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4279},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4279":{"gid":4279,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.154:6835/3766337294","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6833","nonce":3766337294},{"type":"v1","addr":"172.21.15.154:6835","nonce":3766337294}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-11-13T11:29:45.376 INFO:teuthology.orchestra.run.smithi102.stderr:dumped fsmap epoch 8 2023-11-13T11:29:45.377 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:45.370+0000 7fb013468640 1 -- 172.21.15.102:0/2557765281 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7faff0066470 msgr2=0x7faff0068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:45.378 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:45.370+0000 7fb013468640 1 --2- 172.21.15.102:0/2557765281 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7faff0066470 0x7faff0068930 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7faffc0ad000 tx=0x7faffc0a6000 comp rx=0 tx=0).stop 2023-11-13T11:29:45.378 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:45.370+0000 7fb013468640 1 -- 172.21.15.102:0/2557765281 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb00c06bfd0 msgr2=0x7fb00c1f8a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:45.378 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:45.370+0000 7fb013468640 1 --2- 172.21.15.102:0/2557765281 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb00c06bfd0 0x7fb00c1f8a70 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7fb00800e870 tx=0x7fb00800ec70 comp rx=0 tx=0).stop 2023-11-13T11:29:45.378 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:45.370+0000 7fb013468640 1 -- 172.21.15.102:0/2557765281 shutdown_connections 2023-11-13T11:29:45.378 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:45.370+0000 7fb013468640 1 --2- 172.21.15.102:0/2557765281 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb00c13df40 0x7fb00c15a3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:45.379 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:45.370+0000 7fb013468640 1 --2- 172.21.15.102:0/2557765281 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb00c06dc70 0x7fb00c1f5b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:45.379 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:45.370+0000 7fb013468640 1 --2- 172.21.15.102:0/2557765281 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7faff0066470 0x7faff0068930 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:45.379 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:45.370+0000 7fb013468640 1 --2- 172.21.15.102:0/2557765281 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb00c06bfd0 0x7fb00c1f8a70 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:45.379 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:45.370+0000 7fb013468640 1 -- 172.21.15.102:0/2557765281 >> 172.21.15.102:0/2557765281 conn(0x7fb00c0b0870 msgr2=0x7fb00c06fd10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-13T11:29:45.379 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:45.370+0000 7fb013468640 1 -- 172.21.15.102:0/2557765281 shutdown_connections 2023-11-13T11:29:45.380 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:45.370+0000 7fb013468640 1 -- 172.21.15.102:0/2557765281 wait complete. 2023-11-13T11:29:45.396 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-13T11:29:45.534 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:45.525+0000 7f1c9638d640 1 Processor -- start 2023-11-13T11:29:45.534 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:45.525+0000 7f1c9638d640 1 -- start start 2023-11-13T11:29:45.535 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:45.529+0000 7f1c9638d640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f1c90159420 0x7f1c9006d8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:45.535 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:45.529+0000 7f1c9638d640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1c900cd960 0x7f1c900b1b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:45.536 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:45.529+0000 7f1c9638d640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1c9006dde0 con 0x7f1c900cae80 2023-11-13T11:29:45.536 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:45.529+0000 7f1c9638d640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1c9006c800 con 0x7f1c90159420 2023-11-13T11:29:45.536 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:45.529+0000 7f1c9638d640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c9006cae0 con 0x7f1c900cd960 2023-11-13T11:29:45.536 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:45.529+0000 7f1c8ffff640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f1c90159420 0x7f1c9006d8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:45.537 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:45.529+0000 7f1c8ffff640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f1c90159420 0x7f1c9006d8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:45582/0 (socket says 172.21.15.102:45582) 2023-11-13T11:29:45.537 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:45.529+0000 7f1c8ffff640 1 -- 172.21.15.102:0/214913292 learned_addr learned my addr 172.21.15.102:0/214913292 (peer_addr_for_me v2:172.21.15.102:0/0) 2023-11-13T11:29:45.538 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:45.529+0000 7f1c8ffff640 1 -- 172.21.15.102:0/214913292 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1c900cd960 msgr2=0x7f1c900b1b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-13T11:29:45.538 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:45.529+0000 7f1c9492a640 1 --2- 172.21.15.102:0/214913292 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1c900cd960 0x7f1c900b1b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:45.538 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:45.529+0000 7f1c8ffff640 1 --2- 172.21.15.102:0/214913292 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1c900cd960 0x7f1c900b1b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:45.538 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:45.529+0000 7f1c8ffff640 1 -- 172.21.15.102:0/214913292 >> v1:172.21.15.154:6789/0 conn(0x7f1c900cae80 legacy=0x7f1c900cd250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-13T11:29:45.539 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:45.529+0000 7f1c8ffff640 1 -- 172.21.15.102:0/214913292 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c9006cdc0 con 0x7f1c90159420 2023-11-13T11:29:45.539 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:45.529+0000 7f1c9492a640 1 --2- 172.21.15.102:0/214913292 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1c900cd960 0x7f1c900b1b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-13T11:29:45.540 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:45.529+0000 7f1c8ffff640 1 --2- 172.21.15.102:0/214913292 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1c90159420 0x7f1c9006d8a0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f1c80009870 tx=0x7f1c8001ecf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=79def7cdd343d0cd server_cookie=0 in_seq=0 out_seq=0 2023-11-13T11:29:45.540 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:45.533+0000 7f1c8effd640 1 -- 172.21.15.102:0/214913292 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c800a89b0 con 0x7f1c90159420 2023-11-13T11:29:45.541 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:45.533+0000 7f1c8effd640 1 -- 172.21.15.102:0/214913292 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c800a8b10 con 0x7f1c90159420 2023-11-13T11:29:45.541 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:45.533+0000 7f1c8effd640 1 -- 172.21.15.102:0/214913292 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c800a8ea0 con 0x7f1c90159420 2023-11-13T11:29:45.542 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:45.533+0000 7f1c9638d640 1 -- 172.21.15.102:0/214913292 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1c90159420 msgr2=0x7f1c9006d8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:45.542 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:45.533+0000 7f1c9638d640 1 --2- 172.21.15.102:0/214913292 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1c90159420 0x7f1c9006d8a0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f1c80009870 tx=0x7f1c8001ecf0 comp rx=0 tx=0).stop 2023-11-13T11:29:45.542 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:45.533+0000 7f1c9638d640 1 -- 172.21.15.102:0/214913292 shutdown_connections 2023-11-13T11:29:45.542 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:45.533+0000 7f1c9638d640 1 --2- 172.21.15.102:0/214913292 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1c900cd960 0x7f1c900b1b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:45.542 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:45.533+0000 7f1c9638d640 1 --2- 172.21.15.102:0/214913292 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1c90159420 0x7f1c9006d8a0 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:45.543 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:45.533+0000 7f1c9638d640 1 -- 172.21.15.102:0/214913292 >> 172.21.15.102:0/214913292 conn(0x7f1c900b0870 msgr2=0x7f1c900b0c80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-13T11:29:45.543 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:45.533+0000 7f1c9638d640 1 -- 172.21.15.102:0/214913292 shutdown_connections 2023-11-13T11:29:45.543 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:45.533+0000 7f1c9638d640 1 -- 172.21.15.102:0/214913292 wait complete. 2023-11-13T11:29:45.545 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:45.533+0000 7f1c9638d640 1 Processor -- start 2023-11-13T11:29:45.546 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:45.533+0000 7f1c9638d640 1 -- start start 2023-11-13T11:29:45.546 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:45.533+0000 7f1c9638d640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1c900cae80 0x7f1c90141480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:45.546 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:45.533+0000 7f1c9638d640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1c900cd960 0x7f1c9015c3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:45.546 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:45.533+0000 7f1c9638d640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1c90159420 0x7f1c9015a540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:45.547 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:45.533+0000 7f1c9638d640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c9015d9d0 con 0x7f1c900cd960 2023-11-13T11:29:45.547 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:45.533+0000 7f1c9638d640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c901419c0 con 0x7f1c90159420 2023-11-13T11:29:45.547 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:45.533+0000 7f1c9638d640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c9015ce50 con 0x7f1c900cae80 2023-11-13T11:29:45.547 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:45.537+0000 7f1c8f7fe640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1c900cd960 0x7f1c9015c3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:45.548 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:45.537+0000 7f1c8f7fe640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1c900cd960 0x7f1c9015c3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:45584/0 (socket says 172.21.15.102:45584) 2023-11-13T11:29:45.548 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:45.537+0000 7f1c8f7fe640 1 -- 172.21.15.102:0/2102041371 learned_addr learned my addr 172.21.15.102:0/2102041371 (peer_addr_for_me v2:172.21.15.102:0/0) 2023-11-13T11:29:45.548 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:45.537+0000 7f1c9492a640 1 --2- 172.21.15.102:0/2102041371 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1c90159420 0x7f1c9015a540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:45.548 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:45.537+0000 7f1c8ffff640 1 --2- 172.21.15.102:0/2102041371 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1c900cae80 0x7f1c90141480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:45.548 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:45.537+0000 7f1c8f7fe640 1 -- 172.21.15.102:0/2102041371 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1c900cae80 msgr2=0x7f1c90141480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:45.549 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:45.537+0000 7f1c8f7fe640 1 --2- 172.21.15.102:0/2102041371 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1c900cae80 0x7f1c90141480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:45.549 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:45.537+0000 7f1c8f7fe640 1 -- 172.21.15.102:0/2102041371 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1c90159420 msgr2=0x7f1c9015a540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:45.549 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:45.537+0000 7f1c8f7fe640 1 --2- 172.21.15.102:0/2102041371 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1c90159420 0x7f1c9015a540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:45.550 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:45.537+0000 7f1c8f7fe640 1 -- 172.21.15.102:0/2102041371 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c800094d0 con 0x7f1c900cd960 2023-11-13T11:29:45.550 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:45.537+0000 7f1c8f7fe640 1 --2- 172.21.15.102:0/2102041371 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1c900cd960 0x7f1c9015c3e0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f1c8400c450 tx=0x7f1c8400c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-13T11:29:45.550 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:45.537+0000 7f1c8cff9640 1 -- 172.21.15.102:0/2102041371 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c84012830 con 0x7f1c900cd960 2023-11-13T11:29:45.550 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:45.537+0000 7f1c8cff9640 1 -- 172.21.15.102:0/2102041371 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c840129b0 con 0x7f1c900cd960 2023-11-13T11:29:45.550 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:45.537+0000 7f1c8cff9640 1 -- 172.21.15.102:0/2102041371 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c84012d60 con 0x7f1c900cd960 2023-11-13T11:29:45.551 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:45.537+0000 7f1c9638d640 1 -- 172.21.15.102:0/2102041371 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1c9015d130 con 0x7f1c900cd960 2023-11-13T11:29:45.551 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:45.537+0000 7f1c9638d640 1 -- 172.21.15.102:0/2102041371 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1c9015d6f0 con 0x7f1c900cd960 2023-11-13T11:29:45.552 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:45.537+0000 7f1c9638d640 1 -- 172.21.15.102:0/2102041371 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1c90068520 con 0x7f1c900cd960 2023-11-13T11:29:45.553 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:45.537+0000 7f1c8cff9640 1 -- 172.21.15.102:0/2102041371 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f1c8401c460 con 0x7f1c900cd960 2023-11-13T11:29:45.553 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:45.541+0000 7f1c8cff9640 1 --2- 172.21.15.102:0/2102041371 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f1c7c0664a0 0x7f1c7c068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:45.553 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:45.541+0000 7f1c8cff9640 1 -- 172.21.15.102:0/2102041371 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 5738+0+0 (secure 0 0 0) 0x7f1c84083b10 con 0x7f1c900cd960 2023-11-13T11:29:45.553 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:45.541+0000 7f1c8ffff640 1 --2- 172.21.15.102:0/2102041371 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f1c7c0664a0 0x7f1c7c068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:45.554 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:45.541+0000 7f1c8ffff640 1 --2- 172.21.15.102:0/2102041371 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f1c7c0664a0 0x7f1c7c068960 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f1c800b2000 tx=0x7f1c80009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-13T11:29:45.554 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:45.541+0000 7f1c8cff9640 1 -- 172.21.15.102:0/2102041371 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f1c84051020 con 0x7f1c900cd960 2023-11-13T11:29:45.705 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:45.697+0000 7f1c9638d640 1 -- 172.21.15.102:0/2102041371 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f1c900ce260 con 0x7f1c900cd960 2023-11-13T11:29:45.707 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:45.701+0000 7f1c8cff9640 1 -- 172.21.15.102:0/2102041371 <== mon.0 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+16594 (secure 0 0 0) 0x7f1c84054640 con 0x7f1c900cd960 2023-11-13T11:29:45.708 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T11:29:45.708 INFO:teuthology.orchestra.run.smithi102.stdout:{"epoch":24,"fsid":"97b3eb2b-7ccf-4aae-8d92-bff986c671ea","created":"2023-11-13T11:28:31.836724+0000","modified":"2023-11-13T11:29:38.698982+0000","last_up_change":"2023-11-13T11:28:44.876638+0000","last_in_change":"2023-11-13T11:28:35.312740+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-13T11:28:44.981356+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-13T11:28:55.958525+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-13T11:28:56.394264+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"bdefaa17-fcca-4c86-aa40-27dc33a789af","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6800","nonce":53303834},{"type":"v1","addr":"172.21.15.102:6801","nonce":53303834}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6802","nonce":53303834},{"type":"v1","addr":"172.21.15.102:6803","nonce":53303834}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6806","nonce":53303834},{"type":"v1","addr":"172.21.15.102:6807","nonce":53303834}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6804","nonce":53303834},{"type":"v1","addr":"172.21.15.102:6805","nonce":53303834}]},"public_addr":"172.21.15.102:6801/53303834","cluster_addr":"172.21.15.102:6803/53303834","heartbeat_back_addr":"172.21.15.102:6807/53303834","heartbeat_front_addr":"172.21.15.102:6805/53303834","state":["exists","up"]},{"osd":1,"uuid":"f0033196-dec9-4ae9-945e-6aeef6dbb47f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6808","nonce":1732708348},{"type":"v1","addr":"172.21.15.102:6809","nonce":1732708348}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6811","nonce":1732708348},{"type":"v1","addr":"172.21.15.102:6813","nonce":1732708348}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6818","nonce":1732708348},{"type":"v1","addr":"172.21.15.102:6820","nonce":1732708348}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6815","nonce":1732708348},{"type":"v1","addr":"172.21.15.102:6817","nonce":1732708348}]},"public_addr":"172.21.15.102:6809/1732708348","cluster_addr":"172.21.15.102:6813/1732708348","heartbeat_back_addr":"172.21.15.102:6820/1732708348","heartbeat_front_addr":"172.21.15.102:6817/1732708348","state":["exists","up"]},{"osd":2,"uuid":"496b0834-351e-4ec2-a714-86ed0c0ff4fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6810","nonce":1825475150},{"type":"v1","addr":"172.21.15.102:6812","nonce":1825475150}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6814","nonce":1825475150},{"type":"v1","addr":"172.21.15.102:6816","nonce":1825475150}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6822","nonce":1825475150},{"type":"v1","addr":"172.21.15.102:6823","nonce":1825475150}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6819","nonce":1825475150},{"type":"v1","addr":"172.21.15.102:6821","nonce":1825475150}]},"public_addr":"172.21.15.102:6812/1825475150","cluster_addr":"172.21.15.102:6816/1825475150","heartbeat_back_addr":"172.21.15.102:6823/1825475150","heartbeat_front_addr":"172.21.15.102:6821/1825475150","state":["exists","up"]},{"osd":3,"uuid":"3ba6cc41-e0a0-4273-86cb-90000c06a55a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6824","nonce":4149355528},{"type":"v1","addr":"172.21.15.102:6825","nonce":4149355528}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6826","nonce":4149355528},{"type":"v1","addr":"172.21.15.102:6827","nonce":4149355528}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6830","nonce":4149355528},{"type":"v1","addr":"172.21.15.102:6831","nonce":4149355528}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6828","nonce":4149355528},{"type":"v1","addr":"172.21.15.102:6829","nonce":4149355528}]},"public_addr":"172.21.15.102:6825/4149355528","cluster_addr":"172.21.15.102:6827/4149355528","heartbeat_back_addr":"172.21.15.102:6831/4149355528","heartbeat_front_addr":"172.21.15.102:6829/4149355528","state":["exists","up"]},{"osd":4,"uuid":"16e797d8-e6e7-4140-95c3-b85283c42a2a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6808","nonce":4028899241},{"type":"v1","addr":"172.21.15.154:6809","nonce":4028899241}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6810","nonce":4028899241},{"type":"v1","addr":"172.21.15.154:6811","nonce":4028899241}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6814","nonce":4028899241},{"type":"v1","addr":"172.21.15.154:6815","nonce":4028899241}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6812","nonce":4028899241},{"type":"v1","addr":"172.21.15.154:6813","nonce":4028899241}]},"public_addr":"172.21.15.154:6809/4028899241","cluster_addr":"172.21.15.154:6811/4028899241","heartbeat_back_addr":"172.21.15.154:6815/4028899241","heartbeat_front_addr":"172.21.15.154:6813/4028899241","state":["exists","up"]},{"osd":5,"uuid":"d6ab225c-1b55-450a-89a9-abe5c3f8d6af","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":3562396827},{"type":"v1","addr":"172.21.15.154:6801","nonce":3562396827}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":3562396827},{"type":"v1","addr":"172.21.15.154:6803","nonce":3562396827}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6806","nonce":3562396827},{"type":"v1","addr":"172.21.15.154:6807","nonce":3562396827}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6804","nonce":3562396827},{"type":"v1","addr":"172.21.15.154:6805","nonce":3562396827}]},"public_addr":"172.21.15.154:6801/3562396827","cluster_addr":"172.21.15.154:6803/3562396827","heartbeat_back_addr":"172.21.15.154:6807/3562396827","heartbeat_front_addr":"172.21.15.154:6805/3562396827","state":["exists","up"]},{"osd":6,"uuid":"96f905ac-491c-4662-8e2b-5bb8e929ab9d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6816","nonce":2933728751},{"type":"v1","addr":"172.21.15.154:6817","nonce":2933728751}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6818","nonce":2933728751},{"type":"v1","addr":"172.21.15.154:6819","nonce":2933728751}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6822","nonce":2933728751},{"type":"v1","addr":"172.21.15.154:6823","nonce":2933728751}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6820","nonce":2933728751},{"type":"v1","addr":"172.21.15.154:6821","nonce":2933728751}]},"public_addr":"172.21.15.154:6817/2933728751","cluster_addr":"172.21.15.154:6819/2933728751","heartbeat_back_addr":"172.21.15.154:6823/2933728751","heartbeat_front_addr":"172.21.15.154:6821/2933728751","state":["exists","up"]},{"osd":7,"uuid":"07012d3b-3ab4-40df-a471-93caed22e2dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6824","nonce":1753500785},{"type":"v1","addr":"172.21.15.154:6825","nonce":1753500785}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6826","nonce":1753500785},{"type":"v1","addr":"172.21.15.154:6827","nonce":1753500785}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6830","nonce":1753500785},{"type":"v1","addr":"172.21.15.154:6831","nonce":1753500785}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6828","nonce":1753500785},{"type":"v1","addr":"172.21.15.154:6829","nonce":1753500785}]},"public_addr":"172.21.15.154:6825/1753500785","cluster_addr":"172.21.15.154:6827/1753500785","heartbeat_back_addr":"172.21.15.154:6831/1753500785","heartbeat_front_addr":"172.21.15.154:6829/1753500785","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-13T11:28:40.978603+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-13T11:28:41.200985+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-13T11:28:41.222815+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-13T11:28:41.202162+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-13T11:28:40.925911+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-13T11:28:41.087725+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-13T11:28:41.072208+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-13T11:28:40.875257+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.2c","mappings":[{"from":0,"to":7}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-13T11:29:45.709 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:45.701+0000 7f1c9638d640 1 -- 172.21.15.102:0/2102041371 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f1c7c0664a0 msgr2=0x7f1c7c068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:45.710 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:45.701+0000 7f1c9638d640 1 --2- 172.21.15.102:0/2102041371 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f1c7c0664a0 0x7f1c7c068960 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f1c800b2000 tx=0x7f1c80009040 comp rx=0 tx=0).stop 2023-11-13T11:29:45.710 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:45.701+0000 7f1c9638d640 1 -- 172.21.15.102:0/2102041371 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1c900cd960 msgr2=0x7f1c9015c3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:45.710 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:45.701+0000 7f1c9638d640 1 --2- 172.21.15.102:0/2102041371 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1c900cd960 0x7f1c9015c3e0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f1c8400c450 tx=0x7f1c8400c910 comp rx=0 tx=0).stop 2023-11-13T11:29:45.710 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:45.701+0000 7f1c9638d640 1 -- 172.21.15.102:0/2102041371 shutdown_connections 2023-11-13T11:29:45.711 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:45.701+0000 7f1c9638d640 1 --2- 172.21.15.102:0/2102041371 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1c90159420 0x7f1c9015a540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:45.711 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:45.701+0000 7f1c9638d640 1 --2- 172.21.15.102:0/2102041371 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f1c7c0664a0 0x7f1c7c068960 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:45.711 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:45.701+0000 7f1c9638d640 1 --2- 172.21.15.102:0/2102041371 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1c900cd960 0x7f1c9015c3e0 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:45.712 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:45.701+0000 7f1c9638d640 1 --2- 172.21.15.102:0/2102041371 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1c900cae80 0x7f1c90141480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:45.712 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:45.701+0000 7f1c9638d640 1 -- 172.21.15.102:0/2102041371 >> 172.21.15.102:0/2102041371 conn(0x7f1c900b0870 msgr2=0x7f1c900b2860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-13T11:29:45.715 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:45.701+0000 7f1c9638d640 1 -- 172.21.15.102:0/2102041371 shutdown_connections 2023-11-13T11:29:45.715 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:45.701+0000 7f1c9638d640 1 -- 172.21.15.102:0/2102041371 wait complete. 2023-11-13T11:29:45.729 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-11-13T11:29:45.870 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:45.861+0000 7fe1b9955640 1 Processor -- start 2023-11-13T11:29:45.870 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:45.861+0000 7fe1b9955640 1 -- start start 2023-11-13T11:29:45.872 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:45.865+0000 7fe1b9955640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe1b4160750 0x7fe1b40b3bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:45.872 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:45.865+0000 7fe1b9955640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7fe1b40d3570 0x7fe1b40cf6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:45.872 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:45.865+0000 7fe1b9955640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fe1b40cfbe0 0x7fe1b4160cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:45.873 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:45.865+0000 7fe1b9955640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe1b40d1ca0 con 0x7fe1b40d3570 2023-11-13T11:29:45.873 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:45.865+0000 7fe1b9955640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe1b40b2570 con 0x7fe1b40cfbe0 2023-11-13T11:29:45.873 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:45.865+0000 7fe1b9955640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe1b40d0040 con 0x7fe1b4160750 2023-11-13T11:29:45.873 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:45.865+0000 7fe1aa7fc640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7fe1b40d3570 0x7fe1b40cf6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:45.873 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:45.865+0000 7fe1aa7fc640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7fe1b40d3570 0x7fe1b40cf6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:45598/0 (socket says 172.21.15.102:45598) 2023-11-13T11:29:45.874 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:45.865+0000 7fe1aa7fc640 1 -- 172.21.15.102:0/3339064139 learned_addr learned my addr 172.21.15.102:0/3339064139 (peer_addr_for_me v2:172.21.15.102:0/0) 2023-11-13T11:29:45.874 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:45.865+0000 7fe1b37fe640 1 --2- 172.21.15.102:0/3339064139 >> v2:172.21.15.154:3300/0 conn(0x7fe1b40cfbe0 0x7fe1b4160cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:45.874 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:45.865+0000 7fe1b2ffd640 1 --2- 172.21.15.102:0/3339064139 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe1b4160750 0x7fe1b40b3bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:45.874 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:45.865+0000 7fe1aa7fc640 1 -- 172.21.15.102:0/3339064139 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe1b4160750 msgr2=0x7fe1b40b3bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-13T11:29:45.874 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:45.865+0000 7fe1aa7fc640 1 --2- 172.21.15.102:0/3339064139 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe1b4160750 0x7fe1b40b3bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:45.875 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:45.865+0000 7fe1aa7fc640 1 -- 172.21.15.102:0/3339064139 >> v2:172.21.15.154:3300/0 conn(0x7fe1b40cfbe0 msgr2=0x7fe1b4160cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-13T11:29:45.875 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:45.865+0000 7fe1aa7fc640 1 --2- 172.21.15.102:0/3339064139 >> v2:172.21.15.154:3300/0 conn(0x7fe1b40cfbe0 0x7fe1b4160cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:45.875 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:45.865+0000 7fe1aa7fc640 1 -- 172.21.15.102:0/3339064139 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1b40d3ae0 con 0x7fe1b40d3570 2023-11-13T11:29:45.875 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:45.865+0000 7fe1b2ffd640 1 --2- 172.21.15.102:0/3339064139 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe1b4160750 0x7fe1b40b3bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-13T11:29:45.876 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:45.869+0000 7fe1aa7fc640 1 --2- 172.21.15.102:0/3339064139 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe1b40d3570 0x7fe1b40cf6a0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7fe1b40d03e0 tx=0x7fe19c01c1b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2de2dce8da9fc8b8 server_cookie=0 in_seq=0 out_seq=0 2023-11-13T11:29:45.877 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:45.869+0000 7fe1b27fc640 1 -- 172.21.15.102:0/3339064139 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe19c0ab600 con 0x7fe1b40d3570 2023-11-13T11:29:45.877 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:45.869+0000 7fe1b27fc640 1 -- 172.21.15.102:0/3339064139 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe19c0a7050 con 0x7fe1b40d3570 2023-11-13T11:29:45.877 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:45.869+0000 7fe1b27fc640 1 -- 172.21.15.102:0/3339064139 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe19c0ab980 con 0x7fe1b40d3570 2023-11-13T11:29:45.877 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:45.869+0000 7fe1b9955640 1 -- 172.21.15.102:0/3339064139 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe1b40d3570 msgr2=0x7fe1b40cf6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:45.877 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:45.869+0000 7fe1b9955640 1 --2- 172.21.15.102:0/3339064139 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe1b40d3570 0x7fe1b40cf6a0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7fe1b40d03e0 tx=0x7fe19c01c1b0 comp rx=0 tx=0).stop 2023-11-13T11:29:45.878 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:45.869+0000 7fe1b9955640 1 -- 172.21.15.102:0/3339064139 shutdown_connections 2023-11-13T11:29:45.878 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:45.869+0000 7fe1b9955640 1 --2- 172.21.15.102:0/3339064139 >> v2:172.21.15.154:3300/0 conn(0x7fe1b40cfbe0 0x7fe1b4160cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:45.878 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:45.869+0000 7fe1b9955640 1 --2- 172.21.15.102:0/3339064139 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe1b40d3570 0x7fe1b40cf6a0 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:45.878 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:45.869+0000 7fe1b9955640 1 --2- 172.21.15.102:0/3339064139 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe1b4160750 0x7fe1b40b3bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:45.878 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:45.869+0000 7fe1b9955640 1 -- 172.21.15.102:0/3339064139 >> 172.21.15.102:0/3339064139 conn(0x7fe1b409c130 msgr2=0x7fe1b40d2e60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-13T11:29:45.879 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:45.869+0000 7fe1b9955640 1 -- 172.21.15.102:0/3339064139 shutdown_connections 2023-11-13T11:29:45.879 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:45.869+0000 7fe1b9955640 1 -- 172.21.15.102:0/3339064139 wait complete. 2023-11-13T11:29:45.881 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:45.869+0000 7fe1b9955640 1 Processor -- start 2023-11-13T11:29:45.881 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:45.869+0000 7fe1b9955640 1 -- start start 2023-11-13T11:29:45.881 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:45.869+0000 7fe1b9955640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe1b40cfbe0 0x7fe1b40c9360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:45.882 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:45.869+0000 7fe1b9955640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe1b40d3570 0x7fe1b406c5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:45.882 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:45.869+0000 7fe1b9955640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe1b4160750 0x7fe1b4152d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:45.882 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:45.869+0000 7fe1b9955640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1b4151c20 con 0x7fe1b40d3570 2023-11-13T11:29:45.882 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:45.869+0000 7fe1b9955640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1b4151f60 con 0x7fe1b40cfbe0 2023-11-13T11:29:45.882 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:45.869+0000 7fe1b9955640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe1b4152220 con 0x7fe1b4160750 2023-11-13T11:29:45.883 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:45.873+0000 7fe1aa7fc640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe1b40d3570 0x7fe1b406c5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:45.883 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:45.873+0000 7fe1aa7fc640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe1b40d3570 0x7fe1b406c5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:45612/0 (socket says 172.21.15.102:45612) 2023-11-13T11:29:45.883 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:45.873+0000 7fe1aa7fc640 1 -- 172.21.15.102:0/3246377557 learned_addr learned my addr 172.21.15.102:0/3246377557 (peer_addr_for_me v2:172.21.15.102:0/0) 2023-11-13T11:29:45.883 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:45.873+0000 7fe1b2ffd640 1 --2- 172.21.15.102:0/3246377557 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe1b40cfbe0 0x7fe1b40c9360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:45.883 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:45.873+0000 7fe1b37fe640 1 --2- 172.21.15.102:0/3246377557 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe1b4160750 0x7fe1b4152d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:45.883 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:45.873+0000 7fe1aa7fc640 1 -- 172.21.15.102:0/3246377557 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe1b4160750 msgr2=0x7fe1b4152d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:45.884 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:45.873+0000 7fe1aa7fc640 1 --2- 172.21.15.102:0/3246377557 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe1b4160750 0x7fe1b4152d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:45.884 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:45.873+0000 7fe1aa7fc640 1 -- 172.21.15.102:0/3246377557 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe1b40cfbe0 msgr2=0x7fe1b40c9360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:45.884 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:45.873+0000 7fe1aa7fc640 1 --2- 172.21.15.102:0/3246377557 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe1b40cfbe0 0x7fe1b40c9360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:45.884 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:45.873+0000 7fe1aa7fc640 1 -- 172.21.15.102:0/3246377557 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe19c0094d0 con 0x7fe1b40d3570 2023-11-13T11:29:45.884 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:45.873+0000 7fe1aa7fc640 1 --2- 172.21.15.102:0/3246377557 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe1b40d3570 0x7fe1b406c5d0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7fe19c0ae040 tx=0x7fe19c01a9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-13T11:29:45.885 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:45.873+0000 7fe1b0ff9640 1 -- 172.21.15.102:0/3246377557 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe19c0b6420 con 0x7fe1b40d3570 2023-11-13T11:29:45.885 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:45.873+0000 7fe1b0ff9640 1 -- 172.21.15.102:0/3246377557 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe19c0b6580 con 0x7fe1b40d3570 2023-11-13T11:29:45.885 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:45.873+0000 7fe1b9955640 1 -- 172.21.15.102:0/3246377557 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe1b4152500 con 0x7fe1b40d3570 2023-11-13T11:29:45.885 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:45.873+0000 7fe1b0ff9640 1 -- 172.21.15.102:0/3246377557 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe19c0b6910 con 0x7fe1b40d3570 2023-11-13T11:29:45.885 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:45.873+0000 7fe1b9955640 1 -- 172.21.15.102:0/3246377557 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe1b40cbd80 con 0x7fe1b40d3570 2023-11-13T11:29:45.886 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:45.873+0000 7fe1b9955640 1 -- 172.21.15.102:0/3246377557 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe1b4068520 con 0x7fe1b40d3570 2023-11-13T11:29:45.887 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:45.873+0000 7fe1b0ff9640 1 -- 172.21.15.102:0/3246377557 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fe19c0b2040 con 0x7fe1b40d3570 2023-11-13T11:29:45.887 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:45.877+0000 7fe1b0ff9640 1 --2- 172.21.15.102:0/3246377557 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7fe194066470 0x7fe194068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:45.887 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:45.877+0000 7fe1b0ff9640 1 -- 172.21.15.102:0/3246377557 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 5738+0+0 (secure 0 0 0) 0x7fe19c11e120 con 0x7fe1b40d3570 2023-11-13T11:29:45.887 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:45.877+0000 7fe1b2ffd640 1 --2- 172.21.15.102:0/3246377557 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7fe194066470 0x7fe194068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:45.887 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:45.877+0000 7fe1b2ffd640 1 --2- 172.21.15.102:0/3246377557 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7fe194066470 0x7fe194068930 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fe1a40045f0 tx=0x7fe1a4008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-13T11:29:45.888 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:45.877+0000 7fe1b0ff9640 1 -- 172.21.15.102:0/3246377557 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fe19c0eb740 con 0x7fe1b40d3570 2023-11-13T11:29:46.068 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:46.061+0000 7fe1b9955640 1 -- 172.21.15.102:0/3246377557 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7fe1b41529b0 con 0x7fe1b40d3570 2023-11-13T11:29:46.069 INFO:tasks.ceph.mon.a.smithi102.stderr:2023-11-13T11:29:46.061+0000 7fb06c1ec640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-11-13T11:29:46.071 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:46.065+0000 7fe1b0ff9640 1 -- 172.21.15.102:0/3246377557 <== mon.0 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v9) v1 ==== 161+0+0 (secure 0 0 0) 0x7fe19c0eed60 con 0x7fe1b40d3570 2023-11-13T11:29:46.072 INFO:teuthology.orchestra.run.smithi102.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-11-13T11:29:46.073 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:46.065+0000 7fe1b9955640 1 -- 172.21.15.102:0/3246377557 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7fe194066470 msgr2=0x7fe194068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:46.074 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:46.065+0000 7fe1b9955640 1 --2- 172.21.15.102:0/3246377557 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7fe194066470 0x7fe194068930 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fe1a40045f0 tx=0x7fe1a4008040 comp rx=0 tx=0).stop 2023-11-13T11:29:46.074 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:46.065+0000 7fe1b9955640 1 -- 172.21.15.102:0/3246377557 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe1b40d3570 msgr2=0x7fe1b406c5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:46.074 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:46.065+0000 7fe1b9955640 1 --2- 172.21.15.102:0/3246377557 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe1b40d3570 0x7fe1b406c5d0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7fe19c0ae040 tx=0x7fe19c01a9f0 comp rx=0 tx=0).stop 2023-11-13T11:29:46.075 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:46.065+0000 7fe1b9955640 1 -- 172.21.15.102:0/3246377557 shutdown_connections 2023-11-13T11:29:46.075 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:46.065+0000 7fe1b9955640 1 --2- 172.21.15.102:0/3246377557 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe1b4160750 0x7fe1b4152d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:46.075 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:46.065+0000 7fe1b9955640 1 --2- 172.21.15.102:0/3246377557 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7fe194066470 0x7fe194068930 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:46.075 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:46.065+0000 7fe1b9955640 1 --2- 172.21.15.102:0/3246377557 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe1b40d3570 0x7fe1b406c5d0 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:46.076 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:46.065+0000 7fe1b9955640 1 --2- 172.21.15.102:0/3246377557 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe1b40cfbe0 0x7fe1b40c9360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:46.076 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:46.065+0000 7fe1b9955640 1 -- 172.21.15.102:0/3246377557 >> 172.21.15.102:0/3246377557 conn(0x7fe1b409c130 msgr2=0x7fe1b41564e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-13T11:29:46.076 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:46.065+0000 7fe1b9955640 1 -- 172.21.15.102:0/3246377557 shutdown_connections 2023-11-13T11:29:46.076 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:46.065+0000 7fe1b9955640 1 -- 172.21.15.102:0/3246377557 wait complete. 2023-11-13T11:29:46.082 INFO:tasks.ceph.mds.d.smithi154.stderr: -2763> 2023-11-13T11:29:02.359+0000 7fec4274d640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-11-13T11:29:46.094 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-11-13T11:29:46.131 INFO:tasks.ceph.mds.d.smithi154.stdout:starting mds.d at 2023-11-13T11:29:46.234 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:46.225+0000 7f00c2bd1640 1 Processor -- start 2023-11-13T11:29:46.234 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:46.225+0000 7f00c2bd1640 1 -- start start 2023-11-13T11:29:46.236 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:46.229+0000 7f00c2bd1640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f00bc15d0b0 0x7f00bc0cebc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:46.236 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:46.229+0000 7f00c2bd1640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f00bc071620 0x7f00bc0cf100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:46.236 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:46.229+0000 7f00c2bd1640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f00bc06d130 con 0x7f00bc0b1920 2023-11-13T11:29:46.236 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:46.229+0000 7f00c2bd1640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f00bc070030 con 0x7f00bc15d0b0 2023-11-13T11:29:46.236 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:46.229+0000 7f00c2bd1640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00bc070310 con 0x7f00bc071620 2023-11-13T11:29:46.237 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:46.229+0000 7f00c096d640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f00bc15d0b0 0x7f00bc0cebc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:46.237 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:46.229+0000 7f00c096d640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f00bc15d0b0 0x7f00bc0cebc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:45618/0 (socket says 172.21.15.102:45618) 2023-11-13T11:29:46.237 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:46.229+0000 7f00c096d640 1 -- 172.21.15.102:0/2816878854 learned_addr learned my addr 172.21.15.102:0/2816878854 (peer_addr_for_me v2:172.21.15.102:0/0) 2023-11-13T11:29:46.237 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:46.229+0000 7f00c116e640 1 --2- 172.21.15.102:0/2816878854 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f00bc071620 0x7f00bc0cf100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:46.237 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:46.229+0000 7f00c096d640 1 -- 172.21.15.102:0/2816878854 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f00bc071620 msgr2=0x7f00bc0cf100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-13T11:29:46.238 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:46.229+0000 7f00c096d640 1 --2- 172.21.15.102:0/2816878854 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f00bc071620 0x7f00bc0cf100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:46.238 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:46.229+0000 7f00c096d640 1 -- 172.21.15.102:0/2816878854 >> v1:172.21.15.154:6789/0 conn(0x7f00bc0b1920 legacy=0x7f00bc0ac8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:46.238 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:46.229+0000 7f00c096d640 1 -- 172.21.15.102:0/2816878854 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00bc0705f0 con 0x7f00bc15d0b0 2023-11-13T11:29:46.239 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:46.229+0000 7f00c096d640 1 --2- 172.21.15.102:0/2816878854 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f00bc15d0b0 0x7f00bc0cebc0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f00b8009870 tx=0x7f00b801ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=25ac542312dee50f server_cookie=0 in_seq=0 out_seq=0 2023-11-13T11:29:46.240 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:46.233+0000 7f00b37fe640 1 -- 172.21.15.102:0/2816878854 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00b80a8a30 con 0x7f00bc15d0b0 2023-11-13T11:29:46.240 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:46.233+0000 7f00b37fe640 1 -- 172.21.15.102:0/2816878854 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f00b80a8b90 con 0x7f00bc15d0b0 2023-11-13T11:29:46.240 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:46.233+0000 7f00b37fe640 1 -- 172.21.15.102:0/2816878854 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00b80b0440 con 0x7f00bc15d0b0 2023-11-13T11:29:46.241 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:46.233+0000 7f00c2bd1640 1 -- 172.21.15.102:0/2816878854 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f00bc15d0b0 msgr2=0x7f00bc0cebc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:46.241 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:46.233+0000 7f00c2bd1640 1 --2- 172.21.15.102:0/2816878854 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f00bc15d0b0 0x7f00bc0cebc0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f00b8009870 tx=0x7f00b801ed30 comp rx=0 tx=0).stop 2023-11-13T11:29:46.241 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:46.233+0000 7f00c2bd1640 1 -- 172.21.15.102:0/2816878854 shutdown_connections 2023-11-13T11:29:46.241 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:46.233+0000 7f00c2bd1640 1 --2- 172.21.15.102:0/2816878854 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f00bc071620 0x7f00bc0cf100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:46.241 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:46.233+0000 7f00c2bd1640 1 --2- 172.21.15.102:0/2816878854 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f00bc15d0b0 0x7f00bc0cebc0 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:46.242 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:46.233+0000 7f00c2bd1640 1 -- 172.21.15.102:0/2816878854 >> 172.21.15.102:0/2816878854 conn(0x7f00bc06a410 msgr2=0x7f00bc06a820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-13T11:29:46.242 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:46.233+0000 7f00c2bd1640 1 -- 172.21.15.102:0/2816878854 shutdown_connections 2023-11-13T11:29:46.242 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:46.233+0000 7f00c2bd1640 1 -- 172.21.15.102:0/2816878854 wait complete. 2023-11-13T11:29:46.244 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:46.233+0000 7f00c2bd1640 1 Processor -- start 2023-11-13T11:29:46.244 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:46.233+0000 7f00c2bd1640 1 -- start start 2023-11-13T11:29:46.245 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:46.233+0000 7f00c2bd1640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f00bc071620 0x7f00bc14b500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:46.245 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:46.233+0000 7f00c2bd1640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f00bc0b1920 0x7f00bc0cb550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:46.245 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:46.233+0000 7f00c2bd1640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f00bc15d0b0 0x7f00bc157880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:46.245 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:46.233+0000 7f00c2bd1640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00bc0cc340 con 0x7f00bc0b1920 2023-11-13T11:29:46.245 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:46.233+0000 7f00c2bd1640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00bc156e70 con 0x7f00bc071620 2023-11-13T11:29:46.246 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:46.233+0000 7f00c2bd1640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00bc14ba40 con 0x7f00bc15d0b0 2023-11-13T11:29:46.246 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:46.233+0000 7f00b3fff640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f00bc0b1920 0x7f00bc0cb550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:46.246 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:46.233+0000 7f00c096d640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f00bc071620 0x7f00bc14b500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:46.246 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:46.233+0000 7f00b3fff640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f00bc0b1920 0x7f00bc0cb550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:45622/0 (socket says 172.21.15.102:45622) 2023-11-13T11:29:46.246 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:46.233+0000 7f00b3fff640 1 -- 172.21.15.102:0/3708631527 learned_addr learned my addr 172.21.15.102:0/3708631527 (peer_addr_for_me v2:172.21.15.102:0/0) 2023-11-13T11:29:46.247 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:46.233+0000 7f00c116e640 1 --2- 172.21.15.102:0/3708631527 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f00bc15d0b0 0x7f00bc157880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:46.247 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:46.237+0000 7f00b3fff640 1 -- 172.21.15.102:0/3708631527 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f00bc15d0b0 msgr2=0x7f00bc157880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:46.247 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:46.237+0000 7f00b3fff640 1 --2- 172.21.15.102:0/3708631527 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f00bc15d0b0 0x7f00bc157880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:46.247 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:46.237+0000 7f00b3fff640 1 -- 172.21.15.102:0/3708631527 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f00bc071620 msgr2=0x7f00bc14b500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:46.248 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:46.237+0000 7f00b3fff640 1 --2- 172.21.15.102:0/3708631527 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f00bc071620 0x7f00bc14b500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:46.248 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:46.237+0000 7f00b3fff640 1 -- 172.21.15.102:0/3708631527 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00b80094d0 con 0x7f00bc0b1920 2023-11-13T11:29:46.248 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:46.237+0000 7f00c096d640 1 --2- 172.21.15.102:0/3708631527 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f00bc071620 0x7f00bc14b500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-13T11:29:46.248 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:46.237+0000 7f00b3fff640 1 --2- 172.21.15.102:0/3708631527 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f00bc0b1920 0x7f00bc0cb550 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f00ac00c4d0 tx=0x7f00ac00c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-13T11:29:46.248 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:46.237+0000 7f00b17fa640 1 -- 172.21.15.102:0/3708631527 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00ac0052d0 con 0x7f00bc0b1920 2023-11-13T11:29:46.249 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:46.237+0000 7f00b17fa640 1 -- 172.21.15.102:0/3708631527 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f00ac005430 con 0x7f00bc0b1920 2023-11-13T11:29:46.249 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:46.237+0000 7f00b17fa640 1 -- 172.21.15.102:0/3708631527 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00ac012830 con 0x7f00bc0b1920 2023-11-13T11:29:46.249 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:46.237+0000 7f00c2bd1640 1 -- 172.21.15.102:0/3708631527 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f00bc0cbd80 con 0x7f00bc0b1920 2023-11-13T11:29:46.249 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:46.237+0000 7f00c2bd1640 1 -- 172.21.15.102:0/3708631527 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f00bc157080 con 0x7f00bc0b1920 2023-11-13T11:29:46.250 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:46.237+0000 7f00c2bd1640 1 -- 172.21.15.102:0/3708631527 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f00bc067640 con 0x7f00bc0b1920 2023-11-13T11:29:46.251 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:46.237+0000 7f00b17fa640 1 -- 172.21.15.102:0/3708631527 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f00ac012990 con 0x7f00bc0b1920 2023-11-13T11:29:46.251 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:46.237+0000 7f00b17fa640 1 --2- 172.21.15.102:0/3708631527 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f00a8066470 0x7f00a8068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:46.251 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:46.237+0000 7f00b17fa640 1 -- 172.21.15.102:0/3708631527 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 5824+0+0 (secure 0 0 0) 0x7f00ac083950 con 0x7f00bc0b1920 2023-11-13T11:29:46.251 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:46.237+0000 7f00c096d640 1 --2- 172.21.15.102:0/3708631527 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f00a8066470 0x7f00a8068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:46.252 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:46.241+0000 7f00c096d640 1 --2- 172.21.15.102:0/3708631527 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f00a8066470 0x7f00a8068930 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f00b80b2000 tx=0x7f00b8009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-13T11:29:46.252 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:46.241+0000 7f00b17fa640 1 -- 172.21.15.102:0/3708631527 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f00ac050d90 con 0x7f00bc0b1920 2023-11-13T11:29:46.432 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:46.425+0000 7f00c2bd1640 1 -- 172.21.15.102:0/3708631527 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f00bc068520 con 0x7f00bc0b1920 2023-11-13T11:29:47.074 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:47.065+0000 7f00b17fa640 1 -- 172.21.15.102:0/3708631527 <== mon.0 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v10) v1 ==== 104+0+0 (secure 0 0 0) 0x7f00ac0543b0 con 0x7f00bc0b1920 2023-11-13T11:29:47.076 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:47.069+0000 7f00c2bd1640 1 -- 172.21.15.102:0/3708631527 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f00a8066470 msgr2=0x7f00a8068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:47.077 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:47.069+0000 7f00c2bd1640 1 --2- 172.21.15.102:0/3708631527 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f00a8066470 0x7f00a8068930 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f00b80b2000 tx=0x7f00b8009040 comp rx=0 tx=0).stop 2023-11-13T11:29:47.077 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:47.069+0000 7f00c2bd1640 1 -- 172.21.15.102:0/3708631527 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f00bc0b1920 msgr2=0x7f00bc0cb550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:47.077 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:47.069+0000 7f00c2bd1640 1 --2- 172.21.15.102:0/3708631527 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f00bc0b1920 0x7f00bc0cb550 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f00ac00c4d0 tx=0x7f00ac00c990 comp rx=0 tx=0).stop 2023-11-13T11:29:47.077 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:47.069+0000 7f00c2bd1640 1 -- 172.21.15.102:0/3708631527 shutdown_connections 2023-11-13T11:29:47.077 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:47.069+0000 7f00c2bd1640 1 --2- 172.21.15.102:0/3708631527 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f00bc15d0b0 0x7f00bc157880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:47.078 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:47.069+0000 7f00c2bd1640 1 --2- 172.21.15.102:0/3708631527 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f00a8066470 0x7f00a8068930 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:47.078 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:47.069+0000 7f00c2bd1640 1 --2- 172.21.15.102:0/3708631527 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f00bc0b1920 0x7f00bc0cb550 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:47.078 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:47.069+0000 7f00c2bd1640 1 --2- 172.21.15.102:0/3708631527 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f00bc071620 0x7f00bc14b500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:47.078 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:47.069+0000 7f00c2bd1640 1 -- 172.21.15.102:0/3708631527 >> 172.21.15.102:0/3708631527 conn(0x7f00bc06a410 msgr2=0x7f00bc0ceb90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-13T11:29:47.078 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:47.069+0000 7f00c2bd1640 1 -- 172.21.15.102:0/3708631527 shutdown_connections 2023-11-13T11:29:47.079 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:47.069+0000 7f00c2bd1640 1 -- 172.21.15.102:0/3708631527 wait complete. 2023-11-13T11:29:47.097 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-11-13T11:29:47.242 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:47.233+0000 7fb1d06e3640 1 Processor -- start 2023-11-13T11:29:47.242 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:47.233+0000 7fb1d06e3640 1 -- start start 2023-11-13T11:29:47.243 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:47.237+0000 7fb1d06e3640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb1c8144310 0x7fb1c806bc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:47.244 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:47.237+0000 7fb1d06e3640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7fb1c81446f0 0x7fb1c80b36e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:47.244 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:47.237+0000 7fb1d06e3640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb1c80cd8e0 con 0x7fb1c80b3c20 2023-11-13T11:29:47.244 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:47.237+0000 7fb1d06e3640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb1c815f710 con 0x7fb1c81446f0 2023-11-13T11:29:47.244 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:47.237+0000 7fb1d06e3640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb1c80b1a30 con 0x7fb1c8144310 2023-11-13T11:29:47.244 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:47.237+0000 7fb1cdc7e640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7fb1c81446f0 0x7fb1c80b36e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:47.245 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:47.237+0000 7fb1cdc7e640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7fb1c81446f0 0x7fb1c80b36e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:45624/0 (socket says 172.21.15.102:45624) 2023-11-13T11:29:47.245 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:47.237+0000 7fb1cdc7e640 1 -- 172.21.15.102:0/3093655873 learned_addr learned my addr 172.21.15.102:0/3093655873 (peer_addr_for_me v2:172.21.15.102:0/0) 2023-11-13T11:29:47.245 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:47.237+0000 7fb1cdc7e640 1 -- 172.21.15.102:0/3093655873 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb1c8144310 msgr2=0x7fb1c806bc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-13T11:29:47.246 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:47.237+0000 7fb1cdc7e640 1 --2- 172.21.15.102:0/3093655873 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb1c8144310 0x7fb1c806bc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:47.246 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:47.237+0000 7fb1cdc7e640 1 -- 172.21.15.102:0/3093655873 >> v1:172.21.15.154:6789/0 conn(0x7fb1c80b3c20 legacy=0x7fb1c815e810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-13T11:29:47.246 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:47.237+0000 7fb1cdc7e640 1 -- 172.21.15.102:0/3093655873 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1c80cdb30 con 0x7fb1c81446f0 2023-11-13T11:29:47.247 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:47.237+0000 7fb1cdc7e640 1 --2- 172.21.15.102:0/3093655873 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb1c81446f0 0x7fb1c80b36e0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7fb1b8009870 tx=0x7fb1b801c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=89d9ac9ebc435a42 server_cookie=0 in_seq=0 out_seq=0 2023-11-13T11:29:47.247 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:47.241+0000 7fb1cd47d640 1 -- 172.21.15.102:0/3093655873 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1b80aa5f0 con 0x7fb1c81446f0 2023-11-13T11:29:47.247 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:47.241+0000 7fb1cd47d640 1 -- 172.21.15.102:0/3093655873 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb1b80aa750 con 0x7fb1c81446f0 2023-11-13T11:29:47.247 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:47.241+0000 7fb1cd47d640 1 -- 172.21.15.102:0/3093655873 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1b80aaae0 con 0x7fb1c81446f0 2023-11-13T11:29:47.252 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:47.241+0000 7fb1d06e3640 1 -- 172.21.15.102:0/3093655873 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb1c81446f0 msgr2=0x7fb1c80b36e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:47.252 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:47.241+0000 7fb1d06e3640 1 --2- 172.21.15.102:0/3093655873 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb1c81446f0 0x7fb1c80b36e0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7fb1b8009870 tx=0x7fb1b801c4d0 comp rx=0 tx=0).stop 2023-11-13T11:29:47.253 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:47.241+0000 7fb1d06e3640 1 -- 172.21.15.102:0/3093655873 shutdown_connections 2023-11-13T11:29:47.253 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:47.241+0000 7fb1d06e3640 1 --2- 172.21.15.102:0/3093655873 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb1c81446f0 0x7fb1c80b36e0 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:47.253 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:47.241+0000 7fb1d06e3640 1 --2- 172.21.15.102:0/3093655873 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb1c8144310 0x7fb1c806bc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:47.254 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:47.241+0000 7fb1d06e3640 1 -- 172.21.15.102:0/3093655873 >> 172.21.15.102:0/3093655873 conn(0x7fb1c80b0690 msgr2=0x7fb1c80b0aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-13T11:29:47.254 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:47.241+0000 7fb1d06e3640 1 -- 172.21.15.102:0/3093655873 shutdown_connections 2023-11-13T11:29:47.254 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:47.241+0000 7fb1d06e3640 1 -- 172.21.15.102:0/3093655873 wait complete. 2023-11-13T11:29:47.256 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:47.241+0000 7fb1d06e3640 1 Processor -- start 2023-11-13T11:29:47.256 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:47.241+0000 7fb1d06e3640 1 -- start start 2023-11-13T11:29:47.257 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:47.241+0000 7fb1d06e3640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb1c80b3c20 0x7fb1c81346c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:47.257 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:47.241+0000 7fb1d06e3640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb1c8144310 0x7fb1c8135830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:47.257 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:47.241+0000 7fb1d06e3640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb1c81446f0 0x7fb1c8159840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:47.257 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:47.241+0000 7fb1d06e3640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1c80706e0 con 0x7fb1c80b3c20 2023-11-13T11:29:47.257 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:47.241+0000 7fb1d06e3640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1c80708f0 con 0x7fb1c81446f0 2023-11-13T11:29:47.258 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:47.241+0000 7fb1d06e3640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb1c8070bd0 con 0x7fb1c8144310 2023-11-13T11:29:47.258 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:47.241+0000 7fb1ce47f640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb1c80b3c20 0x7fb1c81346c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:47.259 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:47.245+0000 7fb1ce47f640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb1c80b3c20 0x7fb1c81346c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:45640/0 (socket says 172.21.15.102:45640) 2023-11-13T11:29:47.259 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:47.245+0000 7fb1ce47f640 1 -- 172.21.15.102:0/1503248729 learned_addr learned my addr 172.21.15.102:0/1503248729 (peer_addr_for_me v2:172.21.15.102:0/0) 2023-11-13T11:29:47.259 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:47.245+0000 7fb1cec80640 1 --2- 172.21.15.102:0/1503248729 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb1c81446f0 0x7fb1c8159840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:47.259 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:47.245+0000 7fb1cdc7e640 1 --2- 172.21.15.102:0/1503248729 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb1c8144310 0x7fb1c8135830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:47.259 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:47.245+0000 7fb1ce47f640 1 -- 172.21.15.102:0/1503248729 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb1c8144310 msgr2=0x7fb1c8135830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:47.260 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:47.245+0000 7fb1ce47f640 1 --2- 172.21.15.102:0/1503248729 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb1c8144310 0x7fb1c8135830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:47.260 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:47.245+0000 7fb1ce47f640 1 -- 172.21.15.102:0/1503248729 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb1c81446f0 msgr2=0x7fb1c8159840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:47.260 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:47.245+0000 7fb1ce47f640 1 --2- 172.21.15.102:0/1503248729 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb1c81446f0 0x7fb1c8159840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:47.260 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:47.245+0000 7fb1ce47f640 1 -- 172.21.15.102:0/1503248729 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1b80094d0 con 0x7fb1c80b3c20 2023-11-13T11:29:47.261 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:47.245+0000 7fb1cdc7e640 1 --2- 172.21.15.102:0/1503248729 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb1c8144310 0x7fb1c8135830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-13T11:29:47.261 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:47.245+0000 7fb1ce47f640 1 --2- 172.21.15.102:0/1503248729 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb1c80b3c20 0x7fb1c81346c0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7fb1c400b550 tx=0x7fb1c400ba10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-13T11:29:47.261 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:47.245+0000 7fb1beffd640 1 -- 172.21.15.102:0/1503248729 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1c4010870 con 0x7fb1c80b3c20 2023-11-13T11:29:47.261 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:47.245+0000 7fb1beffd640 1 -- 172.21.15.102:0/1503248729 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb1c40109f0 con 0x7fb1c80b3c20 2023-11-13T11:29:47.262 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:47.245+0000 7fb1beffd640 1 -- 172.21.15.102:0/1503248729 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1c4010da0 con 0x7fb1c80b3c20 2023-11-13T11:29:47.262 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:47.245+0000 7fb1d06e3640 1 -- 172.21.15.102:0/1503248729 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb1c8070eb0 con 0x7fb1c80b3c20 2023-11-13T11:29:47.262 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:47.245+0000 7fb1d06e3640 1 -- 172.21.15.102:0/1503248729 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb1c8071470 con 0x7fb1c80b3c20 2023-11-13T11:29:47.263 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:47.245+0000 7fb1d06e3640 1 -- 172.21.15.102:0/1503248729 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb1c8067b50 con 0x7fb1c80b3c20 2023-11-13T11:29:47.263 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:47.245+0000 7fb1beffd640 1 -- 172.21.15.102:0/1503248729 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fb1c400f3c0 con 0x7fb1c80b3c20 2023-11-13T11:29:47.264 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:47.245+0000 7fb1beffd640 1 --2- 172.21.15.102:0/1503248729 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7fb1ac0664a0 0x7fb1ac068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:47.264 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:47.245+0000 7fb1beffd640 1 -- 172.21.15.102:0/1503248729 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 5824+0+0 (secure 0 0 0) 0x7fb1c4083f20 con 0x7fb1c80b3c20 2023-11-13T11:29:47.264 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:47.245+0000 7fb1cdc7e640 1 --2- 172.21.15.102:0/1503248729 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7fb1ac0664a0 0x7fb1ac068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:47.264 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:47.249+0000 7fb1cdc7e640 1 --2- 172.21.15.102:0/1503248729 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7fb1ac0664a0 0x7fb1ac068960 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fb1b80ae000 tx=0x7fb1b80a7000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-13T11:29:47.264 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:47.249+0000 7fb1beffd640 1 -- 172.21.15.102:0/1503248729 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fb1c4051360 con 0x7fb1c80b3c20 2023-11-13T11:29:47.410 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:47.401+0000 7fb1d06e3640 1 -- 172.21.15.102:0/1503248729 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fb1c8071660 con 0x7fb1c80b3c20 2023-11-13T11:29:48.076 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:48.069+0000 7fb1beffd640 1 -- 172.21.15.102:0/1503248729 <== mon.0 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v26) v1 ==== 181+0+0 (secure 0 0 0) 0x7fb1c4054980 con 0x7fb1c80b3c20 2023-11-13T11:29:48.076 INFO:teuthology.orchestra.run.smithi102.stderr:pool 'cephfs_metadata' removed 2023-11-13T11:29:48.078 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:48.069+0000 7fb1d06e3640 1 -- 172.21.15.102:0/1503248729 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7fb1ac0664a0 msgr2=0x7fb1ac068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:48.079 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:48.069+0000 7fb1d06e3640 1 --2- 172.21.15.102:0/1503248729 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7fb1ac0664a0 0x7fb1ac068960 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fb1b80ae000 tx=0x7fb1b80a7000 comp rx=0 tx=0).stop 2023-11-13T11:29:48.079 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:48.069+0000 7fb1d06e3640 1 -- 172.21.15.102:0/1503248729 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb1c80b3c20 msgr2=0x7fb1c81346c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:48.079 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:48.069+0000 7fb1d06e3640 1 --2- 172.21.15.102:0/1503248729 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb1c80b3c20 0x7fb1c81346c0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7fb1c400b550 tx=0x7fb1c400ba10 comp rx=0 tx=0).stop 2023-11-13T11:29:48.079 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:48.069+0000 7fb1d06e3640 1 -- 172.21.15.102:0/1503248729 shutdown_connections 2023-11-13T11:29:48.080 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:48.069+0000 7fb1d06e3640 1 --2- 172.21.15.102:0/1503248729 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb1c81446f0 0x7fb1c8159840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:48.080 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:48.069+0000 7fb1d06e3640 1 --2- 172.21.15.102:0/1503248729 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb1c8144310 0x7fb1c8135830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:48.080 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:48.069+0000 7fb1d06e3640 1 --2- 172.21.15.102:0/1503248729 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7fb1ac0664a0 0x7fb1ac068960 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:48.080 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:48.069+0000 7fb1d06e3640 1 --2- 172.21.15.102:0/1503248729 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb1c80b3c20 0x7fb1c81346c0 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:48.080 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:48.069+0000 7fb1d06e3640 1 -- 172.21.15.102:0/1503248729 >> 172.21.15.102:0/1503248729 conn(0x7fb1c80b0690 msgr2=0x7fb1c806d040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-13T11:29:48.081 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:48.069+0000 7fb1d06e3640 1 -- 172.21.15.102:0/1503248729 shutdown_connections 2023-11-13T11:29:48.081 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:48.069+0000 7fb1d06e3640 1 -- 172.21.15.102:0/1503248729 wait complete. 2023-11-13T11:29:48.105 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-11-13T11:29:48.248 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:48.241+0000 7f6eef98d640 1 Processor -- start 2023-11-13T11:29:48.248 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:48.241+0000 7f6eef98d640 1 -- start start 2023-11-13T11:29:48.250 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:48.241+0000 7f6eef98d640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f6ee8161e10 0x7f6ee81621f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:48.250 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:48.241+0000 7f6eef98d640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f6ee8164e00 0x7f6ee80b1990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:48.250 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:48.241+0000 7f6eef98d640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6ee806fd60 con 0x7f6ee80b1ed0 2023-11-13T11:29:48.251 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:48.241+0000 7f6eef98d640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6ee80b3dc0 con 0x7f6ee8164e00 2023-11-13T11:29:48.251 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:48.241+0000 7f6eef98d640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6ee81446a0 con 0x7f6ee8161e10 2023-11-13T11:29:48.251 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:48.241+0000 7f6eecf28640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f6ee8164e00 0x7f6ee80b1990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:48.251 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:48.241+0000 7f6eecf28640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f6ee8164e00 0x7f6ee80b1990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:46292/0 (socket says 172.21.15.102:46292) 2023-11-13T11:29:48.252 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:48.241+0000 7f6eecf28640 1 -- 172.21.15.102:0/2258031083 learned_addr learned my addr 172.21.15.102:0/2258031083 (peer_addr_for_me v2:172.21.15.102:0/0) 2023-11-13T11:29:48.252 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:48.241+0000 7f6eed729640 1 --2- 172.21.15.102:0/2258031083 >> v2:172.21.15.154:3300/0 conn(0x7f6ee8161e10 0x7f6ee81621f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:48.252 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:48.241+0000 7f6eecf28640 1 -- 172.21.15.102:0/2258031083 >> v2:172.21.15.154:3300/0 conn(0x7f6ee8161e10 msgr2=0x7f6ee81621f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-13T11:29:48.252 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:48.241+0000 7f6eecf28640 1 --2- 172.21.15.102:0/2258031083 >> v2:172.21.15.154:3300/0 conn(0x7f6ee8161e10 0x7f6ee81621f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:48.252 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:48.241+0000 7f6eecf28640 1 -- 172.21.15.102:0/2258031083 >> v1:172.21.15.154:6789/0 conn(0x7f6ee80b1ed0 legacy=0x7f6ee80cd3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:48.252 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:48.241+0000 7f6eecf28640 1 -- 172.21.15.102:0/2258031083 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ee8162730 con 0x7f6ee8164e00 2023-11-13T11:29:48.254 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:48.245+0000 7f6eecf28640 1 --2- 172.21.15.102:0/2258031083 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6ee8164e00 0x7f6ee80b1990 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f6ee806f560 tx=0x7f6ed801c500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1f7932691dd4f0ef server_cookie=0 in_seq=0 out_seq=0 2023-11-13T11:29:48.254 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:48.245+0000 7f6edffff640 1 -- 172.21.15.102:0/2258031083 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ed80ab5f0 con 0x7f6ee8164e00 2023-11-13T11:29:48.254 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:48.245+0000 7f6edffff640 1 -- 172.21.15.102:0/2258031083 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ed80ab750 con 0x7f6ee8164e00 2023-11-13T11:29:48.255 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:48.245+0000 7f6edffff640 1 -- 172.21.15.102:0/2258031083 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ed80abae0 con 0x7f6ee8164e00 2023-11-13T11:29:48.255 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:48.245+0000 7f6eef98d640 1 -- 172.21.15.102:0/2258031083 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6ee8164e00 msgr2=0x7f6ee80b1990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:48.255 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:48.245+0000 7f6eef98d640 1 --2- 172.21.15.102:0/2258031083 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6ee8164e00 0x7f6ee80b1990 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f6ee806f560 tx=0x7f6ed801c500 comp rx=0 tx=0).stop 2023-11-13T11:29:48.255 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:48.245+0000 7f6eef98d640 1 -- 172.21.15.102:0/2258031083 shutdown_connections 2023-11-13T11:29:48.255 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:48.245+0000 7f6eef98d640 1 --2- 172.21.15.102:0/2258031083 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6ee8164e00 0x7f6ee80b1990 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:48.256 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:48.245+0000 7f6eef98d640 1 --2- 172.21.15.102:0/2258031083 >> v2:172.21.15.154:3300/0 conn(0x7f6ee8161e10 0x7f6ee81621f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:48.256 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:48.245+0000 7f6eef98d640 1 -- 172.21.15.102:0/2258031083 >> 172.21.15.102:0/2258031083 conn(0x7f6ee80b0690 msgr2=0x7f6ee80b0aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-13T11:29:48.256 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:48.245+0000 7f6eef98d640 1 -- 172.21.15.102:0/2258031083 shutdown_connections 2023-11-13T11:29:48.256 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:48.245+0000 7f6eef98d640 1 -- 172.21.15.102:0/2258031083 wait complete. 2023-11-13T11:29:48.258 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:48.249+0000 7f6eef98d640 1 Processor -- start 2023-11-13T11:29:48.259 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:48.249+0000 7f6eef98d640 1 -- start start 2023-11-13T11:29:48.259 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:48.249+0000 7f6eef98d640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6ee80b1ed0 0x7f6ee81324e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:48.259 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:48.249+0000 7f6eef98d640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6ee8161e10 0x7f6ee81581f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:48.260 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:48.249+0000 7f6eef98d640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6ee8164e00 0x7f6ee813dd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:48.260 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:48.249+0000 7f6eef98d640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ee8158730 con 0x7f6ee8161e10 2023-11-13T11:29:48.260 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:48.249+0000 7f6eef98d640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ee8131440 con 0x7f6ee8164e00 2023-11-13T11:29:48.260 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:48.249+0000 7f6eef98d640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ee8131720 con 0x7f6ee80b1ed0 2023-11-13T11:29:48.261 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:48.249+0000 7f6eecf28640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6ee8161e10 0x7f6ee81581f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:48.261 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:48.249+0000 7f6eecf28640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6ee8161e10 0x7f6ee81581f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:46308/0 (socket says 172.21.15.102:46308) 2023-11-13T11:29:48.261 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:48.249+0000 7f6eecf28640 1 -- 172.21.15.102:0/3618416052 learned_addr learned my addr 172.21.15.102:0/3618416052 (peer_addr_for_me v2:172.21.15.102:0/0) 2023-11-13T11:29:48.261 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:48.249+0000 7f6eedf2a640 1 --2- 172.21.15.102:0/3618416052 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6ee8164e00 0x7f6ee813dd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:48.262 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:48.249+0000 7f6eed729640 1 --2- 172.21.15.102:0/3618416052 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6ee80b1ed0 0x7f6ee81324e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:48.262 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:48.249+0000 7f6eecf28640 1 -- 172.21.15.102:0/3618416052 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6ee80b1ed0 msgr2=0x7f6ee81324e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:48.262 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:48.249+0000 7f6eecf28640 1 --2- 172.21.15.102:0/3618416052 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6ee80b1ed0 0x7f6ee81324e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:48.262 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:48.249+0000 7f6eecf28640 1 -- 172.21.15.102:0/3618416052 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6ee8164e00 msgr2=0x7f6ee813dd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:48.263 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:48.249+0000 7f6eecf28640 1 --2- 172.21.15.102:0/3618416052 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6ee8164e00 0x7f6ee813dd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:48.263 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:48.249+0000 7f6eecf28640 1 -- 172.21.15.102:0/3618416052 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ed80094d0 con 0x7f6ee8161e10 2023-11-13T11:29:48.263 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:48.249+0000 7f6eecf28640 1 --2- 172.21.15.102:0/3618416052 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6ee8161e10 0x7f6ee81581f0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f6ed80ad040 tx=0x7f6ed80192a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-13T11:29:48.263 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:48.249+0000 7f6eddffb640 1 -- 172.21.15.102:0/3618416052 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ed80b5810 con 0x7f6ee8161e10 2023-11-13T11:29:48.263 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:48.249+0000 7f6eddffb640 1 -- 172.21.15.102:0/3618416052 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ed80b5970 con 0x7f6ee8161e10 2023-11-13T11:29:48.264 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:48.249+0000 7f6eddffb640 1 -- 172.21.15.102:0/3618416052 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ed80b5d20 con 0x7f6ee8161e10 2023-11-13T11:29:48.264 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:48.249+0000 7f6eef98d640 1 -- 172.21.15.102:0/3618416052 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6ee8131a00 con 0x7f6ee8161e10 2023-11-13T11:29:48.264 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:48.249+0000 7f6eef98d640 1 -- 172.21.15.102:0/3618416052 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6ee8131fc0 con 0x7f6ee8161e10 2023-11-13T11:29:48.265 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:48.253+0000 7f6eef98d640 1 -- 172.21.15.102:0/3618416052 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6ee8067b50 con 0x7f6ee8161e10 2023-11-13T11:29:48.266 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:48.253+0000 7f6eddffb640 1 -- 172.21.15.102:0/3618416052 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f6ed80bf410 con 0x7f6ee8161e10 2023-11-13T11:29:48.266 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:48.253+0000 7f6eddffb640 1 --2- 172.21.15.102:0/3618416052 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f6ecc066470 0x7f6ecc068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:48.266 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:48.253+0000 7f6eddffb640 1 -- 172.21.15.102:0/3618416052 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 5386+0+0 (secure 0 0 0) 0x7f6ed80a8050 con 0x7f6ee8161e10 2023-11-13T11:29:48.267 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:48.253+0000 7f6eed729640 1 --2- 172.21.15.102:0/3618416052 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f6ecc066470 0x7f6ecc068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:48.267 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:48.253+0000 7f6eed729640 1 --2- 172.21.15.102:0/3618416052 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f6ecc066470 0x7f6ecc068930 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f6ee400b9d0 tx=0x7f6ee4008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-13T11:29:48.267 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:48.257+0000 7f6eddffb640 1 -- 172.21.15.102:0/3618416052 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f6ed80ebaa0 con 0x7f6ee8161e10 2023-11-13T11:29:48.416 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:48.409+0000 7f6eef98d640 1 -- 172.21.15.102:0/3618416052 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f6ee8068590 con 0x7f6ee8161e10 2023-11-13T11:29:49.078 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:49.069+0000 7f6eddffb640 1 -- 172.21.15.102:0/3618416052 <== mon.0 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v27) v1 ==== 169+0+0 (secure 0 0 0) 0x7f6ed80ab5b0 con 0x7f6ee8161e10 2023-11-13T11:29:49.079 INFO:teuthology.orchestra.run.smithi102.stderr:pool 'cephfs_data' removed 2023-11-13T11:29:49.081 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:49.073+0000 7f6eef98d640 1 -- 172.21.15.102:0/3618416052 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f6ecc066470 msgr2=0x7f6ecc068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:49.081 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:49.073+0000 7f6eef98d640 1 --2- 172.21.15.102:0/3618416052 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f6ecc066470 0x7f6ecc068930 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f6ee400b9d0 tx=0x7f6ee4008040 comp rx=0 tx=0).stop 2023-11-13T11:29:49.081 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:49.073+0000 7f6eef98d640 1 -- 172.21.15.102:0/3618416052 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6ee8161e10 msgr2=0x7f6ee81581f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:49.082 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:49.073+0000 7f6eef98d640 1 --2- 172.21.15.102:0/3618416052 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6ee8161e10 0x7f6ee81581f0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f6ed80ad040 tx=0x7f6ed80192a0 comp rx=0 tx=0).stop 2023-11-13T11:29:49.082 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:49.073+0000 7f6eef98d640 1 -- 172.21.15.102:0/3618416052 shutdown_connections 2023-11-13T11:29:49.083 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:49.073+0000 7f6eef98d640 1 --2- 172.21.15.102:0/3618416052 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6ee8164e00 0x7f6ee813dd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:49.083 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:49.073+0000 7f6eef98d640 1 --2- 172.21.15.102:0/3618416052 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f6ecc066470 0x7f6ecc068930 secure :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f6ee400b9d0 tx=0x7f6ee4008040 comp rx=0 tx=0).stop 2023-11-13T11:29:49.083 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:49.073+0000 7f6eef98d640 1 --2- 172.21.15.102:0/3618416052 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6ee8161e10 0x7f6ee81581f0 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:49.083 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:49.073+0000 7f6eef98d640 1 --2- 172.21.15.102:0/3618416052 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6ee80b1ed0 0x7f6ee81324e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:49.084 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:49.073+0000 7f6eef98d640 1 -- 172.21.15.102:0/3618416052 >> 172.21.15.102:0/3618416052 conn(0x7f6ee80b0690 msgr2=0x7f6ee813ca90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-13T11:29:49.084 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:49.073+0000 7f6eef98d640 1 -- 172.21.15.102:0/3618416052 shutdown_connections 2023-11-13T11:29:49.084 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:49.073+0000 7f6eef98d640 1 -- 172.21.15.102:0/3618416052 wait complete. 2023-11-13T11:29:49.108 INFO:tasks.ceph.mds.a:Restarting daemon 2023-11-13T11:29:49.108 INFO:tasks.ceph.mds.a:Stopping old one... 2023-11-13T11:29:49.108 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-11-13T11:29:49.109 INFO:teuthology.orchestra.run:waiting for 300 2023-11-13T11:29:49.109 INFO:tasks.ceph.mds.c:Restarting daemon 2023-11-13T11:29:49.109 INFO:tasks.ceph.mds.c:Stopping old one... 2023-11-13T11:29:49.110 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-11-13T11:29:49.110 INFO:teuthology.orchestra.run:waiting for 300 2023-11-13T11:29:49.110 INFO:tasks.ceph.mds.b:Restarting daemon 2023-11-13T11:29:49.110 INFO:tasks.ceph.mds.b:Stopping old one... 2023-11-13T11:29:49.111 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-11-13T11:29:49.111 INFO:teuthology.orchestra.run:waiting for 300 2023-11-13T11:29:49.111 INFO:tasks.ceph.mds.d:Restarting daemon 2023-11-13T11:29:49.112 INFO:tasks.ceph.mds.d:Stopping old one... 2023-11-13T11:29:49.112 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-11-13T11:29:49.112 INFO:teuthology.orchestra.run:waiting for 300 2023-11-13T11:29:49.125 INFO:tasks.ceph.mds.c:Stopped 2023-11-13T11:29:49.126 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-11-13T11:29:49.127 INFO:tasks.ceph.mds.a:Stopped 2023-11-13T11:29:49.127 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-11-13T11:29:49.130 INFO:tasks.ceph.mds.b:Stopped 2023-11-13T11:29:49.130 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-11-13T11:29:49.132 INFO:tasks.ceph.mds.d:Stopped 2023-11-13T11:29:49.132 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-11-13T11:29:49.174 INFO:tasks.ceph.mds.c:Started 2023-11-13T11:29:49.174 DEBUG:teuthology.parallel:result is None 2023-11-13T11:29:49.176 INFO:tasks.ceph.mds.a:Started 2023-11-13T11:29:49.176 DEBUG:teuthology.parallel:result is None 2023-11-13T11:29:49.178 INFO:tasks.ceph.mds.b:Started 2023-11-13T11:29:49.178 DEBUG:teuthology.parallel:result is None 2023-11-13T11:29:49.181 INFO:tasks.ceph.mds.d:Started 2023-11-13T11:29:49.181 DEBUG:teuthology.parallel:result is None 2023-11-13T11:29:49.182 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-11-13T11:29:49.261 INFO:tasks.ceph.mds.c.smithi102.stdout:starting mds.c at 2023-11-13T11:29:49.261 INFO:tasks.ceph.mds.a.smithi102.stdout:starting mds.a at 2023-11-13T11:29:49.269 INFO:tasks.ceph.mds.d.smithi154.stdout:starting mds.d at 2023-11-13T11:29:49.270 INFO:tasks.ceph.mds.b.smithi154.stdout:starting mds.b at 2023-11-13T11:29:49.271 INFO:tasks.ceph.mds.d.smithi154.stderr:2023-11-13T11:29:49.265+0000 7f814f714640 -1 PosixStack listen unable to listen on v2:0.0.0.0:6832/0: (98) Address already in use 2023-11-13T11:29:49.329 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:49.321+0000 7f5b48c5a640 1 Processor -- start 2023-11-13T11:29:49.329 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:49.321+0000 7f5b48c5a640 1 -- start start 2023-11-13T11:29:49.330 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:49.321+0000 7f5b48c5a640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f5b4406a4a0 0x7f5b440aec50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:49.331 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:49.321+0000 7f5b48c5a640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5b440b2fc0 con 0x7f5b440af190 2023-11-13T11:29:49.331 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:49.321+0000 7f5b48c5a640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5b4406d8a0 con 0x7f5b4406a880 2023-11-13T11:29:49.331 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:49.321+0000 7f5b48c5a640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5b440af600 con 0x7f5b4406a4a0 2023-11-13T11:29:49.331 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:49.321+0000 7f5b4259c640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f5b4406a4a0 0x7f5b440aec50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:49.331 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:49.321+0000 7f5b42d9d640 1 --1- >> v1:172.21.15.102:6789/0 conn(0x7f5b440af190 0x7f5b44160a90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.102:6789/0 says I am v1:172.21.15.102:39388/0 (socket says 172.21.15.102:39388) 2023-11-13T11:29:49.332 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:49.321+0000 7f5b42d9d640 1 -- 172.21.15.102:0/3467987318 learned_addr learned my addr 172.21.15.102:0/3467987318 (peer_addr_for_me v1:172.21.15.102:0/0) 2023-11-13T11:29:49.332 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:49.325+0000 7f5b4259c640 1 -- 172.21.15.102:0/3467987318 >> v1:172.21.15.154:6789/0 conn(0x7f5b4406a880 legacy=0x7f5b4415c960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:49.333 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:49.325+0000 7f5b4259c640 1 -- 172.21.15.102:0/3467987318 >> v1:172.21.15.102:6789/0 conn(0x7f5b440af190 legacy=0x7f5b44160a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:49.333 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:49.325+0000 7f5b41d9b640 1 -- 172.21.15.102:0/3467987318 <== mon.0 v1:172.21.15.102:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2983529413 0 0) 0x7f5b440b2fc0 con 0x7f5b440af190 2023-11-13T11:29:49.333 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:49.325+0000 7f5b4259c640 1 -- 172.21.15.102:0/3467987318 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b4415d6f0 con 0x7f5b4406a4a0 2023-11-13T11:29:49.334 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:49.325+0000 7f5b4259c640 1 --2- 172.21.15.102:0/3467987318 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5b4406a4a0 0x7f5b440aec50 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f5b340097c0 tx=0x7f5b3401c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d9b3bd68e7e4eb26 server_cookie=0 in_seq=0 out_seq=0 2023-11-13T11:29:49.335 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:49.325+0000 7f5b41d9b640 1 -- 172.21.15.102:0/3467987318 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b340ab600 con 0x7f5b4406a4a0 2023-11-13T11:29:49.335 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:49.325+0000 7f5b41d9b640 1 -- 172.21.15.102:0/3467987318 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b340a7050 con 0x7f5b4406a4a0 2023-11-13T11:29:49.335 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:49.325+0000 7f5b41d9b640 1 -- 172.21.15.102:0/3467987318 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b340ab980 con 0x7f5b4406a4a0 2023-11-13T11:29:49.336 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:49.325+0000 7f5b48c5a640 1 -- 172.21.15.102:0/3467987318 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5b4406a4a0 msgr2=0x7f5b440aec50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:49.336 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:49.325+0000 7f5b48c5a640 1 --2- 172.21.15.102:0/3467987318 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5b4406a4a0 0x7f5b440aec50 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f5b340097c0 tx=0x7f5b3401c480 comp rx=0 tx=0).stop 2023-11-13T11:29:49.336 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:49.329+0000 7f5b48c5a640 1 -- 172.21.15.102:0/3467987318 shutdown_connections 2023-11-13T11:29:49.336 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:49.329+0000 7f5b48c5a640 1 --2- 172.21.15.102:0/3467987318 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5b4406a4a0 0x7f5b440aec50 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:49.336 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:49.329+0000 7f5b48c5a640 1 -- 172.21.15.102:0/3467987318 >> 172.21.15.102:0/3467987318 conn(0x7f5b4406b350 msgr2=0x7f5b4406b760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-13T11:29:49.336 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:49.329+0000 7f5b48c5a640 1 -- 172.21.15.102:0/3467987318 shutdown_connections 2023-11-13T11:29:49.337 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:49.329+0000 7f5b48c5a640 1 -- 172.21.15.102:0/3467987318 wait complete. 2023-11-13T11:29:49.337 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:49.329+0000 7f5b48c5a640 1 Processor -- start 2023-11-13T11:29:49.337 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:49.329+0000 7f5b48c5a640 1 -- start start 2023-11-13T11:29:49.340 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:49.329+0000 7f5b48c5a640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5b4406a4a0 0x7f5b441676e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:49.340 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:49.329+0000 7f5b48c5a640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5b4406a880 0x7f5b441453f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:49.340 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:49.329+0000 7f5b48c5a640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5b440af190 0x7f5b440b0a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:49.340 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:49.329+0000 7f5b48c5a640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b44158090 con 0x7f5b440af190 2023-11-13T11:29:49.340 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:49.329+0000 7f5b48c5a640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b44158370 con 0x7f5b4406a4a0 2023-11-13T11:29:49.341 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:49.329+0000 7f5b48c5a640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5b44158650 con 0x7f5b4406a880 2023-11-13T11:29:49.341 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:49.329+0000 7f5b42d9d640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5b440af190 0x7f5b440b0a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:49.341 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:49.329+0000 7f5b42d9d640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5b440af190 0x7f5b440b0a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:46376/0 (socket says 172.21.15.102:46376) 2023-11-13T11:29:49.341 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:49.329+0000 7f5b42d9d640 1 -- 172.21.15.102:0/969802164 learned_addr learned my addr 172.21.15.102:0/969802164 (peer_addr_for_me v2:172.21.15.102:0/0) 2023-11-13T11:29:49.341 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:49.329+0000 7f5b4259c640 1 --2- 172.21.15.102:0/969802164 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5b4406a4a0 0x7f5b441676e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:49.342 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:49.329+0000 7f5b39d9b640 1 --2- 172.21.15.102:0/969802164 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5b4406a880 0x7f5b441453f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:49.342 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:49.329+0000 7f5b42d9d640 1 -- 172.21.15.102:0/969802164 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5b4406a880 msgr2=0x7f5b441453f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:49.342 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:49.329+0000 7f5b42d9d640 1 --2- 172.21.15.102:0/969802164 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5b4406a880 0x7f5b441453f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:49.342 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:49.329+0000 7f5b42d9d640 1 -- 172.21.15.102:0/969802164 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5b4406a4a0 msgr2=0x7f5b441676e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:49.343 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:49.329+0000 7f5b42d9d640 1 --2- 172.21.15.102:0/969802164 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5b4406a4a0 0x7f5b441676e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:49.343 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:49.329+0000 7f5b42d9d640 1 -- 172.21.15.102:0/969802164 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b34009420 con 0x7f5b440af190 2023-11-13T11:29:49.343 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:49.333+0000 7f5b42d9d640 1 --2- 172.21.15.102:0/969802164 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5b440af190 0x7f5b440b0a00 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f5b3c00c3c0 tx=0x7f5b3c00c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-13T11:29:49.343 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:49.333+0000 7f5b3b7fe640 1 -- 172.21.15.102:0/969802164 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b3c0074e0 con 0x7f5b440af190 2023-11-13T11:29:49.343 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:49.333+0000 7f5b3b7fe640 1 -- 172.21.15.102:0/969802164 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b3c007640 con 0x7f5b440af190 2023-11-13T11:29:49.343 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:49.333+0000 7f5b48c5a640 1 -- 172.21.15.102:0/969802164 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5b44158930 con 0x7f5b440af190 2023-11-13T11:29:49.344 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:49.333+0000 7f5b3b7fe640 1 -- 172.21.15.102:0/969802164 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b3c004a30 con 0x7f5b440af190 2023-11-13T11:29:49.344 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:49.333+0000 7f5b48c5a640 1 -- 172.21.15.102:0/969802164 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5b44167c20 con 0x7f5b440af190 2023-11-13T11:29:49.345 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:49.333+0000 7f5b48c5a640 1 -- 172.21.15.102:0/969802164 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5b44158e50 con 0x7f5b440af190 2023-11-13T11:29:49.345 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:49.333+0000 7f5b3b7fe640 1 -- 172.21.15.102:0/969802164 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f5b3c004b90 con 0x7f5b440af190 2023-11-13T11:29:49.345 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:49.333+0000 7f5b3b7fe640 1 --2- 172.21.15.102:0/969802164 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f5b24066470 0x7f5b24068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:49.345 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:49.337+0000 7f5b3b7fe640 1 -- 172.21.15.102:0/969802164 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f5b3c083840 con 0x7f5b440af190 2023-11-13T11:29:49.346 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:49.337+0000 7f5b4259c640 1 --2- 172.21.15.102:0/969802164 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f5b24066470 0x7f5b24068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:49.346 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:49.337+0000 7f5b4259c640 1 --2- 172.21.15.102:0/969802164 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f5b24066470 0x7f5b24068930 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f5b340ad000 tx=0x7f5b340a6000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-13T11:29:49.347 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:49.341+0000 7f5b3b7fe640 1 -- 172.21.15.102:0/969802164 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f5b44158e50 con 0x7f5b440af190 2023-11-13T11:29:49.508 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:49.501+0000 7f5b48c5a640 1 -- 172.21.15.102:0/969802164 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7f5b44158e50 con 0x7f5b440af190 2023-11-13T11:29:49.837 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T11:29:49.842 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T11:29:50.784 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:50.777+0000 7f5b3b7fe640 1 -- 172.21.15.102:0/969802164 <== mon.0 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v32) v1 ==== 97+0+0 (secure 0 0 0) 0x7f5b44158e50 con 0x7f5b440af190 2023-11-13T11:29:50.785 INFO:teuthology.orchestra.run.smithi102.stderr: removed all blocklist entries 2023-11-13T11:29:50.786 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:50.777+0000 7f5b48c5a640 1 -- 172.21.15.102:0/969802164 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f5b24066470 msgr2=0x7f5b24068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:50.786 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:50.777+0000 7f5b48c5a640 1 --2- 172.21.15.102:0/969802164 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f5b24066470 0x7f5b24068930 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f5b340ad000 tx=0x7f5b340a6000 comp rx=0 tx=0).stop 2023-11-13T11:29:50.787 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:50.777+0000 7f5b48c5a640 1 -- 172.21.15.102:0/969802164 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5b440af190 msgr2=0x7f5b440b0a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:50.787 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:50.777+0000 7f5b48c5a640 1 --2- 172.21.15.102:0/969802164 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5b440af190 0x7f5b440b0a00 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f5b3c00c3c0 tx=0x7f5b3c00c880 comp rx=0 tx=0).stop 2023-11-13T11:29:50.787 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:50.777+0000 7f5b48c5a640 1 -- 172.21.15.102:0/969802164 shutdown_connections 2023-11-13T11:29:50.787 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:50.777+0000 7f5b48c5a640 1 --2- 172.21.15.102:0/969802164 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f5b24066470 0x7f5b24068930 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:50.788 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:50.777+0000 7f5b48c5a640 1 --2- 172.21.15.102:0/969802164 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5b440af190 0x7f5b440b0a00 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:50.788 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:50.777+0000 7f5b48c5a640 1 --2- 172.21.15.102:0/969802164 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5b4406a880 0x7f5b441453f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:50.788 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:50.777+0000 7f5b48c5a640 1 --2- 172.21.15.102:0/969802164 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5b4406a4a0 0x7f5b441676e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:50.788 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:50.777+0000 7f5b48c5a640 1 -- 172.21.15.102:0/969802164 >> 172.21.15.102:0/969802164 conn(0x7f5b4406b350 msgr2=0x7f5b440ceed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-13T11:29:50.788 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:50.777+0000 7f5b48c5a640 1 -- 172.21.15.102:0/969802164 shutdown_connections 2023-11-13T11:29:50.789 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:50.777+0000 7f5b48c5a640 1 -- 172.21.15.102:0/969802164 wait complete. 2023-11-13T11:29:50.806 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-11-13T11:29:50.945 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:50.937+0000 7f5f59901640 1 Processor -- start 2023-11-13T11:29:50.945 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:50.937+0000 7f5f59901640 1 -- start start 2023-11-13T11:29:50.947 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:50.937+0000 7f5f59901640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f5f540b1fd0 0x7f5f5406b910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:50.947 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:50.937+0000 7f5f59901640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f5f5406be50 0x7f5f5406c2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:50.947 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:50.937+0000 7f5f59901640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5f5406c7f0 con 0x7f5f540c5b70 2023-11-13T11:29:50.948 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:50.937+0000 7f5f59901640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5f540cf3b0 con 0x7f5f5406be50 2023-11-13T11:29:50.948 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:50.937+0000 7f5f59901640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5f540cf690 con 0x7f5f540b1fd0 2023-11-13T11:29:50.948 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:50.937+0000 7f5f4a7fc640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f5f5406be50 0x7f5f5406c2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:50.948 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:50.937+0000 7f5f4a7fc640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f5f5406be50 0x7f5f5406c2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:46382/0 (socket says 172.21.15.102:46382) 2023-11-13T11:29:50.948 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:50.937+0000 7f5f4a7fc640 1 -- 172.21.15.102:0/1693240771 learned_addr learned my addr 172.21.15.102:0/1693240771 (peer_addr_for_me v2:172.21.15.102:0/0) 2023-11-13T11:29:50.949 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:50.937+0000 7f5f52ffd640 1 --2- 172.21.15.102:0/1693240771 >> v2:172.21.15.154:3300/0 conn(0x7f5f540b1fd0 0x7f5f5406b910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:50.949 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:50.941+0000 7f5f4a7fc640 1 -- 172.21.15.102:0/1693240771 >> v2:172.21.15.154:3300/0 conn(0x7f5f540b1fd0 msgr2=0x7f5f5406b910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-13T11:29:50.949 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:50.941+0000 7f5f4a7fc640 1 --2- 172.21.15.102:0/1693240771 >> v2:172.21.15.154:3300/0 conn(0x7f5f540b1fd0 0x7f5f5406b910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:50.949 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:50.941+0000 7f5f4a7fc640 1 -- 172.21.15.102:0/1693240771 >> v1:172.21.15.154:6789/0 conn(0x7f5f540c5b70 legacy=0x7f5f540c5fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:50.949 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:50.941+0000 7f5f4a7fc640 1 -- 172.21.15.102:0/1693240771 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f540cf970 con 0x7f5f5406be50 2023-11-13T11:29:50.950 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:50.941+0000 7f5f4a7fc640 1 --2- 172.21.15.102:0/1693240771 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5f5406be50 0x7f5f5406c2b0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f5f54070c70 tx=0x7f5f4401c500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9ae91f7892802cc6 server_cookie=0 in_seq=0 out_seq=0 2023-11-13T11:29:50.950 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:50.941+0000 7f5f527fc640 1 -- 172.21.15.102:0/1693240771 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f440ab5f0 con 0x7f5f5406be50 2023-11-13T11:29:50.951 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:50.941+0000 7f5f527fc640 1 -- 172.21.15.102:0/1693240771 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f440ab750 con 0x7f5f5406be50 2023-11-13T11:29:50.951 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:50.941+0000 7f5f527fc640 1 -- 172.21.15.102:0/1693240771 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f440abae0 con 0x7f5f5406be50 2023-11-13T11:29:50.952 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:50.941+0000 7f5f59901640 1 -- 172.21.15.102:0/1693240771 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5f5406be50 msgr2=0x7f5f5406c2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:50.952 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:50.941+0000 7f5f59901640 1 --2- 172.21.15.102:0/1693240771 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5f5406be50 0x7f5f5406c2b0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f5f54070c70 tx=0x7f5f4401c500 comp rx=0 tx=0).stop 2023-11-13T11:29:50.952 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:50.945+0000 7f5f59901640 1 -- 172.21.15.102:0/1693240771 shutdown_connections 2023-11-13T11:29:50.952 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:50.945+0000 7f5f59901640 1 --2- 172.21.15.102:0/1693240771 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5f5406be50 0x7f5f5406c2b0 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:50.953 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:50.945+0000 7f5f59901640 1 --2- 172.21.15.102:0/1693240771 >> v2:172.21.15.154:3300/0 conn(0x7f5f540b1fd0 0x7f5f5406b910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:50.953 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:50.945+0000 7f5f59901640 1 -- 172.21.15.102:0/1693240771 >> 172.21.15.102:0/1693240771 conn(0x7f5f540b2660 msgr2=0x7f5f540b2a70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-13T11:29:50.953 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:50.945+0000 7f5f59901640 1 -- 172.21.15.102:0/1693240771 shutdown_connections 2023-11-13T11:29:50.953 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:50.945+0000 7f5f59901640 1 -- 172.21.15.102:0/1693240771 wait complete. 2023-11-13T11:29:50.955 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:50.945+0000 7f5f59901640 1 Processor -- start 2023-11-13T11:29:50.956 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:50.945+0000 7f5f59901640 1 -- start start 2023-11-13T11:29:50.956 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:50.945+0000 7f5f59901640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5f5406be50 0x7f5f54158d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:50.956 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:50.945+0000 7f5f59901640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5f540b1fd0 0x7f5f540ad940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:50.956 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:50.945+0000 7f5f59901640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5f540c5b70 0x7f5f540b5b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:50.956 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:50.945+0000 7f5f59901640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f540af810 con 0x7f5f540b1fd0 2023-11-13T11:29:50.957 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:50.945+0000 7f5f59901640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f54158bd0 con 0x7f5f540c5b70 2023-11-13T11:29:50.957 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:50.945+0000 7f5f59901640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f540ade80 con 0x7f5f5406be50 2023-11-13T11:29:50.957 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:50.945+0000 7f5f4a7fc640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5f540b1fd0 0x7f5f540ad940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:50.957 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:50.945+0000 7f5f4a7fc640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5f540b1fd0 0x7f5f540ad940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:46396/0 (socket says 172.21.15.102:46396) 2023-11-13T11:29:50.957 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:50.945+0000 7f5f4a7fc640 1 -- 172.21.15.102:0/1651776253 learned_addr learned my addr 172.21.15.102:0/1651776253 (peer_addr_for_me v2:172.21.15.102:0/0) 2023-11-13T11:29:50.958 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:50.945+0000 7f5f52ffd640 1 --2- 172.21.15.102:0/1651776253 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5f5406be50 0x7f5f54158d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:50.958 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:50.945+0000 7f5f537fe640 1 --2- 172.21.15.102:0/1651776253 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5f540c5b70 0x7f5f540b5b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:50.958 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:50.945+0000 7f5f4a7fc640 1 -- 172.21.15.102:0/1651776253 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5f5406be50 msgr2=0x7f5f54158d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:50.958 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:50.945+0000 7f5f4a7fc640 1 --2- 172.21.15.102:0/1651776253 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5f5406be50 0x7f5f54158d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:50.958 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:50.945+0000 7f5f4a7fc640 1 -- 172.21.15.102:0/1651776253 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5f540c5b70 msgr2=0x7f5f540b5b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:50.958 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:50.945+0000 7f5f4a7fc640 1 --2- 172.21.15.102:0/1651776253 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5f540c5b70 0x7f5f540b5b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:50.959 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:50.945+0000 7f5f4a7fc640 1 -- 172.21.15.102:0/1651776253 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f440094d0 con 0x7f5f540b1fd0 2023-11-13T11:29:50.959 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:50.945+0000 7f5f537fe640 1 --2- 172.21.15.102:0/1651776253 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5f540c5b70 0x7f5f540b5b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-13T11:29:50.959 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:50.945+0000 7f5f4a7fc640 1 --2- 172.21.15.102:0/1651776253 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5f540b1fd0 0x7f5f540ad940 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f5f44019110 tx=0x7f5f4401ad40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-13T11:29:50.959 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:50.949+0000 7f5f50ff9640 1 -- 172.21.15.102:0/1651776253 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f440be5f0 con 0x7f5f540b1fd0 2023-11-13T11:29:50.959 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:50.949+0000 7f5f50ff9640 1 -- 172.21.15.102:0/1651776253 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f440be770 con 0x7f5f540b1fd0 2023-11-13T11:29:50.960 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:50.949+0000 7f5f50ff9640 1 -- 172.21.15.102:0/1651776253 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f440beb20 con 0x7f5f540b1fd0 2023-11-13T11:29:50.960 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:50.949+0000 7f5f59901640 1 -- 172.21.15.102:0/1651776253 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5f540cd730 con 0x7f5f540b1fd0 2023-11-13T11:29:50.960 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:50.949+0000 7f5f59901640 1 -- 172.21.15.102:0/1651776253 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5f540af3c0 con 0x7f5f540b1fd0 2023-11-13T11:29:50.961 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:50.949+0000 7f5f59901640 1 -- 172.21.15.102:0/1651776253 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5f540c7180 con 0x7f5f540b1fd0 2023-11-13T11:29:50.961 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:50.949+0000 7f5f50ff9640 1 -- 172.21.15.102:0/1651776253 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f5f440b4600 con 0x7f5f540b1fd0 2023-11-13T11:29:50.961 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:50.949+0000 7f5f50ff9640 1 --2- 172.21.15.102:0/1651776253 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f5f34066470 0x7f5f34068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:50.962 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:50.949+0000 7f5f50ff9640 1 -- 172.21.15.102:0/1651776253 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f5f440a8050 con 0x7f5f540b1fd0 2023-11-13T11:29:50.962 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:50.949+0000 7f5f52ffd640 1 --2- 172.21.15.102:0/1651776253 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f5f34066470 0x7f5f34068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:50.962 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:50.949+0000 7f5f52ffd640 1 --2- 172.21.15.102:0/1651776253 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f5f34066470 0x7f5f34068930 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f5f3c0079c0 tx=0x7f5f3c008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-13T11:29:50.963 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:50.953+0000 7f5f50ff9640 1 -- 172.21.15.102:0/1651776253 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f5f440eba30 con 0x7f5f540b1fd0 2023-11-13T11:29:51.169 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:51.161+0000 7f5f59901640 1 -- 172.21.15.102:0/1651776253 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f5f54068520 con 0x7f5f540b1fd0 2023-11-13T11:29:51.169 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:51.161+0000 7f5f50ff9640 1 -- 172.21.15.102:0/1651776253 <== mon.0 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v4) v1 ==== 80+0+6645 (secure 0 0 0) 0x7f5f440c4090 con 0x7f5f540b1fd0 2023-11-13T11:29:51.170 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T11:29:51.170 INFO:teuthology.orchestra.run.smithi102.stdout:{ 2023-11-13T11:29:51.170 INFO:teuthology.orchestra.run.smithi102.stdout: "auth_dump": [ 2023-11-13T11:29:51.170 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-11-13T11:29:51.171 INFO:teuthology.orchestra.run.smithi102.stdout: "entity": "mds.a", 2023-11-13T11:29:51.171 INFO:teuthology.orchestra.run.smithi102.stdout: "key": "AQA4CFJl7F5cBRAAmR6QoqWujj7xEB2F594TOQ==", 2023-11-13T11:29:51.171 INFO:teuthology.orchestra.run.smithi102.stdout: "caps": { 2023-11-13T11:29:51.171 INFO:teuthology.orchestra.run.smithi102.stdout: "mds": "allow", 2023-11-13T11:29:51.171 INFO:teuthology.orchestra.run.smithi102.stdout: "mgr": "allow *", 2023-11-13T11:29:51.172 INFO:teuthology.orchestra.run.smithi102.stdout: "mon": "allow *", 2023-11-13T11:29:51.172 INFO:teuthology.orchestra.run.smithi102.stdout: "osd": "allow *" 2023-11-13T11:29:51.172 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-11-13T11:29:51.172 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-11-13T11:29:51.173 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-11-13T11:29:51.174 INFO:teuthology.orchestra.run.smithi102.stdout: "entity": "mds.b", 2023-11-13T11:29:51.174 INFO:teuthology.orchestra.run.smithi102.stdout: "key": "AQA4CFJlDRD4ERAAH1DZyCXwbycSRrc5HuGQhg==", 2023-11-13T11:29:51.175 INFO:teuthology.orchestra.run.smithi102.stdout: "caps": { 2023-11-13T11:29:51.175 INFO:teuthology.orchestra.run.smithi102.stdout: "mds": "allow", 2023-11-13T11:29:51.175 INFO:teuthology.orchestra.run.smithi102.stdout: "mgr": "allow *", 2023-11-13T11:29:51.175 INFO:teuthology.orchestra.run.smithi102.stdout: "mon": "allow *", 2023-11-13T11:29:51.175 INFO:teuthology.orchestra.run.smithi102.stdout: "osd": "allow *" 2023-11-13T11:29:51.176 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-11-13T11:29:51.176 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-11-13T11:29:51.176 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-11-13T11:29:51.176 INFO:teuthology.orchestra.run.smithi102.stdout: "entity": "mds.c", 2023-11-13T11:29:51.176 INFO:teuthology.orchestra.run.smithi102.stdout: "key": "AQA4CFJlp+bJDBAAJVNL/tAnvXTkNqdqeJbT9w==", 2023-11-13T11:29:51.177 INFO:teuthology.orchestra.run.smithi102.stdout: "caps": { 2023-11-13T11:29:51.177 INFO:teuthology.orchestra.run.smithi102.stdout: "mds": "allow", 2023-11-13T11:29:51.177 INFO:teuthology.orchestra.run.smithi102.stdout: "mgr": "allow *", 2023-11-13T11:29:51.177 INFO:teuthology.orchestra.run.smithi102.stdout: "mon": "allow *", 2023-11-13T11:29:51.178 INFO:teuthology.orchestra.run.smithi102.stdout: "osd": "allow *" 2023-11-13T11:29:51.178 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-11-13T11:29:51.178 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-11-13T11:29:51.178 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-11-13T11:29:51.179 INFO:teuthology.orchestra.run.smithi102.stdout: "entity": "mds.d", 2023-11-13T11:29:51.179 INFO:teuthology.orchestra.run.smithi102.stdout: "key": "AQA4CFJlrPOqGRAAilDvVa/CQc6sEAmBy2KElw==", 2023-11-13T11:29:51.179 INFO:teuthology.orchestra.run.smithi102.stdout: "caps": { 2023-11-13T11:29:51.179 INFO:teuthology.orchestra.run.smithi102.stdout: "mds": "allow", 2023-11-13T11:29:51.180 INFO:teuthology.orchestra.run.smithi102.stdout: "mgr": "allow *", 2023-11-13T11:29:51.180 INFO:teuthology.orchestra.run.smithi102.stdout: "mon": "allow *", 2023-11-13T11:29:51.180 INFO:teuthology.orchestra.run.smithi102.stdout: "osd": "allow *" 2023-11-13T11:29:51.180 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-11-13T11:29:51.180 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-11-13T11:29:51.180 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-11-13T11:29:51.181 INFO:teuthology.orchestra.run.smithi102.stdout: "entity": "osd.0", 2023-11-13T11:29:51.181 INFO:teuthology.orchestra.run.smithi102.stdout: "key": "AQA7CFJlUupYNRAAZyoKBEduTZIysbwHQzrSag==", 2023-11-13T11:29:51.181 INFO:teuthology.orchestra.run.smithi102.stdout: "caps": { 2023-11-13T11:29:51.182 INFO:teuthology.orchestra.run.smithi102.stdout: "mgr": "allow profile osd", 2023-11-13T11:29:51.182 INFO:teuthology.orchestra.run.smithi102.stdout: "mon": "allow profile osd", 2023-11-13T11:29:51.182 INFO:teuthology.orchestra.run.smithi102.stdout: "osd": "allow *" 2023-11-13T11:29:51.182 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-11-13T11:29:51.183 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-11-13T11:29:51.184 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-11-13T11:29:51.184 INFO:teuthology.orchestra.run.smithi102.stdout: "entity": "osd.1", 2023-11-13T11:29:51.184 INFO:teuthology.orchestra.run.smithi102.stdout: "key": "AQA/CFJlUnxvABAABNod7jDUWVe64fEwtHMb9w==", 2023-11-13T11:29:51.184 INFO:teuthology.orchestra.run.smithi102.stdout: "caps": { 2023-11-13T11:29:51.184 INFO:teuthology.orchestra.run.smithi102.stdout: "mgr": "allow profile osd", 2023-11-13T11:29:51.185 INFO:teuthology.orchestra.run.smithi102.stdout: "mon": "allow profile osd", 2023-11-13T11:29:51.186 INFO:teuthology.orchestra.run.smithi102.stdout: "osd": "allow *" 2023-11-13T11:29:51.186 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-11-13T11:29:51.186 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-11-13T11:29:51.186 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-11-13T11:29:51.187 INFO:teuthology.orchestra.run.smithi102.stdout: "entity": "osd.2", 2023-11-13T11:29:51.187 INFO:teuthology.orchestra.run.smithi102.stdout: "key": "AQBCCFJlYhdbBxAAYTzu9d9ofGtmfvMfedtmTw==", 2023-11-13T11:29:51.187 INFO:teuthology.orchestra.run.smithi102.stdout: "caps": { 2023-11-13T11:29:51.188 INFO:teuthology.orchestra.run.smithi102.stdout: "mgr": "allow profile osd", 2023-11-13T11:29:51.188 INFO:teuthology.orchestra.run.smithi102.stdout: "mon": "allow profile osd", 2023-11-13T11:29:51.188 INFO:teuthology.orchestra.run.smithi102.stdout: "osd": "allow *" 2023-11-13T11:29:51.188 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-11-13T11:29:51.189 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-11-13T11:29:51.189 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-11-13T11:29:51.189 INFO:teuthology.orchestra.run.smithi102.stdout: "entity": "osd.3", 2023-11-13T11:29:51.190 INFO:teuthology.orchestra.run.smithi102.stdout: "key": "AQBFCFJlZbUKDhAAwtM/e4oDPF5sztblOH77uQ==", 2023-11-13T11:29:51.190 INFO:teuthology.orchestra.run.smithi102.stdout: "caps": { 2023-11-13T11:29:51.192 INFO:teuthology.orchestra.run.smithi102.stdout: "mgr": "allow profile osd", 2023-11-13T11:29:51.192 INFO:teuthology.orchestra.run.smithi102.stdout: "mon": "allow profile osd", 2023-11-13T11:29:51.192 INFO:teuthology.orchestra.run.smithi102.stdout: "osd": "allow *" 2023-11-13T11:29:51.193 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-11-13T11:29:51.193 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-11-13T11:29:51.194 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-11-13T11:29:51.195 INFO:teuthology.orchestra.run.smithi102.stdout: "entity": "osd.4", 2023-11-13T11:29:51.195 INFO:teuthology.orchestra.run.smithi102.stdout: "key": "AQBLCFJlYKE5FRAAJdvXzuMVHeeaCw5jYQdClQ==", 2023-11-13T11:29:51.196 INFO:teuthology.orchestra.run.smithi102.stdout: "caps": { 2023-11-13T11:29:51.196 INFO:teuthology.orchestra.run.smithi102.stdout: "mgr": "allow profile osd", 2023-11-13T11:29:51.196 INFO:teuthology.orchestra.run.smithi102.stdout: "mon": "allow profile osd", 2023-11-13T11:29:51.196 INFO:teuthology.orchestra.run.smithi102.stdout: "osd": "allow *" 2023-11-13T11:29:51.196 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-11-13T11:29:51.197 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-11-13T11:29:51.197 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-11-13T11:29:51.197 INFO:teuthology.orchestra.run.smithi102.stdout: "entity": "osd.5", 2023-11-13T11:29:51.197 INFO:teuthology.orchestra.run.smithi102.stdout: "key": "AQBOCFJlVX5tHBAANS/0oCJ85BV7fWKU/YkehA==", 2023-11-13T11:29:51.197 INFO:teuthology.orchestra.run.smithi102.stdout: "caps": { 2023-11-13T11:29:51.198 INFO:teuthology.orchestra.run.smithi102.stdout: "mgr": "allow profile osd", 2023-11-13T11:29:51.198 INFO:teuthology.orchestra.run.smithi102.stdout: "mon": "allow profile osd", 2023-11-13T11:29:51.198 INFO:teuthology.orchestra.run.smithi102.stdout: "osd": "allow *" 2023-11-13T11:29:51.198 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-11-13T11:29:51.199 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-11-13T11:29:51.199 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-11-13T11:29:51.199 INFO:teuthology.orchestra.run.smithi102.stdout: "entity": "osd.6", 2023-11-13T11:29:51.200 INFO:teuthology.orchestra.run.smithi102.stdout: "key": "AQBRCFJlYuKJIxAAWvYLo7/JBcfEtOd3Uf+E1w==", 2023-11-13T11:29:51.200 INFO:teuthology.orchestra.run.smithi102.stdout: "caps": { 2023-11-13T11:29:51.200 INFO:teuthology.orchestra.run.smithi102.stdout: "mgr": "allow profile osd", 2023-11-13T11:29:51.200 INFO:teuthology.orchestra.run.smithi102.stdout: "mon": "allow profile osd", 2023-11-13T11:29:51.200 INFO:teuthology.orchestra.run.smithi102.stdout: "osd": "allow *" 2023-11-13T11:29:51.201 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-11-13T11:29:51.201 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-11-13T11:29:51.201 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-11-13T11:29:51.201 INFO:teuthology.orchestra.run.smithi102.stdout: "entity": "osd.7", 2023-11-13T11:29:51.201 INFO:teuthology.orchestra.run.smithi102.stdout: "key": "AQBUCFJlohOuKxAA3UTlSgmg0xLcZg0xENEuCg==", 2023-11-13T11:29:51.202 INFO:teuthology.orchestra.run.smithi102.stdout: "caps": { 2023-11-13T11:29:51.202 INFO:teuthology.orchestra.run.smithi102.stdout: "mgr": "allow profile osd", 2023-11-13T11:29:51.202 INFO:teuthology.orchestra.run.smithi102.stdout: "mon": "allow profile osd", 2023-11-13T11:29:51.202 INFO:teuthology.orchestra.run.smithi102.stdout: "osd": "allow *" 2023-11-13T11:29:51.202 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-11-13T11:29:51.203 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-11-13T11:29:51.203 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-11-13T11:29:51.203 INFO:teuthology.orchestra.run.smithi102.stdout: "entity": "client.0", 2023-11-13T11:29:51.203 INFO:teuthology.orchestra.run.smithi102.stdout: "key": "AQA4CFJlCrzJHRAAifnfqFe57iLwnoWmhavnMA==", 2023-11-13T11:29:51.203 INFO:teuthology.orchestra.run.smithi102.stdout: "caps": { 2023-11-13T11:29:51.204 INFO:teuthology.orchestra.run.smithi102.stdout: "mds": "allow", 2023-11-13T11:29:51.204 INFO:teuthology.orchestra.run.smithi102.stdout: "mgr": "allow r", 2023-11-13T11:29:51.204 INFO:teuthology.orchestra.run.smithi102.stdout: "mon": "allow rw", 2023-11-13T11:29:51.205 INFO:teuthology.orchestra.run.smithi102.stdout: "osd": "allow rwx" 2023-11-13T11:29:51.205 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-11-13T11:29:51.205 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-11-13T11:29:51.205 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-11-13T11:29:51.206 INFO:teuthology.orchestra.run.smithi102.stdout: "entity": "client.1", 2023-11-13T11:29:51.206 INFO:teuthology.orchestra.run.smithi102.stdout: "key": "AQA4CFJlKSR/JxAAfL/MN+5b3AbDF3C3G2VsGw==", 2023-11-13T11:29:51.206 INFO:teuthology.orchestra.run.smithi102.stdout: "caps": { 2023-11-13T11:29:51.206 INFO:teuthology.orchestra.run.smithi102.stdout: "mds": "allow", 2023-11-13T11:29:51.206 INFO:teuthology.orchestra.run.smithi102.stdout: "mgr": "allow r", 2023-11-13T11:29:51.207 INFO:teuthology.orchestra.run.smithi102.stdout: "mon": "allow rw", 2023-11-13T11:29:51.207 INFO:teuthology.orchestra.run.smithi102.stdout: "osd": "allow rwx" 2023-11-13T11:29:51.207 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-11-13T11:29:51.207 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-11-13T11:29:51.207 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-11-13T11:29:51.208 INFO:teuthology.orchestra.run.smithi102.stdout: "entity": "client.2", 2023-11-13T11:29:51.208 INFO:teuthology.orchestra.run.smithi102.stdout: "key": "AQA4CFJlS13vIxAAnXgB5W2MZzaQsqMhrplKAA==", 2023-11-13T11:29:51.208 INFO:teuthology.orchestra.run.smithi102.stdout: "caps": { 2023-11-13T11:29:51.208 INFO:teuthology.orchestra.run.smithi102.stdout: "mds": "allow", 2023-11-13T11:29:51.208 INFO:teuthology.orchestra.run.smithi102.stdout: "mgr": "allow r", 2023-11-13T11:29:51.209 INFO:teuthology.orchestra.run.smithi102.stdout: "mon": "allow rw", 2023-11-13T11:29:51.209 INFO:teuthology.orchestra.run.smithi102.stdout: "osd": "allow rwx" 2023-11-13T11:29:51.209 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-11-13T11:29:51.209 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-11-13T11:29:51.209 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-11-13T11:29:51.210 INFO:teuthology.orchestra.run.smithi102.stdout: "entity": "client.3", 2023-11-13T11:29:51.210 INFO:teuthology.orchestra.run.smithi102.stdout: "key": "AQA4CFJlf8yILRAAN9OTWaqlZBaTfkTPvpoO/g==", 2023-11-13T11:29:51.210 INFO:teuthology.orchestra.run.smithi102.stdout: "caps": { 2023-11-13T11:29:51.211 INFO:teuthology.orchestra.run.smithi102.stdout: "mds": "allow", 2023-11-13T11:29:51.211 INFO:teuthology.orchestra.run.smithi102.stdout: "mgr": "allow r", 2023-11-13T11:29:51.211 INFO:teuthology.orchestra.run.smithi102.stdout: "mon": "allow rw", 2023-11-13T11:29:51.211 INFO:teuthology.orchestra.run.smithi102.stdout: "osd": "allow rwx" 2023-11-13T11:29:51.211 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-11-13T11:29:51.211 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-11-13T11:29:51.212 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-11-13T11:29:51.212 INFO:teuthology.orchestra.run.smithi102.stdout: "entity": "client.admin", 2023-11-13T11:29:51.212 INFO:teuthology.orchestra.run.smithi102.stdout: "key": "AQA3CFJloHUXJBAAfS9vthrU8x6VhOXCTJgyLg==", 2023-11-13T11:29:51.212 INFO:teuthology.orchestra.run.smithi102.stdout: "caps": { 2023-11-13T11:29:51.212 INFO:teuthology.orchestra.run.smithi102.stdout: "mds": "allow *", 2023-11-13T11:29:51.213 INFO:teuthology.orchestra.run.smithi102.stdout: "mgr": "allow *", 2023-11-13T11:29:51.213 INFO:teuthology.orchestra.run.smithi102.stdout: "mon": "allow *", 2023-11-13T11:29:51.213 INFO:teuthology.orchestra.run.smithi102.stdout: "osd": "allow *" 2023-11-13T11:29:51.213 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-11-13T11:29:51.213 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-11-13T11:29:51.214 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-11-13T11:29:51.214 INFO:teuthology.orchestra.run.smithi102.stdout: "entity": "client.bootstrap-mds", 2023-11-13T11:29:51.214 INFO:teuthology.orchestra.run.smithi102.stdout: "key": "AQBfCFJlpwjpMRAA6bSKzvUMLch8C5Tc8iBt6g==", 2023-11-13T11:29:51.214 INFO:teuthology.orchestra.run.smithi102.stdout: "caps": { 2023-11-13T11:29:51.215 INFO:teuthology.orchestra.run.smithi102.stdout: "mon": "allow profile bootstrap-mds" 2023-11-13T11:29:51.215 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-11-13T11:29:51.215 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-11-13T11:29:51.216 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-11-13T11:29:51.216 INFO:teuthology.orchestra.run.smithi102.stdout: "entity": "client.bootstrap-mgr", 2023-11-13T11:29:51.216 INFO:teuthology.orchestra.run.smithi102.stdout: "key": "AQBfCFJlCBTpMRAAyt4G1IkULnSVPU5cQau8xQ==", 2023-11-13T11:29:51.217 INFO:teuthology.orchestra.run.smithi102.stdout: "caps": { 2023-11-13T11:29:51.217 INFO:teuthology.orchestra.run.smithi102.stdout: "mon": "allow profile bootstrap-mgr" 2023-11-13T11:29:51.217 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-11-13T11:29:51.217 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-11-13T11:29:51.218 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-11-13T11:29:51.218 INFO:teuthology.orchestra.run.smithi102.stdout: "entity": "client.bootstrap-osd", 2023-11-13T11:29:51.218 INFO:teuthology.orchestra.run.smithi102.stdout: "key": "AQBfCFJlNR7pMRAA8MvCcMomqhQof73kN1qcVQ==", 2023-11-13T11:29:51.218 INFO:teuthology.orchestra.run.smithi102.stdout: "caps": { 2023-11-13T11:29:51.218 INFO:teuthology.orchestra.run.smithi102.stdout: "mon": "allow profile bootstrap-osd" 2023-11-13T11:29:51.219 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-11-13T11:29:51.219 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-11-13T11:29:51.219 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-11-13T11:29:51.219 INFO:teuthology.orchestra.run.smithi102.stdout: "entity": "client.bootstrap-rbd", 2023-11-13T11:29:51.219 INFO:teuthology.orchestra.run.smithi102.stdout: "key": "AQBfCFJl7SbpMRAANjoA/LvNJGMgB8qDlORFKg==", 2023-11-13T11:29:51.220 INFO:teuthology.orchestra.run.smithi102.stdout: "caps": { 2023-11-13T11:29:51.220 INFO:teuthology.orchestra.run.smithi102.stdout: "mon": "allow profile bootstrap-rbd" 2023-11-13T11:29:51.220 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-11-13T11:29:51.220 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-11-13T11:29:51.221 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-11-13T11:29:51.221 INFO:teuthology.orchestra.run.smithi102.stdout: "entity": "client.bootstrap-rbd-mirror", 2023-11-13T11:29:51.221 INFO:teuthology.orchestra.run.smithi102.stdout: "key": "AQBfCFJlri/pMRAAQrXemTJL71+JaqSXdhGiRg==", 2023-11-13T11:29:51.221 INFO:teuthology.orchestra.run.smithi102.stdout: "caps": { 2023-11-13T11:29:51.224 INFO:teuthology.orchestra.run.smithi102.stdout: "mon": "allow profile bootstrap-rbd-mirror" 2023-11-13T11:29:51.224 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-11-13T11:29:51.224 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-11-13T11:29:51.224 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-11-13T11:29:51.225 INFO:teuthology.orchestra.run.smithi102.stdout: "entity": "client.bootstrap-rgw", 2023-11-13T11:29:51.225 INFO:teuthology.orchestra.run.smithi102.stdout: "key": "AQBfCFJlsDjpMRAAjPbVrZjadjDPvXfdXuQIYA==", 2023-11-13T11:29:51.225 INFO:teuthology.orchestra.run.smithi102.stdout: "caps": { 2023-11-13T11:29:51.225 INFO:teuthology.orchestra.run.smithi102.stdout: "mon": "allow profile bootstrap-rgw" 2023-11-13T11:29:51.225 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-11-13T11:29:51.226 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-11-13T11:29:51.226 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-11-13T11:29:51.226 INFO:teuthology.orchestra.run.smithi102.stdout: "entity": "mgr.x", 2023-11-13T11:29:51.226 INFO:teuthology.orchestra.run.smithi102.stdout: "key": "AQA4CFJll6/mABAAiasnzrTfVz84ZR3TWn1dfw==", 2023-11-13T11:29:51.227 INFO:teuthology.orchestra.run.smithi102.stdout: "caps": { 2023-11-13T11:29:51.227 INFO:teuthology.orchestra.run.smithi102.stdout: "mds": "allow *", 2023-11-13T11:29:51.227 INFO:teuthology.orchestra.run.smithi102.stdout: "mon": "allow profile mgr", 2023-11-13T11:29:51.227 INFO:teuthology.orchestra.run.smithi102.stdout: "osd": "allow *" 2023-11-13T11:29:51.228 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-11-13T11:29:51.228 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-11-13T11:29:51.228 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-11-13T11:29:51.228 INFO:teuthology.orchestra.run.smithi102.stdout: "entity": "mgr.y", 2023-11-13T11:29:51.228 INFO:teuthology.orchestra.run.smithi102.stdout: "key": "AQA3CFJlBW+UOBAAq/Q6BMOG8BqhQfgScI+IFw==", 2023-11-13T11:29:51.228 INFO:teuthology.orchestra.run.smithi102.stdout: "caps": { 2023-11-13T11:29:51.229 INFO:teuthology.orchestra.run.smithi102.stdout: "mds": "allow *", 2023-11-13T11:29:51.229 INFO:teuthology.orchestra.run.smithi102.stdout: "mon": "allow profile mgr", 2023-11-13T11:29:51.229 INFO:teuthology.orchestra.run.smithi102.stdout: "osd": "allow *" 2023-11-13T11:29:51.229 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-11-13T11:29:51.229 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-11-13T11:29:51.230 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2023-11-13T11:29:51.230 INFO:teuthology.orchestra.run.smithi102.stdout:} 2023-11-13T11:29:51.232 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:51.165+0000 7f5f59901640 1 -- 172.21.15.102:0/1651776253 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f5f34066470 msgr2=0x7f5f34068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:51.232 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:51.165+0000 7f5f59901640 1 --2- 172.21.15.102:0/1651776253 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f5f34066470 0x7f5f34068930 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f5f3c0079c0 tx=0x7f5f3c008040 comp rx=0 tx=0).stop 2023-11-13T11:29:51.232 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:51.165+0000 7f5f59901640 1 -- 172.21.15.102:0/1651776253 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5f540b1fd0 msgr2=0x7f5f540ad940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:51.233 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:51.165+0000 7f5f59901640 1 --2- 172.21.15.102:0/1651776253 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5f540b1fd0 0x7f5f540ad940 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f5f44019110 tx=0x7f5f4401ad40 comp rx=0 tx=0).stop 2023-11-13T11:29:51.233 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:51.165+0000 7f5f59901640 1 -- 172.21.15.102:0/1651776253 shutdown_connections 2023-11-13T11:29:51.233 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:51.165+0000 7f5f59901640 1 --2- 172.21.15.102:0/1651776253 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5f540c5b70 0x7f5f540b5b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:51.234 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:51.165+0000 7f5f59901640 1 --2- 172.21.15.102:0/1651776253 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f5f34066470 0x7f5f34068930 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:51.234 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:51.165+0000 7f5f59901640 1 --2- 172.21.15.102:0/1651776253 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5f540b1fd0 0x7f5f540ad940 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:51.234 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:51.165+0000 7f5f59901640 1 --2- 172.21.15.102:0/1651776253 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5f5406be50 0x7f5f54158d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:51.234 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:51.165+0000 7f5f59901640 1 -- 172.21.15.102:0/1651776253 >> 172.21.15.102:0/1651776253 conn(0x7f5f540b2660 msgr2=0x7f5f5415d760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-13T11:29:51.235 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:51.165+0000 7f5f59901640 1 -- 172.21.15.102:0/1651776253 shutdown_connections 2023-11-13T11:29:51.235 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:51.165+0000 7f5f59901640 1 -- 172.21.15.102:0/1651776253 wait complete. 2023-11-13T11:29:51.235 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mds 2023-11-13T11:29:51.373 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:51.365+0000 7fd345816640 1 Processor -- start 2023-11-13T11:29:51.373 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:51.365+0000 7fd345816640 1 -- start start 2023-11-13T11:29:51.375 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:51.365+0000 7fd345816640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7fd340140540 0x7fd34015e3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:51.375 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:51.365+0000 7fd345816640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd34006caa0 0x7fd3400711f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:51.375 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:51.365+0000 7fd345816640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd34015e910 con 0x7fd340071730 2023-11-13T11:29:51.376 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:51.365+0000 7fd345816640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd340071be0 con 0x7fd340140540 2023-11-13T11:29:51.376 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:51.365+0000 7fd345816640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd340140920 con 0x7fd34006caa0 2023-11-13T11:29:51.376 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:51.365+0000 7fd33effd640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7fd340140540 0x7fd34015e3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:51.376 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:51.365+0000 7fd33effd640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7fd340140540 0x7fd34015e3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:46400/0 (socket says 172.21.15.102:46400) 2023-11-13T11:29:51.377 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:51.365+0000 7fd33effd640 1 -- 172.21.15.102:0/1076546630 learned_addr learned my addr 172.21.15.102:0/1076546630 (peer_addr_for_me v2:172.21.15.102:0/0) 2023-11-13T11:29:51.377 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:51.365+0000 7fd3367fc640 1 --2- 172.21.15.102:0/1076546630 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd34006caa0 0x7fd3400711f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:51.377 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:51.369+0000 7fd33effd640 1 -- 172.21.15.102:0/1076546630 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd34006caa0 msgr2=0x7fd3400711f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-13T11:29:51.377 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:51.369+0000 7fd33effd640 1 --2- 172.21.15.102:0/1076546630 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd34006caa0 0x7fd3400711f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:51.378 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:51.369+0000 7fd33effd640 1 -- 172.21.15.102:0/1076546630 >> v1:172.21.15.154:6789/0 conn(0x7fd340071730 legacy=0x7fd34006fd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:51.378 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:51.369+0000 7fd33effd640 1 -- 172.21.15.102:0/1076546630 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3400ccc50 con 0x7fd340140540 2023-11-13T11:29:51.388 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:51.369+0000 7fd33effd640 1 --2- 172.21.15.102:0/1076546630 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd340140540 0x7fd34015e3d0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7fd330009870 tx=0x7fd33001c510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4d88aa2058912506 server_cookie=0 in_seq=0 out_seq=0 2023-11-13T11:29:51.388 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:51.369+0000 7fd33e7fc640 1 -- 172.21.15.102:0/1076546630 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3300aa670 con 0x7fd340140540 2023-11-13T11:29:51.388 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:51.369+0000 7fd33e7fc640 1 -- 172.21.15.102:0/1076546630 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd3300aa7d0 con 0x7fd340140540 2023-11-13T11:29:51.389 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:51.369+0000 7fd33e7fc640 1 -- 172.21.15.102:0/1076546630 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3300aab60 con 0x7fd340140540 2023-11-13T11:29:51.389 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:51.369+0000 7fd345816640 1 -- 172.21.15.102:0/1076546630 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd340140540 msgr2=0x7fd34015e3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:51.389 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:51.369+0000 7fd345816640 1 --2- 172.21.15.102:0/1076546630 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd340140540 0x7fd34015e3d0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7fd330009870 tx=0x7fd33001c510 comp rx=0 tx=0).stop 2023-11-13T11:29:51.390 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:51.369+0000 7fd345816640 1 -- 172.21.15.102:0/1076546630 shutdown_connections 2023-11-13T11:29:51.390 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:51.369+0000 7fd345816640 1 --2- 172.21.15.102:0/1076546630 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd34006caa0 0x7fd3400711f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:51.391 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:51.369+0000 7fd345816640 1 --2- 172.21.15.102:0/1076546630 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd340140540 0x7fd34015e3d0 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:51.391 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:51.369+0000 7fd345816640 1 -- 172.21.15.102:0/1076546630 >> 172.21.15.102:0/1076546630 conn(0x7fd3400b0870 msgr2=0x7fd3400b0c80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-13T11:29:51.391 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:51.369+0000 7fd345816640 1 -- 172.21.15.102:0/1076546630 shutdown_connections 2023-11-13T11:29:51.392 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:51.369+0000 7fd345816640 1 -- 172.21.15.102:0/1076546630 wait complete. 2023-11-13T11:29:51.392 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:51.373+0000 7fd345816640 1 Processor -- start 2023-11-13T11:29:51.392 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:51.373+0000 7fd345816640 1 -- start start 2023-11-13T11:29:51.392 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:51.373+0000 7fd345816640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd34006caa0 0x7fd340164f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:51.392 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:51.373+0000 7fd345816640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd340071730 0x7fd34015a370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:51.393 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:51.373+0000 7fd345816640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd340140540 0x7fd34015bed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:51.393 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:51.373+0000 7fd345816640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd34015ad10 con 0x7fd340140540 2023-11-13T11:29:51.393 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:51.373+0000 7fd345816640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd34015b110 con 0x7fd340071730 2023-11-13T11:29:51.393 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:51.373+0000 7fd345816640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd34015b3f0 con 0x7fd34006caa0 2023-11-13T11:29:51.393 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:51.373+0000 7fd33effd640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd34006caa0 0x7fd340164f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:51.394 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:51.373+0000 7fd33f7fe640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd340140540 0x7fd34015bed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:51.394 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:51.373+0000 7fd33effd640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd34006caa0 0x7fd340164f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.102:55186/0 (socket says 172.21.15.102:55186) 2023-11-13T11:29:51.394 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:51.373+0000 7fd33effd640 1 -- 172.21.15.102:0/3332334941 learned_addr learned my addr 172.21.15.102:0/3332334941 (peer_addr_for_me v2:172.21.15.102:0/0) 2023-11-13T11:29:51.394 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:51.373+0000 7fd3367fc640 1 --2- 172.21.15.102:0/3332334941 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd340071730 0x7fd34015a370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:51.395 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:51.373+0000 7fd33effd640 1 -- 172.21.15.102:0/3332334941 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd340071730 msgr2=0x7fd34015a370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:51.395 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:51.373+0000 7fd33effd640 1 --2- 172.21.15.102:0/3332334941 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd340071730 0x7fd34015a370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:51.396 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:51.373+0000 7fd33effd640 1 -- 172.21.15.102:0/3332334941 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd340140540 msgr2=0x7fd34015bed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:51.396 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:51.373+0000 7fd33effd640 1 --2- 172.21.15.102:0/3332334941 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd340140540 0x7fd34015bed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:51.396 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:51.373+0000 7fd33effd640 1 -- 172.21.15.102:0/3332334941 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3300094d0 con 0x7fd34006caa0 2023-11-13T11:29:51.397 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:51.373+0000 7fd33f7fe640 1 --2- 172.21.15.102:0/3332334941 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd340140540 0x7fd34015bed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-13T11:29:51.397 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:51.373+0000 7fd33effd640 1 --2- 172.21.15.102:0/3332334941 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd34006caa0 0x7fd340164f40 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fd3300ac040 tx=0x7fd33001ad50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-13T11:29:51.397 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:51.373+0000 7fd33cff9640 1 -- 172.21.15.102:0/3332334941 <== mon.2 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3300b3800 con 0x7fd34006caa0 2023-11-13T11:29:51.398 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:51.377+0000 7fd33cff9640 1 -- 172.21.15.102:0/3332334941 <== mon.2 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd3300b3980 con 0x7fd34006caa0 2023-11-13T11:29:51.398 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:51.377+0000 7fd345816640 1 -- 172.21.15.102:0/3332334941 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd34015b6d0 con 0x7fd34006caa0 2023-11-13T11:29:51.398 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:51.377+0000 7fd33cff9640 1 -- 172.21.15.102:0/3332334941 <== mon.2 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3300b3d30 con 0x7fd34006caa0 2023-11-13T11:29:51.398 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:51.377+0000 7fd345816640 1 -- 172.21.15.102:0/3332334941 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd340165480 con 0x7fd34006caa0 2023-11-13T11:29:51.398 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:51.377+0000 7fd345816640 1 -- 172.21.15.102:0/3332334941 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd34015b250 con 0x7fd34006caa0 2023-11-13T11:29:51.399 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:51.377+0000 7fd33cff9640 1 -- 172.21.15.102:0/3332334941 <== mon.2 v2:172.21.15.154:3301/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fd3300059a0 con 0x7fd34006caa0 2023-11-13T11:29:51.399 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:51.377+0000 7fd33cff9640 1 --2- 172.21.15.102:0/3332334941 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7fd320066470 0x7fd320068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:51.400 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:51.377+0000 7fd33cff9640 1 -- 172.21.15.102:0/3332334941 <== mon.2 v2:172.21.15.154:3301/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fd33011df50 con 0x7fd34006caa0 2023-11-13T11:29:51.400 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:51.377+0000 7fd3367fc640 1 --2- 172.21.15.102:0/3332334941 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7fd320066470 0x7fd320068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:51.400 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:51.377+0000 7fd3367fc640 1 --2- 172.21.15.102:0/3332334941 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7fd320066470 0x7fd320068930 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fd340164980 tx=0x7fd328009190 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-13T11:29:51.401 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:51.381+0000 7fd33cff9640 1 -- 172.21.15.102:0/3332334941 <== mon.2 v2:172.21.15.154:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fd3300eb840 con 0x7fd34006caa0 2023-11-13T11:29:51.590 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:51.581+0000 7fd345816640 1 -- 172.21.15.102:0/3332334941 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mds"} v 0) v1 -- 0x7fd34015b250 con 0x7fd34006caa0 2023-11-13T11:29:51.596 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:51.589+0000 7fd33cff9640 1 -- 172.21.15.102:0/3332334941 <== mon.2 v2:172.21.15.154:3301/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mds"}]=0 v5) v1 ==== 90+0+0 (secure 0 0 0) 0x7fd34015b250 con 0x7fd34006caa0 2023-11-13T11:29:51.598 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:51.589+0000 7fd345816640 1 -- 172.21.15.102:0/3332334941 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7fd320066470 msgr2=0x7fd320068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:51.598 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:51.589+0000 7fd345816640 1 --2- 172.21.15.102:0/3332334941 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7fd320066470 0x7fd320068930 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fd340164980 tx=0x7fd328009190 comp rx=0 tx=0).stop 2023-11-13T11:29:51.598 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:51.589+0000 7fd345816640 1 -- 172.21.15.102:0/3332334941 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd34006caa0 msgr2=0x7fd340164f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:51.599 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:51.589+0000 7fd345816640 1 --2- 172.21.15.102:0/3332334941 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd34006caa0 0x7fd340164f40 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fd3300ac040 tx=0x7fd33001ad50 comp rx=0 tx=0).stop 2023-11-13T11:29:51.599 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:51.589+0000 7fd345816640 1 -- 172.21.15.102:0/3332334941 shutdown_connections 2023-11-13T11:29:51.599 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:51.589+0000 7fd345816640 1 --2- 172.21.15.102:0/3332334941 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7fd320066470 0x7fd320068930 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:51.599 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:51.589+0000 7fd345816640 1 --2- 172.21.15.102:0/3332334941 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd340140540 0x7fd34015bed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:51.600 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:51.589+0000 7fd345816640 1 --2- 172.21.15.102:0/3332334941 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd340071730 0x7fd34015a370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:51.600 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:51.589+0000 7fd345816640 1 --2- 172.21.15.102:0/3332334941 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd34006caa0 0x7fd340164f40 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:51.600 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:51.589+0000 7fd345816640 1 -- 172.21.15.102:0/3332334941 >> 172.21.15.102:0/3332334941 conn(0x7fd3400b0870 msgr2=0x7fd34006fd10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-13T11:29:51.600 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:51.589+0000 7fd345816640 1 -- 172.21.15.102:0/3332334941 shutdown_connections 2023-11-13T11:29:51.600 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:51.589+0000 7fd345816640 1 -- 172.21.15.102:0/3332334941 wait complete. 2023-11-13T11:29:51.617 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mgr 2023-11-13T11:29:51.759 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:51.749+0000 7f8a54479640 1 Processor -- start 2023-11-13T11:29:51.759 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:51.749+0000 7f8a54479640 1 -- start start 2023-11-13T11:29:51.759 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:51.749+0000 7f8a54479640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8a4c071900 0x7f8a4c15e3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:51.759 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:51.749+0000 7f8a54479640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f8a4c06caa0 0x7f8a4c0b1c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:51.760 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:51.749+0000 7f8a54479640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8a4c15e910 con 0x7f8a4c140540 2023-11-13T11:29:51.760 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:51.749+0000 7f8a54479640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8a4c140920 con 0x7f8a4c06caa0 2023-11-13T11:29:51.760 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:51.749+0000 7f8a54479640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8a4c0ccc50 con 0x7f8a4c071900 2023-11-13T11:29:51.760 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:51.749+0000 7f8a52a16640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f8a4c06caa0 0x7f8a4c0b1c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:51.761 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:51.749+0000 7f8a52215640 1 --1- >> v1:172.21.15.102:6789/0 conn(0x7f8a4c140540 0x7f8a4c0711f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.102:6789/0 says I am v1:172.21.15.102:39404/0 (socket says 172.21.15.102:39404) 2023-11-13T11:29:51.761 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:51.749+0000 7f8a52215640 1 -- 172.21.15.102:0/3445269831 learned_addr learned my addr 172.21.15.102:0/3445269831 (peer_addr_for_me v1:172.21.15.102:0/0) 2023-11-13T11:29:51.761 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:51.749+0000 7f8a51a14640 1 --2- 172.21.15.102:0/3445269831 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8a4c071900 0x7f8a4c15e3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:51.761 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:51.749+0000 7f8a52a16640 1 -- 172.21.15.102:0/3445269831 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8a4c071900 msgr2=0x7f8a4c15e3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-13T11:29:51.761 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:51.749+0000 7f8a52a16640 1 --2- 172.21.15.102:0/3445269831 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8a4c071900 0x7f8a4c15e3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:51.761 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:51.749+0000 7f8a52a16640 1 -- 172.21.15.102:0/3445269831 >> v1:172.21.15.102:6789/0 conn(0x7f8a4c140540 legacy=0x7f8a4c0711f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:51.762 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:51.749+0000 7f8a52a16640 1 -- 172.21.15.102:0/3445269831 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a4c06cfc0 con 0x7f8a4c06caa0 2023-11-13T11:29:51.762 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:51.749+0000 7f8a51213640 1 -- 172.21.15.102:0/3445269831 <== mon.0 v1:172.21.15.102:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1730850971 0 0) 0x7f8a48001120 con 0x7f8a4c140540 2023-11-13T11:29:51.764 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:51.753+0000 7f8a52a16640 1 --2- 172.21.15.102:0/3445269831 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8a4c06caa0 0x7f8a4c0b1c00 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f8a44009d90 tx=0x7f8a4401c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6340979b3e41d1db server_cookie=0 in_seq=0 out_seq=0 2023-11-13T11:29:51.764 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:51.753+0000 7f8a51213640 1 -- 172.21.15.102:0/3445269831 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a440a59e0 con 0x7f8a4c06caa0 2023-11-13T11:29:51.765 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:51.753+0000 7f8a51213640 1 -- 172.21.15.102:0/3445269831 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a440a5b40 con 0x7f8a4c06caa0 2023-11-13T11:29:51.765 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:51.753+0000 7f8a51213640 1 -- 172.21.15.102:0/3445269831 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a440ad440 con 0x7f8a4c06caa0 2023-11-13T11:29:51.765 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:51.753+0000 7f8a54479640 1 -- 172.21.15.102:0/3445269831 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8a4c06caa0 msgr2=0x7f8a4c0b1c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:51.766 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:51.753+0000 7f8a54479640 1 --2- 172.21.15.102:0/3445269831 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8a4c06caa0 0x7f8a4c0b1c00 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f8a44009d90 tx=0x7f8a4401c920 comp rx=0 tx=0).stop 2023-11-13T11:29:51.766 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:51.753+0000 7f8a54479640 1 -- 172.21.15.102:0/3445269831 shutdown_connections 2023-11-13T11:29:51.766 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:51.753+0000 7f8a54479640 1 --2- 172.21.15.102:0/3445269831 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8a4c06caa0 0x7f8a4c0b1c00 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:51.766 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:51.753+0000 7f8a54479640 1 --2- 172.21.15.102:0/3445269831 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8a4c071900 0x7f8a4c15e3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:51.767 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:51.753+0000 7f8a54479640 1 -- 172.21.15.102:0/3445269831 >> 172.21.15.102:0/3445269831 conn(0x7f8a4c0b0870 msgr2=0x7f8a4c0b0c80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-13T11:29:51.767 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:51.753+0000 7f8a54479640 1 -- 172.21.15.102:0/3445269831 shutdown_connections 2023-11-13T11:29:51.767 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:51.753+0000 7f8a54479640 1 -- 172.21.15.102:0/3445269831 wait complete. 2023-11-13T11:29:51.767 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:51.757+0000 7f8a54479640 1 Processor -- start 2023-11-13T11:29:51.767 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:51.757+0000 7f8a54479640 1 -- start start 2023-11-13T11:29:51.770 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:51.757+0000 7f8a54479640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8a4c06caa0 0x7f8a4c13d0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:51.770 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:51.757+0000 7f8a54479640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8a4c071900 0x7f8a4c0af760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:51.770 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:51.757+0000 7f8a54479640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8a4c140540 0x7f8a4c0afca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:51.771 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:51.757+0000 7f8a54479640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a4c159b10 con 0x7f8a4c071900 2023-11-13T11:29:51.771 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:51.757+0000 7f8a54479640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a4c13e7e0 con 0x7f8a4c06caa0 2023-11-13T11:29:51.771 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:51.757+0000 7f8a54479640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8a4c1f57b0 con 0x7f8a4c140540 2023-11-13T11:29:51.771 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:51.757+0000 7f8a51a14640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8a4c071900 0x7f8a4c0af760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:51.771 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:51.757+0000 7f8a51a14640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8a4c071900 0x7f8a4c0af760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:46436/0 (socket says 172.21.15.102:46436) 2023-11-13T11:29:51.772 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:51.757+0000 7f8a51a14640 1 -- 172.21.15.102:0/1410338635 learned_addr learned my addr 172.21.15.102:0/1410338635 (peer_addr_for_me v2:172.21.15.102:0/0) 2023-11-13T11:29:51.772 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:51.757+0000 7f8a52215640 1 --2- 172.21.15.102:0/1410338635 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8a4c06caa0 0x7f8a4c13d0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:51.772 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:51.757+0000 7f8a52a16640 1 --2- 172.21.15.102:0/1410338635 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8a4c140540 0x7f8a4c0afca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:51.772 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:51.757+0000 7f8a51a14640 1 -- 172.21.15.102:0/1410338635 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8a4c140540 msgr2=0x7f8a4c0afca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:51.772 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:51.757+0000 7f8a51a14640 1 --2- 172.21.15.102:0/1410338635 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8a4c140540 0x7f8a4c0afca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:51.773 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:51.757+0000 7f8a51a14640 1 -- 172.21.15.102:0/1410338635 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8a4c06caa0 msgr2=0x7f8a4c13d0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:51.773 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:51.757+0000 7f8a51a14640 1 --2- 172.21.15.102:0/1410338635 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8a4c06caa0 0x7f8a4c13d0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:51.773 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:51.757+0000 7f8a51a14640 1 -- 172.21.15.102:0/1410338635 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a44009a70 con 0x7f8a4c071900 2023-11-13T11:29:51.773 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:51.757+0000 7f8a51a14640 1 --2- 172.21.15.102:0/1410338635 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8a4c071900 0x7f8a4c0af760 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f8a3c00d800 tx=0x7f8a3c00dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-13T11:29:51.773 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:51.757+0000 7f8a42ffd640 1 -- 172.21.15.102:0/1410338635 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a3c00b6c0 con 0x7f8a4c071900 2023-11-13T11:29:51.774 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:51.757+0000 7f8a42ffd640 1 -- 172.21.15.102:0/1410338635 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a3c00b820 con 0x7f8a4c071900 2023-11-13T11:29:51.774 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:51.757+0000 7f8a54479640 1 -- 172.21.15.102:0/1410338635 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8a4c1f5a90 con 0x7f8a4c071900 2023-11-13T11:29:51.774 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:51.757+0000 7f8a42ffd640 1 -- 172.21.15.102:0/1410338635 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a3c00bb90 con 0x7f8a4c071900 2023-11-13T11:29:51.774 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:51.757+0000 7f8a54479640 1 -- 172.21.15.102:0/1410338635 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8a4c1f5460 con 0x7f8a4c071900 2023-11-13T11:29:51.774 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:51.761+0000 7f8a54479640 1 -- 172.21.15.102:0/1410338635 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8a4c068520 con 0x7f8a4c071900 2023-11-13T11:29:51.775 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:51.761+0000 7f8a42ffd640 1 -- 172.21.15.102:0/1410338635 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f8a3c00bcf0 con 0x7f8a4c071900 2023-11-13T11:29:51.775 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:51.761+0000 7f8a42ffd640 1 --2- 172.21.15.102:0/1410338635 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f8a30066470 0x7f8a30068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:51.775 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:51.761+0000 7f8a42ffd640 1 -- 172.21.15.102:0/1410338635 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f8a3c084160 con 0x7f8a4c071900 2023-11-13T11:29:51.775 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:51.761+0000 7f8a52215640 1 --2- 172.21.15.102:0/1410338635 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f8a30066470 0x7f8a30068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:51.775 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:51.761+0000 7f8a52215640 1 --2- 172.21.15.102:0/1410338635 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f8a30066470 0x7f8a30068930 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f8a48000f70 tx=0x7f8a48007c10 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-13T11:29:51.776 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:51.765+0000 7f8a42ffd640 1 -- 172.21.15.102:0/1410338635 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f8a3c051890 con 0x7f8a4c071900 2023-11-13T11:29:51.976 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:51.969+0000 7f8a54479640 1 -- 172.21.15.102:0/1410338635 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mgr"} v 0) v1 -- 0x7f8a4c0b1da0 con 0x7f8a4c071900 2023-11-13T11:29:51.981 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:51.973+0000 7f8a42ffd640 1 -- 172.21.15.102:0/1410338635 <== mon.0 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mgr"}]=0 v6) v1 ==== 90+0+0 (secure 0 0 0) 0x7f8a3c011340 con 0x7f8a4c071900 2023-11-13T11:29:51.984 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:51.977+0000 7f8a54479640 1 -- 172.21.15.102:0/1410338635 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f8a30066470 msgr2=0x7f8a30068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:51.984 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:51.977+0000 7f8a54479640 1 --2- 172.21.15.102:0/1410338635 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f8a30066470 0x7f8a30068930 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f8a48000f70 tx=0x7f8a48007c10 comp rx=0 tx=0).stop 2023-11-13T11:29:51.985 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:51.977+0000 7f8a54479640 1 -- 172.21.15.102:0/1410338635 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8a4c071900 msgr2=0x7f8a4c0af760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:51.985 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:51.977+0000 7f8a54479640 1 --2- 172.21.15.102:0/1410338635 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8a4c071900 0x7f8a4c0af760 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f8a3c00d800 tx=0x7f8a3c00dcc0 comp rx=0 tx=0).stop 2023-11-13T11:29:51.985 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:51.977+0000 7f8a54479640 1 -- 172.21.15.102:0/1410338635 shutdown_connections 2023-11-13T11:29:51.985 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:51.977+0000 7f8a54479640 1 --2- 172.21.15.102:0/1410338635 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8a4c140540 0x7f8a4c0afca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:51.986 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:51.977+0000 7f8a54479640 1 --2- 172.21.15.102:0/1410338635 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f8a30066470 0x7f8a30068930 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:51.986 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:51.977+0000 7f8a54479640 1 --2- 172.21.15.102:0/1410338635 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8a4c071900 0x7f8a4c0af760 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:51.986 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:51.977+0000 7f8a54479640 1 --2- 172.21.15.102:0/1410338635 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8a4c06caa0 0x7f8a4c13d0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:51.986 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:51.977+0000 7f8a54479640 1 -- 172.21.15.102:0/1410338635 >> 172.21.15.102:0/1410338635 conn(0x7f8a4c0b0870 msgr2=0x7f8a4c15d1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-13T11:29:51.986 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:51.977+0000 7f8a54479640 1 -- 172.21.15.102:0/1410338635 shutdown_connections 2023-11-13T11:29:51.987 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:51.977+0000 7f8a54479640 1 -- 172.21.15.102:0/1410338635 wait complete. 2023-11-13T11:29:52.003 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-osd 2023-11-13T11:29:52.142 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:52.133+0000 7f754511c640 1 Processor -- start 2023-11-13T11:29:52.142 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:52.133+0000 7f754511c640 1 -- start start 2023-11-13T11:29:52.143 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:52.133+0000 7f754511c640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f754006dc70 0x7f754006ba90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:52.143 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:52.137+0000 7f754511c640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f754006bfd0 0x7f754013f6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:52.143 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:52.137+0000 7f754511c640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f754013e530 con 0x7f754013df40 2023-11-13T11:29:52.143 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:52.137+0000 7f754511c640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f754015f0a0 con 0x7f754006bfd0 2023-11-13T11:29:52.143 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:52.137+0000 7f754511c640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f754006c460 con 0x7f754006dc70 2023-11-13T11:29:52.145 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:52.137+0000 7f753ed9d640 1 --1- >> v1:172.21.15.102:6789/0 conn(0x7f754013df40 0x7f754015e990 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.102:6789/0 says I am v1:172.21.15.102:39410/0 (socket says 172.21.15.102:39410) 2023-11-13T11:29:52.145 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:52.137+0000 7f753ed9d640 1 -- 172.21.15.102:0/3944642933 learned_addr learned my addr 172.21.15.102:0/3944642933 (peer_addr_for_me v1:172.21.15.102:0/0) 2023-11-13T11:29:52.145 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:52.137+0000 7f753f59e640 1 --2- 172.21.15.102:0/3944642933 >> v2:172.21.15.154:3300/0 conn(0x7f754006bfd0 0x7f754013f6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:52.145 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:52.137+0000 7f753e59c640 1 --2- 172.21.15.102:0/3944642933 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f754006dc70 0x7f754006ba90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:52.145 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:52.137+0000 7f753dd9b640 1 -- 172.21.15.102:0/3944642933 <== mon.0 v1:172.21.15.102:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1516111323 0 0) 0x7f754013e530 con 0x7f754013df40 2023-11-13T11:29:52.146 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:52.137+0000 7f753dd9b640 1 -- 172.21.15.102:0/3944642933 --> v1:172.21.15.102:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7528003530 con 0x7f754013df40 2023-11-13T11:29:52.146 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:52.137+0000 7f753e59c640 1 -- 172.21.15.102:0/3944642933 >> v2:172.21.15.154:3300/0 conn(0x7f754006bfd0 msgr2=0x7f754013f6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-13T11:29:52.146 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:52.137+0000 7f753e59c640 1 --2- 172.21.15.102:0/3944642933 >> v2:172.21.15.154:3300/0 conn(0x7f754006bfd0 0x7f754013f6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:52.146 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:52.137+0000 7f753e59c640 1 -- 172.21.15.102:0/3944642933 >> v1:172.21.15.102:6789/0 conn(0x7f754013df40 legacy=0x7f754015e990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:52.146 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:52.137+0000 7f753e59c640 1 -- 172.21.15.102:0/3944642933 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f754015f290 con 0x7f754006dc70 2023-11-13T11:29:52.147 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:52.137+0000 7f753f59e640 1 --2- 172.21.15.102:0/3944642933 >> v2:172.21.15.154:3300/0 conn(0x7f754006bfd0 0x7f754013f6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-13T11:29:52.148 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:52.137+0000 7f753e59c640 1 --2- 172.21.15.102:0/3944642933 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f754006dc70 0x7f754006ba90 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f75340097c0 tx=0x7f753401c480 comp rx=0 tx=0).ready entity=mon.2 client_cookie=301dd20d2b1c1369 server_cookie=0 in_seq=0 out_seq=0 2023-11-13T11:29:52.148 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:52.141+0000 7f753dd9b640 1 -- 172.21.15.102:0/3944642933 <== mon.2 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75340ab600 con 0x7f754006dc70 2023-11-13T11:29:52.148 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:52.141+0000 7f753dd9b640 1 -- 172.21.15.102:0/3944642933 <== mon.2 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f75340a7050 con 0x7f754006dc70 2023-11-13T11:29:52.149 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:52.141+0000 7f753dd9b640 1 -- 172.21.15.102:0/3944642933 <== mon.2 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75340ab980 con 0x7f754006dc70 2023-11-13T11:29:52.149 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:52.141+0000 7f754511c640 1 -- 172.21.15.102:0/3944642933 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f754006dc70 msgr2=0x7f754006ba90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:52.149 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:52.141+0000 7f754511c640 1 --2- 172.21.15.102:0/3944642933 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f754006dc70 0x7f754006ba90 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f75340097c0 tx=0x7f753401c480 comp rx=0 tx=0).stop 2023-11-13T11:29:52.149 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:52.141+0000 7f754511c640 1 -- 172.21.15.102:0/3944642933 shutdown_connections 2023-11-13T11:29:52.149 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:52.141+0000 7f754511c640 1 --2- 172.21.15.102:0/3944642933 >> v2:172.21.15.154:3300/0 conn(0x7f754006bfd0 0x7f754013f6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:52.150 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:52.141+0000 7f754511c640 1 --2- 172.21.15.102:0/3944642933 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f754006dc70 0x7f754006ba90 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:52.150 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:52.141+0000 7f754511c640 1 -- 172.21.15.102:0/3944642933 >> 172.21.15.102:0/3944642933 conn(0x7f75400b0870 msgr2=0x7f75400b0c80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-13T11:29:52.150 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:52.141+0000 7f754511c640 1 -- 172.21.15.102:0/3944642933 shutdown_connections 2023-11-13T11:29:52.151 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:52.141+0000 7f754511c640 1 -- 172.21.15.102:0/3944642933 wait complete. 2023-11-13T11:29:52.153 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:52.141+0000 7f754511c640 1 Processor -- start 2023-11-13T11:29:52.153 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:52.141+0000 7f754511c640 1 -- start start 2023-11-13T11:29:52.153 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:52.141+0000 7f754511c640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f754006bfd0 0x7f75401597e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:52.154 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:52.141+0000 7f754511c640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f754006dc70 0x7f754015b1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:52.154 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:52.141+0000 7f754511c640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f754013df40 0x7f754015b700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:52.154 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:52.141+0000 7f754511c640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75400b2260 con 0x7f754006bfd0 2023-11-13T11:29:52.154 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:52.141+0000 7f754511c640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75400b2540 con 0x7f754013df40 2023-11-13T11:29:52.154 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:52.141+0000 7f754511c640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f75400b2820 con 0x7f754006dc70 2023-11-13T11:29:52.155 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:52.141+0000 7f753ed9d640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f754006bfd0 0x7f75401597e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:52.155 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:52.145+0000 7f753ed9d640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f754006bfd0 0x7f75401597e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:46444/0 (socket says 172.21.15.102:46444) 2023-11-13T11:29:52.155 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:52.145+0000 7f753ed9d640 1 -- 172.21.15.102:0/2146938271 learned_addr learned my addr 172.21.15.102:0/2146938271 (peer_addr_for_me v2:172.21.15.102:0/0) 2023-11-13T11:29:52.155 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:52.145+0000 7f753e59c640 1 --2- 172.21.15.102:0/2146938271 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f754006dc70 0x7f754015b1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:52.155 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:52.145+0000 7f753f59e640 1 --2- 172.21.15.102:0/2146938271 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f754013df40 0x7f754015b700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:52.156 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:52.145+0000 7f753ed9d640 1 -- 172.21.15.102:0/2146938271 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f754006dc70 msgr2=0x7f754015b1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:52.156 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:52.145+0000 7f753ed9d640 1 --2- 172.21.15.102:0/2146938271 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f754006dc70 0x7f754015b1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:52.156 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:52.145+0000 7f753ed9d640 1 -- 172.21.15.102:0/2146938271 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f754013df40 msgr2=0x7f754015b700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:52.156 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:52.145+0000 7f753ed9d640 1 --2- 172.21.15.102:0/2146938271 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f754013df40 0x7f754015b700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:52.156 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:52.145+0000 7f753ed9d640 1 -- 172.21.15.102:0/2146938271 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7538009420 con 0x7f754006bfd0 2023-11-13T11:29:52.156 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:52.145+0000 7f753f59e640 1 --2- 172.21.15.102:0/2146938271 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f754013df40 0x7f754015b700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-13T11:29:52.157 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:52.145+0000 7f753ed9d640 1 --2- 172.21.15.102:0/2146938271 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f754006bfd0 0x7f75401597e0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f753000cbc0 tx=0x7f753000a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-13T11:29:52.157 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:52.145+0000 7f75277fe640 1 -- 172.21.15.102:0/2146938271 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f753000ad40 con 0x7f754006bfd0 2023-11-13T11:29:52.157 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:52.145+0000 7f75277fe640 1 -- 172.21.15.102:0/2146938271 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7530012400 con 0x7f754006bfd0 2023-11-13T11:29:52.157 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:52.145+0000 7f75277fe640 1 -- 172.21.15.102:0/2146938271 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f753000aea0 con 0x7f754006bfd0 2023-11-13T11:29:52.157 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:52.145+0000 7f754511c640 1 -- 172.21.15.102:0/2146938271 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7534009420 con 0x7f754006bfd0 2023-11-13T11:29:52.158 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:52.145+0000 7f754511c640 1 -- 172.21.15.102:0/2146938271 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f75400b2de0 con 0x7f754006bfd0 2023-11-13T11:29:52.158 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:52.145+0000 7f754511c640 1 -- 172.21.15.102:0/2146938271 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7540068520 con 0x7f754006bfd0 2023-11-13T11:29:52.159 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:52.145+0000 7f75277fe640 1 -- 172.21.15.102:0/2146938271 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f7530007070 con 0x7f754006bfd0 2023-11-13T11:29:52.159 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:52.145+0000 7f75277fe640 1 --2- 172.21.15.102:0/2146938271 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f752c0664a0 0x7f752c068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:52.159 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:52.145+0000 7f75277fe640 1 -- 172.21.15.102:0/2146938271 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f7530083aa0 con 0x7f754006bfd0 2023-11-13T11:29:52.160 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:52.149+0000 7f753e59c640 1 --2- 172.21.15.102:0/2146938271 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f752c0664a0 0x7f752c068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:52.160 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:52.149+0000 7f753e59c640 1 --2- 172.21.15.102:0/2146938271 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f752c0664a0 0x7f752c068960 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f75340ad000 tx=0x7f75340a6000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-13T11:29:52.160 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:52.149+0000 7f75277fe640 1 -- 172.21.15.102:0/2146938271 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f7530051310 con 0x7f754006bfd0 2023-11-13T11:29:52.361 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:52.353+0000 7f754511c640 1 -- 172.21.15.102:0/2146938271 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-osd"} v 0) v1 -- 0x7f75400b2fd0 con 0x7f754006bfd0 2023-11-13T11:29:52.364 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:52.357+0000 7f75277fe640 1 -- 172.21.15.102:0/2146938271 <== mon.0 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-osd"}]=0 v7) v1 ==== 90+0+0 (secure 0 0 0) 0x7f75300170a0 con 0x7f754006bfd0 2023-11-13T11:29:52.366 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:52.357+0000 7f754511c640 1 -- 172.21.15.102:0/2146938271 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f752c0664a0 msgr2=0x7f752c068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:52.367 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:52.357+0000 7f754511c640 1 --2- 172.21.15.102:0/2146938271 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f752c0664a0 0x7f752c068960 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f75340ad000 tx=0x7f75340a6000 comp rx=0 tx=0).stop 2023-11-13T11:29:52.367 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:52.357+0000 7f754511c640 1 -- 172.21.15.102:0/2146938271 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f754006bfd0 msgr2=0x7f75401597e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:52.367 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:52.357+0000 7f754511c640 1 --2- 172.21.15.102:0/2146938271 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f754006bfd0 0x7f75401597e0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f753000cbc0 tx=0x7f753000a430 comp rx=0 tx=0).stop 2023-11-13T11:29:52.367 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:52.357+0000 7f754511c640 1 -- 172.21.15.102:0/2146938271 shutdown_connections 2023-11-13T11:29:52.367 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:52.357+0000 7f754511c640 1 --2- 172.21.15.102:0/2146938271 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f754013df40 0x7f754015b700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:52.368 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:52.357+0000 7f754511c640 1 --2- 172.21.15.102:0/2146938271 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f754006dc70 0x7f754015b1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:52.368 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:52.357+0000 7f754511c640 1 --2- 172.21.15.102:0/2146938271 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f752c0664a0 0x7f752c068960 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:52.368 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:52.357+0000 7f754511c640 1 --2- 172.21.15.102:0/2146938271 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f754006bfd0 0x7f75401597e0 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:52.368 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:52.357+0000 7f754511c640 1 -- 172.21.15.102:0/2146938271 >> 172.21.15.102:0/2146938271 conn(0x7f75400b0870 msgr2=0x7f754013d570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-13T11:29:52.369 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:52.357+0000 7f754511c640 1 -- 172.21.15.102:0/2146938271 shutdown_connections 2023-11-13T11:29:52.369 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:52.357+0000 7f754511c640 1 -- 172.21.15.102:0/2146938271 wait complete. 2023-11-13T11:29:52.387 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd 2023-11-13T11:29:52.526 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:52.517+0000 7fb9b73aa640 1 Processor -- start 2023-11-13T11:29:52.527 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:52.517+0000 7fb9b73aa640 1 -- start start 2023-11-13T11:29:52.530 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:52.521+0000 7fb9b73aa640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7fb9b013df40 0x7fb9b015e990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:52.530 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:52.521+0000 7fb9b73aa640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fb9b006dc70 0x7fb9b006ba90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:52.532 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:52.521+0000 7fb9b73aa640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb9b013e530 con 0x7fb9b006bfd0 2023-11-13T11:29:52.532 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:52.521+0000 7fb9b73aa640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb9b006c480 con 0x7fb9b013df40 2023-11-13T11:29:52.533 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:52.521+0000 7fb9b73aa640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb9b015f290 con 0x7fb9b006dc70 2023-11-13T11:29:52.533 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:52.521+0000 7fb9b5146640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7fb9b013df40 0x7fb9b015e990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:52.534 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:52.521+0000 7fb9b5146640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7fb9b013df40 0x7fb9b015e990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:46456/0 (socket says 172.21.15.102:46456) 2023-11-13T11:29:52.535 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:52.521+0000 7fb9b5146640 1 -- 172.21.15.102:0/2829528121 learned_addr learned my addr 172.21.15.102:0/2829528121 (peer_addr_for_me v2:172.21.15.102:0/0) 2023-11-13T11:29:52.535 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:52.521+0000 7fb9b5146640 1 -- 172.21.15.102:0/2829528121 >> v2:172.21.15.154:3300/0 conn(0x7fb9b006dc70 msgr2=0x7fb9b006ba90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-13T11:29:52.536 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:52.521+0000 7fb9b4945640 1 --2- 172.21.15.102:0/2829528121 >> v2:172.21.15.154:3300/0 conn(0x7fb9b006dc70 0x7fb9b006ba90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:52.536 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:52.521+0000 7fb9b5146640 1 --2- 172.21.15.102:0/2829528121 >> v2:172.21.15.154:3300/0 conn(0x7fb9b006dc70 0x7fb9b006ba90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:52.536 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:52.521+0000 7fb9b5146640 1 -- 172.21.15.102:0/2829528121 >> v1:172.21.15.154:6789/0 conn(0x7fb9b006bfd0 legacy=0x7fb9b00cd260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-13T11:29:52.537 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:52.521+0000 7fb9b5146640 1 -- 172.21.15.102:0/2829528121 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9b015f570 con 0x7fb9b013df40 2023-11-13T11:29:52.537 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:52.521+0000 7fb9b4945640 1 --2- 172.21.15.102:0/2829528121 >> v2:172.21.15.154:3300/0 conn(0x7fb9b006dc70 0x7fb9b006ba90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-13T11:29:52.544 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:52.521+0000 7fb9b5146640 1 --2- 172.21.15.102:0/2829528121 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb9b013df40 0x7fb9b015e990 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7fb9b00b4010 tx=0x7fb9ac01c4c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c9198bb7b3e4a84f server_cookie=0 in_seq=0 out_seq=0 2023-11-13T11:29:52.545 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:52.521+0000 7fb9a7fff640 1 -- 172.21.15.102:0/2829528121 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9ac0ac410 con 0x7fb9b013df40 2023-11-13T11:29:52.545 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:52.525+0000 7fb9a7fff640 1 -- 172.21.15.102:0/2829528121 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb9ac0ac570 con 0x7fb9b013df40 2023-11-13T11:29:52.545 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:52.525+0000 7fb9a7fff640 1 -- 172.21.15.102:0/2829528121 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9ac0ac900 con 0x7fb9b013df40 2023-11-13T11:29:52.546 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:52.525+0000 7fb9b73aa640 1 -- 172.21.15.102:0/2829528121 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb9b013df40 msgr2=0x7fb9b015e990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:52.546 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:52.525+0000 7fb9b73aa640 1 --2- 172.21.15.102:0/2829528121 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb9b013df40 0x7fb9b015e990 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7fb9b00b4010 tx=0x7fb9ac01c4c0 comp rx=0 tx=0).stop 2023-11-13T11:29:52.546 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:52.525+0000 7fb9b73aa640 1 -- 172.21.15.102:0/2829528121 shutdown_connections 2023-11-13T11:29:52.547 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:52.525+0000 7fb9b73aa640 1 --2- 172.21.15.102:0/2829528121 >> v2:172.21.15.154:3300/0 conn(0x7fb9b006dc70 0x7fb9b006ba90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:52.547 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:52.525+0000 7fb9b73aa640 1 --2- 172.21.15.102:0/2829528121 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb9b013df40 0x7fb9b015e990 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:52.547 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:52.525+0000 7fb9b73aa640 1 -- 172.21.15.102:0/2829528121 >> 172.21.15.102:0/2829528121 conn(0x7fb9b00b0870 msgr2=0x7fb9b00b0c80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-13T11:29:52.548 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:52.525+0000 7fb9b73aa640 1 -- 172.21.15.102:0/2829528121 shutdown_connections 2023-11-13T11:29:52.548 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:52.525+0000 7fb9b73aa640 1 -- 172.21.15.102:0/2829528121 wait complete. 2023-11-13T11:29:52.548 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:52.525+0000 7fb9b73aa640 1 Processor -- start 2023-11-13T11:29:52.549 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:52.525+0000 7fb9b73aa640 1 -- start start 2023-11-13T11:29:52.549 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:52.525+0000 7fb9b73aa640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb9b006bfd0 0x7fb9b015a660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:52.549 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:52.525+0000 7fb9b73aa640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb9b006dc70 0x7fb9b0137a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:52.550 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:52.525+0000 7fb9b73aa640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb9b013df40 0x7fb9b015d6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:52.550 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:52.525+0000 7fb9b73aa640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9b0142510 con 0x7fb9b006dc70 2023-11-13T11:29:52.551 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:52.525+0000 7fb9b73aa640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9b0141900 con 0x7fb9b013df40 2023-11-13T11:29:52.551 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:52.525+0000 7fb9b73aa640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb9b0141be0 con 0x7fb9b006bfd0 2023-11-13T11:29:52.551 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:52.525+0000 7fb9b4945640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb9b006dc70 0x7fb9b0137a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:52.552 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:52.525+0000 7fb9b4945640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb9b006dc70 0x7fb9b0137a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:46460/0 (socket says 172.21.15.102:46460) 2023-11-13T11:29:52.552 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:52.525+0000 7fb9b4945640 1 -- 172.21.15.102:0/4283113252 learned_addr learned my addr 172.21.15.102:0/4283113252 (peer_addr_for_me v2:172.21.15.102:0/0) 2023-11-13T11:29:52.553 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:52.529+0000 7fb9b5146640 1 --2- 172.21.15.102:0/4283113252 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb9b006bfd0 0x7fb9b015a660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:52.554 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:52.529+0000 7fb9b4945640 1 -- 172.21.15.102:0/4283113252 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb9b006bfd0 msgr2=0x7fb9b015a660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:52.554 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:52.529+0000 7fb9b4945640 1 --2- 172.21.15.102:0/4283113252 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb9b006bfd0 0x7fb9b015a660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:52.555 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:52.529+0000 7fb9b4945640 1 -- 172.21.15.102:0/4283113252 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb9b013df40 msgr2=0x7fb9b015d6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:52.555 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:52.529+0000 7fb9b4945640 1 --2- 172.21.15.102:0/4283113252 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb9b013df40 0x7fb9b015d6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:52.555 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:52.529+0000 7fb9b4945640 1 -- 172.21.15.102:0/4283113252 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9ac0094d0 con 0x7fb9b006dc70 2023-11-13T11:29:52.556 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:52.529+0000 7fb9b4945640 1 --2- 172.21.15.102:0/4283113252 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb9b006dc70 0x7fb9b0137a80 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7fb9a000c7c0 tx=0x7fb9a000cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-13T11:29:52.556 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:52.529+0000 7fb9a5ffb640 1 -- 172.21.15.102:0/4283113252 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9a0007a30 con 0x7fb9b006dc70 2023-11-13T11:29:52.556 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:52.529+0000 7fb9a5ffb640 1 -- 172.21.15.102:0/4283113252 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb9a0007b90 con 0x7fb9b006dc70 2023-11-13T11:29:52.558 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:52.529+0000 7fb9a5ffb640 1 -- 172.21.15.102:0/4283113252 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9a000ce70 con 0x7fb9b006dc70 2023-11-13T11:29:52.558 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:52.529+0000 7fb9b73aa640 1 -- 172.21.15.102:0/4283113252 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb9b0141ec0 con 0x7fb9b006dc70 2023-11-13T11:29:52.559 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:52.529+0000 7fb9b73aa640 1 -- 172.21.15.102:0/4283113252 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb9b015aba0 con 0x7fb9b006dc70 2023-11-13T11:29:52.559 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:52.529+0000 7fb9b73aa640 1 -- 172.21.15.102:0/4283113252 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb9b01426c0 con 0x7fb9b006dc70 2023-11-13T11:29:52.559 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:52.529+0000 7fb9a5ffb640 1 -- 172.21.15.102:0/4283113252 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fb9a00113f0 con 0x7fb9b006dc70 2023-11-13T11:29:52.560 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:52.529+0000 7fb9a5ffb640 1 --2- 172.21.15.102:0/4283113252 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7fb994066470 0x7fb994068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:52.560 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:52.529+0000 7fb9a5ffb640 1 -- 172.21.15.102:0/4283113252 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fb9a0083fa0 con 0x7fb9b006dc70 2023-11-13T11:29:52.561 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:52.529+0000 7fb9b5146640 1 --2- 172.21.15.102:0/4283113252 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7fb994066470 0x7fb994068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:52.561 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:52.533+0000 7fb9b5146640 1 --2- 172.21.15.102:0/4283113252 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7fb994066470 0x7fb994068930 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fb9ac0ae000 tx=0x7fb9ac0a6040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-13T11:29:52.561 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:52.533+0000 7fb9a5ffb640 1 -- 172.21.15.102:0/4283113252 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fb9a00b5280 con 0x7fb9b006dc70 2023-11-13T11:29:52.743 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:52.733+0000 7fb9b73aa640 1 -- 172.21.15.102:0/4283113252 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd"} v 0) v1 -- 0x7fb9b0068520 con 0x7fb9b006dc70 2023-11-13T11:29:52.748 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:52.741+0000 7fb9a5ffb640 1 -- 172.21.15.102:0/4283113252 <== mon.0 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd"}]=0 v8) v1 ==== 90+0+0 (secure 0 0 0) 0x7fb9b01426c0 con 0x7fb9b006dc70 2023-11-13T11:29:52.750 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:52.741+0000 7fb9b73aa640 1 -- 172.21.15.102:0/4283113252 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7fb994066470 msgr2=0x7fb994068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:52.750 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:52.741+0000 7fb9b73aa640 1 --2- 172.21.15.102:0/4283113252 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7fb994066470 0x7fb994068930 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fb9ac0ae000 tx=0x7fb9ac0a6040 comp rx=0 tx=0).stop 2023-11-13T11:29:52.751 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:52.741+0000 7fb9b73aa640 1 -- 172.21.15.102:0/4283113252 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb9b006dc70 msgr2=0x7fb9b0137a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:52.751 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:52.741+0000 7fb9b73aa640 1 --2- 172.21.15.102:0/4283113252 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb9b006dc70 0x7fb9b0137a80 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7fb9a000c7c0 tx=0x7fb9a000cc80 comp rx=0 tx=0).stop 2023-11-13T11:29:52.751 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:52.741+0000 7fb9b73aa640 1 -- 172.21.15.102:0/4283113252 shutdown_connections 2023-11-13T11:29:52.752 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:52.741+0000 7fb9b73aa640 1 --2- 172.21.15.102:0/4283113252 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb9b013df40 0x7fb9b015d6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:52.752 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:52.741+0000 7fb9b73aa640 1 --2- 172.21.15.102:0/4283113252 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7fb994066470 0x7fb994068930 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:52.752 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:52.741+0000 7fb9b73aa640 1 --2- 172.21.15.102:0/4283113252 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb9b006dc70 0x7fb9b0137a80 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:52.753 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:52.741+0000 7fb9b73aa640 1 --2- 172.21.15.102:0/4283113252 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb9b006bfd0 0x7fb9b015a660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:52.753 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:52.741+0000 7fb9b73aa640 1 -- 172.21.15.102:0/4283113252 >> 172.21.15.102:0/4283113252 conn(0x7fb9b00b0870 msgr2=0x7fb9b006c880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-13T11:29:52.753 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:52.741+0000 7fb9b73aa640 1 -- 172.21.15.102:0/4283113252 shutdown_connections 2023-11-13T11:29:52.753 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:52.741+0000 7fb9b73aa640 1 -- 172.21.15.102:0/4283113252 wait complete. 2023-11-13T11:29:52.769 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd-mirror 2023-11-13T11:29:52.912 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:52.905+0000 7ff61f59e640 1 Processor -- start 2023-11-13T11:29:52.913 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:52.905+0000 7ff61f59e640 1 -- start start 2023-11-13T11:29:52.914 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:52.905+0000 7ff61f59e640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff62015ce00 0x7ff6200cf340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:52.914 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:52.905+0000 7ff61f59e640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff6200cfcb0 con 0x7ff6200d0940 2023-11-13T11:29:52.914 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:52.905+0000 7ff61f59e640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff6200cff90 con 0x7ff6200d1980 2023-11-13T11:29:52.914 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:52.905+0000 7ff61f59e640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff6200d0270 con 0x7ff62015ce00 2023-11-13T11:29:52.915 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:52.905+0000 7ff615d9b640 1 --1- >> v1:172.21.15.102:6789/0 conn(0x7ff6200d0940 0x7ff6200d1270 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.102:6789/0 says I am v1:172.21.15.102:39416/0 (socket says 172.21.15.102:39416) 2023-11-13T11:29:52.915 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:52.905+0000 7ff615d9b640 1 -- 172.21.15.102:0/1338767268 learned_addr learned my addr 172.21.15.102:0/1338767268 (peer_addr_for_me v1:172.21.15.102:0/0) 2023-11-13T11:29:52.915 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:52.905+0000 7ff61e59c640 1 --2- 172.21.15.102:0/1338767268 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff62015ce00 0x7ff6200cf340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:52.916 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:52.905+0000 7ff61dd9b640 1 -- 172.21.15.102:0/1338767268 <== mon.0 v1:172.21.15.102:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3150748589 0 0) 0x7ff6200cfcb0 con 0x7ff6200d0940 2023-11-13T11:29:52.916 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:52.905+0000 7ff61dd9b640 1 -- 172.21.15.102:0/1338767268 --> v1:172.21.15.102:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff60c003530 con 0x7ff6200d0940 2023-11-13T11:29:52.916 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:52.905+0000 7ff61dd9b640 1 -- 172.21.15.102:0/1338767268 <== mon.1 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1879560546 0 0) 0x7ff6200cff90 con 0x7ff6200d1980 2023-11-13T11:29:52.917 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:52.905+0000 7ff61dd9b640 1 -- 172.21.15.102:0/1338767268 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff6200cfcb0 con 0x7ff6200d1980 2023-11-13T11:29:52.917 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:52.905+0000 7ff61e59c640 1 -- 172.21.15.102:0/1338767268 >> v1:172.21.15.154:6789/0 conn(0x7ff6200d1980 legacy=0x7ff6200b2860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:52.917 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:52.905+0000 7ff61dd9b640 1 -- 172.21.15.102:0/1338767268 <== mon.0 v1:172.21.15.102:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2864094915 0 0) 0x7ff60c003530 con 0x7ff6200d0940 2023-11-13T11:29:52.918 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:52.905+0000 7ff61e59c640 1 -- 172.21.15.102:0/1338767268 >> v1:172.21.15.102:6789/0 conn(0x7ff6200d0940 legacy=0x7ff6200d1270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:52.919 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:52.905+0000 7ff61e59c640 1 -- 172.21.15.102:0/1338767268 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6200d0550 con 0x7ff62015ce00 2023-11-13T11:29:52.920 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:52.909+0000 7ff61e59c640 1 --2- 172.21.15.102:0/1338767268 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff62015ce00 0x7ff6200cf340 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7ff6100097f0 tx=0x7ff61001ce10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4ec24da531e73814 server_cookie=0 in_seq=0 out_seq=0 2023-11-13T11:29:52.920 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:52.909+0000 7ff61dd9b640 1 -- 172.21.15.102:0/1338767268 <== mon.2 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff608001a00 con 0x7ff62015ce00 2023-11-13T11:29:52.921 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:52.909+0000 7ff61dd9b640 1 -- 172.21.15.102:0/1338767268 <== mon.2 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff6100a7050 con 0x7ff62015ce00 2023-11-13T11:29:52.921 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:52.909+0000 7ff61dd9b640 1 -- 172.21.15.102:0/1338767268 <== mon.2 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff610004250 con 0x7ff62015ce00 2023-11-13T11:29:52.921 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:52.909+0000 7ff61f59e640 1 -- 172.21.15.102:0/1338767268 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff62015ce00 msgr2=0x7ff6200cf340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:52.922 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:52.909+0000 7ff61f59e640 1 --2- 172.21.15.102:0/1338767268 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff62015ce00 0x7ff6200cf340 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7ff6100097f0 tx=0x7ff61001ce10 comp rx=0 tx=0).stop 2023-11-13T11:29:52.922 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:52.909+0000 7ff61f59e640 1 -- 172.21.15.102:0/1338767268 shutdown_connections 2023-11-13T11:29:52.922 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:52.909+0000 7ff61f59e640 1 --2- 172.21.15.102:0/1338767268 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff62015ce00 0x7ff6200cf340 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:52.922 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:52.909+0000 7ff61f59e640 1 -- 172.21.15.102:0/1338767268 >> 172.21.15.102:0/1338767268 conn(0x7ff62009bf60 msgr2=0x7ff6200d2c90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-13T11:29:52.923 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:52.909+0000 7ff61f59e640 1 -- 172.21.15.102:0/1338767268 shutdown_connections 2023-11-13T11:29:52.923 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:52.909+0000 7ff61f59e640 1 -- 172.21.15.102:0/1338767268 wait complete. 2023-11-13T11:29:52.925 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:52.913+0000 7ff61f59e640 1 Processor -- start 2023-11-13T11:29:52.925 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:52.913+0000 7ff61f59e640 1 -- start start 2023-11-13T11:29:52.926 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:52.913+0000 7ff61f59e640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff6200d0940 0x7ff6200b8130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:52.926 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:52.913+0000 7ff61f59e640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff6200d1980 0x7ff620152850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:52.926 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:52.913+0000 7ff61f59e640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff62015ce00 0x7ff620151990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:52.926 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:52.913+0000 7ff61f59e640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff620156040 con 0x7ff6200d0940 2023-11-13T11:29:52.927 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:52.913+0000 7ff61f59e640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff620158d60 con 0x7ff62015ce00 2023-11-13T11:29:52.927 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:52.913+0000 7ff61f59e640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff6201587a0 con 0x7ff6200d1980 2023-11-13T11:29:52.927 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:52.913+0000 7ff61e59c640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff6200d0940 0x7ff6200b8130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:52.927 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:52.913+0000 7ff61e59c640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff6200d0940 0x7ff6200b8130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:46474/0 (socket says 172.21.15.102:46474) 2023-11-13T11:29:52.927 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:52.913+0000 7ff61e59c640 1 -- 172.21.15.102:0/1972868787 learned_addr learned my addr 172.21.15.102:0/1972868787 (peer_addr_for_me v2:172.21.15.102:0/0) 2023-11-13T11:29:52.927 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:52.913+0000 7ff615d9b640 1 --2- 172.21.15.102:0/1972868787 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff6200d1980 0x7ff620152850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:52.928 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:52.913+0000 7ff61ed9d640 1 --2- 172.21.15.102:0/1972868787 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff62015ce00 0x7ff620151990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:52.928 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:52.913+0000 7ff61e59c640 1 -- 172.21.15.102:0/1972868787 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff6200d1980 msgr2=0x7ff620152850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:52.928 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:52.913+0000 7ff61e59c640 1 --2- 172.21.15.102:0/1972868787 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff6200d1980 0x7ff620152850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:52.928 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:52.913+0000 7ff61e59c640 1 -- 172.21.15.102:0/1972868787 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff62015ce00 msgr2=0x7ff620151990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:52.929 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:52.913+0000 7ff61e59c640 1 --2- 172.21.15.102:0/1972868787 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff62015ce00 0x7ff620151990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:52.929 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:52.913+0000 7ff61e59c640 1 -- 172.21.15.102:0/1972868787 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff610009420 con 0x7ff6200d0940 2023-11-13T11:29:52.929 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:52.913+0000 7ff615d9b640 1 --2- 172.21.15.102:0/1972868787 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff6200d1980 0x7ff620152850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-13T11:29:52.929 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:52.913+0000 7ff61ed9d640 1 --2- 172.21.15.102:0/1972868787 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff62015ce00 0x7ff620151990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-13T11:29:52.929 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:52.913+0000 7ff61e59c640 1 --2- 172.21.15.102:0/1972868787 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff6200d0940 0x7ff6200b8130 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7ff6100ae040 tx=0x7ff610019150 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-13T11:29:52.930 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:52.917+0000 7ff6177fe640 1 -- 172.21.15.102:0/1972868787 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff610003af0 con 0x7ff6200d0940 2023-11-13T11:29:52.930 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:52.917+0000 7ff6177fe640 1 -- 172.21.15.102:0/1972868787 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff610003c50 con 0x7ff6200d0940 2023-11-13T11:29:52.930 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:52.917+0000 7ff61f59e640 1 -- 172.21.15.102:0/1972868787 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff620158a80 con 0x7ff6200d0940 2023-11-13T11:29:52.930 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:52.917+0000 7ff6177fe640 1 -- 172.21.15.102:0/1972868787 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6100ab440 con 0x7ff6200d0940 2023-11-13T11:29:52.930 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:52.917+0000 7ff61f59e640 1 -- 172.21.15.102:0/1972868787 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff6200b8670 con 0x7ff6200d0940 2023-11-13T11:29:52.931 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:52.917+0000 7ff61f59e640 1 -- 172.21.15.102:0/1972868787 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff620067680 con 0x7ff6200d0940 2023-11-13T11:29:52.931 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:52.917+0000 7ff6177fe640 1 -- 172.21.15.102:0/1972868787 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7ff6100b2040 con 0x7ff6200d0940 2023-11-13T11:29:52.932 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:52.917+0000 7ff6177fe640 1 --2- 172.21.15.102:0/1972868787 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7ff600066470 0x7ff600068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:52.932 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:52.917+0000 7ff6177fe640 1 -- 172.21.15.102:0/1972868787 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 4857+0+0 (secure 0 0 0) 0x7ff61011d9d0 con 0x7ff6200d0940 2023-11-13T11:29:52.933 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:52.917+0000 7ff615d9b640 1 --2- 172.21.15.102:0/1972868787 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7ff600066470 0x7ff600068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:52.933 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:52.917+0000 7ff615d9b640 1 --2- 172.21.15.102:0/1972868787 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7ff600066470 0x7ff600068930 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7ff608001570 tx=0x7ff608009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-13T11:29:52.933 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:52.921+0000 7ff6177fe640 1 -- 172.21.15.102:0/1972868787 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7ff6100eb190 con 0x7ff6200d0940 2023-11-13T11:29:53.136 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:53.129+0000 7ff61f59e640 1 -- 172.21.15.102:0/1972868787 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"} v 0) v1 -- 0x7ff6200d10c0 con 0x7ff6200d0940 2023-11-13T11:29:53.140 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:53.133+0000 7ff6177fe640 1 -- 172.21.15.102:0/1972868787 <== mon.0 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"}]=0 v9) v1 ==== 97+0+0 (secure 0 0 0) 0x7ff6100b00a0 con 0x7ff6200d0940 2023-11-13T11:29:53.142 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:53.133+0000 7ff61f59e640 1 -- 172.21.15.102:0/1972868787 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7ff600066470 msgr2=0x7ff600068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:53.143 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:53.133+0000 7ff61f59e640 1 --2- 172.21.15.102:0/1972868787 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7ff600066470 0x7ff600068930 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7ff608001570 tx=0x7ff608009040 comp rx=0 tx=0).stop 2023-11-13T11:29:53.143 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:53.133+0000 7ff61f59e640 1 -- 172.21.15.102:0/1972868787 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff6200d0940 msgr2=0x7ff6200b8130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:53.143 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:53.133+0000 7ff61f59e640 1 --2- 172.21.15.102:0/1972868787 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff6200d0940 0x7ff6200b8130 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7ff6100ae040 tx=0x7ff610019150 comp rx=0 tx=0).stop 2023-11-13T11:29:53.143 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:53.133+0000 7ff61f59e640 1 -- 172.21.15.102:0/1972868787 shutdown_connections 2023-11-13T11:29:53.144 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:53.133+0000 7ff61f59e640 1 --2- 172.21.15.102:0/1972868787 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff62015ce00 0x7ff620151990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:53.144 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:53.133+0000 7ff61f59e640 1 --2- 172.21.15.102:0/1972868787 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff6200d1980 0x7ff620152850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:53.145 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:53.133+0000 7ff61f59e640 1 --2- 172.21.15.102:0/1972868787 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7ff600066470 0x7ff600068930 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:53.145 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:53.133+0000 7ff61f59e640 1 --2- 172.21.15.102:0/1972868787 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff6200d0940 0x7ff6200b8130 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:53.145 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:53.133+0000 7ff61f59e640 1 -- 172.21.15.102:0/1972868787 >> 172.21.15.102:0/1972868787 conn(0x7ff62009bf60 msgr2=0x7ff6200afb50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-13T11:29:53.145 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:53.133+0000 7ff61f59e640 1 -- 172.21.15.102:0/1972868787 shutdown_connections 2023-11-13T11:29:53.146 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:53.133+0000 7ff61f59e640 1 -- 172.21.15.102:0/1972868787 wait complete. 2023-11-13T11:29:53.161 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rgw 2023-11-13T11:29:53.302 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:53.293+0000 7f54ceb65640 1 Processor -- start 2023-11-13T11:29:53.302 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:53.293+0000 7f54ceb65640 1 -- start start 2023-11-13T11:29:53.303 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:53.297+0000 7f54ceb65640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f54c806c1a0 0x7f54c81406e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:53.303 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:53.297+0000 7f54ceb65640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f54c813e530 con 0x7f54c813df40 2023-11-13T11:29:53.304 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:53.297+0000 7f54ceb65640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f54c815f290 con 0x7f54c806dc70 2023-11-13T11:29:53.304 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:53.297+0000 7f54ceb65640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f54c815f0a0 con 0x7f54c806c1a0 2023-11-13T11:29:53.304 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:53.297+0000 7f54cc901640 1 --1- >> v1:172.21.15.102:6789/0 conn(0x7f54c813df40 0x7f54c815e990 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.102:6789/0 says I am v1:172.21.15.102:39424/0 (socket says 172.21.15.102:39424) 2023-11-13T11:29:53.304 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:53.297+0000 7f54cc901640 1 -- 172.21.15.102:0/1649548041 learned_addr learned my addr 172.21.15.102:0/1649548041 (peer_addr_for_me v1:172.21.15.102:0/0) 2023-11-13T11:29:53.304 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:53.297+0000 7f54cd102640 1 --2- 172.21.15.102:0/1649548041 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f54c806c1a0 0x7f54c81406e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:53.305 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:53.297+0000 7f54bf7fe640 1 -- 172.21.15.102:0/1649548041 <== mon.0 v1:172.21.15.102:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 775225180 0 0) 0x7f54c813e530 con 0x7f54c813df40 2023-11-13T11:29:53.305 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:53.297+0000 7f54bf7fe640 1 -- 172.21.15.102:0/1649548041 --> v1:172.21.15.102:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f54b0003530 con 0x7f54c813df40 2023-11-13T11:29:53.306 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:53.297+0000 7f54bf7fe640 1 -- 172.21.15.102:0/1649548041 <== mon.1 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2477104122 0 0) 0x7f54c815f290 con 0x7f54c806dc70 2023-11-13T11:29:53.306 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:53.297+0000 7f54bf7fe640 1 -- 172.21.15.102:0/1649548041 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f54c813e530 con 0x7f54c806dc70 2023-11-13T11:29:53.306 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:53.297+0000 7f54cd102640 1 -- 172.21.15.102:0/1649548041 >> v1:172.21.15.154:6789/0 conn(0x7f54c806dc70 legacy=0x7f54c806ba90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:53.306 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:53.297+0000 7f54cd102640 1 -- 172.21.15.102:0/1649548041 >> v1:172.21.15.102:6789/0 conn(0x7f54c813df40 legacy=0x7f54c815e990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:53.307 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:53.297+0000 7f54cd102640 1 -- 172.21.15.102:0/1649548041 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54c815f570 con 0x7f54c806c1a0 2023-11-13T11:29:53.307 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:53.301+0000 7f54cd102640 1 --2- 172.21.15.102:0/1649548041 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f54c806c1a0 0x7f54c81406e0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f54c0009dc0 tx=0x7f54c001c970 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d371dcd662ef02e2 server_cookie=0 in_seq=0 out_seq=0 2023-11-13T11:29:53.308 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:53.301+0000 7f54bf7fe640 1 -- 172.21.15.102:0/1649548041 <== mon.2 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54c00a5920 con 0x7f54c806c1a0 2023-11-13T11:29:53.308 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:53.301+0000 7f54bf7fe640 1 -- 172.21.15.102:0/1649548041 <== mon.2 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f54c00a5a80 con 0x7f54c806c1a0 2023-11-13T11:29:53.308 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:53.301+0000 7f54bf7fe640 1 -- 172.21.15.102:0/1649548041 <== mon.2 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54c00a5e10 con 0x7f54c806c1a0 2023-11-13T11:29:53.308 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:53.301+0000 7f54ceb65640 1 -- 172.21.15.102:0/1649548041 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f54c806c1a0 msgr2=0x7f54c81406e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:53.308 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:53.301+0000 7f54ceb65640 1 --2- 172.21.15.102:0/1649548041 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f54c806c1a0 0x7f54c81406e0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f54c0009dc0 tx=0x7f54c001c970 comp rx=0 tx=0).stop 2023-11-13T11:29:53.309 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:53.301+0000 7f54ceb65640 1 -- 172.21.15.102:0/1649548041 shutdown_connections 2023-11-13T11:29:53.310 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:53.301+0000 7f54ceb65640 1 --2- 172.21.15.102:0/1649548041 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f54c806c1a0 0x7f54c81406e0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:53.310 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:53.301+0000 7f54ceb65640 1 -- 172.21.15.102:0/1649548041 >> 172.21.15.102:0/1649548041 conn(0x7f54c80b0870 msgr2=0x7f54c80b0c80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-13T11:29:53.310 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:53.301+0000 7f54ceb65640 1 -- 172.21.15.102:0/1649548041 shutdown_connections 2023-11-13T11:29:53.310 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:53.301+0000 7f54ceb65640 1 -- 172.21.15.102:0/1649548041 wait complete. 2023-11-13T11:29:53.311 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:53.301+0000 7f54ceb65640 1 Processor -- start 2023-11-13T11:29:53.311 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:53.301+0000 7f54ceb65640 1 -- start start 2023-11-13T11:29:53.312 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:53.301+0000 7f54ceb65640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f54c806c1a0 0x7f54c80acb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:53.313 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:53.301+0000 7f54ceb65640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f54c806dc70 0x7f54c81595b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:53.313 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:53.301+0000 7f54ceb65640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f54c813df40 0x7f54c8159af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:53.313 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:53.301+0000 7f54ceb65640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54c8140880 con 0x7f54c806dc70 2023-11-13T11:29:53.313 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:53.301+0000 7f54ceb65640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54c815a030 con 0x7f54c806c1a0 2023-11-13T11:29:53.314 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:53.301+0000 7f54ceb65640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f54c80b3cf0 con 0x7f54c813df40 2023-11-13T11:29:53.314 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:53.305+0000 7f54bffff640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f54c806dc70 0x7f54c81595b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:53.314 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:53.305+0000 7f54bffff640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f54c806dc70 0x7f54c81595b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:46476/0 (socket says 172.21.15.102:46476) 2023-11-13T11:29:53.315 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:53.305+0000 7f54bffff640 1 -- 172.21.15.102:0/1565891204 learned_addr learned my addr 172.21.15.102:0/1565891204 (peer_addr_for_me v2:172.21.15.102:0/0) 2023-11-13T11:29:53.315 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:53.305+0000 7f54cd102640 1 --2- 172.21.15.102:0/1565891204 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f54c813df40 0x7f54c8159af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:53.315 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:53.305+0000 7f54cc901640 1 --2- 172.21.15.102:0/1565891204 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f54c806c1a0 0x7f54c80acb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:53.315 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:53.305+0000 7f54bffff640 1 -- 172.21.15.102:0/1565891204 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f54c813df40 msgr2=0x7f54c8159af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:53.315 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:53.305+0000 7f54bffff640 1 --2- 172.21.15.102:0/1565891204 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f54c813df40 0x7f54c8159af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:53.316 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:53.305+0000 7f54bffff640 1 -- 172.21.15.102:0/1565891204 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f54c806c1a0 msgr2=0x7f54c80acb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:53.316 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:53.305+0000 7f54bffff640 1 --2- 172.21.15.102:0/1565891204 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f54c806c1a0 0x7f54c80acb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:53.316 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:53.305+0000 7f54bffff640 1 -- 172.21.15.102:0/1565891204 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54c0009a70 con 0x7f54c806dc70 2023-11-13T11:29:53.316 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:53.305+0000 7f54cc901640 1 --2- 172.21.15.102:0/1565891204 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f54c806c1a0 0x7f54c80acb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-13T11:29:53.317 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:53.305+0000 7f54bffff640 1 --2- 172.21.15.102:0/1565891204 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f54c806dc70 0x7f54c81595b0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f54b800c490 tx=0x7f54b800c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-13T11:29:53.317 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:53.305+0000 7f54bd7fa640 1 -- 172.21.15.102:0/1565891204 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54b80052d0 con 0x7f54c806dc70 2023-11-13T11:29:53.317 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:53.305+0000 7f54bd7fa640 1 -- 172.21.15.102:0/1565891204 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f54b8005430 con 0x7f54c806dc70 2023-11-13T11:29:53.317 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:53.305+0000 7f54bd7fa640 1 -- 172.21.15.102:0/1565891204 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54b8012870 con 0x7f54c806dc70 2023-11-13T11:29:53.317 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:53.305+0000 7f54ceb65640 1 -- 172.21.15.102:0/1565891204 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f54c813ee00 con 0x7f54c806dc70 2023-11-13T11:29:53.318 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:53.305+0000 7f54ceb65640 1 -- 172.21.15.102:0/1565891204 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f54c813e840 con 0x7f54c806dc70 2023-11-13T11:29:53.319 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:53.305+0000 7f54ceb65640 1 -- 172.21.15.102:0/1565891204 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f54c81409c0 con 0x7f54c806dc70 2023-11-13T11:29:53.319 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:53.305+0000 7f54bd7fa640 1 -- 172.21.15.102:0/1565891204 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f54b80129d0 con 0x7f54c806dc70 2023-11-13T11:29:53.319 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:53.305+0000 7f54bd7fa640 1 --2- 172.21.15.102:0/1565891204 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f54b4066470 0x7f54b4068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:53.320 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:53.309+0000 7f54bd7fa640 1 -- 172.21.15.102:0/1565891204 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f54b80835e0 con 0x7f54c806dc70 2023-11-13T11:29:53.320 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:53.309+0000 7f54cc901640 1 --2- 172.21.15.102:0/1565891204 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f54b4066470 0x7f54b4068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:53.320 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:53.309+0000 7f54cc901640 1 --2- 172.21.15.102:0/1565891204 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f54b4066470 0x7f54b4068930 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f54c40011f0 tx=0x7f54c4009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-13T11:29:53.320 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:53.313+0000 7f54bd7fa640 1 -- 172.21.15.102:0/1565891204 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f54c81409c0 con 0x7f54c806dc70 2023-11-13T11:29:53.524 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:53.517+0000 7f54ceb65640 1 -- 172.21.15.102:0/1565891204 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rgw"} v 0) v1 -- 0x7f54c81409c0 con 0x7f54c806dc70 2023-11-13T11:29:53.529 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:53.521+0000 7f54bd7fa640 1 -- 172.21.15.102:0/1565891204 <== mon.0 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rgw"}]=0 v10) v1 ==== 90+0+0 (secure 0 0 0) 0x7f54c81409c0 con 0x7f54c806dc70 2023-11-13T11:29:53.531 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:53.521+0000 7f54ceb65640 1 -- 172.21.15.102:0/1565891204 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f54b4066470 msgr2=0x7f54b4068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:53.531 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:53.521+0000 7f54ceb65640 1 --2- 172.21.15.102:0/1565891204 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f54b4066470 0x7f54b4068930 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f54c40011f0 tx=0x7f54c4009040 comp rx=0 tx=0).stop 2023-11-13T11:29:53.532 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:53.521+0000 7f54ceb65640 1 -- 172.21.15.102:0/1565891204 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f54c806dc70 msgr2=0x7f54c81595b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:53.532 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:53.521+0000 7f54ceb65640 1 --2- 172.21.15.102:0/1565891204 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f54c806dc70 0x7f54c81595b0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f54b800c490 tx=0x7f54b800c950 comp rx=0 tx=0).stop 2023-11-13T11:29:53.532 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:53.525+0000 7f54ceb65640 1 -- 172.21.15.102:0/1565891204 shutdown_connections 2023-11-13T11:29:53.532 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:53.525+0000 7f54ceb65640 1 --2- 172.21.15.102:0/1565891204 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f54c813df40 0x7f54c8159af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:53.532 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:53.525+0000 7f54ceb65640 1 --2- 172.21.15.102:0/1565891204 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f54b4066470 0x7f54b4068930 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:53.533 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:53.525+0000 7f54ceb65640 1 --2- 172.21.15.102:0/1565891204 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f54c806dc70 0x7f54c81595b0 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:53.533 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:53.525+0000 7f54ceb65640 1 --2- 172.21.15.102:0/1565891204 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f54c806c1a0 0x7f54c80acb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:53.533 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:53.525+0000 7f54ceb65640 1 -- 172.21.15.102:0/1565891204 >> 172.21.15.102:0/1565891204 conn(0x7f54c80b0870 msgr2=0x7f54c806ba90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-13T11:29:53.533 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:53.525+0000 7f54ceb65640 1 -- 172.21.15.102:0/1565891204 shutdown_connections 2023-11-13T11:29:53.533 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:53.525+0000 7f54ceb65640 1 -- 172.21.15.102:0/1565891204 wait complete. 2023-11-13T11:29:53.551 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-13T11:29:53.690 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:53.681+0000 7f28631df640 1 Processor -- start 2023-11-13T11:29:53.690 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:53.681+0000 7f28631df640 1 -- start start 2023-11-13T11:29:53.692 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:53.685+0000 7f28631df640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f285c143520 0x7f285c15b280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:53.692 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:53.685+0000 7f28631df640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f285c06ce40 0x7f285c06d2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:53.692 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:53.685+0000 7f28631df640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f285c0b26f0 0x7f285c0b2b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:53.692 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:53.685+0000 7f28631df640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f285c06d810 con 0x7f285c0b26f0 2023-11-13T11:29:53.693 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:53.685+0000 7f28631df640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f285c0b3460 con 0x7f285c143520 2023-11-13T11:29:53.693 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:53.685+0000 7f28631df640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f285c143900 con 0x7f285c06ce40 2023-11-13T11:29:53.693 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:53.685+0000 7f286177c640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f285c0b26f0 0x7f285c0b2b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:53.693 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:53.685+0000 7f286177c640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f285c0b26f0 0x7f285c0b2b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:46478/0 (socket says 172.21.15.102:46478) 2023-11-13T11:29:53.693 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:53.685+0000 7f286177c640 1 -- 172.21.15.102:0/2439849831 learned_addr learned my addr 172.21.15.102:0/2439849831 (peer_addr_for_me v2:172.21.15.102:0/0) 2023-11-13T11:29:53.694 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:53.685+0000 7f2860f7b640 1 --2- 172.21.15.102:0/2439849831 >> v2:172.21.15.154:3300/0 conn(0x7f285c143520 0x7f285c15b280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:53.694 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:53.685+0000 7f2853fff640 1 --2- 172.21.15.102:0/2439849831 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f285c06ce40 0x7f285c06d2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:53.694 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:53.685+0000 7f286177c640 1 -- 172.21.15.102:0/2439849831 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f285c06ce40 msgr2=0x7f285c06d2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-13T11:29:53.694 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:53.685+0000 7f286177c640 1 --2- 172.21.15.102:0/2439849831 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f285c06ce40 0x7f285c06d2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:53.694 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:53.685+0000 7f286177c640 1 -- 172.21.15.102:0/2439849831 >> v2:172.21.15.154:3300/0 conn(0x7f285c143520 msgr2=0x7f285c15b280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-13T11:29:53.695 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:53.685+0000 7f286177c640 1 --2- 172.21.15.102:0/2439849831 >> v2:172.21.15.154:3300/0 conn(0x7f285c143520 0x7f285c15b280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:53.695 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:53.685+0000 7f286177c640 1 -- 172.21.15.102:0/2439849831 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f285c15b7c0 con 0x7f285c0b26f0 2023-11-13T11:29:53.695 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:53.685+0000 7f2860f7b640 1 --2- 172.21.15.102:0/2439849831 >> v2:172.21.15.154:3300/0 conn(0x7f285c143520 0x7f285c15b280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-13T11:29:53.697 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:53.685+0000 7f286177c640 1 --2- 172.21.15.102:0/2439849831 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f285c0b26f0 0x7f285c0b2b60 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f285c06dfb0 tx=0x7f285401c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a8419a6ab4fddc10 server_cookie=0 in_seq=0 out_seq=0 2023-11-13T11:29:53.697 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:53.685+0000 7f28537fe640 1 -- 172.21.15.102:0/2439849831 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28540a5790 con 0x7f285c0b26f0 2023-11-13T11:29:53.697 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:53.689+0000 7f28537fe640 1 -- 172.21.15.102:0/2439849831 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f28540a58f0 con 0x7f285c0b26f0 2023-11-13T11:29:53.697 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:53.689+0000 7f28537fe640 1 -- 172.21.15.102:0/2439849831 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28540a5c80 con 0x7f285c0b26f0 2023-11-13T11:29:53.697 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:53.689+0000 7f28631df640 1 -- 172.21.15.102:0/2439849831 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f285c0b26f0 msgr2=0x7f285c0b2b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:53.698 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:53.689+0000 7f28631df640 1 --2- 172.21.15.102:0/2439849831 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f285c0b26f0 0x7f285c0b2b60 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f285c06dfb0 tx=0x7f285401c910 comp rx=0 tx=0).stop 2023-11-13T11:29:53.698 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:53.689+0000 7f28631df640 1 -- 172.21.15.102:0/2439849831 shutdown_connections 2023-11-13T11:29:53.699 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:53.689+0000 7f28631df640 1 --2- 172.21.15.102:0/2439849831 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f285c0b26f0 0x7f285c0b2b60 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:53.699 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:53.689+0000 7f28631df640 1 --2- 172.21.15.102:0/2439849831 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f285c06ce40 0x7f285c06d2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:53.699 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:53.689+0000 7f28631df640 1 --2- 172.21.15.102:0/2439849831 >> v2:172.21.15.154:3300/0 conn(0x7f285c143520 0x7f285c15b280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:53.699 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:53.689+0000 7f28631df640 1 -- 172.21.15.102:0/2439849831 >> 172.21.15.102:0/2439849831 conn(0x7f285c06a240 msgr2=0x7f285c06a650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-13T11:29:53.700 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:53.689+0000 7f28631df640 1 -- 172.21.15.102:0/2439849831 shutdown_connections 2023-11-13T11:29:53.700 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:53.689+0000 7f28631df640 1 -- 172.21.15.102:0/2439849831 wait complete. 2023-11-13T11:29:53.702 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:53.689+0000 7f28631df640 1 Processor -- start 2023-11-13T11:29:53.702 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:53.689+0000 7f28631df640 1 -- start start 2023-11-13T11:29:53.702 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:53.689+0000 7f28631df640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f285c06ce40 0x7f285c0ae570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:53.703 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:53.689+0000 7f28631df640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f285c0b26f0 0x7f285c13d790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:53.703 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:53.689+0000 7f28631df640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f285c143520 0x7f285c139340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:53.703 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:53.689+0000 7f28631df640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f285c140250 con 0x7f285c0b26f0 2023-11-13T11:29:53.703 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:53.689+0000 7f28631df640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f285c0af760 con 0x7f285c06ce40 2023-11-13T11:29:53.703 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:53.689+0000 7f28631df640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f285c13dcd0 con 0x7f285c143520 2023-11-13T11:29:53.704 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:53.689+0000 7f2853fff640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f285c0b26f0 0x7f285c13d790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:53.704 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:53.689+0000 7f2860f7b640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f285c06ce40 0x7f285c0ae570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:53.704 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:53.689+0000 7f2853fff640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f285c0b26f0 0x7f285c13d790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:46492/0 (socket says 172.21.15.102:46492) 2023-11-13T11:29:53.705 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:53.689+0000 7f286177c640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f285c143520 0x7f285c139340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:53.706 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:53.693+0000 7f2853fff640 1 -- 172.21.15.102:0/2896083195 learned_addr learned my addr 172.21.15.102:0/2896083195 (peer_addr_for_me v2:172.21.15.102:0/0) 2023-11-13T11:29:53.706 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:53.693+0000 7f2853fff640 1 -- 172.21.15.102:0/2896083195 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f285c143520 msgr2=0x7f285c139340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:53.706 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:53.693+0000 7f2853fff640 1 --2- 172.21.15.102:0/2896083195 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f285c143520 0x7f285c139340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:53.706 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:53.693+0000 7f2853fff640 1 -- 172.21.15.102:0/2896083195 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f285c06ce40 msgr2=0x7f285c0ae570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:53.706 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:53.693+0000 7f2853fff640 1 --2- 172.21.15.102:0/2896083195 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f285c06ce40 0x7f285c0ae570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:53.707 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:53.693+0000 7f2853fff640 1 -- 172.21.15.102:0/2896083195 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2854009b30 con 0x7f285c0b26f0 2023-11-13T11:29:53.707 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:53.693+0000 7f2853fff640 1 --2- 172.21.15.102:0/2896083195 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f285c0b26f0 0x7f285c13d790 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f284c00d800 tx=0x7f284c00dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-13T11:29:53.707 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:53.693+0000 7f28517fa640 1 -- 172.21.15.102:0/2896083195 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f284c0096a0 con 0x7f285c0b26f0 2023-11-13T11:29:53.707 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:53.693+0000 7f28517fa640 1 -- 172.21.15.102:0/2896083195 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f284c009800 con 0x7f285c0b26f0 2023-11-13T11:29:53.707 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:53.693+0000 7f28517fa640 1 -- 172.21.15.102:0/2896083195 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f284c009b70 con 0x7f285c0b26f0 2023-11-13T11:29:53.708 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:53.693+0000 7f28631df640 1 -- 172.21.15.102:0/2896083195 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f285c0aebe0 con 0x7f285c0b26f0 2023-11-13T11:29:53.708 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:53.693+0000 7f28631df640 1 -- 172.21.15.102:0/2896083195 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f285c0af1a0 con 0x7f285c0b26f0 2023-11-13T11:29:53.708 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:53.693+0000 7f28631df640 1 -- 172.21.15.102:0/2896083195 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f285c068520 con 0x7f285c0b26f0 2023-11-13T11:29:53.708 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:53.693+0000 7f28517fa640 1 -- 172.21.15.102:0/2896083195 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f284c009cd0 con 0x7f285c0b26f0 2023-11-13T11:29:53.710 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:53.693+0000 7f28517fa640 1 --2- 172.21.15.102:0/2896083195 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f2848066470 0x7f2848068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:53.710 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:53.693+0000 7f28517fa640 1 -- 172.21.15.102:0/2896083195 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f284c084100 con 0x7f285c0b26f0 2023-11-13T11:29:53.711 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:53.697+0000 7f2860f7b640 1 --2- 172.21.15.102:0/2896083195 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f2848066470 0x7f2848068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:53.711 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:53.697+0000 7f2860f7b640 1 --2- 172.21.15.102:0/2896083195 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f2848066470 0x7f2848068930 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f285800bb40 tx=0x7f2858008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-13T11:29:53.711 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:53.697+0000 7f28517fa640 1 -- 172.21.15.102:0/2896083195 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f284c051970 con 0x7f285c0b26f0 2023-11-13T11:29:53.859 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:53.849+0000 7f28631df640 1 -- 172.21.15.102:0/2896083195 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f285c15a480 con 0x7f285c0b26f0 2023-11-13T11:29:53.859 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:53.853+0000 7f28517fa640 1 -- 172.21.15.102:0/2896083195 <== mon.0 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v32) v1 ==== 74+0+12893 (secure 0 0 0) 0x7f284c054f90 con 0x7f285c0b26f0 2023-11-13T11:29:53.860 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T11:29:53.860 INFO:teuthology.orchestra.run.smithi102.stdout:{"epoch":32,"fsid":"97b3eb2b-7ccf-4aae-8d92-bff986c671ea","created":"2023-11-13T11:28:31.836724+0000","modified":"2023-11-13T11:29:50.779154+0000","last_up_change":"2023-11-13T11:28:44.876638+0000","last_in_change":"2023-11-13T11:28:35.312740+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-13T11:28:44.981356+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"bdefaa17-fcca-4c86-aa40-27dc33a789af","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6800","nonce":53303834},{"type":"v1","addr":"172.21.15.102:6801","nonce":53303834}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6802","nonce":53303834},{"type":"v1","addr":"172.21.15.102:6803","nonce":53303834}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6806","nonce":53303834},{"type":"v1","addr":"172.21.15.102:6807","nonce":53303834}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6804","nonce":53303834},{"type":"v1","addr":"172.21.15.102:6805","nonce":53303834}]},"public_addr":"172.21.15.102:6801/53303834","cluster_addr":"172.21.15.102:6803/53303834","heartbeat_back_addr":"172.21.15.102:6807/53303834","heartbeat_front_addr":"172.21.15.102:6805/53303834","state":["exists","up"]},{"osd":1,"uuid":"f0033196-dec9-4ae9-945e-6aeef6dbb47f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6808","nonce":1732708348},{"type":"v1","addr":"172.21.15.102:6809","nonce":1732708348}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6811","nonce":1732708348},{"type":"v1","addr":"172.21.15.102:6813","nonce":1732708348}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6818","nonce":1732708348},{"type":"v1","addr":"172.21.15.102:6820","nonce":1732708348}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6815","nonce":1732708348},{"type":"v1","addr":"172.21.15.102:6817","nonce":1732708348}]},"public_addr":"172.21.15.102:6809/1732708348","cluster_addr":"172.21.15.102:6813/1732708348","heartbeat_back_addr":"172.21.15.102:6820/1732708348","heartbeat_front_addr":"172.21.15.102:6817/1732708348","state":["exists","up"]},{"osd":2,"uuid":"496b0834-351e-4ec2-a714-86ed0c0ff4fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6810","nonce":1825475150},{"type":"v1","addr":"172.21.15.102:6812","nonce":1825475150}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6814","nonce":1825475150},{"type":"v1","addr":"172.21.15.102:6816","nonce":1825475150}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6822","nonce":1825475150},{"type":"v1","addr":"172.21.15.102:6823","nonce":1825475150}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6819","nonce":1825475150},{"type":"v1","addr":"172.21.15.102:6821","nonce":1825475150}]},"public_addr":"172.21.15.102:6812/1825475150","cluster_addr":"172.21.15.102:6816/1825475150","heartbeat_back_addr":"172.21.15.102:6823/1825475150","heartbeat_front_addr":"172.21.15.102:6821/1825475150","state":["exists","up"]},{"osd":3,"uuid":"3ba6cc41-e0a0-4273-86cb-90000c06a55a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6824","nonce":4149355528},{"type":"v1","addr":"172.21.15.102:6825","nonce":4149355528}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6826","nonce":4149355528},{"type":"v1","addr":"172.21.15.102:6827","nonce":4149355528}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6830","nonce":4149355528},{"type":"v1","addr":"172.21.15.102:6831","nonce":4149355528}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6828","nonce":4149355528},{"type":"v1","addr":"172.21.15.102:6829","nonce":4149355528}]},"public_addr":"172.21.15.102:6825/4149355528","cluster_addr":"172.21.15.102:6827/4149355528","heartbeat_back_addr":"172.21.15.102:6831/4149355528","heartbeat_front_addr":"172.21.15.102:6829/4149355528","state":["exists","up"]},{"osd":4,"uuid":"16e797d8-e6e7-4140-95c3-b85283c42a2a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6808","nonce":4028899241},{"type":"v1","addr":"172.21.15.154:6809","nonce":4028899241}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6810","nonce":4028899241},{"type":"v1","addr":"172.21.15.154:6811","nonce":4028899241}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6814","nonce":4028899241},{"type":"v1","addr":"172.21.15.154:6815","nonce":4028899241}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6812","nonce":4028899241},{"type":"v1","addr":"172.21.15.154:6813","nonce":4028899241}]},"public_addr":"172.21.15.154:6809/4028899241","cluster_addr":"172.21.15.154:6811/4028899241","heartbeat_back_addr":"172.21.15.154:6815/4028899241","heartbeat_front_addr":"172.21.15.154:6813/4028899241","state":["exists","up"]},{"osd":5,"uuid":"d6ab225c-1b55-450a-89a9-abe5c3f8d6af","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":3562396827},{"type":"v1","addr":"172.21.15.154:6801","nonce":3562396827}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":3562396827},{"type":"v1","addr":"172.21.15.154:6803","nonce":3562396827}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6806","nonce":3562396827},{"type":"v1","addr":"172.21.15.154:6807","nonce":3562396827}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6804","nonce":3562396827},{"type":"v1","addr":"172.21.15.154:6805","nonce":3562396827}]},"public_addr":"172.21.15.154:6801/3562396827","cluster_addr":"172.21.15.154:6803/3562396827","heartbeat_back_addr":"172.21.15.154:6807/3562396827","heartbeat_front_addr":"172.21.15.154:6805/3562396827","state":["exists","up"]},{"osd":6,"uuid":"96f905ac-491c-4662-8e2b-5bb8e929ab9d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6816","nonce":2933728751},{"type":"v1","addr":"172.21.15.154:6817","nonce":2933728751}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6818","nonce":2933728751},{"type":"v1","addr":"172.21.15.154:6819","nonce":2933728751}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6822","nonce":2933728751},{"type":"v1","addr":"172.21.15.154:6823","nonce":2933728751}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6820","nonce":2933728751},{"type":"v1","addr":"172.21.15.154:6821","nonce":2933728751}]},"public_addr":"172.21.15.154:6817/2933728751","cluster_addr":"172.21.15.154:6819/2933728751","heartbeat_back_addr":"172.21.15.154:6823/2933728751","heartbeat_front_addr":"172.21.15.154:6821/2933728751","state":["exists","up"]},{"osd":7,"uuid":"07012d3b-3ab4-40df-a471-93caed22e2dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6824","nonce":1753500785},{"type":"v1","addr":"172.21.15.154:6825","nonce":1753500785}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6826","nonce":1753500785},{"type":"v1","addr":"172.21.15.154:6827","nonce":1753500785}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6830","nonce":1753500785},{"type":"v1","addr":"172.21.15.154:6831","nonce":1753500785}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6828","nonce":1753500785},{"type":"v1","addr":"172.21.15.154:6829","nonce":1753500785}]},"public_addr":"172.21.15.154:6825/1753500785","cluster_addr":"172.21.15.154:6827/1753500785","heartbeat_back_addr":"172.21.15.154:6831/1753500785","heartbeat_front_addr":"172.21.15.154:6829/1753500785","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-13T11:28:40.978603+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-13T11:28:41.200985+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-13T11:28:41.222815+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-13T11:28:41.202162+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-13T11:28:40.925911+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-13T11:28:41.087725+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-13T11:28:41.072208+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-13T11:28:40.875257+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-13T11:29:53.862 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:53.853+0000 7f28631df640 1 -- 172.21.15.102:0/2896083195 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f2848066470 msgr2=0x7f2848068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:53.862 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:53.853+0000 7f28631df640 1 --2- 172.21.15.102:0/2896083195 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f2848066470 0x7f2848068930 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f285800bb40 tx=0x7f2858008040 comp rx=0 tx=0).stop 2023-11-13T11:29:53.862 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:53.853+0000 7f28631df640 1 -- 172.21.15.102:0/2896083195 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f285c0b26f0 msgr2=0x7f285c13d790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:53.862 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:53.853+0000 7f28631df640 1 --2- 172.21.15.102:0/2896083195 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f285c0b26f0 0x7f285c13d790 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f284c00d800 tx=0x7f284c00dcc0 comp rx=0 tx=0).stop 2023-11-13T11:29:53.862 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:53.853+0000 7f28631df640 1 -- 172.21.15.102:0/2896083195 shutdown_connections 2023-11-13T11:29:53.863 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:53.853+0000 7f28631df640 1 --2- 172.21.15.102:0/2896083195 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f285c143520 0x7f285c139340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:53.863 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:53.853+0000 7f28631df640 1 --2- 172.21.15.102:0/2896083195 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f2848066470 0x7f2848068930 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:53.863 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:53.853+0000 7f28631df640 1 --2- 172.21.15.102:0/2896083195 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f285c0b26f0 0x7f285c13d790 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:53.863 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:53.853+0000 7f28631df640 1 --2- 172.21.15.102:0/2896083195 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f285c06ce40 0x7f285c0ae570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:53.863 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:53.853+0000 7f28631df640 1 -- 172.21.15.102:0/2896083195 >> 172.21.15.102:0/2896083195 conn(0x7f285c06a240 msgr2=0x7f285c15c1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-13T11:29:53.864 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:53.853+0000 7f28631df640 1 -- 172.21.15.102:0/2896083195 shutdown_connections 2023-11-13T11:29:53.864 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:53.853+0000 7f28631df640 1 -- 172.21.15.102:0/2896083195 wait complete. 2023-11-13T11:29:53.882 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-13T11:28:44.981356+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-13T11:29:53.883 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-13T11:29:54.023 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:54.017+0000 7f7e66555640 1 Processor -- start 2023-11-13T11:29:54.023 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:54.017+0000 7f7e66555640 1 -- start start 2023-11-13T11:29:54.024 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:54.017+0000 7f7e66555640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f7e6006fc80 0x7f7e600711c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:54.025 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:54.017+0000 7f7e66555640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7e600b21f0 con 0x7f7e60159b30 2023-11-13T11:29:54.025 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:54.017+0000 7f7e66555640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7e600b2440 con 0x7f7e600cf2d0 2023-11-13T11:29:54.025 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:54.017+0000 7f7e66555640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7e600b2720 con 0x7f7e6006fc80 2023-11-13T11:29:54.025 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:54.017+0000 7f7e5ffff640 1 --1- >> v1:172.21.15.102:6789/0 conn(0x7f7e60159b30 0x7f7e600cebc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.102:6789/0 says I am v1:172.21.15.102:39438/0 (socket says 172.21.15.102:39438) 2023-11-13T11:29:54.026 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:54.017+0000 7f7e5ffff640 1 -- 172.21.15.102:0/3780049979 learned_addr learned my addr 172.21.15.102:0/3780049979 (peer_addr_for_me v1:172.21.15.102:0/0) 2023-11-13T11:29:54.026 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:54.017+0000 7f7e64af2640 1 --2- 172.21.15.102:0/3780049979 >> v2:172.21.15.154:3300/0 conn(0x7f7e6006fc80 0x7f7e600711c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:54.027 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:54.017+0000 7f7e5effd640 1 -- 172.21.15.102:0/3780049979 <== mon.0 v1:172.21.15.102:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3528860043 0 0) 0x7f7e600b21f0 con 0x7f7e60159b30 2023-11-13T11:29:54.027 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:54.017+0000 7f7e5effd640 1 -- 172.21.15.102:0/3780049979 --> v1:172.21.15.102:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7e48005740 con 0x7f7e60159b30 2023-11-13T11:29:54.027 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:54.017+0000 7f7e5effd640 1 -- 172.21.15.102:0/3780049979 <== mon.0 v1:172.21.15.102:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2350222788 0 0) 0x7f7e48005740 con 0x7f7e60159b30 2023-11-13T11:29:54.027 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:54.017+0000 7f7e64af2640 1 -- 172.21.15.102:0/3780049979 >> v1:172.21.15.154:6789/0 conn(0x7f7e600cf2d0 legacy=0x7f7e600cbe90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:54.028 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:54.017+0000 7f7e64af2640 1 -- 172.21.15.102:0/3780049979 >> v1:172.21.15.102:6789/0 conn(0x7f7e60159b30 legacy=0x7f7e600cebc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:54.028 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:54.017+0000 7f7e64af2640 1 -- 172.21.15.102:0/3780049979 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e600b2d20 con 0x7f7e6006fc80 2023-11-13T11:29:54.029 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:54.021+0000 7f7e64af2640 1 --2- 172.21.15.102:0/3780049979 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7e6006fc80 0x7f7e600711c0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f7e58009dc0 tx=0x7f7e5801c820 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2b2fb07ee31ab14f server_cookie=0 in_seq=0 out_seq=0 2023-11-13T11:29:54.030 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:54.021+0000 7f7e5effd640 1 -- 172.21.15.102:0/3780049979 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e50001680 con 0x7f7e6006fc80 2023-11-13T11:29:54.031 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:54.021+0000 7f7e5effd640 1 -- 172.21.15.102:0/3780049979 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e580a5630 con 0x7f7e6006fc80 2023-11-13T11:29:54.031 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:54.021+0000 7f7e5effd640 1 -- 172.21.15.102:0/3780049979 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e580a59c0 con 0x7f7e6006fc80 2023-11-13T11:29:54.031 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:54.021+0000 7f7e66555640 1 -- 172.21.15.102:0/3780049979 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7e6006fc80 msgr2=0x7f7e600711c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:54.032 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:54.021+0000 7f7e66555640 1 --2- 172.21.15.102:0/3780049979 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7e6006fc80 0x7f7e600711c0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f7e58009dc0 tx=0x7f7e5801c820 comp rx=0 tx=0).stop 2023-11-13T11:29:54.032 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:54.021+0000 7f7e66555640 1 -- 172.21.15.102:0/3780049979 shutdown_connections 2023-11-13T11:29:54.033 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:54.021+0000 7f7e66555640 1 --2- 172.21.15.102:0/3780049979 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7e6006fc80 0x7f7e600711c0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:54.033 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:54.021+0000 7f7e66555640 1 -- 172.21.15.102:0/3780049979 >> 172.21.15.102:0/3780049979 conn(0x7f7e6006a410 msgr2=0x7f7e6006a820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-13T11:29:54.033 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:54.021+0000 7f7e66555640 1 -- 172.21.15.102:0/3780049979 shutdown_connections 2023-11-13T11:29:54.033 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:54.021+0000 7f7e66555640 1 -- 172.21.15.102:0/3780049979 wait complete. 2023-11-13T11:29:54.036 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:54.025+0000 7f7e66555640 1 Processor -- start 2023-11-13T11:29:54.036 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:54.025+0000 7f7e66555640 1 -- start start 2023-11-13T11:29:54.037 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:54.025+0000 7f7e66555640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7e6006fc80 0x7f7e6014e5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:54.037 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:54.025+0000 7f7e66555640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7e600cf2d0 0x7f7e60139220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:54.037 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:54.025+0000 7f7e66555640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7e60159b30 0x7f7e6006d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:54.037 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:54.025+0000 7f7e66555640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e60151e80 con 0x7f7e6006fc80 2023-11-13T11:29:54.038 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:54.025+0000 7f7e66555640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e60151550 con 0x7f7e600cf2d0 2023-11-13T11:29:54.038 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:54.025+0000 7f7e66555640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e60151830 con 0x7f7e60159b30 2023-11-13T11:29:54.038 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:54.025+0000 7f7e5ffff640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7e6006fc80 0x7f7e6014e5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:54.039 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:54.025+0000 7f7e5ffff640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7e6006fc80 0x7f7e6014e5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:46500/0 (socket says 172.21.15.102:46500) 2023-11-13T11:29:54.039 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:54.025+0000 7f7e5ffff640 1 -- 172.21.15.102:0/285651732 learned_addr learned my addr 172.21.15.102:0/285651732 (peer_addr_for_me v2:172.21.15.102:0/0) 2023-11-13T11:29:54.039 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:54.025+0000 7f7e5f7fe640 1 --2- 172.21.15.102:0/285651732 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7e600cf2d0 0x7f7e60139220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:54.039 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:54.025+0000 7f7e64af2640 1 --2- 172.21.15.102:0/285651732 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7e60159b30 0x7f7e6006d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:54.040 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:54.025+0000 7f7e5ffff640 1 -- 172.21.15.102:0/285651732 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7e60159b30 msgr2=0x7f7e6006d1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:54.040 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:54.025+0000 7f7e5ffff640 1 --2- 172.21.15.102:0/285651732 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7e60159b30 0x7f7e6006d1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:54.042 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:54.025+0000 7f7e5ffff640 1 -- 172.21.15.102:0/285651732 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7e600cf2d0 msgr2=0x7f7e60139220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:54.042 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:54.025+0000 7f7e5ffff640 1 --2- 172.21.15.102:0/285651732 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7e600cf2d0 0x7f7e60139220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:54.042 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:54.025+0000 7f7e5ffff640 1 -- 172.21.15.102:0/285651732 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e58009a70 con 0x7f7e6006fc80 2023-11-13T11:29:54.043 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:54.025+0000 7f7e5f7fe640 1 --2- 172.21.15.102:0/285651732 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7e600cf2d0 0x7f7e60139220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-13T11:29:54.043 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:54.025+0000 7f7e5ffff640 1 --2- 172.21.15.102:0/285651732 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7e6006fc80 0x7f7e6014e5f0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f7e5000c750 tx=0x7f7e5000cc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-13T11:29:54.043 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:54.025+0000 7f7e5cff9640 1 -- 172.21.15.102:0/285651732 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e50005ae0 con 0x7f7e6006fc80 2023-11-13T11:29:54.043 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:54.025+0000 7f7e5cff9640 1 -- 172.21.15.102:0/285651732 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e50005c40 con 0x7f7e6006fc80 2023-11-13T11:29:54.044 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:54.025+0000 7f7e66555640 1 -- 172.21.15.102:0/285651732 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7e60151b10 con 0x7f7e6006fc80 2023-11-13T11:29:54.044 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:54.025+0000 7f7e5cff9640 1 -- 172.21.15.102:0/285651732 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e500072b0 con 0x7f7e6006fc80 2023-11-13T11:29:54.044 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:54.025+0000 7f7e66555640 1 -- 172.21.15.102:0/285651732 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7e60139760 con 0x7f7e6006fc80 2023-11-13T11:29:54.044 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:54.025+0000 7f7e66555640 1 -- 172.21.15.102:0/285651732 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7e60067640 con 0x7f7e6006fc80 2023-11-13T11:29:54.044 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:54.029+0000 7f7e5cff9640 1 -- 172.21.15.102:0/285651732 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f7e50007410 con 0x7f7e6006fc80 2023-11-13T11:29:54.045 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:54.029+0000 7f7e5cff9640 1 --2- 172.21.15.102:0/285651732 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f7e4c066470 0x7f7e4c068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:54.046 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:54.029+0000 7f7e5cff9640 1 -- 172.21.15.102:0/285651732 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f7e50083290 con 0x7f7e6006fc80 2023-11-13T11:29:54.046 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:54.029+0000 7f7e5f7fe640 1 --2- 172.21.15.102:0/285651732 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f7e4c066470 0x7f7e4c068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:54.046 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:54.029+0000 7f7e5f7fe640 1 --2- 172.21.15.102:0/285651732 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f7e4c066470 0x7f7e4c068930 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f7e60158d20 tx=0x7f7e54009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-13T11:29:54.046 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:54.033+0000 7f7e5cff9640 1 -- 172.21.15.102:0/285651732 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f7e50050a80 con 0x7f7e6006fc80 2023-11-13T11:29:54.190 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:54.181+0000 7f7e66555640 1 -- 172.21.15.102:0/285651732 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f7e60068520 con 0x7f7e6006fc80 2023-11-13T11:29:54.191 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:54.181+0000 7f7e5cff9640 1 -- 172.21.15.102:0/285651732 <== mon.0 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v32) v1 ==== 93+0+10 (secure 0 0 0) 0x7f7e500540a0 con 0x7f7e6006fc80 2023-11-13T11:29:54.191 INFO:teuthology.orchestra.run.smithi102.stdout:pg_num: 1 2023-11-13T11:29:54.193 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:54.185+0000 7f7e66555640 1 -- 172.21.15.102:0/285651732 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f7e4c066470 msgr2=0x7f7e4c068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:54.193 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:54.185+0000 7f7e66555640 1 --2- 172.21.15.102:0/285651732 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f7e4c066470 0x7f7e4c068930 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f7e60158d20 tx=0x7f7e54009040 comp rx=0 tx=0).stop 2023-11-13T11:29:54.193 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:54.185+0000 7f7e66555640 1 -- 172.21.15.102:0/285651732 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7e6006fc80 msgr2=0x7f7e6014e5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:54.194 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:54.185+0000 7f7e66555640 1 --2- 172.21.15.102:0/285651732 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7e6006fc80 0x7f7e6014e5f0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f7e5000c750 tx=0x7f7e5000cc10 comp rx=0 tx=0).stop 2023-11-13T11:29:54.194 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:54.185+0000 7f7e66555640 1 -- 172.21.15.102:0/285651732 shutdown_connections 2023-11-13T11:29:54.194 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:54.185+0000 7f7e66555640 1 --2- 172.21.15.102:0/285651732 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7e60159b30 0x7f7e6006d1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:54.194 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:54.185+0000 7f7e66555640 1 --2- 172.21.15.102:0/285651732 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7e600cf2d0 0x7f7e60139220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:54.195 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:54.185+0000 7f7e66555640 1 --2- 172.21.15.102:0/285651732 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f7e4c066470 0x7f7e4c068930 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:54.195 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:54.185+0000 7f7e66555640 1 --2- 172.21.15.102:0/285651732 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7e6006fc80 0x7f7e6014e5f0 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:54.195 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:54.185+0000 7f7e66555640 1 -- 172.21.15.102:0/285651732 >> 172.21.15.102:0/285651732 conn(0x7f7e6006a410 msgr2=0x7f7e600b0600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-13T11:29:54.195 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:54.185+0000 7f7e66555640 1 -- 172.21.15.102:0/285651732 shutdown_connections 2023-11-13T11:29:54.196 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:54.185+0000 7f7e66555640 1 -- 172.21.15.102:0/285651732 wait complete. 2023-11-13T11:29:54.212 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-11-13T11:29:54.352 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:54.345+0000 7fb07bbc1640 1 Processor -- start 2023-11-13T11:29:54.353 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:54.345+0000 7fb07bbc1640 1 -- start start 2023-11-13T11:29:54.356 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:54.345+0000 7fb07bbc1640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fb07406dc70 0x7fb07406ba90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:54.356 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:54.345+0000 7fb07bbc1640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb07413e530 con 0x7fb07413df40 2023-11-13T11:29:54.356 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:54.345+0000 7fb07bbc1640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb07415f290 con 0x7fb07406bfd0 2023-11-13T11:29:54.357 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:54.345+0000 7fb07bbc1640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb07406c480 con 0x7fb07406dc70 2023-11-13T11:29:54.357 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:54.345+0000 7fb07995d640 1 --1- >> v1:172.21.15.102:6789/0 conn(0x7fb07413df40 0x7fb07415e990 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.102:6789/0 says I am v1:172.21.15.102:39450/0 (socket says 172.21.15.102:39450) 2023-11-13T11:29:54.357 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:54.345+0000 7fb07995d640 1 -- 172.21.15.102:0/1721961537 learned_addr learned my addr 172.21.15.102:0/1721961537 (peer_addr_for_me v1:172.21.15.102:0/0) 2023-11-13T11:29:54.357 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:54.345+0000 7fb07915c640 1 --2- 172.21.15.102:0/1721961537 >> v2:172.21.15.154:3300/0 conn(0x7fb07406dc70 0x7fb07406ba90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:54.358 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:54.345+0000 7fb07895b640 1 -- 172.21.15.102:0/1721961537 <== mon.0 v1:172.21.15.102:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1028089330 0 0) 0x7fb07413e530 con 0x7fb07413df40 2023-11-13T11:29:54.358 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:54.345+0000 7fb07895b640 1 -- 172.21.15.102:0/1721961537 --> v1:172.21.15.102:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb060003530 con 0x7fb07413df40 2023-11-13T11:29:54.358 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:54.345+0000 7fb07895b640 1 -- 172.21.15.102:0/1721961537 <== mon.1 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2020296672 0 0) 0x7fb07415f290 con 0x7fb07406bfd0 2023-11-13T11:29:54.359 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:54.345+0000 7fb07895b640 1 -- 172.21.15.102:0/1721961537 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb07413e530 con 0x7fb07406bfd0 2023-11-13T11:29:54.359 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:54.345+0000 7fb07895b640 1 -- 172.21.15.102:0/1721961537 <== mon.0 v1:172.21.15.102:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3649752081 0 0) 0x7fb060003530 con 0x7fb07413df40 2023-11-13T11:29:54.359 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:54.345+0000 7fb07895b640 1 -- 172.21.15.102:0/1721961537 >> v2:172.21.15.154:3300/0 conn(0x7fb07406dc70 msgr2=0x7fb07406ba90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-13T11:29:54.359 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:54.345+0000 7fb07895b640 1 --2- 172.21.15.102:0/1721961537 >> v2:172.21.15.154:3300/0 conn(0x7fb07406dc70 0x7fb07406ba90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:54.360 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:54.345+0000 7fb07895b640 1 -- 172.21.15.102:0/1721961537 >> v1:172.21.15.154:6789/0 conn(0x7fb07406bfd0 legacy=0x7fb07413f6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:54.360 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:54.345+0000 7fb07895b640 1 -- 172.21.15.102:0/1721961537 --> v1:172.21.15.102:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb07415f570 con 0x7fb07413df40 2023-11-13T11:29:54.360 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:54.345+0000 7fb07895b640 1 -- 172.21.15.102:0/1721961537 <== mon.0 v1:172.21.15.102:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 895381068 0 0) 0x7fb070001680 con 0x7fb07413df40 2023-11-13T11:29:54.361 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:54.345+0000 7fb07895b640 1 -- 172.21.15.102:0/1721961537 >> v1:172.21.15.102:6789/0 conn(0x7fb07413df40 legacy=0x7fb07415e990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:54.361 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:54.345+0000 7fb07895b640 1 --2- 172.21.15.102:0/1721961537 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb060003b60 0x7fb060003f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:54.361 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:54.345+0000 7fb07895b640 1 --2- 172.21.15.102:0/1721961537 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb0600047d0 0x7fb060004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:54.361 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:54.345+0000 7fb07895b640 1 --2- 172.21.15.102:0/1721961537 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb060005190 0x7fb06000b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:54.362 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:54.345+0000 7fb07895b640 1 -- 172.21.15.102:0/1721961537 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb07406c480 con 0x7fb060003b60 2023-11-13T11:29:54.362 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:54.345+0000 7fb07895b640 1 -- 172.21.15.102:0/1721961537 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb06000c060 con 0x7fb0600047d0 2023-11-13T11:29:54.362 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:54.345+0000 7fb07895b640 1 -- 172.21.15.102:0/1721961537 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb06000c220 con 0x7fb060005190 2023-11-13T11:29:54.362 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:54.345+0000 7fb07995d640 1 --2- 172.21.15.102:0/1721961537 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb060003b60 0x7fb060003f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:54.363 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:54.349+0000 7fb07915c640 1 --2- 172.21.15.102:0/1721961537 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb0600047d0 0x7fb060004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:54.363 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:54.349+0000 7fb07a15e640 1 --2- 172.21.15.102:0/1721961537 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb060005190 0x7fb06000b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:54.363 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:54.349+0000 7fb07995d640 1 -- 172.21.15.102:0/1721961537 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb060005190 msgr2=0x7fb06000b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-13T11:29:54.363 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:54.349+0000 7fb07995d640 1 --2- 172.21.15.102:0/1721961537 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb060005190 0x7fb06000b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:54.363 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:54.349+0000 7fb07995d640 1 -- 172.21.15.102:0/1721961537 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb0600047d0 msgr2=0x7fb060004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-13T11:29:54.364 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:54.349+0000 7fb07995d640 1 --2- 172.21.15.102:0/1721961537 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb0600047d0 0x7fb060004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:54.364 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:54.349+0000 7fb07995d640 1 -- 172.21.15.102:0/1721961537 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb060003530 con 0x7fb060003b60 2023-11-13T11:29:54.364 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:54.349+0000 7fb07a15e640 1 --2- 172.21.15.102:0/1721961537 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb060005190 0x7fb06000b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-13T11:29:54.364 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:54.349+0000 7fb07a15e640 1 -- 172.21.15.102:0/1721961537 reap_dead start 2023-11-13T11:29:54.367 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:54.349+0000 7fb07995d640 1 --2- 172.21.15.102:0/1721961537 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb060003b60 0x7fb060003f60 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7fb070007fa0 tx=0x7fb07001cb00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dc1073c40801b1a server_cookie=0 in_seq=0 out_seq=0 2023-11-13T11:29:54.368 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:54.349+0000 7fb07895b640 1 -- 172.21.15.102:0/1721961537 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb070005ae0 con 0x7fb060003b60 2023-11-13T11:29:54.368 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:54.349+0000 7fb07895b640 1 -- 172.21.15.102:0/1721961537 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb070005c40 con 0x7fb060003b60 2023-11-13T11:29:54.368 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:54.349+0000 7fb07895b640 1 -- 172.21.15.102:0/1721961537 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb070007290 con 0x7fb060003b60 2023-11-13T11:29:54.368 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:54.349+0000 7fb07bbc1640 1 -- 172.21.15.102:0/1721961537 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb060003b60 msgr2=0x7fb060003f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:54.369 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:54.349+0000 7fb07bbc1640 1 --2- 172.21.15.102:0/1721961537 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb060003b60 0x7fb060003f60 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7fb070007fa0 tx=0x7fb07001cb00 comp rx=0 tx=0).stop 2023-11-13T11:29:54.369 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:54.353+0000 7fb07bbc1640 1 -- 172.21.15.102:0/1721961537 shutdown_connections 2023-11-13T11:29:54.369 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:54.353+0000 7fb07bbc1640 1 --2- 172.21.15.102:0/1721961537 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb060003b60 0x7fb060003f60 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:54.369 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:54.353+0000 7fb07bbc1640 1 -- 172.21.15.102:0/1721961537 >> 172.21.15.102:0/1721961537 conn(0x7fb0740b0870 msgr2=0x7fb0740b0c80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-13T11:29:54.370 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:54.353+0000 7fb07bbc1640 1 -- 172.21.15.102:0/1721961537 shutdown_connections 2023-11-13T11:29:54.370 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:54.353+0000 7fb07bbc1640 1 -- 172.21.15.102:0/1721961537 wait complete. 2023-11-13T11:29:54.370 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:54.353+0000 7fb07bbc1640 1 Processor -- start 2023-11-13T11:29:54.370 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:54.353+0000 7fb07bbc1640 1 -- start start 2023-11-13T11:29:54.370 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:54.353+0000 7fb07bbc1640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb060003b60 0x7fb074070190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:54.371 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:54.353+0000 7fb07bbc1640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb07415b1c0 0x7fb07415b640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:54.371 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:54.353+0000 7fb07bbc1640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb07415d4d0 0x7fb07415d950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:54.371 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:54.353+0000 7fb07bbc1640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb07415de90 con 0x7fb07415b1c0 2023-11-13T11:29:54.371 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:54.353+0000 7fb07bbc1640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0741403a0 con 0x7fb060003b60 2023-11-13T11:29:54.371 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:54.353+0000 7fb07bbc1640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb07415c940 con 0x7fb07415d4d0 2023-11-13T11:29:54.372 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:54.353+0000 7fb07915c640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb07415b1c0 0x7fb07415b640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:54.372 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:54.353+0000 7fb07915c640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb07415b1c0 0x7fb07415b640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:46522/0 (socket says 172.21.15.102:46522) 2023-11-13T11:29:54.372 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:54.353+0000 7fb07915c640 1 -- 172.21.15.102:0/2723293069 learned_addr learned my addr 172.21.15.102:0/2723293069 (peer_addr_for_me v2:172.21.15.102:0/0) 2023-11-13T11:29:54.372 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:54.353+0000 7fb07995d640 1 --2- 172.21.15.102:0/2723293069 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb060003b60 0x7fb074070190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:54.372 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:54.353+0000 7fb07a15e640 1 --2- 172.21.15.102:0/2723293069 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb07415d4d0 0x7fb07415d950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:54.373 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:54.353+0000 7fb07915c640 1 -- 172.21.15.102:0/2723293069 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb07415d4d0 msgr2=0x7fb07415d950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:54.373 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:54.353+0000 7fb07915c640 1 --2- 172.21.15.102:0/2723293069 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb07415d4d0 0x7fb07415d950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:54.373 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:54.353+0000 7fb07915c640 1 -- 172.21.15.102:0/2723293069 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb060003b60 msgr2=0x7fb074070190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:54.373 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:54.353+0000 7fb07915c640 1 --2- 172.21.15.102:0/2723293069 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb060003b60 0x7fb074070190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:54.373 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:54.353+0000 7fb07915c640 1 -- 172.21.15.102:0/2723293069 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb07415bd30 con 0x7fb07415b1c0 2023-11-13T11:29:54.374 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:54.353+0000 7fb07915c640 1 --2- 172.21.15.102:0/2723293069 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb07415b1c0 0x7fb07415b640 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7fb064011aa0 tx=0x7fb064011f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-13T11:29:54.374 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:54.357+0000 7fb06a7fc640 1 -- 172.21.15.102:0/2723293069 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb06400fb80 con 0x7fb07415b1c0 2023-11-13T11:29:54.374 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:54.357+0000 7fb06a7fc640 1 -- 172.21.15.102:0/2723293069 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb06400fce0 con 0x7fb07415b1c0 2023-11-13T11:29:54.374 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:54.357+0000 7fb07bbc1640 1 -- 172.21.15.102:0/2723293069 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb07415c010 con 0x7fb07415b1c0 2023-11-13T11:29:54.374 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:54.357+0000 7fb06a7fc640 1 -- 172.21.15.102:0/2723293069 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb064014680 con 0x7fb07415b1c0 2023-11-13T11:29:54.375 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:54.357+0000 7fb07bbc1640 1 -- 172.21.15.102:0/2723293069 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb07415c5d0 con 0x7fb07415b1c0 2023-11-13T11:29:54.375 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:54.357+0000 7fb07bbc1640 1 -- 172.21.15.102:0/2723293069 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb0741f6000 con 0x7fb07415b1c0 2023-11-13T11:29:54.375 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:54.357+0000 7fb06a7fc640 1 -- 172.21.15.102:0/2723293069 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fb06401d400 con 0x7fb07415b1c0 2023-11-13T11:29:54.375 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:54.357+0000 7fb06a7fc640 1 --2- 172.21.15.102:0/2723293069 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7fb0580664a0 0x7fb058068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:54.375 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:54.357+0000 7fb06a7fc640 1 -- 172.21.15.102:0/2723293069 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fb0640844e0 con 0x7fb07415b1c0 2023-11-13T11:29:54.376 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:54.357+0000 7fb07995d640 1 --2- 172.21.15.102:0/2723293069 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7fb0580664a0 0x7fb058068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:54.376 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:54.357+0000 7fb07995d640 1 --2- 172.21.15.102:0/2723293069 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7fb0580664a0 0x7fb058068960 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fb0700ab000 tx=0x7fb0700b1040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-13T11:29:54.377 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:54.361+0000 7fb06a7fc640 1 -- 172.21.15.102:0/2723293069 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fb064051c10 con 0x7fb07415b1c0 2023-11-13T11:29:54.521 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:54.513+0000 7fb07bbc1640 1 -- 172.21.15.102:0/2723293069 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7fb0740ce770 con 0x7fb07415b1c0 2023-11-13T11:29:54.521 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:54.513+0000 7fb06a7fc640 1 -- 172.21.15.102:0/2723293069 <== mon.0 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v32) v1 ==== 84+0+65 (secure 0 0 0) 0x7fb064055230 con 0x7fb07415b1c0 2023-11-13T11:29:54.522 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T11:29:54.522 INFO:teuthology.orchestra.run.smithi102.stdout:[ 2023-11-13T11:29:54.522 INFO:teuthology.orchestra.run.smithi102.stdout: { 2023-11-13T11:29:54.522 INFO:teuthology.orchestra.run.smithi102.stdout: "poolnum": 1, 2023-11-13T11:29:54.523 INFO:teuthology.orchestra.run.smithi102.stdout: "poolname": ".mgr" 2023-11-13T11:29:54.523 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-11-13T11:29:54.523 INFO:teuthology.orchestra.run.smithi102.stdout:] 2023-11-13T11:29:54.524 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:54.513+0000 7fb07bbc1640 1 -- 172.21.15.102:0/2723293069 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7fb0580664a0 msgr2=0x7fb058068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:54.524 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:54.513+0000 7fb07bbc1640 1 --2- 172.21.15.102:0/2723293069 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7fb0580664a0 0x7fb058068960 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fb0700ab000 tx=0x7fb0700b1040 comp rx=0 tx=0).stop 2023-11-13T11:29:54.525 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:54.513+0000 7fb07bbc1640 1 -- 172.21.15.102:0/2723293069 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb07415b1c0 msgr2=0x7fb07415b640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:54.525 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:54.513+0000 7fb07bbc1640 1 --2- 172.21.15.102:0/2723293069 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb07415b1c0 0x7fb07415b640 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7fb064011aa0 tx=0x7fb064011f60 comp rx=0 tx=0).stop 2023-11-13T11:29:54.525 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:54.517+0000 7fb07bbc1640 1 -- 172.21.15.102:0/2723293069 shutdown_connections 2023-11-13T11:29:54.526 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:54.517+0000 7fb07bbc1640 1 --2- 172.21.15.102:0/2723293069 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb07415d4d0 0x7fb07415d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:54.526 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:54.517+0000 7fb07bbc1640 1 --2- 172.21.15.102:0/2723293069 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7fb0580664a0 0x7fb058068960 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:54.526 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:54.517+0000 7fb07bbc1640 1 --2- 172.21.15.102:0/2723293069 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb07415b1c0 0x7fb07415b640 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:54.526 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:54.517+0000 7fb07bbc1640 1 --2- 172.21.15.102:0/2723293069 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb060003b60 0x7fb074070190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:54.527 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:54.517+0000 7fb07bbc1640 1 -- 172.21.15.102:0/2723293069 >> 172.21.15.102:0/2723293069 conn(0x7fb0740b0870 msgr2=0x7fb0740ce060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-13T11:29:54.527 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:54.517+0000 7fb07bbc1640 1 -- 172.21.15.102:0/2723293069 shutdown_connections 2023-11-13T11:29:54.527 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:54.517+0000 7fb07bbc1640 1 -- 172.21.15.102:0/2723293069 wait complete. 2023-11-13T11:29:54.542 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-11-13T11:29:54.543 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-11-13T11:29:54.683 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:54.677+0000 7f604b1ec640 1 Processor -- start 2023-11-13T11:29:54.684 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:54.677+0000 7f604b1ec640 1 -- start start 2023-11-13T11:29:54.686 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:54.677+0000 7f604b1ec640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f60441540c0 0x7f604406d600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:54.686 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:54.677+0000 7f604b1ec640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f604406db40 0x7f60440b2840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:54.686 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:54.677+0000 7f604b1ec640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f60440b2d80 0x7f604406fcd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:54.686 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:54.677+0000 7f604b1ec640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f604415a180 con 0x7f60440b2d80 2023-11-13T11:29:54.687 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:54.677+0000 7f604b1ec640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f604415b340 con 0x7f60441540c0 2023-11-13T11:29:54.687 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:54.677+0000 7f604b1ec640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60440b3570 con 0x7f604406db40 2023-11-13T11:29:54.687 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:54.677+0000 7f6049789640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f60440b2d80 0x7f604406fcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:54.687 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:54.677+0000 7f6049789640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f60440b2d80 0x7f604406fcd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:46526/0 (socket says 172.21.15.102:46526) 2023-11-13T11:29:54.688 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:54.677+0000 7f6049789640 1 -- 172.21.15.102:0/2648993655 learned_addr learned my addr 172.21.15.102:0/2648993655 (peer_addr_for_me v2:172.21.15.102:0/0) 2023-11-13T11:29:54.688 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:54.677+0000 7f6043fff640 1 --2- 172.21.15.102:0/2648993655 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f604406db40 0x7f60440b2840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:54.688 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:54.677+0000 7f6048f88640 1 --2- 172.21.15.102:0/2648993655 >> v2:172.21.15.154:3300/0 conn(0x7f60441540c0 0x7f604406d600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:54.688 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:54.677+0000 7f6049789640 1 -- 172.21.15.102:0/2648993655 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f604406db40 msgr2=0x7f60440b2840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-13T11:29:54.689 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:54.677+0000 7f6049789640 1 --2- 172.21.15.102:0/2648993655 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f604406db40 0x7f60440b2840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:54.689 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:54.677+0000 7f6049789640 1 -- 172.21.15.102:0/2648993655 >> v2:172.21.15.154:3300/0 conn(0x7f60441540c0 msgr2=0x7f604406d600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-13T11:29:54.689 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:54.677+0000 7f6049789640 1 --2- 172.21.15.102:0/2648993655 >> v2:172.21.15.154:3300/0 conn(0x7f60441540c0 0x7f604406d600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:54.689 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:54.677+0000 7f6049789640 1 -- 172.21.15.102:0/2648993655 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f604406df80 con 0x7f60440b2d80 2023-11-13T11:29:54.689 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:54.677+0000 7f6048f88640 1 --2- 172.21.15.102:0/2648993655 >> v2:172.21.15.154:3300/0 conn(0x7f60441540c0 0x7f604406d600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-13T11:29:54.691 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:54.681+0000 7f6049789640 1 --2- 172.21.15.102:0/2648993655 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f60440b2d80 0x7f604406fcd0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f604406e1e0 tx=0x7f603c01e880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2d87deda3050ab04 server_cookie=0 in_seq=0 out_seq=0 2023-11-13T11:29:54.692 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:54.681+0000 7f60437fe640 1 -- 172.21.15.102:0/2648993655 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f603c00b2d0 con 0x7f60440b2d80 2023-11-13T11:29:54.692 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:54.681+0000 7f60437fe640 1 -- 172.21.15.102:0/2648993655 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f603c00b430 con 0x7f60440b2d80 2023-11-13T11:29:54.692 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:54.681+0000 7f60437fe640 1 -- 172.21.15.102:0/2648993655 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f603c009820 con 0x7f60440b2d80 2023-11-13T11:29:54.692 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:54.681+0000 7f604b1ec640 1 -- 172.21.15.102:0/2648993655 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f60440b2d80 msgr2=0x7f604406fcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:54.693 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:54.681+0000 7f604b1ec640 1 --2- 172.21.15.102:0/2648993655 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f60440b2d80 0x7f604406fcd0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f604406e1e0 tx=0x7f603c01e880 comp rx=0 tx=0).stop 2023-11-13T11:29:54.693 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:54.681+0000 7f604b1ec640 1 -- 172.21.15.102:0/2648993655 shutdown_connections 2023-11-13T11:29:54.693 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:54.681+0000 7f604b1ec640 1 --2- 172.21.15.102:0/2648993655 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f60440b2d80 0x7f604406fcd0 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:54.693 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:54.681+0000 7f604b1ec640 1 --2- 172.21.15.102:0/2648993655 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f604406db40 0x7f60440b2840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:54.693 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:54.681+0000 7f604b1ec640 1 --2- 172.21.15.102:0/2648993655 >> v2:172.21.15.154:3300/0 conn(0x7f60441540c0 0x7f604406d600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:54.694 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:54.681+0000 7f604b1ec640 1 -- 172.21.15.102:0/2648993655 >> 172.21.15.102:0/2648993655 conn(0x7f60440b0690 msgr2=0x7f60440b0aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-13T11:29:54.694 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:54.681+0000 7f604b1ec640 1 -- 172.21.15.102:0/2648993655 shutdown_connections 2023-11-13T11:29:54.694 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:54.681+0000 7f604b1ec640 1 -- 172.21.15.102:0/2648993655 wait complete. 2023-11-13T11:29:54.694 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:54.681+0000 7f604b1ec640 1 Processor -- start 2023-11-13T11:29:54.695 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:54.685+0000 7f604b1ec640 1 -- start start 2023-11-13T11:29:54.698 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:54.685+0000 7f604b1ec640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f604406db40 0x7f6044142480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:54.698 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:54.685+0000 7f604b1ec640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f60440b2d80 0x7f60441447a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:54.699 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:54.685+0000 7f604b1ec640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f60441540c0 0x7f6044144ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:54.699 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:54.685+0000 7f604b1ec640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6044150730 con 0x7f60440b2d80 2023-11-13T11:29:54.699 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:54.685+0000 7f604b1ec640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6044145220 con 0x7f60441540c0 2023-11-13T11:29:54.699 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:54.685+0000 7f604b1ec640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6044150980 con 0x7f604406db40 2023-11-13T11:29:54.700 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:54.685+0000 7f6043fff640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f60440b2d80 0x7f60441447a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:54.700 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:54.685+0000 7f6043fff640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f60440b2d80 0x7f60441447a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:46538/0 (socket says 172.21.15.102:46538) 2023-11-13T11:29:54.700 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:54.685+0000 7f6043fff640 1 -- 172.21.15.102:0/2513448754 learned_addr learned my addr 172.21.15.102:0/2513448754 (peer_addr_for_me v2:172.21.15.102:0/0) 2023-11-13T11:29:54.700 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:54.685+0000 7f6049789640 1 --2- 172.21.15.102:0/2513448754 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f60441540c0 0x7f6044144ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:54.700 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:54.685+0000 7f6048f88640 1 --2- 172.21.15.102:0/2513448754 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f604406db40 0x7f6044142480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:54.701 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:54.685+0000 7f6043fff640 1 -- 172.21.15.102:0/2513448754 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f604406db40 msgr2=0x7f6044142480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:54.701 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:54.685+0000 7f6043fff640 1 --2- 172.21.15.102:0/2513448754 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f604406db40 0x7f6044142480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:54.701 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:54.685+0000 7f6043fff640 1 -- 172.21.15.102:0/2513448754 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f60441540c0 msgr2=0x7f6044144ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:54.701 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:54.685+0000 7f6043fff640 1 --2- 172.21.15.102:0/2513448754 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f60441540c0 0x7f6044144ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:54.702 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:54.685+0000 7f6043fff640 1 -- 172.21.15.102:0/2513448754 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f603c00bd40 con 0x7f60440b2d80 2023-11-13T11:29:54.702 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:54.685+0000 7f6043fff640 1 --2- 172.21.15.102:0/2513448754 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f60440b2d80 0x7f60441447a0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f603000e930 tx=0x7f603000edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-13T11:29:54.702 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:54.685+0000 7f60417fa640 1 -- 172.21.15.102:0/2513448754 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6030009690 con 0x7f60440b2d80 2023-11-13T11:29:54.702 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:54.685+0000 7f60417fa640 1 -- 172.21.15.102:0/2513448754 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f603000ca00 con 0x7f60440b2d80 2023-11-13T11:29:54.702 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:54.685+0000 7f604b1ec640 1 -- 172.21.15.102:0/2513448754 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6044150c60 con 0x7f60440b2d80 2023-11-13T11:29:54.703 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:54.685+0000 7f60417fa640 1 -- 172.21.15.102:0/2513448754 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f603000cd70 con 0x7f60440b2d80 2023-11-13T11:29:54.703 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:54.685+0000 7f604b1ec640 1 -- 172.21.15.102:0/2513448754 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6044151220 con 0x7f60440b2d80 2023-11-13T11:29:54.703 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:54.685+0000 7f604b1ec640 1 -- 172.21.15.102:0/2513448754 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6044067b50 con 0x7f60440b2d80 2023-11-13T11:29:54.703 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:54.689+0000 7f60417fa640 1 -- 172.21.15.102:0/2513448754 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f6030013470 con 0x7f60440b2d80 2023-11-13T11:29:54.703 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:54.689+0000 7f60417fa640 1 --2- 172.21.15.102:0/2513448754 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f6028066470 0x7f6028068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:54.704 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:54.689+0000 7f60417fa640 1 -- 172.21.15.102:0/2513448754 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f6030084160 con 0x7f60440b2d80 2023-11-13T11:29:54.704 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:54.689+0000 7f6048f88640 1 --2- 172.21.15.102:0/2513448754 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f6028066470 0x7f6028068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:54.704 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:54.689+0000 7f6048f88640 1 --2- 172.21.15.102:0/2513448754 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f6028066470 0x7f6028068930 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f6038006e90 tx=0x7f6038008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-13T11:29:54.705 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:54.693+0000 7f60417fa640 1 -- 172.21.15.102:0/2513448754 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f6030051a00 con 0x7f60440b2d80 2023-11-13T11:29:54.850 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:54.841+0000 7f604b1ec640 1 -- 172.21.15.102:0/2513448754 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f6044068590 con 0x7f60440b2d80 2023-11-13T11:29:55.103 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:55.093+0000 7f60417fa640 1 -- 172.21.15.102:0/2513448754 <== mon.0 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v33) v1 ==== 138+0+0 (secure 0 0 0) 0x7f6030055020 con 0x7f60440b2d80 2023-11-13T11:29:55.103 INFO:teuthology.orchestra.run.smithi102.stderr:pool 'cephfs_metadata' created 2023-11-13T11:29:55.105 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:55.097+0000 7f604b1ec640 1 -- 172.21.15.102:0/2513448754 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f6028066470 msgr2=0x7f6028068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:55.105 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:55.097+0000 7f604b1ec640 1 --2- 172.21.15.102:0/2513448754 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f6028066470 0x7f6028068930 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f6038006e90 tx=0x7f6038008040 comp rx=0 tx=0).stop 2023-11-13T11:29:55.105 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:55.097+0000 7f604b1ec640 1 -- 172.21.15.102:0/2513448754 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f60440b2d80 msgr2=0x7f60441447a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:55.106 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:55.097+0000 7f604b1ec640 1 --2- 172.21.15.102:0/2513448754 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f60440b2d80 0x7f60441447a0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f603000e930 tx=0x7f603000edf0 comp rx=0 tx=0).stop 2023-11-13T11:29:55.106 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:55.097+0000 7f604b1ec640 1 -- 172.21.15.102:0/2513448754 shutdown_connections 2023-11-13T11:29:55.106 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:55.097+0000 7f604b1ec640 1 --2- 172.21.15.102:0/2513448754 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f60441540c0 0x7f6044144ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:55.106 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:55.097+0000 7f604b1ec640 1 --2- 172.21.15.102:0/2513448754 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f6028066470 0x7f6028068930 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:55.106 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:55.097+0000 7f604b1ec640 1 --2- 172.21.15.102:0/2513448754 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f60440b2d80 0x7f60441447a0 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:55.107 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:55.097+0000 7f604b1ec640 1 --2- 172.21.15.102:0/2513448754 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f604406db40 0x7f6044142480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:55.107 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:55.097+0000 7f604b1ec640 1 -- 172.21.15.102:0/2513448754 >> 172.21.15.102:0/2513448754 conn(0x7f60440b0690 msgr2=0x7f60440cc560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-13T11:29:55.107 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:55.097+0000 7f604b1ec640 1 -- 172.21.15.102:0/2513448754 shutdown_connections 2023-11-13T11:29:55.108 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:55.097+0000 7f604b1ec640 1 -- 172.21.15.102:0/2513448754 wait complete. 2023-11-13T11:29:55.131 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-11-13T11:29:55.275 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:55.265+0000 7f8f8005a640 1 Processor -- start 2023-11-13T11:29:55.275 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:55.265+0000 7f8f8005a640 1 -- start start 2023-11-13T11:29:55.277 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:55.269+0000 7f8f8005a640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8f78144310 0x7f8f7806bc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:55.277 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:55.269+0000 7f8f8005a640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f8f781446f0 0x7f8f780b36e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:55.277 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:55.269+0000 7f8f8005a640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f8f780b3c20 0x7f8f7815e810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:55.277 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:55.269+0000 7f8f8005a640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8f7815f710 con 0x7f8f781446f0 2023-11-13T11:29:55.277 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:55.269+0000 7f8f8005a640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8f780cd8e0 con 0x7f8f780b3c20 2023-11-13T11:29:55.278 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:55.269+0000 7f8f8005a640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8f780b1a30 con 0x7f8f78144310 2023-11-13T11:29:55.278 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:55.269+0000 7f8f7d5f5640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f8f781446f0 0x7f8f780b36e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:55.278 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:55.269+0000 7f8f7d5f5640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f8f781446f0 0x7f8f780b36e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:46552/0 (socket says 172.21.15.102:46552) 2023-11-13T11:29:55.278 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:55.269+0000 7f8f7d5f5640 1 -- 172.21.15.102:0/3548905769 learned_addr learned my addr 172.21.15.102:0/3548905769 (peer_addr_for_me v2:172.21.15.102:0/0) 2023-11-13T11:29:55.278 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:55.269+0000 7f8f7e5f7640 1 --2- 172.21.15.102:0/3548905769 >> v2:172.21.15.154:3300/0 conn(0x7f8f780b3c20 0x7f8f7815e810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:55.279 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:55.269+0000 7f8f7ddf6640 1 --2- 172.21.15.102:0/3548905769 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8f78144310 0x7f8f7806bc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:55.279 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:55.269+0000 7f8f7d5f5640 1 -- 172.21.15.102:0/3548905769 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8f78144310 msgr2=0x7f8f7806bc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-13T11:29:55.279 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:55.269+0000 7f8f7d5f5640 1 --2- 172.21.15.102:0/3548905769 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8f78144310 0x7f8f7806bc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:55.279 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:55.269+0000 7f8f7d5f5640 1 -- 172.21.15.102:0/3548905769 >> v2:172.21.15.154:3300/0 conn(0x7f8f780b3c20 msgr2=0x7f8f7815e810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-13T11:29:55.279 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:55.269+0000 7f8f7d5f5640 1 --2- 172.21.15.102:0/3548905769 >> v2:172.21.15.154:3300/0 conn(0x7f8f780b3c20 0x7f8f7815e810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:55.280 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:55.269+0000 7f8f7d5f5640 1 -- 172.21.15.102:0/3548905769 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f780cdb30 con 0x7f8f781446f0 2023-11-13T11:29:55.281 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:55.273+0000 7f8f7d5f5640 1 --2- 172.21.15.102:0/3548905769 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8f781446f0 0x7f8f780b36e0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f8f780cc9f0 tx=0x7f8f6801c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cfa2cee0d4f05583 server_cookie=0 in_seq=0 out_seq=0 2023-11-13T11:29:55.281 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:55.273+0000 7f8f7cdf4640 1 -- 172.21.15.102:0/3548905769 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f680ac600 con 0x7f8f781446f0 2023-11-13T11:29:55.281 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:55.273+0000 7f8f7cdf4640 1 -- 172.21.15.102:0/3548905769 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f680a8050 con 0x7f8f781446f0 2023-11-13T11:29:55.281 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:55.273+0000 7f8f7cdf4640 1 -- 172.21.15.102:0/3548905769 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f680ac980 con 0x7f8f781446f0 2023-11-13T11:29:55.281 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:55.273+0000 7f8f8005a640 1 -- 172.21.15.102:0/3548905769 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8f781446f0 msgr2=0x7f8f780b36e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:55.282 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:55.273+0000 7f8f8005a640 1 --2- 172.21.15.102:0/3548905769 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8f781446f0 0x7f8f780b36e0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f8f780cc9f0 tx=0x7f8f6801c4d0 comp rx=0 tx=0).stop 2023-11-13T11:29:55.282 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:55.273+0000 7f8f8005a640 1 -- 172.21.15.102:0/3548905769 shutdown_connections 2023-11-13T11:29:55.282 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:55.273+0000 7f8f8005a640 1 --2- 172.21.15.102:0/3548905769 >> v2:172.21.15.154:3300/0 conn(0x7f8f780b3c20 0x7f8f7815e810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:55.282 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:55.273+0000 7f8f8005a640 1 --2- 172.21.15.102:0/3548905769 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8f781446f0 0x7f8f780b36e0 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:55.283 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:55.273+0000 7f8f8005a640 1 --2- 172.21.15.102:0/3548905769 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8f78144310 0x7f8f7806bc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:55.283 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:55.273+0000 7f8f8005a640 1 -- 172.21.15.102:0/3548905769 >> 172.21.15.102:0/3548905769 conn(0x7f8f780b0690 msgr2=0x7f8f780b0aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-13T11:29:55.283 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:55.273+0000 7f8f8005a640 1 -- 172.21.15.102:0/3548905769 shutdown_connections 2023-11-13T11:29:55.283 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:55.273+0000 7f8f8005a640 1 -- 172.21.15.102:0/3548905769 wait complete. 2023-11-13T11:29:55.286 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:55.273+0000 7f8f8005a640 1 Processor -- start 2023-11-13T11:29:55.286 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:55.273+0000 7f8f8005a640 1 -- start start 2023-11-13T11:29:55.286 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:55.277+0000 7f8f8005a640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8f780b3c20 0x7f8f7813e920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:55.286 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:55.277+0000 7f8f8005a640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8f78144310 0x7f8f7813bae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:55.287 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:55.277+0000 7f8f8005a640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8f781446f0 0x7f8f78139e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:55.287 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:55.277+0000 7f8f8005a640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f7813ee60 con 0x7f8f78144310 2023-11-13T11:29:55.287 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:55.277+0000 7f8f8005a640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f78070980 con 0x7f8f780b3c20 2023-11-13T11:29:55.287 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:55.277+0000 7f8f8005a640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8f7813c020 con 0x7f8f781446f0 2023-11-13T11:29:55.287 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:55.277+0000 7f8f7d5f5640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8f78144310 0x7f8f7813bae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:55.288 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:55.277+0000 7f8f7d5f5640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8f78144310 0x7f8f7813bae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:46566/0 (socket says 172.21.15.102:46566) 2023-11-13T11:29:55.288 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:55.277+0000 7f8f7d5f5640 1 -- 172.21.15.102:0/2056845456 learned_addr learned my addr 172.21.15.102:0/2056845456 (peer_addr_for_me v2:172.21.15.102:0/0) 2023-11-13T11:29:55.288 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:55.277+0000 7f8f7ddf6640 1 --2- 172.21.15.102:0/2056845456 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8f780b3c20 0x7f8f7813e920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:55.288 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:55.277+0000 7f8f7e5f7640 1 --2- 172.21.15.102:0/2056845456 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8f781446f0 0x7f8f78139e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:55.288 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:55.277+0000 7f8f7d5f5640 1 -- 172.21.15.102:0/2056845456 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8f781446f0 msgr2=0x7f8f78139e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:55.288 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:55.277+0000 7f8f7d5f5640 1 --2- 172.21.15.102:0/2056845456 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8f781446f0 0x7f8f78139e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:55.289 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:55.277+0000 7f8f7d5f5640 1 -- 172.21.15.102:0/2056845456 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8f780b3c20 msgr2=0x7f8f7813e920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:55.289 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:55.277+0000 7f8f7d5f5640 1 --2- 172.21.15.102:0/2056845456 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8f780b3c20 0x7f8f7813e920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:55.289 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:55.277+0000 7f8f7d5f5640 1 -- 172.21.15.102:0/2056845456 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f680094d0 con 0x7f8f78144310 2023-11-13T11:29:55.289 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:55.277+0000 7f8f7ddf6640 1 --2- 172.21.15.102:0/2056845456 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8f780b3c20 0x7f8f7813e920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-13T11:29:55.290 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:55.277+0000 7f8f7d5f5640 1 --2- 172.21.15.102:0/2056845456 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8f78144310 0x7f8f7813bae0 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f8f6801cd70 tx=0x7f8f68019270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-13T11:29:55.290 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:55.277+0000 7f8f6e7fc640 1 -- 172.21.15.102:0/2056845456 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f680b5830 con 0x7f8f78144310 2023-11-13T11:29:55.290 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:55.277+0000 7f8f6e7fc640 1 -- 172.21.15.102:0/2056845456 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f680b5990 con 0x7f8f78144310 2023-11-13T11:29:55.291 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:55.277+0000 7f8f8005a640 1 -- 172.21.15.102:0/2056845456 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8f7806fd70 con 0x7f8f78144310 2023-11-13T11:29:55.291 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:55.277+0000 7f8f6e7fc640 1 -- 172.21.15.102:0/2056845456 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f680b5d20 con 0x7f8f78144310 2023-11-13T11:29:55.291 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:55.277+0000 7f8f8005a640 1 -- 172.21.15.102:0/2056845456 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8f78070330 con 0x7f8f78144310 2023-11-13T11:29:55.292 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:55.277+0000 7f8f8005a640 1 -- 172.21.15.102:0/2056845456 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8f78067b50 con 0x7f8f78144310 2023-11-13T11:29:55.293 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:55.281+0000 7f8f6e7fc640 1 -- 172.21.15.102:0/2056845456 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f8f680b3070 con 0x7f8f78144310 2023-11-13T11:29:55.293 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:55.281+0000 7f8f6e7fc640 1 --2- 172.21.15.102:0/2056845456 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f8f5c066470 0x7f8f5c068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:55.294 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:55.281+0000 7f8f6e7fc640 1 -- 172.21.15.102:0/2056845456 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5227+0+0 (secure 0 0 0) 0x7f8f6811e1c0 con 0x7f8f78144310 2023-11-13T11:29:55.294 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:55.281+0000 7f8f7ddf6640 1 --2- 172.21.15.102:0/2056845456 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f8f5c066470 0x7f8f5c068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:55.294 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:55.281+0000 7f8f7ddf6640 1 --2- 172.21.15.102:0/2056845456 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f8f5c066470 0x7f8f5c068930 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f8f7815ab80 tx=0x7f8f74008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-13T11:29:55.295 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:55.285+0000 7f8f6e7fc640 1 -- 172.21.15.102:0/2056845456 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f8f680eb820 con 0x7f8f78144310 2023-11-13T11:29:55.442 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:55.433+0000 7f8f8005a640 1 -- 172.21.15.102:0/2056845456 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f8f78068590 con 0x7f8f78144310 2023-11-13T11:29:56.114 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:56.105+0000 7f8f6e7fc640 1 -- 172.21.15.102:0/2056845456 <== mon.0 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v34) v1 ==== 170+0+0 (secure 0 0 0) 0x7f8f680eee40 con 0x7f8f78144310 2023-11-13T11:29:56.115 INFO:teuthology.orchestra.run.smithi102.stderr:pool 'cephfs_data' created 2023-11-13T11:29:56.116 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:56.109+0000 7f8f8005a640 1 -- 172.21.15.102:0/2056845456 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f8f5c066470 msgr2=0x7f8f5c068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:56.117 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:56.109+0000 7f8f8005a640 1 --2- 172.21.15.102:0/2056845456 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f8f5c066470 0x7f8f5c068930 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f8f7815ab80 tx=0x7f8f74008040 comp rx=0 tx=0).stop 2023-11-13T11:29:56.117 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:56.109+0000 7f8f8005a640 1 -- 172.21.15.102:0/2056845456 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8f78144310 msgr2=0x7f8f7813bae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:56.117 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:56.109+0000 7f8f8005a640 1 --2- 172.21.15.102:0/2056845456 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8f78144310 0x7f8f7813bae0 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f8f6801cd70 tx=0x7f8f68019270 comp rx=0 tx=0).stop 2023-11-13T11:29:56.117 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:56.109+0000 7f8f8005a640 1 -- 172.21.15.102:0/2056845456 shutdown_connections 2023-11-13T11:29:56.118 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:56.109+0000 7f8f8005a640 1 --2- 172.21.15.102:0/2056845456 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8f781446f0 0x7f8f78139e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:56.118 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:56.109+0000 7f8f8005a640 1 --2- 172.21.15.102:0/2056845456 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f8f5c066470 0x7f8f5c068930 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:56.118 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:56.109+0000 7f8f8005a640 1 --2- 172.21.15.102:0/2056845456 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8f78144310 0x7f8f7813bae0 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:56.118 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:56.109+0000 7f8f8005a640 1 --2- 172.21.15.102:0/2056845456 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8f780b3c20 0x7f8f7813e920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:56.118 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:56.109+0000 7f8f8005a640 1 -- 172.21.15.102:0/2056845456 >> 172.21.15.102:0/2056845456 conn(0x7f8f780b0690 msgr2=0x7f8f78165190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-13T11:29:56.119 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:56.109+0000 7f8f8005a640 1 -- 172.21.15.102:0/2056845456 shutdown_connections 2023-11-13T11:29:56.119 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:56.109+0000 7f8f8005a640 1 -- 172.21.15.102:0/2056845456 wait complete. 2023-11-13T11:29:56.157 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-11-13T11:29:56.300 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:56.293+0000 7fac253d1640 1 Processor -- start 2023-11-13T11:29:56.300 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:56.293+0000 7fac253d1640 1 -- start start 2023-11-13T11:29:56.303 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:56.293+0000 7fac253d1640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fac2015d600 0x7fac200b2e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:56.303 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:56.293+0000 7fac253d1640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fac200b3840 con 0x7fac2015d220 2023-11-13T11:29:56.303 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:56.293+0000 7fac253d1640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fac200cecb0 con 0x7fac200b3f60 2023-11-13T11:29:56.303 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:56.293+0000 7fac253d1640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fac200d0d00 con 0x7fac2015d600 2023-11-13T11:29:56.304 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:56.293+0000 7fac1effd640 1 --1- >> v1:172.21.15.102:6789/0 conn(0x7fac2015d220 0x7fac200b2750 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.102:6789/0 says I am v1:172.21.15.102:39466/0 (socket says 172.21.15.102:39466) 2023-11-13T11:29:56.304 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:56.293+0000 7fac1effd640 1 -- 172.21.15.102:0/4125486991 learned_addr learned my addr 172.21.15.102:0/4125486991 (peer_addr_for_me v1:172.21.15.102:0/0) 2023-11-13T11:29:56.304 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:56.293+0000 7fac1e7fc640 1 --2- 172.21.15.102:0/4125486991 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fac2015d600 0x7fac200b2e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:56.304 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:56.293+0000 7fac1dffb640 1 -- 172.21.15.102:0/4125486991 <== mon.0 v1:172.21.15.102:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 225222053 0 0) 0x7fac200b3840 con 0x7fac2015d220 2023-11-13T11:29:56.304 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:56.293+0000 7fac1dffb640 1 -- 172.21.15.102:0/4125486991 --> v1:172.21.15.102:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fac08003530 con 0x7fac2015d220 2023-11-13T11:29:56.304 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:56.293+0000 7fac1dffb640 1 -- 172.21.15.102:0/4125486991 <== mon.0 v1:172.21.15.102:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2754599141 0 0) 0x7fac08003530 con 0x7fac2015d220 2023-11-13T11:29:56.305 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:56.293+0000 7fac1dffb640 1 -- 172.21.15.102:0/4125486991 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fac2015d600 msgr2=0x7fac200b2e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-13T11:29:56.305 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:56.293+0000 7fac1dffb640 1 --2- 172.21.15.102:0/4125486991 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fac2015d600 0x7fac200b2e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:56.305 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:56.293+0000 7fac1dffb640 1 -- 172.21.15.102:0/4125486991 >> v1:172.21.15.154:6789/0 conn(0x7fac200b3f60 legacy=0x7fac200cf420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:56.305 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:56.293+0000 7fac1dffb640 1 -- 172.21.15.102:0/4125486991 --> v1:172.21.15.102:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac200d0fe0 con 0x7fac2015d220 2023-11-13T11:29:56.306 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:56.293+0000 7fac1dffb640 1 -- 172.21.15.102:0/4125486991 <== mon.0 v1:172.21.15.102:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 895381068 0 0) 0x7fac10001680 con 0x7fac2015d220 2023-11-13T11:29:56.306 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:56.293+0000 7fac1dffb640 1 -- 172.21.15.102:0/4125486991 >> v1:172.21.15.102:6789/0 conn(0x7fac2015d220 legacy=0x7fac200b2750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:56.306 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:56.293+0000 7fac1dffb640 1 --2- 172.21.15.102:0/4125486991 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fac080039b0 0x7fac08003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:56.306 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:56.293+0000 7fac1dffb640 1 --2- 172.21.15.102:0/4125486991 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fac2015d600 0x7fac080047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:56.306 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:56.293+0000 7fac1dffb640 1 --2- 172.21.15.102:0/4125486991 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fac08004d10 0x7fac08005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:56.307 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:56.293+0000 7fac1dffb640 1 -- 172.21.15.102:0/4125486991 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac200d0d00 con 0x7fac080039b0 2023-11-13T11:29:56.307 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:56.293+0000 7fac1dffb640 1 -- 172.21.15.102:0/4125486991 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac0800bb20 con 0x7fac08004d10 2023-11-13T11:29:56.307 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:56.293+0000 7fac1dffb640 1 -- 172.21.15.102:0/4125486991 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fac0800bce0 con 0x7fac2015d600 2023-11-13T11:29:56.307 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:56.293+0000 7fac1effd640 1 --2- 172.21.15.102:0/4125486991 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fac080039b0 0x7fac08003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:56.308 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:56.293+0000 7fac1e7fc640 1 --2- 172.21.15.102:0/4125486991 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fac2015d600 0x7fac080047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:56.308 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:56.293+0000 7fac1effd640 1 -- 172.21.15.102:0/4125486991 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fac2015d600 msgr2=0x7fac080047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-13T11:29:56.308 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:56.293+0000 7fac1effd640 1 --2- 172.21.15.102:0/4125486991 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fac2015d600 0x7fac080047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:56.308 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:56.293+0000 7fac1effd640 1 -- 172.21.15.102:0/4125486991 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fac08004d10 msgr2=0x7fac08005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-13T11:29:56.308 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:56.293+0000 7fac1f7fe640 1 --2- 172.21.15.102:0/4125486991 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fac08004d10 0x7fac08005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:56.309 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:56.293+0000 7fac1effd640 1 --2- 172.21.15.102:0/4125486991 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fac08004d10 0x7fac08005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:56.309 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:56.293+0000 7fac1effd640 1 -- 172.21.15.102:0/4125486991 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac08003530 con 0x7fac080039b0 2023-11-13T11:29:56.309 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:56.293+0000 7fac1f7fe640 1 --2- 172.21.15.102:0/4125486991 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fac08004d10 0x7fac08005190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-13T11:29:56.309 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:56.293+0000 7fac1e7fc640 1 --2- 172.21.15.102:0/4125486991 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fac2015d600 0x7fac080047d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-13T11:29:56.312 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:56.297+0000 7fac1effd640 1 --2- 172.21.15.102:0/4125486991 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fac080039b0 0x7fac08003d90 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7fac1000c190 tx=0x7fac1001cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=708f8b5ffdd22574 server_cookie=0 in_seq=0 out_seq=0 2023-11-13T11:29:56.312 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:56.297+0000 7fac1dffb640 1 -- 172.21.15.102:0/4125486991 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac10005ae0 con 0x7fac080039b0 2023-11-13T11:29:56.313 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:56.297+0000 7fac1dffb640 1 -- 172.21.15.102:0/4125486991 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac10005c40 con 0x7fac080039b0 2023-11-13T11:29:56.313 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:56.297+0000 7fac1dffb640 1 -- 172.21.15.102:0/4125486991 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac10007070 con 0x7fac080039b0 2023-11-13T11:29:56.313 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:56.297+0000 7fac253d1640 1 -- 172.21.15.102:0/4125486991 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fac080039b0 msgr2=0x7fac08003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:56.313 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:56.297+0000 7fac253d1640 1 --2- 172.21.15.102:0/4125486991 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fac080039b0 0x7fac08003d90 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7fac1000c190 tx=0x7fac1001cbf0 comp rx=0 tx=0).stop 2023-11-13T11:29:56.313 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:56.297+0000 7fac1f7fe640 1 -- 172.21.15.102:0/4125486991 reap_dead start 2023-11-13T11:29:56.314 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:56.297+0000 7fac253d1640 1 -- 172.21.15.102:0/4125486991 shutdown_connections 2023-11-13T11:29:56.314 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:56.297+0000 7fac253d1640 1 -- 172.21.15.102:0/4125486991 >> 172.21.15.102:0/4125486991 conn(0x7fac200d2df0 msgr2=0x7fac200d3200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-13T11:29:56.314 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:56.297+0000 7fac253d1640 1 -- 172.21.15.102:0/4125486991 shutdown_connections 2023-11-13T11:29:56.314 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:56.297+0000 7fac253d1640 1 -- 172.21.15.102:0/4125486991 wait complete. 2023-11-13T11:29:56.315 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:56.301+0000 7fac253d1640 1 Processor -- start 2023-11-13T11:29:56.315 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:56.301+0000 7fac253d1640 1 -- start start 2023-11-13T11:29:56.315 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:56.301+0000 7fac253d1640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fac080039b0 0x7fac2015aff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:56.315 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:56.301+0000 7fac253d1640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fac201553a0 0x7fac200b0030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:56.315 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:56.301+0000 7fac253d1640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fac201547a0 0x7fac20154c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:56.316 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:56.301+0000 7fac253d1640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac20155190 con 0x7fac080039b0 2023-11-13T11:29:56.316 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:56.301+0000 7fac253d1640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac201594d0 con 0x7fac201553a0 2023-11-13T11:29:56.316 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:56.301+0000 7fac253d1640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fac201597b0 con 0x7fac201547a0 2023-11-13T11:29:56.316 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:56.301+0000 7fac1effd640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fac080039b0 0x7fac2015aff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:56.316 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:56.301+0000 7fac1effd640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fac080039b0 0x7fac2015aff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:46588/0 (socket says 172.21.15.102:46588) 2023-11-13T11:29:56.317 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:56.301+0000 7fac1effd640 1 -- 172.21.15.102:0/1576928609 learned_addr learned my addr 172.21.15.102:0/1576928609 (peer_addr_for_me v2:172.21.15.102:0/0) 2023-11-13T11:29:56.317 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:56.301+0000 7fac1e7fc640 1 --2- 172.21.15.102:0/1576928609 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fac201553a0 0x7fac200b0030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:56.317 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:56.301+0000 7fac1f7fe640 1 --2- 172.21.15.102:0/1576928609 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fac201547a0 0x7fac20154c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:56.317 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:56.301+0000 7fac1effd640 1 -- 172.21.15.102:0/1576928609 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fac201547a0 msgr2=0x7fac20154c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:56.317 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:56.301+0000 7fac1effd640 1 --2- 172.21.15.102:0/1576928609 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fac201547a0 0x7fac20154c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:56.318 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:56.301+0000 7fac1effd640 1 -- 172.21.15.102:0/1576928609 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fac201553a0 msgr2=0x7fac200b0030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:56.318 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:56.301+0000 7fac1effd640 1 --2- 172.21.15.102:0/1576928609 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fac201553a0 0x7fac200b0030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:56.318 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:56.301+0000 7fac1effd640 1 -- 172.21.15.102:0/1576928609 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac20159a90 con 0x7fac080039b0 2023-11-13T11:29:56.318 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:56.301+0000 7fac1f7fe640 1 --2- 172.21.15.102:0/1576928609 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fac201547a0 0x7fac20154c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-13T11:29:56.318 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:56.301+0000 7fac1effd640 1 --2- 172.21.15.102:0/1576928609 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fac080039b0 0x7fac2015aff0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7fac1000c190 tx=0x7fac08005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-13T11:29:56.319 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:56.301+0000 7fac077fe640 1 -- 172.21.15.102:0/1576928609 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac100b4070 con 0x7fac080039b0 2023-11-13T11:29:56.319 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:56.301+0000 7fac077fe640 1 -- 172.21.15.102:0/1576928609 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac100013c0 con 0x7fac080039b0 2023-11-13T11:29:56.319 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:56.301+0000 7fac077fe640 1 -- 172.21.15.102:0/1576928609 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac10007090 con 0x7fac080039b0 2023-11-13T11:29:56.319 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:56.301+0000 7fac253d1640 1 -- 172.21.15.102:0/1576928609 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fac20159d70 con 0x7fac080039b0 2023-11-13T11:29:56.319 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:56.301+0000 7fac253d1640 1 -- 172.21.15.102:0/1576928609 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fac2015b530 con 0x7fac080039b0 2023-11-13T11:29:56.320 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:56.305+0000 7fac253d1640 1 -- 172.21.15.102:0/1576928609 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fac20068520 con 0x7fac080039b0 2023-11-13T11:29:56.321 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:56.305+0000 7fac077fe640 1 -- 172.21.15.102:0/1576928609 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fac100071f0 con 0x7fac080039b0 2023-11-13T11:29:56.321 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:56.305+0000 7fac077fe640 1 --2- 172.21.15.102:0/1576928609 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7fac0c066470 0x7fac0c068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:56.321 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:56.305+0000 7fac077fe640 1 -- 172.21.15.102:0/1576928609 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5609+0+0 (secure 0 0 0) 0x7fac1011d7d0 con 0x7fac080039b0 2023-11-13T11:29:56.321 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:56.305+0000 7fac1e7fc640 1 --2- 172.21.15.102:0/1576928609 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7fac0c066470 0x7fac0c068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:56.321 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:56.309+0000 7fac1e7fc640 1 --2- 172.21.15.102:0/1576928609 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7fac0c066470 0x7fac0c068930 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fac200b2c80 tx=0x7fac14008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-13T11:29:56.322 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:56.309+0000 7fac077fe640 1 -- 172.21.15.102:0/1576928609 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fac100ead40 con 0x7fac080039b0 2023-11-13T11:29:56.499 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:56.493+0000 7fac253d1640 1 -- 172.21.15.102:0/1576928609 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7fac2008c5a0 con 0x7fac080039b0 2023-11-13T11:29:57.116 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:57.109+0000 7fac077fe640 1 -- 172.21.15.102:0/1576928609 <== mon.0 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 4 and data pool 5 v12) v1 ==== 172+0+0 (secure 0 0 0) 0x7fac100bf0c0 con 0x7fac080039b0 2023-11-13T11:29:57.117 INFO:teuthology.orchestra.run.smithi102.stderr:new fs with metadata pool 4 and data pool 5 2023-11-13T11:29:57.118 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:57.109+0000 7fac253d1640 1 -- 172.21.15.102:0/1576928609 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7fac0c066470 msgr2=0x7fac0c068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:57.119 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:57.109+0000 7fac253d1640 1 --2- 172.21.15.102:0/1576928609 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7fac0c066470 0x7fac0c068930 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fac200b2c80 tx=0x7fac14008040 comp rx=0 tx=0).stop 2023-11-13T11:29:57.119 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:57.109+0000 7fac253d1640 1 -- 172.21.15.102:0/1576928609 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fac080039b0 msgr2=0x7fac2015aff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:57.119 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:57.109+0000 7fac253d1640 1 --2- 172.21.15.102:0/1576928609 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fac080039b0 0x7fac2015aff0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7fac1000c190 tx=0x7fac08005800 comp rx=0 tx=0).stop 2023-11-13T11:29:57.119 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:57.109+0000 7fac253d1640 1 -- 172.21.15.102:0/1576928609 shutdown_connections 2023-11-13T11:29:57.119 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:57.109+0000 7fac253d1640 1 --2- 172.21.15.102:0/1576928609 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fac201547a0 0x7fac20154c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:57.120 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:57.109+0000 7fac253d1640 1 --2- 172.21.15.102:0/1576928609 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fac201553a0 0x7fac200b0030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:57.120 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:57.109+0000 7fac253d1640 1 --2- 172.21.15.102:0/1576928609 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7fac0c066470 0x7fac0c068930 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:57.120 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:57.109+0000 7fac253d1640 1 --2- 172.21.15.102:0/1576928609 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fac080039b0 0x7fac2015aff0 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:57.120 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:57.109+0000 7fac253d1640 1 -- 172.21.15.102:0/1576928609 >> 172.21.15.102:0/1576928609 conn(0x7fac200d2df0 msgr2=0x7fac200ce010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-13T11:29:57.121 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:57.113+0000 7fac253d1640 1 -- 172.21.15.102:0/1576928609 shutdown_connections 2023-11-13T11:29:57.121 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:57.113+0000 7fac253d1640 1 -- 172.21.15.102:0/1576928609 wait complete. 2023-11-13T11:29:57.147 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-13T11:29:57.288 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:57.281+0000 7f74b21f8640 1 Processor -- start 2023-11-13T11:29:57.288 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:57.281+0000 7f74b21f8640 1 -- start start 2023-11-13T11:29:57.289 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:57.281+0000 7f74b21f8640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f74ac15d300 0x7f74ac0cf810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:57.290 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:57.281+0000 7f74b21f8640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f74ac0b0a80 con 0x7f74ac06c2c0 2023-11-13T11:29:57.290 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:57.281+0000 7f74b21f8640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f74ac0cfea0 con 0x7f74ac15cf20 2023-11-13T11:29:57.290 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:57.281+0000 7f74b21f8640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f74ac0b0430 con 0x7f74ac15d300 2023-11-13T11:29:57.290 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:57.281+0000 7f74aaffd640 1 --1- >> v1:172.21.15.102:6789/0 conn(0x7f74ac06c2c0 0x7f74ac0b0f10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.102:6789/0 says I am v1:172.21.15.102:39478/0 (socket says 172.21.15.102:39478) 2023-11-13T11:29:57.290 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:57.281+0000 7f74aaffd640 1 -- 172.21.15.102:0/1043230291 learned_addr learned my addr 172.21.15.102:0/1043230291 (peer_addr_for_me v1:172.21.15.102:0/0) 2023-11-13T11:29:57.292 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:57.281+0000 7f74abfff640 1 --2- 172.21.15.102:0/1043230291 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f74ac15d300 0x7f74ac0cf810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:57.293 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:57.281+0000 7f74aa7fc640 1 -- 172.21.15.102:0/1043230291 <== mon.0 v1:172.21.15.102:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 464811147 0 0) 0x7f74ac0b0a80 con 0x7f74ac06c2c0 2023-11-13T11:29:57.293 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:57.281+0000 7f74aa7fc640 1 -- 172.21.15.102:0/1043230291 --> v1:172.21.15.102:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7494003530 con 0x7f74ac06c2c0 2023-11-13T11:29:57.293 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:57.281+0000 7f74aa7fc640 1 -- 172.21.15.102:0/1043230291 <== mon.1 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3231188268 0 0) 0x7f74ac0cfea0 con 0x7f74ac15cf20 2023-11-13T11:29:57.293 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:57.281+0000 7f74aa7fc640 1 -- 172.21.15.102:0/1043230291 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f74ac0b0a80 con 0x7f74ac15cf20 2023-11-13T11:29:57.293 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:57.281+0000 7f74aa7fc640 1 -- 172.21.15.102:0/1043230291 <== mon.0 v1:172.21.15.102:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3631640325 0 0) 0x7f7494003530 con 0x7f74ac06c2c0 2023-11-13T11:29:57.294 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:57.281+0000 7f74aa7fc640 1 -- 172.21.15.102:0/1043230291 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f74ac15d300 msgr2=0x7f74ac0cf810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-13T11:29:57.294 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:57.281+0000 7f74aa7fc640 1 --2- 172.21.15.102:0/1043230291 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f74ac15d300 0x7f74ac0cf810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:57.294 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:57.281+0000 7f74aa7fc640 1 -- 172.21.15.102:0/1043230291 >> v1:172.21.15.154:6789/0 conn(0x7f74ac15cf20 legacy=0x7f74ac06bbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:57.294 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:57.281+0000 7f74aa7fc640 1 -- 172.21.15.102:0/1043230291 --> v1:172.21.15.102:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74ac0b0710 con 0x7f74ac06c2c0 2023-11-13T11:29:57.294 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:57.281+0000 7f74aa7fc640 1 -- 172.21.15.102:0/1043230291 <== mon.0 v1:172.21.15.102:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 895381068 0 0) 0x7f74a0001680 con 0x7f74ac06c2c0 2023-11-13T11:29:57.295 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:57.281+0000 7f74abfff640 1 --2- 172.21.15.102:0/1043230291 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f74ac15d300 0x7f74ac0cf810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-13T11:29:57.295 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:57.281+0000 7f74aa7fc640 1 -- 172.21.15.102:0/1043230291 >> v1:172.21.15.102:6789/0 conn(0x7f74ac06c2c0 legacy=0x7f74ac0b0f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:57.295 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:57.281+0000 7f74aa7fc640 1 --2- 172.21.15.102:0/1043230291 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7494003b40 0x7f7494003f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:57.295 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:57.281+0000 7f74aa7fc640 1 --2- 172.21.15.102:0/1043230291 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f74ac15d300 0x7f74940047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:57.295 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:57.281+0000 7f74aa7fc640 1 --2- 172.21.15.102:0/1043230291 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7494004d10 0x7f7494005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:57.295 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:57.281+0000 7f74aa7fc640 1 -- 172.21.15.102:0/1043230291 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74ac0b0430 con 0x7f7494004d10 2023-11-13T11:29:57.296 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:57.281+0000 7f74aa7fc640 1 -- 172.21.15.102:0/1043230291 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f749400ba40 con 0x7f7494003b40 2023-11-13T11:29:57.296 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:57.281+0000 7f74aa7fc640 1 -- 172.21.15.102:0/1043230291 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f749400bb80 con 0x7f74ac15d300 2023-11-13T11:29:57.296 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:57.281+0000 7f74abfff640 1 --2- 172.21.15.102:0/1043230291 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7494004d10 0x7f7494005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:57.296 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:57.281+0000 7f74aaffd640 1 --2- 172.21.15.102:0/1043230291 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f74ac15d300 0x7f74940047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:57.296 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:57.281+0000 7f74ab7fe640 1 --2- 172.21.15.102:0/1043230291 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7494003b40 0x7f7494003f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:57.297 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:57.285+0000 7f74abfff640 1 -- 172.21.15.102:0/1043230291 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f74ac15d300 msgr2=0x7f74940047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-13T11:29:57.297 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:57.285+0000 7f74abfff640 1 --2- 172.21.15.102:0/1043230291 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f74ac15d300 0x7f74940047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:57.297 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:57.285+0000 7f74abfff640 1 -- 172.21.15.102:0/1043230291 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7494003b40 msgr2=0x7f7494003f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-13T11:29:57.297 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:57.285+0000 7f74abfff640 1 --2- 172.21.15.102:0/1043230291 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7494003b40 0x7f7494003f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:57.297 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:57.285+0000 7f74abfff640 1 -- 172.21.15.102:0/1043230291 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74a4009a70 con 0x7f7494004d10 2023-11-13T11:29:57.298 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:57.285+0000 7f74ab7fe640 1 --2- 172.21.15.102:0/1043230291 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7494003b40 0x7f7494003f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-13T11:29:57.301 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:57.285+0000 7f74abfff640 1 --2- 172.21.15.102:0/1043230291 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7494004d10 0x7f7494005190 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f74a400e380 tx=0x7f74a401cdc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7d3dedade4888702 server_cookie=0 in_seq=0 out_seq=0 2023-11-13T11:29:57.301 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:57.285+0000 7f74aa7fc640 1 -- 172.21.15.102:0/1043230291 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74a0007ea0 con 0x7f7494004d10 2023-11-13T11:29:57.301 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:57.285+0000 7f74aa7fc640 1 -- 172.21.15.102:0/1043230291 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f74a400f040 con 0x7f7494004d10 2023-11-13T11:29:57.301 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:57.285+0000 7f74aa7fc640 1 -- 172.21.15.102:0/1043230291 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74a40ad440 con 0x7f7494004d10 2023-11-13T11:29:57.302 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:57.285+0000 7f74b21f8640 1 -- 172.21.15.102:0/1043230291 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7494004d10 msgr2=0x7f7494005190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:57.302 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:57.285+0000 7f74b21f8640 1 --2- 172.21.15.102:0/1043230291 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7494004d10 0x7f7494005190 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f74a400e380 tx=0x7f74a401cdc0 comp rx=0 tx=0).stop 2023-11-13T11:29:57.302 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:57.285+0000 7f74abfff640 1 -- 172.21.15.102:0/1043230291 reap_dead start 2023-11-13T11:29:57.302 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:57.285+0000 7f74b21f8640 1 -- 172.21.15.102:0/1043230291 shutdown_connections 2023-11-13T11:29:57.303 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:57.285+0000 7f74b21f8640 1 -- 172.21.15.102:0/1043230291 >> 172.21.15.102:0/1043230291 conn(0x7f74ac0d0b70 msgr2=0x7f74ac0d0f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-13T11:29:57.303 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:57.285+0000 7f74b21f8640 1 -- 172.21.15.102:0/1043230291 shutdown_connections 2023-11-13T11:29:57.303 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:57.289+0000 7f74b21f8640 1 -- 172.21.15.102:0/1043230291 wait complete. 2023-11-13T11:29:57.303 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:57.289+0000 7f74b21f8640 1 Processor -- start 2023-11-13T11:29:57.303 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:57.289+0000 7f74b21f8640 1 -- start start 2023-11-13T11:29:57.304 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:57.289+0000 7f74b21f8640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7494004d10 0x7f74ac148ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:57.304 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:57.289+0000 7f74b21f8640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f74ac153d10 0x7f74ac0d0f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:57.304 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:57.289+0000 7f74b21f8640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f74ac154190 0x7f74ac0d14c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:57.304 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:57.289+0000 7f74b21f8640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74ac1546f0 con 0x7f74ac153d10 2023-11-13T11:29:57.304 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:57.289+0000 7f74b21f8640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74ac1549d0 con 0x7f74ac154190 2023-11-13T11:29:57.305 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:57.289+0000 7f74b21f8640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f74ac154cb0 con 0x7f7494004d10 2023-11-13T11:29:57.305 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:57.289+0000 7f74aaffd640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f74ac153d10 0x7f74ac0d0f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:57.305 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:57.289+0000 7f74aaffd640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f74ac153d10 0x7f74ac0d0f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:46596/0 (socket says 172.21.15.102:46596) 2023-11-13T11:29:57.305 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:57.289+0000 7f74aaffd640 1 -- 172.21.15.102:0/3481159770 learned_addr learned my addr 172.21.15.102:0/3481159770 (peer_addr_for_me v2:172.21.15.102:0/0) 2023-11-13T11:29:57.305 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:57.289+0000 7f74ab7fe640 1 --2- 172.21.15.102:0/3481159770 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7494004d10 0x7f74ac148ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:57.306 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:57.289+0000 7f74abfff640 1 --2- 172.21.15.102:0/3481159770 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f74ac154190 0x7f74ac0d14c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:57.306 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:57.289+0000 7f74aaffd640 1 -- 172.21.15.102:0/3481159770 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7494004d10 msgr2=0x7f74ac148ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:57.306 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:57.289+0000 7f74aaffd640 1 --2- 172.21.15.102:0/3481159770 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7494004d10 0x7f74ac148ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:57.306 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:57.289+0000 7f74aaffd640 1 -- 172.21.15.102:0/3481159770 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f74ac154190 msgr2=0x7f74ac0d14c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:57.306 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:57.289+0000 7f74aaffd640 1 --2- 172.21.15.102:0/3481159770 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f74ac154190 0x7f74ac0d14c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:57.307 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:57.289+0000 7f74aaffd640 1 -- 172.21.15.102:0/3481159770 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74ac154f90 con 0x7f74ac153d10 2023-11-13T11:29:57.307 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:57.293+0000 7f74aaffd640 1 --2- 172.21.15.102:0/3481159770 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f74ac153d10 0x7f74ac0d0f80 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f74a0012540 tx=0x7f74a0012a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-13T11:29:57.307 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:57.293+0000 7f7493fff640 1 -- 172.21.15.102:0/3481159770 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74a0014810 con 0x7f74ac153d10 2023-11-13T11:29:57.307 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:57.293+0000 7f7493fff640 1 -- 172.21.15.102:0/3481159770 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f74a0014970 con 0x7f74ac153d10 2023-11-13T11:29:57.307 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:57.293+0000 7f74b21f8640 1 -- 172.21.15.102:0/3481159770 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f74ac155270 con 0x7f74ac153d10 2023-11-13T11:29:57.307 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:57.293+0000 7f7493fff640 1 -- 172.21.15.102:0/3481159770 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74a0014d20 con 0x7f74ac153d10 2023-11-13T11:29:57.308 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:57.293+0000 7f74b21f8640 1 -- 172.21.15.102:0/3481159770 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f74ac0c76e0 con 0x7f74ac153d10 2023-11-13T11:29:57.308 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:57.293+0000 7f74b21f8640 1 -- 172.21.15.102:0/3481159770 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f74ac068520 con 0x7f74ac153d10 2023-11-13T11:29:57.309 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:57.293+0000 7f7493fff640 1 -- 172.21.15.102:0/3481159770 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f74a00153e0 con 0x7f74ac153d10 2023-11-13T11:29:57.309 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:57.293+0000 7f7493fff640 1 --2- 172.21.15.102:0/3481159770 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f7498066470 0x7f7498068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:57.309 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:57.293+0000 7f7493fff640 1 -- 172.21.15.102:0/3481159770 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f74a0086b50 con 0x7f74ac153d10 2023-11-13T11:29:57.310 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:57.293+0000 7f74ab7fe640 1 --2- 172.21.15.102:0/3481159770 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f7498066470 0x7f7498068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:57.310 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:57.297+0000 7f74ab7fe640 1 --2- 172.21.15.102:0/3481159770 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f7498066470 0x7f7498068930 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f749c000f70 tx=0x7f749c009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-13T11:29:57.310 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:57.297+0000 7f7493fff640 1 -- 172.21.15.102:0/3481159770 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f74a0053f30 con 0x7f74ac153d10 2023-11-13T11:29:57.456 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:57.449+0000 7f74b21f8640 1 -- 172.21.15.102:0/3481159770 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f74ac0b6af0 con 0x7f74ac153d10 2023-11-13T11:29:57.459 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:57.449+0000 7f7493fff640 1 -- 172.21.15.102:0/3481159770 <== mon.0 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v35) v1 ==== 74+0+16558 (secure 0 0 0) 0x7f74a001c020 con 0x7f74ac153d10 2023-11-13T11:29:57.459 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T11:29:57.459 INFO:teuthology.orchestra.run.smithi102.stdout:{"epoch":35,"fsid":"97b3eb2b-7ccf-4aae-8d92-bff986c671ea","created":"2023-11-13T11:28:31.836724+0000","modified":"2023-11-13T11:29:56.497678+0000","last_up_change":"2023-11-13T11:28:44.876638+0000","last_in_change":"2023-11-13T11:28:35.312740+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-13T11:28:44.981356+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2023-11-13T11:29:54.890079+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"35","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2023-11-13T11:29:55.482816+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"35","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"bdefaa17-fcca-4c86-aa40-27dc33a789af","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6800","nonce":53303834},{"type":"v1","addr":"172.21.15.102:6801","nonce":53303834}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6802","nonce":53303834},{"type":"v1","addr":"172.21.15.102:6803","nonce":53303834}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6806","nonce":53303834},{"type":"v1","addr":"172.21.15.102:6807","nonce":53303834}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6804","nonce":53303834},{"type":"v1","addr":"172.21.15.102:6805","nonce":53303834}]},"public_addr":"172.21.15.102:6801/53303834","cluster_addr":"172.21.15.102:6803/53303834","heartbeat_back_addr":"172.21.15.102:6807/53303834","heartbeat_front_addr":"172.21.15.102:6805/53303834","state":["exists","up"]},{"osd":1,"uuid":"f0033196-dec9-4ae9-945e-6aeef6dbb47f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6808","nonce":1732708348},{"type":"v1","addr":"172.21.15.102:6809","nonce":1732708348}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6811","nonce":1732708348},{"type":"v1","addr":"172.21.15.102:6813","nonce":1732708348}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6818","nonce":1732708348},{"type":"v1","addr":"172.21.15.102:6820","nonce":1732708348}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6815","nonce":1732708348},{"type":"v1","addr":"172.21.15.102:6817","nonce":1732708348}]},"public_addr":"172.21.15.102:6809/1732708348","cluster_addr":"172.21.15.102:6813/1732708348","heartbeat_back_addr":"172.21.15.102:6820/1732708348","heartbeat_front_addr":"172.21.15.102:6817/1732708348","state":["exists","up"]},{"osd":2,"uuid":"496b0834-351e-4ec2-a714-86ed0c0ff4fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6810","nonce":1825475150},{"type":"v1","addr":"172.21.15.102:6812","nonce":1825475150}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6814","nonce":1825475150},{"type":"v1","addr":"172.21.15.102:6816","nonce":1825475150}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6822","nonce":1825475150},{"type":"v1","addr":"172.21.15.102:6823","nonce":1825475150}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6819","nonce":1825475150},{"type":"v1","addr":"172.21.15.102:6821","nonce":1825475150}]},"public_addr":"172.21.15.102:6812/1825475150","cluster_addr":"172.21.15.102:6816/1825475150","heartbeat_back_addr":"172.21.15.102:6823/1825475150","heartbeat_front_addr":"172.21.15.102:6821/1825475150","state":["exists","up"]},{"osd":3,"uuid":"3ba6cc41-e0a0-4273-86cb-90000c06a55a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6824","nonce":4149355528},{"type":"v1","addr":"172.21.15.102:6825","nonce":4149355528}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6826","nonce":4149355528},{"type":"v1","addr":"172.21.15.102:6827","nonce":4149355528}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6830","nonce":4149355528},{"type":"v1","addr":"172.21.15.102:6831","nonce":4149355528}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6828","nonce":4149355528},{"type":"v1","addr":"172.21.15.102:6829","nonce":4149355528}]},"public_addr":"172.21.15.102:6825/4149355528","cluster_addr":"172.21.15.102:6827/4149355528","heartbeat_back_addr":"172.21.15.102:6831/4149355528","heartbeat_front_addr":"172.21.15.102:6829/4149355528","state":["exists","up"]},{"osd":4,"uuid":"16e797d8-e6e7-4140-95c3-b85283c42a2a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6808","nonce":4028899241},{"type":"v1","addr":"172.21.15.154:6809","nonce":4028899241}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6810","nonce":4028899241},{"type":"v1","addr":"172.21.15.154:6811","nonce":4028899241}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6814","nonce":4028899241},{"type":"v1","addr":"172.21.15.154:6815","nonce":4028899241}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6812","nonce":4028899241},{"type":"v1","addr":"172.21.15.154:6813","nonce":4028899241}]},"public_addr":"172.21.15.154:6809/4028899241","cluster_addr":"172.21.15.154:6811/4028899241","heartbeat_back_addr":"172.21.15.154:6815/4028899241","heartbeat_front_addr":"172.21.15.154:6813/4028899241","state":["exists","up"]},{"osd":5,"uuid":"d6ab225c-1b55-450a-89a9-abe5c3f8d6af","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":3562396827},{"type":"v1","addr":"172.21.15.154:6801","nonce":3562396827}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":3562396827},{"type":"v1","addr":"172.21.15.154:6803","nonce":3562396827}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6806","nonce":3562396827},{"type":"v1","addr":"172.21.15.154:6807","nonce":3562396827}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6804","nonce":3562396827},{"type":"v1","addr":"172.21.15.154:6805","nonce":3562396827}]},"public_addr":"172.21.15.154:6801/3562396827","cluster_addr":"172.21.15.154:6803/3562396827","heartbeat_back_addr":"172.21.15.154:6807/3562396827","heartbeat_front_addr":"172.21.15.154:6805/3562396827","state":["exists","up"]},{"osd":6,"uuid":"96f905ac-491c-4662-8e2b-5bb8e929ab9d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6816","nonce":2933728751},{"type":"v1","addr":"172.21.15.154:6817","nonce":2933728751}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6818","nonce":2933728751},{"type":"v1","addr":"172.21.15.154:6819","nonce":2933728751}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6822","nonce":2933728751},{"type":"v1","addr":"172.21.15.154:6823","nonce":2933728751}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6820","nonce":2933728751},{"type":"v1","addr":"172.21.15.154:6821","nonce":2933728751}]},"public_addr":"172.21.15.154:6817/2933728751","cluster_addr":"172.21.15.154:6819/2933728751","heartbeat_back_addr":"172.21.15.154:6823/2933728751","heartbeat_front_addr":"172.21.15.154:6821/2933728751","state":["exists","up"]},{"osd":7,"uuid":"07012d3b-3ab4-40df-a471-93caed22e2dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6824","nonce":1753500785},{"type":"v1","addr":"172.21.15.154:6825","nonce":1753500785}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6826","nonce":1753500785},{"type":"v1","addr":"172.21.15.154:6827","nonce":1753500785}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6830","nonce":1753500785},{"type":"v1","addr":"172.21.15.154:6831","nonce":1753500785}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6828","nonce":1753500785},{"type":"v1","addr":"172.21.15.154:6829","nonce":1753500785}]},"public_addr":"172.21.15.154:6825/1753500785","cluster_addr":"172.21.15.154:6827/1753500785","heartbeat_back_addr":"172.21.15.154:6831/1753500785","heartbeat_front_addr":"172.21.15.154:6829/1753500785","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-13T11:28:40.978603+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-13T11:28:41.200985+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-13T11:28:41.222815+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-13T11:28:41.202162+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-13T11:28:40.925911+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-13T11:28:41.087725+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-13T11:28:41.072208+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-13T11:28:40.875257+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-13T11:29:57.461 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:57.453+0000 7f74b21f8640 1 -- 172.21.15.102:0/3481159770 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f7498066470 msgr2=0x7f7498068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:57.461 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:57.453+0000 7f74b21f8640 1 --2- 172.21.15.102:0/3481159770 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f7498066470 0x7f7498068930 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f749c000f70 tx=0x7f749c009040 comp rx=0 tx=0).stop 2023-11-13T11:29:57.461 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:57.453+0000 7f74b21f8640 1 -- 172.21.15.102:0/3481159770 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f74ac153d10 msgr2=0x7f74ac0d0f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:57.461 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:57.453+0000 7f74b21f8640 1 --2- 172.21.15.102:0/3481159770 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f74ac153d10 0x7f74ac0d0f80 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f74a0012540 tx=0x7f74a0012a00 comp rx=0 tx=0).stop 2023-11-13T11:29:57.462 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:57.453+0000 7f74b21f8640 1 -- 172.21.15.102:0/3481159770 shutdown_connections 2023-11-13T11:29:57.462 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:57.453+0000 7f74b21f8640 1 --2- 172.21.15.102:0/3481159770 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f74ac154190 0x7f74ac0d14c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:57.462 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:57.453+0000 7f74b21f8640 1 --2- 172.21.15.102:0/3481159770 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f7498066470 0x7f7498068930 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:57.462 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:57.453+0000 7f74b21f8640 1 --2- 172.21.15.102:0/3481159770 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f74ac153d10 0x7f74ac0d0f80 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:57.463 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:57.453+0000 7f74b21f8640 1 --2- 172.21.15.102:0/3481159770 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7494004d10 0x7f74ac148ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:57.463 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:57.453+0000 7f74b21f8640 1 -- 172.21.15.102:0/3481159770 >> 172.21.15.102:0/3481159770 conn(0x7f74ac0d0b70 msgr2=0x7f74ac0ae2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-13T11:29:57.463 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:57.453+0000 7f74b21f8640 1 -- 172.21.15.102:0/3481159770 shutdown_connections 2023-11-13T11:29:57.464 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:57.453+0000 7f74b21f8640 1 -- 172.21.15.102:0/3481159770 wait complete. 2023-11-13T11:29:57.480 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-13T11:29:57.617 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:57.609+0000 7f1284ae3640 1 Processor -- start 2023-11-13T11:29:57.618 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:57.609+0000 7f1284ae3640 1 -- start start 2023-11-13T11:29:57.619 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:57.609+0000 7f1284ae3640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f128006caa0 0x7f128015e3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:57.619 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:57.609+0000 7f1284ae3640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f128015e910 con 0x7f1280140540 2023-11-13T11:29:57.619 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:57.613+0000 7f1284ae3640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1280140920 con 0x7f1280071900 2023-11-13T11:29:57.620 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:57.613+0000 7f1284ae3640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f12800ccc50 con 0x7f128006caa0 2023-11-13T11:29:57.620 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:57.613+0000 7f127e59c640 1 --1- >> v1:172.21.15.102:6789/0 conn(0x7f1280140540 0x7f12800711f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.102:6789/0 says I am v1:172.21.15.102:57324/0 (socket says 172.21.15.102:57324) 2023-11-13T11:29:57.620 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:57.613+0000 7f127e59c640 1 -- 172.21.15.102:0/268320131 learned_addr learned my addr 172.21.15.102:0/268320131 (peer_addr_for_me v1:172.21.15.102:0/0) 2023-11-13T11:29:57.620 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:57.613+0000 7f127ed9d640 1 --2- 172.21.15.102:0/268320131 >> v2:172.21.15.102:3300/0 conn(0x7f128006caa0 0x7f128015e3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:57.621 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:57.613+0000 7f127dd9b640 1 -- 172.21.15.102:0/268320131 <== mon.0 v1:172.21.15.102:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2161379406 0 0) 0x7f1270001120 con 0x7f1280140540 2023-11-13T11:29:57.621 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:57.613+0000 7f127dd9b640 1 -- 172.21.15.102:0/268320131 --> v1:172.21.15.102:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f126c003530 con 0x7f1280140540 2023-11-13T11:29:57.621 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:57.613+0000 7f127ed9d640 1 -- 172.21.15.102:0/268320131 >> v1:172.21.15.154:6789/0 conn(0x7f1280071900 legacy=0x7f12800b1c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-13T11:29:57.622 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:57.613+0000 7f127ed9d640 1 -- 172.21.15.102:0/268320131 >> v1:172.21.15.102:6789/0 conn(0x7f1280140540 legacy=0x7f12800711f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:57.622 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:57.613+0000 7f127ed9d640 1 -- 172.21.15.102:0/268320131 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f128006cfc0 con 0x7f128006caa0 2023-11-13T11:29:57.622 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:57.613+0000 7f127ed9d640 1 --2- 172.21.15.102:0/268320131 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f128006caa0 0x7f128015e3d0 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f1278009d90 tx=0x7f127801c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=25c5a4030e0f9be9 server_cookie=0 in_seq=0 out_seq=0 2023-11-13T11:29:57.623 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:57.613+0000 7f127dd9b640 1 -- 172.21.15.102:0/268320131 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12780a59e0 con 0x7f128006caa0 2023-11-13T11:29:57.623 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:57.613+0000 7f127dd9b640 1 -- 172.21.15.102:0/268320131 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f12780a5b40 con 0x7f128006caa0 2023-11-13T11:29:57.623 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:57.617+0000 7f127dd9b640 1 -- 172.21.15.102:0/268320131 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12780ad440 con 0x7f128006caa0 2023-11-13T11:29:57.624 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:57.617+0000 7f1284ae3640 1 -- 172.21.15.102:0/268320131 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f128006caa0 msgr2=0x7f128015e3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:57.624 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:57.617+0000 7f1284ae3640 1 --2- 172.21.15.102:0/268320131 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f128006caa0 0x7f128015e3d0 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f1278009d90 tx=0x7f127801c920 comp rx=0 tx=0).stop 2023-11-13T11:29:57.625 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:57.617+0000 7f1284ae3640 1 -- 172.21.15.102:0/268320131 shutdown_connections 2023-11-13T11:29:57.625 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:57.617+0000 7f1284ae3640 1 --2- 172.21.15.102:0/268320131 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f128006caa0 0x7f128015e3d0 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:57.625 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:57.617+0000 7f1284ae3640 1 -- 172.21.15.102:0/268320131 >> 172.21.15.102:0/268320131 conn(0x7f12800b0870 msgr2=0x7f12800b0c80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-13T11:29:57.625 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:57.617+0000 7f1284ae3640 1 -- 172.21.15.102:0/268320131 shutdown_connections 2023-11-13T11:29:57.625 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:57.617+0000 7f1284ae3640 1 -- 172.21.15.102:0/268320131 wait complete. 2023-11-13T11:29:57.627 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:57.617+0000 7f1284ae3640 1 Processor -- start 2023-11-13T11:29:57.627 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:57.617+0000 7f1284ae3640 1 -- start start 2023-11-13T11:29:57.627 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:57.617+0000 7f1284ae3640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f128006caa0 0x7f12801519c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:57.627 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:57.617+0000 7f1284ae3640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1280071900 0x7f128014ffb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:57.628 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:57.617+0000 7f1284ae3640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1280140540 0x7f12800afbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:57.628 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:57.617+0000 7f1284ae3640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1280151530 con 0x7f1280071900 2023-11-13T11:29:57.628 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:57.617+0000 7f1284ae3640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1280151f00 con 0x7f128006caa0 2023-11-13T11:29:57.628 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:57.617+0000 7f1284ae3640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1280150920 con 0x7f1280140540 2023-11-13T11:29:57.628 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:57.617+0000 7f1277fff640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1280071900 0x7f128014ffb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:57.629 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:57.621+0000 7f1277fff640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1280071900 0x7f128014ffb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:38218/0 (socket says 172.21.15.102:38218) 2023-11-13T11:29:57.629 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:57.621+0000 7f1277fff640 1 -- 172.21.15.102:0/1126264725 learned_addr learned my addr 172.21.15.102:0/1126264725 (peer_addr_for_me v2:172.21.15.102:0/0) 2023-11-13T11:29:57.629 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:57.621+0000 7f127e59c640 1 --2- 172.21.15.102:0/1126264725 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f128006caa0 0x7f12801519c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:57.629 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:57.621+0000 7f127ed9d640 1 --2- 172.21.15.102:0/1126264725 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1280140540 0x7f12800afbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:57.631 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:57.621+0000 7f1277fff640 1 -- 172.21.15.102:0/1126264725 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1280140540 msgr2=0x7f12800afbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:57.631 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:57.621+0000 7f1277fff640 1 --2- 172.21.15.102:0/1126264725 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1280140540 0x7f12800afbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:57.631 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:57.621+0000 7f1277fff640 1 -- 172.21.15.102:0/1126264725 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f128006caa0 msgr2=0x7f12801519c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:57.632 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:57.621+0000 7f1277fff640 1 --2- 172.21.15.102:0/1126264725 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f128006caa0 0x7f12801519c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:57.632 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:57.621+0000 7f1277fff640 1 -- 172.21.15.102:0/1126264725 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1278009a70 con 0x7f1280071900 2023-11-13T11:29:57.632 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:57.621+0000 7f1277fff640 1 --2- 172.21.15.102:0/1126264725 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1280071900 0x7f128014ffb0 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f126800c500 tx=0x7f126800c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-13T11:29:57.632 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:57.621+0000 7f1276ffd640 1 -- 172.21.15.102:0/1126264725 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1268005220 con 0x7f1280071900 2023-11-13T11:29:57.632 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:57.621+0000 7f1276ffd640 1 -- 172.21.15.102:0/1126264725 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1268005380 con 0x7f1280071900 2023-11-13T11:29:57.633 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:57.621+0000 7f1276ffd640 1 -- 172.21.15.102:0/1126264725 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1268007270 con 0x7f1280071900 2023-11-13T11:29:57.633 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:57.621+0000 7f1284ae3640 1 -- 172.21.15.102:0/1126264725 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1280150c00 con 0x7f1280071900 2023-11-13T11:29:57.633 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:57.621+0000 7f1284ae3640 1 -- 172.21.15.102:0/1126264725 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f12801511c0 con 0x7f1280071900 2023-11-13T11:29:57.634 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:57.625+0000 7f1284ae3640 1 -- 172.21.15.102:0/1126264725 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f12801516e0 con 0x7f1280071900 2023-11-13T11:29:57.634 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:57.625+0000 7f1276ffd640 1 -- 172.21.15.102:0/1126264725 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f12680073d0 con 0x7f1280071900 2023-11-13T11:29:57.635 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:57.625+0000 7f1276ffd640 1 --2- 172.21.15.102:0/1126264725 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f1260066470 0x7f1260068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:57.635 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:57.625+0000 7f1276ffd640 1 -- 172.21.15.102:0/1126264725 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f1268083680 con 0x7f1280071900 2023-11-13T11:29:57.635 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:57.625+0000 7f127e59c640 1 --2- 172.21.15.102:0/1126264725 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f1260066470 0x7f1260068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:57.635 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:57.625+0000 7f127e59c640 1 --2- 172.21.15.102:0/1126264725 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f1260066470 0x7f1260068930 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f1270001280 tx=0x7f1270007bc0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-13T11:29:57.637 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:57.629+0000 7f1276ffd640 1 -- 172.21.15.102:0/1126264725 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f12801516e0 con 0x7f1280071900 2023-11-13T11:29:57.786 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:57.777+0000 7f1284ae3640 1 -- 172.21.15.102:0/1126264725 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f12801516e0 con 0x7f1280071900 2023-11-13T11:29:57.787 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:57.781+0000 7f1276ffd640 1 -- 172.21.15.102:0/1126264725 <== mon.0 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v36) v1 ==== 74+0+16545 (secure 0 0 0) 0x7f12801516e0 con 0x7f1280071900 2023-11-13T11:29:57.787 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T11:29:57.788 INFO:teuthology.orchestra.run.smithi102.stdout:{"epoch":36,"fsid":"97b3eb2b-7ccf-4aae-8d92-bff986c671ea","created":"2023-11-13T11:28:31.836724+0000","modified":"2023-11-13T11:29:57.619823+0000","last_up_change":"2023-11-13T11:28:44.876638+0000","last_in_change":"2023-11-13T11:28:35.312740+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-13T11:28:44.981356+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2023-11-13T11:29:54.890079+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"35","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2023-11-13T11:29:55.482816+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"36","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"bdefaa17-fcca-4c86-aa40-27dc33a789af","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6800","nonce":53303834},{"type":"v1","addr":"172.21.15.102:6801","nonce":53303834}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6802","nonce":53303834},{"type":"v1","addr":"172.21.15.102:6803","nonce":53303834}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6806","nonce":53303834},{"type":"v1","addr":"172.21.15.102:6807","nonce":53303834}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6804","nonce":53303834},{"type":"v1","addr":"172.21.15.102:6805","nonce":53303834}]},"public_addr":"172.21.15.102:6801/53303834","cluster_addr":"172.21.15.102:6803/53303834","heartbeat_back_addr":"172.21.15.102:6807/53303834","heartbeat_front_addr":"172.21.15.102:6805/53303834","state":["exists","up"]},{"osd":1,"uuid":"f0033196-dec9-4ae9-945e-6aeef6dbb47f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6808","nonce":1732708348},{"type":"v1","addr":"172.21.15.102:6809","nonce":1732708348}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6811","nonce":1732708348},{"type":"v1","addr":"172.21.15.102:6813","nonce":1732708348}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6818","nonce":1732708348},{"type":"v1","addr":"172.21.15.102:6820","nonce":1732708348}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6815","nonce":1732708348},{"type":"v1","addr":"172.21.15.102:6817","nonce":1732708348}]},"public_addr":"172.21.15.102:6809/1732708348","cluster_addr":"172.21.15.102:6813/1732708348","heartbeat_back_addr":"172.21.15.102:6820/1732708348","heartbeat_front_addr":"172.21.15.102:6817/1732708348","state":["exists","up"]},{"osd":2,"uuid":"496b0834-351e-4ec2-a714-86ed0c0ff4fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6810","nonce":1825475150},{"type":"v1","addr":"172.21.15.102:6812","nonce":1825475150}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6814","nonce":1825475150},{"type":"v1","addr":"172.21.15.102:6816","nonce":1825475150}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6822","nonce":1825475150},{"type":"v1","addr":"172.21.15.102:6823","nonce":1825475150}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6819","nonce":1825475150},{"type":"v1","addr":"172.21.15.102:6821","nonce":1825475150}]},"public_addr":"172.21.15.102:6812/1825475150","cluster_addr":"172.21.15.102:6816/1825475150","heartbeat_back_addr":"172.21.15.102:6823/1825475150","heartbeat_front_addr":"172.21.15.102:6821/1825475150","state":["exists","up"]},{"osd":3,"uuid":"3ba6cc41-e0a0-4273-86cb-90000c06a55a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6824","nonce":4149355528},{"type":"v1","addr":"172.21.15.102:6825","nonce":4149355528}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6826","nonce":4149355528},{"type":"v1","addr":"172.21.15.102:6827","nonce":4149355528}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6830","nonce":4149355528},{"type":"v1","addr":"172.21.15.102:6831","nonce":4149355528}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6828","nonce":4149355528},{"type":"v1","addr":"172.21.15.102:6829","nonce":4149355528}]},"public_addr":"172.21.15.102:6825/4149355528","cluster_addr":"172.21.15.102:6827/4149355528","heartbeat_back_addr":"172.21.15.102:6831/4149355528","heartbeat_front_addr":"172.21.15.102:6829/4149355528","state":["exists","up"]},{"osd":4,"uuid":"16e797d8-e6e7-4140-95c3-b85283c42a2a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6808","nonce":4028899241},{"type":"v1","addr":"172.21.15.154:6809","nonce":4028899241}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6810","nonce":4028899241},{"type":"v1","addr":"172.21.15.154:6811","nonce":4028899241}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6814","nonce":4028899241},{"type":"v1","addr":"172.21.15.154:6815","nonce":4028899241}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6812","nonce":4028899241},{"type":"v1","addr":"172.21.15.154:6813","nonce":4028899241}]},"public_addr":"172.21.15.154:6809/4028899241","cluster_addr":"172.21.15.154:6811/4028899241","heartbeat_back_addr":"172.21.15.154:6815/4028899241","heartbeat_front_addr":"172.21.15.154:6813/4028899241","state":["exists","up"]},{"osd":5,"uuid":"d6ab225c-1b55-450a-89a9-abe5c3f8d6af","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":3562396827},{"type":"v1","addr":"172.21.15.154:6801","nonce":3562396827}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":3562396827},{"type":"v1","addr":"172.21.15.154:6803","nonce":3562396827}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6806","nonce":3562396827},{"type":"v1","addr":"172.21.15.154:6807","nonce":3562396827}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6804","nonce":3562396827},{"type":"v1","addr":"172.21.15.154:6805","nonce":3562396827}]},"public_addr":"172.21.15.154:6801/3562396827","cluster_addr":"172.21.15.154:6803/3562396827","heartbeat_back_addr":"172.21.15.154:6807/3562396827","heartbeat_front_addr":"172.21.15.154:6805/3562396827","state":["exists","up"]},{"osd":6,"uuid":"96f905ac-491c-4662-8e2b-5bb8e929ab9d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6816","nonce":2933728751},{"type":"v1","addr":"172.21.15.154:6817","nonce":2933728751}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6818","nonce":2933728751},{"type":"v1","addr":"172.21.15.154:6819","nonce":2933728751}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6822","nonce":2933728751},{"type":"v1","addr":"172.21.15.154:6823","nonce":2933728751}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6820","nonce":2933728751},{"type":"v1","addr":"172.21.15.154:6821","nonce":2933728751}]},"public_addr":"172.21.15.154:6817/2933728751","cluster_addr":"172.21.15.154:6819/2933728751","heartbeat_back_addr":"172.21.15.154:6823/2933728751","heartbeat_front_addr":"172.21.15.154:6821/2933728751","state":["exists","up"]},{"osd":7,"uuid":"07012d3b-3ab4-40df-a471-93caed22e2dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6824","nonce":1753500785},{"type":"v1","addr":"172.21.15.154:6825","nonce":1753500785}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6826","nonce":1753500785},{"type":"v1","addr":"172.21.15.154:6827","nonce":1753500785}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6830","nonce":1753500785},{"type":"v1","addr":"172.21.15.154:6831","nonce":1753500785}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6828","nonce":1753500785},{"type":"v1","addr":"172.21.15.154:6829","nonce":1753500785}]},"public_addr":"172.21.15.154:6825/1753500785","cluster_addr":"172.21.15.154:6827/1753500785","heartbeat_back_addr":"172.21.15.154:6831/1753500785","heartbeat_front_addr":"172.21.15.154:6829/1753500785","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-13T11:28:40.978603+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-13T11:28:41.200985+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-13T11:28:41.222815+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-13T11:28:41.202162+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-13T11:28:40.925911+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-13T11:28:41.087725+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-13T11:28:41.072208+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-13T11:28:40.875257+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-13T11:29:57.789 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:57.781+0000 7f1284ae3640 1 -- 172.21.15.102:0/1126264725 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f1260066470 msgr2=0x7f1260068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:57.789 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:57.781+0000 7f1284ae3640 1 --2- 172.21.15.102:0/1126264725 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f1260066470 0x7f1260068930 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f1270001280 tx=0x7f1270007bc0 comp rx=0 tx=0).stop 2023-11-13T11:29:57.790 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:57.781+0000 7f1284ae3640 1 -- 172.21.15.102:0/1126264725 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1280071900 msgr2=0x7f128014ffb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:57.790 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:57.781+0000 7f1284ae3640 1 --2- 172.21.15.102:0/1126264725 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1280071900 0x7f128014ffb0 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f126800c500 tx=0x7f126800c9c0 comp rx=0 tx=0).stop 2023-11-13T11:29:57.790 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:57.781+0000 7f1284ae3640 1 -- 172.21.15.102:0/1126264725 shutdown_connections 2023-11-13T11:29:57.790 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:57.781+0000 7f1284ae3640 1 --2- 172.21.15.102:0/1126264725 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1280140540 0x7f12800afbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:57.791 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:57.781+0000 7f1284ae3640 1 --2- 172.21.15.102:0/1126264725 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f1260066470 0x7f1260068930 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:57.791 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:57.781+0000 7f1284ae3640 1 --2- 172.21.15.102:0/1126264725 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1280071900 0x7f128014ffb0 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:57.791 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:57.781+0000 7f1284ae3640 1 --2- 172.21.15.102:0/1126264725 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f128006caa0 0x7f12801519c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:57.791 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:57.781+0000 7f1284ae3640 1 -- 172.21.15.102:0/1126264725 >> 172.21.15.102:0/1126264725 conn(0x7f12800b0870 msgr2=0x7f12800aed40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-13T11:29:57.792 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:57.781+0000 7f1284ae3640 1 -- 172.21.15.102:0/1126264725 shutdown_connections 2023-11-13T11:29:57.792 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:57.781+0000 7f1284ae3640 1 -- 172.21.15.102:0/1126264725 wait complete. 2023-11-13T11:29:57.809 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-11-13T11:29:57.951 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:57.941+0000 7fac54679640 1 Processor -- start 2023-11-13T11:29:57.951 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:57.941+0000 7fac54679640 1 -- start start 2023-11-13T11:29:57.952 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:57.945+0000 7fac54679640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fac4c0cf2d0 0x7fac4c15b3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:57.953 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:57.945+0000 7fac54679640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fac4c06c800 0x7fac4c15b8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:57.953 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:57.945+0000 7fac54679640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fac4c15c150 con 0x7fac4c1553c0 2023-11-13T11:29:57.953 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:57.945+0000 7fac54679640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fac4c06c3e0 con 0x7fac4c0cf2d0 2023-11-13T11:29:57.953 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:57.945+0000 7fac54679640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fac4c06bd20 con 0x7fac4c06c800 2023-11-13T11:29:57.953 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:57.945+0000 7fac52415640 1 --1- >> v1:172.21.15.102:6789/0 conn(0x7fac4c1553c0 0x7fac4c0cebc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.102:6789/0 says I am v1:172.21.15.102:57340/0 (socket says 172.21.15.102:57340) 2023-11-13T11:29:57.954 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:57.945+0000 7fac52415640 1 -- 172.21.15.102:0/2762262489 learned_addr learned my addr 172.21.15.102:0/2762262489 (peer_addr_for_me v1:172.21.15.102:0/0) 2023-11-13T11:29:57.956 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:57.945+0000 7fac51413640 1 -- 172.21.15.102:0/2762262489 <== mon.0 v1:172.21.15.102:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3248130622 0 0) 0x7fac4c15c150 con 0x7fac4c1553c0 2023-11-13T11:29:57.956 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:57.945+0000 7fac52c16640 1 --2- 172.21.15.102:0/2762262489 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fac4c06c800 0x7fac4c15b8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:57.956 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:57.945+0000 7fac51c14640 1 --2- 172.21.15.102:0/2762262489 >> v2:172.21.15.154:3300/0 conn(0x7fac4c0cf2d0 0x7fac4c15b3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:57.956 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:57.945+0000 7fac51413640 1 -- 172.21.15.102:0/2762262489 --> v1:172.21.15.102:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fac38003530 con 0x7fac4c1553c0 2023-11-13T11:29:57.957 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:57.945+0000 7fac51413640 1 -- 172.21.15.102:0/2762262489 <== mon.0 v1:172.21.15.102:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1165942182 0 0) 0x7fac38003530 con 0x7fac4c1553c0 2023-11-13T11:29:57.957 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:57.945+0000 7fac51413640 1 -- 172.21.15.102:0/2762262489 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fac4c06c800 msgr2=0x7fac4c15b8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-13T11:29:57.957 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:57.945+0000 7fac51413640 1 --2- 172.21.15.102:0/2762262489 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fac4c06c800 0x7fac4c15b8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:57.957 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:57.945+0000 7fac51413640 1 -- 172.21.15.102:0/2762262489 >> v2:172.21.15.154:3300/0 conn(0x7fac4c0cf2d0 msgr2=0x7fac4c15b3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-13T11:29:57.957 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:57.945+0000 7fac51413640 1 --2- 172.21.15.102:0/2762262489 >> v2:172.21.15.154:3300/0 conn(0x7fac4c0cf2d0 0x7fac4c15b3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:57.958 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:57.945+0000 7fac51413640 1 -- 172.21.15.102:0/2762262489 --> v1:172.21.15.102:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac4c06c000 con 0x7fac4c1553c0 2023-11-13T11:29:57.958 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:57.945+0000 7fac51413640 1 -- 172.21.15.102:0/2762262489 <== mon.0 v1:172.21.15.102:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 895381068 0 0) 0x7fac48001680 con 0x7fac4c1553c0 2023-11-13T11:29:57.958 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:57.945+0000 7fac51413640 1 -- 172.21.15.102:0/2762262489 >> v1:172.21.15.102:6789/0 conn(0x7fac4c1553c0 legacy=0x7fac4c0cebc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:57.958 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:57.945+0000 7fac51413640 1 --2- 172.21.15.102:0/2762262489 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fac38003980 0x7fac38003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:57.958 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:57.945+0000 7fac51413640 1 --2- 172.21.15.102:0/2762262489 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fac4c06c800 0x7fac380047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:57.959 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:57.945+0000 7fac51413640 1 --2- 172.21.15.102:0/2762262489 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fac38004d10 0x7fac38005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:57.959 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:57.945+0000 7fac51413640 1 -- 172.21.15.102:0/2762262489 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac4c06c3e0 con 0x7fac38004d10 2023-11-13T11:29:57.959 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:57.945+0000 7fac51413640 1 -- 172.21.15.102:0/2762262489 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac4c06bd20 con 0x7fac38003980 2023-11-13T11:29:57.959 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:57.945+0000 7fac51413640 1 -- 172.21.15.102:0/2762262489 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fac3800b9c0 con 0x7fac4c06c800 2023-11-13T11:29:57.959 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:57.945+0000 7fac52c16640 1 --2- 172.21.15.102:0/2762262489 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fac38004d10 0x7fac38005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:57.960 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:57.945+0000 7fac52415640 1 --2- 172.21.15.102:0/2762262489 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fac38003980 0x7fac38003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:57.960 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:57.945+0000 7fac51c14640 1 --2- 172.21.15.102:0/2762262489 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fac4c06c800 0x7fac380047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:57.960 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:57.945+0000 7fac52c16640 1 -- 172.21.15.102:0/2762262489 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fac4c06c800 msgr2=0x7fac380047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-13T11:29:57.961 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:57.945+0000 7fac52c16640 1 --2- 172.21.15.102:0/2762262489 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fac4c06c800 0x7fac380047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:57.961 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:57.945+0000 7fac52c16640 1 -- 172.21.15.102:0/2762262489 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fac38003980 msgr2=0x7fac38003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-13T11:29:57.961 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:57.945+0000 7fac52c16640 1 --2- 172.21.15.102:0/2762262489 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fac38003980 0x7fac38003da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:57.961 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:57.945+0000 7fac52c16640 1 -- 172.21.15.102:0/2762262489 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac38003530 con 0x7fac38004d10 2023-11-13T11:29:57.964 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:57.949+0000 7fac52c16640 1 --2- 172.21.15.102:0/2762262489 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fac38004d10 0x7fac38005190 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7fac44009fc0 tx=0x7fac4401cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=209718943d417b82 server_cookie=0 in_seq=0 out_seq=0 2023-11-13T11:29:57.965 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:57.949+0000 7fac51413640 1 -- 172.21.15.102:0/2762262489 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac440a5c70 con 0x7fac38004d10 2023-11-13T11:29:57.965 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:57.949+0000 7fac51413640 1 -- 172.21.15.102:0/2762262489 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac4400f040 con 0x7fac38004d10 2023-11-13T11:29:57.965 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:57.949+0000 7fac51413640 1 -- 172.21.15.102:0/2762262489 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac440ad440 con 0x7fac38004d10 2023-11-13T11:29:57.965 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:57.949+0000 7fac54679640 1 -- 172.21.15.102:0/2762262489 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fac38004d10 msgr2=0x7fac38005190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:57.965 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:57.949+0000 7fac54679640 1 --2- 172.21.15.102:0/2762262489 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fac38004d10 0x7fac38005190 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7fac44009fc0 tx=0x7fac4401cc60 comp rx=0 tx=0).stop 2023-11-13T11:29:57.966 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:57.949+0000 7fac52c16640 1 -- 172.21.15.102:0/2762262489 reap_dead start 2023-11-13T11:29:57.966 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:57.949+0000 7fac54679640 1 -- 172.21.15.102:0/2762262489 shutdown_connections 2023-11-13T11:29:57.966 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:57.949+0000 7fac54679640 1 -- 172.21.15.102:0/2762262489 >> 172.21.15.102:0/2762262489 conn(0x7fac4c06a410 msgr2=0x7fac4c06a820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-13T11:29:57.966 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:57.949+0000 7fac54679640 1 -- 172.21.15.102:0/2762262489 shutdown_connections 2023-11-13T11:29:57.966 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:57.949+0000 7fac54679640 1 -- 172.21.15.102:0/2762262489 wait complete. 2023-11-13T11:29:57.967 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:57.953+0000 7fac54679640 1 Processor -- start 2023-11-13T11:29:57.967 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:57.953+0000 7fac54679640 1 -- start start 2023-11-13T11:29:57.967 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:57.953+0000 7fac54679640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fac38004d10 0x7fac4c14f8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:57.967 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:57.953+0000 7fac54679640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fac4c1596f0 0x7fac4c156670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:57.967 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:57.953+0000 7fac54679640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fac4c159b70 0x7fac4c156bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:57.968 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:57.953+0000 7fac54679640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac4c158700 con 0x7fac4c159b70 2023-11-13T11:29:57.968 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:57.953+0000 7fac54679640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac4c158930 con 0x7fac4c1596f0 2023-11-13T11:29:57.968 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:57.953+0000 7fac54679640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fac4c158c10 con 0x7fac38004d10 2023-11-13T11:29:57.968 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:57.953+0000 7fac52c16640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fac4c159b70 0x7fac4c156bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:57.968 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:57.953+0000 7fac52c16640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fac4c159b70 0x7fac4c156bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:38250/0 (socket says 172.21.15.102:38250) 2023-11-13T11:29:57.969 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:57.953+0000 7fac52c16640 1 -- 172.21.15.102:0/851280789 learned_addr learned my addr 172.21.15.102:0/851280789 (peer_addr_for_me v2:172.21.15.102:0/0) 2023-11-13T11:29:57.969 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:57.953+0000 7fac52415640 1 --2- 172.21.15.102:0/851280789 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fac38004d10 0x7fac4c14f8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:57.969 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:57.953+0000 7fac51c14640 1 --2- 172.21.15.102:0/851280789 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fac4c1596f0 0x7fac4c156670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:57.969 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:57.953+0000 7fac52c16640 1 -- 172.21.15.102:0/851280789 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fac38004d10 msgr2=0x7fac4c14f8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:57.969 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:57.953+0000 7fac52c16640 1 --2- 172.21.15.102:0/851280789 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fac38004d10 0x7fac4c14f8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:57.969 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:57.953+0000 7fac52c16640 1 -- 172.21.15.102:0/851280789 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fac4c1596f0 msgr2=0x7fac4c156670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:57.970 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:57.953+0000 7fac52c16640 1 --2- 172.21.15.102:0/851280789 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fac4c1596f0 0x7fac4c156670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:57.970 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:57.953+0000 7fac52c16640 1 -- 172.21.15.102:0/851280789 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac4c158ef0 con 0x7fac4c159b70 2023-11-13T11:29:57.970 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:57.953+0000 7fac52c16640 1 --2- 172.21.15.102:0/851280789 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fac4c159b70 0x7fac4c156bb0 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7fac440b0040 tx=0x7fac44009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-13T11:29:57.970 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:57.953+0000 7fac42ffd640 1 -- 172.21.15.102:0/851280789 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac440ba070 con 0x7fac4c159b70 2023-11-13T11:29:57.971 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:57.953+0000 7fac42ffd640 1 -- 172.21.15.102:0/851280789 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac440039a0 con 0x7fac4c159b70 2023-11-13T11:29:57.971 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:57.953+0000 7fac42ffd640 1 -- 172.21.15.102:0/851280789 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac44003b30 con 0x7fac4c159b70 2023-11-13T11:29:57.971 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:57.953+0000 7fac54679640 1 -- 172.21.15.102:0/851280789 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fac4c1591d0 con 0x7fac4c159b70 2023-11-13T11:29:57.971 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:57.953+0000 7fac54679640 1 -- 172.21.15.102:0/851280789 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fac4c150860 con 0x7fac4c159b70 2023-11-13T11:29:57.972 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:57.953+0000 7fac54679640 1 -- 172.21.15.102:0/851280789 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fac4c067640 con 0x7fac4c159b70 2023-11-13T11:29:57.972 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:57.957+0000 7fac42ffd640 1 -- 172.21.15.102:0/851280789 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fac440b4040 con 0x7fac4c159b70 2023-11-13T11:29:57.972 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:57.957+0000 7fac42ffd640 1 --2- 172.21.15.102:0/851280789 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7fac300664a0 0x7fac30068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:57.973 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:57.957+0000 7fac42ffd640 1 -- 172.21.15.102:0/851280789 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fac4411d710 con 0x7fac4c159b70 2023-11-13T11:29:57.973 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:57.957+0000 7fac52415640 1 --2- 172.21.15.102:0/851280789 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7fac300664a0 0x7fac30068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:57.973 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:57.957+0000 7fac52415640 1 --2- 172.21.15.102:0/851280789 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7fac300664a0 0x7fac30068960 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fac48001060 tx=0x7fac48009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-13T11:29:57.974 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:57.961+0000 7fac42ffd640 1 -- 172.21.15.102:0/851280789 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fac440eac20 con 0x7fac4c159b70 2023-11-13T11:29:58.154 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:58.145+0000 7fac54679640 1 -- 172.21.15.102:0/851280789 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7fac4c1593c0 con 0x7fac4c159b70 2023-11-13T11:29:59.153 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:59.145+0000 7fac42ffd640 1 -- 172.21.15.102:0/851280789 <== mon.0 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v15) v1 ==== 118+0+0 (secure 0 0 0) 0x7fac440ee240 con 0x7fac4c159b70 2023-11-13T11:29:59.156 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:59.149+0000 7fac54679640 1 -- 172.21.15.102:0/851280789 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7fac300664a0 msgr2=0x7fac30068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:59.157 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:59.149+0000 7fac54679640 1 --2- 172.21.15.102:0/851280789 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7fac300664a0 0x7fac30068960 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fac48001060 tx=0x7fac48009040 comp rx=0 tx=0).stop 2023-11-13T11:29:59.157 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:59.149+0000 7fac54679640 1 -- 172.21.15.102:0/851280789 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fac4c159b70 msgr2=0x7fac4c156bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:59.157 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:59.149+0000 7fac54679640 1 --2- 172.21.15.102:0/851280789 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fac4c159b70 0x7fac4c156bb0 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7fac440b0040 tx=0x7fac44009750 comp rx=0 tx=0).stop 2023-11-13T11:29:59.157 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:59.149+0000 7fac54679640 1 -- 172.21.15.102:0/851280789 shutdown_connections 2023-11-13T11:29:59.158 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:59.149+0000 7fac54679640 1 --2- 172.21.15.102:0/851280789 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7fac300664a0 0x7fac30068960 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:59.158 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:59.149+0000 7fac54679640 1 --2- 172.21.15.102:0/851280789 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fac4c159b70 0x7fac4c156bb0 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:59.158 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:59.149+0000 7fac54679640 1 --2- 172.21.15.102:0/851280789 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fac4c1596f0 0x7fac4c156670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:59.158 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:59.149+0000 7fac54679640 1 --2- 172.21.15.102:0/851280789 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fac38004d10 0x7fac4c14f8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:59.158 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:59.149+0000 7fac54679640 1 -- 172.21.15.102:0/851280789 >> 172.21.15.102:0/851280789 conn(0x7fac4c06a410 msgr2=0x7fac4c150df0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-13T11:29:59.159 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:59.149+0000 7fac54679640 1 -- 172.21.15.102:0/851280789 shutdown_connections 2023-11-13T11:29:59.159 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:59.149+0000 7fac54679640 1 -- 172.21.15.102:0/851280789 wait complete. 2023-11-13T11:29:59.179 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-11-13T11:29:59.179 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-11-13T11:29:59.326 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:59.317+0000 7f7b5f5df640 1 Processor -- start 2023-11-13T11:29:59.326 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:59.317+0000 7f7b5f5df640 1 -- start start 2023-11-13T11:29:59.328 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:59.317+0000 7f7b5f5df640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7b5815d0b0 0x7f7b580cebc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:59.328 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:59.317+0000 7f7b5f5df640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f7b580b1920 0x7f7b580cf100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:59.328 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:59.317+0000 7f7b5f5df640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f7b58071620 0x7f7b580ac8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:59.328 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:59.317+0000 7f7b5f5df640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7b58070030 con 0x7f7b580b1920 2023-11-13T11:29:59.329 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:59.317+0000 7f7b5f5df640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7b58070310 con 0x7f7b58071620 2023-11-13T11:29:59.329 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:59.317+0000 7f7b5f5df640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7b580705f0 con 0x7f7b5815d0b0 2023-11-13T11:29:59.329 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:59.321+0000 7f7b5cb7a640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f7b580b1920 0x7f7b580cf100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:59.329 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:59.321+0000 7f7b5cb7a640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f7b580b1920 0x7f7b580cf100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:38258/0 (socket says 172.21.15.102:38258) 2023-11-13T11:29:59.329 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:59.321+0000 7f7b5cb7a640 1 -- 172.21.15.102:0/2064508707 learned_addr learned my addr 172.21.15.102:0/2064508707 (peer_addr_for_me v2:172.21.15.102:0/0) 2023-11-13T11:29:59.330 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:59.321+0000 7f7b5cb7a640 1 -- 172.21.15.102:0/2064508707 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7b5815d0b0 msgr2=0x7f7b580cebc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-13T11:29:59.330 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:59.321+0000 7f7b5d37b640 1 --2- 172.21.15.102:0/2064508707 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7b5815d0b0 0x7f7b580cebc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:59.330 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:59.321+0000 7f7b5db7c640 1 --2- 172.21.15.102:0/2064508707 >> v2:172.21.15.154:3300/0 conn(0x7f7b58071620 0x7f7b580ac8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:59.330 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:59.321+0000 7f7b5cb7a640 1 --2- 172.21.15.102:0/2064508707 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7b5815d0b0 0x7f7b580cebc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:59.331 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:59.321+0000 7f7b5cb7a640 1 -- 172.21.15.102:0/2064508707 >> v2:172.21.15.154:3300/0 conn(0x7f7b58071620 msgr2=0x7f7b580ac8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-13T11:29:59.331 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:59.321+0000 7f7b5cb7a640 1 --2- 172.21.15.102:0/2064508707 >> v2:172.21.15.154:3300/0 conn(0x7f7b58071620 0x7f7b580ac8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:59.331 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:59.321+0000 7f7b5cb7a640 1 -- 172.21.15.102:0/2064508707 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b580708d0 con 0x7f7b580b1920 2023-11-13T11:29:59.331 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:59.321+0000 7f7b5db7c640 1 --2- 172.21.15.102:0/2064508707 >> v2:172.21.15.154:3300/0 conn(0x7f7b58071620 0x7f7b580ac8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-13T11:29:59.331 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:59.321+0000 7f7b5d37b640 1 --2- 172.21.15.102:0/2064508707 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7b5815d0b0 0x7f7b580cebc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-13T11:29:59.332 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:59.321+0000 7f7b5cb7a640 1 --2- 172.21.15.102:0/2064508707 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7b580b1920 0x7f7b580cf100 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f7b5806f9d0 tx=0x7f7b4801ecf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5422966584f6c6bd server_cookie=0 in_seq=0 out_seq=0 2023-11-13T11:29:59.333 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:59.321+0000 7f7b4ffff640 1 -- 172.21.15.102:0/2064508707 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b480a89b0 con 0x7f7b580b1920 2023-11-13T11:29:59.333 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:59.321+0000 7f7b4ffff640 1 -- 172.21.15.102:0/2064508707 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b480a8b10 con 0x7f7b580b1920 2023-11-13T11:29:59.333 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:59.321+0000 7f7b4ffff640 1 -- 172.21.15.102:0/2064508707 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b480a8ea0 con 0x7f7b580b1920 2023-11-13T11:29:59.333 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:59.325+0000 7f7b5f5df640 1 -- 172.21.15.102:0/2064508707 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7b580b1920 msgr2=0x7f7b580cf100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:59.334 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:59.325+0000 7f7b5f5df640 1 --2- 172.21.15.102:0/2064508707 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7b580b1920 0x7f7b580cf100 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f7b5806f9d0 tx=0x7f7b4801ecf0 comp rx=0 tx=0).stop 2023-11-13T11:29:59.334 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:59.325+0000 7f7b5f5df640 1 -- 172.21.15.102:0/2064508707 shutdown_connections 2023-11-13T11:29:59.334 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:59.325+0000 7f7b5f5df640 1 --2- 172.21.15.102:0/2064508707 >> v2:172.21.15.154:3300/0 conn(0x7f7b58071620 0x7f7b580ac8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:59.334 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:59.325+0000 7f7b5f5df640 1 --2- 172.21.15.102:0/2064508707 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7b580b1920 0x7f7b580cf100 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:59.334 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:59.325+0000 7f7b5f5df640 1 --2- 172.21.15.102:0/2064508707 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7b5815d0b0 0x7f7b580cebc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:59.335 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:59.325+0000 7f7b5f5df640 1 -- 172.21.15.102:0/2064508707 >> 172.21.15.102:0/2064508707 conn(0x7f7b5806a410 msgr2=0x7f7b5806a820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-13T11:29:59.335 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:59.325+0000 7f7b5f5df640 1 -- 172.21.15.102:0/2064508707 shutdown_connections 2023-11-13T11:29:59.335 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:59.325+0000 7f7b5f5df640 1 -- 172.21.15.102:0/2064508707 wait complete. 2023-11-13T11:29:59.337 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:59.325+0000 7f7b5f5df640 1 Processor -- start 2023-11-13T11:29:59.337 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:59.325+0000 7f7b5f5df640 1 -- start start 2023-11-13T11:29:59.338 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:59.325+0000 7f7b5f5df640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7b58071620 0x7f7b580c47a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:59.338 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:59.325+0000 7f7b5f5df640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7b580b1920 0x7f7b581f2310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:59.338 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:59.325+0000 7f7b5f5df640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7b5815d0b0 0x7f7b580cbe90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:59.338 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:59.325+0000 7f7b5f5df640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b580c5290 con 0x7f7b5815d0b0 2023-11-13T11:29:59.338 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:59.325+0000 7f7b5f5df640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b580cadf0 con 0x7f7b580b1920 2023-11-13T11:29:59.339 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:59.325+0000 7f7b5f5df640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7b580cb0d0 con 0x7f7b58071620 2023-11-13T11:29:59.339 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:59.325+0000 7f7b5db7c640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7b5815d0b0 0x7f7b580cbe90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:59.339 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:59.325+0000 7f7b5db7c640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7b5815d0b0 0x7f7b580cbe90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:38270/0 (socket says 172.21.15.102:38270) 2023-11-13T11:29:59.339 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:59.325+0000 7f7b5db7c640 1 -- 172.21.15.102:0/3039823035 learned_addr learned my addr 172.21.15.102:0/3039823035 (peer_addr_for_me v2:172.21.15.102:0/0) 2023-11-13T11:29:59.339 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:59.325+0000 7f7b5d37b640 1 --2- 172.21.15.102:0/3039823035 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7b58071620 0x7f7b580c47a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:59.340 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:59.325+0000 7f7b5cb7a640 1 --2- 172.21.15.102:0/3039823035 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7b580b1920 0x7f7b581f2310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:59.340 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:59.325+0000 7f7b5db7c640 1 -- 172.21.15.102:0/3039823035 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7b58071620 msgr2=0x7f7b580c47a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:59.340 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:59.325+0000 7f7b5db7c640 1 --2- 172.21.15.102:0/3039823035 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7b58071620 0x7f7b580c47a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:59.340 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:59.325+0000 7f7b5db7c640 1 -- 172.21.15.102:0/3039823035 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7b580b1920 msgr2=0x7f7b581f2310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:29:59.340 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:59.325+0000 7f7b5db7c640 1 --2- 172.21.15.102:0/3039823035 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7b580b1920 0x7f7b581f2310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:29:59.341 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:59.329+0000 7f7b5db7c640 1 -- 172.21.15.102:0/3039823035 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b480094d0 con 0x7f7b5815d0b0 2023-11-13T11:29:59.341 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:59.329+0000 7f7b5db7c640 1 --2- 172.21.15.102:0/3039823035 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7b5815d0b0 0x7f7b580cbe90 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f7b5000cd80 tx=0x7f7b5000a650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-13T11:29:59.341 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:59.329+0000 7f7b4dffb640 1 -- 172.21.15.102:0/3039823035 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b5000f680 con 0x7f7b5815d0b0 2023-11-13T11:29:59.342 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:59.329+0000 7f7b4dffb640 1 -- 172.21.15.102:0/3039823035 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b5000f800 con 0x7f7b5815d0b0 2023-11-13T11:29:59.342 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:59.329+0000 7f7b5f5df640 1 -- 172.21.15.102:0/3039823035 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7b580cb3b0 con 0x7f7b5815d0b0 2023-11-13T11:29:59.342 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:59.329+0000 7f7b4dffb640 1 -- 172.21.15.102:0/3039823035 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b5000fbb0 con 0x7f7b5815d0b0 2023-11-13T11:29:59.342 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:59.329+0000 7f7b5f5df640 1 -- 172.21.15.102:0/3039823035 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7b580cb970 con 0x7f7b5815d0b0 2023-11-13T11:29:59.342 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:59.329+0000 7f7b5f5df640 1 -- 172.21.15.102:0/3039823035 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7b58067640 con 0x7f7b5815d0b0 2023-11-13T11:29:59.343 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:59.329+0000 7f7b4dffb640 1 -- 172.21.15.102:0/3039823035 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f7b5000b040 con 0x7f7b5815d0b0 2023-11-13T11:29:59.344 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:59.329+0000 7f7b4dffb640 1 --2- 172.21.15.102:0/3039823035 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f7b3c066470 0x7f7b3c068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:29:59.344 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:59.329+0000 7f7b4dffb640 1 -- 172.21.15.102:0/3039823035 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f7b50084760 con 0x7f7b5815d0b0 2023-11-13T11:29:59.344 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:59.329+0000 7f7b5d37b640 1 --2- 172.21.15.102:0/3039823035 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f7b3c066470 0x7f7b3c068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:29:59.344 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:59.333+0000 7f7b5d37b640 1 --2- 172.21.15.102:0/3039823035 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f7b3c066470 0x7f7b3c068930 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f7b5400aae0 tx=0x7f7b54008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-13T11:29:59.344 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:59.333+0000 7f7b4dffb640 1 -- 172.21.15.102:0/3039823035 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f7b50051bf0 con 0x7f7b5815d0b0 2023-11-13T11:29:59.521 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:29:59.513+0000 7f7b5f5df640 1 -- 172.21.15.102:0/3039823035 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f7b580cbb60 con 0x7f7b5815d0b0 2023-11-13T11:30:00.089 INFO:tasks.ceph.mds.a.smithi102.stderr:2023-11-13T11:30:00.085+0000 7fd98414d640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-11-13T11:30:00.162 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:00.153+0000 7f7b4dffb640 1 -- 172.21.15.102:0/3039823035 <== mon.0 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v16) v1 ==== 122+0+0 (secure 0 0 0) 0x7f7b50055210 con 0x7f7b5815d0b0 2023-11-13T11:30:00.165 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:00.157+0000 7f7b5f5df640 1 -- 172.21.15.102:0/3039823035 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f7b3c066470 msgr2=0x7f7b3c068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:30:00.165 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:00.157+0000 7f7b5f5df640 1 --2- 172.21.15.102:0/3039823035 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f7b3c066470 0x7f7b3c068930 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f7b5400aae0 tx=0x7f7b54008040 comp rx=0 tx=0).stop 2023-11-13T11:30:00.165 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:00.157+0000 7f7b5f5df640 1 -- 172.21.15.102:0/3039823035 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7b5815d0b0 msgr2=0x7f7b580cbe90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:30:00.165 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:00.157+0000 7f7b5f5df640 1 --2- 172.21.15.102:0/3039823035 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7b5815d0b0 0x7f7b580cbe90 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f7b5000cd80 tx=0x7f7b5000a650 comp rx=0 tx=0).stop 2023-11-13T11:30:00.165 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:00.157+0000 7f7b5f5df640 1 -- 172.21.15.102:0/3039823035 shutdown_connections 2023-11-13T11:30:00.166 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:00.157+0000 7f7b5f5df640 1 --2- 172.21.15.102:0/3039823035 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f7b3c066470 0x7f7b3c068930 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:30:00.166 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:00.157+0000 7f7b5f5df640 1 --2- 172.21.15.102:0/3039823035 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7b5815d0b0 0x7f7b580cbe90 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:30:00.166 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:00.157+0000 7f7b5f5df640 1 --2- 172.21.15.102:0/3039823035 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7b580b1920 0x7f7b581f2310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:30:00.166 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:00.157+0000 7f7b5f5df640 1 --2- 172.21.15.102:0/3039823035 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7b58071620 0x7f7b580c47a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:30:00.167 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:00.157+0000 7f7b5f5df640 1 -- 172.21.15.102:0/3039823035 >> 172.21.15.102:0/3039823035 conn(0x7f7b5806a410 msgr2=0x7f7b5815c040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-13T11:30:00.167 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:00.157+0000 7f7b5f5df640 1 -- 172.21.15.102:0/3039823035 shutdown_connections 2023-11-13T11:30:00.167 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:00.157+0000 7f7b5f5df640 1 -- 172.21.15.102:0/3039823035 wait complete. 2023-11-13T11:30:00.185 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-11-13T11:30:00.186 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-13T11:30:00.326 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:00.317+0000 7f003b3aa640 1 Processor -- start 2023-11-13T11:30:00.327 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:00.317+0000 7f003b3aa640 1 -- start start 2023-11-13T11:30:00.327 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:00.317+0000 7f003b3aa640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f003406dc70 0x7f003406ba90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:30:00.327 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:00.317+0000 7f003b3aa640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f003406bfd0 0x7f003413f6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:30:00.328 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:00.317+0000 7f003b3aa640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f003413e530 con 0x7f003413df40 2023-11-13T11:30:00.328 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:00.317+0000 7f003b3aa640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f003406c480 con 0x7f003406dc70 2023-11-13T11:30:00.328 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:00.317+0000 7f003b3aa640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f003415f0a0 con 0x7f003406bfd0 2023-11-13T11:30:00.328 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:00.317+0000 7f0039146640 1 --1- >> v1:172.21.15.102:6789/0 conn(0x7f003413df40 0x7f003415e990 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.102:6789/0 says I am v1:172.21.15.102:57356/0 (socket says 172.21.15.102:57356) 2023-11-13T11:30:00.328 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:00.317+0000 7f0039146640 1 -- 172.21.15.102:0/1593841915 learned_addr learned my addr 172.21.15.102:0/1593841915 (peer_addr_for_me v1:172.21.15.102:0/0) 2023-11-13T11:30:00.331 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:00.321+0000 7f002bfff640 1 -- 172.21.15.102:0/1593841915 <== mon.0 v1:172.21.15.102:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 828199039 0 0) 0x7f003413e530 con 0x7f003413df40 2023-11-13T11:30:00.331 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:00.321+0000 7f002bfff640 1 -- 172.21.15.102:0/1593841915 --> v1:172.21.15.102:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0020003530 con 0x7f003413df40 2023-11-13T11:30:00.331 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:00.321+0000 7f0038945640 1 --2- 172.21.15.102:0/1593841915 >> v2:172.21.15.154:3300/0 conn(0x7f003406dc70 0x7f003406ba90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:30:00.331 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:00.321+0000 7f0039947640 1 --2- 172.21.15.102:0/1593841915 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f003406bfd0 0x7f003413f6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:30:00.331 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:00.321+0000 7f002bfff640 1 -- 172.21.15.102:0/1593841915 <== mon.0 v1:172.21.15.102:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1272864467 0 0) 0x7f0020003530 con 0x7f003413df40 2023-11-13T11:30:00.332 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:00.321+0000 7f002bfff640 1 -- 172.21.15.102:0/1593841915 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f003406bfd0 msgr2=0x7f003413f6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-13T11:30:00.332 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:00.321+0000 7f002bfff640 1 --2- 172.21.15.102:0/1593841915 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f003406bfd0 0x7f003413f6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:30:00.332 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:00.321+0000 7f002bfff640 1 -- 172.21.15.102:0/1593841915 >> v2:172.21.15.154:3300/0 conn(0x7f003406dc70 msgr2=0x7f003406ba90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-13T11:30:00.332 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:00.321+0000 7f002bfff640 1 --2- 172.21.15.102:0/1593841915 >> v2:172.21.15.154:3300/0 conn(0x7f003406dc70 0x7f003406ba90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:30:00.332 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:00.321+0000 7f002bfff640 1 -- 172.21.15.102:0/1593841915 --> v1:172.21.15.102:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f003415f290 con 0x7f003413df40 2023-11-13T11:30:00.333 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:00.321+0000 7f002bfff640 1 -- 172.21.15.102:0/1593841915 <== mon.0 v1:172.21.15.102:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 895381068 0 0) 0x7f0030001680 con 0x7f003413df40 2023-11-13T11:30:00.333 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:00.321+0000 7f0039947640 1 --2- 172.21.15.102:0/1593841915 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f003406bfd0 0x7f003413f6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-13T11:30:00.333 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:00.321+0000 7f002bfff640 1 -- 172.21.15.102:0/1593841915 >> v1:172.21.15.102:6789/0 conn(0x7f003413df40 legacy=0x7f003415e990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:30:00.333 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:00.321+0000 7f002bfff640 1 --2- 172.21.15.102:0/1593841915 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f003406bfd0 0x7f0020003980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:30:00.333 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:00.321+0000 7f002bfff640 1 --2- 172.21.15.102:0/1593841915 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0020003ec0 0x7f00200047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:30:00.334 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:00.321+0000 7f002bfff640 1 --2- 172.21.15.102:0/1593841915 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0020004d10 0x7f0020005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:30:00.334 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:00.321+0000 7f002bfff640 1 -- 172.21.15.102:0/1593841915 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f003406c480 con 0x7f0020003ec0 2023-11-13T11:30:00.334 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:00.321+0000 7f002bfff640 1 -- 172.21.15.102:0/1593841915 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f002000b990 con 0x7f0020004d10 2023-11-13T11:30:00.335 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:00.321+0000 7f002bfff640 1 -- 172.21.15.102:0/1593841915 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f002000bb00 con 0x7f003406bfd0 2023-11-13T11:30:00.335 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:00.321+0000 7f0038945640 1 --2- 172.21.15.102:0/1593841915 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0020003ec0 0x7f00200047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:30:00.335 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:00.321+0000 7f0039146640 1 --2- 172.21.15.102:0/1593841915 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f003406bfd0 0x7f0020003980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:30:00.335 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:00.321+0000 7f0039947640 1 --2- 172.21.15.102:0/1593841915 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0020004d10 0x7f0020005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:30:00.336 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:00.321+0000 7f0038945640 1 -- 172.21.15.102:0/1593841915 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f003406bfd0 msgr2=0x7f0020003980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-13T11:30:00.336 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:00.321+0000 7f0038945640 1 --2- 172.21.15.102:0/1593841915 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f003406bfd0 0x7f0020003980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:30:00.336 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:00.321+0000 7f0038945640 1 -- 172.21.15.102:0/1593841915 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0020004d10 msgr2=0x7f0020005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-13T11:30:00.337 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:00.321+0000 7f0038945640 1 --2- 172.21.15.102:0/1593841915 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0020004d10 0x7f0020005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:30:00.337 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:00.321+0000 7f0038945640 1 -- 172.21.15.102:0/1593841915 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0020003530 con 0x7f0020003ec0 2023-11-13T11:30:00.337 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:00.321+0000 7f0039947640 1 --2- 172.21.15.102:0/1593841915 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0020004d10 0x7f0020005190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-13T11:30:00.341 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:00.325+0000 7f0038945640 1 --2- 172.21.15.102:0/1593841915 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0020003ec0 0x7f00200047d0 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f0024009ae0 tx=0x7f002401ca90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f1f6e92fcab6c235 server_cookie=0 in_seq=0 out_seq=0 2023-11-13T11:30:00.342 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:00.325+0000 7f002bfff640 1 -- 172.21.15.102:0/1593841915 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00240a5680 con 0x7f0020003ec0 2023-11-13T11:30:00.342 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:00.325+0000 7f002bfff640 1 -- 172.21.15.102:0/1593841915 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f00240a57e0 con 0x7f0020003ec0 2023-11-13T11:30:00.342 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:00.325+0000 7f002bfff640 1 -- 172.21.15.102:0/1593841915 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00240a5b90 con 0x7f0020003ec0 2023-11-13T11:30:00.342 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:00.325+0000 7f003b3aa640 1 -- 172.21.15.102:0/1593841915 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0020003ec0 msgr2=0x7f00200047d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:30:00.342 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:00.325+0000 7f003b3aa640 1 --2- 172.21.15.102:0/1593841915 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0020003ec0 0x7f00200047d0 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f0024009ae0 tx=0x7f002401ca90 comp rx=0 tx=0).stop 2023-11-13T11:30:00.343 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:00.325+0000 7f0039947640 1 -- 172.21.15.102:0/1593841915 reap_dead start 2023-11-13T11:30:00.343 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:00.325+0000 7f003b3aa640 1 -- 172.21.15.102:0/1593841915 shutdown_connections 2023-11-13T11:30:00.343 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:00.325+0000 7f003b3aa640 1 -- 172.21.15.102:0/1593841915 >> 172.21.15.102:0/1593841915 conn(0x7f00340b0870 msgr2=0x7f00340b0c80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-13T11:30:00.343 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:00.325+0000 7f003b3aa640 1 -- 172.21.15.102:0/1593841915 shutdown_connections 2023-11-13T11:30:00.343 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:00.325+0000 7f003b3aa640 1 -- 172.21.15.102:0/1593841915 wait complete. 2023-11-13T11:30:00.344 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:00.325+0000 7f003b3aa640 1 Processor -- start 2023-11-13T11:30:00.344 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:00.325+0000 7f003b3aa640 1 -- start start 2023-11-13T11:30:00.344 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:00.325+0000 7f003b3aa640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0020003ec0 0x7f00341417d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:30:00.344 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:00.325+0000 7f003b3aa640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f003415b1c0 0x7f00341f5af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:30:00.344 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:00.325+0000 7f003b3aa640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f003413ba90 0x7f00340aea30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:30:00.345 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:00.325+0000 7f003b3aa640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00341f6030 con 0x7f003413ba90 2023-11-13T11:30:00.345 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:00.325+0000 7f003b3aa640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f003415b600 con 0x7f0020003ec0 2023-11-13T11:30:00.345 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:00.325+0000 7f003b3aa640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00341f6220 con 0x7f003415b1c0 2023-11-13T11:30:00.345 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:00.329+0000 7f0039947640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f003413ba90 0x7f00340aea30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:30:00.345 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:00.329+0000 7f0039947640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f003413ba90 0x7f00340aea30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:38292/0 (socket says 172.21.15.102:38292) 2023-11-13T11:30:00.346 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:00.329+0000 7f0039947640 1 -- 172.21.15.102:0/2433204749 learned_addr learned my addr 172.21.15.102:0/2433204749 (peer_addr_for_me v2:172.21.15.102:0/0) 2023-11-13T11:30:00.346 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:00.329+0000 7f0038945640 1 --2- 172.21.15.102:0/2433204749 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f003415b1c0 0x7f00341f5af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:30:00.346 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:00.329+0000 7f0039146640 1 --2- 172.21.15.102:0/2433204749 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0020003ec0 0x7f00341417d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:30:00.346 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:00.329+0000 7f0039947640 1 -- 172.21.15.102:0/2433204749 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f003415b1c0 msgr2=0x7f00341f5af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:30:00.346 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:00.329+0000 7f0039947640 1 --2- 172.21.15.102:0/2433204749 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f003415b1c0 0x7f00341f5af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:30:00.347 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:00.329+0000 7f0039947640 1 -- 172.21.15.102:0/2433204749 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0020003ec0 msgr2=0x7f00341417d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:30:00.347 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:00.329+0000 7f0039947640 1 --2- 172.21.15.102:0/2433204749 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0020003ec0 0x7f00341417d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:30:00.347 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:00.329+0000 7f0039947640 1 -- 172.21.15.102:0/2433204749 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00341f6500 con 0x7f003413ba90 2023-11-13T11:30:00.347 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:00.329+0000 7f0039947640 1 --2- 172.21.15.102:0/2433204749 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f003413ba90 0x7f00340aea30 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f003404eda0 tx=0x7f002c007700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-13T11:30:00.347 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:00.329+0000 7f0029ffb640 1 -- 172.21.15.102:0/2433204749 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f002c015420 con 0x7f003413ba90 2023-11-13T11:30:00.348 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:00.329+0000 7f0029ffb640 1 -- 172.21.15.102:0/2433204749 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f002c015580 con 0x7f003413ba90 2023-11-13T11:30:00.348 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:00.329+0000 7f003b3aa640 1 -- 172.21.15.102:0/2433204749 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f00341f67e0 con 0x7f003413ba90 2023-11-13T11:30:00.348 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:00.329+0000 7f0029ffb640 1 -- 172.21.15.102:0/2433204749 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f002c015930 con 0x7f003413ba90 2023-11-13T11:30:00.348 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:00.329+0000 7f003b3aa640 1 -- 172.21.15.102:0/2433204749 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f003413bf10 con 0x7f003413ba90 2023-11-13T11:30:00.348 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:00.329+0000 7f003b3aa640 1 -- 172.21.15.102:0/2433204749 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f00341590c0 con 0x7f003413ba90 2023-11-13T11:30:00.349 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:00.329+0000 7f0029ffb640 1 -- 172.21.15.102:0/2433204749 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f002c015a90 con 0x7f003413ba90 2023-11-13T11:30:00.350 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:00.333+0000 7f0029ffb640 1 --2- 172.21.15.102:0/2433204749 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f0018066470 0x7f0018068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:30:00.350 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:00.333+0000 7f0029ffb640 1 -- 172.21.15.102:0/2433204749 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f002c0844b0 con 0x7f003413ba90 2023-11-13T11:30:00.350 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:00.333+0000 7f0039146640 1 --2- 172.21.15.102:0/2433204749 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f0018066470 0x7f0018068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:30:00.351 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:00.333+0000 7f0039146640 1 --2- 172.21.15.102:0/2433204749 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f0018066470 0x7f0018068930 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f0030001cd0 tx=0x7f0030007900 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-13T11:30:00.351 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:00.333+0000 7f0029ffb640 1 -- 172.21.15.102:0/2433204749 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f00341590c0 con 0x7f003413ba90 2023-11-13T11:30:00.525 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:00.517+0000 7f003b3aa640 1 -- 172.21.15.102:0/2433204749 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f00341590c0 con 0x7f003413ba90 2023-11-13T11:30:00.526 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:00.517+0000 7f0029ffb640 1 -- 172.21.15.102:0/2433204749 <== mon.0 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) v1 ==== 94+0+4922 (secure 0 0 0) 0x7f00341590c0 con 0x7f003413ba90 2023-11-13T11:30:00.526 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T11:30:00.526 INFO:teuthology.orchestra.run.smithi102.stdout:{"epoch":16,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4826,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6834/3121803929","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6832","nonce":3121803929},{"type":"v1","addr":"172.21.15.154:6834","nonce":3121803929}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":4829,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6835/2990283260","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6833","nonce":2990283260},{"type":"v1","addr":"172.21.15.154:6835","nonce":2990283260}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":5271,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.102:6836/868460192","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6834","nonce":868460192},{"type":"v1","addr":"172.21.15.102:6836","nonce":868460192}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-13T11:29:56.498042+0000","modified":"2023-11-13T11:29:59.519487+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5274},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5274":{"gid":5274,"name":"a","rank":0,"incarnation":12,"state":"up:active","state_seq":3,"addr":"172.21.15.102:6837/3869977039","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6835","nonce":3869977039},{"type":"v1","addr":"172.21.15.102:6837","nonce":3869977039}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-11-13T11:30:00.527 INFO:teuthology.orchestra.run.smithi102.stderr:dumped fsmap epoch 16 2023-11-13T11:30:00.528 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:00.521+0000 7f003b3aa640 1 -- 172.21.15.102:0/2433204749 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f0018066470 msgr2=0x7f0018068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:30:00.528 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:00.521+0000 7f003b3aa640 1 --2- 172.21.15.102:0/2433204749 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f0018066470 0x7f0018068930 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f0030001cd0 tx=0x7f0030007900 comp rx=0 tx=0).stop 2023-11-13T11:30:00.528 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:00.521+0000 7f003b3aa640 1 -- 172.21.15.102:0/2433204749 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f003413ba90 msgr2=0x7f00340aea30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:30:00.529 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:00.521+0000 7f003b3aa640 1 --2- 172.21.15.102:0/2433204749 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f003413ba90 0x7f00340aea30 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f003404eda0 tx=0x7f002c007700 comp rx=0 tx=0).stop 2023-11-13T11:30:00.529 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:00.521+0000 7f003b3aa640 1 -- 172.21.15.102:0/2433204749 shutdown_connections 2023-11-13T11:30:00.529 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:00.521+0000 7f003b3aa640 1 --2- 172.21.15.102:0/2433204749 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f0018066470 0x7f0018068930 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:30:00.529 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:00.521+0000 7f003b3aa640 1 --2- 172.21.15.102:0/2433204749 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f003413ba90 0x7f00340aea30 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:30:00.529 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:00.521+0000 7f003b3aa640 1 --2- 172.21.15.102:0/2433204749 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f003415b1c0 0x7f00341f5af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:30:00.530 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:00.521+0000 7f003b3aa640 1 --2- 172.21.15.102:0/2433204749 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0020003ec0 0x7f00341417d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:30:00.530 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:00.521+0000 7f003b3aa640 1 -- 172.21.15.102:0/2433204749 >> 172.21.15.102:0/2433204749 conn(0x7f00340b0870 msgr2=0x7f00340afec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-13T11:30:00.530 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:00.521+0000 7f003b3aa640 1 -- 172.21.15.102:0/2433204749 shutdown_connections 2023-11-13T11:30:00.530 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:00.521+0000 7f003b3aa640 1 -- 172.21.15.102:0/2433204749 wait complete. 2023-11-13T11:30:00.547 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-13T11:30:00.685 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:00.677+0000 7fe5e9a32640 1 Processor -- start 2023-11-13T11:30:00.685 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:00.677+0000 7fe5e9a32640 1 -- start start 2023-11-13T11:30:00.686 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:00.677+0000 7fe5e9a32640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fe5e40d0c40 0x7fe5e40c69b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:30:00.686 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:00.677+0000 7fe5e9a32640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe5e40cf490 0x7fe5e40cf920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:30:00.687 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:00.677+0000 7fe5e9a32640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe5e40d1440 con 0x7fe5e41606e0 2023-11-13T11:30:00.687 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:00.677+0000 7fe5e9a32640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe5e40cfe60 con 0x7fe5e40d0c40 2023-11-13T11:30:00.687 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:00.677+0000 7fe5e9a32640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe5e40cdb10 con 0x7fe5e40cf490 2023-11-13T11:30:00.687 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:00.677+0000 7fe5e37fe640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe5e40cf490 0x7fe5e40cf920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:30:00.687 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:00.677+0000 7fe5e27fc640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fe5e40d0c40 0x7fe5e40c69b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:30:00.688 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:00.677+0000 7fe5e27fc640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fe5e40d0c40 0x7fe5e40c69b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.102:53100/0 (socket says 172.21.15.102:53100) 2023-11-13T11:30:00.688 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:00.677+0000 7fe5e37fe640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe5e40cf490 0x7fe5e40cf920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.102:53240/0 (socket says 172.21.15.102:53240) 2023-11-13T11:30:00.688 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:00.677+0000 7fe5e27fc640 1 -- 172.21.15.102:0/1381861056 learned_addr learned my addr 172.21.15.102:0/1381861056 (peer_addr_for_me v2:172.21.15.102:0/0) 2023-11-13T11:30:00.689 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:00.677+0000 7fe5e37fe640 1 -- 172.21.15.102:0/1381861056 >> v2:172.21.15.154:3300/0 conn(0x7fe5e40d0c40 msgr2=0x7fe5e40c69b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-13T11:30:00.689 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:00.677+0000 7fe5e37fe640 1 --2- 172.21.15.102:0/1381861056 >> v2:172.21.15.154:3300/0 conn(0x7fe5e40d0c40 0x7fe5e40c69b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:30:00.689 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:00.677+0000 7fe5e37fe640 1 -- 172.21.15.102:0/1381861056 >> v1:172.21.15.154:6789/0 conn(0x7fe5e41606e0 legacy=0x7fe5e40b3e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:30:00.689 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:00.677+0000 7fe5e37fe640 1 -- 172.21.15.102:0/1381861056 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5e40d1690 con 0x7fe5e40cf490 2023-11-13T11:30:00.689 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:00.677+0000 7fe5e27fc640 1 --2- 172.21.15.102:0/1381861056 >> v2:172.21.15.154:3300/0 conn(0x7fe5e40d0c40 0x7fe5e40c69b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-13T11:30:00.691 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:00.681+0000 7fe5e37fe640 1 --2- 172.21.15.102:0/1381861056 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe5e40cf490 0x7fe5e40cf920 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fe5dc0097c0 tx=0x7fe5dc01c3c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=311f9c4be01ec7a8 server_cookie=0 in_seq=0 out_seq=0 2023-11-13T11:30:00.691 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:00.681+0000 7fe5e1ffb640 1 -- 172.21.15.102:0/1381861056 <== mon.2 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5dc0ac640 con 0x7fe5e40cf490 2023-11-13T11:30:00.691 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:00.681+0000 7fe5e1ffb640 1 -- 172.21.15.102:0/1381861056 <== mon.2 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe5dc0ac7a0 con 0x7fe5e40cf490 2023-11-13T11:30:00.692 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:00.681+0000 7fe5e1ffb640 1 -- 172.21.15.102:0/1381861056 <== mon.2 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5dc0acb30 con 0x7fe5e40cf490 2023-11-13T11:30:00.692 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:00.681+0000 7fe5e9a32640 1 -- 172.21.15.102:0/1381861056 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe5e40cf490 msgr2=0x7fe5e40cf920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:30:00.692 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:00.681+0000 7fe5e9a32640 1 --2- 172.21.15.102:0/1381861056 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe5e40cf490 0x7fe5e40cf920 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fe5dc0097c0 tx=0x7fe5dc01c3c0 comp rx=0 tx=0).stop 2023-11-13T11:30:00.692 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:00.681+0000 7fe5e9a32640 1 -- 172.21.15.102:0/1381861056 shutdown_connections 2023-11-13T11:30:00.692 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:00.681+0000 7fe5e9a32640 1 --2- 172.21.15.102:0/1381861056 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe5e40cf490 0x7fe5e40cf920 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:30:00.693 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:00.681+0000 7fe5e9a32640 1 --2- 172.21.15.102:0/1381861056 >> v2:172.21.15.154:3300/0 conn(0x7fe5e40d0c40 0x7fe5e40c69b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:30:00.693 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:00.681+0000 7fe5e9a32640 1 -- 172.21.15.102:0/1381861056 >> 172.21.15.102:0/1381861056 conn(0x7fe5e409c130 msgr2=0x7fe5e40d2e60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-13T11:30:00.693 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:00.681+0000 7fe5e9a32640 1 -- 172.21.15.102:0/1381861056 shutdown_connections 2023-11-13T11:30:00.693 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:00.681+0000 7fe5e9a32640 1 -- 172.21.15.102:0/1381861056 wait complete. 2023-11-13T11:30:00.696 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:00.685+0000 7fe5e9a32640 1 Processor -- start 2023-11-13T11:30:00.696 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:00.685+0000 7fe5e9a32640 1 -- start start 2023-11-13T11:30:00.696 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:00.685+0000 7fe5e9a32640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe5e40cf490 0x7fe5e414ab00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:30:00.697 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:00.685+0000 7fe5e9a32640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe5e40d0c40 0x7fe5e4158060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:30:00.697 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:00.685+0000 7fe5e9a32640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe5e41606e0 0x7fe5e40cbaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:30:00.697 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:00.685+0000 7fe5e9a32640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5e414bdf0 con 0x7fe5e41606e0 2023-11-13T11:30:00.697 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:00.685+0000 7fe5e9a32640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5e414b1e0 con 0x7fe5e40d0c40 2023-11-13T11:30:00.697 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:00.685+0000 7fe5e9a32640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe5e414b4c0 con 0x7fe5e40cf490 2023-11-13T11:30:00.698 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:00.685+0000 7fe5e37fe640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe5e41606e0 0x7fe5e40cbaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:30:00.698 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:00.685+0000 7fe5e37fe640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe5e41606e0 0x7fe5e40cbaa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:38306/0 (socket says 172.21.15.102:38306) 2023-11-13T11:30:00.699 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:00.685+0000 7fe5e37fe640 1 -- 172.21.15.102:0/2635066366 learned_addr learned my addr 172.21.15.102:0/2635066366 (peer_addr_for_me v2:172.21.15.102:0/0) 2023-11-13T11:30:00.699 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:00.685+0000 7fe5e27fc640 1 --2- 172.21.15.102:0/2635066366 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe5e40d0c40 0x7fe5e4158060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:30:00.699 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:00.685+0000 7fe5e37fe640 1 -- 172.21.15.102:0/2635066366 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe5e40cf490 msgr2=0x7fe5e414ab00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:30:00.700 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:00.685+0000 7fe5e2ffd640 1 --2- 172.21.15.102:0/2635066366 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe5e40cf490 0x7fe5e414ab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:30:00.700 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:00.685+0000 7fe5e37fe640 1 --2- 172.21.15.102:0/2635066366 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe5e40cf490 0x7fe5e414ab00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:30:00.700 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:00.685+0000 7fe5e37fe640 1 -- 172.21.15.102:0/2635066366 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe5e40d0c40 msgr2=0x7fe5e4158060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:30:00.700 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:00.685+0000 7fe5e37fe640 1 --2- 172.21.15.102:0/2635066366 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe5e40d0c40 0x7fe5e4158060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:30:00.700 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:00.685+0000 7fe5e37fe640 1 -- 172.21.15.102:0/2635066366 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5d80094d0 con 0x7fe5e41606e0 2023-11-13T11:30:00.701 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:00.685+0000 7fe5e27fc640 1 --2- 172.21.15.102:0/2635066366 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe5e40d0c40 0x7fe5e4158060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-13T11:30:00.701 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:00.685+0000 7fe5e2ffd640 1 --2- 172.21.15.102:0/2635066366 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe5e40cf490 0x7fe5e414ab00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-13T11:30:00.702 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:00.685+0000 7fe5e37fe640 1 --2- 172.21.15.102:0/2635066366 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe5e41606e0 0x7fe5e40cbaa0 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7fe5dc019ff0 tx=0x7fe5dc019160 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-13T11:30:00.702 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:00.685+0000 7fe5cbfff640 1 -- 172.21.15.102:0/2635066366 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5dc0b5610 con 0x7fe5e41606e0 2023-11-13T11:30:00.702 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:00.685+0000 7fe5cbfff640 1 -- 172.21.15.102:0/2635066366 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe5dc0b5770 con 0x7fe5e41606e0 2023-11-13T11:30:00.702 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:00.685+0000 7fe5cbfff640 1 -- 172.21.15.102:0/2635066366 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5dc0b5b00 con 0x7fe5e41606e0 2023-11-13T11:30:00.703 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:00.689+0000 7fe5e9a32640 1 -- 172.21.15.102:0/2635066366 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe5dc009420 con 0x7fe5e41606e0 2023-11-13T11:30:00.703 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:00.689+0000 7fe5e9a32640 1 -- 172.21.15.102:0/2635066366 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe5e414ba80 con 0x7fe5e41606e0 2023-11-13T11:30:00.703 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:00.689+0000 7fe5e9a32640 1 -- 172.21.15.102:0/2635066366 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe5e4068520 con 0x7fe5e41606e0 2023-11-13T11:30:00.704 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:00.689+0000 7fe5cbfff640 1 -- 172.21.15.102:0/2635066366 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fe5dc0b3040 con 0x7fe5e41606e0 2023-11-13T11:30:00.704 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:00.689+0000 7fe5cbfff640 1 --2- 172.21.15.102:0/2635066366 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7fe5d0066470 0x7fe5d0068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:30:00.705 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:00.689+0000 7fe5cbfff640 1 -- 172.21.15.102:0/2635066366 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe5dc11e260 con 0x7fe5e41606e0 2023-11-13T11:30:00.705 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:00.689+0000 7fe5e2ffd640 1 --2- 172.21.15.102:0/2635066366 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7fe5d0066470 0x7fe5d0068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:30:00.705 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:00.693+0000 7fe5e2ffd640 1 --2- 172.21.15.102:0/2635066366 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7fe5d0066470 0x7fe5d0068930 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fe5d4007fd0 tx=0x7fe5d4009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-13T11:30:00.705 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:00.693+0000 7fe5cbfff640 1 -- 172.21.15.102:0/2635066366 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fe5dc0eb640 con 0x7fe5e41606e0 2023-11-13T11:30:00.853 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:00.845+0000 7fe5e9a32640 1 -- 172.21.15.102:0/2635066366 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe5e40d0410 con 0x7fe5e41606e0 2023-11-13T11:30:00.854 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:00.845+0000 7fe5cbfff640 1 -- 172.21.15.102:0/2635066366 <== mon.0 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v36) v1 ==== 74+0+16545 (secure 0 0 0) 0x7fe5dc0b1090 con 0x7fe5e41606e0 2023-11-13T11:30:00.854 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T11:30:00.855 INFO:teuthology.orchestra.run.smithi102.stdout:{"epoch":36,"fsid":"97b3eb2b-7ccf-4aae-8d92-bff986c671ea","created":"2023-11-13T11:28:31.836724+0000","modified":"2023-11-13T11:29:57.619823+0000","last_up_change":"2023-11-13T11:28:44.876638+0000","last_in_change":"2023-11-13T11:28:35.312740+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-13T11:28:44.981356+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2023-11-13T11:29:54.890079+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"35","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2023-11-13T11:29:55.482816+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"36","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"bdefaa17-fcca-4c86-aa40-27dc33a789af","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6800","nonce":53303834},{"type":"v1","addr":"172.21.15.102:6801","nonce":53303834}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6802","nonce":53303834},{"type":"v1","addr":"172.21.15.102:6803","nonce":53303834}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6806","nonce":53303834},{"type":"v1","addr":"172.21.15.102:6807","nonce":53303834}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6804","nonce":53303834},{"type":"v1","addr":"172.21.15.102:6805","nonce":53303834}]},"public_addr":"172.21.15.102:6801/53303834","cluster_addr":"172.21.15.102:6803/53303834","heartbeat_back_addr":"172.21.15.102:6807/53303834","heartbeat_front_addr":"172.21.15.102:6805/53303834","state":["exists","up"]},{"osd":1,"uuid":"f0033196-dec9-4ae9-945e-6aeef6dbb47f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6808","nonce":1732708348},{"type":"v1","addr":"172.21.15.102:6809","nonce":1732708348}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6811","nonce":1732708348},{"type":"v1","addr":"172.21.15.102:6813","nonce":1732708348}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6818","nonce":1732708348},{"type":"v1","addr":"172.21.15.102:6820","nonce":1732708348}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6815","nonce":1732708348},{"type":"v1","addr":"172.21.15.102:6817","nonce":1732708348}]},"public_addr":"172.21.15.102:6809/1732708348","cluster_addr":"172.21.15.102:6813/1732708348","heartbeat_back_addr":"172.21.15.102:6820/1732708348","heartbeat_front_addr":"172.21.15.102:6817/1732708348","state":["exists","up"]},{"osd":2,"uuid":"496b0834-351e-4ec2-a714-86ed0c0ff4fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6810","nonce":1825475150},{"type":"v1","addr":"172.21.15.102:6812","nonce":1825475150}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6814","nonce":1825475150},{"type":"v1","addr":"172.21.15.102:6816","nonce":1825475150}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6822","nonce":1825475150},{"type":"v1","addr":"172.21.15.102:6823","nonce":1825475150}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6819","nonce":1825475150},{"type":"v1","addr":"172.21.15.102:6821","nonce":1825475150}]},"public_addr":"172.21.15.102:6812/1825475150","cluster_addr":"172.21.15.102:6816/1825475150","heartbeat_back_addr":"172.21.15.102:6823/1825475150","heartbeat_front_addr":"172.21.15.102:6821/1825475150","state":["exists","up"]},{"osd":3,"uuid":"3ba6cc41-e0a0-4273-86cb-90000c06a55a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6824","nonce":4149355528},{"type":"v1","addr":"172.21.15.102:6825","nonce":4149355528}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6826","nonce":4149355528},{"type":"v1","addr":"172.21.15.102:6827","nonce":4149355528}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6830","nonce":4149355528},{"type":"v1","addr":"172.21.15.102:6831","nonce":4149355528}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6828","nonce":4149355528},{"type":"v1","addr":"172.21.15.102:6829","nonce":4149355528}]},"public_addr":"172.21.15.102:6825/4149355528","cluster_addr":"172.21.15.102:6827/4149355528","heartbeat_back_addr":"172.21.15.102:6831/4149355528","heartbeat_front_addr":"172.21.15.102:6829/4149355528","state":["exists","up"]},{"osd":4,"uuid":"16e797d8-e6e7-4140-95c3-b85283c42a2a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6808","nonce":4028899241},{"type":"v1","addr":"172.21.15.154:6809","nonce":4028899241}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6810","nonce":4028899241},{"type":"v1","addr":"172.21.15.154:6811","nonce":4028899241}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6814","nonce":4028899241},{"type":"v1","addr":"172.21.15.154:6815","nonce":4028899241}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6812","nonce":4028899241},{"type":"v1","addr":"172.21.15.154:6813","nonce":4028899241}]},"public_addr":"172.21.15.154:6809/4028899241","cluster_addr":"172.21.15.154:6811/4028899241","heartbeat_back_addr":"172.21.15.154:6815/4028899241","heartbeat_front_addr":"172.21.15.154:6813/4028899241","state":["exists","up"]},{"osd":5,"uuid":"d6ab225c-1b55-450a-89a9-abe5c3f8d6af","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":3562396827},{"type":"v1","addr":"172.21.15.154:6801","nonce":3562396827}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":3562396827},{"type":"v1","addr":"172.21.15.154:6803","nonce":3562396827}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6806","nonce":3562396827},{"type":"v1","addr":"172.21.15.154:6807","nonce":3562396827}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6804","nonce":3562396827},{"type":"v1","addr":"172.21.15.154:6805","nonce":3562396827}]},"public_addr":"172.21.15.154:6801/3562396827","cluster_addr":"172.21.15.154:6803/3562396827","heartbeat_back_addr":"172.21.15.154:6807/3562396827","heartbeat_front_addr":"172.21.15.154:6805/3562396827","state":["exists","up"]},{"osd":6,"uuid":"96f905ac-491c-4662-8e2b-5bb8e929ab9d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6816","nonce":2933728751},{"type":"v1","addr":"172.21.15.154:6817","nonce":2933728751}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6818","nonce":2933728751},{"type":"v1","addr":"172.21.15.154:6819","nonce":2933728751}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6822","nonce":2933728751},{"type":"v1","addr":"172.21.15.154:6823","nonce":2933728751}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6820","nonce":2933728751},{"type":"v1","addr":"172.21.15.154:6821","nonce":2933728751}]},"public_addr":"172.21.15.154:6817/2933728751","cluster_addr":"172.21.15.154:6819/2933728751","heartbeat_back_addr":"172.21.15.154:6823/2933728751","heartbeat_front_addr":"172.21.15.154:6821/2933728751","state":["exists","up"]},{"osd":7,"uuid":"07012d3b-3ab4-40df-a471-93caed22e2dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6824","nonce":1753500785},{"type":"v1","addr":"172.21.15.154:6825","nonce":1753500785}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6826","nonce":1753500785},{"type":"v1","addr":"172.21.15.154:6827","nonce":1753500785}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6830","nonce":1753500785},{"type":"v1","addr":"172.21.15.154:6831","nonce":1753500785}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6828","nonce":1753500785},{"type":"v1","addr":"172.21.15.154:6829","nonce":1753500785}]},"public_addr":"172.21.15.154:6825/1753500785","cluster_addr":"172.21.15.154:6827/1753500785","heartbeat_back_addr":"172.21.15.154:6831/1753500785","heartbeat_front_addr":"172.21.15.154:6829/1753500785","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-13T11:28:40.978603+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-13T11:28:41.200985+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-13T11:28:41.222815+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-13T11:28:41.202162+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-13T11:28:40.925911+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-13T11:28:41.087725+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-13T11:28:41.072208+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-13T11:28:40.875257+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-13T11:30:00.856 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:00.849+0000 7fe5e9a32640 1 -- 172.21.15.102:0/2635066366 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7fe5d0066470 msgr2=0x7fe5d0068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:30:00.857 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:00.849+0000 7fe5e9a32640 1 --2- 172.21.15.102:0/2635066366 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7fe5d0066470 0x7fe5d0068930 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fe5d4007fd0 tx=0x7fe5d4009040 comp rx=0 tx=0).stop 2023-11-13T11:30:00.857 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:00.849+0000 7fe5e9a32640 1 -- 172.21.15.102:0/2635066366 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe5e41606e0 msgr2=0x7fe5e40cbaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:30:00.857 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:00.849+0000 7fe5e9a32640 1 --2- 172.21.15.102:0/2635066366 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe5e41606e0 0x7fe5e40cbaa0 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7fe5dc019ff0 tx=0x7fe5dc019160 comp rx=0 tx=0).stop 2023-11-13T11:30:00.857 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:00.849+0000 7fe5e9a32640 1 -- 172.21.15.102:0/2635066366 shutdown_connections 2023-11-13T11:30:00.857 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:00.849+0000 7fe5e9a32640 1 --2- 172.21.15.102:0/2635066366 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7fe5d0066470 0x7fe5d0068930 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:30:00.858 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:00.849+0000 7fe5e9a32640 1 --2- 172.21.15.102:0/2635066366 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe5e41606e0 0x7fe5e40cbaa0 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:30:00.858 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:00.849+0000 7fe5e9a32640 1 --2- 172.21.15.102:0/2635066366 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe5e40d0c40 0x7fe5e4158060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:30:00.858 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:00.849+0000 7fe5e9a32640 1 --2- 172.21.15.102:0/2635066366 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe5e40cf490 0x7fe5e414ab00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:30:00.858 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:00.849+0000 7fe5e9a32640 1 -- 172.21.15.102:0/2635066366 >> 172.21.15.102:0/2635066366 conn(0x7fe5e409c130 msgr2=0x7fe5e415e240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-13T11:30:00.858 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:00.849+0000 7fe5e9a32640 1 -- 172.21.15.102:0/2635066366 shutdown_connections 2023-11-13T11:30:00.862 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:00.849+0000 7fe5e9a32640 1 -- 172.21.15.102:0/2635066366 wait complete. 2023-11-13T11:30:00.876 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-11-13T11:30:00.876 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-13T11:30:01.014 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:01.005+0000 7fdda00ea640 1 Processor -- start 2023-11-13T11:30:01.014 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:01.005+0000 7fdda00ea640 1 -- start start 2023-11-13T11:30:01.015 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:01.009+0000 7fdda00ea640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fdd9806e0d0 0x7fdd980b2de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:30:01.016 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:01.009+0000 7fdda00ea640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdd9806e4b0 con 0x7fdd980b3320 2023-11-13T11:30:01.016 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:01.009+0000 7fdda00ea640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdd9806c430 con 0x7fdd9806b960 2023-11-13T11:30:01.016 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:01.009+0000 7fdda00ea640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdd980b37c0 con 0x7fdd9806e0d0 2023-11-13T11:30:01.016 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:01.009+0000 7fdd9d685640 1 --1- >> v1:172.21.15.102:6789/0 conn(0x7fdd980b3320 0x7fdd9806b250 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.102:6789/0 says I am v1:172.21.15.102:57372/0 (socket says 172.21.15.102:57372) 2023-11-13T11:30:01.016 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:01.009+0000 7fdd9d685640 1 -- 172.21.15.102:0/3985020358 learned_addr learned my addr 172.21.15.102:0/3985020358 (peer_addr_for_me v1:172.21.15.102:0/0) 2023-11-13T11:30:01.018 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:01.009+0000 7fdd9de86640 1 --2- 172.21.15.102:0/3985020358 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fdd9806e0d0 0x7fdd980b2de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:30:01.019 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:01.009+0000 7fdd9ce84640 1 -- 172.21.15.102:0/3985020358 <== mon.0 v1:172.21.15.102:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2009124312 0 0) 0x7fdd88001120 con 0x7fdd980b3320 2023-11-13T11:30:01.019 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:01.009+0000 7fdd9ce84640 1 -- 172.21.15.102:0/3985020358 --> v1:172.21.15.102:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdd84003530 con 0x7fdd980b3320 2023-11-13T11:30:01.019 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:01.009+0000 7fdd9ce84640 1 -- 172.21.15.102:0/3985020358 <== mon.0 v1:172.21.15.102:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3972813676 0 0) 0x7fdd84003530 con 0x7fdd980b3320 2023-11-13T11:30:01.019 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:01.009+0000 7fdd9ce84640 1 -- 172.21.15.102:0/3985020358 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fdd9806e0d0 msgr2=0x7fdd980b2de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-13T11:30:01.019 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:01.009+0000 7fdd9ce84640 1 --2- 172.21.15.102:0/3985020358 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fdd9806e0d0 0x7fdd980b2de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:30:01.020 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:01.009+0000 7fdd9ce84640 1 -- 172.21.15.102:0/3985020358 >> v1:172.21.15.154:6789/0 conn(0x7fdd9806b960 legacy=0x7fdd980adc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:30:01.020 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:01.009+0000 7fdd9ce84640 1 -- 172.21.15.102:0/3985020358 --> v1:172.21.15.102:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd980b3aa0 con 0x7fdd980b3320 2023-11-13T11:30:01.020 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:01.009+0000 7fdd9ce84640 1 -- 172.21.15.102:0/3985020358 <== mon.0 v1:172.21.15.102:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 895381068 0 0) 0x7fdd88001810 con 0x7fdd980b3320 2023-11-13T11:30:01.020 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:01.009+0000 7fdd9ce84640 1 -- 172.21.15.102:0/3985020358 >> v1:172.21.15.102:6789/0 conn(0x7fdd980b3320 legacy=0x7fdd9806b250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:30:01.020 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:01.009+0000 7fdd9ce84640 1 --2- 172.21.15.102:0/3985020358 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdd840039b0 0x7fdd84003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:30:01.021 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:01.009+0000 7fdd9ce84640 1 --2- 172.21.15.102:0/3985020358 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fdd9806e0d0 0x7fdd840047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:30:01.021 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:01.009+0000 7fdd9ce84640 1 --2- 172.21.15.102:0/3985020358 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fdd84004d10 0x7fdd84005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:30:01.021 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:01.009+0000 7fdd9ce84640 1 -- 172.21.15.102:0/3985020358 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd980b37c0 con 0x7fdd84004d10 2023-11-13T11:30:01.021 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:01.009+0000 7fdd9ce84640 1 -- 172.21.15.102:0/3985020358 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd8400b990 con 0x7fdd840039b0 2023-11-13T11:30:01.021 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:01.009+0000 7fdd9ce84640 1 -- 172.21.15.102:0/3985020358 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdd8400bb50 con 0x7fdd9806e0d0 2023-11-13T11:30:01.022 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:01.009+0000 7fdd9de86640 1 --2- 172.21.15.102:0/3985020358 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdd840039b0 0x7fdd84003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:30:01.022 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:01.009+0000 7fdd9e687640 1 --2- 172.21.15.102:0/3985020358 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fdd84004d10 0x7fdd84005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:30:01.022 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:01.009+0000 7fdd9d685640 1 --2- 172.21.15.102:0/3985020358 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fdd9806e0d0 0x7fdd840047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:30:01.022 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:01.009+0000 7fdd9de86640 1 -- 172.21.15.102:0/3985020358 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fdd9806e0d0 msgr2=0x7fdd840047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-13T11:30:01.022 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:01.009+0000 7fdd9de86640 1 --2- 172.21.15.102:0/3985020358 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fdd9806e0d0 0x7fdd840047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:30:01.023 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:01.009+0000 7fdd9de86640 1 -- 172.21.15.102:0/3985020358 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fdd84004d10 msgr2=0x7fdd84005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-13T11:30:01.024 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:01.009+0000 7fdd9de86640 1 --2- 172.21.15.102:0/3985020358 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fdd84004d10 0x7fdd84005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:30:01.024 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:01.009+0000 7fdd9de86640 1 -- 172.21.15.102:0/3985020358 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd84003530 con 0x7fdd840039b0 2023-11-13T11:30:01.027 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:01.013+0000 7fdd9de86640 1 --2- 172.21.15.102:0/3985020358 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdd840039b0 0x7fdd84003d90 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fdd94009ae0 tx=0x7fdd9401c990 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a742d8390dfa643c server_cookie=0 in_seq=0 out_seq=0 2023-11-13T11:30:01.028 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:01.013+0000 7fdd9ce84640 1 -- 172.21.15.102:0/3985020358 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd940a6480 con 0x7fdd840039b0 2023-11-13T11:30:01.028 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:01.013+0000 7fdd9ce84640 1 -- 172.21.15.102:0/3985020358 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd940a65e0 con 0x7fdd840039b0 2023-11-13T11:30:01.028 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:01.013+0000 7fdd9ce84640 1 -- 172.21.15.102:0/3985020358 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd940a6990 con 0x7fdd840039b0 2023-11-13T11:30:01.028 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:01.013+0000 7fdda00ea640 1 -- 172.21.15.102:0/3985020358 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdd840039b0 msgr2=0x7fdd84003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:30:01.028 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:01.013+0000 7fdda00ea640 1 --2- 172.21.15.102:0/3985020358 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdd840039b0 0x7fdd84003d90 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fdd94009ae0 tx=0x7fdd9401c990 comp rx=0 tx=0).stop 2023-11-13T11:30:01.029 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:01.013+0000 7fdd9e687640 1 -- 172.21.15.102:0/3985020358 reap_dead start 2023-11-13T11:30:01.029 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:01.013+0000 7fdda00ea640 1 -- 172.21.15.102:0/3985020358 shutdown_connections 2023-11-13T11:30:01.029 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:01.013+0000 7fdda00ea640 1 -- 172.21.15.102:0/3985020358 >> 172.21.15.102:0/3985020358 conn(0x7fdd98070590 msgr2=0x7fdd980709a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-13T11:30:01.030 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:01.013+0000 7fdda00ea640 1 -- 172.21.15.102:0/3985020358 shutdown_connections 2023-11-13T11:30:01.030 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:01.013+0000 7fdda00ea640 1 -- 172.21.15.102:0/3985020358 wait complete. 2023-11-13T11:30:01.030 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:01.017+0000 7fdda00ea640 1 Processor -- start 2023-11-13T11:30:01.030 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:01.017+0000 7fdda00ea640 1 -- start start 2023-11-13T11:30:01.031 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:01.017+0000 7fdda00ea640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdd840039b0 0x7fdd981e82d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:30:01.031 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:01.017+0000 7fdda00ea640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fdd9814ff10 0x7fdd98150390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:30:01.031 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:01.017+0000 7fdda00ea640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fdd981e5730 0x7fdd981e5bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:30:01.031 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:01.017+0000 7fdda00ea640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd981e7500 con 0x7fdd9814ff10 2023-11-13T11:30:01.031 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:01.017+0000 7fdda00ea640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd981e7070 con 0x7fdd840039b0 2023-11-13T11:30:01.032 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:01.017+0000 7fdda00ea640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdd981508d0 con 0x7fdd981e5730 2023-11-13T11:30:01.032 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:01.017+0000 7fdd9d685640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fdd9814ff10 0x7fdd98150390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:30:01.032 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:01.017+0000 7fdd9d685640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fdd9814ff10 0x7fdd98150390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:38320/0 (socket says 172.21.15.102:38320) 2023-11-13T11:30:01.032 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:01.017+0000 7fdd9d685640 1 -- 172.21.15.102:0/582224494 learned_addr learned my addr 172.21.15.102:0/582224494 (peer_addr_for_me v2:172.21.15.102:0/0) 2023-11-13T11:30:01.032 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:01.017+0000 7fdd9de86640 1 --2- 172.21.15.102:0/582224494 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdd840039b0 0x7fdd981e82d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:30:01.033 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:01.017+0000 7fdd9e687640 1 --2- 172.21.15.102:0/582224494 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fdd981e5730 0x7fdd981e5bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:30:01.033 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:01.017+0000 7fdd9d685640 1 -- 172.21.15.102:0/582224494 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fdd981e5730 msgr2=0x7fdd981e5bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:30:01.033 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:01.017+0000 7fdd9d685640 1 --2- 172.21.15.102:0/582224494 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fdd981e5730 0x7fdd981e5bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:30:01.033 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:01.017+0000 7fdd9d685640 1 -- 172.21.15.102:0/582224494 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdd840039b0 msgr2=0x7fdd981e82d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:30:01.033 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:01.017+0000 7fdd9d685640 1 --2- 172.21.15.102:0/582224494 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdd840039b0 0x7fdd981e82d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:30:01.034 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:01.017+0000 7fdd9d685640 1 -- 172.21.15.102:0/582224494 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd981e6460 con 0x7fdd9814ff10 2023-11-13T11:30:01.034 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:01.017+0000 7fdd9e687640 1 --2- 172.21.15.102:0/582224494 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fdd981e5730 0x7fdd981e5bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-13T11:30:01.034 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:01.017+0000 7fdd9d685640 1 --2- 172.21.15.102:0/582224494 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fdd9814ff10 0x7fdd98150390 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7fdd88004880 tx=0x7fdd88012630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-13T11:30:01.034 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:01.017+0000 7fdd8e7fc640 1 -- 172.21.15.102:0/582224494 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd880155e0 con 0x7fdd9814ff10 2023-11-13T11:30:01.035 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:01.017+0000 7fdd8e7fc640 1 -- 172.21.15.102:0/582224494 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd88015740 con 0x7fdd9814ff10 2023-11-13T11:30:01.035 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:01.017+0000 7fdda00ea640 1 -- 172.21.15.102:0/582224494 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdd981e6740 con 0x7fdd9814ff10 2023-11-13T11:30:01.035 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:01.017+0000 7fdd8e7fc640 1 -- 172.21.15.102:0/582224494 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd88015af0 con 0x7fdd9814ff10 2023-11-13T11:30:01.035 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:01.017+0000 7fdda00ea640 1 -- 172.21.15.102:0/582224494 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdd981e6d00 con 0x7fdd9814ff10 2023-11-13T11:30:01.035 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:01.017+0000 7fdda00ea640 1 -- 172.21.15.102:0/582224494 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdd981e7200 con 0x7fdd9814ff10 2023-11-13T11:30:01.036 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:01.021+0000 7fdd8e7fc640 1 -- 172.21.15.102:0/582224494 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fdd88015c50 con 0x7fdd9814ff10 2023-11-13T11:30:01.037 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:01.021+0000 7fdd8e7fc640 1 --2- 172.21.15.102:0/582224494 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7fdd7c066470 0x7fdd7c068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:30:01.037 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:01.021+0000 7fdd8e7fc640 1 -- 172.21.15.102:0/582224494 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fdd88086590 con 0x7fdd9814ff10 2023-11-13T11:30:01.037 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:01.021+0000 7fdd9de86640 1 --2- 172.21.15.102:0/582224494 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7fdd7c066470 0x7fdd7c068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:30:01.037 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:01.021+0000 7fdd9de86640 1 --2- 172.21.15.102:0/582224494 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7fdd7c066470 0x7fdd7c068930 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fdd940ad000 tx=0x7fdd940b3040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-13T11:30:01.038 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:01.025+0000 7fdd8e7fc640 1 -- 172.21.15.102:0/582224494 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fdd88053ab0 con 0x7fdd9814ff10 2023-11-13T11:30:01.182 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:01.173+0000 7fdda00ea640 1 -- 172.21.15.102:0/582224494 --> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fdd980ad6e0 con 0x7fdd7c066470 2023-11-13T11:30:01.191 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:01.185+0000 7fdd8e7fc640 1 -- 172.21.15.102:0/582224494 <== mgr.4103 v2:172.21.15.102:6832/1009482693 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+289760 (secure 0 0 0) 0x7fdd9400f000 con 0x7fdd7c066470 2023-11-13T11:30:01.194 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T11:30:01.196 INFO:teuthology.orchestra.run.smithi102.stderr:dumped all 2023-11-13T11:30:01.197 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:01.189+0000 7fdda00ea640 1 -- 172.21.15.102:0/582224494 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7fdd7c066470 msgr2=0x7fdd7c068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:30:01.198 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:01.189+0000 7fdda00ea640 1 --2- 172.21.15.102:0/582224494 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7fdd7c066470 0x7fdd7c068930 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fdd940ad000 tx=0x7fdd940b3040 comp rx=0 tx=0).stop 2023-11-13T11:30:01.198 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:01.189+0000 7fdda00ea640 1 -- 172.21.15.102:0/582224494 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fdd9814ff10 msgr2=0x7fdd98150390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:30:01.198 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:01.189+0000 7fdda00ea640 1 --2- 172.21.15.102:0/582224494 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fdd9814ff10 0x7fdd98150390 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7fdd88004880 tx=0x7fdd88012630 comp rx=0 tx=0).stop 2023-11-13T11:30:01.198 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:01.189+0000 7fdda00ea640 1 -- 172.21.15.102:0/582224494 shutdown_connections 2023-11-13T11:30:01.198 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:01.189+0000 7fdda00ea640 1 --2- 172.21.15.102:0/582224494 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fdd981e5730 0x7fdd981e5bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:30:01.199 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:01.189+0000 7fdda00ea640 1 --2- 172.21.15.102:0/582224494 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7fdd7c066470 0x7fdd7c068930 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:30:01.199 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:01.189+0000 7fdda00ea640 1 --2- 172.21.15.102:0/582224494 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fdd9814ff10 0x7fdd98150390 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:30:01.199 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:01.189+0000 7fdda00ea640 1 --2- 172.21.15.102:0/582224494 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdd840039b0 0x7fdd981e82d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:30:01.199 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:01.189+0000 7fdda00ea640 1 -- 172.21.15.102:0/582224494 >> 172.21.15.102:0/582224494 conn(0x7fdd98070590 msgr2=0x7fdd980ae750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-13T11:30:01.199 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:01.189+0000 7fdda00ea640 1 -- 172.21.15.102:0/582224494 shutdown_connections 2023-11-13T11:30:01.200 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:01.189+0000 7fdda00ea640 1 -- 172.21.15.102:0/582224494 wait complete. 2023-11-13T11:30:01.214 INFO:teuthology.orchestra.run.smithi102.stdout:{"pg_ready":true,"pg_map":{"version":68,"stamp":"2023-11-13T11:30:00.935536+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":166,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":220544,"kb_used_data":4352,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754754176,"statfs":{"total":773094113280,"available":772868276224,"internally_reserved":0,"allocated":4456448,"data_stored":2437658,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":31,"apply_latency_ms":31,"commit_latency_ns":31000000,"apply_latency_ns":31000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.832498"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-13T11:29:58.008315+0000","last_change":"2023-11-13T11:29:56.639972+0000","last_active":"2023-11-13T11:29:58.008315+0000","last_peered":"2023-11-13T11:29:58.008315+0000","last_clean":"2023-11-13T11:29:58.008315+0000","last_became_active":"2023-11-13T11:29:56.639732+0000","last_became_peered":"2023-11-13T11:29:56.639732+0000","last_unstale":"2023-11-13T11:29:58.008315+0000","last_undegraded":"2023-11-13T11:29:58.008315+0000","last_fullsized":"2023-11-13T11:29:58.008315+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-13T11:29:56.100939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-13T11:29:56.100939+0000","last_clean_scrub_stamp":"2023-11-13T11:29:56.100939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-14T22:42:29.649952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-13T11:29:58.899149+0000","last_change":"2023-11-13T11:29:56.653545+0000","last_active":"2023-11-13T11:29:58.899149+0000","last_peered":"2023-11-13T11:29:58.899149+0000","last_clean":"2023-11-13T11:29:58.899149+0000","last_became_active":"2023-11-13T11:29:56.652931+0000","last_became_peered":"2023-11-13T11:29:56.652931+0000","last_unstale":"2023-11-13T11:29:58.899149+0000","last_undegraded":"2023-11-13T11:29:58.899149+0000","last_fullsized":"2023-11-13T11:29:58.899149+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-13T11:29:56.100939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-13T11:29:56.100939+0000","last_clean_scrub_stamp":"2023-11-13T11:29:56.100939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-14T13:42:48.610968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-13T11:29:57.628489+0000","last_change":"2023-11-13T11:29:56.641263+0000","last_active":"2023-11-13T11:29:57.628489+0000","last_peered":"2023-11-13T11:29:57.628489+0000","last_clean":"2023-11-13T11:29:57.628489+0000","last_became_active":"2023-11-13T11:29:56.641014+0000","last_became_peered":"2023-11-13T11:29:56.641014+0000","last_unstale":"2023-11-13T11:29:57.628489+0000","last_undegraded":"2023-11-13T11:29:57.628489+0000","last_fullsized":"2023-11-13T11:29:57.628489+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-13T11:29:56.100939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-13T11:29:56.100939+0000","last_clean_scrub_stamp":"2023-11-13T11:29:56.100939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-14T12:12:25.951745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-13T11:29:57.632969+0000","last_change":"2023-11-13T11:29:56.652504+0000","last_active":"2023-11-13T11:29:57.632969+0000","last_peered":"2023-11-13T11:29:57.632969+0000","last_clean":"2023-11-13T11:29:57.632969+0000","last_became_active":"2023-11-13T11:29:56.651789+0000","last_became_peered":"2023-11-13T11:29:56.651789+0000","last_unstale":"2023-11-13T11:29:57.632969+0000","last_undegraded":"2023-11-13T11:29:57.632969+0000","last_fullsized":"2023-11-13T11:29:57.632969+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-13T11:29:56.100939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-13T11:29:56.100939+0000","last_clean_scrub_stamp":"2023-11-13T11:29:56.100939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-14T14:07:14.129755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-13T11:29:58.898913+0000","last_change":"2023-11-13T11:29:56.631474+0000","last_active":"2023-11-13T11:29:58.898913+0000","last_peered":"2023-11-13T11:29:58.898913+0000","last_clean":"2023-11-13T11:29:58.898913+0000","last_became_active":"2023-11-13T11:29:56.631109+0000","last_became_peered":"2023-11-13T11:29:56.631109+0000","last_unstale":"2023-11-13T11:29:58.898913+0000","last_undegraded":"2023-11-13T11:29:58.898913+0000","last_fullsized":"2023-11-13T11:29:58.898913+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-13T11:29:56.100939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-13T11:29:56.100939+0000","last_clean_scrub_stamp":"2023-11-13T11:29:56.100939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-14T17:12:32.904334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-13T11:29:57.632175+0000","last_change":"2023-11-13T11:29:56.648095+0000","last_active":"2023-11-13T11:29:57.632175+0000","last_peered":"2023-11-13T11:29:57.632175+0000","last_clean":"2023-11-13T11:29:57.632175+0000","last_became_active":"2023-11-13T11:29:56.647756+0000","last_became_peered":"2023-11-13T11:29:56.647756+0000","last_unstale":"2023-11-13T11:29:57.632175+0000","last_undegraded":"2023-11-13T11:29:57.632175+0000","last_fullsized":"2023-11-13T11:29:57.632175+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-13T11:29:56.100939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-13T11:29:56.100939+0000","last_clean_scrub_stamp":"2023-11-13T11:29:56.100939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-14T22:13:59.841241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-13T11:29:58.007895+0000","last_change":"2023-11-13T11:29:56.640694+0000","last_active":"2023-11-13T11:29:58.007895+0000","last_peered":"2023-11-13T11:29:58.007895+0000","last_clean":"2023-11-13T11:29:58.007895+0000","last_became_active":"2023-11-13T11:29:56.640411+0000","last_became_peered":"2023-11-13T11:29:56.640411+0000","last_unstale":"2023-11-13T11:29:58.007895+0000","last_undegraded":"2023-11-13T11:29:58.007895+0000","last_fullsized":"2023-11-13T11:29:58.007895+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-13T11:29:56.100939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-13T11:29:56.100939+0000","last_clean_scrub_stamp":"2023-11-13T11:29:56.100939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-14T15:19:54.300012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-13T11:29:58.007881+0000","last_change":"2023-11-13T11:29:56.646127+0000","last_active":"2023-11-13T11:29:58.007881+0000","last_peered":"2023-11-13T11:29:58.007881+0000","last_clean":"2023-11-13T11:29:58.007881+0000","last_became_active":"2023-11-13T11:29:56.645832+0000","last_became_peered":"2023-11-13T11:29:56.645832+0000","last_unstale":"2023-11-13T11:29:58.007881+0000","last_undegraded":"2023-11-13T11:29:58.007881+0000","last_fullsized":"2023-11-13T11:29:58.007881+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-13T11:29:56.100939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-13T11:29:56.100939+0000","last_clean_scrub_stamp":"2023-11-13T11:29:56.100939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-14T15:51:57.260172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-13T11:29:57.628440+0000","last_change":"2023-11-13T11:29:56.652998+0000","last_active":"2023-11-13T11:29:57.628440+0000","last_peered":"2023-11-13T11:29:57.628440+0000","last_clean":"2023-11-13T11:29:57.628440+0000","last_became_active":"2023-11-13T11:29:56.652730+0000","last_became_peered":"2023-11-13T11:29:56.652730+0000","last_unstale":"2023-11-13T11:29:57.628440+0000","last_undegraded":"2023-11-13T11:29:57.628440+0000","last_fullsized":"2023-11-13T11:29:57.628440+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-13T11:29:56.100939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-13T11:29:56.100939+0000","last_clean_scrub_stamp":"2023-11-13T11:29:56.100939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-14T20:51:46.721526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-13T11:29:57.633212+0000","last_change":"2023-11-13T11:29:56.652981+0000","last_active":"2023-11-13T11:29:57.633212+0000","last_peered":"2023-11-13T11:29:57.633212+0000","last_clean":"2023-11-13T11:29:57.633212+0000","last_became_active":"2023-11-13T11:29:56.652698+0000","last_became_peered":"2023-11-13T11:29:56.652698+0000","last_unstale":"2023-11-13T11:29:57.633212+0000","last_undegraded":"2023-11-13T11:29:57.633212+0000","last_fullsized":"2023-11-13T11:29:57.633212+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-13T11:29:56.100939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-13T11:29:56.100939+0000","last_clean_scrub_stamp":"2023-11-13T11:29:56.100939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-14T15:12:20.880081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-13T11:29:57.797894+0000","last_change":"2023-11-13T11:29:56.652698+0000","last_active":"2023-11-13T11:29:57.797894+0000","last_peered":"2023-11-13T11:29:57.797894+0000","last_clean":"2023-11-13T11:29:57.797894+0000","last_became_active":"2023-11-13T11:29:56.652046+0000","last_became_peered":"2023-11-13T11:29:56.652046+0000","last_unstale":"2023-11-13T11:29:57.797894+0000","last_undegraded":"2023-11-13T11:29:57.797894+0000","last_fullsized":"2023-11-13T11:29:57.797894+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-13T11:29:56.100939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-13T11:29:56.100939+0000","last_clean_scrub_stamp":"2023-11-13T11:29:56.100939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-14T21:46:13.496607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-13T11:29:57.628301+0000","last_change":"2023-11-13T11:29:56.634704+0000","last_active":"2023-11-13T11:29:57.628301+0000","last_peered":"2023-11-13T11:29:57.628301+0000","last_clean":"2023-11-13T11:29:57.628301+0000","last_became_active":"2023-11-13T11:29:56.631581+0000","last_became_peered":"2023-11-13T11:29:56.631581+0000","last_unstale":"2023-11-13T11:29:57.628301+0000","last_undegraded":"2023-11-13T11:29:57.628301+0000","last_fullsized":"2023-11-13T11:29:57.628301+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-13T11:29:56.100939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-13T11:29:56.100939+0000","last_clean_scrub_stamp":"2023-11-13T11:29:56.100939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-14T21:54:04.224470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-13T11:29:57.983009+0000","last_change":"2023-11-13T11:29:56.656157+0000","last_active":"2023-11-13T11:29:57.983009+0000","last_peered":"2023-11-13T11:29:57.983009+0000","last_clean":"2023-11-13T11:29:57.983009+0000","last_became_active":"2023-11-13T11:29:56.655842+0000","last_became_peered":"2023-11-13T11:29:56.655842+0000","last_unstale":"2023-11-13T11:29:57.983009+0000","last_undegraded":"2023-11-13T11:29:57.983009+0000","last_fullsized":"2023-11-13T11:29:57.983009+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-13T11:29:56.100939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-13T11:29:56.100939+0000","last_clean_scrub_stamp":"2023-11-13T11:29:56.100939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-14T12:57:15.751399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-13T11:29:57.632599+0000","last_change":"2023-11-13T11:29:56.652024+0000","last_active":"2023-11-13T11:29:57.632599+0000","last_peered":"2023-11-13T11:29:57.632599+0000","last_clean":"2023-11-13T11:29:57.632599+0000","last_became_active":"2023-11-13T11:29:56.651727+0000","last_became_peered":"2023-11-13T11:29:56.651727+0000","last_unstale":"2023-11-13T11:29:57.632599+0000","last_undegraded":"2023-11-13T11:29:57.632599+0000","last_fullsized":"2023-11-13T11:29:57.632599+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-13T11:29:56.100939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-13T11:29:56.100939+0000","last_clean_scrub_stamp":"2023-11-13T11:29:56.100939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-14T14:40:28.997511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-13T11:29:58.898395+0000","last_change":"2023-11-13T11:29:56.643726+0000","last_active":"2023-11-13T11:29:58.898395+0000","last_peered":"2023-11-13T11:29:58.898395+0000","last_clean":"2023-11-13T11:29:58.898395+0000","last_became_active":"2023-11-13T11:29:56.643327+0000","last_became_peered":"2023-11-13T11:29:56.643327+0000","last_unstale":"2023-11-13T11:29:58.898395+0000","last_undegraded":"2023-11-13T11:29:58.898395+0000","last_fullsized":"2023-11-13T11:29:58.898395+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-13T11:29:56.100939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-13T11:29:56.100939+0000","last_clean_scrub_stamp":"2023-11-13T11:29:56.100939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-14T14:40:28.997511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-13T11:29:58.898399+0000","last_change":"2023-11-13T11:29:56.642763+0000","last_active":"2023-11-13T11:29:58.898399+0000","last_peered":"2023-11-13T11:29:58.898399+0000","last_clean":"2023-11-13T11:29:58.898399+0000","last_became_active":"2023-11-13T11:29:56.642414+0000","last_became_peered":"2023-11-13T11:29:56.642414+0000","last_unstale":"2023-11-13T11:29:58.898399+0000","last_undegraded":"2023-11-13T11:29:58.898399+0000","last_fullsized":"2023-11-13T11:29:58.898399+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-13T11:29:56.100939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-13T11:29:56.100939+0000","last_clean_scrub_stamp":"2023-11-13T11:29:56.100939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-14T16:23:20.155271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-13T11:29:57.798167+0000","last_change":"2023-11-13T11:29:56.643684+0000","last_active":"2023-11-13T11:29:57.798167+0000","last_peered":"2023-11-13T11:29:57.798167+0000","last_clean":"2023-11-13T11:29:57.798167+0000","last_became_active":"2023-11-13T11:29:56.641077+0000","last_became_peered":"2023-11-13T11:29:56.641077+0000","last_unstale":"2023-11-13T11:29:57.798167+0000","last_undegraded":"2023-11-13T11:29:57.798167+0000","last_fullsized":"2023-11-13T11:29:57.798167+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-13T11:29:56.100939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-13T11:29:56.100939+0000","last_clean_scrub_stamp":"2023-11-13T11:29:56.100939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-14T12:12:20.901983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-13T11:29:57.632641+0000","last_change":"2023-11-13T11:29:56.648623+0000","last_active":"2023-11-13T11:29:57.632641+0000","last_peered":"2023-11-13T11:29:57.632641+0000","last_clean":"2023-11-13T11:29:57.632641+0000","last_became_active":"2023-11-13T11:29:56.648311+0000","last_became_peered":"2023-11-13T11:29:56.648311+0000","last_unstale":"2023-11-13T11:29:57.632641+0000","last_undegraded":"2023-11-13T11:29:57.632641+0000","last_fullsized":"2023-11-13T11:29:57.632641+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-13T11:29:56.100939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-13T11:29:56.100939+0000","last_clean_scrub_stamp":"2023-11-13T11:29:56.100939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-14T22:59:20.771927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-13T11:29:57.632441+0000","last_change":"2023-11-13T11:29:56.647775+0000","last_active":"2023-11-13T11:29:57.632441+0000","last_peered":"2023-11-13T11:29:57.632441+0000","last_clean":"2023-11-13T11:29:57.632441+0000","last_became_active":"2023-11-13T11:29:56.646835+0000","last_became_peered":"2023-11-13T11:29:56.646835+0000","last_unstale":"2023-11-13T11:29:57.632441+0000","last_undegraded":"2023-11-13T11:29:57.632441+0000","last_fullsized":"2023-11-13T11:29:57.632441+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-13T11:29:56.100939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-13T11:29:56.100939+0000","last_clean_scrub_stamp":"2023-11-13T11:29:56.100939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-14T19:17:15.234382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-13T11:29:57.983162+0000","last_change":"2023-11-13T11:29:56.637148+0000","last_active":"2023-11-13T11:29:57.983162+0000","last_peered":"2023-11-13T11:29:57.983162+0000","last_clean":"2023-11-13T11:29:57.983162+0000","last_became_active":"2023-11-13T11:29:56.633775+0000","last_became_peered":"2023-11-13T11:29:56.633775+0000","last_unstale":"2023-11-13T11:29:57.983162+0000","last_undegraded":"2023-11-13T11:29:57.983162+0000","last_fullsized":"2023-11-13T11:29:57.983162+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-13T11:29:56.100939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-13T11:29:56.100939+0000","last_clean_scrub_stamp":"2023-11-13T11:29:56.100939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-14T20:50:51.787224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-13T11:29:58.898800+0000","last_change":"2023-11-13T11:29:56.631437+0000","last_active":"2023-11-13T11:29:58.898800+0000","last_peered":"2023-11-13T11:29:58.898800+0000","last_clean":"2023-11-13T11:29:58.898800+0000","last_became_active":"2023-11-13T11:29:56.631127+0000","last_became_peered":"2023-11-13T11:29:56.631127+0000","last_unstale":"2023-11-13T11:29:58.898800+0000","last_undegraded":"2023-11-13T11:29:58.898800+0000","last_fullsized":"2023-11-13T11:29:58.898800+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-13T11:29:56.100939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-13T11:29:56.100939+0000","last_clean_scrub_stamp":"2023-11-13T11:29:56.100939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-14T18:15:57.792911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-13T11:29:58.007878+0000","last_change":"2023-11-13T11:29:56.650430+0000","last_active":"2023-11-13T11:29:58.007878+0000","last_peered":"2023-11-13T11:29:58.007878+0000","last_clean":"2023-11-13T11:29:58.007878+0000","last_became_active":"2023-11-13T11:29:56.650131+0000","last_became_peered":"2023-11-13T11:29:56.650131+0000","last_unstale":"2023-11-13T11:29:58.007878+0000","last_undegraded":"2023-11-13T11:29:58.007878+0000","last_fullsized":"2023-11-13T11:29:58.007878+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-13T11:29:56.100939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-13T11:29:56.100939+0000","last_clean_scrub_stamp":"2023-11-13T11:29:56.100939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-14T20:50:51.787224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-13T11:29:57.982712+0000","last_change":"2023-11-13T11:29:56.637510+0000","last_active":"2023-11-13T11:29:57.982712+0000","last_peered":"2023-11-13T11:29:57.982712+0000","last_clean":"2023-11-13T11:29:57.982712+0000","last_became_active":"2023-11-13T11:29:56.636616+0000","last_became_peered":"2023-11-13T11:29:56.636616+0000","last_unstale":"2023-11-13T11:29:57.982712+0000","last_undegraded":"2023-11-13T11:29:57.982712+0000","last_fullsized":"2023-11-13T11:29:57.982712+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-13T11:29:56.100939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-13T11:29:56.100939+0000","last_clean_scrub_stamp":"2023-11-13T11:29:56.100939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-14T15:04:46.347040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-13T11:29:58.007880+0000","last_change":"2023-11-13T11:29:56.655252+0000","last_active":"2023-11-13T11:29:58.007880+0000","last_peered":"2023-11-13T11:29:58.007880+0000","last_clean":"2023-11-13T11:29:58.007880+0000","last_became_active":"2023-11-13T11:29:56.654824+0000","last_became_peered":"2023-11-13T11:29:56.654824+0000","last_unstale":"2023-11-13T11:29:58.007880+0000","last_undegraded":"2023-11-13T11:29:58.007880+0000","last_fullsized":"2023-11-13T11:29:58.007880+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-13T11:29:56.100939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-13T11:29:56.100939+0000","last_clean_scrub_stamp":"2023-11-13T11:29:56.100939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-14T12:57:15.751399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-13T11:29:57.633347+0000","last_change":"2023-11-13T11:29:56.652650+0000","last_active":"2023-11-13T11:29:57.633347+0000","last_peered":"2023-11-13T11:29:57.633347+0000","last_clean":"2023-11-13T11:29:57.633347+0000","last_became_active":"2023-11-13T11:29:56.652341+0000","last_became_peered":"2023-11-13T11:29:56.652341+0000","last_unstale":"2023-11-13T11:29:57.633347+0000","last_undegraded":"2023-11-13T11:29:57.633347+0000","last_fullsized":"2023-11-13T11:29:57.633347+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-13T11:29:56.100939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-13T11:29:56.100939+0000","last_clean_scrub_stamp":"2023-11-13T11:29:56.100939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-14T13:42:48.610968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-13T11:29:57.633264+0000","last_change":"2023-11-13T11:29:56.650527+0000","last_active":"2023-11-13T11:29:57.633264+0000","last_peered":"2023-11-13T11:29:57.633264+0000","last_clean":"2023-11-13T11:29:57.633264+0000","last_became_active":"2023-11-13T11:29:56.650240+0000","last_became_peered":"2023-11-13T11:29:56.650240+0000","last_unstale":"2023-11-13T11:29:57.633264+0000","last_undegraded":"2023-11-13T11:29:57.633264+0000","last_fullsized":"2023-11-13T11:29:57.633264+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-13T11:29:56.100939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-13T11:29:56.100939+0000","last_clean_scrub_stamp":"2023-11-13T11:29:56.100939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-14T18:15:57.792911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-13T11:29:58.899071+0000","last_change":"2023-11-13T11:29:56.631774+0000","last_active":"2023-11-13T11:29:58.899071+0000","last_peered":"2023-11-13T11:29:58.899071+0000","last_clean":"2023-11-13T11:29:58.899071+0000","last_became_active":"2023-11-13T11:29:56.630884+0000","last_became_peered":"2023-11-13T11:29:56.630884+0000","last_unstale":"2023-11-13T11:29:58.899071+0000","last_undegraded":"2023-11-13T11:29:58.899071+0000","last_fullsized":"2023-11-13T11:29:58.899071+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-13T11:29:56.100939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-13T11:29:56.100939+0000","last_clean_scrub_stamp":"2023-11-13T11:29:56.100939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-14T19:14:32.577711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-13T11:29:58.008207+0000","last_change":"2023-11-13T11:29:56.646415+0000","last_active":"2023-11-13T11:29:58.008207+0000","last_peered":"2023-11-13T11:29:58.008207+0000","last_clean":"2023-11-13T11:29:58.008207+0000","last_became_active":"2023-11-13T11:29:56.645851+0000","last_became_peered":"2023-11-13T11:29:56.645851+0000","last_unstale":"2023-11-13T11:29:58.008207+0000","last_undegraded":"2023-11-13T11:29:58.008207+0000","last_fullsized":"2023-11-13T11:29:58.008207+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-13T11:29:56.100939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-13T11:29:56.100939+0000","last_clean_scrub_stamp":"2023-11-13T11:29:56.100939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-14T16:23:20.155271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-13T11:29:58.898593+0000","last_change":"2023-11-13T11:29:56.655431+0000","last_active":"2023-11-13T11:29:58.898593+0000","last_peered":"2023-11-13T11:29:58.898593+0000","last_clean":"2023-11-13T11:29:58.898593+0000","last_became_active":"2023-11-13T11:29:56.655111+0000","last_became_peered":"2023-11-13T11:29:56.655111+0000","last_unstale":"2023-11-13T11:29:58.898593+0000","last_undegraded":"2023-11-13T11:29:58.898593+0000","last_fullsized":"2023-11-13T11:29:58.898593+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-13T11:29:56.100939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-13T11:29:56.100939+0000","last_clean_scrub_stamp":"2023-11-13T11:29:56.100939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-14T17:12:32.904334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-13T11:29:58.898423+0000","last_change":"2023-11-13T11:29:56.632434+0000","last_active":"2023-11-13T11:29:58.898423+0000","last_peered":"2023-11-13T11:29:58.898423+0000","last_clean":"2023-11-13T11:29:58.898423+0000","last_became_active":"2023-11-13T11:29:56.632186+0000","last_became_peered":"2023-11-13T11:29:56.632186+0000","last_unstale":"2023-11-13T11:29:58.898423+0000","last_undegraded":"2023-11-13T11:29:58.898423+0000","last_fullsized":"2023-11-13T11:29:58.898423+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-13T11:29:56.100939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-13T11:29:56.100939+0000","last_clean_scrub_stamp":"2023-11-13T11:29:56.100939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-14T22:42:29.649952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-13T11:29:58.007929+0000","last_change":"2023-11-13T11:29:56.645411+0000","last_active":"2023-11-13T11:29:58.007929+0000","last_peered":"2023-11-13T11:29:58.007929+0000","last_clean":"2023-11-13T11:29:58.007929+0000","last_became_active":"2023-11-13T11:29:56.644539+0000","last_became_peered":"2023-11-13T11:29:56.644539+0000","last_unstale":"2023-11-13T11:29:58.007929+0000","last_undegraded":"2023-11-13T11:29:58.007929+0000","last_fullsized":"2023-11-13T11:29:58.007929+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-13T11:29:56.100939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-13T11:29:56.100939+0000","last_clean_scrub_stamp":"2023-11-13T11:29:56.100939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-14T14:17:53.387282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-13T11:29:57.797579+0000","last_change":"2023-11-13T11:29:56.641361+0000","last_active":"2023-11-13T11:29:57.797579+0000","last_peered":"2023-11-13T11:29:57.797579+0000","last_clean":"2023-11-13T11:29:57.797579+0000","last_became_active":"2023-11-13T11:29:56.641052+0000","last_became_peered":"2023-11-13T11:29:56.641052+0000","last_unstale":"2023-11-13T11:29:57.797579+0000","last_undegraded":"2023-11-13T11:29:57.797579+0000","last_fullsized":"2023-11-13T11:29:57.797579+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-13T11:29:56.100939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-13T11:29:56.100939+0000","last_clean_scrub_stamp":"2023-11-13T11:29:56.100939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-14T19:17:37.763288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-13T11:29:57.983246+0000","last_change":"2023-11-13T11:29:56.632618+0000","last_active":"2023-11-13T11:29:57.983246+0000","last_peered":"2023-11-13T11:29:57.983246+0000","last_clean":"2023-11-13T11:29:57.983246+0000","last_became_active":"2023-11-13T11:29:56.632221+0000","last_became_peered":"2023-11-13T11:29:56.632221+0000","last_unstale":"2023-11-13T11:29:57.983246+0000","last_undegraded":"2023-11-13T11:29:57.983246+0000","last_fullsized":"2023-11-13T11:29:57.983246+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-13T11:29:56.100939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-13T11:29:56.100939+0000","last_clean_scrub_stamp":"2023-11-13T11:29:56.100939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-14T15:51:57.260172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1f","version":"35'4","reported_seq":16,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-13T11:29:57.798252+0000","last_change":"2023-11-13T11:29:56.139915+0000","last_active":"2023-11-13T11:29:57.798252+0000","last_peered":"2023-11-13T11:29:57.798252+0000","last_clean":"2023-11-13T11:29:57.798252+0000","last_became_active":"2023-11-13T11:29:56.139383+0000","last_became_peered":"2023-11-13T11:29:56.139383+0000","last_unstale":"2023-11-13T11:29:57.798252+0000","last_undegraded":"2023-11-13T11:29:57.798252+0000","last_fullsized":"2023-11-13T11:29:57.798252+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-13T11:29:55.092850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-13T11:29:55.092850+0000","last_clean_scrub_stamp":"2023-11-13T11:29:55.092850+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-14T20:38:30.675223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-13T11:29:58.008335+0000","last_change":"2023-11-13T11:29:56.641371+0000","last_active":"2023-11-13T11:29:58.008335+0000","last_peered":"2023-11-13T11:29:58.008335+0000","last_clean":"2023-11-13T11:29:58.008335+0000","last_became_active":"2023-11-13T11:29:56.641060+0000","last_became_peered":"2023-11-13T11:29:56.641060+0000","last_unstale":"2023-11-13T11:29:58.008335+0000","last_undegraded":"2023-11-13T11:29:58.008335+0000","last_fullsized":"2023-11-13T11:29:58.008335+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-13T11:29:56.100939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-13T11:29:56.100939+0000","last_clean_scrub_stamp":"2023-11-13T11:29:56.100939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-14T17:12:32.904334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1e","version":"35'1","reported_seq":13,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-13T11:29:57.633351+0000","last_change":"2023-11-13T11:29:56.143114+0000","last_active":"2023-11-13T11:29:57.633351+0000","last_peered":"2023-11-13T11:29:57.633351+0000","last_clean":"2023-11-13T11:29:57.633351+0000","last_became_active":"2023-11-13T11:29:56.142821+0000","last_became_peered":"2023-11-13T11:29:56.142821+0000","last_unstale":"2023-11-13T11:29:57.633351+0000","last_undegraded":"2023-11-13T11:29:57.633351+0000","last_fullsized":"2023-11-13T11:29:57.633351+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-13T11:29:55.092850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-13T11:29:55.092850+0000","last_clean_scrub_stamp":"2023-11-13T11:29:55.092850+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-14T15:19:53.291923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-13T11:29:58.008317+0000","last_change":"2023-11-13T11:29:56.651750+0000","last_active":"2023-11-13T11:29:58.008317+0000","last_peered":"2023-11-13T11:29:58.008317+0000","last_clean":"2023-11-13T11:29:58.008317+0000","last_became_active":"2023-11-13T11:29:56.651520+0000","last_became_peered":"2023-11-13T11:29:56.651520+0000","last_unstale":"2023-11-13T11:29:58.008317+0000","last_undegraded":"2023-11-13T11:29:58.008317+0000","last_fullsized":"2023-11-13T11:29:58.008317+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-13T11:29:56.100939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-13T11:29:56.100939+0000","last_clean_scrub_stamp":"2023-11-13T11:29:56.100939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-14T14:07:14.129755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1d","version":"35'2","reported_seq":14,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-13T11:29:57.632676+0000","last_change":"2023-11-13T11:29:56.135619+0000","last_active":"2023-11-13T11:29:57.632676+0000","last_peered":"2023-11-13T11:29:57.632676+0000","last_clean":"2023-11-13T11:29:57.632676+0000","last_became_active":"2023-11-13T11:29:56.134105+0000","last_became_peered":"2023-11-13T11:29:56.134105+0000","last_unstale":"2023-11-13T11:29:57.632676+0000","last_undegraded":"2023-11-13T11:29:57.632676+0000","last_fullsized":"2023-11-13T11:29:57.632676+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-13T11:29:55.092850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-13T11:29:55.092850+0000","last_clean_scrub_stamp":"2023-11-13T11:29:55.092850+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-14T21:01:05.249630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-13T11:29:57.633294+0000","last_change":"2023-11-13T11:29:56.652089+0000","last_active":"2023-11-13T11:29:57.633294+0000","last_peered":"2023-11-13T11:29:57.633294+0000","last_clean":"2023-11-13T11:29:57.633294+0000","last_became_active":"2023-11-13T11:29:56.651787+0000","last_became_peered":"2023-11-13T11:29:56.651787+0000","last_unstale":"2023-11-13T11:29:57.633294+0000","last_undegraded":"2023-11-13T11:29:57.633294+0000","last_fullsized":"2023-11-13T11:29:57.633294+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-13T11:29:56.100939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-13T11:29:56.100939+0000","last_clean_scrub_stamp":"2023-11-13T11:29:56.100939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-14T19:14:32.577711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"35'2","reported_seq":14,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-13T11:29:57.633131+0000","last_change":"2023-11-13T11:29:56.140158+0000","last_active":"2023-11-13T11:29:57.633131+0000","last_peered":"2023-11-13T11:29:57.633131+0000","last_clean":"2023-11-13T11:29:57.633131+0000","last_became_active":"2023-11-13T11:29:56.139725+0000","last_became_peered":"2023-11-13T11:29:56.139725+0000","last_unstale":"2023-11-13T11:29:57.633131+0000","last_undegraded":"2023-11-13T11:29:57.633131+0000","last_fullsized":"2023-11-13T11:29:57.633131+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-13T11:29:55.092850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-13T11:29:55.092850+0000","last_clean_scrub_stamp":"2023-11-13T11:29:55.092850+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-14T15:51:56.252083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-13T11:29:57.628161+0000","last_change":"2023-11-13T11:29:56.650525+0000","last_active":"2023-11-13T11:29:57.628161+0000","last_peered":"2023-11-13T11:29:57.628161+0000","last_clean":"2023-11-13T11:29:57.628161+0000","last_became_active":"2023-11-13T11:29:56.650212+0000","last_became_peered":"2023-11-13T11:29:56.650212+0000","last_unstale":"2023-11-13T11:29:57.628161+0000","last_undegraded":"2023-11-13T11:29:57.628161+0000","last_fullsized":"2023-11-13T11:29:57.628161+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-13T11:29:56.100939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-13T11:29:56.100939+0000","last_clean_scrub_stamp":"2023-11-13T11:29:56.100939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-14T22:53:53.304240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"35'1","reported_seq":13,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-13T11:29:58.008105+0000","last_change":"2023-11-13T11:29:56.137809+0000","last_active":"2023-11-13T11:29:58.008105+0000","last_peered":"2023-11-13T11:29:58.008105+0000","last_clean":"2023-11-13T11:29:58.008105+0000","last_became_active":"2023-11-13T11:29:56.137499+0000","last_became_peered":"2023-11-13T11:29:56.137499+0000","last_unstale":"2023-11-13T11:29:58.008105+0000","last_undegraded":"2023-11-13T11:29:58.008105+0000","last_fullsized":"2023-11-13T11:29:58.008105+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-13T11:29:55.092850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-13T11:29:55.092850+0000","last_clean_scrub_stamp":"2023-11-13T11:29:55.092850+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-14T22:15:05.936409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-13T11:29:58.008086+0000","last_change":"2023-11-13T11:29:56.646426+0000","last_active":"2023-11-13T11:29:58.008086+0000","last_peered":"2023-11-13T11:29:58.008086+0000","last_clean":"2023-11-13T11:29:58.008086+0000","last_became_active":"2023-11-13T11:29:56.646182+0000","last_became_peered":"2023-11-13T11:29:56.646182+0000","last_unstale":"2023-11-13T11:29:58.008086+0000","last_undegraded":"2023-11-13T11:29:58.008086+0000","last_fullsized":"2023-11-13T11:29:58.008086+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-13T11:29:56.100939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-13T11:29:56.100939+0000","last_clean_scrub_stamp":"2023-11-13T11:29:56.100939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-14T14:40:28.997511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1a","version":"35'1","reported_seq":13,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-13T11:29:58.008011+0000","last_change":"2023-11-13T11:29:56.129939+0000","last_active":"2023-11-13T11:29:58.008011+0000","last_peered":"2023-11-13T11:29:58.008011+0000","last_clean":"2023-11-13T11:29:58.008011+0000","last_became_active":"2023-11-13T11:29:56.129589+0000","last_became_peered":"2023-11-13T11:29:56.129589+0000","last_unstale":"2023-11-13T11:29:58.008011+0000","last_undegraded":"2023-11-13T11:29:58.008011+0000","last_fullsized":"2023-11-13T11:29:58.008011+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-13T11:29:55.092850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-13T11:29:55.092850+0000","last_clean_scrub_stamp":"2023-11-13T11:29:55.092850+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-14T21:56:12.389066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-13T11:29:57.628084+0000","last_change":"2023-11-13T11:29:56.629954+0000","last_active":"2023-11-13T11:29:57.628084+0000","last_peered":"2023-11-13T11:29:57.628084+0000","last_clean":"2023-11-13T11:29:57.628084+0000","last_became_active":"2023-11-13T11:29:56.629690+0000","last_became_peered":"2023-11-13T11:29:56.629690+0000","last_unstale":"2023-11-13T11:29:57.628084+0000","last_undegraded":"2023-11-13T11:29:57.628084+0000","last_fullsized":"2023-11-13T11:29:57.628084+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-13T11:29:56.100939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-13T11:29:56.100939+0000","last_clean_scrub_stamp":"2023-11-13T11:29:56.100939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-14T13:31:55.774316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-13T11:29:57.632065+0000","last_change":"2023-11-13T11:29:56.137023+0000","last_active":"2023-11-13T11:29:57.632065+0000","last_peered":"2023-11-13T11:29:57.632065+0000","last_clean":"2023-11-13T11:29:57.632065+0000","last_became_active":"2023-11-13T11:29:56.134237+0000","last_became_peered":"2023-11-13T11:29:56.134237+0000","last_unstale":"2023-11-13T11:29:57.632065+0000","last_undegraded":"2023-11-13T11:29:57.632065+0000","last_fullsized":"2023-11-13T11:29:57.632065+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-13T11:29:55.092850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-13T11:29:55.092850+0000","last_clean_scrub_stamp":"2023-11-13T11:29:55.092850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-14T12:30:21.023677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-13T11:29:57.632389+0000","last_change":"2023-11-13T11:29:56.653360+0000","last_active":"2023-11-13T11:29:57.632389+0000","last_peered":"2023-11-13T11:29:57.632389+0000","last_clean":"2023-11-13T11:29:57.632389+0000","last_became_active":"2023-11-13T11:29:56.653019+0000","last_became_peered":"2023-11-13T11:29:56.653019+0000","last_unstale":"2023-11-13T11:29:57.632389+0000","last_undegraded":"2023-11-13T11:29:57.632389+0000","last_fullsized":"2023-11-13T11:29:57.632389+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-13T11:29:56.100939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-13T11:29:56.100939+0000","last_clean_scrub_stamp":"2023-11-13T11:29:56.100939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-14T20:58:00.300912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-13T11:29:58.007978+0000","last_change":"2023-11-13T11:29:56.131213+0000","last_active":"2023-11-13T11:29:58.007978+0000","last_peered":"2023-11-13T11:29:58.007978+0000","last_clean":"2023-11-13T11:29:58.007978+0000","last_became_active":"2023-11-13T11:29:56.129270+0000","last_became_peered":"2023-11-13T11:29:56.129270+0000","last_unstale":"2023-11-13T11:29:58.007978+0000","last_undegraded":"2023-11-13T11:29:58.007978+0000","last_fullsized":"2023-11-13T11:29:58.007978+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-13T11:29:55.092850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-13T11:29:55.092850+0000","last_clean_scrub_stamp":"2023-11-13T11:29:55.092850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-14T23:27:05.058467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-13T11:29:57.798087+0000","last_change":"2023-11-13T11:29:56.631250+0000","last_active":"2023-11-13T11:29:57.798087+0000","last_peered":"2023-11-13T11:29:57.798087+0000","last_clean":"2023-11-13T11:29:57.798087+0000","last_became_active":"2023-11-13T11:29:56.630965+0000","last_became_peered":"2023-11-13T11:29:56.630965+0000","last_unstale":"2023-11-13T11:29:57.798087+0000","last_undegraded":"2023-11-13T11:29:57.798087+0000","last_fullsized":"2023-11-13T11:29:57.798087+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-13T11:29:56.100939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-13T11:29:56.100939+0000","last_clean_scrub_stamp":"2023-11-13T11:29:56.100939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-14T19:41:10.789843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-13T11:29:58.899235+0000","last_change":"2023-11-13T11:29:56.142096+0000","last_active":"2023-11-13T11:29:58.899235+0000","last_peered":"2023-11-13T11:29:58.899235+0000","last_clean":"2023-11-13T11:29:58.899235+0000","last_became_active":"2023-11-13T11:29:56.141723+0000","last_became_peered":"2023-11-13T11:29:56.141723+0000","last_unstale":"2023-11-13T11:29:58.899235+0000","last_undegraded":"2023-11-13T11:29:58.899235+0000","last_fullsized":"2023-11-13T11:29:58.899235+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-13T11:29:55.092850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-13T11:29:55.092850+0000","last_clean_scrub_stamp":"2023-11-13T11:29:55.092850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-14T14:07:13.121666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-13T11:29:57.633388+0000","last_change":"2023-11-13T11:29:56.652726+0000","last_active":"2023-11-13T11:29:57.633388+0000","last_peered":"2023-11-13T11:29:57.633388+0000","last_clean":"2023-11-13T11:29:57.633388+0000","last_became_active":"2023-11-13T11:29:56.652062+0000","last_became_peered":"2023-11-13T11:29:56.652062+0000","last_unstale":"2023-11-13T11:29:57.633388+0000","last_undegraded":"2023-11-13T11:29:57.633388+0000","last_fullsized":"2023-11-13T11:29:57.633388+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-13T11:29:56.100939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-13T11:29:56.100939+0000","last_clean_scrub_stamp":"2023-11-13T11:29:56.100939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-14T17:39:54.996192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-13T11:29:58.899215+0000","last_change":"2023-11-13T11:29:56.138917+0000","last_active":"2023-11-13T11:29:58.899215+0000","last_peered":"2023-11-13T11:29:58.899215+0000","last_clean":"2023-11-13T11:29:58.899215+0000","last_became_active":"2023-11-13T11:29:56.138391+0000","last_became_peered":"2023-11-13T11:29:56.138391+0000","last_unstale":"2023-11-13T11:29:58.899215+0000","last_undegraded":"2023-11-13T11:29:58.899215+0000","last_fullsized":"2023-11-13T11:29:58.899215+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-13T11:29:55.092850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-13T11:29:55.092850+0000","last_clean_scrub_stamp":"2023-11-13T11:29:55.092850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-14T16:23:19.147182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-13T11:29:57.633062+0000","last_change":"2023-11-13T11:29:56.651230+0000","last_active":"2023-11-13T11:29:57.633062+0000","last_peered":"2023-11-13T11:29:57.633062+0000","last_clean":"2023-11-13T11:29:57.633062+0000","last_became_active":"2023-11-13T11:29:56.650853+0000","last_became_peered":"2023-11-13T11:29:56.650853+0000","last_unstale":"2023-11-13T11:29:57.633062+0000","last_undegraded":"2023-11-13T11:29:57.633062+0000","last_fullsized":"2023-11-13T11:29:57.633062+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-13T11:29:56.100939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-13T11:29:56.100939+0000","last_clean_scrub_stamp":"2023-11-13T11:29:56.100939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-14T17:12:32.904334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.15","version":"35'3","reported_seq":15,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-13T11:29:57.797852+0000","last_change":"2023-11-13T11:29:56.143808+0000","last_active":"2023-11-13T11:29:57.797852+0000","last_peered":"2023-11-13T11:29:57.797852+0000","last_clean":"2023-11-13T11:29:57.797852+0000","last_became_active":"2023-11-13T11:29:56.143467+0000","last_became_peered":"2023-11-13T11:29:56.143467+0000","last_unstale":"2023-11-13T11:29:57.797852+0000","last_undegraded":"2023-11-13T11:29:57.797852+0000","last_fullsized":"2023-11-13T11:29:57.797852+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-13T11:29:55.092850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-13T11:29:55.092850+0000","last_clean_scrub_stamp":"2023-11-13T11:29:55.092850+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-14T13:42:47.602879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-13T11:29:57.797773+0000","last_change":"2023-11-13T11:29:56.652383+0000","last_active":"2023-11-13T11:29:57.797773+0000","last_peered":"2023-11-13T11:29:57.797773+0000","last_clean":"2023-11-13T11:29:57.797773+0000","last_became_active":"2023-11-13T11:29:56.652056+0000","last_became_peered":"2023-11-13T11:29:56.652056+0000","last_unstale":"2023-11-13T11:29:57.797773+0000","last_undegraded":"2023-11-13T11:29:57.797773+0000","last_fullsized":"2023-11-13T11:29:57.797773+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-13T11:29:56.100939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-13T11:29:56.100939+0000","last_clean_scrub_stamp":"2023-11-13T11:29:56.100939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-14T16:10:06.244630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"35'6","reported_seq":18,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-13T11:29:57.983187+0000","last_change":"2023-11-13T11:29:56.142186+0000","last_active":"2023-11-13T11:29:57.983187+0000","last_peered":"2023-11-13T11:29:57.983187+0000","last_clean":"2023-11-13T11:29:57.983187+0000","last_became_active":"2023-11-13T11:29:56.137746+0000","last_became_peered":"2023-11-13T11:29:56.137746+0000","last_unstale":"2023-11-13T11:29:57.983187+0000","last_undegraded":"2023-11-13T11:29:57.983187+0000","last_fullsized":"2023-11-13T11:29:57.983187+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-13T11:29:55.092850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-13T11:29:55.092850+0000","last_clean_scrub_stamp":"2023-11-13T11:29:55.092850+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-14T22:09:01.172827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-13T11:29:57.982752+0000","last_change":"2023-11-13T11:29:56.637229+0000","last_active":"2023-11-13T11:29:57.982752+0000","last_peered":"2023-11-13T11:29:57.982752+0000","last_clean":"2023-11-13T11:29:57.982752+0000","last_became_active":"2023-11-13T11:29:56.636678+0000","last_became_peered":"2023-11-13T11:29:56.636678+0000","last_unstale":"2023-11-13T11:29:57.982752+0000","last_undegraded":"2023-11-13T11:29:57.982752+0000","last_fullsized":"2023-11-13T11:29:57.982752+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-13T11:29:56.100939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-13T11:29:56.100939+0000","last_clean_scrub_stamp":"2023-11-13T11:29:56.100939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-14T13:40:39.253955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.13","version":"35'2","reported_seq":14,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-13T11:29:58.008173+0000","last_change":"2023-11-13T11:29:56.141412+0000","last_active":"2023-11-13T11:29:58.008173+0000","last_peered":"2023-11-13T11:29:58.008173+0000","last_clean":"2023-11-13T11:29:58.008173+0000","last_became_active":"2023-11-13T11:29:56.140090+0000","last_became_peered":"2023-11-13T11:29:56.140090+0000","last_unstale":"2023-11-13T11:29:58.008173+0000","last_undegraded":"2023-11-13T11:29:58.008173+0000","last_fullsized":"2023-11-13T11:29:58.008173+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-13T11:29:55.092850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-13T11:29:55.092850+0000","last_clean_scrub_stamp":"2023-11-13T11:29:55.092850+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-14T20:22:23.574212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-13T11:29:57.632913+0000","last_change":"2023-11-13T11:29:56.654745+0000","last_active":"2023-11-13T11:29:57.632913+0000","last_peered":"2023-11-13T11:29:57.632913+0000","last_clean":"2023-11-13T11:29:57.632913+0000","last_became_active":"2023-11-13T11:29:56.654336+0000","last_became_peered":"2023-11-13T11:29:56.654336+0000","last_unstale":"2023-11-13T11:29:57.632913+0000","last_undegraded":"2023-11-13T11:29:57.632913+0000","last_fullsized":"2023-11-13T11:29:57.632913+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-13T11:29:56.100939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-13T11:29:56.100939+0000","last_clean_scrub_stamp":"2023-11-13T11:29:56.100939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-14T16:23:20.155271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-13T11:29:57.632635+0000","last_change":"2023-11-13T11:29:56.146156+0000","last_active":"2023-11-13T11:29:57.632635+0000","last_peered":"2023-11-13T11:29:57.632635+0000","last_clean":"2023-11-13T11:29:57.632635+0000","last_became_active":"2023-11-13T11:29:56.145868+0000","last_became_peered":"2023-11-13T11:29:56.145868+0000","last_unstale":"2023-11-13T11:29:57.632635+0000","last_undegraded":"2023-11-13T11:29:57.632635+0000","last_fullsized":"2023-11-13T11:29:57.632635+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-13T11:29:55.092850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-13T11:29:55.092850+0000","last_clean_scrub_stamp":"2023-11-13T11:29:55.092850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-14T20:50:50.779135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-13T11:29:58.008032+0000","last_change":"2023-11-13T11:29:56.639688+0000","last_active":"2023-11-13T11:29:58.008032+0000","last_peered":"2023-11-13T11:29:58.008032+0000","last_clean":"2023-11-13T11:29:58.008032+0000","last_became_active":"2023-11-13T11:29:56.639439+0000","last_became_peered":"2023-11-13T11:29:56.639439+0000","last_unstale":"2023-11-13T11:29:58.008032+0000","last_undegraded":"2023-11-13T11:29:58.008032+0000","last_fullsized":"2023-11-13T11:29:58.008032+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-13T11:29:56.100939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-13T11:29:56.100939+0000","last_clean_scrub_stamp":"2023-11-13T11:29:56.100939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-14T20:58:00.300912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-13T11:29:57.632437+0000","last_change":"2023-11-13T11:29:56.132494+0000","last_active":"2023-11-13T11:29:57.632437+0000","last_peered":"2023-11-13T11:29:57.632437+0000","last_clean":"2023-11-13T11:29:57.632437+0000","last_became_active":"2023-11-13T11:29:56.132181+0000","last_became_peered":"2023-11-13T11:29:56.132181+0000","last_unstale":"2023-11-13T11:29:57.632437+0000","last_undegraded":"2023-11-13T11:29:57.632437+0000","last_fullsized":"2023-11-13T11:29:57.632437+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-13T11:29:55.092850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-13T11:29:55.092850+0000","last_clean_scrub_stamp":"2023-11-13T11:29:55.092850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-14T12:57:14.743310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-13T11:29:57.797598+0000","last_change":"2023-11-13T11:29:56.641918+0000","last_active":"2023-11-13T11:29:57.797598+0000","last_peered":"2023-11-13T11:29:57.797598+0000","last_clean":"2023-11-13T11:29:57.797598+0000","last_became_active":"2023-11-13T11:29:56.641664+0000","last_became_peered":"2023-11-13T11:29:56.641664+0000","last_unstale":"2023-11-13T11:29:57.797598+0000","last_undegraded":"2023-11-13T11:29:57.797598+0000","last_fullsized":"2023-11-13T11:29:57.797598+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-13T11:29:56.100939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-13T11:29:56.100939+0000","last_clean_scrub_stamp":"2023-11-13T11:29:56.100939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-14T18:11:23.250505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"35'8","reported_seq":20,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-13T11:29:57.631835+0000","last_change":"2023-11-13T11:29:56.141314+0000","last_active":"2023-11-13T11:29:57.631835+0000","last_peered":"2023-11-13T11:29:57.631835+0000","last_clean":"2023-11-13T11:29:57.631835+0000","last_became_active":"2023-11-13T11:29:56.141017+0000","last_became_peered":"2023-11-13T11:29:56.141017+0000","last_unstale":"2023-11-13T11:29:57.631835+0000","last_undegraded":"2023-11-13T11:29:57.631835+0000","last_fullsized":"2023-11-13T11:29:57.631835+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-13T11:29:55.092850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-13T11:29:55.092850+0000","last_clean_scrub_stamp":"2023-11-13T11:29:55.092850+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-14T11:34:16.583204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-13T11:29:57.798098+0000","last_change":"2023-11-13T11:29:56.657267+0000","last_active":"2023-11-13T11:29:57.798098+0000","last_peered":"2023-11-13T11:29:57.798098+0000","last_clean":"2023-11-13T11:29:57.798098+0000","last_became_active":"2023-11-13T11:29:56.657010+0000","last_became_peered":"2023-11-13T11:29:56.657010+0000","last_unstale":"2023-11-13T11:29:57.798098+0000","last_undegraded":"2023-11-13T11:29:57.798098+0000","last_fullsized":"2023-11-13T11:29:57.798098+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-13T11:29:56.100939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-13T11:29:56.100939+0000","last_clean_scrub_stamp":"2023-11-13T11:29:56.100939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-14T18:20:49.397646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"35'1","reported_seq":13,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-13T11:29:57.632764+0000","last_change":"2023-11-13T11:29:56.139559+0000","last_active":"2023-11-13T11:29:57.632764+0000","last_peered":"2023-11-13T11:29:57.632764+0000","last_clean":"2023-11-13T11:29:57.632764+0000","last_became_active":"2023-11-13T11:29:56.139195+0000","last_became_peered":"2023-11-13T11:29:56.139195+0000","last_unstale":"2023-11-13T11:29:57.632764+0000","last_undegraded":"2023-11-13T11:29:57.632764+0000","last_fullsized":"2023-11-13T11:29:57.632764+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-13T11:29:55.092850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-13T11:29:55.092850+0000","last_clean_scrub_stamp":"2023-11-13T11:29:55.092850+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-14T18:49:15.716769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-13T11:29:57.628561+0000","last_change":"2023-11-13T11:29:56.635180+0000","last_active":"2023-11-13T11:29:57.628561+0000","last_peered":"2023-11-13T11:29:57.628561+0000","last_clean":"2023-11-13T11:29:57.628561+0000","last_became_active":"2023-11-13T11:29:56.634926+0000","last_became_peered":"2023-11-13T11:29:56.634926+0000","last_unstale":"2023-11-13T11:29:57.628561+0000","last_undegraded":"2023-11-13T11:29:57.628561+0000","last_fullsized":"2023-11-13T11:29:57.628561+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-13T11:29:56.100939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-13T11:29:56.100939+0000","last_clean_scrub_stamp":"2023-11-13T11:29:56.100939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-14T16:23:48.084208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"35'2","reported_seq":14,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-13T11:29:58.008200+0000","last_change":"2023-11-13T11:29:56.146612+0000","last_active":"2023-11-13T11:29:58.008200+0000","last_peered":"2023-11-13T11:29:58.008200+0000","last_clean":"2023-11-13T11:29:58.008200+0000","last_became_active":"2023-11-13T11:29:56.146306+0000","last_became_peered":"2023-11-13T11:29:56.146306+0000","last_unstale":"2023-11-13T11:29:58.008200+0000","last_undegraded":"2023-11-13T11:29:58.008200+0000","last_fullsized":"2023-11-13T11:29:58.008200+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-13T11:29:55.092850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-13T11:29:55.092850+0000","last_clean_scrub_stamp":"2023-11-13T11:29:55.092850+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-14T18:02:37.298150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-13T11:29:58.898955+0000","last_change":"2023-11-13T11:29:56.634621+0000","last_active":"2023-11-13T11:29:58.898955+0000","last_peered":"2023-11-13T11:29:58.898955+0000","last_clean":"2023-11-13T11:29:58.898955+0000","last_became_active":"2023-11-13T11:29:56.634315+0000","last_became_peered":"2023-11-13T11:29:56.634315+0000","last_unstale":"2023-11-13T11:29:58.898955+0000","last_undegraded":"2023-11-13T11:29:58.898955+0000","last_fullsized":"2023-11-13T11:29:58.898955+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-13T11:29:56.100939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-13T11:29:56.100939+0000","last_clean_scrub_stamp":"2023-11-13T11:29:56.100939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-14T18:15:57.792911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.d","version":"35'1","reported_seq":13,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-13T11:29:57.797934+0000","last_change":"2023-11-13T11:29:56.146417+0000","last_active":"2023-11-13T11:29:57.797934+0000","last_peered":"2023-11-13T11:29:57.797934+0000","last_clean":"2023-11-13T11:29:57.797934+0000","last_became_active":"2023-11-13T11:29:56.143698+0000","last_became_peered":"2023-11-13T11:29:56.143698+0000","last_unstale":"2023-11-13T11:29:57.797934+0000","last_undegraded":"2023-11-13T11:29:57.797934+0000","last_fullsized":"2023-11-13T11:29:57.797934+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-13T11:29:55.092850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-13T11:29:55.092850+0000","last_clean_scrub_stamp":"2023-11-13T11:29:55.092850+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-14T17:38:39.693133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-13T11:29:57.632600+0000","last_change":"2023-11-13T11:29:56.646510+0000","last_active":"2023-11-13T11:29:57.632600+0000","last_peered":"2023-11-13T11:29:57.632600+0000","last_clean":"2023-11-13T11:29:57.632600+0000","last_became_active":"2023-11-13T11:29:56.646182+0000","last_became_peered":"2023-11-13T11:29:56.646182+0000","last_unstale":"2023-11-13T11:29:57.632600+0000","last_undegraded":"2023-11-13T11:29:57.632600+0000","last_fullsized":"2023-11-13T11:29:57.632600+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-13T11:29:56.100939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-13T11:29:56.100939+0000","last_clean_scrub_stamp":"2023-11-13T11:29:56.100939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-14T20:38:15.395510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-13T11:29:58.898682+0000","last_change":"2023-11-13T11:29:56.130105+0000","last_active":"2023-11-13T11:29:58.898682+0000","last_peered":"2023-11-13T11:29:58.898682+0000","last_clean":"2023-11-13T11:29:58.898682+0000","last_became_active":"2023-11-13T11:29:56.129821+0000","last_became_peered":"2023-11-13T11:29:56.129821+0000","last_unstale":"2023-11-13T11:29:58.898682+0000","last_undegraded":"2023-11-13T11:29:58.898682+0000","last_fullsized":"2023-11-13T11:29:58.898682+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-13T11:29:55.092850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-13T11:29:55.092850+0000","last_clean_scrub_stamp":"2023-11-13T11:29:55.092850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-14T20:57:59.292823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-13T11:29:57.982813+0000","last_change":"2023-11-13T11:29:56.637028+0000","last_active":"2023-11-13T11:29:57.982813+0000","last_peered":"2023-11-13T11:29:57.982813+0000","last_clean":"2023-11-13T11:29:57.982813+0000","last_became_active":"2023-11-13T11:29:56.636305+0000","last_became_peered":"2023-11-13T11:29:56.636305+0000","last_unstale":"2023-11-13T11:29:57.982813+0000","last_undegraded":"2023-11-13T11:29:57.982813+0000","last_fullsized":"2023-11-13T11:29:57.982813+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-13T11:29:56.100939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-13T11:29:56.100939+0000","last_clean_scrub_stamp":"2023-11-13T11:29:56.100939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-14T13:56:03.506335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.b","version":"35'2","reported_seq":14,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-13T11:29:58.899032+0000","last_change":"2023-11-13T11:29:56.135045+0000","last_active":"2023-11-13T11:29:58.899032+0000","last_peered":"2023-11-13T11:29:58.899032+0000","last_clean":"2023-11-13T11:29:58.899032+0000","last_became_active":"2023-11-13T11:29:56.134764+0000","last_became_peered":"2023-11-13T11:29:56.134764+0000","last_unstale":"2023-11-13T11:29:58.899032+0000","last_undegraded":"2023-11-13T11:29:58.899032+0000","last_fullsized":"2023-11-13T11:29:58.899032+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-13T11:29:55.092850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-13T11:29:55.092850+0000","last_clean_scrub_stamp":"2023-11-13T11:29:55.092850+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-14T20:57:59.292823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-13T11:29:58.898929+0000","last_change":"2023-11-13T11:29:56.642114+0000","last_active":"2023-11-13T11:29:58.898929+0000","last_peered":"2023-11-13T11:29:58.898929+0000","last_clean":"2023-11-13T11:29:58.898929+0000","last_became_active":"2023-11-13T11:29:56.641796+0000","last_became_peered":"2023-11-13T11:29:56.641796+0000","last_unstale":"2023-11-13T11:29:58.898929+0000","last_undegraded":"2023-11-13T11:29:58.898929+0000","last_fullsized":"2023-11-13T11:29:58.898929+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-13T11:29:56.100939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-13T11:29:56.100939+0000","last_clean_scrub_stamp":"2023-11-13T11:29:56.100939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-14T15:12:20.880081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-13T11:29:58.008106+0000","last_change":"2023-11-13T11:29:56.140511+0000","last_active":"2023-11-13T11:29:58.008106+0000","last_peered":"2023-11-13T11:29:58.008106+0000","last_clean":"2023-11-13T11:29:58.008106+0000","last_became_active":"2023-11-13T11:29:56.139904+0000","last_became_peered":"2023-11-13T11:29:56.139904+0000","last_unstale":"2023-11-13T11:29:58.008106+0000","last_undegraded":"2023-11-13T11:29:58.008106+0000","last_fullsized":"2023-11-13T11:29:58.008106+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-13T11:29:55.092850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-13T11:29:55.092850+0000","last_clean_scrub_stamp":"2023-11-13T11:29:55.092850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-14T15:04:45.338951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-13T11:29:57.982718+0000","last_change":"2023-11-13T11:29:56.643334+0000","last_active":"2023-11-13T11:29:57.982718+0000","last_peered":"2023-11-13T11:29:57.982718+0000","last_clean":"2023-11-13T11:29:57.982718+0000","last_became_active":"2023-11-13T11:29:56.642513+0000","last_became_peered":"2023-11-13T11:29:56.642513+0000","last_unstale":"2023-11-13T11:29:57.982718+0000","last_undegraded":"2023-11-13T11:29:57.982718+0000","last_fullsized":"2023-11-13T11:29:57.982718+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-13T11:29:56.100939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-13T11:29:56.100939+0000","last_clean_scrub_stamp":"2023-11-13T11:29:56.100939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-14T21:56:13.397155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-13T11:29:57.628164+0000","last_change":"2023-11-13T11:29:56.134866+0000","last_active":"2023-11-13T11:29:57.628164+0000","last_peered":"2023-11-13T11:29:57.628164+0000","last_clean":"2023-11-13T11:29:57.628164+0000","last_became_active":"2023-11-13T11:29:56.134603+0000","last_became_peered":"2023-11-13T11:29:56.134603+0000","last_unstale":"2023-11-13T11:29:57.628164+0000","last_undegraded":"2023-11-13T11:29:57.628164+0000","last_fullsized":"2023-11-13T11:29:57.628164+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-13T11:29:55.092850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-13T11:29:55.092850+0000","last_clean_scrub_stamp":"2023-11-13T11:29:55.092850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-14T15:38:38.756006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-13T11:29:57.628151+0000","last_change":"2023-11-13T11:29:56.635132+0000","last_active":"2023-11-13T11:29:57.628151+0000","last_peered":"2023-11-13T11:29:57.628151+0000","last_clean":"2023-11-13T11:29:57.628151+0000","last_became_active":"2023-11-13T11:29:56.634818+0000","last_became_peered":"2023-11-13T11:29:56.634818+0000","last_unstale":"2023-11-13T11:29:57.628151+0000","last_undegraded":"2023-11-13T11:29:57.628151+0000","last_fullsized":"2023-11-13T11:29:57.628151+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-13T11:29:56.100939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-13T11:29:56.100939+0000","last_clean_scrub_stamp":"2023-11-13T11:29:56.100939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-14T22:00:23.831826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-13T11:29:57.797600+0000","last_change":"2023-11-13T11:29:56.144301+0000","last_active":"2023-11-13T11:29:57.797600+0000","last_peered":"2023-11-13T11:29:57.797600+0000","last_clean":"2023-11-13T11:29:57.797600+0000","last_became_active":"2023-11-13T11:29:56.143893+0000","last_became_peered":"2023-11-13T11:29:56.143893+0000","last_unstale":"2023-11-13T11:29:57.797600+0000","last_undegraded":"2023-11-13T11:29:57.797600+0000","last_fullsized":"2023-11-13T11:29:57.797600+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-13T11:29:55.092850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-13T11:29:55.092850+0000","last_clean_scrub_stamp":"2023-11-13T11:29:55.092850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-14T16:23:19.147182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-13T11:29:57.632675+0000","last_change":"2023-11-13T11:29:56.649179+0000","last_active":"2023-11-13T11:29:57.632675+0000","last_peered":"2023-11-13T11:29:57.632675+0000","last_clean":"2023-11-13T11:29:57.632675+0000","last_became_active":"2023-11-13T11:29:56.648886+0000","last_became_peered":"2023-11-13T11:29:56.648886+0000","last_unstale":"2023-11-13T11:29:57.632675+0000","last_undegraded":"2023-11-13T11:29:57.632675+0000","last_fullsized":"2023-11-13T11:29:57.632675+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-13T11:29:56.100939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-13T11:29:56.100939+0000","last_clean_scrub_stamp":"2023-11-13T11:29:56.100939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-14T13:09:18.720541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.7","version":"35'2","reported_seq":14,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-13T11:29:57.983139+0000","last_change":"2023-11-13T11:29:56.145644+0000","last_active":"2023-11-13T11:29:57.983139+0000","last_peered":"2023-11-13T11:29:57.983139+0000","last_clean":"2023-11-13T11:29:57.983139+0000","last_became_active":"2023-11-13T11:29:56.145378+0000","last_became_peered":"2023-11-13T11:29:56.145378+0000","last_unstale":"2023-11-13T11:29:57.983139+0000","last_undegraded":"2023-11-13T11:29:57.983139+0000","last_fullsized":"2023-11-13T11:29:57.983139+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-13T11:29:55.092850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-13T11:29:55.092850+0000","last_clean_scrub_stamp":"2023-11-13T11:29:55.092850+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-14T18:02:37.298150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-13T11:29:57.798212+0000","last_change":"2023-11-13T11:29:56.642384+0000","last_active":"2023-11-13T11:29:57.798212+0000","last_peered":"2023-11-13T11:29:57.798212+0000","last_clean":"2023-11-13T11:29:57.798212+0000","last_became_active":"2023-11-13T11:29:56.642131+0000","last_became_peered":"2023-11-13T11:29:56.642131+0000","last_unstale":"2023-11-13T11:29:57.798212+0000","last_undegraded":"2023-11-13T11:29:57.798212+0000","last_fullsized":"2023-11-13T11:29:57.798212+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-13T11:29:56.100939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-13T11:29:56.100939+0000","last_clean_scrub_stamp":"2023-11-13T11:29:56.100939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-14T21:08:30.440323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.6","version":"36'1","reported_seq":13,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-13T11:29:59.269112+0000","last_change":"2023-11-13T11:29:56.138680+0000","last_active":"2023-11-13T11:29:59.269112+0000","last_peered":"2023-11-13T11:29:59.269112+0000","last_clean":"2023-11-13T11:29:59.269112+0000","last_became_active":"2023-11-13T11:29:56.138040+0000","last_became_peered":"2023-11-13T11:29:56.138040+0000","last_unstale":"2023-11-13T11:29:59.269112+0000","last_undegraded":"2023-11-13T11:29:59.269112+0000","last_fullsized":"2023-11-13T11:29:59.269112+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-13T11:29:55.092850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-13T11:29:55.092850+0000","last_clean_scrub_stamp":"2023-11-13T11:29:55.092850+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-14T22:42:28.641863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-13T11:29:57.632768+0000","last_change":"2023-11-13T11:29:56.656068+0000","last_active":"2023-11-13T11:29:57.632768+0000","last_peered":"2023-11-13T11:29:57.632768+0000","last_clean":"2023-11-13T11:29:57.632768+0000","last_became_active":"2023-11-13T11:29:56.655785+0000","last_became_peered":"2023-11-13T11:29:56.655785+0000","last_unstale":"2023-11-13T11:29:57.632768+0000","last_undegraded":"2023-11-13T11:29:57.632768+0000","last_fullsized":"2023-11-13T11:29:57.632768+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-13T11:29:56.100939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-13T11:29:56.100939+0000","last_clean_scrub_stamp":"2023-11-13T11:29:56.100939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-14T21:19:43.523677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-13T11:29:57.983249+0000","last_change":"2023-11-13T11:29:56.142162+0000","last_active":"2023-11-13T11:29:57.983249+0000","last_peered":"2023-11-13T11:29:57.983249+0000","last_clean":"2023-11-13T11:29:57.983249+0000","last_became_active":"2023-11-13T11:29:56.137853+0000","last_became_peered":"2023-11-13T11:29:56.137853+0000","last_unstale":"2023-11-13T11:29:57.983249+0000","last_undegraded":"2023-11-13T11:29:57.983249+0000","last_fullsized":"2023-11-13T11:29:57.983249+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-13T11:29:55.092850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-13T11:29:55.092850+0000","last_clean_scrub_stamp":"2023-11-13T11:29:55.092850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-14T23:27:05.058467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-13T11:29:58.898698+0000","last_change":"2023-11-13T11:29:56.641825+0000","last_active":"2023-11-13T11:29:58.898698+0000","last_peered":"2023-11-13T11:29:58.898698+0000","last_clean":"2023-11-13T11:29:58.898698+0000","last_became_active":"2023-11-13T11:29:56.641585+0000","last_became_peered":"2023-11-13T11:29:56.641585+0000","last_unstale":"2023-11-13T11:29:58.898698+0000","last_undegraded":"2023-11-13T11:29:58.898698+0000","last_fullsized":"2023-11-13T11:29:58.898698+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-13T11:29:56.100939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-13T11:29:56.100939+0000","last_clean_scrub_stamp":"2023-11-13T11:29:56.100939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-14T15:12:20.880081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-13T11:29:57.983061+0000","last_change":"2023-11-13T11:29:56.138898+0000","last_active":"2023-11-13T11:29:57.983061+0000","last_peered":"2023-11-13T11:29:57.983061+0000","last_clean":"2023-11-13T11:29:57.983061+0000","last_became_active":"2023-11-13T11:29:56.138567+0000","last_became_peered":"2023-11-13T11:29:56.138567+0000","last_unstale":"2023-11-13T11:29:57.983061+0000","last_undegraded":"2023-11-13T11:29:57.983061+0000","last_fullsized":"2023-11-13T11:29:57.983061+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-13T11:29:55.092850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-13T11:29:55.092850+0000","last_clean_scrub_stamp":"2023-11-13T11:29:55.092850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-14T16:46:11.291057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-13T11:29:57.632951+0000","last_change":"2023-11-13T11:29:56.654832+0000","last_active":"2023-11-13T11:29:57.632951+0000","last_peered":"2023-11-13T11:29:57.632951+0000","last_clean":"2023-11-13T11:29:57.632951+0000","last_became_active":"2023-11-13T11:29:56.654402+0000","last_became_peered":"2023-11-13T11:29:56.654402+0000","last_unstale":"2023-11-13T11:29:57.632951+0000","last_undegraded":"2023-11-13T11:29:57.632951+0000","last_fullsized":"2023-11-13T11:29:57.632951+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-13T11:29:56.100939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-13T11:29:56.100939+0000","last_clean_scrub_stamp":"2023-11-13T11:29:56.100939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-14T22:42:29.649952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-13T11:29:57.982846+0000","last_change":"2023-11-13T11:29:56.144565+0000","last_active":"2023-11-13T11:29:57.982846+0000","last_peered":"2023-11-13T11:29:57.982846+0000","last_clean":"2023-11-13T11:29:57.982846+0000","last_became_active":"2023-11-13T11:29:56.144261+0000","last_became_peered":"2023-11-13T11:29:56.144261+0000","last_unstale":"2023-11-13T11:29:57.982846+0000","last_undegraded":"2023-11-13T11:29:57.982846+0000","last_fullsized":"2023-11-13T11:29:57.982846+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-13T11:29:55.092850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-13T11:29:55.092850+0000","last_clean_scrub_stamp":"2023-11-13T11:29:55.092850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-14T21:03:47.544626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-13T11:29:57.632142+0000","last_change":"2023-11-13T11:29:56.642258+0000","last_active":"2023-11-13T11:29:57.632142+0000","last_peered":"2023-11-13T11:29:57.632142+0000","last_clean":"2023-11-13T11:29:57.632142+0000","last_became_active":"2023-11-13T11:29:56.641998+0000","last_became_peered":"2023-11-13T11:29:56.641998+0000","last_unstale":"2023-11-13T11:29:57.632142+0000","last_undegraded":"2023-11-13T11:29:57.632142+0000","last_fullsized":"2023-11-13T11:29:57.632142+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-13T11:29:56.100939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-13T11:29:56.100939+0000","last_clean_scrub_stamp":"2023-11-13T11:29:56.100939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-14T14:17:53.387282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-13T11:29:58.007973+0000","last_change":"2023-11-13T11:29:56.135994+0000","last_active":"2023-11-13T11:29:58.007973+0000","last_peered":"2023-11-13T11:29:58.007973+0000","last_clean":"2023-11-13T11:29:58.007973+0000","last_became_active":"2023-11-13T11:29:56.135708+0000","last_became_peered":"2023-11-13T11:29:56.135708+0000","last_unstale":"2023-11-13T11:29:58.007973+0000","last_undegraded":"2023-11-13T11:29:58.007973+0000","last_fullsized":"2023-11-13T11:29:58.007973+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-13T11:29:55.092850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-13T11:29:55.092850+0000","last_clean_scrub_stamp":"2023-11-13T11:29:55.092850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-14T22:09:01.172827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-13T11:29:57.797695+0000","last_change":"2023-11-13T11:29:56.642941+0000","last_active":"2023-11-13T11:29:57.797695+0000","last_peered":"2023-11-13T11:29:57.797695+0000","last_clean":"2023-11-13T11:29:57.797695+0000","last_became_active":"2023-11-13T11:29:56.642650+0000","last_became_peered":"2023-11-13T11:29:56.642650+0000","last_unstale":"2023-11-13T11:29:57.797695+0000","last_undegraded":"2023-11-13T11:29:57.797695+0000","last_fullsized":"2023-11-13T11:29:57.797695+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-13T11:29:56.100939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-13T11:29:56.100939+0000","last_clean_scrub_stamp":"2023-11-13T11:29:56.100939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-14T21:14:53.493647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-13T11:29:57.632187+0000","last_change":"2023-11-13T11:29:56.140560+0000","last_active":"2023-11-13T11:29:57.632187+0000","last_peered":"2023-11-13T11:29:57.632187+0000","last_clean":"2023-11-13T11:29:57.632187+0000","last_became_active":"2023-11-13T11:29:56.140217+0000","last_became_peered":"2023-11-13T11:29:56.140217+0000","last_unstale":"2023-11-13T11:29:57.632187+0000","last_undegraded":"2023-11-13T11:29:57.632187+0000","last_fullsized":"2023-11-13T11:29:57.632187+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-13T11:29:55.092850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-13T11:29:55.092850+0000","last_clean_scrub_stamp":"2023-11-13T11:29:55.092850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-14T13:56:02.498246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-13T11:29:58.898545+0000","last_change":"2023-11-13T11:29:56.643517+0000","last_active":"2023-11-13T11:29:58.898545+0000","last_peered":"2023-11-13T11:29:58.898545+0000","last_clean":"2023-11-13T11:29:58.898545+0000","last_became_active":"2023-11-13T11:29:56.643249+0000","last_became_peered":"2023-11-13T11:29:56.643249+0000","last_unstale":"2023-11-13T11:29:58.898545+0000","last_undegraded":"2023-11-13T11:29:58.898545+0000","last_fullsized":"2023-11-13T11:29:58.898545+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-13T11:29:56.100939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-13T11:29:56.100939+0000","last_clean_scrub_stamp":"2023-11-13T11:29:56.100939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-14T14:07:14.129755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-13T11:29:57.797960+0000","last_change":"2023-11-13T11:29:56.144318+0000","last_active":"2023-11-13T11:29:57.797960+0000","last_peered":"2023-11-13T11:29:57.797960+0000","last_clean":"2023-11-13T11:29:57.797960+0000","last_became_active":"2023-11-13T11:29:56.144025+0000","last_became_peered":"2023-11-13T11:29:56.144025+0000","last_unstale":"2023-11-13T11:29:57.797960+0000","last_undegraded":"2023-11-13T11:29:57.797960+0000","last_fullsized":"2023-11-13T11:29:57.797960+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-13T11:29:55.092850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-13T11:29:55.092850+0000","last_clean_scrub_stamp":"2023-11-13T11:29:55.092850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-14T22:32:31.676402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":176,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-13T11:29:56.628615+0000","last_change":"2023-11-13T11:28:47.002866+0000","last_active":"2023-11-13T11:29:56.628615+0000","last_peered":"2023-11-13T11:29:56.628615+0000","last_clean":"2023-11-13T11:29:56.628615+0000","last_became_active":"2023-11-13T11:28:47.001494+0000","last_became_peered":"2023-11-13T11:28:47.001494+0000","last_unstale":"2023-11-13T11:29:56.628615+0000","last_undegraded":"2023-11-13T11:29:56.628615+0000","last_fullsized":"2023-11-13T11:29:56.628615+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-13T11:28:45.879416+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-13T11:28:45.879416+0000","last_clean_scrub_stamp":"2023-11-13T11:28:45.879416+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-14T14:38:55.166320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":15,"seq":64424509458,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27432,"kb_used_data":404,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344408,"statfs":{"total":96636764160,"available":96608673792,"internally_reserved":0,"allocated":413696,"data_stored":158367,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Nov 13 11:29:47 2023","interfaces":[{"interface":"back","average":{"1min":0.68799999999999994,"5min":0.68799999999999994,"15min":0.68799999999999994},"min":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":0.91600000000000004,"5min":0.91600000000000004,"15min":0.91600000000000004},"last":0.77300000000000002},{"interface":"front","average":{"1min":0.70899999999999996,"5min":0.70899999999999996,"15min":0.70899999999999996},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":1.319,"5min":1.319,"15min":1.319},"last":0.58499999999999996}]},{"osd":1,"last update":"Mon Nov 13 11:29:47 2023","interfaces":[{"interface":"back","average":{"1min":0.745,"5min":0.745,"15min":0.745},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":1.2869999999999999,"5min":1.2869999999999999,"15min":1.2869999999999999},"last":0.624},{"interface":"front","average":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.77100000000000002},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":1.206,"5min":1.206,"15min":1.206},"last":0.53800000000000003}]},{"osd":2,"last update":"Mon Nov 13 11:29:47 2023","interfaces":[{"interface":"back","average":{"1min":0.71099999999999997,"5min":0.71099999999999997,"15min":0.71099999999999997},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":0.93899999999999995,"5min":0.93899999999999995,"15min":0.93899999999999995},"last":0.755},{"interface":"front","average":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":1.0589999999999999,"5min":1.0589999999999999,"15min":1.0589999999999999},"last":0.55400000000000005}]},{"osd":3,"last update":"Mon Nov 13 11:29:47 2023","interfaces":[{"interface":"back","average":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":0.81299999999999994},"min":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":1.367,"5min":1.367,"15min":1.367},"last":0.73299999999999998},{"interface":"front","average":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":0.77900000000000003},"min":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":1.4950000000000001,"5min":1.4950000000000001,"15min":1.4950000000000001},"last":0.60599999999999998}]},{"osd":4,"last update":"Mon Nov 13 11:29:47 2023","interfaces":[{"interface":"back","average":{"1min":0.66200000000000003,"5min":0.66200000000000003,"15min":0.66200000000000003},"min":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":1.002,"5min":1.002,"15min":1.002},"last":0.68100000000000005},{"interface":"front","average":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":0.77900000000000003},"min":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":1.403,"5min":1.403,"15min":1.403},"last":0.48599999999999999}]},{"osd":5,"last update":"Mon Nov 13 11:29:47 2023","interfaces":[{"interface":"back","average":{"1min":0.69599999999999995,"5min":0.69599999999999995,"15min":0.69599999999999995},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.96099999999999997,"5min":0.96099999999999997,"15min":0.96099999999999997},"last":0.70399999999999996},{"interface":"front","average":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":0.78000000000000003},"min":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"max":{"1min":1.1040000000000001,"5min":1.1040000000000001,"15min":1.1040000000000001},"last":0.81100000000000005}]},{"osd":7,"last update":"Mon Nov 13 11:29:47 2023","interfaces":[{"interface":"back","average":{"1min":0.79700000000000004,"5min":0.79700000000000004,"15min":0.79700000000000004},"min":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"max":{"1min":1.0820000000000001,"5min":1.0820000000000001,"15min":1.0820000000000001},"last":0.65600000000000003},{"interface":"front","average":{"1min":0.79100000000000004,"5min":0.79100000000000004,"15min":0.79100000000000004},"min":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":1.089,"5min":1.089,"15min":1.089},"last":0.78700000000000003}]}]},{"osd":5,"up_from":15,"seq":64424509458,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27992,"kb_used_data":972,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343848,"statfs":{"total":96636764160,"available":96608100352,"internally_reserved":0,"allocated":995328,"data_stored":746736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Nov 13 11:29:45 2023","interfaces":[{"interface":"back","average":{"1min":0.69699999999999995,"5min":0.69699999999999995,"15min":0.69699999999999995},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":1.7609999999999999,"5min":1.7609999999999999,"15min":1.7609999999999999},"last":0.66700000000000004},{"interface":"front","average":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":2.3370000000000002,"5min":2.3370000000000002,"15min":2.3370000000000002},"last":0.53800000000000003}]},{"osd":1,"last update":"Mon Nov 13 11:29:45 2023","interfaces":[{"interface":"back","average":{"1min":0.751,"5min":0.751,"15min":0.751},"min":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":1.8560000000000001,"5min":1.8560000000000001,"15min":1.8560000000000001},"last":0.40699999999999997},{"interface":"front","average":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":2.3599999999999999,"5min":2.3599999999999999,"15min":2.3599999999999999},"last":0.56899999999999995}]},{"osd":2,"last update":"Mon Nov 13 11:29:45 2023","interfaces":[{"interface":"back","average":{"1min":0.79300000000000004,"5min":0.79300000000000004,"15min":0.79300000000000004},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":3.2480000000000002,"5min":3.2480000000000002,"15min":3.2480000000000002},"last":0.499},{"interface":"front","average":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"min":{"1min":0.5,"5min":0.5,"15min":0.5},"max":{"1min":1.0129999999999999,"5min":1.0129999999999999,"15min":1.0129999999999999},"last":0.64200000000000002}]},{"osd":3,"last update":"Mon Nov 13 11:29:45 2023","interfaces":[{"interface":"back","average":{"1min":0.747,"5min":0.747,"15min":0.747},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":1.3680000000000001,"5min":1.3680000000000001,"15min":1.3680000000000001},"last":0.60699999999999998},{"interface":"front","average":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.71299999999999997},"min":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":1.6779999999999999,"5min":1.6779999999999999,"15min":1.6779999999999999},"last":0.44800000000000001}]},{"osd":4,"last update":"Mon Nov 13 11:29:45 2023","interfaces":[{"interface":"back","average":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.71299999999999997},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":2.323,"5min":2.323,"15min":2.323},"last":0.623},{"interface":"front","average":{"1min":0.78300000000000003,"5min":0.78300000000000003,"15min":0.78300000000000003},"min":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":1.04,"5min":1.04,"15min":1.04},"last":0.36899999999999999}]},{"osd":6,"last update":"Mon Nov 13 11:29:45 2023","interfaces":[{"interface":"back","average":{"1min":0.77200000000000002,"5min":0.77200000000000002,"15min":0.77200000000000002},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":2.5750000000000002,"5min":2.5750000000000002,"15min":2.5750000000000002},"last":0.52100000000000002},{"interface":"front","average":{"1min":0.79300000000000004,"5min":0.79300000000000004,"15min":0.79300000000000004},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":2.7010000000000001,"5min":2.7010000000000001,"15min":2.7010000000000001},"last":0.54900000000000004}]},{"osd":7,"last update":"Mon Nov 13 11:29:45 2023","interfaces":[{"interface":"back","average":{"1min":0.80900000000000005,"5min":0.80900000000000005,"15min":0.80900000000000005},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":2.3079999999999998,"5min":2.3079999999999998,"15min":2.3079999999999998},"last":0.47899999999999998},{"interface":"front","average":{"1min":0.75600000000000001,"5min":0.75600000000000001,"15min":0.75600000000000001},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":2.266,"5min":2.266,"15min":2.266},"last":0.58799999999999997}]}]},{"osd":4,"up_from":15,"seq":64424509457,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27436,"kb_used_data":408,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344404,"statfs":{"total":96636764160,"available":96608669696,"internally_reserved":0,"allocated":417792,"data_stored":158389,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Nov 13 11:29:45 2023","interfaces":[{"interface":"back","average":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":1.129,"5min":1.129,"15min":1.129},"last":0.75700000000000001},{"interface":"front","average":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":0.88300000000000001,"5min":0.88300000000000001,"15min":0.88300000000000001},"last":0.74099999999999999}]},{"osd":1,"last update":"Mon Nov 13 11:29:45 2023","interfaces":[{"interface":"back","average":{"1min":0.85699999999999998,"5min":0.85699999999999998,"15min":0.85699999999999998},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":2.4929999999999999,"5min":2.4929999999999999,"15min":2.4929999999999999},"last":0.84399999999999997},{"interface":"front","average":{"1min":0.69499999999999995,"5min":0.69499999999999995,"15min":0.69499999999999995},"min":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":1.181,"5min":1.181,"15min":1.181},"last":0.64900000000000002}]},{"osd":2,"last update":"Mon Nov 13 11:29:45 2023","interfaces":[{"interface":"back","average":{"1min":0.83499999999999996,"5min":0.83499999999999996,"15min":0.83499999999999996},"min":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":2.5129999999999999,"5min":2.5129999999999999,"15min":2.5129999999999999},"last":0.61099999999999999},{"interface":"front","average":{"1min":0.71699999999999997,"5min":0.71699999999999997,"15min":0.71699999999999997},"min":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":0.89700000000000002,"5min":0.89700000000000002,"15min":0.89700000000000002},"last":0.80200000000000005}]},{"osd":3,"last update":"Mon Nov 13 11:29:45 2023","interfaces":[{"interface":"back","average":{"1min":0.68899999999999995,"5min":0.68899999999999995,"15min":0.68899999999999995},"min":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":0.91500000000000004,"5min":0.91500000000000004,"15min":0.91500000000000004},"last":0.67000000000000004},{"interface":"front","average":{"1min":0.73299999999999998,"5min":0.73299999999999998,"15min":0.73299999999999998},"min":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"max":{"1min":0.90600000000000003,"5min":0.90600000000000003,"15min":0.90600000000000003},"last":0.77600000000000002}]},{"osd":5,"last update":"Mon Nov 13 11:29:45 2023","interfaces":[{"interface":"back","average":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.85199999999999998,"5min":0.85199999999999998,"15min":0.85199999999999998},"last":0.69299999999999995},{"interface":"front","average":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"last":0.46200000000000002}]},{"osd":6,"last update":"Mon Nov 13 11:29:45 2023","interfaces":[{"interface":"back","average":{"1min":0.67100000000000004,"5min":0.67100000000000004,"15min":0.67100000000000004},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":0.86799999999999999,"5min":0.86799999999999999,"15min":0.86799999999999999},"last":0.55000000000000004},{"interface":"front","average":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.93799999999999994,"5min":0.93799999999999994,"15min":0.93799999999999994},"last":0.56299999999999994}]},{"osd":7,"last update":"Mon Nov 13 11:29:45 2023","interfaces":[{"interface":"back","average":{"1min":0.73199999999999998,"5min":0.73199999999999998,"15min":0.73199999999999998},"min":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":0.90400000000000003,"5min":0.90400000000000003,"15min":0.90400000000000003},"last":0.52400000000000002},{"interface":"front","average":{"1min":0.80300000000000005,"5min":0.80300000000000005,"15min":0.80300000000000005},"min":{"1min":0.69499999999999995,"5min":0.69499999999999995,"15min":0.69499999999999995},"max":{"1min":0.97399999999999998,"5min":0.97399999999999998,"15min":0.97399999999999998},"last":0.72099999999999997}]}]},{"osd":3,"up_from":15,"seq":64424509458,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27436,"kb_used_data":408,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344404,"statfs":{"total":96636764160,"available":96608669696,"internally_reserved":0,"allocated":417792,"data_stored":157531,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Nov 13 11:29:46 2023","interfaces":[{"interface":"back","average":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":1.0229999999999999,"5min":1.0229999999999999,"15min":1.0229999999999999},"last":0.379},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"min":{"1min":0.31,"5min":0.31,"15min":0.31},"max":{"1min":1.522,"5min":1.522,"15min":1.522},"last":0.45500000000000002}]},{"osd":1,"last update":"Mon Nov 13 11:29:46 2023","interfaces":[{"interface":"back","average":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":2.9199999999999999,"5min":2.9199999999999999,"15min":2.9199999999999999},"last":0.435},{"interface":"front","average":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":3.0619999999999998,"5min":3.0619999999999998,"15min":3.0619999999999998},"last":0.56899999999999995}]},{"osd":2,"last update":"Mon Nov 13 11:29:46 2023","interfaces":[{"interface":"back","average":{"1min":0.68300000000000005,"5min":0.68300000000000005,"15min":0.68300000000000005},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":2.9820000000000002,"5min":2.9820000000000002,"15min":2.9820000000000002},"last":0.47699999999999998},{"interface":"front","average":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":2.1920000000000002,"5min":2.1920000000000002,"15min":2.1920000000000002},"last":0.53700000000000003}]},{"osd":4,"last update":"Mon Nov 13 11:29:46 2023","interfaces":[{"interface":"back","average":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.77300000000000002},"min":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":1.135,"5min":1.135,"15min":1.135},"last":0.81299999999999994},{"interface":"front","average":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.76600000000000001},"min":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":1.2949999999999999,"5min":1.2949999999999999,"15min":1.2949999999999999},"last":0.82699999999999996}]},{"osd":5,"last update":"Mon Nov 13 11:29:46 2023","interfaces":[{"interface":"back","average":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.76600000000000001},"min":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":1.3340000000000001,"5min":1.3340000000000001,"15min":1.3340000000000001},"last":0.88700000000000001},{"interface":"front","average":{"1min":0.79100000000000004,"5min":0.79100000000000004,"15min":0.79100000000000004},"min":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":1.7350000000000001,"5min":1.7350000000000001,"15min":1.7350000000000001},"last":0.67500000000000004}]},{"osd":6,"last update":"Mon Nov 13 11:29:46 2023","interfaces":[{"interface":"back","average":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"min":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":1.173,"5min":1.173,"15min":1.173},"last":0.65200000000000002},{"interface":"front","average":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":0.80600000000000005},"min":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"max":{"1min":1.3600000000000001,"5min":1.3600000000000001,"15min":1.3600000000000001},"last":0.73699999999999999}]},{"osd":7,"last update":"Mon Nov 13 11:29:46 2023","interfaces":[{"interface":"back","average":{"1min":0.84899999999999998,"5min":0.84899999999999998,"15min":0.84899999999999998},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":2.0070000000000001,"5min":2.0070000000000001,"15min":2.0070000000000001},"last":0.79100000000000004},{"interface":"front","average":{"1min":0.81499999999999995,"5min":0.81499999999999995,"15min":0.81499999999999995},"min":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"max":{"1min":1.208,"5min":1.208,"15min":1.208},"last":0.77100000000000002}]}]},{"osd":2,"up_from":15,"seq":64424509458,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27424,"kb_used_data":396,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344416,"statfs":{"total":96636764160,"available":96608681984,"internally_reserved":0,"allocated":405504,"data_stored":156789,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Nov 13 11:29:45 2023","interfaces":[{"interface":"back","average":{"1min":0.99299999999999999,"5min":0.99299999999999999,"15min":0.99299999999999999},"min":{"1min":0.245,"5min":0.245,"15min":0.245},"max":{"1min":8.6050000000000004,"5min":8.6050000000000004,"15min":8.6050000000000004},"last":0.26500000000000001},{"interface":"front","average":{"1min":0.96599999999999997,"5min":0.96599999999999997,"15min":0.96599999999999997},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":8.3770000000000007,"5min":8.3770000000000007,"15min":8.3770000000000007},"last":0.61799999999999999}]},{"osd":1,"last update":"Mon Nov 13 11:29:45 2023","interfaces":[{"interface":"back","average":{"1min":0.73199999999999998,"5min":0.73199999999999998,"15min":0.73199999999999998},"min":{"1min":0.28199999999999997,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":4.351,"5min":4.351,"15min":4.351},"last":0.40300000000000002},{"interface":"front","average":{"1min":1.008,"5min":1.008,"15min":1.008},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":8.1649999999999991,"5min":8.1649999999999991,"15min":8.1649999999999991},"last":0.36099999999999999}]},{"osd":3,"last update":"Mon Nov 13 11:29:45 2023","interfaces":[{"interface":"back","average":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.64100000000000001,"5min":0.64100000000000001,"15min":0.64100000000000001},"last":0.42799999999999999},{"interface":"front","average":{"1min":1.097,"5min":1.097,"15min":1.097},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":8.8059999999999992,"5min":8.8059999999999992,"15min":8.8059999999999992},"last":0.54800000000000004}]},{"osd":4,"last update":"Mon Nov 13 11:29:45 2023","interfaces":[{"interface":"back","average":{"1min":1.0489999999999999,"5min":1.0489999999999999,"15min":1.0489999999999999},"min":{"1min":0.64800000000000002,"5min":0.64800000000000002,"15min":0.64800000000000002},"max":{"1min":4.6310000000000002,"5min":4.6310000000000002,"15min":4.6310000000000002},"last":0.58599999999999997},{"interface":"front","average":{"1min":1.075,"5min":1.075,"15min":1.075},"min":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":5.1639999999999997,"5min":5.1639999999999997,"15min":5.1639999999999997},"last":0.66700000000000004}]},{"osd":5,"last update":"Mon Nov 13 11:29:45 2023","interfaces":[{"interface":"back","average":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"min":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":0.95499999999999996,"5min":0.95499999999999996,"15min":0.95499999999999996},"last":0.56799999999999995},{"interface":"front","average":{"1min":1.056,"5min":1.056,"15min":1.056},"min":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":4.6779999999999999,"5min":4.6779999999999999,"15min":4.6779999999999999},"last":0.51500000000000001}]},{"osd":6,"last update":"Mon Nov 13 11:29:45 2023","interfaces":[{"interface":"back","average":{"1min":1.0600000000000001,"5min":1.0600000000000001,"15min":1.0600000000000001},"min":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"max":{"1min":4.7080000000000002,"5min":4.7080000000000002,"15min":4.7080000000000002},"last":0.76000000000000001},{"interface":"front","average":{"1min":0.77800000000000002,"5min":0.77800000000000002,"15min":0.77800000000000002},"min":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":1.1200000000000001,"5min":1.1200000000000001,"15min":1.1200000000000001},"last":0.68400000000000005}]},{"osd":7,"last update":"Mon Nov 13 11:29:45 2023","interfaces":[{"interface":"back","average":{"1min":1.0629999999999999,"5min":1.0629999999999999,"15min":1.0629999999999999},"min":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"max":{"1min":4.9530000000000003,"5min":4.9530000000000003,"15min":4.9530000000000003},"last":0.70499999999999996},{"interface":"front","average":{"1min":0.81100000000000005,"5min":0.81100000000000005,"15min":0.81100000000000005},"min":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"max":{"1min":1.294,"5min":1.294,"15min":1.294},"last":0.64700000000000002}]}]},{"osd":1,"up_from":15,"seq":64424509459,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27996,"kb_used_data":976,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343844,"statfs":{"total":96636764160,"available":96608096256,"internally_reserved":0,"allocated":999424,"data_stored":747193,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Nov 13 11:29:45 2023","interfaces":[{"interface":"back","average":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"last":0.44600000000000001},{"interface":"front","average":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"min":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.80700000000000005,"5min":0.80700000000000005,"15min":0.80700000000000005},"last":0.46700000000000003}]},{"osd":2,"last update":"Mon Nov 13 11:29:45 2023","interfaces":[{"interface":"back","average":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":0.63500000000000001,"5min":0.63500000000000001,"15min":0.63500000000000001},"last":0.48299999999999998},{"interface":"front","average":{"1min":0.499,"5min":0.499,"15min":0.499},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.64800000000000002,"5min":0.64800000000000002,"15min":0.64800000000000002},"last":0.57599999999999996}]},{"osd":3,"last update":"Mon Nov 13 11:29:45 2023","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.77000000000000002,"5min":0.77000000000000002,"15min":0.77000000000000002},"last":0.54300000000000004},{"interface":"front","average":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.68300000000000005,"5min":0.68300000000000005,"15min":0.68300000000000005},"last":0.49099999999999999}]},{"osd":4,"last update":"Mon Nov 13 11:29:45 2023","interfaces":[{"interface":"back","average":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"min":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":1.3720000000000001,"5min":1.3720000000000001,"15min":1.3720000000000001},"last":0.60599999999999998},{"interface":"front","average":{"1min":0.73199999999999998,"5min":0.73199999999999998,"15min":0.73199999999999998},"min":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":1.0389999999999999,"5min":1.0389999999999999,"15min":1.0389999999999999},"last":0.70099999999999996}]},{"osd":5,"last update":"Mon Nov 13 11:29:45 2023","interfaces":[{"interface":"back","average":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"min":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":1.0669999999999999,"5min":1.0669999999999999,"15min":1.0669999999999999},"last":0.88700000000000001},{"interface":"front","average":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"min":{"1min":0.60099999999999998,"5min":0.60099999999999998,"15min":0.60099999999999998},"max":{"1min":1.0009999999999999,"5min":1.0009999999999999,"15min":1.0009999999999999},"last":0.871}]},{"osd":6,"last update":"Mon Nov 13 11:29:45 2023","interfaces":[{"interface":"back","average":{"1min":0.752,"5min":0.752,"15min":0.752},"min":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":0.94799999999999995,"5min":0.94799999999999995,"15min":0.94799999999999995},"last":0.78400000000000003},{"interface":"front","average":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"min":{"1min":0.66300000000000003,"5min":0.66300000000000003,"15min":0.66300000000000003},"max":{"1min":1.0249999999999999,"5min":1.0249999999999999,"15min":1.0249999999999999},"last":0.85599999999999998}]},{"osd":7,"last update":"Mon Nov 13 11:29:45 2023","interfaces":[{"interface":"back","average":{"1min":0.77000000000000002,"5min":0.77000000000000002,"15min":0.77000000000000002},"min":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"max":{"1min":0.96299999999999997,"5min":0.96299999999999997,"15min":0.96299999999999997},"last":0.82799999999999996},{"interface":"front","average":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.78200000000000003},"min":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":0.98399999999999999,"5min":0.98399999999999999,"15min":0.98399999999999999},"last":0.83899999999999997}]}]},{"osd":0,"up_from":15,"seq":64424509459,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27412,"kb_used_data":392,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344428,"statfs":{"total":96636764160,"available":96608694272,"internally_reserved":0,"allocated":401408,"data_stored":155876,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Nov 13 11:29:45 2023","interfaces":[{"interface":"back","average":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"min":{"1min":0.29099999999999998,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"last":0.64400000000000002},{"interface":"front","average":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"min":{"1min":0.29899999999999999,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.60299999999999998,"5min":0.60299999999999998,"15min":0.60299999999999998},"last":0.41099999999999998}]},{"osd":2,"last update":"Mon Nov 13 11:29:45 2023","interfaces":[{"interface":"back","average":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"last":0.52400000000000002},{"interface":"front","average":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":1.0069999999999999,"5min":1.0069999999999999,"15min":1.0069999999999999},"last":0.45800000000000002}]},{"osd":3,"last update":"Mon Nov 13 11:29:45 2023","interfaces":[{"interface":"back","average":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"last":0.55300000000000005},{"interface":"front","average":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"last":0.61399999999999999}]},{"osd":4,"last update":"Mon Nov 13 11:29:45 2023","interfaces":[{"interface":"back","average":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"min":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":1.048,"5min":1.048,"15min":1.048},"last":0.65800000000000003},{"interface":"front","average":{"1min":0.79700000000000004,"5min":0.79700000000000004,"15min":0.79700000000000004},"min":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"max":{"1min":1.0629999999999999,"5min":1.0629999999999999,"15min":1.0629999999999999},"last":0.74399999999999999}]},{"osd":5,"last update":"Mon Nov 13 11:29:45 2023","interfaces":[{"interface":"back","average":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":0.78700000000000003},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.5189999999999999,"5min":1.5189999999999999,"15min":1.5189999999999999},"last":0.68000000000000005},{"interface":"front","average":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.77300000000000002},"min":{"1min":0.629,"5min":0.629,"15min":0.629},"max":{"1min":1.1519999999999999,"5min":1.1519999999999999,"15min":1.1519999999999999},"last":0.77300000000000002}]},{"osd":6,"last update":"Mon Nov 13 11:29:45 2023","interfaces":[{"interface":"back","average":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.78800000000000003},"min":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.004,"5min":1.004,"15min":1.004},"last":0.69799999999999995},{"interface":"front","average":{"1min":0.82899999999999996,"5min":0.82899999999999996,"15min":0.82899999999999996},"min":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"max":{"1min":2.0270000000000001,"5min":2.0270000000000001,"15min":2.0270000000000001},"last":0.63200000000000001}]},{"osd":7,"last update":"Mon Nov 13 11:29:45 2023","interfaces":[{"interface":"back","average":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"min":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"max":{"1min":1.579,"5min":1.579,"15min":1.579},"last":0.71099999999999997},{"interface":"front","average":{"1min":0.79000000000000004,"5min":0.79000000000000004,"15min":0.79000000000000004},"min":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":1.101,"5min":1.101,"15min":1.101},"last":0.72299999999999998}]}]},{"osd":7,"up_from":14,"seq":60129542162,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27416,"kb_used_data":396,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344424,"statfs":{"total":96636764160,"available":96608690176,"internally_reserved":0,"allocated":405504,"data_stored":156777,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Nov 13 11:29:49 2023","interfaces":[{"interface":"back","average":{"1min":0.86499999999999999,"5min":0.86499999999999999,"15min":0.86499999999999999},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":5.5019999999999998,"5min":5.5019999999999998,"15min":5.5019999999999998},"last":0.65700000000000003},{"interface":"front","average":{"1min":0.89900000000000002,"5min":0.89900000000000002,"15min":0.89900000000000002},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":5.7329999999999997,"5min":5.7329999999999997,"15min":5.7329999999999997},"last":0.747}]},{"osd":1,"last update":"Mon Nov 13 11:29:49 2023","interfaces":[{"interface":"back","average":{"1min":0.66100000000000003,"5min":0.66100000000000003,"15min":0.66100000000000003},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.89700000000000002,"5min":0.89700000000000002,"15min":0.89700000000000002},"last":0.77300000000000002},{"interface":"front","average":{"1min":0.72999999999999998,"5min":0.72999999999999998,"15min":0.72999999999999998},"min":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":0.95599999999999996,"5min":0.95599999999999996,"15min":0.95599999999999996},"last":0.70299999999999996}]},{"osd":2,"last update":"Mon Nov 13 11:29:49 2023","interfaces":[{"interface":"back","average":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":0.91100000000000003,"5min":0.91100000000000003,"15min":0.91100000000000003},"last":0.73299999999999998},{"interface":"front","average":{"1min":0.95599999999999996,"5min":0.95599999999999996,"15min":0.95599999999999996},"min":{"1min":0.502,"5min":0.502,"15min":0.502},"max":{"1min":5.569,"5min":5.569,"15min":5.569},"last":0.79800000000000004}]},{"osd":3,"last update":"Mon Nov 13 11:29:49 2023","interfaces":[{"interface":"back","average":{"1min":0.89300000000000002,"5min":0.89300000000000002,"15min":0.89300000000000002},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":5.5979999999999999,"5min":5.5979999999999999,"15min":5.5979999999999999},"last":0.72199999999999998},{"interface":"front","average":{"1min":0.79100000000000004,"5min":0.79100000000000004,"15min":0.79100000000000004},"min":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"max":{"1min":1.7050000000000001,"5min":1.7050000000000001,"15min":1.7050000000000001},"last":0.61799999999999999}]},{"osd":4,"last update":"Mon Nov 13 11:29:49 2023","interfaces":[{"interface":"back","average":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":1.018,"5min":1.018,"15min":1.018},"last":0.58399999999999996},{"interface":"front","average":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":0.71499999999999997},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.95599999999999996,"5min":0.95599999999999996,"15min":0.95599999999999996},"last":0.46200000000000002}]},{"osd":5,"last update":"Mon Nov 13 11:29:49 2023","interfaces":[{"interface":"back","average":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":1.0029999999999999,"5min":1.0029999999999999,"15min":1.0029999999999999},"last":0.44500000000000001},{"interface":"front","average":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"min":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":1.0189999999999999,"5min":1.0189999999999999,"15min":1.0189999999999999},"last":0.52900000000000003}]},{"osd":6,"last update":"Mon Nov 13 11:29:49 2023","interfaces":[{"interface":"back","average":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"min":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"max":{"1min":1.02,"5min":1.02,"15min":1.02},"last":0.64000000000000001},{"interface":"front","average":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":0.77900000000000003},"min":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"max":{"1min":1.0029999999999999,"5min":1.0029999999999999,"15min":1.0029999999999999},"last":0.67500000000000004}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":776,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-13T11:30:01.222 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-13T11:30:01.392 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:01.385+0000 7f53b9c6b640 1 Processor -- start 2023-11-13T11:30:01.392 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:01.385+0000 7f53b9c6b640 1 -- start start 2023-11-13T11:30:01.393 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:01.385+0000 7f53b9c6b640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f53b40d0c40 0x7f53b40c69b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:30:01.393 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:01.385+0000 7f53b9c6b640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f53b40cf490 0x7f53b40cf920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:30:01.394 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:01.385+0000 7f53b9c6b640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f53b40d1440 con 0x7f53b41606e0 2023-11-13T11:30:01.394 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:01.385+0000 7f53b9c6b640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f53b40cfe60 con 0x7f53b40d0c40 2023-11-13T11:30:01.394 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:01.385+0000 7f53b9c6b640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f53b40cdb10 con 0x7f53b40cf490 2023-11-13T11:30:01.395 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:01.385+0000 7f53aaffd640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f53b40d0c40 0x7f53b40c69b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:30:01.395 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:01.385+0000 7f53aaffd640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f53b40d0c40 0x7f53b40c69b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.102:53138/0 (socket says 172.21.15.102:53138) 2023-11-13T11:30:01.395 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:01.385+0000 7f53aaffd640 1 -- 172.21.15.102:0/1372258077 learned_addr learned my addr 172.21.15.102:0/1372258077 (peer_addr_for_me v2:172.21.15.102:0/0) 2023-11-13T11:30:01.396 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:01.385+0000 7f53b3fff640 1 --2- 172.21.15.102:0/1372258077 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f53b40cf490 0x7f53b40cf920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:30:01.396 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:01.385+0000 7f53b37fe640 1 --1- 172.21.15.102:0/1372258077 >> v1:172.21.15.154:6789/0 conn(0x7f53b41606e0 0x7f53b40b3e20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.102:52216/0 (socket says 172.21.15.102:52216) 2023-11-13T11:30:01.396 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:01.385+0000 7f53aaffd640 1 -- 172.21.15.102:0/1372258077 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f53b40cf490 msgr2=0x7f53b40cf920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-13T11:30:01.396 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:01.385+0000 7f53aaffd640 1 --2- 172.21.15.102:0/1372258077 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f53b40cf490 0x7f53b40cf920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:30:01.396 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:01.385+0000 7f53aaffd640 1 -- 172.21.15.102:0/1372258077 >> v1:172.21.15.154:6789/0 conn(0x7f53b41606e0 legacy=0x7f53b40b3e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:30:01.397 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:01.385+0000 7f53aaffd640 1 -- 172.21.15.102:0/1372258077 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53b40d1690 con 0x7f53b40d0c40 2023-11-13T11:30:01.397 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:01.385+0000 7f53b3fff640 1 --2- 172.21.15.102:0/1372258077 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f53b40cf490 0x7f53b40cf920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-13T11:30:01.398 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:01.389+0000 7f53aaffd640 1 --2- 172.21.15.102:0/1372258077 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f53b40d0c40 0x7f53b40c69b0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f53a4009870 tx=0x7f53a401c480 comp rx=0 tx=0).ready entity=mon.1 client_cookie=39c5d465eee0560b server_cookie=0 in_seq=0 out_seq=0 2023-11-13T11:30:01.399 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:01.389+0000 7f53b2ffd640 1 -- 172.21.15.102:0/1372258077 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53a40a6040 con 0x7f53b40d0c40 2023-11-13T11:30:01.399 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:01.389+0000 7f53b2ffd640 1 -- 172.21.15.102:0/1372258077 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f53a40aa600 con 0x7f53b40d0c40 2023-11-13T11:30:01.399 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:01.389+0000 7f53b2ffd640 1 -- 172.21.15.102:0/1372258077 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53a40aa990 con 0x7f53b40d0c40 2023-11-13T11:30:01.399 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:01.389+0000 7f53b9c6b640 1 -- 172.21.15.102:0/1372258077 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f53b40d0c40 msgr2=0x7f53b40c69b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:30:01.400 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:01.389+0000 7f53b9c6b640 1 --2- 172.21.15.102:0/1372258077 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f53b40d0c40 0x7f53b40c69b0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f53a4009870 tx=0x7f53a401c480 comp rx=0 tx=0).stop 2023-11-13T11:30:01.400 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:01.389+0000 7f53b9c6b640 1 -- 172.21.15.102:0/1372258077 shutdown_connections 2023-11-13T11:30:01.400 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:01.389+0000 7f53b9c6b640 1 --2- 172.21.15.102:0/1372258077 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f53b40cf490 0x7f53b40cf920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:30:01.400 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:01.389+0000 7f53b9c6b640 1 --2- 172.21.15.102:0/1372258077 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f53b40d0c40 0x7f53b40c69b0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:30:01.400 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:01.389+0000 7f53b9c6b640 1 -- 172.21.15.102:0/1372258077 >> 172.21.15.102:0/1372258077 conn(0x7f53b409c130 msgr2=0x7f53b40d2e60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-13T11:30:01.401 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:01.389+0000 7f53b9c6b640 1 -- 172.21.15.102:0/1372258077 shutdown_connections 2023-11-13T11:30:01.401 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:01.389+0000 7f53b9c6b640 1 -- 172.21.15.102:0/1372258077 wait complete. 2023-11-13T11:30:01.403 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:01.393+0000 7f53b9c6b640 1 Processor -- start 2023-11-13T11:30:01.403 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:01.393+0000 7f53b9c6b640 1 -- start start 2023-11-13T11:30:01.403 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:01.393+0000 7f53b9c6b640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f53b40cf490 0x7f53b40afa20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:30:01.403 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:01.393+0000 7f53b9c6b640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f53b40d0c40 0x7f53b4143a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:30:01.403 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:01.393+0000 7f53b9c6b640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f53b41606e0 0x7f53b40b7aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:30:01.404 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:01.393+0000 7f53b9c6b640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53b40b7680 con 0x7f53b40d0c40 2023-11-13T11:30:01.404 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:01.393+0000 7f53b9c6b640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53b40aff60 con 0x7f53b41606e0 2023-11-13T11:30:01.404 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:01.393+0000 7f53b9c6b640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f53b41591c0 con 0x7f53b40cf490 2023-11-13T11:30:01.404 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:01.393+0000 7f53aaffd640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f53b40d0c40 0x7f53b4143a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:30:01.404 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:01.393+0000 7f53aaffd640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f53b40d0c40 0x7f53b4143a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:38336/0 (socket says 172.21.15.102:38336) 2023-11-13T11:30:01.405 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:01.393+0000 7f53aaffd640 1 -- 172.21.15.102:0/155138270 learned_addr learned my addr 172.21.15.102:0/155138270 (peer_addr_for_me v2:172.21.15.102:0/0) 2023-11-13T11:30:01.405 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:01.393+0000 7f53aaffd640 1 -- 172.21.15.102:0/155138270 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f53b40cf490 msgr2=0x7f53b40afa20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:30:01.405 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:01.393+0000 7f53aaffd640 1 --2- 172.21.15.102:0/155138270 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f53b40cf490 0x7f53b40afa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:30:01.405 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:01.393+0000 7f53aaffd640 1 -- 172.21.15.102:0/155138270 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f53b41606e0 msgr2=0x7f53b40b7aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:30:01.405 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:01.393+0000 7f53aaffd640 1 --2- 172.21.15.102:0/155138270 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f53b41606e0 0x7f53b40b7aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:30:01.406 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:01.393+0000 7f53aaffd640 1 -- 172.21.15.102:0/155138270 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53ac009a70 con 0x7f53b40d0c40 2023-11-13T11:30:01.406 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:01.393+0000 7f53aaffd640 1 --2- 172.21.15.102:0/155138270 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f53b40d0c40 0x7f53b4143a20 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f53a401a0b0 tx=0x7f53a401acc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-13T11:30:01.406 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:01.393+0000 7f53b0ff9640 1 -- 172.21.15.102:0/155138270 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53a40b3600 con 0x7f53b40d0c40 2023-11-13T11:30:01.406 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:01.393+0000 7f53b0ff9640 1 -- 172.21.15.102:0/155138270 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f53a40b3780 con 0x7f53b40d0c40 2023-11-13T11:30:01.406 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:01.393+0000 7f53b9c6b640 1 -- 172.21.15.102:0/155138270 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f53a40094d0 con 0x7f53b40d0c40 2023-11-13T11:30:01.407 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:01.393+0000 7f53b0ff9640 1 -- 172.21.15.102:0/155138270 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53a40b3b30 con 0x7f53b40d0c40 2023-11-13T11:30:01.407 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:01.393+0000 7f53b9c6b640 1 -- 172.21.15.102:0/155138270 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f53b40b0150 con 0x7f53b40d0c40 2023-11-13T11:30:01.408 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:01.397+0000 7f53b9c6b640 1 -- 172.21.15.102:0/155138270 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f53b4068520 con 0x7f53b40d0c40 2023-11-13T11:30:01.408 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:01.397+0000 7f53b0ff9640 1 -- 172.21.15.102:0/155138270 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f53a40b3c90 con 0x7f53b40d0c40 2023-11-13T11:30:01.408 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:01.397+0000 7f53b0ff9640 1 --2- 172.21.15.102:0/155138270 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f5394066470 0x7f5394068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:30:01.408 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:01.397+0000 7f53b0ff9640 1 -- 172.21.15.102:0/155138270 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f53a411e950 con 0x7f53b40d0c40 2023-11-13T11:30:01.409 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:01.397+0000 7f53b37fe640 1 --2- 172.21.15.102:0/155138270 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f5394066470 0x7f5394068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:30:01.409 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:01.397+0000 7f53b37fe640 1 --2- 172.21.15.102:0/155138270 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f5394066470 0x7f5394068930 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f539c001550 tx=0x7f539c0079d0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-13T11:30:01.409 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:01.401+0000 7f53b0ff9640 1 -- 172.21.15.102:0/155138270 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f53a40ebdc0 con 0x7f53b40d0c40 2023-11-13T11:30:01.555 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:01.545+0000 7f53b9c6b640 1 -- 172.21.15.102:0/155138270 --> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f53b4159330 con 0x7f5394066470 2023-11-13T11:30:01.562 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:01.553+0000 7f53b0ff9640 1 -- 172.21.15.102:0/155138270 <== mgr.4103 v2:172.21.15.102:6832/1009482693 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+289760 (secure 0 0 0) 0x7f53b4159330 con 0x7f5394066470 2023-11-13T11:30:01.565 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T11:30:01.567 INFO:teuthology.orchestra.run.smithi102.stderr:dumped all 2023-11-13T11:30:01.568 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:01.557+0000 7f53b9c6b640 1 -- 172.21.15.102:0/155138270 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f5394066470 msgr2=0x7f5394068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:30:01.568 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:01.557+0000 7f53b9c6b640 1 --2- 172.21.15.102:0/155138270 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f5394066470 0x7f5394068930 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f539c001550 tx=0x7f539c0079d0 comp rx=0 tx=0).stop 2023-11-13T11:30:01.568 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:01.557+0000 7f53b9c6b640 1 -- 172.21.15.102:0/155138270 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f53b40d0c40 msgr2=0x7f53b4143a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:30:01.569 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:01.557+0000 7f53b9c6b640 1 --2- 172.21.15.102:0/155138270 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f53b40d0c40 0x7f53b4143a20 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f53a401a0b0 tx=0x7f53a401acc0 comp rx=0 tx=0).stop 2023-11-13T11:30:01.569 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:01.557+0000 7f53b9c6b640 1 -- 172.21.15.102:0/155138270 shutdown_connections 2023-11-13T11:30:01.569 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:01.557+0000 7f53b9c6b640 1 --2- 172.21.15.102:0/155138270 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f53b41606e0 0x7f53b40b7aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:30:01.569 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:01.557+0000 7f53b9c6b640 1 --2- 172.21.15.102:0/155138270 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f5394066470 0x7f5394068930 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:30:01.569 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:01.557+0000 7f53b9c6b640 1 --2- 172.21.15.102:0/155138270 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f53b40d0c40 0x7f53b4143a20 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:30:01.570 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:01.557+0000 7f53b9c6b640 1 --2- 172.21.15.102:0/155138270 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f53b40cf490 0x7f53b40afa20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:30:01.570 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:01.557+0000 7f53b9c6b640 1 -- 172.21.15.102:0/155138270 >> 172.21.15.102:0/155138270 conn(0x7f53b409c130 msgr2=0x7f53b40cbf40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-13T11:30:01.570 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:01.557+0000 7f53b9c6b640 1 -- 172.21.15.102:0/155138270 shutdown_connections 2023-11-13T11:30:01.570 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:01.557+0000 7f53b9c6b640 1 -- 172.21.15.102:0/155138270 wait complete. 2023-11-13T11:30:01.586 INFO:teuthology.orchestra.run.smithi102.stdout:{"pg_ready":true,"pg_map":{"version":68,"stamp":"2023-11-13T11:30:00.935536+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":166,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":220544,"kb_used_data":4352,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754754176,"statfs":{"total":773094113280,"available":772868276224,"internally_reserved":0,"allocated":4456448,"data_stored":2437658,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":31,"apply_latency_ms":31,"commit_latency_ns":31000000,"apply_latency_ns":31000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.832498"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-13T11:29:58.008315+0000","last_change":"2023-11-13T11:29:56.639972+0000","last_active":"2023-11-13T11:29:58.008315+0000","last_peered":"2023-11-13T11:29:58.008315+0000","last_clean":"2023-11-13T11:29:58.008315+0000","last_became_active":"2023-11-13T11:29:56.639732+0000","last_became_peered":"2023-11-13T11:29:56.639732+0000","last_unstale":"2023-11-13T11:29:58.008315+0000","last_undegraded":"2023-11-13T11:29:58.008315+0000","last_fullsized":"2023-11-13T11:29:58.008315+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-13T11:29:56.100939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-13T11:29:56.100939+0000","last_clean_scrub_stamp":"2023-11-13T11:29:56.100939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-14T22:42:29.649952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-13T11:29:58.899149+0000","last_change":"2023-11-13T11:29:56.653545+0000","last_active":"2023-11-13T11:29:58.899149+0000","last_peered":"2023-11-13T11:29:58.899149+0000","last_clean":"2023-11-13T11:29:58.899149+0000","last_became_active":"2023-11-13T11:29:56.652931+0000","last_became_peered":"2023-11-13T11:29:56.652931+0000","last_unstale":"2023-11-13T11:29:58.899149+0000","last_undegraded":"2023-11-13T11:29:58.899149+0000","last_fullsized":"2023-11-13T11:29:58.899149+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-13T11:29:56.100939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-13T11:29:56.100939+0000","last_clean_scrub_stamp":"2023-11-13T11:29:56.100939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-14T13:42:48.610968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-13T11:29:57.628489+0000","last_change":"2023-11-13T11:29:56.641263+0000","last_active":"2023-11-13T11:29:57.628489+0000","last_peered":"2023-11-13T11:29:57.628489+0000","last_clean":"2023-11-13T11:29:57.628489+0000","last_became_active":"2023-11-13T11:29:56.641014+0000","last_became_peered":"2023-11-13T11:29:56.641014+0000","last_unstale":"2023-11-13T11:29:57.628489+0000","last_undegraded":"2023-11-13T11:29:57.628489+0000","last_fullsized":"2023-11-13T11:29:57.628489+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-13T11:29:56.100939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-13T11:29:56.100939+0000","last_clean_scrub_stamp":"2023-11-13T11:29:56.100939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-14T12:12:25.951745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-13T11:29:57.632969+0000","last_change":"2023-11-13T11:29:56.652504+0000","last_active":"2023-11-13T11:29:57.632969+0000","last_peered":"2023-11-13T11:29:57.632969+0000","last_clean":"2023-11-13T11:29:57.632969+0000","last_became_active":"2023-11-13T11:29:56.651789+0000","last_became_peered":"2023-11-13T11:29:56.651789+0000","last_unstale":"2023-11-13T11:29:57.632969+0000","last_undegraded":"2023-11-13T11:29:57.632969+0000","last_fullsized":"2023-11-13T11:29:57.632969+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-13T11:29:56.100939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-13T11:29:56.100939+0000","last_clean_scrub_stamp":"2023-11-13T11:29:56.100939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-14T14:07:14.129755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-13T11:29:58.898913+0000","last_change":"2023-11-13T11:29:56.631474+0000","last_active":"2023-11-13T11:29:58.898913+0000","last_peered":"2023-11-13T11:29:58.898913+0000","last_clean":"2023-11-13T11:29:58.898913+0000","last_became_active":"2023-11-13T11:29:56.631109+0000","last_became_peered":"2023-11-13T11:29:56.631109+0000","last_unstale":"2023-11-13T11:29:58.898913+0000","last_undegraded":"2023-11-13T11:29:58.898913+0000","last_fullsized":"2023-11-13T11:29:58.898913+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-13T11:29:56.100939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-13T11:29:56.100939+0000","last_clean_scrub_stamp":"2023-11-13T11:29:56.100939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-14T17:12:32.904334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-13T11:29:57.632175+0000","last_change":"2023-11-13T11:29:56.648095+0000","last_active":"2023-11-13T11:29:57.632175+0000","last_peered":"2023-11-13T11:29:57.632175+0000","last_clean":"2023-11-13T11:29:57.632175+0000","last_became_active":"2023-11-13T11:29:56.647756+0000","last_became_peered":"2023-11-13T11:29:56.647756+0000","last_unstale":"2023-11-13T11:29:57.632175+0000","last_undegraded":"2023-11-13T11:29:57.632175+0000","last_fullsized":"2023-11-13T11:29:57.632175+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-13T11:29:56.100939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-13T11:29:56.100939+0000","last_clean_scrub_stamp":"2023-11-13T11:29:56.100939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-14T22:13:59.841241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-13T11:29:58.007895+0000","last_change":"2023-11-13T11:29:56.640694+0000","last_active":"2023-11-13T11:29:58.007895+0000","last_peered":"2023-11-13T11:29:58.007895+0000","last_clean":"2023-11-13T11:29:58.007895+0000","last_became_active":"2023-11-13T11:29:56.640411+0000","last_became_peered":"2023-11-13T11:29:56.640411+0000","last_unstale":"2023-11-13T11:29:58.007895+0000","last_undegraded":"2023-11-13T11:29:58.007895+0000","last_fullsized":"2023-11-13T11:29:58.007895+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-13T11:29:56.100939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-13T11:29:56.100939+0000","last_clean_scrub_stamp":"2023-11-13T11:29:56.100939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-14T15:19:54.300012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-13T11:29:58.007881+0000","last_change":"2023-11-13T11:29:56.646127+0000","last_active":"2023-11-13T11:29:58.007881+0000","last_peered":"2023-11-13T11:29:58.007881+0000","last_clean":"2023-11-13T11:29:58.007881+0000","last_became_active":"2023-11-13T11:29:56.645832+0000","last_became_peered":"2023-11-13T11:29:56.645832+0000","last_unstale":"2023-11-13T11:29:58.007881+0000","last_undegraded":"2023-11-13T11:29:58.007881+0000","last_fullsized":"2023-11-13T11:29:58.007881+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-13T11:29:56.100939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-13T11:29:56.100939+0000","last_clean_scrub_stamp":"2023-11-13T11:29:56.100939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-14T15:51:57.260172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-13T11:29:57.628440+0000","last_change":"2023-11-13T11:29:56.652998+0000","last_active":"2023-11-13T11:29:57.628440+0000","last_peered":"2023-11-13T11:29:57.628440+0000","last_clean":"2023-11-13T11:29:57.628440+0000","last_became_active":"2023-11-13T11:29:56.652730+0000","last_became_peered":"2023-11-13T11:29:56.652730+0000","last_unstale":"2023-11-13T11:29:57.628440+0000","last_undegraded":"2023-11-13T11:29:57.628440+0000","last_fullsized":"2023-11-13T11:29:57.628440+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-13T11:29:56.100939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-13T11:29:56.100939+0000","last_clean_scrub_stamp":"2023-11-13T11:29:56.100939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-14T20:51:46.721526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-13T11:29:57.633212+0000","last_change":"2023-11-13T11:29:56.652981+0000","last_active":"2023-11-13T11:29:57.633212+0000","last_peered":"2023-11-13T11:29:57.633212+0000","last_clean":"2023-11-13T11:29:57.633212+0000","last_became_active":"2023-11-13T11:29:56.652698+0000","last_became_peered":"2023-11-13T11:29:56.652698+0000","last_unstale":"2023-11-13T11:29:57.633212+0000","last_undegraded":"2023-11-13T11:29:57.633212+0000","last_fullsized":"2023-11-13T11:29:57.633212+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-13T11:29:56.100939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-13T11:29:56.100939+0000","last_clean_scrub_stamp":"2023-11-13T11:29:56.100939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-14T15:12:20.880081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-13T11:29:57.797894+0000","last_change":"2023-11-13T11:29:56.652698+0000","last_active":"2023-11-13T11:29:57.797894+0000","last_peered":"2023-11-13T11:29:57.797894+0000","last_clean":"2023-11-13T11:29:57.797894+0000","last_became_active":"2023-11-13T11:29:56.652046+0000","last_became_peered":"2023-11-13T11:29:56.652046+0000","last_unstale":"2023-11-13T11:29:57.797894+0000","last_undegraded":"2023-11-13T11:29:57.797894+0000","last_fullsized":"2023-11-13T11:29:57.797894+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-13T11:29:56.100939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-13T11:29:56.100939+0000","last_clean_scrub_stamp":"2023-11-13T11:29:56.100939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-14T21:46:13.496607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-13T11:29:57.628301+0000","last_change":"2023-11-13T11:29:56.634704+0000","last_active":"2023-11-13T11:29:57.628301+0000","last_peered":"2023-11-13T11:29:57.628301+0000","last_clean":"2023-11-13T11:29:57.628301+0000","last_became_active":"2023-11-13T11:29:56.631581+0000","last_became_peered":"2023-11-13T11:29:56.631581+0000","last_unstale":"2023-11-13T11:29:57.628301+0000","last_undegraded":"2023-11-13T11:29:57.628301+0000","last_fullsized":"2023-11-13T11:29:57.628301+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-13T11:29:56.100939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-13T11:29:56.100939+0000","last_clean_scrub_stamp":"2023-11-13T11:29:56.100939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-14T21:54:04.224470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-13T11:29:57.983009+0000","last_change":"2023-11-13T11:29:56.656157+0000","last_active":"2023-11-13T11:29:57.983009+0000","last_peered":"2023-11-13T11:29:57.983009+0000","last_clean":"2023-11-13T11:29:57.983009+0000","last_became_active":"2023-11-13T11:29:56.655842+0000","last_became_peered":"2023-11-13T11:29:56.655842+0000","last_unstale":"2023-11-13T11:29:57.983009+0000","last_undegraded":"2023-11-13T11:29:57.983009+0000","last_fullsized":"2023-11-13T11:29:57.983009+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-13T11:29:56.100939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-13T11:29:56.100939+0000","last_clean_scrub_stamp":"2023-11-13T11:29:56.100939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-14T12:57:15.751399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-13T11:29:57.632599+0000","last_change":"2023-11-13T11:29:56.652024+0000","last_active":"2023-11-13T11:29:57.632599+0000","last_peered":"2023-11-13T11:29:57.632599+0000","last_clean":"2023-11-13T11:29:57.632599+0000","last_became_active":"2023-11-13T11:29:56.651727+0000","last_became_peered":"2023-11-13T11:29:56.651727+0000","last_unstale":"2023-11-13T11:29:57.632599+0000","last_undegraded":"2023-11-13T11:29:57.632599+0000","last_fullsized":"2023-11-13T11:29:57.632599+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-13T11:29:56.100939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-13T11:29:56.100939+0000","last_clean_scrub_stamp":"2023-11-13T11:29:56.100939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-14T14:40:28.997511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-13T11:29:58.898395+0000","last_change":"2023-11-13T11:29:56.643726+0000","last_active":"2023-11-13T11:29:58.898395+0000","last_peered":"2023-11-13T11:29:58.898395+0000","last_clean":"2023-11-13T11:29:58.898395+0000","last_became_active":"2023-11-13T11:29:56.643327+0000","last_became_peered":"2023-11-13T11:29:56.643327+0000","last_unstale":"2023-11-13T11:29:58.898395+0000","last_undegraded":"2023-11-13T11:29:58.898395+0000","last_fullsized":"2023-11-13T11:29:58.898395+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-13T11:29:56.100939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-13T11:29:56.100939+0000","last_clean_scrub_stamp":"2023-11-13T11:29:56.100939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-14T14:40:28.997511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-13T11:29:58.898399+0000","last_change":"2023-11-13T11:29:56.642763+0000","last_active":"2023-11-13T11:29:58.898399+0000","last_peered":"2023-11-13T11:29:58.898399+0000","last_clean":"2023-11-13T11:29:58.898399+0000","last_became_active":"2023-11-13T11:29:56.642414+0000","last_became_peered":"2023-11-13T11:29:56.642414+0000","last_unstale":"2023-11-13T11:29:58.898399+0000","last_undegraded":"2023-11-13T11:29:58.898399+0000","last_fullsized":"2023-11-13T11:29:58.898399+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-13T11:29:56.100939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-13T11:29:56.100939+0000","last_clean_scrub_stamp":"2023-11-13T11:29:56.100939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-14T16:23:20.155271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-13T11:29:57.798167+0000","last_change":"2023-11-13T11:29:56.643684+0000","last_active":"2023-11-13T11:29:57.798167+0000","last_peered":"2023-11-13T11:29:57.798167+0000","last_clean":"2023-11-13T11:29:57.798167+0000","last_became_active":"2023-11-13T11:29:56.641077+0000","last_became_peered":"2023-11-13T11:29:56.641077+0000","last_unstale":"2023-11-13T11:29:57.798167+0000","last_undegraded":"2023-11-13T11:29:57.798167+0000","last_fullsized":"2023-11-13T11:29:57.798167+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-13T11:29:56.100939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-13T11:29:56.100939+0000","last_clean_scrub_stamp":"2023-11-13T11:29:56.100939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-14T12:12:20.901983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-13T11:29:57.632641+0000","last_change":"2023-11-13T11:29:56.648623+0000","last_active":"2023-11-13T11:29:57.632641+0000","last_peered":"2023-11-13T11:29:57.632641+0000","last_clean":"2023-11-13T11:29:57.632641+0000","last_became_active":"2023-11-13T11:29:56.648311+0000","last_became_peered":"2023-11-13T11:29:56.648311+0000","last_unstale":"2023-11-13T11:29:57.632641+0000","last_undegraded":"2023-11-13T11:29:57.632641+0000","last_fullsized":"2023-11-13T11:29:57.632641+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-13T11:29:56.100939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-13T11:29:56.100939+0000","last_clean_scrub_stamp":"2023-11-13T11:29:56.100939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-14T22:59:20.771927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-13T11:29:57.632441+0000","last_change":"2023-11-13T11:29:56.647775+0000","last_active":"2023-11-13T11:29:57.632441+0000","last_peered":"2023-11-13T11:29:57.632441+0000","last_clean":"2023-11-13T11:29:57.632441+0000","last_became_active":"2023-11-13T11:29:56.646835+0000","last_became_peered":"2023-11-13T11:29:56.646835+0000","last_unstale":"2023-11-13T11:29:57.632441+0000","last_undegraded":"2023-11-13T11:29:57.632441+0000","last_fullsized":"2023-11-13T11:29:57.632441+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-13T11:29:56.100939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-13T11:29:56.100939+0000","last_clean_scrub_stamp":"2023-11-13T11:29:56.100939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-14T19:17:15.234382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-13T11:29:57.983162+0000","last_change":"2023-11-13T11:29:56.637148+0000","last_active":"2023-11-13T11:29:57.983162+0000","last_peered":"2023-11-13T11:29:57.983162+0000","last_clean":"2023-11-13T11:29:57.983162+0000","last_became_active":"2023-11-13T11:29:56.633775+0000","last_became_peered":"2023-11-13T11:29:56.633775+0000","last_unstale":"2023-11-13T11:29:57.983162+0000","last_undegraded":"2023-11-13T11:29:57.983162+0000","last_fullsized":"2023-11-13T11:29:57.983162+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-13T11:29:56.100939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-13T11:29:56.100939+0000","last_clean_scrub_stamp":"2023-11-13T11:29:56.100939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-14T20:50:51.787224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-13T11:29:58.898800+0000","last_change":"2023-11-13T11:29:56.631437+0000","last_active":"2023-11-13T11:29:58.898800+0000","last_peered":"2023-11-13T11:29:58.898800+0000","last_clean":"2023-11-13T11:29:58.898800+0000","last_became_active":"2023-11-13T11:29:56.631127+0000","last_became_peered":"2023-11-13T11:29:56.631127+0000","last_unstale":"2023-11-13T11:29:58.898800+0000","last_undegraded":"2023-11-13T11:29:58.898800+0000","last_fullsized":"2023-11-13T11:29:58.898800+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-13T11:29:56.100939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-13T11:29:56.100939+0000","last_clean_scrub_stamp":"2023-11-13T11:29:56.100939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-14T18:15:57.792911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-13T11:29:58.007878+0000","last_change":"2023-11-13T11:29:56.650430+0000","last_active":"2023-11-13T11:29:58.007878+0000","last_peered":"2023-11-13T11:29:58.007878+0000","last_clean":"2023-11-13T11:29:58.007878+0000","last_became_active":"2023-11-13T11:29:56.650131+0000","last_became_peered":"2023-11-13T11:29:56.650131+0000","last_unstale":"2023-11-13T11:29:58.007878+0000","last_undegraded":"2023-11-13T11:29:58.007878+0000","last_fullsized":"2023-11-13T11:29:58.007878+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-13T11:29:56.100939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-13T11:29:56.100939+0000","last_clean_scrub_stamp":"2023-11-13T11:29:56.100939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-14T20:50:51.787224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-13T11:29:57.982712+0000","last_change":"2023-11-13T11:29:56.637510+0000","last_active":"2023-11-13T11:29:57.982712+0000","last_peered":"2023-11-13T11:29:57.982712+0000","last_clean":"2023-11-13T11:29:57.982712+0000","last_became_active":"2023-11-13T11:29:56.636616+0000","last_became_peered":"2023-11-13T11:29:56.636616+0000","last_unstale":"2023-11-13T11:29:57.982712+0000","last_undegraded":"2023-11-13T11:29:57.982712+0000","last_fullsized":"2023-11-13T11:29:57.982712+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-13T11:29:56.100939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-13T11:29:56.100939+0000","last_clean_scrub_stamp":"2023-11-13T11:29:56.100939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-14T15:04:46.347040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-13T11:29:58.007880+0000","last_change":"2023-11-13T11:29:56.655252+0000","last_active":"2023-11-13T11:29:58.007880+0000","last_peered":"2023-11-13T11:29:58.007880+0000","last_clean":"2023-11-13T11:29:58.007880+0000","last_became_active":"2023-11-13T11:29:56.654824+0000","last_became_peered":"2023-11-13T11:29:56.654824+0000","last_unstale":"2023-11-13T11:29:58.007880+0000","last_undegraded":"2023-11-13T11:29:58.007880+0000","last_fullsized":"2023-11-13T11:29:58.007880+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-13T11:29:56.100939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-13T11:29:56.100939+0000","last_clean_scrub_stamp":"2023-11-13T11:29:56.100939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-14T12:57:15.751399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-13T11:29:57.633347+0000","last_change":"2023-11-13T11:29:56.652650+0000","last_active":"2023-11-13T11:29:57.633347+0000","last_peered":"2023-11-13T11:29:57.633347+0000","last_clean":"2023-11-13T11:29:57.633347+0000","last_became_active":"2023-11-13T11:29:56.652341+0000","last_became_peered":"2023-11-13T11:29:56.652341+0000","last_unstale":"2023-11-13T11:29:57.633347+0000","last_undegraded":"2023-11-13T11:29:57.633347+0000","last_fullsized":"2023-11-13T11:29:57.633347+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-13T11:29:56.100939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-13T11:29:56.100939+0000","last_clean_scrub_stamp":"2023-11-13T11:29:56.100939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-14T13:42:48.610968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-13T11:29:57.633264+0000","last_change":"2023-11-13T11:29:56.650527+0000","last_active":"2023-11-13T11:29:57.633264+0000","last_peered":"2023-11-13T11:29:57.633264+0000","last_clean":"2023-11-13T11:29:57.633264+0000","last_became_active":"2023-11-13T11:29:56.650240+0000","last_became_peered":"2023-11-13T11:29:56.650240+0000","last_unstale":"2023-11-13T11:29:57.633264+0000","last_undegraded":"2023-11-13T11:29:57.633264+0000","last_fullsized":"2023-11-13T11:29:57.633264+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-13T11:29:56.100939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-13T11:29:56.100939+0000","last_clean_scrub_stamp":"2023-11-13T11:29:56.100939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-14T18:15:57.792911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-13T11:29:58.899071+0000","last_change":"2023-11-13T11:29:56.631774+0000","last_active":"2023-11-13T11:29:58.899071+0000","last_peered":"2023-11-13T11:29:58.899071+0000","last_clean":"2023-11-13T11:29:58.899071+0000","last_became_active":"2023-11-13T11:29:56.630884+0000","last_became_peered":"2023-11-13T11:29:56.630884+0000","last_unstale":"2023-11-13T11:29:58.899071+0000","last_undegraded":"2023-11-13T11:29:58.899071+0000","last_fullsized":"2023-11-13T11:29:58.899071+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-13T11:29:56.100939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-13T11:29:56.100939+0000","last_clean_scrub_stamp":"2023-11-13T11:29:56.100939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-14T19:14:32.577711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-13T11:29:58.008207+0000","last_change":"2023-11-13T11:29:56.646415+0000","last_active":"2023-11-13T11:29:58.008207+0000","last_peered":"2023-11-13T11:29:58.008207+0000","last_clean":"2023-11-13T11:29:58.008207+0000","last_became_active":"2023-11-13T11:29:56.645851+0000","last_became_peered":"2023-11-13T11:29:56.645851+0000","last_unstale":"2023-11-13T11:29:58.008207+0000","last_undegraded":"2023-11-13T11:29:58.008207+0000","last_fullsized":"2023-11-13T11:29:58.008207+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-13T11:29:56.100939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-13T11:29:56.100939+0000","last_clean_scrub_stamp":"2023-11-13T11:29:56.100939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-14T16:23:20.155271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-13T11:29:58.898593+0000","last_change":"2023-11-13T11:29:56.655431+0000","last_active":"2023-11-13T11:29:58.898593+0000","last_peered":"2023-11-13T11:29:58.898593+0000","last_clean":"2023-11-13T11:29:58.898593+0000","last_became_active":"2023-11-13T11:29:56.655111+0000","last_became_peered":"2023-11-13T11:29:56.655111+0000","last_unstale":"2023-11-13T11:29:58.898593+0000","last_undegraded":"2023-11-13T11:29:58.898593+0000","last_fullsized":"2023-11-13T11:29:58.898593+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-13T11:29:56.100939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-13T11:29:56.100939+0000","last_clean_scrub_stamp":"2023-11-13T11:29:56.100939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-14T17:12:32.904334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-13T11:29:58.898423+0000","last_change":"2023-11-13T11:29:56.632434+0000","last_active":"2023-11-13T11:29:58.898423+0000","last_peered":"2023-11-13T11:29:58.898423+0000","last_clean":"2023-11-13T11:29:58.898423+0000","last_became_active":"2023-11-13T11:29:56.632186+0000","last_became_peered":"2023-11-13T11:29:56.632186+0000","last_unstale":"2023-11-13T11:29:58.898423+0000","last_undegraded":"2023-11-13T11:29:58.898423+0000","last_fullsized":"2023-11-13T11:29:58.898423+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-13T11:29:56.100939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-13T11:29:56.100939+0000","last_clean_scrub_stamp":"2023-11-13T11:29:56.100939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-14T22:42:29.649952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-13T11:29:58.007929+0000","last_change":"2023-11-13T11:29:56.645411+0000","last_active":"2023-11-13T11:29:58.007929+0000","last_peered":"2023-11-13T11:29:58.007929+0000","last_clean":"2023-11-13T11:29:58.007929+0000","last_became_active":"2023-11-13T11:29:56.644539+0000","last_became_peered":"2023-11-13T11:29:56.644539+0000","last_unstale":"2023-11-13T11:29:58.007929+0000","last_undegraded":"2023-11-13T11:29:58.007929+0000","last_fullsized":"2023-11-13T11:29:58.007929+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-13T11:29:56.100939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-13T11:29:56.100939+0000","last_clean_scrub_stamp":"2023-11-13T11:29:56.100939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-14T14:17:53.387282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-13T11:29:57.797579+0000","last_change":"2023-11-13T11:29:56.641361+0000","last_active":"2023-11-13T11:29:57.797579+0000","last_peered":"2023-11-13T11:29:57.797579+0000","last_clean":"2023-11-13T11:29:57.797579+0000","last_became_active":"2023-11-13T11:29:56.641052+0000","last_became_peered":"2023-11-13T11:29:56.641052+0000","last_unstale":"2023-11-13T11:29:57.797579+0000","last_undegraded":"2023-11-13T11:29:57.797579+0000","last_fullsized":"2023-11-13T11:29:57.797579+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-13T11:29:56.100939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-13T11:29:56.100939+0000","last_clean_scrub_stamp":"2023-11-13T11:29:56.100939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-14T19:17:37.763288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-13T11:29:57.983246+0000","last_change":"2023-11-13T11:29:56.632618+0000","last_active":"2023-11-13T11:29:57.983246+0000","last_peered":"2023-11-13T11:29:57.983246+0000","last_clean":"2023-11-13T11:29:57.983246+0000","last_became_active":"2023-11-13T11:29:56.632221+0000","last_became_peered":"2023-11-13T11:29:56.632221+0000","last_unstale":"2023-11-13T11:29:57.983246+0000","last_undegraded":"2023-11-13T11:29:57.983246+0000","last_fullsized":"2023-11-13T11:29:57.983246+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-13T11:29:56.100939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-13T11:29:56.100939+0000","last_clean_scrub_stamp":"2023-11-13T11:29:56.100939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-14T15:51:57.260172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1f","version":"35'4","reported_seq":16,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-13T11:29:57.798252+0000","last_change":"2023-11-13T11:29:56.139915+0000","last_active":"2023-11-13T11:29:57.798252+0000","last_peered":"2023-11-13T11:29:57.798252+0000","last_clean":"2023-11-13T11:29:57.798252+0000","last_became_active":"2023-11-13T11:29:56.139383+0000","last_became_peered":"2023-11-13T11:29:56.139383+0000","last_unstale":"2023-11-13T11:29:57.798252+0000","last_undegraded":"2023-11-13T11:29:57.798252+0000","last_fullsized":"2023-11-13T11:29:57.798252+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-13T11:29:55.092850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-13T11:29:55.092850+0000","last_clean_scrub_stamp":"2023-11-13T11:29:55.092850+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-14T20:38:30.675223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-13T11:29:58.008335+0000","last_change":"2023-11-13T11:29:56.641371+0000","last_active":"2023-11-13T11:29:58.008335+0000","last_peered":"2023-11-13T11:29:58.008335+0000","last_clean":"2023-11-13T11:29:58.008335+0000","last_became_active":"2023-11-13T11:29:56.641060+0000","last_became_peered":"2023-11-13T11:29:56.641060+0000","last_unstale":"2023-11-13T11:29:58.008335+0000","last_undegraded":"2023-11-13T11:29:58.008335+0000","last_fullsized":"2023-11-13T11:29:58.008335+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-13T11:29:56.100939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-13T11:29:56.100939+0000","last_clean_scrub_stamp":"2023-11-13T11:29:56.100939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-14T17:12:32.904334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1e","version":"35'1","reported_seq":13,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-13T11:29:57.633351+0000","last_change":"2023-11-13T11:29:56.143114+0000","last_active":"2023-11-13T11:29:57.633351+0000","last_peered":"2023-11-13T11:29:57.633351+0000","last_clean":"2023-11-13T11:29:57.633351+0000","last_became_active":"2023-11-13T11:29:56.142821+0000","last_became_peered":"2023-11-13T11:29:56.142821+0000","last_unstale":"2023-11-13T11:29:57.633351+0000","last_undegraded":"2023-11-13T11:29:57.633351+0000","last_fullsized":"2023-11-13T11:29:57.633351+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-13T11:29:55.092850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-13T11:29:55.092850+0000","last_clean_scrub_stamp":"2023-11-13T11:29:55.092850+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-14T15:19:53.291923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-13T11:29:58.008317+0000","last_change":"2023-11-13T11:29:56.651750+0000","last_active":"2023-11-13T11:29:58.008317+0000","last_peered":"2023-11-13T11:29:58.008317+0000","last_clean":"2023-11-13T11:29:58.008317+0000","last_became_active":"2023-11-13T11:29:56.651520+0000","last_became_peered":"2023-11-13T11:29:56.651520+0000","last_unstale":"2023-11-13T11:29:58.008317+0000","last_undegraded":"2023-11-13T11:29:58.008317+0000","last_fullsized":"2023-11-13T11:29:58.008317+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-13T11:29:56.100939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-13T11:29:56.100939+0000","last_clean_scrub_stamp":"2023-11-13T11:29:56.100939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-14T14:07:14.129755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1d","version":"35'2","reported_seq":14,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-13T11:29:57.632676+0000","last_change":"2023-11-13T11:29:56.135619+0000","last_active":"2023-11-13T11:29:57.632676+0000","last_peered":"2023-11-13T11:29:57.632676+0000","last_clean":"2023-11-13T11:29:57.632676+0000","last_became_active":"2023-11-13T11:29:56.134105+0000","last_became_peered":"2023-11-13T11:29:56.134105+0000","last_unstale":"2023-11-13T11:29:57.632676+0000","last_undegraded":"2023-11-13T11:29:57.632676+0000","last_fullsized":"2023-11-13T11:29:57.632676+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-13T11:29:55.092850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-13T11:29:55.092850+0000","last_clean_scrub_stamp":"2023-11-13T11:29:55.092850+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-14T21:01:05.249630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-13T11:29:57.633294+0000","last_change":"2023-11-13T11:29:56.652089+0000","last_active":"2023-11-13T11:29:57.633294+0000","last_peered":"2023-11-13T11:29:57.633294+0000","last_clean":"2023-11-13T11:29:57.633294+0000","last_became_active":"2023-11-13T11:29:56.651787+0000","last_became_peered":"2023-11-13T11:29:56.651787+0000","last_unstale":"2023-11-13T11:29:57.633294+0000","last_undegraded":"2023-11-13T11:29:57.633294+0000","last_fullsized":"2023-11-13T11:29:57.633294+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-13T11:29:56.100939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-13T11:29:56.100939+0000","last_clean_scrub_stamp":"2023-11-13T11:29:56.100939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-14T19:14:32.577711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"35'2","reported_seq":14,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-13T11:29:57.633131+0000","last_change":"2023-11-13T11:29:56.140158+0000","last_active":"2023-11-13T11:29:57.633131+0000","last_peered":"2023-11-13T11:29:57.633131+0000","last_clean":"2023-11-13T11:29:57.633131+0000","last_became_active":"2023-11-13T11:29:56.139725+0000","last_became_peered":"2023-11-13T11:29:56.139725+0000","last_unstale":"2023-11-13T11:29:57.633131+0000","last_undegraded":"2023-11-13T11:29:57.633131+0000","last_fullsized":"2023-11-13T11:29:57.633131+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-13T11:29:55.092850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-13T11:29:55.092850+0000","last_clean_scrub_stamp":"2023-11-13T11:29:55.092850+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-14T15:51:56.252083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-13T11:29:57.628161+0000","last_change":"2023-11-13T11:29:56.650525+0000","last_active":"2023-11-13T11:29:57.628161+0000","last_peered":"2023-11-13T11:29:57.628161+0000","last_clean":"2023-11-13T11:29:57.628161+0000","last_became_active":"2023-11-13T11:29:56.650212+0000","last_became_peered":"2023-11-13T11:29:56.650212+0000","last_unstale":"2023-11-13T11:29:57.628161+0000","last_undegraded":"2023-11-13T11:29:57.628161+0000","last_fullsized":"2023-11-13T11:29:57.628161+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-13T11:29:56.100939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-13T11:29:56.100939+0000","last_clean_scrub_stamp":"2023-11-13T11:29:56.100939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-14T22:53:53.304240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"35'1","reported_seq":13,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-13T11:29:58.008105+0000","last_change":"2023-11-13T11:29:56.137809+0000","last_active":"2023-11-13T11:29:58.008105+0000","last_peered":"2023-11-13T11:29:58.008105+0000","last_clean":"2023-11-13T11:29:58.008105+0000","last_became_active":"2023-11-13T11:29:56.137499+0000","last_became_peered":"2023-11-13T11:29:56.137499+0000","last_unstale":"2023-11-13T11:29:58.008105+0000","last_undegraded":"2023-11-13T11:29:58.008105+0000","last_fullsized":"2023-11-13T11:29:58.008105+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-13T11:29:55.092850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-13T11:29:55.092850+0000","last_clean_scrub_stamp":"2023-11-13T11:29:55.092850+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-14T22:15:05.936409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-13T11:29:58.008086+0000","last_change":"2023-11-13T11:29:56.646426+0000","last_active":"2023-11-13T11:29:58.008086+0000","last_peered":"2023-11-13T11:29:58.008086+0000","last_clean":"2023-11-13T11:29:58.008086+0000","last_became_active":"2023-11-13T11:29:56.646182+0000","last_became_peered":"2023-11-13T11:29:56.646182+0000","last_unstale":"2023-11-13T11:29:58.008086+0000","last_undegraded":"2023-11-13T11:29:58.008086+0000","last_fullsized":"2023-11-13T11:29:58.008086+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-13T11:29:56.100939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-13T11:29:56.100939+0000","last_clean_scrub_stamp":"2023-11-13T11:29:56.100939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-14T14:40:28.997511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1a","version":"35'1","reported_seq":13,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-13T11:29:58.008011+0000","last_change":"2023-11-13T11:29:56.129939+0000","last_active":"2023-11-13T11:29:58.008011+0000","last_peered":"2023-11-13T11:29:58.008011+0000","last_clean":"2023-11-13T11:29:58.008011+0000","last_became_active":"2023-11-13T11:29:56.129589+0000","last_became_peered":"2023-11-13T11:29:56.129589+0000","last_unstale":"2023-11-13T11:29:58.008011+0000","last_undegraded":"2023-11-13T11:29:58.008011+0000","last_fullsized":"2023-11-13T11:29:58.008011+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-13T11:29:55.092850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-13T11:29:55.092850+0000","last_clean_scrub_stamp":"2023-11-13T11:29:55.092850+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-14T21:56:12.389066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-13T11:29:57.628084+0000","last_change":"2023-11-13T11:29:56.629954+0000","last_active":"2023-11-13T11:29:57.628084+0000","last_peered":"2023-11-13T11:29:57.628084+0000","last_clean":"2023-11-13T11:29:57.628084+0000","last_became_active":"2023-11-13T11:29:56.629690+0000","last_became_peered":"2023-11-13T11:29:56.629690+0000","last_unstale":"2023-11-13T11:29:57.628084+0000","last_undegraded":"2023-11-13T11:29:57.628084+0000","last_fullsized":"2023-11-13T11:29:57.628084+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-13T11:29:56.100939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-13T11:29:56.100939+0000","last_clean_scrub_stamp":"2023-11-13T11:29:56.100939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-14T13:31:55.774316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-13T11:29:57.632065+0000","last_change":"2023-11-13T11:29:56.137023+0000","last_active":"2023-11-13T11:29:57.632065+0000","last_peered":"2023-11-13T11:29:57.632065+0000","last_clean":"2023-11-13T11:29:57.632065+0000","last_became_active":"2023-11-13T11:29:56.134237+0000","last_became_peered":"2023-11-13T11:29:56.134237+0000","last_unstale":"2023-11-13T11:29:57.632065+0000","last_undegraded":"2023-11-13T11:29:57.632065+0000","last_fullsized":"2023-11-13T11:29:57.632065+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-13T11:29:55.092850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-13T11:29:55.092850+0000","last_clean_scrub_stamp":"2023-11-13T11:29:55.092850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-14T12:30:21.023677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-13T11:29:57.632389+0000","last_change":"2023-11-13T11:29:56.653360+0000","last_active":"2023-11-13T11:29:57.632389+0000","last_peered":"2023-11-13T11:29:57.632389+0000","last_clean":"2023-11-13T11:29:57.632389+0000","last_became_active":"2023-11-13T11:29:56.653019+0000","last_became_peered":"2023-11-13T11:29:56.653019+0000","last_unstale":"2023-11-13T11:29:57.632389+0000","last_undegraded":"2023-11-13T11:29:57.632389+0000","last_fullsized":"2023-11-13T11:29:57.632389+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-13T11:29:56.100939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-13T11:29:56.100939+0000","last_clean_scrub_stamp":"2023-11-13T11:29:56.100939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-14T20:58:00.300912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-13T11:29:58.007978+0000","last_change":"2023-11-13T11:29:56.131213+0000","last_active":"2023-11-13T11:29:58.007978+0000","last_peered":"2023-11-13T11:29:58.007978+0000","last_clean":"2023-11-13T11:29:58.007978+0000","last_became_active":"2023-11-13T11:29:56.129270+0000","last_became_peered":"2023-11-13T11:29:56.129270+0000","last_unstale":"2023-11-13T11:29:58.007978+0000","last_undegraded":"2023-11-13T11:29:58.007978+0000","last_fullsized":"2023-11-13T11:29:58.007978+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-13T11:29:55.092850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-13T11:29:55.092850+0000","last_clean_scrub_stamp":"2023-11-13T11:29:55.092850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-14T23:27:05.058467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-13T11:29:57.798087+0000","last_change":"2023-11-13T11:29:56.631250+0000","last_active":"2023-11-13T11:29:57.798087+0000","last_peered":"2023-11-13T11:29:57.798087+0000","last_clean":"2023-11-13T11:29:57.798087+0000","last_became_active":"2023-11-13T11:29:56.630965+0000","last_became_peered":"2023-11-13T11:29:56.630965+0000","last_unstale":"2023-11-13T11:29:57.798087+0000","last_undegraded":"2023-11-13T11:29:57.798087+0000","last_fullsized":"2023-11-13T11:29:57.798087+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-13T11:29:56.100939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-13T11:29:56.100939+0000","last_clean_scrub_stamp":"2023-11-13T11:29:56.100939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-14T19:41:10.789843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-13T11:29:58.899235+0000","last_change":"2023-11-13T11:29:56.142096+0000","last_active":"2023-11-13T11:29:58.899235+0000","last_peered":"2023-11-13T11:29:58.899235+0000","last_clean":"2023-11-13T11:29:58.899235+0000","last_became_active":"2023-11-13T11:29:56.141723+0000","last_became_peered":"2023-11-13T11:29:56.141723+0000","last_unstale":"2023-11-13T11:29:58.899235+0000","last_undegraded":"2023-11-13T11:29:58.899235+0000","last_fullsized":"2023-11-13T11:29:58.899235+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-13T11:29:55.092850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-13T11:29:55.092850+0000","last_clean_scrub_stamp":"2023-11-13T11:29:55.092850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-14T14:07:13.121666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-13T11:29:57.633388+0000","last_change":"2023-11-13T11:29:56.652726+0000","last_active":"2023-11-13T11:29:57.633388+0000","last_peered":"2023-11-13T11:29:57.633388+0000","last_clean":"2023-11-13T11:29:57.633388+0000","last_became_active":"2023-11-13T11:29:56.652062+0000","last_became_peered":"2023-11-13T11:29:56.652062+0000","last_unstale":"2023-11-13T11:29:57.633388+0000","last_undegraded":"2023-11-13T11:29:57.633388+0000","last_fullsized":"2023-11-13T11:29:57.633388+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-13T11:29:56.100939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-13T11:29:56.100939+0000","last_clean_scrub_stamp":"2023-11-13T11:29:56.100939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-14T17:39:54.996192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-13T11:29:58.899215+0000","last_change":"2023-11-13T11:29:56.138917+0000","last_active":"2023-11-13T11:29:58.899215+0000","last_peered":"2023-11-13T11:29:58.899215+0000","last_clean":"2023-11-13T11:29:58.899215+0000","last_became_active":"2023-11-13T11:29:56.138391+0000","last_became_peered":"2023-11-13T11:29:56.138391+0000","last_unstale":"2023-11-13T11:29:58.899215+0000","last_undegraded":"2023-11-13T11:29:58.899215+0000","last_fullsized":"2023-11-13T11:29:58.899215+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-13T11:29:55.092850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-13T11:29:55.092850+0000","last_clean_scrub_stamp":"2023-11-13T11:29:55.092850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-14T16:23:19.147182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-13T11:29:57.633062+0000","last_change":"2023-11-13T11:29:56.651230+0000","last_active":"2023-11-13T11:29:57.633062+0000","last_peered":"2023-11-13T11:29:57.633062+0000","last_clean":"2023-11-13T11:29:57.633062+0000","last_became_active":"2023-11-13T11:29:56.650853+0000","last_became_peered":"2023-11-13T11:29:56.650853+0000","last_unstale":"2023-11-13T11:29:57.633062+0000","last_undegraded":"2023-11-13T11:29:57.633062+0000","last_fullsized":"2023-11-13T11:29:57.633062+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-13T11:29:56.100939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-13T11:29:56.100939+0000","last_clean_scrub_stamp":"2023-11-13T11:29:56.100939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-14T17:12:32.904334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.15","version":"35'3","reported_seq":15,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-13T11:29:57.797852+0000","last_change":"2023-11-13T11:29:56.143808+0000","last_active":"2023-11-13T11:29:57.797852+0000","last_peered":"2023-11-13T11:29:57.797852+0000","last_clean":"2023-11-13T11:29:57.797852+0000","last_became_active":"2023-11-13T11:29:56.143467+0000","last_became_peered":"2023-11-13T11:29:56.143467+0000","last_unstale":"2023-11-13T11:29:57.797852+0000","last_undegraded":"2023-11-13T11:29:57.797852+0000","last_fullsized":"2023-11-13T11:29:57.797852+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-13T11:29:55.092850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-13T11:29:55.092850+0000","last_clean_scrub_stamp":"2023-11-13T11:29:55.092850+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-14T13:42:47.602879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-13T11:29:57.797773+0000","last_change":"2023-11-13T11:29:56.652383+0000","last_active":"2023-11-13T11:29:57.797773+0000","last_peered":"2023-11-13T11:29:57.797773+0000","last_clean":"2023-11-13T11:29:57.797773+0000","last_became_active":"2023-11-13T11:29:56.652056+0000","last_became_peered":"2023-11-13T11:29:56.652056+0000","last_unstale":"2023-11-13T11:29:57.797773+0000","last_undegraded":"2023-11-13T11:29:57.797773+0000","last_fullsized":"2023-11-13T11:29:57.797773+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-13T11:29:56.100939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-13T11:29:56.100939+0000","last_clean_scrub_stamp":"2023-11-13T11:29:56.100939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-14T16:10:06.244630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"35'6","reported_seq":18,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-13T11:29:57.983187+0000","last_change":"2023-11-13T11:29:56.142186+0000","last_active":"2023-11-13T11:29:57.983187+0000","last_peered":"2023-11-13T11:29:57.983187+0000","last_clean":"2023-11-13T11:29:57.983187+0000","last_became_active":"2023-11-13T11:29:56.137746+0000","last_became_peered":"2023-11-13T11:29:56.137746+0000","last_unstale":"2023-11-13T11:29:57.983187+0000","last_undegraded":"2023-11-13T11:29:57.983187+0000","last_fullsized":"2023-11-13T11:29:57.983187+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-13T11:29:55.092850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-13T11:29:55.092850+0000","last_clean_scrub_stamp":"2023-11-13T11:29:55.092850+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-14T22:09:01.172827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-13T11:29:57.982752+0000","last_change":"2023-11-13T11:29:56.637229+0000","last_active":"2023-11-13T11:29:57.982752+0000","last_peered":"2023-11-13T11:29:57.982752+0000","last_clean":"2023-11-13T11:29:57.982752+0000","last_became_active":"2023-11-13T11:29:56.636678+0000","last_became_peered":"2023-11-13T11:29:56.636678+0000","last_unstale":"2023-11-13T11:29:57.982752+0000","last_undegraded":"2023-11-13T11:29:57.982752+0000","last_fullsized":"2023-11-13T11:29:57.982752+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-13T11:29:56.100939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-13T11:29:56.100939+0000","last_clean_scrub_stamp":"2023-11-13T11:29:56.100939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-14T13:40:39.253955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.13","version":"35'2","reported_seq":14,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-13T11:29:58.008173+0000","last_change":"2023-11-13T11:29:56.141412+0000","last_active":"2023-11-13T11:29:58.008173+0000","last_peered":"2023-11-13T11:29:58.008173+0000","last_clean":"2023-11-13T11:29:58.008173+0000","last_became_active":"2023-11-13T11:29:56.140090+0000","last_became_peered":"2023-11-13T11:29:56.140090+0000","last_unstale":"2023-11-13T11:29:58.008173+0000","last_undegraded":"2023-11-13T11:29:58.008173+0000","last_fullsized":"2023-11-13T11:29:58.008173+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-13T11:29:55.092850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-13T11:29:55.092850+0000","last_clean_scrub_stamp":"2023-11-13T11:29:55.092850+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-14T20:22:23.574212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-13T11:29:57.632913+0000","last_change":"2023-11-13T11:29:56.654745+0000","last_active":"2023-11-13T11:29:57.632913+0000","last_peered":"2023-11-13T11:29:57.632913+0000","last_clean":"2023-11-13T11:29:57.632913+0000","last_became_active":"2023-11-13T11:29:56.654336+0000","last_became_peered":"2023-11-13T11:29:56.654336+0000","last_unstale":"2023-11-13T11:29:57.632913+0000","last_undegraded":"2023-11-13T11:29:57.632913+0000","last_fullsized":"2023-11-13T11:29:57.632913+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-13T11:29:56.100939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-13T11:29:56.100939+0000","last_clean_scrub_stamp":"2023-11-13T11:29:56.100939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-14T16:23:20.155271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-13T11:29:57.632635+0000","last_change":"2023-11-13T11:29:56.146156+0000","last_active":"2023-11-13T11:29:57.632635+0000","last_peered":"2023-11-13T11:29:57.632635+0000","last_clean":"2023-11-13T11:29:57.632635+0000","last_became_active":"2023-11-13T11:29:56.145868+0000","last_became_peered":"2023-11-13T11:29:56.145868+0000","last_unstale":"2023-11-13T11:29:57.632635+0000","last_undegraded":"2023-11-13T11:29:57.632635+0000","last_fullsized":"2023-11-13T11:29:57.632635+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-13T11:29:55.092850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-13T11:29:55.092850+0000","last_clean_scrub_stamp":"2023-11-13T11:29:55.092850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-14T20:50:50.779135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-13T11:29:58.008032+0000","last_change":"2023-11-13T11:29:56.639688+0000","last_active":"2023-11-13T11:29:58.008032+0000","last_peered":"2023-11-13T11:29:58.008032+0000","last_clean":"2023-11-13T11:29:58.008032+0000","last_became_active":"2023-11-13T11:29:56.639439+0000","last_became_peered":"2023-11-13T11:29:56.639439+0000","last_unstale":"2023-11-13T11:29:58.008032+0000","last_undegraded":"2023-11-13T11:29:58.008032+0000","last_fullsized":"2023-11-13T11:29:58.008032+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-13T11:29:56.100939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-13T11:29:56.100939+0000","last_clean_scrub_stamp":"2023-11-13T11:29:56.100939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-14T20:58:00.300912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-13T11:29:57.632437+0000","last_change":"2023-11-13T11:29:56.132494+0000","last_active":"2023-11-13T11:29:57.632437+0000","last_peered":"2023-11-13T11:29:57.632437+0000","last_clean":"2023-11-13T11:29:57.632437+0000","last_became_active":"2023-11-13T11:29:56.132181+0000","last_became_peered":"2023-11-13T11:29:56.132181+0000","last_unstale":"2023-11-13T11:29:57.632437+0000","last_undegraded":"2023-11-13T11:29:57.632437+0000","last_fullsized":"2023-11-13T11:29:57.632437+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-13T11:29:55.092850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-13T11:29:55.092850+0000","last_clean_scrub_stamp":"2023-11-13T11:29:55.092850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-14T12:57:14.743310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-13T11:29:57.797598+0000","last_change":"2023-11-13T11:29:56.641918+0000","last_active":"2023-11-13T11:29:57.797598+0000","last_peered":"2023-11-13T11:29:57.797598+0000","last_clean":"2023-11-13T11:29:57.797598+0000","last_became_active":"2023-11-13T11:29:56.641664+0000","last_became_peered":"2023-11-13T11:29:56.641664+0000","last_unstale":"2023-11-13T11:29:57.797598+0000","last_undegraded":"2023-11-13T11:29:57.797598+0000","last_fullsized":"2023-11-13T11:29:57.797598+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-13T11:29:56.100939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-13T11:29:56.100939+0000","last_clean_scrub_stamp":"2023-11-13T11:29:56.100939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-14T18:11:23.250505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"35'8","reported_seq":20,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-13T11:29:57.631835+0000","last_change":"2023-11-13T11:29:56.141314+0000","last_active":"2023-11-13T11:29:57.631835+0000","last_peered":"2023-11-13T11:29:57.631835+0000","last_clean":"2023-11-13T11:29:57.631835+0000","last_became_active":"2023-11-13T11:29:56.141017+0000","last_became_peered":"2023-11-13T11:29:56.141017+0000","last_unstale":"2023-11-13T11:29:57.631835+0000","last_undegraded":"2023-11-13T11:29:57.631835+0000","last_fullsized":"2023-11-13T11:29:57.631835+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-13T11:29:55.092850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-13T11:29:55.092850+0000","last_clean_scrub_stamp":"2023-11-13T11:29:55.092850+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-14T11:34:16.583204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-13T11:29:57.798098+0000","last_change":"2023-11-13T11:29:56.657267+0000","last_active":"2023-11-13T11:29:57.798098+0000","last_peered":"2023-11-13T11:29:57.798098+0000","last_clean":"2023-11-13T11:29:57.798098+0000","last_became_active":"2023-11-13T11:29:56.657010+0000","last_became_peered":"2023-11-13T11:29:56.657010+0000","last_unstale":"2023-11-13T11:29:57.798098+0000","last_undegraded":"2023-11-13T11:29:57.798098+0000","last_fullsized":"2023-11-13T11:29:57.798098+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-13T11:29:56.100939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-13T11:29:56.100939+0000","last_clean_scrub_stamp":"2023-11-13T11:29:56.100939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-14T18:20:49.397646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"35'1","reported_seq":13,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-13T11:29:57.632764+0000","last_change":"2023-11-13T11:29:56.139559+0000","last_active":"2023-11-13T11:29:57.632764+0000","last_peered":"2023-11-13T11:29:57.632764+0000","last_clean":"2023-11-13T11:29:57.632764+0000","last_became_active":"2023-11-13T11:29:56.139195+0000","last_became_peered":"2023-11-13T11:29:56.139195+0000","last_unstale":"2023-11-13T11:29:57.632764+0000","last_undegraded":"2023-11-13T11:29:57.632764+0000","last_fullsized":"2023-11-13T11:29:57.632764+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-13T11:29:55.092850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-13T11:29:55.092850+0000","last_clean_scrub_stamp":"2023-11-13T11:29:55.092850+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-14T18:49:15.716769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-13T11:29:57.628561+0000","last_change":"2023-11-13T11:29:56.635180+0000","last_active":"2023-11-13T11:29:57.628561+0000","last_peered":"2023-11-13T11:29:57.628561+0000","last_clean":"2023-11-13T11:29:57.628561+0000","last_became_active":"2023-11-13T11:29:56.634926+0000","last_became_peered":"2023-11-13T11:29:56.634926+0000","last_unstale":"2023-11-13T11:29:57.628561+0000","last_undegraded":"2023-11-13T11:29:57.628561+0000","last_fullsized":"2023-11-13T11:29:57.628561+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-13T11:29:56.100939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-13T11:29:56.100939+0000","last_clean_scrub_stamp":"2023-11-13T11:29:56.100939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-14T16:23:48.084208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"35'2","reported_seq":14,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-13T11:29:58.008200+0000","last_change":"2023-11-13T11:29:56.146612+0000","last_active":"2023-11-13T11:29:58.008200+0000","last_peered":"2023-11-13T11:29:58.008200+0000","last_clean":"2023-11-13T11:29:58.008200+0000","last_became_active":"2023-11-13T11:29:56.146306+0000","last_became_peered":"2023-11-13T11:29:56.146306+0000","last_unstale":"2023-11-13T11:29:58.008200+0000","last_undegraded":"2023-11-13T11:29:58.008200+0000","last_fullsized":"2023-11-13T11:29:58.008200+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-13T11:29:55.092850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-13T11:29:55.092850+0000","last_clean_scrub_stamp":"2023-11-13T11:29:55.092850+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-14T18:02:37.298150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-13T11:29:58.898955+0000","last_change":"2023-11-13T11:29:56.634621+0000","last_active":"2023-11-13T11:29:58.898955+0000","last_peered":"2023-11-13T11:29:58.898955+0000","last_clean":"2023-11-13T11:29:58.898955+0000","last_became_active":"2023-11-13T11:29:56.634315+0000","last_became_peered":"2023-11-13T11:29:56.634315+0000","last_unstale":"2023-11-13T11:29:58.898955+0000","last_undegraded":"2023-11-13T11:29:58.898955+0000","last_fullsized":"2023-11-13T11:29:58.898955+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-13T11:29:56.100939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-13T11:29:56.100939+0000","last_clean_scrub_stamp":"2023-11-13T11:29:56.100939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-14T18:15:57.792911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.d","version":"35'1","reported_seq":13,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-13T11:29:57.797934+0000","last_change":"2023-11-13T11:29:56.146417+0000","last_active":"2023-11-13T11:29:57.797934+0000","last_peered":"2023-11-13T11:29:57.797934+0000","last_clean":"2023-11-13T11:29:57.797934+0000","last_became_active":"2023-11-13T11:29:56.143698+0000","last_became_peered":"2023-11-13T11:29:56.143698+0000","last_unstale":"2023-11-13T11:29:57.797934+0000","last_undegraded":"2023-11-13T11:29:57.797934+0000","last_fullsized":"2023-11-13T11:29:57.797934+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-13T11:29:55.092850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-13T11:29:55.092850+0000","last_clean_scrub_stamp":"2023-11-13T11:29:55.092850+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-14T17:38:39.693133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-13T11:29:57.632600+0000","last_change":"2023-11-13T11:29:56.646510+0000","last_active":"2023-11-13T11:29:57.632600+0000","last_peered":"2023-11-13T11:29:57.632600+0000","last_clean":"2023-11-13T11:29:57.632600+0000","last_became_active":"2023-11-13T11:29:56.646182+0000","last_became_peered":"2023-11-13T11:29:56.646182+0000","last_unstale":"2023-11-13T11:29:57.632600+0000","last_undegraded":"2023-11-13T11:29:57.632600+0000","last_fullsized":"2023-11-13T11:29:57.632600+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-13T11:29:56.100939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-13T11:29:56.100939+0000","last_clean_scrub_stamp":"2023-11-13T11:29:56.100939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-14T20:38:15.395510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-13T11:29:58.898682+0000","last_change":"2023-11-13T11:29:56.130105+0000","last_active":"2023-11-13T11:29:58.898682+0000","last_peered":"2023-11-13T11:29:58.898682+0000","last_clean":"2023-11-13T11:29:58.898682+0000","last_became_active":"2023-11-13T11:29:56.129821+0000","last_became_peered":"2023-11-13T11:29:56.129821+0000","last_unstale":"2023-11-13T11:29:58.898682+0000","last_undegraded":"2023-11-13T11:29:58.898682+0000","last_fullsized":"2023-11-13T11:29:58.898682+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-13T11:29:55.092850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-13T11:29:55.092850+0000","last_clean_scrub_stamp":"2023-11-13T11:29:55.092850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-14T20:57:59.292823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-13T11:29:57.982813+0000","last_change":"2023-11-13T11:29:56.637028+0000","last_active":"2023-11-13T11:29:57.982813+0000","last_peered":"2023-11-13T11:29:57.982813+0000","last_clean":"2023-11-13T11:29:57.982813+0000","last_became_active":"2023-11-13T11:29:56.636305+0000","last_became_peered":"2023-11-13T11:29:56.636305+0000","last_unstale":"2023-11-13T11:29:57.982813+0000","last_undegraded":"2023-11-13T11:29:57.982813+0000","last_fullsized":"2023-11-13T11:29:57.982813+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-13T11:29:56.100939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-13T11:29:56.100939+0000","last_clean_scrub_stamp":"2023-11-13T11:29:56.100939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-14T13:56:03.506335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.b","version":"35'2","reported_seq":14,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-13T11:29:58.899032+0000","last_change":"2023-11-13T11:29:56.135045+0000","last_active":"2023-11-13T11:29:58.899032+0000","last_peered":"2023-11-13T11:29:58.899032+0000","last_clean":"2023-11-13T11:29:58.899032+0000","last_became_active":"2023-11-13T11:29:56.134764+0000","last_became_peered":"2023-11-13T11:29:56.134764+0000","last_unstale":"2023-11-13T11:29:58.899032+0000","last_undegraded":"2023-11-13T11:29:58.899032+0000","last_fullsized":"2023-11-13T11:29:58.899032+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-13T11:29:55.092850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-13T11:29:55.092850+0000","last_clean_scrub_stamp":"2023-11-13T11:29:55.092850+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-14T20:57:59.292823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-13T11:29:58.898929+0000","last_change":"2023-11-13T11:29:56.642114+0000","last_active":"2023-11-13T11:29:58.898929+0000","last_peered":"2023-11-13T11:29:58.898929+0000","last_clean":"2023-11-13T11:29:58.898929+0000","last_became_active":"2023-11-13T11:29:56.641796+0000","last_became_peered":"2023-11-13T11:29:56.641796+0000","last_unstale":"2023-11-13T11:29:58.898929+0000","last_undegraded":"2023-11-13T11:29:58.898929+0000","last_fullsized":"2023-11-13T11:29:58.898929+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-13T11:29:56.100939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-13T11:29:56.100939+0000","last_clean_scrub_stamp":"2023-11-13T11:29:56.100939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-14T15:12:20.880081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-13T11:29:58.008106+0000","last_change":"2023-11-13T11:29:56.140511+0000","last_active":"2023-11-13T11:29:58.008106+0000","last_peered":"2023-11-13T11:29:58.008106+0000","last_clean":"2023-11-13T11:29:58.008106+0000","last_became_active":"2023-11-13T11:29:56.139904+0000","last_became_peered":"2023-11-13T11:29:56.139904+0000","last_unstale":"2023-11-13T11:29:58.008106+0000","last_undegraded":"2023-11-13T11:29:58.008106+0000","last_fullsized":"2023-11-13T11:29:58.008106+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-13T11:29:55.092850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-13T11:29:55.092850+0000","last_clean_scrub_stamp":"2023-11-13T11:29:55.092850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-14T15:04:45.338951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-13T11:29:57.982718+0000","last_change":"2023-11-13T11:29:56.643334+0000","last_active":"2023-11-13T11:29:57.982718+0000","last_peered":"2023-11-13T11:29:57.982718+0000","last_clean":"2023-11-13T11:29:57.982718+0000","last_became_active":"2023-11-13T11:29:56.642513+0000","last_became_peered":"2023-11-13T11:29:56.642513+0000","last_unstale":"2023-11-13T11:29:57.982718+0000","last_undegraded":"2023-11-13T11:29:57.982718+0000","last_fullsized":"2023-11-13T11:29:57.982718+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-13T11:29:56.100939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-13T11:29:56.100939+0000","last_clean_scrub_stamp":"2023-11-13T11:29:56.100939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-14T21:56:13.397155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-13T11:29:57.628164+0000","last_change":"2023-11-13T11:29:56.134866+0000","last_active":"2023-11-13T11:29:57.628164+0000","last_peered":"2023-11-13T11:29:57.628164+0000","last_clean":"2023-11-13T11:29:57.628164+0000","last_became_active":"2023-11-13T11:29:56.134603+0000","last_became_peered":"2023-11-13T11:29:56.134603+0000","last_unstale":"2023-11-13T11:29:57.628164+0000","last_undegraded":"2023-11-13T11:29:57.628164+0000","last_fullsized":"2023-11-13T11:29:57.628164+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-13T11:29:55.092850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-13T11:29:55.092850+0000","last_clean_scrub_stamp":"2023-11-13T11:29:55.092850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-14T15:38:38.756006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-13T11:29:57.628151+0000","last_change":"2023-11-13T11:29:56.635132+0000","last_active":"2023-11-13T11:29:57.628151+0000","last_peered":"2023-11-13T11:29:57.628151+0000","last_clean":"2023-11-13T11:29:57.628151+0000","last_became_active":"2023-11-13T11:29:56.634818+0000","last_became_peered":"2023-11-13T11:29:56.634818+0000","last_unstale":"2023-11-13T11:29:57.628151+0000","last_undegraded":"2023-11-13T11:29:57.628151+0000","last_fullsized":"2023-11-13T11:29:57.628151+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-13T11:29:56.100939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-13T11:29:56.100939+0000","last_clean_scrub_stamp":"2023-11-13T11:29:56.100939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-14T22:00:23.831826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-13T11:29:57.797600+0000","last_change":"2023-11-13T11:29:56.144301+0000","last_active":"2023-11-13T11:29:57.797600+0000","last_peered":"2023-11-13T11:29:57.797600+0000","last_clean":"2023-11-13T11:29:57.797600+0000","last_became_active":"2023-11-13T11:29:56.143893+0000","last_became_peered":"2023-11-13T11:29:56.143893+0000","last_unstale":"2023-11-13T11:29:57.797600+0000","last_undegraded":"2023-11-13T11:29:57.797600+0000","last_fullsized":"2023-11-13T11:29:57.797600+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-13T11:29:55.092850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-13T11:29:55.092850+0000","last_clean_scrub_stamp":"2023-11-13T11:29:55.092850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-14T16:23:19.147182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-13T11:29:57.632675+0000","last_change":"2023-11-13T11:29:56.649179+0000","last_active":"2023-11-13T11:29:57.632675+0000","last_peered":"2023-11-13T11:29:57.632675+0000","last_clean":"2023-11-13T11:29:57.632675+0000","last_became_active":"2023-11-13T11:29:56.648886+0000","last_became_peered":"2023-11-13T11:29:56.648886+0000","last_unstale":"2023-11-13T11:29:57.632675+0000","last_undegraded":"2023-11-13T11:29:57.632675+0000","last_fullsized":"2023-11-13T11:29:57.632675+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-13T11:29:56.100939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-13T11:29:56.100939+0000","last_clean_scrub_stamp":"2023-11-13T11:29:56.100939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-14T13:09:18.720541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.7","version":"35'2","reported_seq":14,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-13T11:29:57.983139+0000","last_change":"2023-11-13T11:29:56.145644+0000","last_active":"2023-11-13T11:29:57.983139+0000","last_peered":"2023-11-13T11:29:57.983139+0000","last_clean":"2023-11-13T11:29:57.983139+0000","last_became_active":"2023-11-13T11:29:56.145378+0000","last_became_peered":"2023-11-13T11:29:56.145378+0000","last_unstale":"2023-11-13T11:29:57.983139+0000","last_undegraded":"2023-11-13T11:29:57.983139+0000","last_fullsized":"2023-11-13T11:29:57.983139+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-13T11:29:55.092850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-13T11:29:55.092850+0000","last_clean_scrub_stamp":"2023-11-13T11:29:55.092850+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-14T18:02:37.298150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-13T11:29:57.798212+0000","last_change":"2023-11-13T11:29:56.642384+0000","last_active":"2023-11-13T11:29:57.798212+0000","last_peered":"2023-11-13T11:29:57.798212+0000","last_clean":"2023-11-13T11:29:57.798212+0000","last_became_active":"2023-11-13T11:29:56.642131+0000","last_became_peered":"2023-11-13T11:29:56.642131+0000","last_unstale":"2023-11-13T11:29:57.798212+0000","last_undegraded":"2023-11-13T11:29:57.798212+0000","last_fullsized":"2023-11-13T11:29:57.798212+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-13T11:29:56.100939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-13T11:29:56.100939+0000","last_clean_scrub_stamp":"2023-11-13T11:29:56.100939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-14T21:08:30.440323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.6","version":"36'1","reported_seq":13,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-13T11:29:59.269112+0000","last_change":"2023-11-13T11:29:56.138680+0000","last_active":"2023-11-13T11:29:59.269112+0000","last_peered":"2023-11-13T11:29:59.269112+0000","last_clean":"2023-11-13T11:29:59.269112+0000","last_became_active":"2023-11-13T11:29:56.138040+0000","last_became_peered":"2023-11-13T11:29:56.138040+0000","last_unstale":"2023-11-13T11:29:59.269112+0000","last_undegraded":"2023-11-13T11:29:59.269112+0000","last_fullsized":"2023-11-13T11:29:59.269112+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-13T11:29:55.092850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-13T11:29:55.092850+0000","last_clean_scrub_stamp":"2023-11-13T11:29:55.092850+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-14T22:42:28.641863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-13T11:29:57.632768+0000","last_change":"2023-11-13T11:29:56.656068+0000","last_active":"2023-11-13T11:29:57.632768+0000","last_peered":"2023-11-13T11:29:57.632768+0000","last_clean":"2023-11-13T11:29:57.632768+0000","last_became_active":"2023-11-13T11:29:56.655785+0000","last_became_peered":"2023-11-13T11:29:56.655785+0000","last_unstale":"2023-11-13T11:29:57.632768+0000","last_undegraded":"2023-11-13T11:29:57.632768+0000","last_fullsized":"2023-11-13T11:29:57.632768+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-13T11:29:56.100939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-13T11:29:56.100939+0000","last_clean_scrub_stamp":"2023-11-13T11:29:56.100939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-14T21:19:43.523677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-13T11:29:57.983249+0000","last_change":"2023-11-13T11:29:56.142162+0000","last_active":"2023-11-13T11:29:57.983249+0000","last_peered":"2023-11-13T11:29:57.983249+0000","last_clean":"2023-11-13T11:29:57.983249+0000","last_became_active":"2023-11-13T11:29:56.137853+0000","last_became_peered":"2023-11-13T11:29:56.137853+0000","last_unstale":"2023-11-13T11:29:57.983249+0000","last_undegraded":"2023-11-13T11:29:57.983249+0000","last_fullsized":"2023-11-13T11:29:57.983249+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-13T11:29:55.092850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-13T11:29:55.092850+0000","last_clean_scrub_stamp":"2023-11-13T11:29:55.092850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-14T23:27:05.058467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-13T11:29:58.898698+0000","last_change":"2023-11-13T11:29:56.641825+0000","last_active":"2023-11-13T11:29:58.898698+0000","last_peered":"2023-11-13T11:29:58.898698+0000","last_clean":"2023-11-13T11:29:58.898698+0000","last_became_active":"2023-11-13T11:29:56.641585+0000","last_became_peered":"2023-11-13T11:29:56.641585+0000","last_unstale":"2023-11-13T11:29:58.898698+0000","last_undegraded":"2023-11-13T11:29:58.898698+0000","last_fullsized":"2023-11-13T11:29:58.898698+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-13T11:29:56.100939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-13T11:29:56.100939+0000","last_clean_scrub_stamp":"2023-11-13T11:29:56.100939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-14T15:12:20.880081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-13T11:29:57.983061+0000","last_change":"2023-11-13T11:29:56.138898+0000","last_active":"2023-11-13T11:29:57.983061+0000","last_peered":"2023-11-13T11:29:57.983061+0000","last_clean":"2023-11-13T11:29:57.983061+0000","last_became_active":"2023-11-13T11:29:56.138567+0000","last_became_peered":"2023-11-13T11:29:56.138567+0000","last_unstale":"2023-11-13T11:29:57.983061+0000","last_undegraded":"2023-11-13T11:29:57.983061+0000","last_fullsized":"2023-11-13T11:29:57.983061+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-13T11:29:55.092850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-13T11:29:55.092850+0000","last_clean_scrub_stamp":"2023-11-13T11:29:55.092850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-14T16:46:11.291057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-13T11:29:57.632951+0000","last_change":"2023-11-13T11:29:56.654832+0000","last_active":"2023-11-13T11:29:57.632951+0000","last_peered":"2023-11-13T11:29:57.632951+0000","last_clean":"2023-11-13T11:29:57.632951+0000","last_became_active":"2023-11-13T11:29:56.654402+0000","last_became_peered":"2023-11-13T11:29:56.654402+0000","last_unstale":"2023-11-13T11:29:57.632951+0000","last_undegraded":"2023-11-13T11:29:57.632951+0000","last_fullsized":"2023-11-13T11:29:57.632951+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-13T11:29:56.100939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-13T11:29:56.100939+0000","last_clean_scrub_stamp":"2023-11-13T11:29:56.100939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-14T22:42:29.649952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-13T11:29:57.982846+0000","last_change":"2023-11-13T11:29:56.144565+0000","last_active":"2023-11-13T11:29:57.982846+0000","last_peered":"2023-11-13T11:29:57.982846+0000","last_clean":"2023-11-13T11:29:57.982846+0000","last_became_active":"2023-11-13T11:29:56.144261+0000","last_became_peered":"2023-11-13T11:29:56.144261+0000","last_unstale":"2023-11-13T11:29:57.982846+0000","last_undegraded":"2023-11-13T11:29:57.982846+0000","last_fullsized":"2023-11-13T11:29:57.982846+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-13T11:29:55.092850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-13T11:29:55.092850+0000","last_clean_scrub_stamp":"2023-11-13T11:29:55.092850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-14T21:03:47.544626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-13T11:29:57.632142+0000","last_change":"2023-11-13T11:29:56.642258+0000","last_active":"2023-11-13T11:29:57.632142+0000","last_peered":"2023-11-13T11:29:57.632142+0000","last_clean":"2023-11-13T11:29:57.632142+0000","last_became_active":"2023-11-13T11:29:56.641998+0000","last_became_peered":"2023-11-13T11:29:56.641998+0000","last_unstale":"2023-11-13T11:29:57.632142+0000","last_undegraded":"2023-11-13T11:29:57.632142+0000","last_fullsized":"2023-11-13T11:29:57.632142+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-13T11:29:56.100939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-13T11:29:56.100939+0000","last_clean_scrub_stamp":"2023-11-13T11:29:56.100939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-14T14:17:53.387282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-13T11:29:58.007973+0000","last_change":"2023-11-13T11:29:56.135994+0000","last_active":"2023-11-13T11:29:58.007973+0000","last_peered":"2023-11-13T11:29:58.007973+0000","last_clean":"2023-11-13T11:29:58.007973+0000","last_became_active":"2023-11-13T11:29:56.135708+0000","last_became_peered":"2023-11-13T11:29:56.135708+0000","last_unstale":"2023-11-13T11:29:58.007973+0000","last_undegraded":"2023-11-13T11:29:58.007973+0000","last_fullsized":"2023-11-13T11:29:58.007973+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-13T11:29:55.092850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-13T11:29:55.092850+0000","last_clean_scrub_stamp":"2023-11-13T11:29:55.092850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-14T22:09:01.172827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-13T11:29:57.797695+0000","last_change":"2023-11-13T11:29:56.642941+0000","last_active":"2023-11-13T11:29:57.797695+0000","last_peered":"2023-11-13T11:29:57.797695+0000","last_clean":"2023-11-13T11:29:57.797695+0000","last_became_active":"2023-11-13T11:29:56.642650+0000","last_became_peered":"2023-11-13T11:29:56.642650+0000","last_unstale":"2023-11-13T11:29:57.797695+0000","last_undegraded":"2023-11-13T11:29:57.797695+0000","last_fullsized":"2023-11-13T11:29:57.797695+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-13T11:29:56.100939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-13T11:29:56.100939+0000","last_clean_scrub_stamp":"2023-11-13T11:29:56.100939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-14T21:14:53.493647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-13T11:29:57.632187+0000","last_change":"2023-11-13T11:29:56.140560+0000","last_active":"2023-11-13T11:29:57.632187+0000","last_peered":"2023-11-13T11:29:57.632187+0000","last_clean":"2023-11-13T11:29:57.632187+0000","last_became_active":"2023-11-13T11:29:56.140217+0000","last_became_peered":"2023-11-13T11:29:56.140217+0000","last_unstale":"2023-11-13T11:29:57.632187+0000","last_undegraded":"2023-11-13T11:29:57.632187+0000","last_fullsized":"2023-11-13T11:29:57.632187+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-13T11:29:55.092850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-13T11:29:55.092850+0000","last_clean_scrub_stamp":"2023-11-13T11:29:55.092850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-14T13:56:02.498246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-13T11:29:58.898545+0000","last_change":"2023-11-13T11:29:56.643517+0000","last_active":"2023-11-13T11:29:58.898545+0000","last_peered":"2023-11-13T11:29:58.898545+0000","last_clean":"2023-11-13T11:29:58.898545+0000","last_became_active":"2023-11-13T11:29:56.643249+0000","last_became_peered":"2023-11-13T11:29:56.643249+0000","last_unstale":"2023-11-13T11:29:58.898545+0000","last_undegraded":"2023-11-13T11:29:58.898545+0000","last_fullsized":"2023-11-13T11:29:58.898545+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-13T11:29:56.100939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-13T11:29:56.100939+0000","last_clean_scrub_stamp":"2023-11-13T11:29:56.100939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-14T14:07:14.129755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-13T11:29:57.797960+0000","last_change":"2023-11-13T11:29:56.144318+0000","last_active":"2023-11-13T11:29:57.797960+0000","last_peered":"2023-11-13T11:29:57.797960+0000","last_clean":"2023-11-13T11:29:57.797960+0000","last_became_active":"2023-11-13T11:29:56.144025+0000","last_became_peered":"2023-11-13T11:29:56.144025+0000","last_unstale":"2023-11-13T11:29:57.797960+0000","last_undegraded":"2023-11-13T11:29:57.797960+0000","last_fullsized":"2023-11-13T11:29:57.797960+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-13T11:29:55.092850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-13T11:29:55.092850+0000","last_clean_scrub_stamp":"2023-11-13T11:29:55.092850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-14T22:32:31.676402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":176,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-13T11:29:56.628615+0000","last_change":"2023-11-13T11:28:47.002866+0000","last_active":"2023-11-13T11:29:56.628615+0000","last_peered":"2023-11-13T11:29:56.628615+0000","last_clean":"2023-11-13T11:29:56.628615+0000","last_became_active":"2023-11-13T11:28:47.001494+0000","last_became_peered":"2023-11-13T11:28:47.001494+0000","last_unstale":"2023-11-13T11:29:56.628615+0000","last_undegraded":"2023-11-13T11:29:56.628615+0000","last_fullsized":"2023-11-13T11:29:56.628615+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-13T11:28:45.879416+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-13T11:28:45.879416+0000","last_clean_scrub_stamp":"2023-11-13T11:28:45.879416+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-14T14:38:55.166320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":15,"seq":64424509458,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27432,"kb_used_data":404,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344408,"statfs":{"total":96636764160,"available":96608673792,"internally_reserved":0,"allocated":413696,"data_stored":158367,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Nov 13 11:29:47 2023","interfaces":[{"interface":"back","average":{"1min":0.68799999999999994,"5min":0.68799999999999994,"15min":0.68799999999999994},"min":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":0.91600000000000004,"5min":0.91600000000000004,"15min":0.91600000000000004},"last":0.77300000000000002},{"interface":"front","average":{"1min":0.70899999999999996,"5min":0.70899999999999996,"15min":0.70899999999999996},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":1.319,"5min":1.319,"15min":1.319},"last":0.58499999999999996}]},{"osd":1,"last update":"Mon Nov 13 11:29:47 2023","interfaces":[{"interface":"back","average":{"1min":0.745,"5min":0.745,"15min":0.745},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":1.2869999999999999,"5min":1.2869999999999999,"15min":1.2869999999999999},"last":0.624},{"interface":"front","average":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.77100000000000002},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":1.206,"5min":1.206,"15min":1.206},"last":0.53800000000000003}]},{"osd":2,"last update":"Mon Nov 13 11:29:47 2023","interfaces":[{"interface":"back","average":{"1min":0.71099999999999997,"5min":0.71099999999999997,"15min":0.71099999999999997},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":0.93899999999999995,"5min":0.93899999999999995,"15min":0.93899999999999995},"last":0.755},{"interface":"front","average":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":1.0589999999999999,"5min":1.0589999999999999,"15min":1.0589999999999999},"last":0.55400000000000005}]},{"osd":3,"last update":"Mon Nov 13 11:29:47 2023","interfaces":[{"interface":"back","average":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":0.81299999999999994},"min":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":1.367,"5min":1.367,"15min":1.367},"last":0.73299999999999998},{"interface":"front","average":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":0.77900000000000003},"min":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":1.4950000000000001,"5min":1.4950000000000001,"15min":1.4950000000000001},"last":0.60599999999999998}]},{"osd":4,"last update":"Mon Nov 13 11:29:47 2023","interfaces":[{"interface":"back","average":{"1min":0.66200000000000003,"5min":0.66200000000000003,"15min":0.66200000000000003},"min":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":1.002,"5min":1.002,"15min":1.002},"last":0.68100000000000005},{"interface":"front","average":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":0.77900000000000003},"min":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":1.403,"5min":1.403,"15min":1.403},"last":0.48599999999999999}]},{"osd":5,"last update":"Mon Nov 13 11:29:47 2023","interfaces":[{"interface":"back","average":{"1min":0.69599999999999995,"5min":0.69599999999999995,"15min":0.69599999999999995},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.96099999999999997,"5min":0.96099999999999997,"15min":0.96099999999999997},"last":0.70399999999999996},{"interface":"front","average":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":0.78000000000000003},"min":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"max":{"1min":1.1040000000000001,"5min":1.1040000000000001,"15min":1.1040000000000001},"last":0.81100000000000005}]},{"osd":7,"last update":"Mon Nov 13 11:29:47 2023","interfaces":[{"interface":"back","average":{"1min":0.79700000000000004,"5min":0.79700000000000004,"15min":0.79700000000000004},"min":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"max":{"1min":1.0820000000000001,"5min":1.0820000000000001,"15min":1.0820000000000001},"last":0.65600000000000003},{"interface":"front","average":{"1min":0.79100000000000004,"5min":0.79100000000000004,"15min":0.79100000000000004},"min":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":1.089,"5min":1.089,"15min":1.089},"last":0.78700000000000003}]}]},{"osd":5,"up_from":15,"seq":64424509458,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27992,"kb_used_data":972,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343848,"statfs":{"total":96636764160,"available":96608100352,"internally_reserved":0,"allocated":995328,"data_stored":746736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Nov 13 11:29:45 2023","interfaces":[{"interface":"back","average":{"1min":0.69699999999999995,"5min":0.69699999999999995,"15min":0.69699999999999995},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":1.7609999999999999,"5min":1.7609999999999999,"15min":1.7609999999999999},"last":0.66700000000000004},{"interface":"front","average":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":2.3370000000000002,"5min":2.3370000000000002,"15min":2.3370000000000002},"last":0.53800000000000003}]},{"osd":1,"last update":"Mon Nov 13 11:29:45 2023","interfaces":[{"interface":"back","average":{"1min":0.751,"5min":0.751,"15min":0.751},"min":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":1.8560000000000001,"5min":1.8560000000000001,"15min":1.8560000000000001},"last":0.40699999999999997},{"interface":"front","average":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":2.3599999999999999,"5min":2.3599999999999999,"15min":2.3599999999999999},"last":0.56899999999999995}]},{"osd":2,"last update":"Mon Nov 13 11:29:45 2023","interfaces":[{"interface":"back","average":{"1min":0.79300000000000004,"5min":0.79300000000000004,"15min":0.79300000000000004},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":3.2480000000000002,"5min":3.2480000000000002,"15min":3.2480000000000002},"last":0.499},{"interface":"front","average":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"min":{"1min":0.5,"5min":0.5,"15min":0.5},"max":{"1min":1.0129999999999999,"5min":1.0129999999999999,"15min":1.0129999999999999},"last":0.64200000000000002}]},{"osd":3,"last update":"Mon Nov 13 11:29:45 2023","interfaces":[{"interface":"back","average":{"1min":0.747,"5min":0.747,"15min":0.747},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":1.3680000000000001,"5min":1.3680000000000001,"15min":1.3680000000000001},"last":0.60699999999999998},{"interface":"front","average":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.71299999999999997},"min":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":1.6779999999999999,"5min":1.6779999999999999,"15min":1.6779999999999999},"last":0.44800000000000001}]},{"osd":4,"last update":"Mon Nov 13 11:29:45 2023","interfaces":[{"interface":"back","average":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.71299999999999997},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":2.323,"5min":2.323,"15min":2.323},"last":0.623},{"interface":"front","average":{"1min":0.78300000000000003,"5min":0.78300000000000003,"15min":0.78300000000000003},"min":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":1.04,"5min":1.04,"15min":1.04},"last":0.36899999999999999}]},{"osd":6,"last update":"Mon Nov 13 11:29:45 2023","interfaces":[{"interface":"back","average":{"1min":0.77200000000000002,"5min":0.77200000000000002,"15min":0.77200000000000002},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":2.5750000000000002,"5min":2.5750000000000002,"15min":2.5750000000000002},"last":0.52100000000000002},{"interface":"front","average":{"1min":0.79300000000000004,"5min":0.79300000000000004,"15min":0.79300000000000004},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":2.7010000000000001,"5min":2.7010000000000001,"15min":2.7010000000000001},"last":0.54900000000000004}]},{"osd":7,"last update":"Mon Nov 13 11:29:45 2023","interfaces":[{"interface":"back","average":{"1min":0.80900000000000005,"5min":0.80900000000000005,"15min":0.80900000000000005},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":2.3079999999999998,"5min":2.3079999999999998,"15min":2.3079999999999998},"last":0.47899999999999998},{"interface":"front","average":{"1min":0.75600000000000001,"5min":0.75600000000000001,"15min":0.75600000000000001},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":2.266,"5min":2.266,"15min":2.266},"last":0.58799999999999997}]}]},{"osd":4,"up_from":15,"seq":64424509457,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27436,"kb_used_data":408,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344404,"statfs":{"total":96636764160,"available":96608669696,"internally_reserved":0,"allocated":417792,"data_stored":158389,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Nov 13 11:29:45 2023","interfaces":[{"interface":"back","average":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":1.129,"5min":1.129,"15min":1.129},"last":0.75700000000000001},{"interface":"front","average":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":0.88300000000000001,"5min":0.88300000000000001,"15min":0.88300000000000001},"last":0.74099999999999999}]},{"osd":1,"last update":"Mon Nov 13 11:29:45 2023","interfaces":[{"interface":"back","average":{"1min":0.85699999999999998,"5min":0.85699999999999998,"15min":0.85699999999999998},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":2.4929999999999999,"5min":2.4929999999999999,"15min":2.4929999999999999},"last":0.84399999999999997},{"interface":"front","average":{"1min":0.69499999999999995,"5min":0.69499999999999995,"15min":0.69499999999999995},"min":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":1.181,"5min":1.181,"15min":1.181},"last":0.64900000000000002}]},{"osd":2,"last update":"Mon Nov 13 11:29:45 2023","interfaces":[{"interface":"back","average":{"1min":0.83499999999999996,"5min":0.83499999999999996,"15min":0.83499999999999996},"min":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":2.5129999999999999,"5min":2.5129999999999999,"15min":2.5129999999999999},"last":0.61099999999999999},{"interface":"front","average":{"1min":0.71699999999999997,"5min":0.71699999999999997,"15min":0.71699999999999997},"min":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":0.89700000000000002,"5min":0.89700000000000002,"15min":0.89700000000000002},"last":0.80200000000000005}]},{"osd":3,"last update":"Mon Nov 13 11:29:45 2023","interfaces":[{"interface":"back","average":{"1min":0.68899999999999995,"5min":0.68899999999999995,"15min":0.68899999999999995},"min":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":0.91500000000000004,"5min":0.91500000000000004,"15min":0.91500000000000004},"last":0.67000000000000004},{"interface":"front","average":{"1min":0.73299999999999998,"5min":0.73299999999999998,"15min":0.73299999999999998},"min":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"max":{"1min":0.90600000000000003,"5min":0.90600000000000003,"15min":0.90600000000000003},"last":0.77600000000000002}]},{"osd":5,"last update":"Mon Nov 13 11:29:45 2023","interfaces":[{"interface":"back","average":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.85199999999999998,"5min":0.85199999999999998,"15min":0.85199999999999998},"last":0.69299999999999995},{"interface":"front","average":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"last":0.46200000000000002}]},{"osd":6,"last update":"Mon Nov 13 11:29:45 2023","interfaces":[{"interface":"back","average":{"1min":0.67100000000000004,"5min":0.67100000000000004,"15min":0.67100000000000004},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":0.86799999999999999,"5min":0.86799999999999999,"15min":0.86799999999999999},"last":0.55000000000000004},{"interface":"front","average":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.93799999999999994,"5min":0.93799999999999994,"15min":0.93799999999999994},"last":0.56299999999999994}]},{"osd":7,"last update":"Mon Nov 13 11:29:45 2023","interfaces":[{"interface":"back","average":{"1min":0.73199999999999998,"5min":0.73199999999999998,"15min":0.73199999999999998},"min":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":0.90400000000000003,"5min":0.90400000000000003,"15min":0.90400000000000003},"last":0.52400000000000002},{"interface":"front","average":{"1min":0.80300000000000005,"5min":0.80300000000000005,"15min":0.80300000000000005},"min":{"1min":0.69499999999999995,"5min":0.69499999999999995,"15min":0.69499999999999995},"max":{"1min":0.97399999999999998,"5min":0.97399999999999998,"15min":0.97399999999999998},"last":0.72099999999999997}]}]},{"osd":3,"up_from":15,"seq":64424509458,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27436,"kb_used_data":408,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344404,"statfs":{"total":96636764160,"available":96608669696,"internally_reserved":0,"allocated":417792,"data_stored":157531,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Nov 13 11:29:46 2023","interfaces":[{"interface":"back","average":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":1.0229999999999999,"5min":1.0229999999999999,"15min":1.0229999999999999},"last":0.379},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"min":{"1min":0.31,"5min":0.31,"15min":0.31},"max":{"1min":1.522,"5min":1.522,"15min":1.522},"last":0.45500000000000002}]},{"osd":1,"last update":"Mon Nov 13 11:29:46 2023","interfaces":[{"interface":"back","average":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":2.9199999999999999,"5min":2.9199999999999999,"15min":2.9199999999999999},"last":0.435},{"interface":"front","average":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":3.0619999999999998,"5min":3.0619999999999998,"15min":3.0619999999999998},"last":0.56899999999999995}]},{"osd":2,"last update":"Mon Nov 13 11:29:46 2023","interfaces":[{"interface":"back","average":{"1min":0.68300000000000005,"5min":0.68300000000000005,"15min":0.68300000000000005},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":2.9820000000000002,"5min":2.9820000000000002,"15min":2.9820000000000002},"last":0.47699999999999998},{"interface":"front","average":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":2.1920000000000002,"5min":2.1920000000000002,"15min":2.1920000000000002},"last":0.53700000000000003}]},{"osd":4,"last update":"Mon Nov 13 11:29:46 2023","interfaces":[{"interface":"back","average":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.77300000000000002},"min":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":1.135,"5min":1.135,"15min":1.135},"last":0.81299999999999994},{"interface":"front","average":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.76600000000000001},"min":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":1.2949999999999999,"5min":1.2949999999999999,"15min":1.2949999999999999},"last":0.82699999999999996}]},{"osd":5,"last update":"Mon Nov 13 11:29:46 2023","interfaces":[{"interface":"back","average":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.76600000000000001},"min":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":1.3340000000000001,"5min":1.3340000000000001,"15min":1.3340000000000001},"last":0.88700000000000001},{"interface":"front","average":{"1min":0.79100000000000004,"5min":0.79100000000000004,"15min":0.79100000000000004},"min":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":1.7350000000000001,"5min":1.7350000000000001,"15min":1.7350000000000001},"last":0.67500000000000004}]},{"osd":6,"last update":"Mon Nov 13 11:29:46 2023","interfaces":[{"interface":"back","average":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"min":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":1.173,"5min":1.173,"15min":1.173},"last":0.65200000000000002},{"interface":"front","average":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":0.80600000000000005},"min":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"max":{"1min":1.3600000000000001,"5min":1.3600000000000001,"15min":1.3600000000000001},"last":0.73699999999999999}]},{"osd":7,"last update":"Mon Nov 13 11:29:46 2023","interfaces":[{"interface":"back","average":{"1min":0.84899999999999998,"5min":0.84899999999999998,"15min":0.84899999999999998},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":2.0070000000000001,"5min":2.0070000000000001,"15min":2.0070000000000001},"last":0.79100000000000004},{"interface":"front","average":{"1min":0.81499999999999995,"5min":0.81499999999999995,"15min":0.81499999999999995},"min":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"max":{"1min":1.208,"5min":1.208,"15min":1.208},"last":0.77100000000000002}]}]},{"osd":2,"up_from":15,"seq":64424509458,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27424,"kb_used_data":396,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344416,"statfs":{"total":96636764160,"available":96608681984,"internally_reserved":0,"allocated":405504,"data_stored":156789,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Nov 13 11:29:45 2023","interfaces":[{"interface":"back","average":{"1min":0.99299999999999999,"5min":0.99299999999999999,"15min":0.99299999999999999},"min":{"1min":0.245,"5min":0.245,"15min":0.245},"max":{"1min":8.6050000000000004,"5min":8.6050000000000004,"15min":8.6050000000000004},"last":0.26500000000000001},{"interface":"front","average":{"1min":0.96599999999999997,"5min":0.96599999999999997,"15min":0.96599999999999997},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":8.3770000000000007,"5min":8.3770000000000007,"15min":8.3770000000000007},"last":0.61799999999999999}]},{"osd":1,"last update":"Mon Nov 13 11:29:45 2023","interfaces":[{"interface":"back","average":{"1min":0.73199999999999998,"5min":0.73199999999999998,"15min":0.73199999999999998},"min":{"1min":0.28199999999999997,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":4.351,"5min":4.351,"15min":4.351},"last":0.40300000000000002},{"interface":"front","average":{"1min":1.008,"5min":1.008,"15min":1.008},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":8.1649999999999991,"5min":8.1649999999999991,"15min":8.1649999999999991},"last":0.36099999999999999}]},{"osd":3,"last update":"Mon Nov 13 11:29:45 2023","interfaces":[{"interface":"back","average":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.64100000000000001,"5min":0.64100000000000001,"15min":0.64100000000000001},"last":0.42799999999999999},{"interface":"front","average":{"1min":1.097,"5min":1.097,"15min":1.097},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":8.8059999999999992,"5min":8.8059999999999992,"15min":8.8059999999999992},"last":0.54800000000000004}]},{"osd":4,"last update":"Mon Nov 13 11:29:45 2023","interfaces":[{"interface":"back","average":{"1min":1.0489999999999999,"5min":1.0489999999999999,"15min":1.0489999999999999},"min":{"1min":0.64800000000000002,"5min":0.64800000000000002,"15min":0.64800000000000002},"max":{"1min":4.6310000000000002,"5min":4.6310000000000002,"15min":4.6310000000000002},"last":0.58599999999999997},{"interface":"front","average":{"1min":1.075,"5min":1.075,"15min":1.075},"min":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":5.1639999999999997,"5min":5.1639999999999997,"15min":5.1639999999999997},"last":0.66700000000000004}]},{"osd":5,"last update":"Mon Nov 13 11:29:45 2023","interfaces":[{"interface":"back","average":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"min":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":0.95499999999999996,"5min":0.95499999999999996,"15min":0.95499999999999996},"last":0.56799999999999995},{"interface":"front","average":{"1min":1.056,"5min":1.056,"15min":1.056},"min":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":4.6779999999999999,"5min":4.6779999999999999,"15min":4.6779999999999999},"last":0.51500000000000001}]},{"osd":6,"last update":"Mon Nov 13 11:29:45 2023","interfaces":[{"interface":"back","average":{"1min":1.0600000000000001,"5min":1.0600000000000001,"15min":1.0600000000000001},"min":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"max":{"1min":4.7080000000000002,"5min":4.7080000000000002,"15min":4.7080000000000002},"last":0.76000000000000001},{"interface":"front","average":{"1min":0.77800000000000002,"5min":0.77800000000000002,"15min":0.77800000000000002},"min":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":1.1200000000000001,"5min":1.1200000000000001,"15min":1.1200000000000001},"last":0.68400000000000005}]},{"osd":7,"last update":"Mon Nov 13 11:29:45 2023","interfaces":[{"interface":"back","average":{"1min":1.0629999999999999,"5min":1.0629999999999999,"15min":1.0629999999999999},"min":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"max":{"1min":4.9530000000000003,"5min":4.9530000000000003,"15min":4.9530000000000003},"last":0.70499999999999996},{"interface":"front","average":{"1min":0.81100000000000005,"5min":0.81100000000000005,"15min":0.81100000000000005},"min":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"max":{"1min":1.294,"5min":1.294,"15min":1.294},"last":0.64700000000000002}]}]},{"osd":1,"up_from":15,"seq":64424509459,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27996,"kb_used_data":976,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343844,"statfs":{"total":96636764160,"available":96608096256,"internally_reserved":0,"allocated":999424,"data_stored":747193,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Nov 13 11:29:45 2023","interfaces":[{"interface":"back","average":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"last":0.44600000000000001},{"interface":"front","average":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"min":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.80700000000000005,"5min":0.80700000000000005,"15min":0.80700000000000005},"last":0.46700000000000003}]},{"osd":2,"last update":"Mon Nov 13 11:29:45 2023","interfaces":[{"interface":"back","average":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":0.63500000000000001,"5min":0.63500000000000001,"15min":0.63500000000000001},"last":0.48299999999999998},{"interface":"front","average":{"1min":0.499,"5min":0.499,"15min":0.499},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.64800000000000002,"5min":0.64800000000000002,"15min":0.64800000000000002},"last":0.57599999999999996}]},{"osd":3,"last update":"Mon Nov 13 11:29:45 2023","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.77000000000000002,"5min":0.77000000000000002,"15min":0.77000000000000002},"last":0.54300000000000004},{"interface":"front","average":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.68300000000000005,"5min":0.68300000000000005,"15min":0.68300000000000005},"last":0.49099999999999999}]},{"osd":4,"last update":"Mon Nov 13 11:29:45 2023","interfaces":[{"interface":"back","average":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"min":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":1.3720000000000001,"5min":1.3720000000000001,"15min":1.3720000000000001},"last":0.60599999999999998},{"interface":"front","average":{"1min":0.73199999999999998,"5min":0.73199999999999998,"15min":0.73199999999999998},"min":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":1.0389999999999999,"5min":1.0389999999999999,"15min":1.0389999999999999},"last":0.70099999999999996}]},{"osd":5,"last update":"Mon Nov 13 11:29:45 2023","interfaces":[{"interface":"back","average":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"min":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":1.0669999999999999,"5min":1.0669999999999999,"15min":1.0669999999999999},"last":0.88700000000000001},{"interface":"front","average":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"min":{"1min":0.60099999999999998,"5min":0.60099999999999998,"15min":0.60099999999999998},"max":{"1min":1.0009999999999999,"5min":1.0009999999999999,"15min":1.0009999999999999},"last":0.871}]},{"osd":6,"last update":"Mon Nov 13 11:29:45 2023","interfaces":[{"interface":"back","average":{"1min":0.752,"5min":0.752,"15min":0.752},"min":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":0.94799999999999995,"5min":0.94799999999999995,"15min":0.94799999999999995},"last":0.78400000000000003},{"interface":"front","average":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"min":{"1min":0.66300000000000003,"5min":0.66300000000000003,"15min":0.66300000000000003},"max":{"1min":1.0249999999999999,"5min":1.0249999999999999,"15min":1.0249999999999999},"last":0.85599999999999998}]},{"osd":7,"last update":"Mon Nov 13 11:29:45 2023","interfaces":[{"interface":"back","average":{"1min":0.77000000000000002,"5min":0.77000000000000002,"15min":0.77000000000000002},"min":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"max":{"1min":0.96299999999999997,"5min":0.96299999999999997,"15min":0.96299999999999997},"last":0.82799999999999996},{"interface":"front","average":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.78200000000000003},"min":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":0.98399999999999999,"5min":0.98399999999999999,"15min":0.98399999999999999},"last":0.83899999999999997}]}]},{"osd":0,"up_from":15,"seq":64424509459,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27412,"kb_used_data":392,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344428,"statfs":{"total":96636764160,"available":96608694272,"internally_reserved":0,"allocated":401408,"data_stored":155876,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Nov 13 11:29:45 2023","interfaces":[{"interface":"back","average":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"min":{"1min":0.29099999999999998,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"last":0.64400000000000002},{"interface":"front","average":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"min":{"1min":0.29899999999999999,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.60299999999999998,"5min":0.60299999999999998,"15min":0.60299999999999998},"last":0.41099999999999998}]},{"osd":2,"last update":"Mon Nov 13 11:29:45 2023","interfaces":[{"interface":"back","average":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"last":0.52400000000000002},{"interface":"front","average":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":1.0069999999999999,"5min":1.0069999999999999,"15min":1.0069999999999999},"last":0.45800000000000002}]},{"osd":3,"last update":"Mon Nov 13 11:29:45 2023","interfaces":[{"interface":"back","average":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"last":0.55300000000000005},{"interface":"front","average":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"last":0.61399999999999999}]},{"osd":4,"last update":"Mon Nov 13 11:29:45 2023","interfaces":[{"interface":"back","average":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"min":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":1.048,"5min":1.048,"15min":1.048},"last":0.65800000000000003},{"interface":"front","average":{"1min":0.79700000000000004,"5min":0.79700000000000004,"15min":0.79700000000000004},"min":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"max":{"1min":1.0629999999999999,"5min":1.0629999999999999,"15min":1.0629999999999999},"last":0.74399999999999999}]},{"osd":5,"last update":"Mon Nov 13 11:29:45 2023","interfaces":[{"interface":"back","average":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":0.78700000000000003},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.5189999999999999,"5min":1.5189999999999999,"15min":1.5189999999999999},"last":0.68000000000000005},{"interface":"front","average":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.77300000000000002},"min":{"1min":0.629,"5min":0.629,"15min":0.629},"max":{"1min":1.1519999999999999,"5min":1.1519999999999999,"15min":1.1519999999999999},"last":0.77300000000000002}]},{"osd":6,"last update":"Mon Nov 13 11:29:45 2023","interfaces":[{"interface":"back","average":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.78800000000000003},"min":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.004,"5min":1.004,"15min":1.004},"last":0.69799999999999995},{"interface":"front","average":{"1min":0.82899999999999996,"5min":0.82899999999999996,"15min":0.82899999999999996},"min":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"max":{"1min":2.0270000000000001,"5min":2.0270000000000001,"15min":2.0270000000000001},"last":0.63200000000000001}]},{"osd":7,"last update":"Mon Nov 13 11:29:45 2023","interfaces":[{"interface":"back","average":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"min":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"max":{"1min":1.579,"5min":1.579,"15min":1.579},"last":0.71099999999999997},{"interface":"front","average":{"1min":0.79000000000000004,"5min":0.79000000000000004,"15min":0.79000000000000004},"min":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":1.101,"5min":1.101,"15min":1.101},"last":0.72299999999999998}]}]},{"osd":7,"up_from":14,"seq":60129542162,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27416,"kb_used_data":396,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344424,"statfs":{"total":96636764160,"available":96608690176,"internally_reserved":0,"allocated":405504,"data_stored":156777,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Nov 13 11:29:49 2023","interfaces":[{"interface":"back","average":{"1min":0.86499999999999999,"5min":0.86499999999999999,"15min":0.86499999999999999},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":5.5019999999999998,"5min":5.5019999999999998,"15min":5.5019999999999998},"last":0.65700000000000003},{"interface":"front","average":{"1min":0.89900000000000002,"5min":0.89900000000000002,"15min":0.89900000000000002},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":5.7329999999999997,"5min":5.7329999999999997,"15min":5.7329999999999997},"last":0.747}]},{"osd":1,"last update":"Mon Nov 13 11:29:49 2023","interfaces":[{"interface":"back","average":{"1min":0.66100000000000003,"5min":0.66100000000000003,"15min":0.66100000000000003},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.89700000000000002,"5min":0.89700000000000002,"15min":0.89700000000000002},"last":0.77300000000000002},{"interface":"front","average":{"1min":0.72999999999999998,"5min":0.72999999999999998,"15min":0.72999999999999998},"min":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":0.95599999999999996,"5min":0.95599999999999996,"15min":0.95599999999999996},"last":0.70299999999999996}]},{"osd":2,"last update":"Mon Nov 13 11:29:49 2023","interfaces":[{"interface":"back","average":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":0.91100000000000003,"5min":0.91100000000000003,"15min":0.91100000000000003},"last":0.73299999999999998},{"interface":"front","average":{"1min":0.95599999999999996,"5min":0.95599999999999996,"15min":0.95599999999999996},"min":{"1min":0.502,"5min":0.502,"15min":0.502},"max":{"1min":5.569,"5min":5.569,"15min":5.569},"last":0.79800000000000004}]},{"osd":3,"last update":"Mon Nov 13 11:29:49 2023","interfaces":[{"interface":"back","average":{"1min":0.89300000000000002,"5min":0.89300000000000002,"15min":0.89300000000000002},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":5.5979999999999999,"5min":5.5979999999999999,"15min":5.5979999999999999},"last":0.72199999999999998},{"interface":"front","average":{"1min":0.79100000000000004,"5min":0.79100000000000004,"15min":0.79100000000000004},"min":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"max":{"1min":1.7050000000000001,"5min":1.7050000000000001,"15min":1.7050000000000001},"last":0.61799999999999999}]},{"osd":4,"last update":"Mon Nov 13 11:29:49 2023","interfaces":[{"interface":"back","average":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":1.018,"5min":1.018,"15min":1.018},"last":0.58399999999999996},{"interface":"front","average":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":0.71499999999999997},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.95599999999999996,"5min":0.95599999999999996,"15min":0.95599999999999996},"last":0.46200000000000002}]},{"osd":5,"last update":"Mon Nov 13 11:29:49 2023","interfaces":[{"interface":"back","average":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":1.0029999999999999,"5min":1.0029999999999999,"15min":1.0029999999999999},"last":0.44500000000000001},{"interface":"front","average":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"min":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":1.0189999999999999,"5min":1.0189999999999999,"15min":1.0189999999999999},"last":0.52900000000000003}]},{"osd":6,"last update":"Mon Nov 13 11:29:49 2023","interfaces":[{"interface":"back","average":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"min":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"max":{"1min":1.02,"5min":1.02,"15min":1.02},"last":0.64000000000000001},{"interface":"front","average":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":0.77900000000000003},"min":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"max":{"1min":1.0029999999999999,"5min":1.0029999999999999,"15min":1.0029999999999999},"last":0.67500000000000004}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":776,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-13T11:30:01.592 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-11-13T11:30:01.593 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-11-13T11:30:01.770 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:01.761+0000 7ff44d805640 1 Processor -- start 2023-11-13T11:30:01.770 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:01.761+0000 7ff44d805640 1 -- start start 2023-11-13T11:30:01.772 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:01.765+0000 7ff44d805640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7ff4480b3c60 0x7ff4480cf670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:30:01.772 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:01.765+0000 7ff44d805640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff4480b40c0 0x7ff4480cfbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:30:01.772 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:01.765+0000 7ff44d805640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff4480ce4c0 con 0x7ff44815e600 2023-11-13T11:30:01.772 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:01.765+0000 7ff44d805640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff4480d0a10 con 0x7ff4480b3c60 2023-11-13T11:30:01.773 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:01.765+0000 7ff44d805640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4480ce710 con 0x7ff4480b40c0 2023-11-13T11:30:01.773 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:01.765+0000 7ff446ffd640 1 --1- >> v1:172.21.15.102:6789/0 conn(0x7ff44815e600 0x7ff44815ec20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.102:6789/0 says I am v1:172.21.15.102:57388/0 (socket says 172.21.15.102:57388) 2023-11-13T11:30:01.773 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:01.765+0000 7ff446ffd640 1 -- 172.21.15.102:0/1293374814 learned_addr learned my addr 172.21.15.102:0/1293374814 (peer_addr_for_me v1:172.21.15.102:0/0) 2023-11-13T11:30:01.773 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:01.765+0000 7ff43e7fc640 1 --2- 172.21.15.102:0/1293374814 >> v2:172.21.15.102:3300/0 conn(0x7ff4480b3c60 0x7ff4480cf670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:30:01.773 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:01.765+0000 7ff4477fe640 1 --2- 172.21.15.102:0/1293374814 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff4480b40c0 0x7ff4480cfbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:30:01.774 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:01.765+0000 7ff4467fc640 1 -- 172.21.15.102:0/1293374814 <== mon.0 v1:172.21.15.102:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3277547749 0 0) 0x7ff4480ce4c0 con 0x7ff44815e600 2023-11-13T11:30:01.774 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:01.765+0000 7ff4467fc640 1 -- 172.21.15.102:0/1293374814 --> v1:172.21.15.102:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff434003530 con 0x7ff44815e600 2023-11-13T11:30:01.774 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:01.765+0000 7ff43e7fc640 1 -- 172.21.15.102:0/1293374814 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff4480b40c0 msgr2=0x7ff4480cfbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-13T11:30:01.774 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:01.765+0000 7ff43e7fc640 1 --2- 172.21.15.102:0/1293374814 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff4480b40c0 0x7ff4480cfbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:30:01.774 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:01.765+0000 7ff43e7fc640 1 -- 172.21.15.102:0/1293374814 >> v1:172.21.15.102:6789/0 conn(0x7ff44815e600 legacy=0x7ff44815ec20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:30:01.775 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:01.765+0000 7ff43e7fc640 1 -- 172.21.15.102:0/1293374814 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4480ce9f0 con 0x7ff4480b3c60 2023-11-13T11:30:01.775 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:01.765+0000 7ff4477fe640 1 --2- 172.21.15.102:0/1293374814 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff4480b40c0 0x7ff4480cfbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-13T11:30:01.776 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:01.765+0000 7ff43e7fc640 1 --2- 172.21.15.102:0/1293374814 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff4480b3c60 0x7ff4480cf670 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7ff4380097c0 tx=0x7ff43801c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b6a53bf459743ab7 server_cookie=0 in_seq=0 out_seq=0 2023-11-13T11:30:01.776 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:01.769+0000 7ff4467fc640 1 -- 172.21.15.102:0/1293374814 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4380a7070 con 0x7ff4480b3c60 2023-11-13T11:30:01.776 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:01.769+0000 7ff4467fc640 1 -- 172.21.15.102:0/1293374814 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4380ab430 con 0x7ff4480b3c60 2023-11-13T11:30:01.777 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:01.769+0000 7ff4467fc640 1 -- 172.21.15.102:0/1293374814 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4380ab7c0 con 0x7ff4480b3c60 2023-11-13T11:30:01.777 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:01.769+0000 7ff44d805640 1 -- 172.21.15.102:0/1293374814 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff4480b3c60 msgr2=0x7ff4480cf670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:30:01.777 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:01.769+0000 7ff44d805640 1 --2- 172.21.15.102:0/1293374814 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff4480b3c60 0x7ff4480cf670 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7ff4380097c0 tx=0x7ff43801c450 comp rx=0 tx=0).stop 2023-11-13T11:30:01.777 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:01.769+0000 7ff44d805640 1 -- 172.21.15.102:0/1293374814 shutdown_connections 2023-11-13T11:30:01.777 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:01.769+0000 7ff44d805640 1 --2- 172.21.15.102:0/1293374814 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff4480b40c0 0x7ff4480cfbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:30:01.778 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:01.769+0000 7ff44d805640 1 --2- 172.21.15.102:0/1293374814 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff4480b3c60 0x7ff4480cf670 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:30:01.778 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:01.769+0000 7ff44d805640 1 -- 172.21.15.102:0/1293374814 >> 172.21.15.102:0/1293374814 conn(0x7ff4480d2da0 msgr2=0x7ff4480d31b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-13T11:30:01.778 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:01.769+0000 7ff44d805640 1 -- 172.21.15.102:0/1293374814 shutdown_connections 2023-11-13T11:30:01.778 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:01.769+0000 7ff44d805640 1 -- 172.21.15.102:0/1293374814 wait complete. 2023-11-13T11:30:01.780 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:01.769+0000 7ff44d805640 1 Processor -- start 2023-11-13T11:30:01.780 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:01.769+0000 7ff44d805640 1 -- start start 2023-11-13T11:30:01.781 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:01.769+0000 7ff44d805640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff4480b3c60 0x7ff4480cafb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:30:01.781 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:01.769+0000 7ff44d805640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff4480b40c0 0x7ff4480cb4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:30:01.781 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:01.769+0000 7ff44d805640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff44815e600 0x7ff448155990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:30:01.781 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:01.769+0000 7ff44d805640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4480cba30 con 0x7ff4480b40c0 2023-11-13T11:30:01.781 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:01.769+0000 7ff44d805640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff448154bd0 con 0x7ff44815e600 2023-11-13T11:30:01.782 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:01.769+0000 7ff44d805640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff448154eb0 con 0x7ff4480b3c60 2023-11-13T11:30:01.782 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:01.773+0000 7ff43e7fc640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff4480b40c0 0x7ff4480cb4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:30:01.782 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:01.773+0000 7ff43e7fc640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff4480b40c0 0x7ff4480cb4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:38342/0 (socket says 172.21.15.102:38342) 2023-11-13T11:30:01.782 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:01.773+0000 7ff43e7fc640 1 -- 172.21.15.102:0/129903370 learned_addr learned my addr 172.21.15.102:0/129903370 (peer_addr_for_me v2:172.21.15.102:0/0) 2023-11-13T11:30:01.782 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:01.773+0000 7ff4477fe640 1 --2- 172.21.15.102:0/129903370 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff44815e600 0x7ff448155990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:30:01.783 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:01.773+0000 7ff446ffd640 1 --2- 172.21.15.102:0/129903370 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff4480b3c60 0x7ff4480cafb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:30:01.783 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:01.773+0000 7ff43e7fc640 1 -- 172.21.15.102:0/129903370 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff4480b3c60 msgr2=0x7ff4480cafb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:30:01.783 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:01.773+0000 7ff43e7fc640 1 --2- 172.21.15.102:0/129903370 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff4480b3c60 0x7ff4480cafb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:30:01.783 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:01.773+0000 7ff43e7fc640 1 -- 172.21.15.102:0/129903370 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff44815e600 msgr2=0x7ff448155990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:30:01.783 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:01.773+0000 7ff43e7fc640 1 --2- 172.21.15.102:0/129903370 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff44815e600 0x7ff448155990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:30:01.784 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:01.773+0000 7ff43e7fc640 1 -- 172.21.15.102:0/129903370 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff438009420 con 0x7ff4480b40c0 2023-11-13T11:30:01.784 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:01.773+0000 7ff43e7fc640 1 --2- 172.21.15.102:0/129903370 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff4480b40c0 0x7ff4480cb4f0 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7ff4380ad040 tx=0x7ff4380191f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-13T11:30:01.784 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:01.773+0000 7ff444ff9640 1 -- 172.21.15.102:0/129903370 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4380bb070 con 0x7ff4480b40c0 2023-11-13T11:30:01.784 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:01.773+0000 7ff444ff9640 1 -- 172.21.15.102:0/129903370 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4380b43f0 con 0x7ff4480b40c0 2023-11-13T11:30:01.784 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:01.773+0000 7ff44d805640 1 -- 172.21.15.102:0/129903370 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff448155190 con 0x7ff4480b40c0 2023-11-13T11:30:01.785 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:01.773+0000 7ff444ff9640 1 -- 172.21.15.102:0/129903370 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4380b47a0 con 0x7ff4480b40c0 2023-11-13T11:30:01.785 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:01.773+0000 7ff44d805640 1 -- 172.21.15.102:0/129903370 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff44814d5f0 con 0x7ff4480b40c0 2023-11-13T11:30:01.786 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:01.773+0000 7ff44d805640 1 -- 172.21.15.102:0/129903370 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff4480d0180 con 0x7ff4480b40c0 2023-11-13T11:30:01.786 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:01.773+0000 7ff444ff9640 1 -- 172.21.15.102:0/129903370 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7ff4380b4900 con 0x7ff4480b40c0 2023-11-13T11:30:01.786 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:01.773+0000 7ff444ff9640 1 --2- 172.21.15.102:0/129903370 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7ff428066470 0x7ff428068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:30:01.786 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:01.777+0000 7ff444ff9640 1 -- 172.21.15.102:0/129903370 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff43811db20 con 0x7ff4480b40c0 2023-11-13T11:30:01.787 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:01.777+0000 7ff446ffd640 1 --2- 172.21.15.102:0/129903370 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7ff428066470 0x7ff428068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:30:01.787 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:01.777+0000 7ff446ffd640 1 --2- 172.21.15.102:0/129903370 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7ff428066470 0x7ff428068930 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7ff4300011f0 tx=0x7ff430009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-13T11:30:01.787 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:01.781+0000 7ff444ff9640 1 -- 172.21.15.102:0/129903370 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7ff4380eb010 con 0x7ff4480b40c0 2023-11-13T11:30:01.989 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:01.981+0000 7ff44d805640 1 -- 172.21.15.102:0/129903370 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7ff448068590 con 0x7ff4480b40c0 2023-11-13T11:30:01.993 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:01.985+0000 7ff444ff9640 1 -- 172.21.15.102:0/129903370 <== mon.0 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v11) v1 ==== 190+0+147 (secure 0 0 0) 0x7ff4380ee630 con 0x7ff4480b40c0 2023-11-13T11:30:01.994 INFO:teuthology.orchestra.run.smithi102.stdout:[client.0] 2023-11-13T11:30:01.994 INFO:teuthology.orchestra.run.smithi102.stdout: key = AQA4CFJlCrzJHRAAifnfqFe57iLwnoWmhavnMA== 2023-11-13T11:30:01.994 INFO:teuthology.orchestra.run.smithi102.stdout: caps mds = "allow" 2023-11-13T11:30:01.994 INFO:teuthology.orchestra.run.smithi102.stdout: caps mon = "allow r" 2023-11-13T11:30:01.995 INFO:teuthology.orchestra.run.smithi102.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2023-11-13T11:30:01.995 INFO:teuthology.orchestra.run.smithi102.stderr:updated caps for client.0 2023-11-13T11:30:01.996 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:01.989+0000 7ff44d805640 1 -- 172.21.15.102:0/129903370 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7ff428066470 msgr2=0x7ff428068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:30:01.997 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:01.989+0000 7ff44d805640 1 --2- 172.21.15.102:0/129903370 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7ff428066470 0x7ff428068930 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7ff4300011f0 tx=0x7ff430009040 comp rx=0 tx=0).stop 2023-11-13T11:30:01.997 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:01.989+0000 7ff44d805640 1 -- 172.21.15.102:0/129903370 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff4480b40c0 msgr2=0x7ff4480cb4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:30:01.997 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:01.989+0000 7ff44d805640 1 --2- 172.21.15.102:0/129903370 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff4480b40c0 0x7ff4480cb4f0 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7ff4380ad040 tx=0x7ff4380191f0 comp rx=0 tx=0).stop 2023-11-13T11:30:01.998 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:01.989+0000 7ff44d805640 1 -- 172.21.15.102:0/129903370 shutdown_connections 2023-11-13T11:30:01.998 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:01.989+0000 7ff44d805640 1 --2- 172.21.15.102:0/129903370 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff44815e600 0x7ff448155990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:30:01.998 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:01.989+0000 7ff44d805640 1 --2- 172.21.15.102:0/129903370 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7ff428066470 0x7ff428068930 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:30:01.998 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:01.989+0000 7ff44d805640 1 --2- 172.21.15.102:0/129903370 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff4480b40c0 0x7ff4480cb4f0 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:30:01.998 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:01.989+0000 7ff44d805640 1 --2- 172.21.15.102:0/129903370 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff4480b3c60 0x7ff4480cafb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:30:01.999 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:01.989+0000 7ff44d805640 1 -- 172.21.15.102:0/129903370 >> 172.21.15.102:0/129903370 conn(0x7ff4480d2da0 msgr2=0x7ff44806b800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-13T11:30:01.999 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:01.989+0000 7ff44d805640 1 -- 172.21.15.102:0/129903370 shutdown_connections 2023-11-13T11:30:01.999 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:01.989+0000 7ff44d805640 1 -- 172.21.15.102:0/129903370 wait complete. 2023-11-13T11:30:02.016 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-13T11:30:02.154 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:02.145+0000 7f03101a1640 1 Processor -- start 2023-11-13T11:30:02.155 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:02.145+0000 7f03101a1640 1 -- start start 2023-11-13T11:30:02.156 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:02.149+0000 7f03101a1640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f0308140540 0x7f030815e3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:30:02.156 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:02.149+0000 7f03101a1640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0308071900 0x7f03080b1c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:30:02.156 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:02.149+0000 7f03101a1640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f030815e910 con 0x7f030806caa0 2023-11-13T11:30:02.157 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:02.149+0000 7f03101a1640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0308140920 con 0x7f0308140540 2023-11-13T11:30:02.157 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:02.149+0000 7f03101a1640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f03080ccc50 con 0x7f0308071900 2023-11-13T11:30:02.157 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:02.149+0000 7f030d73c640 1 --1- >> v1:172.21.15.102:6789/0 conn(0x7f030806caa0 0x7f03080711f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.102:6789/0 says I am v1:172.21.15.102:57398/0 (socket says 172.21.15.102:57398) 2023-11-13T11:30:02.157 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:02.149+0000 7f030d73c640 1 -- 172.21.15.102:0/1937625770 learned_addr learned my addr 172.21.15.102:0/1937625770 (peer_addr_for_me v1:172.21.15.102:0/0) 2023-11-13T11:30:02.157 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:02.149+0000 7f030e73e640 1 --2- 172.21.15.102:0/1937625770 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0308071900 0x7f03080b1c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:30:02.158 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:02.149+0000 7f030df3d640 1 --2- 172.21.15.102:0/1937625770 >> v2:172.21.15.154:3300/0 conn(0x7f0308140540 0x7f030815e3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:30:02.158 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:02.149+0000 7f030cf3b640 1 -- 172.21.15.102:0/1937625770 <== mon.0 v1:172.21.15.102:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3376320096 0 0) 0x7f02f8001120 con 0x7f030806caa0 2023-11-13T11:30:02.159 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:02.149+0000 7f030cf3b640 1 -- 172.21.15.102:0/1937625770 --> v1:172.21.15.102:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f02f4003530 con 0x7f030806caa0 2023-11-13T11:30:02.159 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:02.149+0000 7f030e73e640 1 -- 172.21.15.102:0/1937625770 >> v2:172.21.15.154:3300/0 conn(0x7f0308140540 msgr2=0x7f030815e3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-13T11:30:02.159 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:02.149+0000 7f030e73e640 1 --2- 172.21.15.102:0/1937625770 >> v2:172.21.15.154:3300/0 conn(0x7f0308140540 0x7f030815e3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:30:02.159 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:02.149+0000 7f030e73e640 1 -- 172.21.15.102:0/1937625770 >> v1:172.21.15.102:6789/0 conn(0x7f030806caa0 legacy=0x7f03080711f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:30:02.159 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:02.149+0000 7f030cf3b640 1 -- 172.21.15.102:0/1937625770 <== mon.0 v1:172.21.15.102:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3984291812 0 0) 0x7f02f4003530 con 0x7f030806caa0 2023-11-13T11:30:02.160 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:02.149+0000 7f030e73e640 1 -- 172.21.15.102:0/1937625770 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f030806cfc0 con 0x7f0308071900 2023-11-13T11:30:02.161 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:02.153+0000 7f030e73e640 1 --2- 172.21.15.102:0/1937625770 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0308071900 0x7f03080b1c00 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f0300009d90 tx=0x7f030001c840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=259b3a594dbe267 server_cookie=0 in_seq=0 out_seq=0 2023-11-13T11:30:02.161 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:02.153+0000 7f030cf3b640 1 -- 172.21.15.102:0/1937625770 <== mon.2 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02f8001810 con 0x7f0308071900 2023-11-13T11:30:02.162 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:02.153+0000 7f030cf3b640 1 -- 172.21.15.102:0/1937625770 <== mon.2 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f03000a5640 con 0x7f0308071900 2023-11-13T11:30:02.162 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:02.153+0000 7f030cf3b640 1 -- 172.21.15.102:0/1937625770 <== mon.2 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03000a59b0 con 0x7f0308071900 2023-11-13T11:30:02.162 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:02.153+0000 7f03101a1640 1 -- 172.21.15.102:0/1937625770 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0308071900 msgr2=0x7f03080b1c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:30:02.162 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:02.153+0000 7f03101a1640 1 --2- 172.21.15.102:0/1937625770 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0308071900 0x7f03080b1c00 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f0300009d90 tx=0x7f030001c840 comp rx=0 tx=0).stop 2023-11-13T11:30:02.162 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:02.153+0000 7f03101a1640 1 -- 172.21.15.102:0/1937625770 shutdown_connections 2023-11-13T11:30:02.163 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:02.153+0000 7f03101a1640 1 --2- 172.21.15.102:0/1937625770 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0308071900 0x7f03080b1c00 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:30:02.163 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:02.153+0000 7f03101a1640 1 --2- 172.21.15.102:0/1937625770 >> v2:172.21.15.154:3300/0 conn(0x7f0308140540 0x7f030815e3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:30:02.163 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:02.153+0000 7f03101a1640 1 -- 172.21.15.102:0/1937625770 >> 172.21.15.102:0/1937625770 conn(0x7f03080b0870 msgr2=0x7f03080b0c80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-13T11:30:02.163 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:02.153+0000 7f03101a1640 1 -- 172.21.15.102:0/1937625770 shutdown_connections 2023-11-13T11:30:02.163 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:02.153+0000 7f03101a1640 1 -- 172.21.15.102:0/1937625770 wait complete. 2023-11-13T11:30:02.165 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:02.153+0000 7f03101a1640 1 Processor -- start 2023-11-13T11:30:02.166 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:02.157+0000 7f03101a1640 1 -- start start 2023-11-13T11:30:02.166 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:02.157+0000 7f03101a1640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f030806caa0 0x7f0308166d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:30:02.166 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:02.157+0000 7f03101a1640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0308071900 0x7f0308155f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:30:02.166 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:02.157+0000 7f03101a1640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0308140540 0x7f03081564a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:30:02.167 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:02.157+0000 7f03101a1640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f030814e7f0 con 0x7f030806caa0 2023-11-13T11:30:02.167 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:02.157+0000 7f03101a1640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0308159dd0 con 0x7f0308140540 2023-11-13T11:30:02.167 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:02.157+0000 7f03101a1640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f030813d3c0 con 0x7f0308071900 2023-11-13T11:30:02.167 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:02.157+0000 7f030df3d640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f030806caa0 0x7f0308166d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:30:02.167 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:02.157+0000 7f030df3d640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f030806caa0 0x7f0308166d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:38348/0 (socket says 172.21.15.102:38348) 2023-11-13T11:30:02.168 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:02.157+0000 7f030df3d640 1 -- 172.21.15.102:0/1456415099 learned_addr learned my addr 172.21.15.102:0/1456415099 (peer_addr_for_me v2:172.21.15.102:0/0) 2023-11-13T11:30:02.168 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:02.157+0000 7f030d73c640 1 --2- 172.21.15.102:0/1456415099 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0308071900 0x7f0308155f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:30:02.168 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:02.157+0000 7f030e73e640 1 --2- 172.21.15.102:0/1456415099 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0308140540 0x7f03081564a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:30:02.168 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:02.157+0000 7f030df3d640 1 -- 172.21.15.102:0/1456415099 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0308071900 msgr2=0x7f0308155f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:30:02.168 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:02.157+0000 7f030df3d640 1 --2- 172.21.15.102:0/1456415099 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0308071900 0x7f0308155f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:30:02.169 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:02.157+0000 7f030df3d640 1 -- 172.21.15.102:0/1456415099 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0308140540 msgr2=0x7f03081564a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:30:02.169 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:02.157+0000 7f030df3d640 1 --2- 172.21.15.102:0/1456415099 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0308140540 0x7f03081564a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:30:02.169 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:02.157+0000 7f030df3d640 1 -- 172.21.15.102:0/1456415099 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0300009a70 con 0x7f030806caa0 2023-11-13T11:30:02.169 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:02.157+0000 7f030df3d640 1 --2- 172.21.15.102:0/1456415099 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f030806caa0 0x7f0308166d90 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f030400e870 tx=0x7f030400ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-13T11:30:02.169 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:02.157+0000 7f02fe7fc640 1 -- 172.21.15.102:0/1456415099 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0304009510 con 0x7f030806caa0 2023-11-13T11:30:02.170 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:02.157+0000 7f02fe7fc640 1 -- 172.21.15.102:0/1456415099 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f030400eec0 con 0x7f030806caa0 2023-11-13T11:30:02.170 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:02.157+0000 7f03101a1640 1 -- 172.21.15.102:0/1456415099 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0308167370 con 0x7f030806caa0 2023-11-13T11:30:02.170 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:02.157+0000 7f02fe7fc640 1 -- 172.21.15.102:0/1456415099 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f030400cb40 con 0x7f030806caa0 2023-11-13T11:30:02.170 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:02.157+0000 7f03101a1640 1 -- 172.21.15.102:0/1456415099 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0308159780 con 0x7f030806caa0 2023-11-13T11:30:02.171 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:02.157+0000 7f03101a1640 1 -- 172.21.15.102:0/1456415099 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0308068520 con 0x7f030806caa0 2023-11-13T11:30:02.171 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:02.161+0000 7f02fe7fc640 1 -- 172.21.15.102:0/1456415099 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f030400cca0 con 0x7f030806caa0 2023-11-13T11:30:02.172 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:02.161+0000 7f02fe7fc640 1 --2- 172.21.15.102:0/1456415099 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f02ec066470 0x7f02ec068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:30:02.172 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:02.161+0000 7f02fe7fc640 1 -- 172.21.15.102:0/1456415099 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f0304083f90 con 0x7f030806caa0 2023-11-13T11:30:02.172 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:02.161+0000 7f030d73c640 1 --2- 172.21.15.102:0/1456415099 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f02ec066470 0x7f02ec068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:30:02.172 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:02.161+0000 7f030d73c640 1 --2- 172.21.15.102:0/1456415099 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f02ec066470 0x7f02ec068930 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f02f8001820 tx=0x7f02f8001770 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-13T11:30:02.173 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:02.165+0000 7f02fe7fc640 1 -- 172.21.15.102:0/1456415099 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f03040b5280 con 0x7f030806caa0 2023-11-13T11:30:02.354 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:02.345+0000 7f03101a1640 1 -- 172.21.15.102:0/1456415099 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f03080b38d0 con 0x7f030806caa0 2023-11-13T11:30:02.355 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:02.345+0000 7f02fe7fc640 1 -- 172.21.15.102:0/1456415099 <== mon.0 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) v1 ==== 94+0+4922 (secure 0 0 0) 0x7f0304021090 con 0x7f030806caa0 2023-11-13T11:30:02.355 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T11:30:02.355 INFO:teuthology.orchestra.run.smithi102.stdout:{"epoch":16,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4826,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6834/3121803929","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6832","nonce":3121803929},{"type":"v1","addr":"172.21.15.154:6834","nonce":3121803929}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":4829,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6835/2990283260","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6833","nonce":2990283260},{"type":"v1","addr":"172.21.15.154:6835","nonce":2990283260}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":5271,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.102:6836/868460192","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6834","nonce":868460192},{"type":"v1","addr":"172.21.15.102:6836","nonce":868460192}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-13T11:29:56.498042+0000","modified":"2023-11-13T11:29:59.519487+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5274},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5274":{"gid":5274,"name":"a","rank":0,"incarnation":12,"state":"up:active","state_seq":3,"addr":"172.21.15.102:6837/3869977039","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6835","nonce":3869977039},{"type":"v1","addr":"172.21.15.102:6837","nonce":3869977039}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-11-13T11:30:02.356 INFO:teuthology.orchestra.run.smithi102.stderr:dumped fsmap epoch 16 2023-11-13T11:30:02.356 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:02.349+0000 7f03101a1640 1 -- 172.21.15.102:0/1456415099 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f02ec066470 msgr2=0x7f02ec068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:30:02.357 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:02.349+0000 7f03101a1640 1 --2- 172.21.15.102:0/1456415099 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f02ec066470 0x7f02ec068930 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f02f8001820 tx=0x7f02f8001770 comp rx=0 tx=0).stop 2023-11-13T11:30:02.357 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:02.349+0000 7f03101a1640 1 -- 172.21.15.102:0/1456415099 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f030806caa0 msgr2=0x7f0308166d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:30:02.357 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:02.349+0000 7f03101a1640 1 --2- 172.21.15.102:0/1456415099 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f030806caa0 0x7f0308166d90 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f030400e870 tx=0x7f030400ec70 comp rx=0 tx=0).stop 2023-11-13T11:30:02.357 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:02.349+0000 7f03101a1640 1 -- 172.21.15.102:0/1456415099 shutdown_connections 2023-11-13T11:30:02.357 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:02.349+0000 7f03101a1640 1 --2- 172.21.15.102:0/1456415099 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0308140540 0x7f03081564a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:30:02.358 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:02.349+0000 7f03101a1640 1 --2- 172.21.15.102:0/1456415099 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0308071900 0x7f0308155f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:30:02.358 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:02.349+0000 7f03101a1640 1 --2- 172.21.15.102:0/1456415099 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f02ec066470 0x7f02ec068930 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:30:02.358 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:02.349+0000 7f03101a1640 1 --2- 172.21.15.102:0/1456415099 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f030806caa0 0x7f0308166d90 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:30:02.358 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:02.349+0000 7f03101a1640 1 -- 172.21.15.102:0/1456415099 >> 172.21.15.102:0/1456415099 conn(0x7f03080b0870 msgr2=0x7f03080cbdc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-13T11:30:02.358 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:02.349+0000 7f03101a1640 1 -- 172.21.15.102:0/1456415099 shutdown_connections 2023-11-13T11:30:02.359 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:02.349+0000 7f03101a1640 1 -- 172.21.15.102:0/1456415099 wait complete. 2023-11-13T11:30:02.779 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 16, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-11-13T11:29:56.498042+0000', 'modified': '2023-11-13T11:29:59.519487+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5274}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5274': {'gid': 5274, 'name': 'a', 'rank': 0, 'incarnation': 12, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.102:6837/3869977039', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.102:6835', 'nonce': 3869977039}, {'type': 'v1', 'addr': '172.21.15.102:6837', 'nonce': 3869977039}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [5], 'metadata_pool': 4, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-11-13T11:30:02.779 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-11-13T11:30:02.780 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2023-11-13T11:30:02.922 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:02.913+0000 7fac105df640 1 Processor -- start 2023-11-13T11:30:02.923 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:02.913+0000 7fac105df640 1 -- start start 2023-11-13T11:30:02.924 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:02.917+0000 7fac105df640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fac08140540 0x7fac0815e3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:30:02.924 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:02.917+0000 7fac105df640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7fac0806caa0 0x7fac080711f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:30:02.924 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:02.917+0000 7fac105df640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fac0815e910 con 0x7fac08071730 2023-11-13T11:30:02.925 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:02.917+0000 7fac105df640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fac08071be0 con 0x7fac0806caa0 2023-11-13T11:30:02.925 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:02.917+0000 7fac105df640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fac08140920 con 0x7fac08140540 2023-11-13T11:30:02.925 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:02.917+0000 7fac0eb7c640 1 --1- >> v1:172.21.15.102:6789/0 conn(0x7fac08071730 0x7fac0806fd10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.102:6789/0 says I am v1:172.21.15.102:57404/0 (socket says 172.21.15.102:57404) 2023-11-13T11:30:02.925 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:02.917+0000 7fac0eb7c640 1 -- 172.21.15.102:0/1803857046 learned_addr learned my addr 172.21.15.102:0/1803857046 (peer_addr_for_me v1:172.21.15.102:0/0) 2023-11-13T11:30:02.925 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:02.917+0000 7fac0db7a640 1 --2- 172.21.15.102:0/1803857046 >> v2:172.21.15.102:3300/0 conn(0x7fac0806caa0 0x7fac080711f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:30:02.926 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:02.917+0000 7fac0e37b640 1 --2- 172.21.15.102:0/1803857046 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fac08140540 0x7fac0815e3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:30:02.926 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:02.917+0000 7fac0d379640 1 -- 172.21.15.102:0/1803857046 <== mon.0 v1:172.21.15.102:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4220785936 0 0) 0x7fac000014a0 con 0x7fac08071730 2023-11-13T11:30:02.927 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:02.917+0000 7fac0d379640 1 -- 172.21.15.102:0/1803857046 --> v1:172.21.15.102:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fabf4005740 con 0x7fac08071730 2023-11-13T11:30:02.927 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:02.917+0000 7fac0db7a640 1 -- 172.21.15.102:0/1803857046 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fac08140540 msgr2=0x7fac0815e3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-13T11:30:02.927 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:02.917+0000 7fac0db7a640 1 --2- 172.21.15.102:0/1803857046 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fac08140540 0x7fac0815e3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:30:02.927 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:02.917+0000 7fac0db7a640 1 -- 172.21.15.102:0/1803857046 >> v1:172.21.15.102:6789/0 conn(0x7fac08071730 legacy=0x7fac0806fd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:30:02.927 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:02.917+0000 7fac0db7a640 1 -- 172.21.15.102:0/1803857046 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac080ccc50 con 0x7fac0806caa0 2023-11-13T11:30:02.928 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:02.921+0000 7fac0db7a640 1 --2- 172.21.15.102:0/1803857046 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fac0806caa0 0x7fac080711f0 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7fabf80097c0 tx=0x7fabf801c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=640d5fc043de9c5f server_cookie=0 in_seq=0 out_seq=0 2023-11-13T11:30:02.929 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:02.921+0000 7fac0d379640 1 -- 172.21.15.102:0/1803857046 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabf80ab650 con 0x7fac0806caa0 2023-11-13T11:30:02.929 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:02.921+0000 7fac0d379640 1 -- 172.21.15.102:0/1803857046 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fabf80ab7b0 con 0x7fac0806caa0 2023-11-13T11:30:02.929 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:02.921+0000 7fac0d379640 1 -- 172.21.15.102:0/1803857046 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabf80abb40 con 0x7fac0806caa0 2023-11-13T11:30:02.929 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:02.921+0000 7fac105df640 1 -- 172.21.15.102:0/1803857046 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fac0806caa0 msgr2=0x7fac080711f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:30:02.929 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:02.921+0000 7fac105df640 1 --2- 172.21.15.102:0/1803857046 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fac0806caa0 0x7fac080711f0 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7fabf80097c0 tx=0x7fabf801c450 comp rx=0 tx=0).stop 2023-11-13T11:30:02.930 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:02.921+0000 7fac105df640 1 -- 172.21.15.102:0/1803857046 shutdown_connections 2023-11-13T11:30:02.930 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:02.921+0000 7fac105df640 1 --2- 172.21.15.102:0/1803857046 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fac0806caa0 0x7fac080711f0 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:30:02.930 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:02.921+0000 7fac105df640 1 --2- 172.21.15.102:0/1803857046 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fac08140540 0x7fac0815e3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:30:02.930 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:02.921+0000 7fac105df640 1 -- 172.21.15.102:0/1803857046 >> 172.21.15.102:0/1803857046 conn(0x7fac080b0870 msgr2=0x7fac080b0c80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-13T11:30:02.930 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:02.921+0000 7fac105df640 1 -- 172.21.15.102:0/1803857046 shutdown_connections 2023-11-13T11:30:02.931 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:02.921+0000 7fac105df640 1 -- 172.21.15.102:0/1803857046 wait complete. 2023-11-13T11:30:02.932 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:02.921+0000 7fac105df640 1 Processor -- start 2023-11-13T11:30:02.933 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:02.921+0000 7fac105df640 1 -- start start 2023-11-13T11:30:02.933 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:02.925+0000 7fac105df640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fac0806caa0 0x7fac081523d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:30:02.933 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:02.925+0000 7fac105df640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fac08071730 0x7fac0815bf60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:30:02.933 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:02.925+0000 7fac105df640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fac08140540 0x7fac08162ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:30:02.934 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:02.925+0000 7fac105df640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac0815d0c0 con 0x7fac08140540 2023-11-13T11:30:02.934 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:02.925+0000 7fac105df640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac0815c820 con 0x7fac08071730 2023-11-13T11:30:02.934 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:02.925+0000 7fac105df640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fac0815cb00 con 0x7fac0806caa0 2023-11-13T11:30:02.934 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:02.925+0000 7fac0eb7c640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fac08140540 0x7fac08162ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:30:02.934 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:02.925+0000 7fac0eb7c640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fac08140540 0x7fac08162ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:38364/0 (socket says 172.21.15.102:38364) 2023-11-13T11:30:02.935 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:02.925+0000 7fac0eb7c640 1 -- 172.21.15.102:0/2627353148 learned_addr learned my addr 172.21.15.102:0/2627353148 (peer_addr_for_me v2:172.21.15.102:0/0) 2023-11-13T11:30:02.935 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:02.925+0000 7fac0e37b640 1 --2- 172.21.15.102:0/2627353148 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fac0806caa0 0x7fac081523d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:30:02.935 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:02.925+0000 7fac0db7a640 1 --2- 172.21.15.102:0/2627353148 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fac08071730 0x7fac0815bf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:30:02.935 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:02.925+0000 7fac0eb7c640 1 -- 172.21.15.102:0/2627353148 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fac0806caa0 msgr2=0x7fac081523d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:30:02.935 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:02.925+0000 7fac0eb7c640 1 --2- 172.21.15.102:0/2627353148 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fac0806caa0 0x7fac081523d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:30:02.935 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:02.925+0000 7fac0eb7c640 1 -- 172.21.15.102:0/2627353148 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fac08071730 msgr2=0x7fac0815bf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:30:02.936 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:02.925+0000 7fac0eb7c640 1 --2- 172.21.15.102:0/2627353148 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fac08071730 0x7fac0815bf60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:30:02.936 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:02.925+0000 7fac0eb7c640 1 -- 172.21.15.102:0/2627353148 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fabf8009420 con 0x7fac08140540 2023-11-13T11:30:02.936 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:02.925+0000 7fac0eb7c640 1 --2- 172.21.15.102:0/2627353148 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fac08140540 0x7fac08162ec0 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7fac0000cb40 tx=0x7fac0000a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-13T11:30:02.936 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:02.925+0000 7fabfeffd640 1 -- 172.21.15.102:0/2627353148 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac0000aca0 con 0x7fac08140540 2023-11-13T11:30:02.936 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:02.925+0000 7fabfeffd640 1 -- 172.21.15.102:0/2627353148 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac0000ae00 con 0x7fac08140540 2023-11-13T11:30:02.937 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:02.925+0000 7fac105df640 1 -- 172.21.15.102:0/2627353148 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fac0815cde0 con 0x7fac08140540 2023-11-13T11:30:02.937 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:02.925+0000 7fabfeffd640 1 -- 172.21.15.102:0/2627353148 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac00012620 con 0x7fac08140540 2023-11-13T11:30:02.937 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:02.925+0000 7fac105df640 1 -- 172.21.15.102:0/2627353148 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fac0815c4a0 con 0x7fac08140540 2023-11-13T11:30:02.940 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:02.925+0000 7fabfeffd640 1 -- 172.21.15.102:0/2627353148 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fac00007070 con 0x7fac08140540 2023-11-13T11:30:02.940 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:02.929+0000 7fabfeffd640 1 --2- 172.21.15.102:0/2627353148 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7fabec066470 0x7fabec068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:30:02.940 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:02.929+0000 7fabfeffd640 1 -- 172.21.15.102:0/2627353148 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fac00083c90 con 0x7fac08140540 2023-11-13T11:30:02.941 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:02.929+0000 7fac0e37b640 1 --2- 172.21.15.102:0/2627353148 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7fabec066470 0x7fabec068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:30:02.941 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:02.929+0000 7fac13946000 1 Processor -- start 2023-11-13T11:30:02.941 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:02.929+0000 7fac0e37b640 1 --2- 172.21.15.102:0/2627353148 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7fabec066470 0x7fabec068930 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fac04009ac0 tx=0x7fac04009190 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-13T11:30:02.941 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:02.929+0000 7fac13946000 1 -- start start 2023-11-13T11:30:02.941 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:02.929+0000 7fac13946000 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5634ffe44c90 0x5634ffe45070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:30:02.941 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:02.929+0000 7fac13946000 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x5634ffe455b0 0x5634ffdfade0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:30:02.942 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:02.929+0000 7fac13946000 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5634ffdfb320 0x5634ffdfb700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:30:02.942 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:02.929+0000 7fac13946000 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x5634ffc65130 con 0x5634ffe44c90 2023-11-13T11:30:02.942 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:02.929+0000 7fac13946000 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x5634ffc529a0 con 0x5634ffdfb320 2023-11-13T11:30:02.942 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:02.929+0000 7fac13946000 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x5634ffc4fed0 con 0x5634ffe455b0 2023-11-13T11:30:02.942 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:02.929+0000 7fac0e37b640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5634ffe44c90 0x5634ffe45070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:30:02.943 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:02.929+0000 7fac0e37b640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5634ffe44c90 0x5634ffe45070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:38378/0 (socket says 172.21.15.102:38378) 2023-11-13T11:30:02.943 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:02.929+0000 7fac0e37b640 1 -- 172.21.15.102:0/2172044630 learned_addr learned my addr 172.21.15.102:0/2172044630 (peer_addr_for_me v2:172.21.15.102:0/0) 2023-11-13T11:30:02.943 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:02.929+0000 7fac0db7a640 1 --2- 172.21.15.102:0/2172044630 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x5634ffe455b0 0x5634ffdfade0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:30:02.943 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:02.929+0000 7fac0eb7c640 1 --2- 172.21.15.102:0/2172044630 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5634ffdfb320 0x5634ffdfb700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:30:02.943 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:02.929+0000 7fac0e37b640 1 -- 172.21.15.102:0/2172044630 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x5634ffe455b0 msgr2=0x5634ffdfade0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-13T11:30:02.944 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:02.929+0000 7fac0e37b640 1 --2- 172.21.15.102:0/2172044630 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x5634ffe455b0 0x5634ffdfade0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:30:02.944 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:02.929+0000 7fac0e37b640 1 -- 172.21.15.102:0/2172044630 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5634ffdfb320 msgr2=0x5634ffdfb700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-13T11:30:02.944 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:02.929+0000 7fac0e37b640 1 --2- 172.21.15.102:0/2172044630 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5634ffdfb320 0x5634ffdfb700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:30:02.944 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:02.929+0000 7fac0e37b640 1 -- 172.21.15.102:0/2172044630 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5634ff943890 con 0x5634ffe44c90 2023-11-13T11:30:02.944 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:02.929+0000 7fac0eb7c640 1 --2- 172.21.15.102:0/2172044630 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5634ffdfb320 0x5634ffdfb700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-13T11:30:02.944 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:02.929+0000 7fac0e37b640 1 --2- 172.21.15.102:0/2172044630 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5634ffe44c90 0x5634ffe45070 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7fac04006aa0 tx=0x7fac04014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bba7c08e9609a404 server_cookie=0 in_seq=0 out_seq=0 2023-11-13T11:30:02.945 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:02.929+0000 7fabebfff640 1 -- 172.21.15.102:0/2172044630 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac0401c040 con 0x5634ffe44c90 2023-11-13T11:30:02.945 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:02.929+0000 7fabebfff640 1 -- 172.21.15.102:0/2172044630 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac04003830 con 0x5634ffe44c90 2023-11-13T11:30:02.945 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:02.929+0000 7fabebfff640 1 -- 172.21.15.102:0/2172044630 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac04003ba0 con 0x5634ffe44c90 2023-11-13T11:30:02.945 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:02.933+0000 7fac13946000 1 -- 172.21.15.102:0/2172044630 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5634ffe44c90 msgr2=0x5634ffe45070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:30:02.946 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:02.933+0000 7fac13946000 1 --2- 172.21.15.102:0/2172044630 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5634ffe44c90 0x5634ffe45070 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7fac04006aa0 tx=0x7fac04014000 comp rx=0 tx=0).stop 2023-11-13T11:30:02.946 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:02.933+0000 7fac13946000 1 -- 172.21.15.102:0/2172044630 shutdown_connections 2023-11-13T11:30:02.946 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:02.933+0000 7fac13946000 1 --2- 172.21.15.102:0/2172044630 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5634ffdfb320 0x5634ffdfb700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:30:02.946 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:02.933+0000 7fac13946000 1 --2- 172.21.15.102:0/2172044630 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x5634ffe455b0 0x5634ffdfade0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:30:02.946 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:02.933+0000 7fac13946000 1 --2- 172.21.15.102:0/2172044630 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5634ffe44c90 0x5634ffe45070 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:30:02.947 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:02.933+0000 7fac13946000 1 -- 172.21.15.102:0/2172044630 >> 172.21.15.102:0/2172044630 conn(0x5634ffdf72d0 msgr2=0x5634ffdf96c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-13T11:30:02.947 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:02.933+0000 7fac13946000 1 -- 172.21.15.102:0/2172044630 shutdown_connections 2023-11-13T11:30:02.947 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:02.933+0000 7fac13946000 1 -- 172.21.15.102:0/2172044630 wait complete. 2023-11-13T11:30:02.947 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:02.933+0000 7fac13946000 1 -- start start 2023-11-13T11:30:02.951 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:02.933+0000 7fac13946000 1 Processor -- start 2023-11-13T11:30:02.951 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:02.933+0000 7fac13946000 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x5634ffdfb320 0x5634ffdffd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:30:02.951 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:02.933+0000 7fac13946000 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5634ffe44c90 0x5634ffe00280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:30:02.951 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:02.933+0000 7fac13946000 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5634ffe455b0 0x5634ffe13910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:30:02.951 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:02.933+0000 7fac13946000 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x5634ffc4b7c0 con 0x5634ffe455b0 2023-11-13T11:30:02.952 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:02.933+0000 7fac13946000 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x5634ffc03bf0 con 0x5634ffe44c90 2023-11-13T11:30:02.952 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:02.933+0000 7fac13946000 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x5634ffc09a90 con 0x5634ffdfb320 2023-11-13T11:30:02.952 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:02.933+0000 7fac13946000 10 client.0 _ll_register_callbacks cb 0x5634ffde63c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-13T11:30:02.952 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:02.933+0000 7fac0eb7c640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5634ffe455b0 0x5634ffe13910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:30:02.952 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:02.933+0000 7fac0eb7c640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5634ffe455b0 0x5634ffe13910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:38394/0 (socket says 172.21.15.102:38394) 2023-11-13T11:30:02.953 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:02.933+0000 7fac0eb7c640 1 -- 172.21.15.102:0/2065731299 learned_addr learned my addr 172.21.15.102:0/2065731299 (peer_addr_for_me v2:172.21.15.102:0/0) 2023-11-13T11:30:02.953 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:02.933+0000 7fac0e37b640 1 --2- 172.21.15.102:0/2065731299 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x5634ffdfb320 0x5634ffdffd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:30:02.953 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:02.933+0000 7fac0db7a640 1 --2- 172.21.15.102:0/2065731299 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5634ffe44c90 0x5634ffe00280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:30:02.953 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:02.933+0000 7fac0eb7c640 1 -- 172.21.15.102:0/2065731299 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x5634ffdfb320 msgr2=0x5634ffdffd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-13T11:30:02.953 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:02.933+0000 7fac0eb7c640 1 --2- 172.21.15.102:0/2065731299 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x5634ffdfb320 0x5634ffdffd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:30:02.953 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:02.933+0000 7fac0eb7c640 1 -- 172.21.15.102:0/2065731299 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5634ffe44c90 msgr2=0x5634ffe00280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-13T11:30:02.954 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:02.933+0000 7fac0eb7c640 1 --2- 172.21.15.102:0/2065731299 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5634ffe44c90 0x5634ffe00280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:30:02.954 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:02.933+0000 7fac0eb7c640 1 -- 172.21.15.102:0/2065731299 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fac040041a0 con 0x5634ffe455b0 2023-11-13T11:30:02.954 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:02.933+0000 7fac0eb7c640 1 --2- 172.21.15.102:0/2065731299 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5634ffe455b0 0x5634ffe13910 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7fac00001600 tx=0x7fac00059050 comp rx=0 tx=0).ready entity=mon.0 client_cookie=241dd602b523cc91 server_cookie=0 in_seq=0 out_seq=0 2023-11-13T11:30:02.954 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:02.933+0000 7fabe97fa640 10 client.0 ms_handle_connect on v2:172.21.15.102:3300/0 2023-11-13T11:30:02.954 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:02.933+0000 7fabe97fa640 1 -- 172.21.15.102:0/2065731299 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac00054560 con 0x5634ffe455b0 2023-11-13T11:30:02.955 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:02.933+0000 7fac13946000 1 -- 172.21.15.102:0/2065731299 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5634ffc0d470 con 0x5634ffe455b0 2023-11-13T11:30:02.955 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:02.933+0000 7fabe97fa640 1 -- 172.21.15.102:0/2065731299 <== mon.0 v2:172.21.15.102:3300/0 2 ==== osd_map(36..36 src has 1..36) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fac0005cc30 con 0x5634ffe455b0 2023-11-13T11:30:02.955 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:02.937+0000 7fabe97fa640 1 -- 172.21.15.102:0/2065731299 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_get_version_reply(handle=1 version=16) v2 ==== 24+0+0 (secure 0 0 0) 0x7fac0005cdf0 con 0x5634ffe455b0 2023-11-13T11:30:02.955 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:02.937+0000 7fac13946000 10 client.5445 fetch_fsmap learned FSMap version 16 2023-11-13T11:30:02.955 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:02.937+0000 7fac13946000 1 -- 172.21.15.102:0/2065731299 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,fsmap=16,monmap=2+}) v3 -- 0x5634ffc0c190 con 0x5634ffe455b0 2023-11-13T11:30:02.956 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:02.937+0000 7fabe97fa640 1 -- 172.21.15.102:0/2065731299 <== mon.0 v2:172.21.15.102:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5634ffc0d470 con 0x5634ffe455b0 2023-11-13T11:30:02.956 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:02.937+0000 7fabe97fa640 1 -- 172.21.15.102:0/2065731299 <== mon.0 v2:172.21.15.102:3300/0 5 ==== fsmap(e 16) v1 ==== 3294+0+0 (secure 0 0 0) 0x7fac00004b70 con 0x5634ffe455b0 2023-11-13T11:30:02.956 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:02.937+0000 7fac13946000 10 client.5445 fetch_fsmap finished waiting for FSMap version 16 2023-11-13T11:30:02.956 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:02.937+0000 7fac13946000 10 client.5445 resolve_mds: resolved name 'a' to daemon mds.a 2023-11-13T11:30:02.956 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:02.937+0000 7fac13946000 20 client.5445 populate_metadata read hostname 'smithi102' 2023-11-13T11:30:02.956 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:02.937+0000 7fac13946000 1 --2- 172.21.15.102:0/2065731299 >> [v2:172.21.15.102:6835/3869977039,v1:172.21.15.102:6837/3869977039] conn(0x5634ffe14320 0x5634ffe56f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:30:02.957 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:02.937+0000 7fac13946000 4 client.5445 mds_command: new command op to 5274 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-11-13T11:30:02.957 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:02.937+0000 7fac13946000 1 -- 172.21.15.102:0/2065731299 --> [v2:172.21.15.102:6835/3869977039,v1:172.21.15.102:6837/3869977039] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5634ffc10b50 con 0x5634ffe14320 2023-11-13T11:30:02.957 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:02.937+0000 7fac0e37b640 1 --2- 172.21.15.102:0/2065731299 >> [v2:172.21.15.102:6835/3869977039,v1:172.21.15.102:6837/3869977039] conn(0x5634ffe14320 0x5634ffe56f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:30:02.957 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:02.937+0000 7fabe97fa640 10 client.5445 ms_handle_connect on v2:172.21.15.102:6835/3869977039 2023-11-13T11:30:02.957 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:02.937+0000 7fac0e37b640 1 --2- 172.21.15.102:0/2065731299 >> [v2:172.21.15.102:6835/3869977039,v1:172.21.15.102:6837/3869977039] conn(0x5634ffe14320 0x5634ffe56f50 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=35945f92e9cc93c0 server_cookie=8e45ad02c7aee959 in_seq=0 out_seq=0 2023-11-13T11:30:02.958 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:02.937+0000 7fabe97fa640 1 -- 172.21.15.102:0/2065731299 <== mds.0 v2:172.21.15.102:6835/3869977039 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x5634ffc10b50 con 0x5634ffe14320 2023-11-13T11:30:02.958 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:02.937+0000 7fabe97fa640 10 client.5445 handle_command_reply: tid=0 2023-11-13T11:30:02.958 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:02.937+0000 7fac13946000 1 client.5445 shutdown 2023-11-13T11:30:02.959 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:02.937+0000 7fac13946000 1 -- 172.21.15.102:0/2065731299 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5634ffe455b0 msgr2=0x5634ffe13910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:30:02.959 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:02.937+0000 7fac13946000 1 --2- 172.21.15.102:0/2065731299 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5634ffe455b0 0x5634ffe13910 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7fac00001600 tx=0x7fac00059050 comp rx=0 tx=0).stop 2023-11-13T11:30:02.959 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:02.937+0000 7fac13946000 1 -- 172.21.15.102:0/2065731299 shutdown_connections 2023-11-13T11:30:02.959 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:02.937+0000 7fac13946000 1 --2- 172.21.15.102:0/2065731299 >> [v2:172.21.15.102:6835/3869977039,v1:172.21.15.102:6837/3869977039] conn(0x5634ffe14320 0x5634ffe56f50 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:30:02.959 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:02.937+0000 7fac13946000 1 --2- 172.21.15.102:0/2065731299 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5634ffe455b0 0x5634ffe13910 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:30:02.959 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:02.937+0000 7fac13946000 1 --2- 172.21.15.102:0/2065731299 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5634ffe44c90 0x5634ffe00280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:30:02.960 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:02.937+0000 7fac13946000 1 --2- 172.21.15.102:0/2065731299 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x5634ffdfb320 0x5634ffdffd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:30:02.960 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:02.937+0000 7fabe97fa640 0 client.5445 ms_handle_reset on v2:172.21.15.102:6835/3869977039 2023-11-13T11:30:02.960 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:02.937+0000 7fac13946000 1 -- 172.21.15.102:0/2065731299 >> 172.21.15.102:0/2065731299 conn(0x5634ffdf72d0 msgr2=0x5634ffdf96c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-13T11:30:02.960 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:02.937+0000 7fac13946000 1 -- 172.21.15.102:0/2065731299 shutdown_connections 2023-11-13T11:30:02.960 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:02.937+0000 7fac13946000 1 -- 172.21.15.102:0/2065731299 wait complete. 2023-11-13T11:30:02.961 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:02.937+0000 7fac13946000 20 client.5445 trim_cache size 0 max 16384 2023-11-13T11:30:02.962 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:02.953+0000 7fac13946000 1 Processor -- start 2023-11-13T11:30:02.962 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:02.953+0000 7fac13946000 1 -- start start 2023-11-13T11:30:02.962 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:02.953+0000 7fac13946000 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5634ffdfb320 0x5634ffe42b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:30:02.962 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:02.953+0000 7fac13946000 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5634ffe44c90 0x5634ffe43070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:30:02.963 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:02.953+0000 7fac13946000 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x5634ffe455b0 0x5634ffdfb700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:30:02.963 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:02.953+0000 7fac13946000 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x5634ff904940 con 0x5634ffdfb320 2023-11-13T11:30:02.963 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:02.953+0000 7fac13946000 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x5634ffc48bc0 con 0x5634ffe44c90 2023-11-13T11:30:02.963 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:02.953+0000 7fac13946000 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x5634ffe00fb0 con 0x5634ffe455b0 2023-11-13T11:30:02.963 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:02.953+0000 7fac0e37b640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5634ffdfb320 0x5634ffe42b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:30:02.964 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:02.953+0000 7fac0e37b640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5634ffdfb320 0x5634ffe42b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:38406/0 (socket says 172.21.15.102:38406) 2023-11-13T11:30:02.964 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:02.953+0000 7fac0e37b640 1 -- 172.21.15.102:0/891591594 learned_addr learned my addr 172.21.15.102:0/891591594 (peer_addr_for_me v2:172.21.15.102:0/0) 2023-11-13T11:30:02.966 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:02.953+0000 7fac0e37b640 1 -- 172.21.15.102:0/891591594 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x5634ffe455b0 msgr2=0x5634ffdfb700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-13T11:30:02.967 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:02.953+0000 7fac0e37b640 1 --2- 172.21.15.102:0/891591594 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x5634ffe455b0 0x5634ffdfb700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:30:02.967 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:02.953+0000 7fac0e37b640 1 -- 172.21.15.102:0/891591594 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5634ffe44c90 msgr2=0x5634ffe43070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-13T11:30:02.967 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:02.953+0000 7fac0e37b640 1 --2- 172.21.15.102:0/891591594 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5634ffe44c90 0x5634ffe43070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:30:02.967 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:02.953+0000 7fac0e37b640 1 -- 172.21.15.102:0/891591594 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5634ffbf2490 con 0x5634ffdfb320 2023-11-13T11:30:02.967 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:02.953+0000 7fac0e37b640 1 --2- 172.21.15.102:0/891591594 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5634ffdfb320 0x5634ffe42b30 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7fac04024040 tx=0x7fac04016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bc5698abc12af419 server_cookie=0 in_seq=0 out_seq=0 2023-11-13T11:30:02.968 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:02.957+0000 7fabfcff9640 1 -- 172.21.15.102:0/891591594 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac04009380 con 0x5634ffdfb320 2023-11-13T11:30:02.968 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:02.957+0000 7fabfcff9640 1 -- 172.21.15.102:0/891591594 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac04034040 con 0x5634ffdfb320 2023-11-13T11:30:02.968 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:02.957+0000 7fabfcff9640 1 -- 172.21.15.102:0/891591594 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac04035d00 con 0x5634ffdfb320 2023-11-13T11:30:02.968 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:02.957+0000 7fac13946000 1 -- 172.21.15.102:0/891591594 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5634ffdfb320 msgr2=0x5634ffe42b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:30:02.968 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:02.957+0000 7fac13946000 1 --2- 172.21.15.102:0/891591594 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5634ffdfb320 0x5634ffe42b30 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7fac04024040 tx=0x7fac04016000 comp rx=0 tx=0).stop 2023-11-13T11:30:02.969 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:02.957+0000 7fac13946000 1 -- 172.21.15.102:0/891591594 shutdown_connections 2023-11-13T11:30:02.969 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:02.957+0000 7fac13946000 1 --2- 172.21.15.102:0/891591594 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x5634ffe455b0 0x5634ffdfb700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:30:02.969 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:02.957+0000 7fac13946000 1 --2- 172.21.15.102:0/891591594 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5634ffe44c90 0x5634ffe43070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:30:02.969 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:02.957+0000 7fac13946000 1 --2- 172.21.15.102:0/891591594 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5634ffdfb320 0x5634ffe42b30 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:30:02.969 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:02.957+0000 7fac13946000 1 -- 172.21.15.102:0/891591594 >> 172.21.15.102:0/891591594 conn(0x5634ffdf72d0 msgr2=0x5634ffe59190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-13T11:30:02.969 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:02.957+0000 7fac13946000 1 -- 172.21.15.102:0/891591594 shutdown_connections 2023-11-13T11:30:02.970 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:02.957+0000 7fac13946000 1 -- 172.21.15.102:0/891591594 wait complete. 2023-11-13T11:30:02.970 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:02.957+0000 7fac13946000 1 -- start start 2023-11-13T11:30:02.970 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:02.957+0000 7fac13946000 1 Processor -- start 2023-11-13T11:30:02.970 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:02.957+0000 7fac13946000 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x5634ffdfb320 0x5634ffea5a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:30:02.970 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:02.957+0000 7fac13946000 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5634ffe44c90 0x5634ffea5f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:30:02.971 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:02.957+0000 7fac13946000 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5634ffe455b0 0x5634ffe56f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:30:02.971 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:02.957+0000 7fac13946000 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x5634ffc8d140 con 0x5634ffe44c90 2023-11-13T11:30:02.971 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:02.957+0000 7fac13946000 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x5634ffc44d40 con 0x5634ffe455b0 2023-11-13T11:30:02.971 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:02.957+0000 7fac13946000 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x5634ffdfeeb0 con 0x5634ffdfb320 2023-11-13T11:30:02.971 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:02.957+0000 7fac13946000 10 client.0 _ll_register_callbacks cb 0x5634ffc99c00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-13T11:30:02.972 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:02.957+0000 7fac0db7a640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5634ffe44c90 0x5634ffea5f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:30:02.972 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:02.957+0000 7fac0db7a640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5634ffe44c90 0x5634ffea5f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:38418/0 (socket says 172.21.15.102:38418) 2023-11-13T11:30:02.972 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:02.957+0000 7fac0db7a640 1 -- 172.21.15.102:0/251516134 learned_addr learned my addr 172.21.15.102:0/251516134 (peer_addr_for_me v2:172.21.15.102:0/0) 2023-11-13T11:30:02.972 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:02.957+0000 7fac0e37b640 1 --2- 172.21.15.102:0/251516134 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x5634ffdfb320 0x5634ffea5a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:30:02.972 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:02.957+0000 7fac0eb7c640 1 --2- 172.21.15.102:0/251516134 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5634ffe455b0 0x5634ffe56f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:30:02.972 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:02.957+0000 7fac0db7a640 1 -- 172.21.15.102:0/251516134 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x5634ffdfb320 msgr2=0x5634ffea5a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-13T11:30:02.973 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:02.957+0000 7fac0db7a640 1 --2- 172.21.15.102:0/251516134 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x5634ffdfb320 0x5634ffea5a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:30:02.973 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:02.957+0000 7fac0db7a640 1 -- 172.21.15.102:0/251516134 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5634ffe455b0 msgr2=0x5634ffe56f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-13T11:30:02.973 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:02.957+0000 7fac0db7a640 1 --2- 172.21.15.102:0/251516134 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5634ffe455b0 0x5634ffe56f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:30:02.973 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:02.957+0000 7fac0db7a640 1 -- 172.21.15.102:0/251516134 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5634ff943890 con 0x5634ffe44c90 2023-11-13T11:30:02.973 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:02.957+0000 7fac0db7a640 1 --2- 172.21.15.102:0/251516134 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5634ffe44c90 0x5634ffea5f70 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7fabf80097c0 tx=0x7fabf801ac90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2a88413104bf9a17 server_cookie=0 in_seq=0 out_seq=0 2023-11-13T11:30:02.974 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:02.957+0000 7fabe97fa640 10 client.0 ms_handle_connect on v2:172.21.15.102:3300/0 2023-11-13T11:30:02.976 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:02.957+0000 7fabe97fa640 1 -- 172.21.15.102:0/251516134 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabf80c4070 con 0x5634ffe44c90 2023-11-13T11:30:02.976 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:02.961+0000 7fabe97fa640 1 -- 172.21.15.102:0/251516134 <== mon.0 v2:172.21.15.102:3300/0 2 ==== osd_map(36..36 src has 1..36) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fabf80abbd0 con 0x5634ffe44c90 2023-11-13T11:30:02.977 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:02.961+0000 7fac13946000 1 -- 172.21.15.102:0/251516134 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5634ffc4a110 con 0x5634ffe44c90 2023-11-13T11:30:02.977 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:02.961+0000 7fabe97fa640 1 -- 172.21.15.102:0/251516134 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_get_version_reply(handle=1 version=16) v2 ==== 24+0+0 (secure 0 0 0) 0x7fabf80ba040 con 0x5634ffe44c90 2023-11-13T11:30:02.977 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:02.961+0000 7fac13946000 10 client.5451 fetch_fsmap learned FSMap version 16 2023-11-13T11:30:02.977 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:02.961+0000 7fac13946000 1 -- 172.21.15.102:0/251516134 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,fsmap=16,monmap=2+}) v3 -- 0x5634ff943cc0 con 0x5634ffe44c90 2023-11-13T11:30:02.977 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:02.961+0000 7fabe97fa640 1 -- 172.21.15.102:0/251516134 <== mon.0 v2:172.21.15.102:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5634ffc4a110 con 0x5634ffe44c90 2023-11-13T11:30:02.978 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:02.961+0000 7fabe97fa640 1 -- 172.21.15.102:0/251516134 <== mon.0 v2:172.21.15.102:3300/0 5 ==== fsmap(e 16) v1 ==== 3294+0+0 (secure 0 0 0) 0x7fabf80bd030 con 0x5634ffe44c90 2023-11-13T11:30:02.978 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:02.961+0000 7fac13946000 10 client.5451 fetch_fsmap finished waiting for FSMap version 16 2023-11-13T11:30:02.978 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:02.961+0000 7fac13946000 10 client.5451 resolve_mds: resolved name 'a' to daemon mds.a 2023-11-13T11:30:02.978 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:02.961+0000 7fac13946000 20 client.5451 populate_metadata read hostname 'smithi102' 2023-11-13T11:30:02.979 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:02.961+0000 7fac13946000 1 --2- 172.21.15.102:0/251516134 >> [v2:172.21.15.102:6835/3869977039,v1:172.21.15.102:6837/3869977039] conn(0x5634ffeac890 0x5634ffeaec80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:30:02.979 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:02.961+0000 7fac13946000 4 client.5451 mds_command: new command op to 5274 tid=0 multi_id=0 [{"prefix": "status"}] 2023-11-13T11:30:02.979 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:02.961+0000 7fac13946000 1 -- 172.21.15.102:0/251516134 --> [v2:172.21.15.102:6835/3869977039,v1:172.21.15.102:6837/3869977039] -- command(tid 0: {"prefix": "status"}) v1 -- 0x5634ffc799a0 con 0x5634ffeac890 2023-11-13T11:30:02.979 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:02.961+0000 7fac0e37b640 1 --2- 172.21.15.102:0/251516134 >> [v2:172.21.15.102:6835/3869977039,v1:172.21.15.102:6837/3869977039] conn(0x5634ffeac890 0x5634ffeaec80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:30:02.979 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:02.961+0000 7fac0e37b640 1 --2- 172.21.15.102:0/251516134 >> [v2:172.21.15.102:6835/3869977039,v1:172.21.15.102:6837/3869977039] conn(0x5634ffeac890 0x5634ffeaec80 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=df0a30d8aff49f00 server_cookie=7475f20104f036fe in_seq=0 out_seq=0 2023-11-13T11:30:02.980 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:02.961+0000 7fabe97fa640 10 client.5451 ms_handle_connect on v2:172.21.15.102:6835/3869977039 2023-11-13T11:30:02.980 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:02.961+0000 7fabe97fa640 1 -- 172.21.15.102:0/251516134 <== mds.0 v2:172.21.15.102:6835/3869977039 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+331 (crc 0 0 0) 0x5634ffc799a0 con 0x5634ffeac890 2023-11-13T11:30:02.980 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:02.961+0000 7fabe97fa640 10 client.5451 handle_command_reply: tid=0 2023-11-13T11:30:02.980 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:02.961+0000 7fac13946000 1 client.5451 shutdown 2023-11-13T11:30:02.980 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:02.961+0000 7fac13946000 1 -- 172.21.15.102:0/251516134 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5634ffe44c90 msgr2=0x5634ffea5f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:30:02.981 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:02.961+0000 7fac13946000 1 --2- 172.21.15.102:0/251516134 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5634ffe44c90 0x5634ffea5f70 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7fabf80097c0 tx=0x7fabf801ac90 comp rx=0 tx=0).stop 2023-11-13T11:30:02.981 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:02.961+0000 7fac13946000 1 -- 172.21.15.102:0/251516134 shutdown_connections 2023-11-13T11:30:02.981 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:02.961+0000 7fac13946000 1 --2- 172.21.15.102:0/251516134 >> [v2:172.21.15.102:6835/3869977039,v1:172.21.15.102:6837/3869977039] conn(0x5634ffeac890 0x5634ffeaec80 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:30:02.981 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:02.961+0000 7fac13946000 1 --2- 172.21.15.102:0/251516134 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5634ffe455b0 0x5634ffe56f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:30:02.981 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:02.961+0000 7fac13946000 1 --2- 172.21.15.102:0/251516134 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5634ffe44c90 0x5634ffea5f70 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:30:02.981 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:02.961+0000 7fabe97fa640 0 client.5451 ms_handle_reset on v2:172.21.15.102:6835/3869977039 2023-11-13T11:30:02.982 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:02.961+0000 7fac13946000 1 --2- 172.21.15.102:0/251516134 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x5634ffdfb320 0x5634ffea5a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:30:02.982 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:02.961+0000 7fac13946000 1 -- 172.21.15.102:0/251516134 >> 172.21.15.102:0/251516134 conn(0x5634ffdf72d0 msgr2=0x5634ffe52280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-13T11:30:02.982 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:02.961+0000 7fac13946000 1 -- 172.21.15.102:0/251516134 shutdown_connections 2023-11-13T11:30:02.982 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:02.961+0000 7fac13946000 1 -- 172.21.15.102:0/251516134 wait complete. 2023-11-13T11:30:02.982 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:02.961+0000 7fac13946000 20 client.5451 trim_cache size 0 max 16384 2023-11-13T11:30:02.983 INFO:teuthology.orchestra.run.smithi102.stdout:{ 2023-11-13T11:30:02.983 INFO:teuthology.orchestra.run.smithi102.stdout: "cluster_fsid": "97b3eb2b-7ccf-4aae-8d92-bff986c671ea", 2023-11-13T11:30:02.983 INFO:teuthology.orchestra.run.smithi102.stdout: "whoami": 0, 2023-11-13T11:30:02.983 INFO:teuthology.orchestra.run.smithi102.stdout: "id": 5274, 2023-11-13T11:30:02.984 INFO:teuthology.orchestra.run.smithi102.stdout: "want_state": "up:active", 2023-11-13T11:30:02.984 INFO:teuthology.orchestra.run.smithi102.stdout: "state": "up:active", 2023-11-13T11:30:02.984 INFO:teuthology.orchestra.run.smithi102.stdout: "fs_name": "cephfs", 2023-11-13T11:30:02.984 INFO:teuthology.orchestra.run.smithi102.stdout: "rank_uptime": 5.8515475720000003, 2023-11-13T11:30:02.984 INFO:teuthology.orchestra.run.smithi102.stdout: "mdsmap_epoch": 16, 2023-11-13T11:30:02.985 INFO:teuthology.orchestra.run.smithi102.stdout: "osdmap_epoch": 36, 2023-11-13T11:30:02.985 INFO:teuthology.orchestra.run.smithi102.stdout: "osdmap_epoch_barrier": 36, 2023-11-13T11:30:02.985 INFO:teuthology.orchestra.run.smithi102.stdout: "uptime": 13.702904441999999 2023-11-13T11:30:02.985 INFO:teuthology.orchestra.run.smithi102.stdout:} 2023-11-13T11:30:02.986 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:02.961+0000 7fac105df640 1 -- 172.21.15.102:0/2627353148 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7fabec066470 msgr2=0x7fabec068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:30:02.986 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:02.961+0000 7fac105df640 1 --2- 172.21.15.102:0/2627353148 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7fabec066470 0x7fabec068930 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fac04009ac0 tx=0x7fac04009190 comp rx=0 tx=0).stop 2023-11-13T11:30:02.986 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:02.961+0000 7fac105df640 1 -- 172.21.15.102:0/2627353148 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fac08140540 msgr2=0x7fac08162ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:30:02.986 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:02.961+0000 7fac105df640 1 --2- 172.21.15.102:0/2627353148 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fac08140540 0x7fac08162ec0 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7fac0000cb40 tx=0x7fac0000a060 comp rx=0 tx=0).stop 2023-11-13T11:30:02.987 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:02.961+0000 7fac105df640 1 -- 172.21.15.102:0/2627353148 shutdown_connections 2023-11-13T11:30:02.987 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:02.961+0000 7fac105df640 1 --2- 172.21.15.102:0/2627353148 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7fabec066470 0x7fabec068930 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:30:02.987 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:02.961+0000 7fac105df640 1 --2- 172.21.15.102:0/2627353148 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fac08140540 0x7fac08162ec0 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:30:02.987 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:02.961+0000 7fac105df640 1 --2- 172.21.15.102:0/2627353148 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fac08071730 0x7fac0815bf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:30:02.987 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:02.961+0000 7fac105df640 1 --2- 172.21.15.102:0/2627353148 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fac0806caa0 0x7fac081523d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:30:02.988 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:02.961+0000 7fac105df640 1 -- 172.21.15.102:0/2627353148 >> 172.21.15.102:0/2627353148 conn(0x7fac080b0870 msgr2=0x7fac080cde80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-13T11:30:02.988 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:02.961+0000 7fac105df640 1 -- 172.21.15.102:0/2627353148 shutdown_connections 2023-11-13T11:30:02.988 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:02.961+0000 7fac105df640 1 -- 172.21.15.102:0/2627353148 wait complete. 2023-11-13T11:30:02.989 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-11-13T11:30:03.131 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:03.121+0000 7f810eb3e640 1 Processor -- start 2023-11-13T11:30:03.132 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:03.121+0000 7f810eb3e640 1 -- start start 2023-11-13T11:30:03.132 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:03.121+0000 7f810eb3e640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f810813df40 0x7f810815e990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:30:03.132 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:03.121+0000 7f810eb3e640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f810806c1a0 0x7f810813f6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:30:03.132 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:03.121+0000 7f810eb3e640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f810813e530 con 0x7f810806dc70 2023-11-13T11:30:03.133 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:03.121+0000 7f810eb3e640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f810815f290 con 0x7f810806c1a0 2023-11-13T11:30:03.133 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:03.121+0000 7f810eb3e640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f810815f570 con 0x7f810813df40 2023-11-13T11:30:03.133 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:03.121+0000 7f8107fff640 1 --1- >> v1:172.21.15.102:6789/0 conn(0x7f810806dc70 0x7f810806ba90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.102:6789/0 says I am v1:172.21.15.102:57406/0 (socket says 172.21.15.102:57406) 2023-11-13T11:30:03.133 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:03.121+0000 7f8107fff640 1 -- 172.21.15.102:0/2021654253 learned_addr learned my addr 172.21.15.102:0/2021654253 (peer_addr_for_me v1:172.21.15.102:0/0) 2023-11-13T11:30:03.133 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:03.121+0000 7f810d0db640 1 --2- 172.21.15.102:0/2021654253 >> v2:172.21.15.154:3300/0 conn(0x7f810806c1a0 0x7f810813f6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:30:03.134 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:03.121+0000 7f810c8da640 1 --2- 172.21.15.102:0/2021654253 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f810813df40 0x7f810815e990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:30:03.134 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:03.125+0000 7f81077fe640 1 -- 172.21.15.102:0/2021654253 <== mon.0 v1:172.21.15.102:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 438957442 0 0) 0x7f810813e530 con 0x7f810806dc70 2023-11-13T11:30:03.134 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:03.125+0000 7f81077fe640 1 -- 172.21.15.102:0/2021654253 --> v1:172.21.15.102:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f80f8003530 con 0x7f810806dc70 2023-11-13T11:30:03.134 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:03.125+0000 7f810d0db640 1 -- 172.21.15.102:0/2021654253 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f810813df40 msgr2=0x7f810815e990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-13T11:30:03.134 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:03.125+0000 7f810d0db640 1 --2- 172.21.15.102:0/2021654253 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f810813df40 0x7f810815e990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:30:03.135 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:03.125+0000 7f810d0db640 1 -- 172.21.15.102:0/2021654253 >> v1:172.21.15.102:6789/0 conn(0x7f810806dc70 legacy=0x7f810806ba90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:30:03.135 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:03.125+0000 7f810d0db640 1 -- 172.21.15.102:0/2021654253 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f810815f850 con 0x7f810806c1a0 2023-11-13T11:30:03.136 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:03.125+0000 7f810d0db640 1 --2- 172.21.15.102:0/2021654253 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f810806c1a0 0x7f810813f6d0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f8100009d90 tx=0x7f810001c950 comp rx=0 tx=0).ready entity=mon.1 client_cookie=72e34e9806ee3e07 server_cookie=0 in_seq=0 out_seq=0 2023-11-13T11:30:03.136 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:03.125+0000 7f81077fe640 1 -- 172.21.15.102:0/2021654253 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81000a5900 con 0x7f810806c1a0 2023-11-13T11:30:03.137 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:03.125+0000 7f81077fe640 1 -- 172.21.15.102:0/2021654253 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f81000a5a60 con 0x7f810806c1a0 2023-11-13T11:30:03.137 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:03.125+0000 7f81077fe640 1 -- 172.21.15.102:0/2021654253 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81000a5df0 con 0x7f810806c1a0 2023-11-13T11:30:03.137 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:03.125+0000 7f810eb3e640 1 -- 172.21.15.102:0/2021654253 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f810806c1a0 msgr2=0x7f810813f6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:30:03.137 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:03.125+0000 7f810eb3e640 1 --2- 172.21.15.102:0/2021654253 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f810806c1a0 0x7f810813f6d0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f8100009d90 tx=0x7f810001c950 comp rx=0 tx=0).stop 2023-11-13T11:30:03.137 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:03.129+0000 7f810eb3e640 1 -- 172.21.15.102:0/2021654253 shutdown_connections 2023-11-13T11:30:03.138 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:03.129+0000 7f810eb3e640 1 --2- 172.21.15.102:0/2021654253 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f810806c1a0 0x7f810813f6d0 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:30:03.138 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:03.129+0000 7f810eb3e640 1 --2- 172.21.15.102:0/2021654253 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f810813df40 0x7f810815e990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:30:03.138 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:03.129+0000 7f810eb3e640 1 -- 172.21.15.102:0/2021654253 >> 172.21.15.102:0/2021654253 conn(0x7f81080b0870 msgr2=0x7f81080b0c80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-13T11:30:03.138 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:03.129+0000 7f810eb3e640 1 -- 172.21.15.102:0/2021654253 shutdown_connections 2023-11-13T11:30:03.138 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:03.129+0000 7f810eb3e640 1 -- 172.21.15.102:0/2021654253 wait complete. 2023-11-13T11:30:03.140 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:03.129+0000 7f810eb3e640 1 Processor -- start 2023-11-13T11:30:03.141 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:03.129+0000 7f810eb3e640 1 -- start start 2023-11-13T11:30:03.141 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:03.129+0000 7f810eb3e640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f810806c1a0 0x7f8108143080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:30:03.141 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:03.129+0000 7f810eb3e640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f810806dc70 0x7f8108159df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:30:03.141 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:03.129+0000 7f810eb3e640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f810813df40 0x7f8108141690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:30:03.142 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:03.129+0000 7f810eb3e640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8108137270 con 0x7f810813df40 2023-11-13T11:30:03.142 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:03.129+0000 7f810eb3e640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f810813b380 con 0x7f810806c1a0 2023-11-13T11:30:03.142 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:03.129+0000 7f810eb3e640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8108136f00 con 0x7f810806dc70 2023-11-13T11:30:03.142 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:03.129+0000 7f810d0db640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f810813df40 0x7f8108141690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:30:03.142 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:03.129+0000 7f810d0db640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f810813df40 0x7f8108141690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:38424/0 (socket says 172.21.15.102:38424) 2023-11-13T11:30:03.143 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:03.129+0000 7f810d0db640 1 -- 172.21.15.102:0/4065971831 learned_addr learned my addr 172.21.15.102:0/4065971831 (peer_addr_for_me v2:172.21.15.102:0/0) 2023-11-13T11:30:03.143 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:03.129+0000 7f810c8da640 1 --2- 172.21.15.102:0/4065971831 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f810806c1a0 0x7f8108143080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:30:03.143 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:03.129+0000 7f8107fff640 1 --2- 172.21.15.102:0/4065971831 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f810806dc70 0x7f8108159df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:30:03.143 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:03.129+0000 7f810d0db640 1 -- 172.21.15.102:0/4065971831 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f810806dc70 msgr2=0x7f8108159df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:30:03.143 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:03.129+0000 7f810d0db640 1 --2- 172.21.15.102:0/4065971831 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f810806dc70 0x7f8108159df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:30:03.143 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:03.129+0000 7f810d0db640 1 -- 172.21.15.102:0/4065971831 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f810806c1a0 msgr2=0x7f8108143080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:30:03.144 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:03.129+0000 7f810d0db640 1 --2- 172.21.15.102:0/4065971831 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f810806c1a0 0x7f8108143080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:30:03.144 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:03.129+0000 7f810d0db640 1 -- 172.21.15.102:0/4065971831 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8100009a70 con 0x7f810813df40 2023-11-13T11:30:03.144 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:03.133+0000 7f810d0db640 1 --2- 172.21.15.102:0/4065971831 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f810813df40 0x7f8108141690 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f8100009d90 tx=0x7f81000196f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-13T11:30:03.144 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:03.133+0000 7f81057fa640 1 -- 172.21.15.102:0/4065971831 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81000b7850 con 0x7f810813df40 2023-11-13T11:30:03.144 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:03.133+0000 7f81057fa640 1 -- 172.21.15.102:0/4065971831 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f81000b79b0 con 0x7f810813df40 2023-11-13T11:30:03.145 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:03.133+0000 7f81057fa640 1 -- 172.21.15.102:0/4065971831 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81000b7d60 con 0x7f810813df40 2023-11-13T11:30:03.145 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:03.133+0000 7f810eb3e640 1 -- 172.21.15.102:0/4065971831 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f81081435c0 con 0x7f810813df40 2023-11-13T11:30:03.145 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:03.133+0000 7f810eb3e640 1 -- 172.21.15.102:0/4065971831 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f810813adc0 con 0x7f810813df40 2023-11-13T11:30:03.145 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:03.133+0000 7f810eb3e640 1 -- 172.21.15.102:0/4065971831 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f81081373b0 con 0x7f810813df40 2023-11-13T11:30:03.146 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:03.133+0000 7f81057fa640 1 -- 172.21.15.102:0/4065971831 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f81000ad440 con 0x7f810813df40 2023-11-13T11:30:03.146 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:03.133+0000 7f81057fa640 1 --2- 172.21.15.102:0/4065971831 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f80ec0664a0 0x7f80ec068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:30:03.147 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:03.133+0000 7f81057fa640 1 -- 172.21.15.102:0/4065971831 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f810011e540 con 0x7f810813df40 2023-11-13T11:30:03.147 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:03.133+0000 7f810c8da640 1 --2- 172.21.15.102:0/4065971831 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f80ec0664a0 0x7f80ec068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:30:03.147 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:03.133+0000 7f810c8da640 1 --2- 172.21.15.102:0/4065971831 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f80ec0664a0 0x7f80ec068960 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f80fc009ac0 tx=0x7f80fc009190 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-13T11:30:03.147 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:03.137+0000 7f81057fa640 1 -- 172.21.15.102:0/4065971831 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f81081373b0 con 0x7f810813df40 2023-11-13T11:30:03.334 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:03.321+0000 7f810eb3e640 1 -- 172.21.15.102:0/4065971831 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f81081373b0 con 0x7f810813df40 2023-11-13T11:30:03.335 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:03.325+0000 7f81057fa640 1 -- 172.21.15.102:0/4065971831 <== mon.0 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v16) v1 ==== 53+0+73 (secure 0 0 0) 0x7f81081373b0 con 0x7f810813df40 2023-11-13T11:30:03.335 INFO:teuthology.orchestra.run.smithi102.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-11-13T11:30:03.336 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:03.325+0000 7f810eb3e640 1 -- 172.21.15.102:0/4065971831 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f80ec0664a0 msgr2=0x7f80ec068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:30:03.337 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:03.325+0000 7f810eb3e640 1 --2- 172.21.15.102:0/4065971831 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f80ec0664a0 0x7f80ec068960 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f80fc009ac0 tx=0x7f80fc009190 comp rx=0 tx=0).stop 2023-11-13T11:30:03.337 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:03.325+0000 7f810eb3e640 1 -- 172.21.15.102:0/4065971831 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f810813df40 msgr2=0x7f8108141690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:30:03.337 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:03.325+0000 7f810eb3e640 1 --2- 172.21.15.102:0/4065971831 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f810813df40 0x7f8108141690 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f8100009d90 tx=0x7f81000196f0 comp rx=0 tx=0).stop 2023-11-13T11:30:03.337 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:03.325+0000 7f810eb3e640 1 -- 172.21.15.102:0/4065971831 shutdown_connections 2023-11-13T11:30:03.338 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:03.325+0000 7f810eb3e640 1 --2- 172.21.15.102:0/4065971831 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f80ec0664a0 0x7f80ec068960 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:30:03.338 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:03.325+0000 7f810eb3e640 1 --2- 172.21.15.102:0/4065971831 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f810813df40 0x7f8108141690 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:30:03.338 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:03.325+0000 7f810eb3e640 1 --2- 172.21.15.102:0/4065971831 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f810806dc70 0x7f8108159df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:30:03.338 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:03.325+0000 7f810eb3e640 1 --2- 172.21.15.102:0/4065971831 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f810806c1a0 0x7f8108143080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:30:03.338 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:03.325+0000 7f810eb3e640 1 -- 172.21.15.102:0/4065971831 >> 172.21.15.102:0/4065971831 conn(0x7f81080b0870 msgr2=0x7f81080cbb10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-13T11:30:03.339 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:03.325+0000 7f810eb3e640 1 -- 172.21.15.102:0/4065971831 shutdown_connections 2023-11-13T11:30:03.339 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:03.325+0000 7f810eb3e640 1 -- 172.21.15.102:0/4065971831 wait complete. 2023-11-13T11:30:03.352 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-11-13T11:30:03.353 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-11-13T11:30:03.353 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi102.front.sepia.ceph.com 2023-11-13T11:30:03.353 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-11-13T11:30:03.354 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-11-13T11:30:03.354 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-11-13T11:30:03.354 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-11-13T11:30:03.355 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-11-13T11:30:03.355 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-11-13T11:30:03.356 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-13T11:30:03.356 DEBUG:teuthology.orchestra.run.smithi102:> ip addr 2023-11-13T11:30:03.367 INFO:teuthology.orchestra.run.smithi102.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-11-13T11:30:03.368 INFO:teuthology.orchestra.run.smithi102.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-11-13T11:30:03.369 INFO:teuthology.orchestra.run.smithi102.stdout: inet 127.0.0.1/8 scope host lo 2023-11-13T11:30:03.369 INFO:teuthology.orchestra.run.smithi102.stdout: valid_lft forever preferred_lft forever 2023-11-13T11:30:03.369 INFO:teuthology.orchestra.run.smithi102.stdout: inet6 ::1/128 scope host 2023-11-13T11:30:03.369 INFO:teuthology.orchestra.run.smithi102.stdout: valid_lft forever preferred_lft forever 2023-11-13T11:30:03.370 INFO:teuthology.orchestra.run.smithi102.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-11-13T11:30:03.370 INFO:teuthology.orchestra.run.smithi102.stdout: link/ether 0c:c4:7a:d8:d9:dc brd ff:ff:ff:ff:ff:ff 2023-11-13T11:30:03.370 INFO:teuthology.orchestra.run.smithi102.stdout: altname enp7s0f0 2023-11-13T11:30:03.370 INFO:teuthology.orchestra.run.smithi102.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-11-13T11:30:03.370 INFO:teuthology.orchestra.run.smithi102.stdout: link/ether 0c:c4:7a:d8:d9:dd brd ff:ff:ff:ff:ff:ff 2023-11-13T11:30:03.371 INFO:teuthology.orchestra.run.smithi102.stdout: altname enp7s0f1 2023-11-13T11:30:03.371 INFO:teuthology.orchestra.run.smithi102.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-11-13T11:30:03.371 INFO:teuthology.orchestra.run.smithi102.stdout: link/ether 0c:c4:7a:8f:d7:68 brd ff:ff:ff:ff:ff:ff 2023-11-13T11:30:03.371 INFO:teuthology.orchestra.run.smithi102.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-11-13T11:30:03.371 INFO:teuthology.orchestra.run.smithi102.stdout: link/ether 0c:c4:7a:8f:d7:69 brd ff:ff:ff:ff:ff:ff 2023-11-13T11:30:03.372 INFO:teuthology.orchestra.run.smithi102.stdout: inet 172.21.15.102/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2023-11-13T11:30:03.372 INFO:teuthology.orchestra.run.smithi102.stdout: valid_lft 42360sec preferred_lft 42360sec 2023-11-13T11:30:03.372 INFO:teuthology.orchestra.run.smithi102.stdout: inet6 fe80::ec4:7aff:fe8f:d769/64 scope link 2023-11-13T11:30:03.372 INFO:teuthology.orchestra.run.smithi102.stdout: valid_lft forever preferred_lft forever 2023-11-13T11:30:03.372 INFO:teuthology.orchestra.run.smithi102.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-11-13T11:30:03.372 INFO:teuthology.orchestra.run.smithi102.stdout: link/ether 02:42:47:27:4a:d8 brd ff:ff:ff:ff:ff:ff 2023-11-13T11:30:03.373 INFO:teuthology.orchestra.run.smithi102.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-11-13T11:30:03.373 INFO:teuthology.orchestra.run.smithi102.stdout: valid_lft forever preferred_lft forever 2023-11-13T11:30:03.373 INFO:teuthology.orchestra.run.smithi102.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-11-13T11:30:03.373 INFO:teuthology.orchestra.run.smithi102.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2023-11-13T11:30:03.374 INFO:teuthology.orchestra.run.smithi102.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-11-13T11:30:03.374 INFO:teuthology.orchestra.run.smithi102.stdout: valid_lft forever preferred_lft forever 2023-11-13T11:30:03.374 INFO:teuthology.orchestra.run.smithi102.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2023-11-13T11:30:03.374 INFO:teuthology.orchestra.run.smithi102.stdout: valid_lft forever preferred_lft forever 2023-11-13T11:30:03.375 INFO:teuthology.orchestra.run.smithi102.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-11-13T11:30:03.376 INFO:teuthology.orchestra.run.smithi102.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-13T11:30:03.377 INFO:teuthology.orchestra.run.smithi102.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2023-11-13T11:30:03.379 INFO:teuthology.orchestra.run.smithi102.stdout: valid_lft forever preferred_lft forever 2023-11-13T11:30:03.379 INFO:teuthology.orchestra.run.smithi102.stdout:9: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-11-13T11:30:03.379 INFO:teuthology.orchestra.run.smithi102.stdout: link/ether c6:a6:3d:69:d0:db brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-13T11:30:03.379 INFO:teuthology.orchestra.run.smithi102.stdout: inet6 fe80::c4a6:3dff:fe69:d0db/64 scope link 2023-11-13T11:30:03.380 INFO:teuthology.orchestra.run.smithi102.stdout: valid_lft forever preferred_lft forever 2023-11-13T11:30:03.380 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-13T11:30:03.381 DEBUG:teuthology.orchestra.run.smithi102:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-11-13T11:30:03.433 INFO:teuthology.orchestra.run.smithi102.stdout:1 2023-11-13T11:30:03.436 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-13T11:30:03.436 DEBUG:teuthology.orchestra.run.smithi102:> route 2023-11-13T11:30:03.489 INFO:teuthology.orchestra.run.smithi102.stdout:Kernel IP routing table 2023-11-13T11:30:03.490 INFO:teuthology.orchestra.run.smithi102.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-11-13T11:30:03.490 INFO:teuthology.orchestra.run.smithi102.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2023-11-13T11:30:03.490 INFO:teuthology.orchestra.run.smithi102.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-11-13T11:30:03.491 INFO:teuthology.orchestra.run.smithi102.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-11-13T11:30:03.491 INFO:teuthology.orchestra.run.smithi102.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-11-13T11:30:03.491 INFO:teuthology.orchestra.run.smithi102.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-11-13T11:30:03.491 INFO:teuthology.orchestra.run.smithi102.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-11-13T11:30:03.492 INFO:teuthology.orchestra.run.smithi102.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-11-13T11:30:03.492 INFO:teuthology.orchestra.run.smithi102.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-11-13T11:30:03.492 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-13T11:30:03.493 DEBUG:teuthology.orchestra.run.smithi102:> (cd / && exec bash -c ' 2023-11-13T11:30:03.493 DEBUG:teuthology.orchestra.run.smithi102:> set -e 2023-11-13T11:30:03.493 DEBUG:teuthology.orchestra.run.smithi102:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-11-13T11:30:03.494 DEBUG:teuthology.orchestra.run.smithi102:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-11-13T11:30:03.494 DEBUG:teuthology.orchestra.run.smithi102:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-11-13T11:30:03.495 DEBUG:teuthology.orchestra.run.smithi102:> ') 2023-11-13T11:30:03.581 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-13T11:30:03.582 DEBUG:teuthology.orchestra.run.smithi102:> ip netns list 2023-11-13T11:30:03.592 INFO:teuthology.orchestra.run.smithi102.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-11-13T11:30:03.592 INFO:teuthology.orchestra.run.smithi102.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-11-13T11:30:03.593 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-11-13T11:30:03.593 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-13T11:30:03.594 DEBUG:teuthology.orchestra.run.smithi102:> sudo ip link set brx.0 up 2023-11-13T11:30:03.655 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2023-11-13T11:30:03.656 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-13T11:30:03.656 DEBUG:teuthology.orchestra.run.smithi102:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-11-13T11:30:03.707 INFO:teuthology.orchestra.run.smithi102.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-11-13T11:30:03.707 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-13T11:30:03.708 DEBUG:teuthology.orchestra.run.smithi102:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-11-13T11:30:03.759 DEBUG:teuthology.orchestra.run.smithi102:> sudo modprobe fuse 2023-11-13T11:30:03.827 DEBUG:teuthology.orchestra.run.smithi102:> cat /proc/self/mounts | awk '{print $2}' 2023-11-13T11:30:03.880 INFO:teuthology.orchestra.run.smithi102.stdout:/sys 2023-11-13T11:30:03.881 INFO:teuthology.orchestra.run.smithi102.stdout:/proc 2023-11-13T11:30:03.881 INFO:teuthology.orchestra.run.smithi102.stdout:/dev 2023-11-13T11:30:03.881 INFO:teuthology.orchestra.run.smithi102.stdout:/dev/pts 2023-11-13T11:30:03.881 INFO:teuthology.orchestra.run.smithi102.stdout:/run 2023-11-13T11:30:03.882 INFO:teuthology.orchestra.run.smithi102.stdout:/ 2023-11-13T11:30:03.882 INFO:teuthology.orchestra.run.smithi102.stdout:/sys/kernel/security 2023-11-13T11:30:03.882 INFO:teuthology.orchestra.run.smithi102.stdout:/dev/shm 2023-11-13T11:30:03.882 INFO:teuthology.orchestra.run.smithi102.stdout:/run/lock 2023-11-13T11:30:03.883 INFO:teuthology.orchestra.run.smithi102.stdout:/sys/fs/cgroup 2023-11-13T11:30:03.883 INFO:teuthology.orchestra.run.smithi102.stdout:/sys/fs/pstore 2023-11-13T11:30:03.883 INFO:teuthology.orchestra.run.smithi102.stdout:/sys/fs/bpf 2023-11-13T11:30:03.883 INFO:teuthology.orchestra.run.smithi102.stdout:/proc/sys/fs/binfmt_misc 2023-11-13T11:30:03.883 INFO:teuthology.orchestra.run.smithi102.stdout:/dev/hugepages 2023-11-13T11:30:03.883 INFO:teuthology.orchestra.run.smithi102.stdout:/dev/mqueue 2023-11-13T11:30:03.884 INFO:teuthology.orchestra.run.smithi102.stdout:/sys/kernel/debug 2023-11-13T11:30:03.884 INFO:teuthology.orchestra.run.smithi102.stdout:/sys/kernel/tracing 2023-11-13T11:30:03.885 INFO:teuthology.orchestra.run.smithi102.stdout:/proc/fs/nfsd 2023-11-13T11:30:03.885 INFO:teuthology.orchestra.run.smithi102.stdout:/sys/fs/fuse/connections 2023-11-13T11:30:03.885 INFO:teuthology.orchestra.run.smithi102.stdout:/sys/kernel/config 2023-11-13T11:30:03.885 INFO:teuthology.orchestra.run.smithi102.stdout:/run/credentials/systemd-sysusers.service 2023-11-13T11:30:03.885 INFO:teuthology.orchestra.run.smithi102.stdout:/run/rpc_pipefs 2023-11-13T11:30:03.886 INFO:teuthology.orchestra.run.smithi102.stdout:/run/user/1000 2023-11-13T11:30:03.886 INFO:teuthology.orchestra.run.smithi102.stdout:/var/lib/ceph 2023-11-13T11:30:03.886 INFO:teuthology.orchestra.run.smithi102.stdout:/var/lib/ceph/osd/ceph-0 2023-11-13T11:30:03.886 INFO:teuthology.orchestra.run.smithi102.stdout:/var/lib/ceph/osd/ceph-1 2023-11-13T11:30:03.887 INFO:teuthology.orchestra.run.smithi102.stdout:/var/lib/ceph/osd/ceph-2 2023-11-13T11:30:03.887 INFO:teuthology.orchestra.run.smithi102.stdout:/var/lib/ceph/osd/ceph-3 2023-11-13T11:30:03.887 INFO:teuthology.orchestra.run.smithi102.stdout:/run/netns 2023-11-13T11:30:03.887 INFO:teuthology.orchestra.run.smithi102.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-13T11:30:03.887 INFO:teuthology.orchestra.run.smithi102.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-13T11:30:03.888 INFO:teuthology.orchestra.run.smithi102.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-13T11:30:03.888 INFO:teuthology.orchestra.run.smithi102.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-13T11:30:03.889 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-13T11:30:03.889 DEBUG:teuthology.orchestra.run.smithi102:> ls /sys/fs/fuse/connections 2023-11-13T11:30:03.939 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-11-13T11:30:03.939 DEBUG:teuthology.orchestra.run.smithi102:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2023-11-13T11:30:03.986 DEBUG:teuthology.orchestra.run.smithi102:> sudo modprobe fuse 2023-11-13T11:30:04.010 DEBUG:teuthology.orchestra.run.smithi102:> cat /proc/self/mounts | awk '{print $2}' 2023-11-13T11:30:04.062 INFO:teuthology.orchestra.run.smithi102.stdout:/sys 2023-11-13T11:30:04.062 INFO:teuthology.orchestra.run.smithi102.stdout:/proc 2023-11-13T11:30:04.063 INFO:teuthology.orchestra.run.smithi102.stdout:/dev 2023-11-13T11:30:04.063 INFO:teuthology.orchestra.run.smithi102.stdout:/dev/pts 2023-11-13T11:30:04.063 INFO:teuthology.orchestra.run.smithi102.stdout:/run 2023-11-13T11:30:04.063 INFO:teuthology.orchestra.run.smithi102.stdout:/ 2023-11-13T11:30:04.063 INFO:teuthology.orchestra.run.smithi102.stdout:/sys/kernel/security 2023-11-13T11:30:04.064 INFO:teuthology.orchestra.run.smithi102.stdout:/dev/shm 2023-11-13T11:30:04.064 INFO:teuthology.orchestra.run.smithi102.stdout:/run/lock 2023-11-13T11:30:04.064 INFO:teuthology.orchestra.run.smithi102.stdout:/sys/fs/cgroup 2023-11-13T11:30:04.064 INFO:teuthology.orchestra.run.smithi102.stdout:/sys/fs/pstore 2023-11-13T11:30:04.064 INFO:teuthology.orchestra.run.smithi102.stdout:/sys/fs/bpf 2023-11-13T11:30:04.065 INFO:teuthology.orchestra.run.smithi102.stdout:/proc/sys/fs/binfmt_misc 2023-11-13T11:30:04.065 INFO:teuthology.orchestra.run.smithi102.stdout:/dev/hugepages 2023-11-13T11:30:04.065 INFO:teuthology.orchestra.run.smithi102.stdout:/dev/mqueue 2023-11-13T11:30:04.065 INFO:teuthology.orchestra.run.smithi102.stdout:/sys/kernel/debug 2023-11-13T11:30:04.065 INFO:teuthology.orchestra.run.smithi102.stdout:/sys/kernel/tracing 2023-11-13T11:30:04.066 INFO:teuthology.orchestra.run.smithi102.stdout:/proc/fs/nfsd 2023-11-13T11:30:04.066 INFO:teuthology.orchestra.run.smithi102.stdout:/sys/fs/fuse/connections 2023-11-13T11:30:04.066 INFO:teuthology.orchestra.run.smithi102.stdout:/sys/kernel/config 2023-11-13T11:30:04.066 INFO:teuthology.orchestra.run.smithi102.stdout:/run/credentials/systemd-sysusers.service 2023-11-13T11:30:04.066 INFO:teuthology.orchestra.run.smithi102.stdout:/run/rpc_pipefs 2023-11-13T11:30:04.067 INFO:teuthology.orchestra.run.smithi102.stdout:/run/user/1000 2023-11-13T11:30:04.067 INFO:teuthology.orchestra.run.smithi102.stdout:/var/lib/ceph 2023-11-13T11:30:04.067 INFO:teuthology.orchestra.run.smithi102.stdout:/var/lib/ceph/osd/ceph-0 2023-11-13T11:30:04.067 INFO:teuthology.orchestra.run.smithi102.stdout:/var/lib/ceph/osd/ceph-1 2023-11-13T11:30:04.067 INFO:teuthology.orchestra.run.smithi102.stdout:/var/lib/ceph/osd/ceph-2 2023-11-13T11:30:04.068 INFO:teuthology.orchestra.run.smithi102.stdout:/var/lib/ceph/osd/ceph-3 2023-11-13T11:30:04.068 INFO:teuthology.orchestra.run.smithi102.stdout:/run/netns 2023-11-13T11:30:04.068 INFO:teuthology.orchestra.run.smithi102.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-13T11:30:04.068 INFO:teuthology.orchestra.run.smithi102.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-13T11:30:04.068 INFO:teuthology.orchestra.run.smithi102.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-13T11:30:04.069 INFO:teuthology.orchestra.run.smithi102.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-13T11:30:04.070 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-13T11:30:04.070 DEBUG:teuthology.orchestra.run.smithi102:> ls /sys/fs/fuse/connections 2023-11-13T11:30:04.083 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi102.stderr:2023-11-13T11:30:04.073+0000 7f1867a80580 -1 init, newargv = 0x55d4abcd9400 newargc=15 2023-11-13T11:30:04.084 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi102.stderr:ceph-fuse[48433]: starting ceph client 2023-11-13T11:30:04.090 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi102.stderr:ceph-fuse[48433]: starting fuse 2023-11-13T11:30:04.092 INFO:teuthology.orchestra.run.smithi102.stdout:43 2023-11-13T11:30:04.093 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [43] 2023-11-13T11:30:04.093 DEBUG:teuthology.orchestra.run.smithi102:> sudo stdin-killer -- python3 -c ' 2023-11-13T11:30:04.094 DEBUG:teuthology.orchestra.run.smithi102:> import glob 2023-11-13T11:30:04.094 DEBUG:teuthology.orchestra.run.smithi102:> import re 2023-11-13T11:30:04.096 DEBUG:teuthology.orchestra.run.smithi102:> import os 2023-11-13T11:30:04.096 DEBUG:teuthology.orchestra.run.smithi102:> import subprocess 2023-11-13T11:30:04.096 DEBUG:teuthology.orchestra.run.smithi102:> 2023-11-13T11:30:04.097 DEBUG:teuthology.orchestra.run.smithi102:> def _find_admin_socket(client_name): 2023-11-13T11:30:04.097 DEBUG:teuthology.orchestra.run.smithi102:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2023-11-13T11:30:04.098 DEBUG:teuthology.orchestra.run.smithi102:> files = glob.glob(asok_path) 2023-11-13T11:30:04.098 DEBUG:teuthology.orchestra.run.smithi102:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2023-11-13T11:30:04.098 DEBUG:teuthology.orchestra.run.smithi102:> 2023-11-13T11:30:04.099 DEBUG:teuthology.orchestra.run.smithi102:> # Given a non-glob path, it better be there 2023-11-13T11:30:04.100 DEBUG:teuthology.orchestra.run.smithi102:> if "*" not in asok_path: 2023-11-13T11:30:04.100 DEBUG:teuthology.orchestra.run.smithi102:> assert(len(files) == 1) 2023-11-13T11:30:04.100 DEBUG:teuthology.orchestra.run.smithi102:> return files[0] 2023-11-13T11:30:04.101 DEBUG:teuthology.orchestra.run.smithi102:> 2023-11-13T11:30:04.101 DEBUG:teuthology.orchestra.run.smithi102:> for f in files: 2023-11-13T11:30:04.101 DEBUG:teuthology.orchestra.run.smithi102:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-11-13T11:30:04.102 DEBUG:teuthology.orchestra.run.smithi102:> if os.path.exists("/proc/{0}".format(pid)): 2023-11-13T11:30:04.102 DEBUG:teuthology.orchestra.run.smithi102:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-11-13T11:30:04.103 DEBUG:teuthology.orchestra.run.smithi102:> contents = proc_f.read() 2023-11-13T11:30:04.103 DEBUG:teuthology.orchestra.run.smithi102:> if mountpoint in contents: 2023-11-13T11:30:04.103 DEBUG:teuthology.orchestra.run.smithi102:> return f 2023-11-13T11:30:04.104 DEBUG:teuthology.orchestra.run.smithi102:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-11-13T11:30:04.104 DEBUG:teuthology.orchestra.run.smithi102:> 2023-11-13T11:30:04.105 DEBUG:teuthology.orchestra.run.smithi102:> print(_find_admin_socket("client.0")) 2023-11-13T11:30:04.105 DEBUG:teuthology.orchestra.run.smithi102:> ' 2023-11-13T11:30:04.217 INFO:teuthology.orchestra.run.smithi102.stdout:/var/run/ceph/ceph-client.0.48433.asok 2023-11-13T11:30:04.220 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:04 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-11-13T11:30:04.228 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.48433.asok 2023-11-13T11:30:04.229 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-13T11:30:04.229 DEBUG:teuthology.orchestra.run.smithi102:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.48433.asok status 2023-11-13T11:30:04.399 INFO:teuthology.orchestra.run.smithi102.stdout:{ 2023-11-13T11:30:04.399 INFO:teuthology.orchestra.run.smithi102.stdout: "metadata": { 2023-11-13T11:30:04.400 INFO:teuthology.orchestra.run.smithi102.stdout: "ceph_sha1": "35f0debb3cc28955b7132ef4c509cd138a09d56b", 2023-11-13T11:30:04.400 INFO:teuthology.orchestra.run.smithi102.stdout: "ceph_version": "ceph version 18.0.0-7288-g35f0debb (35f0debb3cc28955b7132ef4c509cd138a09d56b) reef (dev)", 2023-11-13T11:30:04.400 INFO:teuthology.orchestra.run.smithi102.stdout: "entity_id": "0", 2023-11-13T11:30:04.400 INFO:teuthology.orchestra.run.smithi102.stdout: "hostname": "smithi102", 2023-11-13T11:30:04.401 INFO:teuthology.orchestra.run.smithi102.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2023-11-13T11:30:04.401 INFO:teuthology.orchestra.run.smithi102.stdout: "pid": "48433", 2023-11-13T11:30:04.401 INFO:teuthology.orchestra.run.smithi102.stdout: "root": "/" 2023-11-13T11:30:04.401 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-11-13T11:30:04.401 INFO:teuthology.orchestra.run.smithi102.stdout: "dentry_count": 0, 2023-11-13T11:30:04.402 INFO:teuthology.orchestra.run.smithi102.stdout: "dentry_pinned_count": 0, 2023-11-13T11:30:04.402 INFO:teuthology.orchestra.run.smithi102.stdout: "id": 5463, 2023-11-13T11:30:04.402 INFO:teuthology.orchestra.run.smithi102.stdout: "inst": { 2023-11-13T11:30:04.402 INFO:teuthology.orchestra.run.smithi102.stdout: "name": { 2023-11-13T11:30:04.402 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "client", 2023-11-13T11:30:04.403 INFO:teuthology.orchestra.run.smithi102.stdout: "num": 5463 2023-11-13T11:30:04.403 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-11-13T11:30:04.403 INFO:teuthology.orchestra.run.smithi102.stdout: "addr": { 2023-11-13T11:30:04.403 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "v1", 2023-11-13T11:30:04.403 INFO:teuthology.orchestra.run.smithi102.stdout: "addr": "192.168.0.1:0", 2023-11-13T11:30:04.403 INFO:teuthology.orchestra.run.smithi102.stdout: "nonce": 4198747207 2023-11-13T11:30:04.404 INFO:teuthology.orchestra.run.smithi102.stdout: } 2023-11-13T11:30:04.404 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-11-13T11:30:04.404 INFO:teuthology.orchestra.run.smithi102.stdout: "addr": { 2023-11-13T11:30:04.404 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "v1", 2023-11-13T11:30:04.404 INFO:teuthology.orchestra.run.smithi102.stdout: "addr": "192.168.0.1:0", 2023-11-13T11:30:04.405 INFO:teuthology.orchestra.run.smithi102.stdout: "nonce": 4198747207 2023-11-13T11:30:04.405 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2023-11-13T11:30:04.405 INFO:teuthology.orchestra.run.smithi102.stdout: "inst_str": "client.5463 192.168.0.1:0/4198747207", 2023-11-13T11:30:04.405 INFO:teuthology.orchestra.run.smithi102.stdout: "addr_str": "192.168.0.1:0/4198747207", 2023-11-13T11:30:04.405 INFO:teuthology.orchestra.run.smithi102.stdout: "inode_count": 1, 2023-11-13T11:30:04.406 INFO:teuthology.orchestra.run.smithi102.stdout: "mds_epoch": 16, 2023-11-13T11:30:04.406 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_epoch": 36, 2023-11-13T11:30:04.406 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_epoch_barrier": 0, 2023-11-13T11:30:04.406 INFO:teuthology.orchestra.run.smithi102.stdout: "blocklisted": false, 2023-11-13T11:30:04.406 INFO:teuthology.orchestra.run.smithi102.stdout: "fs_name": "cephfs" 2023-11-13T11:30:04.406 INFO:teuthology.orchestra.run.smithi102.stdout:} 2023-11-13T11:30:04.415 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-13T11:30:04.416 DEBUG:teuthology.orchestra.run.smithi102:> stat --file-system '--printf=%T 2023-11-13T11:30:04.416 DEBUG:teuthology.orchestra.run.smithi102:> ' -- /home/ubuntu/cephtest/mnt.0 2023-11-13T11:30:04.426 INFO:teuthology.orchestra.run.smithi102.stdout:fuseblk 2023-11-13T11:30:04.427 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2023-11-13T11:30:04.427 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-13T11:30:04.428 DEBUG:teuthology.orchestra.run.smithi102:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-11-13T11:30:04.495 DEBUG:teuthology.orchestra.run.smithi102:> mktemp -d --suffix=xfstests-dev 2023-11-13T11:30:04.546 INFO:teuthology.orchestra.run.smithi102.stdout:/tmp/tmp.EnLPmcWJbzxfstests-dev 2023-11-13T11:30:04.547 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-13T11:30:04.547 DEBUG:teuthology.orchestra.run.smithi102:> (cd /home/ubuntu/cephtest/mnt.0 && exec sudo chmod a+rx /tmp/tmp.EnLPmcWJbzxfstests-dev) 2023-11-13T11:30:04.612 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-13T11:30:04.613 DEBUG:teuthology.orchestra.run.smithi102:> (cd /home/ubuntu/cephtest/mnt.0 && exec git clone https://git.ceph.com/xfstests-dev.git --depth 1 /tmp/tmp.EnLPmcWJbzxfstests-dev) 2023-11-13T11:30:04.668 INFO:teuthology.orchestra.run.smithi102.stderr:Cloning into '/tmp/tmp.EnLPmcWJbzxfstests-dev'... 2023-11-13T11:30:05.494 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-13T11:30:05.495 DEBUG:teuthology.orchestra.run.smithi102:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir test) 2023-11-13T11:30:05.556 DEBUG:teuthology.orchestra.run.smithi102:> mktemp -d --suffix=test 2023-11-13T11:30:05.607 INFO:teuthology.orchestra.run.smithi102.stdout:/tmp/tmp.T3Y73qtatntest 2023-11-13T11:30:05.607 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-13T11:30:05.608 DEBUG:teuthology.orchestra.run.smithi102:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir scratch) 2023-11-13T11:30:05.667 DEBUG:teuthology.orchestra.run.smithi102:> mktemp -d --suffix=scratch 2023-11-13T11:30:05.719 INFO:teuthology.orchestra.run.smithi102.stdout:/tmp/tmp.74zbLM0RV4scratch 2023-11-13T11:30:05.719 INFO:tasks.cephfs.xfstests_dev:distro and version detected is "ubuntu" and "22.04". 2023-11-13T11:30:05.720 DEBUG:teuthology.orchestra.run.smithi102:> sudo apt-get install -y acl attr automake bc dbench dump e2fsprogs fio gawk gcc git indent libacl1-dev libaio-dev libcap-dev libgdbm-dev libtool libtool-bin liburing-dev libuuid1 lvm2 make psmisc python3 quota sed uuid-dev uuid-runtime xfsprogs sqlite3 exfatprogs f2fs-tools ocfs2-tools udftools xfsdump xfslibs-dev 2023-11-13T11:30:05.837 INFO:teuthology.orchestra.run.smithi102.stdout:Reading package lists... 2023-11-13T11:30:06.006 INFO:teuthology.orchestra.run.smithi102.stdout:Building dependency tree... 2023-11-13T11:30:06.007 INFO:teuthology.orchestra.run.smithi102.stdout:Reading state information... 2023-11-13T11:30:06.159 INFO:teuthology.orchestra.run.smithi102.stdout:acl is already the newest version (2.3.1-1). 2023-11-13T11:30:06.160 INFO:teuthology.orchestra.run.smithi102.stdout:acl set to manually installed. 2023-11-13T11:30:06.160 INFO:teuthology.orchestra.run.smithi102.stdout:attr is already the newest version (1:2.5.1-1build1). 2023-11-13T11:30:06.160 INFO:teuthology.orchestra.run.smithi102.stdout:automake is already the newest version (1:1.16.5-1.3). 2023-11-13T11:30:06.161 INFO:teuthology.orchestra.run.smithi102.stdout:bc is already the newest version (1.07.1-3build1). 2023-11-13T11:30:06.161 INFO:teuthology.orchestra.run.smithi102.stdout:gcc is already the newest version (4:11.2.0-1ubuntu1). 2023-11-13T11:30:06.161 INFO:teuthology.orchestra.run.smithi102.stdout:gcc set to manually installed. 2023-11-13T11:30:06.161 INFO:teuthology.orchestra.run.smithi102.stdout:libacl1-dev is already the newest version (2.3.1-1). 2023-11-13T11:30:06.162 INFO:teuthology.orchestra.run.smithi102.stdout:libaio-dev is already the newest version (0.3.112-13build1). 2023-11-13T11:30:06.162 INFO:teuthology.orchestra.run.smithi102.stdout:libtool is already the newest version (2.4.6-15build2). 2023-11-13T11:30:06.162 INFO:teuthology.orchestra.run.smithi102.stdout:libtool-bin is already the newest version (2.4.6-15build2). 2023-11-13T11:30:06.162 INFO:teuthology.orchestra.run.smithi102.stdout:libuuid1 is already the newest version (2.37.2-4ubuntu3). 2023-11-13T11:30:06.163 INFO:teuthology.orchestra.run.smithi102.stdout:lvm2 is already the newest version (2.03.11-2.1ubuntu4). 2023-11-13T11:30:06.163 INFO:teuthology.orchestra.run.smithi102.stdout:make is already the newest version (4.3-4.1build1). 2023-11-13T11:30:06.163 INFO:teuthology.orchestra.run.smithi102.stdout:make set to manually installed. 2023-11-13T11:30:06.163 INFO:teuthology.orchestra.run.smithi102.stdout:psmisc is already the newest version (23.4-2build3). 2023-11-13T11:30:06.164 INFO:teuthology.orchestra.run.smithi102.stdout:quota is already the newest version (4.06-1build2). 2023-11-13T11:30:06.164 INFO:teuthology.orchestra.run.smithi102.stdout:sed is already the newest version (4.8-1ubuntu2). 2023-11-13T11:30:06.164 INFO:teuthology.orchestra.run.smithi102.stdout:uuid-dev is already the newest version (2.37.2-4ubuntu3). 2023-11-13T11:30:06.164 INFO:teuthology.orchestra.run.smithi102.stdout:uuid-runtime is already the newest version (2.37.2-4ubuntu3). 2023-11-13T11:30:06.164 INFO:teuthology.orchestra.run.smithi102.stdout:xfsdump is already the newest version (3.1.9+0+nmu2). 2023-11-13T11:30:06.165 INFO:teuthology.orchestra.run.smithi102.stdout:xfslibs-dev is already the newest version (5.13.0-1ubuntu2). 2023-11-13T11:30:06.165 INFO:teuthology.orchestra.run.smithi102.stdout:xfsprogs is already the newest version (5.13.0-1ubuntu2). 2023-11-13T11:30:06.165 INFO:teuthology.orchestra.run.smithi102.stdout:dbench is already the newest version (4.0-2build1). 2023-11-13T11:30:06.165 INFO:teuthology.orchestra.run.smithi102.stdout:dump is already the newest version (0.4b47-3). 2023-11-13T11:30:06.165 INFO:teuthology.orchestra.run.smithi102.stdout:e2fsprogs is already the newest version (1.46.5-2ubuntu1.1). 2023-11-13T11:30:06.166 INFO:teuthology.orchestra.run.smithi102.stdout:git is already the newest version (1:2.34.1-1ubuntu1.10). 2023-11-13T11:30:06.166 INFO:teuthology.orchestra.run.smithi102.stdout:indent is already the newest version (2.2.12-1ubuntu0.22.04.1). 2023-11-13T11:30:06.166 INFO:teuthology.orchestra.run.smithi102.stdout:python3 is already the newest version (3.10.6-1~22.04). 2023-11-13T11:30:06.166 INFO:teuthology.orchestra.run.smithi102.stdout:The following packages were automatically installed and are no longer required: 2023-11-13T11:30:06.167 INFO:teuthology.orchestra.run.smithi102.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libiscsi7 libpmemobj1 2023-11-13T11:30:06.167 INFO:teuthology.orchestra.run.smithi102.stdout: libpython2-dev libpython2-stdlib libpython2.7 libpython2.7-dev 2023-11-13T11:30:06.167 INFO:teuthology.orchestra.run.smithi102.stdout: libpython2.7-minimal libpython2.7-stdlib linux-image-5.4.0-135-generic 2023-11-13T11:30:06.167 INFO:teuthology.orchestra.run.smithi102.stdout: linux-modules-5.4.0-135-generic python2 python2-dev python2-minimal 2023-11-13T11:30:06.167 INFO:teuthology.orchestra.run.smithi102.stdout: python2.7 python2.7-dev python2.7-minimal 2023-11-13T11:30:06.168 INFO:teuthology.orchestra.run.smithi102.stdout:Use 'sudo apt autoremove' to remove them. 2023-11-13T11:30:06.169 INFO:teuthology.orchestra.run.smithi102.stdout:The following additional packages will be installed: 2023-11-13T11:30:06.169 INFO:teuthology.orchestra.run.smithi102.stdout: libcap2 libcmap4 libcorosync-common4 libdlm3 libpmemblk1 libqb100 2023-11-13T11:30:06.169 INFO:teuthology.orchestra.run.smithi102.stdout:Suggested packages: 2023-11-13T11:30:06.170 INFO:teuthology.orchestra.run.smithi102.stdout: gnuplot gfio python-scipy gawk-doc sqlite3-doc dvd+rw-tools udfclient 2023-11-13T11:30:06.205 INFO:teuthology.orchestra.run.smithi102.stdout:The following NEW packages will be installed: 2023-11-13T11:30:06.205 INFO:teuthology.orchestra.run.smithi102.stdout: exfatprogs f2fs-tools fio libcap-dev libcmap4 libcorosync-common4 libdlm3 2023-11-13T11:30:06.205 INFO:teuthology.orchestra.run.smithi102.stdout: libgdbm-dev libpmemblk1 libqb100 liburing-dev ocfs2-tools sqlite3 udftools 2023-11-13T11:30:06.206 INFO:teuthology.orchestra.run.smithi102.stdout:The following packages will be upgraded: 2023-11-13T11:30:06.207 INFO:teuthology.orchestra.run.smithi102.stdout: gawk libcap2 2023-11-13T11:30:06.391 INFO:teuthology.orchestra.run.smithi102.stdout:2 upgraded, 14 newly installed, 0 to remove and 258 not upgraded. 2023-11-13T11:30:06.391 INFO:teuthology.orchestra.run.smithi102.stdout:Need to get 6,641 kB of archives. 2023-11-13T11:30:06.391 INFO:teuthology.orchestra.run.smithi102.stdout:After this operation, 14.2 MB of additional disk space will be used. 2023-11-13T11:30:06.391 INFO:teuthology.orchestra.run.smithi102.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 gawk amd64 1:5.1.0-1ubuntu0.1 [447 kB] 2023-11-13T11:30:06.934 INFO:teuthology.orchestra.run.smithi102.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy/main amd64 libcorosync-common4 amd64 3.1.6-1ubuntu1 [7,322 B] 2023-11-13T11:30:06.934 INFO:teuthology.orchestra.run.smithi102.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libqb100 amd64 2.0.4-1ubuntu0.2 [74.2 kB] 2023-11-13T11:30:06.944 INFO:teuthology.orchestra.run.smithi102.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy/main amd64 libcmap4 amd64 3.1.6-1ubuntu1 [10.4 kB] 2023-11-13T11:30:06.945 INFO:teuthology.orchestra.run.smithi102.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy/main amd64 libdlm3 amd64 4.1.1-1build1 [14.4 kB] 2023-11-13T11:30:06.947 INFO:teuthology.orchestra.run.smithi102.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy/main amd64 ocfs2-tools amd64 1.8.7-1build1 [646 kB] 2023-11-13T11:30:07.053 INFO:teuthology.orchestra.run.smithi102.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libcap2 amd64 1:2.44-1ubuntu0.22.04.1 [18.3 kB] 2023-11-13T11:30:07.055 INFO:teuthology.orchestra.run.smithi102.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy/universe amd64 exfatprogs amd64 1.1.3-1 [40.3 kB] 2023-11-13T11:30:07.061 INFO:teuthology.orchestra.run.smithi102.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy/universe amd64 f2fs-tools amd64 1.14.0-2build1 [169 kB] 2023-11-13T11:30:07.081 INFO:teuthology.orchestra.run.smithi102.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libpmemblk1 amd64 1.11.1-3build1 [65.6 kB] 2023-11-13T11:30:07.087 INFO:teuthology.orchestra.run.smithi102.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy/universe amd64 fio amd64 3.28-1 [4,047 kB] 2023-11-13T11:30:07.422 INFO:teuthology.orchestra.run.smithi102.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libcap-dev amd64 1:2.44-1ubuntu0.22.04.1 [39.4 kB] 2023-11-13T11:30:07.631 INFO:teuthology.orchestra.run.smithi102.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/main amd64 libgdbm-dev amd64 1.23-1 [117 kB] 2023-11-13T11:30:07.825 INFO:teuthology.orchestra.run.smithi102.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy/main amd64 liburing-dev amd64 2.1-2build1 [51.8 kB] 2023-11-13T11:30:07.865 INFO:teuthology.orchestra.run.smithi102.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 sqlite3 amd64 3.37.2-2ubuntu0.1 [768 kB] 2023-11-13T11:30:08.067 INFO:teuthology.orchestra.run.smithi102.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy/universe amd64 udftools amd64 2.3-1 [125 kB] 2023-11-13T11:30:08.344 INFO:teuthology.orchestra.run.smithi102.stderr:debconf: unable to initialize frontend: Dialog 2023-11-13T11:30:08.344 INFO:teuthology.orchestra.run.smithi102.stderr:debconf: (Dialog frontend will not work on a dumb terminal, an emacs shell buffer, or without a controlling terminal.) 2023-11-13T11:30:08.344 INFO:teuthology.orchestra.run.smithi102.stderr:debconf: falling back to frontend: Readline 2023-11-13T11:30:08.358 INFO:teuthology.orchestra.run.smithi102.stderr:debconf: unable to initialize frontend: Readline 2023-11-13T11:30:08.358 INFO:teuthology.orchestra.run.smithi102.stderr:debconf: (This frontend requires a controlling tty.) 2023-11-13T11:30:08.359 INFO:teuthology.orchestra.run.smithi102.stderr:debconf: falling back to frontend: Teletype 2023-11-13T11:30:08.365 INFO:teuthology.orchestra.run.smithi102.stderr:dpkg-preconfigure: unable to re-open stdin: 2023-11-13T11:30:08.403 INFO:teuthology.orchestra.run.smithi102.stdout:Fetched 6,641 kB in 2s (3,557 kB/s) 2023-11-13T11:30:08.671 INFO:teuthology.orchestra.run.smithi102.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 142648 files and directories currently installed.) 2023-11-13T11:30:08.674 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../0-gawk_1%3a5.1.0-1ubuntu0.1_amd64.deb ... 2023-11-13T11:30:08.803 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking gawk (1:5.1.0-1ubuntu0.1) over (1:5.1.0-1build3) ... 2023-11-13T11:30:09.347 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package libcorosync-common4:amd64. 2023-11-13T11:30:09.362 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../1-libcorosync-common4_3.1.6-1ubuntu1_amd64.deb ... 2023-11-13T11:30:09.447 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking libcorosync-common4:amd64 (3.1.6-1ubuntu1) ... 2023-11-13T11:30:09.759 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package libqb100:amd64. 2023-11-13T11:30:09.773 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../2-libqb100_2.0.4-1ubuntu0.2_amd64.deb ... 2023-11-13T11:30:09.809 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking libqb100:amd64 (2.0.4-1ubuntu0.2) ... 2023-11-13T11:30:10.137 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package libcmap4:amd64. 2023-11-13T11:30:10.152 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../3-libcmap4_3.1.6-1ubuntu1_amd64.deb ... 2023-11-13T11:30:10.229 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking libcmap4:amd64 (3.1.6-1ubuntu1) ... 2023-11-13T11:30:10.574 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package libdlm3:amd64. 2023-11-13T11:30:10.589 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../4-libdlm3_4.1.1-1build1_amd64.deb ... 2023-11-13T11:30:10.632 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking libdlm3:amd64 (4.1.1-1build1) ... 2023-11-13T11:30:11.044 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package ocfs2-tools. 2023-11-13T11:30:11.059 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../5-ocfs2-tools_1.8.7-1build1_amd64.deb ... 2023-11-13T11:30:11.102 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking ocfs2-tools (1.8.7-1build1) ... 2023-11-13T11:30:11.540 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../6-libcap2_1%3a2.44-1ubuntu0.22.04.1_amd64.deb ... 2023-11-13T11:30:11.658 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking libcap2:amd64 (1:2.44-1ubuntu0.22.04.1) over (1:2.44-1build3) ... 2023-11-13T11:30:12.007 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up libcap2:amd64 (1:2.44-1ubuntu0.22.04.1) ... 2023-11-13T11:30:12.292 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package exfatprogs. 2023-11-13T11:30:12.369 INFO:teuthology.orchestra.run.smithi102.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 142722 files and directories currently installed.) 2023-11-13T11:30:12.373 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../0-exfatprogs_1.1.3-1_amd64.deb ... 2023-11-13T11:30:12.416 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking exfatprogs (1.1.3-1) ... 2023-11-13T11:30:12.694 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package f2fs-tools. 2023-11-13T11:30:12.709 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../1-f2fs-tools_1.14.0-2build1_amd64.deb ... 2023-11-13T11:30:12.803 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking f2fs-tools (1.14.0-2build1) ... 2023-11-13T11:30:13.191 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package libpmemblk1:amd64. 2023-11-13T11:30:13.206 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../2-libpmemblk1_1.11.1-3build1_amd64.deb ... 2023-11-13T11:30:13.249 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking libpmemblk1:amd64 (1.11.1-3build1) ... 2023-11-13T11:30:13.610 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package fio. 2023-11-13T11:30:13.626 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../3-fio_3.28-1_amd64.deb ... 2023-11-13T11:30:13.669 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking fio (3.28-1) ... 2023-11-13T11:30:14.072 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package libcap-dev:amd64. 2023-11-13T11:30:14.087 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../4-libcap-dev_1%3a2.44-1ubuntu0.22.04.1_amd64.deb ... 2023-11-13T11:30:14.131 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking libcap-dev:amd64 (1:2.44-1ubuntu0.22.04.1) ... 2023-11-13T11:30:14.370 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package libgdbm-dev:amd64. 2023-11-13T11:30:14.384 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../5-libgdbm-dev_1.23-1_amd64.deb ... 2023-11-13T11:30:14.428 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking libgdbm-dev:amd64 (1.23-1) ... 2023-11-13T11:30:14.773 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package liburing-dev:amd64. 2023-11-13T11:30:14.787 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../6-liburing-dev_2.1-2build1_amd64.deb ... 2023-11-13T11:30:14.831 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking liburing-dev:amd64 (2.1-2build1) ... 2023-11-13T11:30:15.126 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package sqlite3. 2023-11-13T11:30:15.141 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../7-sqlite3_3.37.2-2ubuntu0.1_amd64.deb ... 2023-11-13T11:30:15.185 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking sqlite3 (3.37.2-2ubuntu0.1) ... 2023-11-13T11:30:15.513 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package udftools. 2023-11-13T11:30:15.528 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../8-udftools_2.3-1_amd64.deb ... 2023-11-13T11:30:15.575 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking udftools (2.3-1) ... 2023-11-13T11:30:15.894 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up exfatprogs (1.1.3-1) ... 2023-11-13T11:30:16.018 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up gawk (1:5.1.0-1ubuntu0.1) ... 2023-11-13T11:30:16.278 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up f2fs-tools (1.14.0-2build1) ... 2023-11-13T11:30:16.379 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up libqb100:amd64 (2.0.4-1ubuntu0.2) ... 2023-11-13T11:30:16.480 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up libcorosync-common4:amd64 (3.1.6-1ubuntu1) ... 2023-11-13T11:30:16.590 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up libpmemblk1:amd64 (1.11.1-3build1) ... 2023-11-13T11:30:16.750 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up udftools (2.3-1) ... 2023-11-13T11:30:16.901 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up libdlm3:amd64 (4.1.1-1build1) ... 2023-11-13T11:30:17.027 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up libgdbm-dev:amd64 (1.23-1) ... 2023-11-13T11:30:17.153 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up libcap-dev:amd64 (1:2.44-1ubuntu0.22.04.1) ... 2023-11-13T11:30:17.296 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up sqlite3 (3.37.2-2ubuntu0.1) ... 2023-11-13T11:30:17.397 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up liburing-dev:amd64 (2.1-2build1) ... 2023-11-13T11:30:17.523 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up libcmap4:amd64 (3.1.6-1ubuntu1) ... 2023-11-13T11:30:17.691 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up fio (3.28-1) ... 2023-11-13T11:30:18.293 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up ocfs2-tools (1.8.7-1build1) ... 2023-11-13T11:30:18.588 INFO:teuthology.orchestra.run.smithi102.stdout:debconf: unable to initialize frontend: Dialog 2023-11-13T11:30:18.588 INFO:teuthology.orchestra.run.smithi102.stdout:debconf: (Dialog frontend will not work on a dumb terminal, an emacs shell buffer, or without a controlling terminal.) 2023-11-13T11:30:18.589 INFO:teuthology.orchestra.run.smithi102.stdout:debconf: falling back to frontend: Readline 2023-11-13T11:30:19.646 INFO:teuthology.orchestra.run.smithi102.stdout:Processing triggers for initramfs-tools (0.140ubuntu13.1) ... 2023-11-13T11:30:19.745 INFO:teuthology.orchestra.run.smithi102.stdout:update-initramfs: Generating /boot/initrd.img-6.6.0-rc5-g5b73517e0e2f 2023-11-13T11:30:19.898 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T11:30:19.903 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T11:30:34.995 INFO:teuthology.orchestra.run.smithi102.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2023-11-13T11:30:35.131 INFO:teuthology.orchestra.run.smithi102.stdout:Processing triggers for man-db (2.10.2-1) ... 2023-11-13T11:30:36.507 INFO:teuthology.orchestra.run.smithi102.stdout:Processing triggers for install-info (6.8-4build1) ... 2023-11-13T11:30:37.046 DEBUG:teuthology.orchestra.run.smithi102:> sudo useradd -m fsgqa 2023-11-13T11:30:37.066 INFO:teuthology.orchestra.run.smithi102.stderr:useradd: user 'fsgqa' already exists 2023-11-13T11:30:37.068 DEBUG:teuthology.orchestra.run:got remote process result: 9 2023-11-13T11:30:37.069 DEBUG:teuthology.orchestra.run.smithi102:> sudo groupadd fsgqa 2023-11-13T11:30:37.132 INFO:teuthology.orchestra.run.smithi102.stderr:groupadd: group 'fsgqa' already exists 2023-11-13T11:30:37.134 DEBUG:teuthology.orchestra.run:got remote process result: 9 2023-11-13T11:30:37.135 DEBUG:teuthology.orchestra.run.smithi102:> sudo useradd fsgqa2 2023-11-13T11:30:37.597 DEBUG:teuthology.orchestra.run.smithi102:> sudo useradd 123456-fsgqa 2023-11-13T11:30:37.975 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json mon dump 2023-11-13T11:30:38.112 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:38.104+0000 7f1cc4d72640 1 Processor -- start 2023-11-13T11:30:38.113 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:38.104+0000 7f1cc4d72640 1 -- start start 2023-11-13T11:30:38.114 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:38.104+0000 7f1cc4d72640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f1cc00719b0 0x7f1cc00b2360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:30:38.114 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:38.104+0000 7f1cc4d72640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1cc00b28a0 0x7f1cc0070240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:30:38.115 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:38.104+0000 7f1cc4d72640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1cc00cdc30 con 0x7f1cc015da20 2023-11-13T11:30:38.115 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:38.104+0000 7f1cc4d72640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1cc00b2d30 con 0x7f1cc00719b0 2023-11-13T11:30:38.115 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:38.104+0000 7f1cc4d72640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1cc00cd300 con 0x7f1cc00b28a0 2023-11-13T11:30:38.115 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:38.104+0000 7f1cb5d9b640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f1cc00719b0 0x7f1cc00b2360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:30:38.115 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:38.104+0000 7f1cb5d9b640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f1cc00719b0 0x7f1cc00b2360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:54434/0 (socket says 172.21.15.102:54434) 2023-11-13T11:30:38.116 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:38.104+0000 7f1cbed9d640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1cc00b28a0 0x7f1cc0070240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:30:38.116 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:38.104+0000 7f1cb5d9b640 1 -- 172.21.15.102:0/1519948887 learned_addr learned my addr 172.21.15.102:0/1519948887 (peer_addr_for_me v2:172.21.15.102:0/0) 2023-11-13T11:30:38.116 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:38.104+0000 7f1cb5d9b640 1 -- 172.21.15.102:0/1519948887 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1cc00b28a0 msgr2=0x7f1cc0070240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-13T11:30:38.116 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:38.104+0000 7f1cb5d9b640 1 --2- 172.21.15.102:0/1519948887 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1cc00b28a0 0x7f1cc0070240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:30:38.116 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:38.104+0000 7f1cb5d9b640 1 -- 172.21.15.102:0/1519948887 >> v1:172.21.15.154:6789/0 conn(0x7f1cc015da20 legacy=0x7f1cc015de00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:30:38.117 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:38.104+0000 7f1cb5d9b640 1 -- 172.21.15.102:0/1519948887 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1cc00cd5e0 con 0x7f1cc00719b0 2023-11-13T11:30:38.117 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:38.104+0000 7f1cbdd9b640 1 -- 172.21.15.102:0/1519948887 <== mon.1 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 813599499 0 0) 0x7f1cc00cdc30 con 0x7f1cc015da20 2023-11-13T11:30:38.118 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:38.108+0000 7f1cb5d9b640 1 --2- 172.21.15.102:0/1519948887 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1cc00719b0 0x7f1cc00b2360 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f1ca8009870 tx=0x7f1ca801c510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=77a96fee4b43296e server_cookie=0 in_seq=0 out_seq=0 2023-11-13T11:30:38.119 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:38.108+0000 7f1cbdd9b640 1 -- 172.21.15.102:0/1519948887 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ca80a95f0 con 0x7f1cc00719b0 2023-11-13T11:30:38.119 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:38.108+0000 7f1cbdd9b640 1 -- 172.21.15.102:0/1519948887 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ca80a9750 con 0x7f1cc00719b0 2023-11-13T11:30:38.119 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:38.108+0000 7f1cbdd9b640 1 -- 172.21.15.102:0/1519948887 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ca80a9ae0 con 0x7f1cc00719b0 2023-11-13T11:30:38.120 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:38.108+0000 7f1cc4d72640 1 -- 172.21.15.102:0/1519948887 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1cc00719b0 msgr2=0x7f1cc00b2360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:30:38.120 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:38.108+0000 7f1cc4d72640 1 --2- 172.21.15.102:0/1519948887 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1cc00719b0 0x7f1cc00b2360 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f1ca8009870 tx=0x7f1ca801c510 comp rx=0 tx=0).stop 2023-11-13T11:30:38.120 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:38.108+0000 7f1cc4d72640 1 -- 172.21.15.102:0/1519948887 shutdown_connections 2023-11-13T11:30:38.120 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:38.108+0000 7f1cc4d72640 1 --2- 172.21.15.102:0/1519948887 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1cc00b28a0 0x7f1cc0070240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:30:38.120 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:38.108+0000 7f1cc4d72640 1 --2- 172.21.15.102:0/1519948887 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1cc00719b0 0x7f1cc00b2360 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:30:38.121 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:38.108+0000 7f1cc4d72640 1 -- 172.21.15.102:0/1519948887 >> 172.21.15.102:0/1519948887 conn(0x7f1cc00b0870 msgr2=0x7f1cc00b0c80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-13T11:30:38.121 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:38.108+0000 7f1cc4d72640 1 -- 172.21.15.102:0/1519948887 shutdown_connections 2023-11-13T11:30:38.121 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:38.108+0000 7f1cc4d72640 1 -- 172.21.15.102:0/1519948887 wait complete. 2023-11-13T11:30:38.125 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:38.112+0000 7f1cc4d72640 1 Processor -- start 2023-11-13T11:30:38.126 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:38.112+0000 7f1cc4d72640 1 -- start start 2023-11-13T11:30:38.126 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:38.112+0000 7f1cc4d72640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1cc00719b0 0x7f1cc0160b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:30:38.126 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:38.112+0000 7f1cc4d72640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1cc00b28a0 0x7f1cc0153820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:30:38.126 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:38.112+0000 7f1cc4d72640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1cc015da20 0x7f1cc006c1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:30:38.126 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:38.112+0000 7f1cc4d72640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1cc0155140 con 0x7f1cc00719b0 2023-11-13T11:30:38.127 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:38.112+0000 7f1cc4d72640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1cc0153f20 con 0x7f1cc015da20 2023-11-13T11:30:38.127 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:38.112+0000 7f1cc4d72640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1cc0154200 con 0x7f1cc00b28a0 2023-11-13T11:30:38.127 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:38.112+0000 7f1cbe59c640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1cc00719b0 0x7f1cc0160b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:30:38.127 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:38.112+0000 7f1cbe59c640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1cc00719b0 0x7f1cc0160b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:54450/0 (socket says 172.21.15.102:54450) 2023-11-13T11:30:38.127 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:38.112+0000 7f1cbe59c640 1 -- 172.21.15.102:0/2083932106 learned_addr learned my addr 172.21.15.102:0/2083932106 (peer_addr_for_me v2:172.21.15.102:0/0) 2023-11-13T11:30:38.128 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:38.112+0000 7f1cb5d9b640 1 --2- 172.21.15.102:0/2083932106 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1cc00b28a0 0x7f1cc0153820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:30:38.128 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:38.112+0000 7f1cbed9d640 1 --2- 172.21.15.102:0/2083932106 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1cc015da20 0x7f1cc006c1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:30:38.128 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:38.112+0000 7f1cbe59c640 1 -- 172.21.15.102:0/2083932106 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1cc00b28a0 msgr2=0x7f1cc0153820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:30:38.128 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:38.112+0000 7f1cbe59c640 1 --2- 172.21.15.102:0/2083932106 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1cc00b28a0 0x7f1cc0153820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:30:38.128 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:38.112+0000 7f1cbe59c640 1 -- 172.21.15.102:0/2083932106 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1cc015da20 msgr2=0x7f1cc006c1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:30:38.129 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:38.112+0000 7f1cbe59c640 1 --2- 172.21.15.102:0/2083932106 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1cc015da20 0x7f1cc006c1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:30:38.129 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:38.112+0000 7f1cbe59c640 1 -- 172.21.15.102:0/2083932106 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ca80094d0 con 0x7f1cc00719b0 2023-11-13T11:30:38.129 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:38.112+0000 7f1cbe59c640 1 --2- 172.21.15.102:0/2083932106 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1cc00719b0 0x7f1cc0160b00 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f1cb0001570 tx=0x7f1cb000cd00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-13T11:30:38.129 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:38.112+0000 7f1cb77fe640 1 -- 172.21.15.102:0/2083932106 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cb0003db0 con 0x7f1cc00719b0 2023-11-13T11:30:38.129 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:38.112+0000 7f1cb77fe640 1 -- 172.21.15.102:0/2083932106 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1cb0005070 con 0x7f1cc00719b0 2023-11-13T11:30:38.130 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:38.112+0000 7f1cc4d72640 1 -- 172.21.15.102:0/2083932106 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1cc01544e0 con 0x7f1cc00719b0 2023-11-13T11:30:38.130 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:38.112+0000 7f1cb77fe640 1 -- 172.21.15.102:0/2083932106 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cb0005420 con 0x7f1cc00719b0 2023-11-13T11:30:38.130 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:38.112+0000 7f1cc4d72640 1 -- 172.21.15.102:0/2083932106 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1cc0154aa0 con 0x7f1cc00719b0 2023-11-13T11:30:38.130 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:38.116+0000 7f1cc4d72640 1 -- 172.21.15.102:0/2083932106 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1cc0159080 con 0x7f1cc00719b0 2023-11-13T11:30:38.130 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:38.116+0000 7f1cb77fe640 1 -- 172.21.15.102:0/2083932106 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f1cb0005580 con 0x7f1cc00719b0 2023-11-13T11:30:38.131 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:38.116+0000 7f1cb77fe640 1 --2- 172.21.15.102:0/2083932106 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f1ca0066470 0x7f1ca0068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:30:38.131 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:38.116+0000 7f1cb77fe640 1 -- 172.21.15.102:0/2083932106 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f1cb00837c0 con 0x7f1cc00719b0 2023-11-13T11:30:38.131 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:38.116+0000 7f1cb5d9b640 1 --2- 172.21.15.102:0/2083932106 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f1ca0066470 0x7f1ca0068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:30:38.132 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:38.116+0000 7f1cb5d9b640 1 --2- 172.21.15.102:0/2083932106 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f1ca0066470 0x7f1ca0068930 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f1ca80ae000 tx=0x7f1ca8009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-13T11:30:38.132 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:38.120+0000 7f1cb77fe640 1 -- 172.21.15.102:0/2083932106 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f1cc0159080 con 0x7f1cc00719b0 2023-11-13T11:30:38.331 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:38.324+0000 7f1cc4d72640 1 -- 172.21.15.102:0/2083932106 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f1cc0159080 con 0x7f1cc00719b0 2023-11-13T11:30:38.332 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:38.324+0000 7f1cb77fe640 1 -- 172.21.15.102:0/2083932106 <== mon.0 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+1280 (secure 0 0 0) 0x7f1cc0159080 con 0x7f1cc00719b0 2023-11-13T11:30:38.332 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T11:30:38.332 INFO:teuthology.orchestra.run.smithi102.stdout:{"epoch":1,"fsid":"97b3eb2b-7ccf-4aae-8d92-bff986c671ea","modified":"2023-11-13T11:27:51.374606Z","created":"2023-11-13T11:27:51.374606Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:3300","nonce":0},{"type":"v1","addr":"172.21.15.102:6789","nonce":0}]},"addr":"172.21.15.102:6789/0","public_addr":"172.21.15.102:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:3300","nonce":0},{"type":"v1","addr":"172.21.15.154:6789","nonce":0}]},"addr":"172.21.15.154:6789/0","public_addr":"172.21.15.154:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:3301","nonce":0},{"type":"v1","addr":"172.21.15.154:6790","nonce":0}]},"addr":"172.21.15.154:6790/0","public_addr":"172.21.15.154:6790/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1,2]} 2023-11-13T11:30:38.333 INFO:teuthology.orchestra.run.smithi102.stderr:dumped monmap epoch 1 2023-11-13T11:30:38.334 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:38.324+0000 7f1cc4d72640 1 -- 172.21.15.102:0/2083932106 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f1ca0066470 msgr2=0x7f1ca0068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:30:38.334 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:38.324+0000 7f1cc4d72640 1 --2- 172.21.15.102:0/2083932106 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f1ca0066470 0x7f1ca0068930 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f1ca80ae000 tx=0x7f1ca8009040 comp rx=0 tx=0).stop 2023-11-13T11:30:38.334 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:38.324+0000 7f1cc4d72640 1 -- 172.21.15.102:0/2083932106 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1cc00719b0 msgr2=0x7f1cc0160b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:30:38.334 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:38.324+0000 7f1cc4d72640 1 --2- 172.21.15.102:0/2083932106 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1cc00719b0 0x7f1cc0160b00 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f1cb0001570 tx=0x7f1cb000cd00 comp rx=0 tx=0).stop 2023-11-13T11:30:38.334 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:38.324+0000 7f1cc4d72640 1 -- 172.21.15.102:0/2083932106 shutdown_connections 2023-11-13T11:30:38.335 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:38.324+0000 7f1cc4d72640 1 --2- 172.21.15.102:0/2083932106 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1cc015da20 0x7f1cc006c1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:30:38.335 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:38.324+0000 7f1cc4d72640 1 --2- 172.21.15.102:0/2083932106 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1cc00b28a0 0x7f1cc0153820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:30:38.335 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:38.324+0000 7f1cc4d72640 1 --2- 172.21.15.102:0/2083932106 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f1ca0066470 0x7f1ca0068930 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:30:38.335 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:38.324+0000 7f1cc4d72640 1 --2- 172.21.15.102:0/2083932106 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1cc00719b0 0x7f1cc0160b00 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:30:38.335 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:38.324+0000 7f1cc4d72640 1 -- 172.21.15.102:0/2083932106 >> 172.21.15.102:0/2083932106 conn(0x7f1cc00b0870 msgr2=0x7f1cc00ad730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-13T11:30:38.336 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:38.324+0000 7f1cc4d72640 1 -- 172.21.15.102:0/2083932106 shutdown_connections 2023-11-13T11:30:38.336 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:38.324+0000 7f1cc4d72640 1 -- 172.21.15.102:0/2083932106 wait complete. 2023-11-13T11:30:38.353 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth get client.admin 2023-11-13T11:30:38.491 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:38.484+0000 7f34578d6640 1 Processor -- start 2023-11-13T11:30:38.492 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:38.484+0000 7f34578d6640 1 -- start start 2023-11-13T11:30:38.493 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:38.484+0000 7f34578d6640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f345013df40 0x7f345015e990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:30:38.493 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:38.484+0000 7f34578d6640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f345006dc70 0x7f345006ba90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:30:38.494 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:38.484+0000 7f34578d6640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f345013e530 con 0x7f345006bfd0 2023-11-13T11:30:38.494 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:38.484+0000 7f34578d6640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f345006c460 con 0x7f345013df40 2023-11-13T11:30:38.494 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:38.484+0000 7f34578d6640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f345015f290 con 0x7f345006dc70 2023-11-13T11:30:38.494 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:38.484+0000 7f3455672640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f345013df40 0x7f345015e990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:30:38.494 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:38.484+0000 7f3455672640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f345013df40 0x7f345015e990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:54456/0 (socket says 172.21.15.102:54456) 2023-11-13T11:30:38.495 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:38.484+0000 7f3455672640 1 -- 172.21.15.102:0/4208803325 learned_addr learned my addr 172.21.15.102:0/4208803325 (peer_addr_for_me v2:172.21.15.102:0/0) 2023-11-13T11:30:38.495 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:38.484+0000 7f3455e73640 1 --1- >> v1:172.21.15.102:6789/0 conn(0x7f345006bfd0 0x7f34500cd260 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.102:6789/0 says I am v1:172.21.15.102:37762/0 (socket says 172.21.15.102:37762) 2023-11-13T11:30:38.495 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:38.484+0000 7f3454e71640 1 --2- 172.21.15.102:0/4208803325 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f345006dc70 0x7f345006ba90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:30:38.495 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:38.484+0000 7f3455672640 1 -- 172.21.15.102:0/4208803325 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f345006dc70 msgr2=0x7f345006ba90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-13T11:30:38.495 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:38.484+0000 7f3455672640 1 --2- 172.21.15.102:0/4208803325 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f345006dc70 0x7f345006ba90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:30:38.496 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:38.484+0000 7f3455672640 1 -- 172.21.15.102:0/4208803325 >> v1:172.21.15.102:6789/0 conn(0x7f345006bfd0 legacy=0x7f34500cd260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:30:38.496 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:38.484+0000 7f3455672640 1 -- 172.21.15.102:0/4208803325 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f345015f570 con 0x7f345013df40 2023-11-13T11:30:38.497 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:38.488+0000 7f3455672640 1 --2- 172.21.15.102:0/4208803325 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f345013df40 0x7f345015e990 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f344c009870 tx=0x7f344c01c540 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f9930178de432a1d server_cookie=0 in_seq=0 out_seq=0 2023-11-13T11:30:38.497 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:38.488+0000 7f3447fff640 1 -- 172.21.15.102:0/4208803325 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f344c0a7070 con 0x7f345013df40 2023-11-13T11:30:38.497 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:38.488+0000 7f3447fff640 1 -- 172.21.15.102:0/4208803325 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f344c0ab430 con 0x7f345013df40 2023-11-13T11:30:38.497 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:38.488+0000 7f3447fff640 1 -- 172.21.15.102:0/4208803325 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f344c0ab7c0 con 0x7f345013df40 2023-11-13T11:30:38.498 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:38.488+0000 7f34578d6640 1 -- 172.21.15.102:0/4208803325 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f345013df40 msgr2=0x7f345015e990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:30:38.498 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:38.488+0000 7f34578d6640 1 --2- 172.21.15.102:0/4208803325 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f345013df40 0x7f345015e990 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f344c009870 tx=0x7f344c01c540 comp rx=0 tx=0).stop 2023-11-13T11:30:38.499 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:38.488+0000 7f34578d6640 1 -- 172.21.15.102:0/4208803325 shutdown_connections 2023-11-13T11:30:38.499 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:38.488+0000 7f34578d6640 1 --2- 172.21.15.102:0/4208803325 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f345006dc70 0x7f345006ba90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:30:38.500 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:38.488+0000 7f34578d6640 1 --2- 172.21.15.102:0/4208803325 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f345013df40 0x7f345015e990 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:30:38.500 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:38.488+0000 7f34578d6640 1 -- 172.21.15.102:0/4208803325 >> 172.21.15.102:0/4208803325 conn(0x7f34500b0870 msgr2=0x7f34500b0c80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-13T11:30:38.500 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:38.488+0000 7f34578d6640 1 -- 172.21.15.102:0/4208803325 shutdown_connections 2023-11-13T11:30:38.500 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:38.488+0000 7f34578d6640 1 -- 172.21.15.102:0/4208803325 wait complete. 2023-11-13T11:30:38.503 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:38.492+0000 7f34578d6640 1 Processor -- start 2023-11-13T11:30:38.503 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:38.492+0000 7f34578d6640 1 -- start start 2023-11-13T11:30:38.503 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:38.492+0000 7f34578d6640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f345006bfd0 0x7f34501f8e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:30:38.504 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:38.492+0000 7f34578d6640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f345006dc70 0x7f3450142010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:30:38.504 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:38.492+0000 7f34578d6640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f345013df40 0x7f3450142550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:30:38.504 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:38.492+0000 7f34578d6640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3450134940 con 0x7f345006dc70 2023-11-13T11:30:38.504 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:38.492+0000 7f34578d6640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3450134c20 con 0x7f345013df40 2023-11-13T11:30:38.504 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:38.492+0000 7f34578d6640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3450134f00 con 0x7f345006bfd0 2023-11-13T11:30:38.505 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:38.492+0000 7f3454e71640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f345006dc70 0x7f3450142010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:30:38.505 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:38.492+0000 7f3454e71640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f345006dc70 0x7f3450142010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:54472/0 (socket says 172.21.15.102:54472) 2023-11-13T11:30:38.505 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:38.492+0000 7f3454e71640 1 -- 172.21.15.102:0/853215805 learned_addr learned my addr 172.21.15.102:0/853215805 (peer_addr_for_me v2:172.21.15.102:0/0) 2023-11-13T11:30:38.505 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:38.492+0000 7f3455672640 1 --2- 172.21.15.102:0/853215805 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f345006bfd0 0x7f34501f8e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:30:38.505 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:38.492+0000 7f3455e73640 1 --2- 172.21.15.102:0/853215805 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f345013df40 0x7f3450142550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:30:38.506 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:38.492+0000 7f3454e71640 1 -- 172.21.15.102:0/853215805 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f345006bfd0 msgr2=0x7f34501f8e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:30:38.506 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:38.492+0000 7f3454e71640 1 --2- 172.21.15.102:0/853215805 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f345006bfd0 0x7f34501f8e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:30:38.506 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:38.492+0000 7f3454e71640 1 -- 172.21.15.102:0/853215805 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f345013df40 msgr2=0x7f3450142550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:30:38.506 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:38.492+0000 7f3454e71640 1 --2- 172.21.15.102:0/853215805 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f345013df40 0x7f3450142550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:30:38.507 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:38.492+0000 7f3454e71640 1 -- 172.21.15.102:0/853215805 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f344c0094d0 con 0x7f345006dc70 2023-11-13T11:30:38.507 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:38.492+0000 7f3454e71640 1 --2- 172.21.15.102:0/853215805 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f345006dc70 0x7f3450142010 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f344000d7d0 tx=0x7f344000dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-13T11:30:38.507 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:38.492+0000 7f3445ffb640 1 -- 172.21.15.102:0/853215805 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f344000b6c0 con 0x7f345006dc70 2023-11-13T11:30:38.507 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:38.492+0000 7f3445ffb640 1 -- 172.21.15.102:0/853215805 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f344000b820 con 0x7f345006dc70 2023-11-13T11:30:38.507 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:38.492+0000 7f3445ffb640 1 -- 172.21.15.102:0/853215805 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f344000bbd0 con 0x7f345006dc70 2023-11-13T11:30:38.507 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:38.492+0000 7f34578d6640 1 -- 172.21.15.102:0/853215805 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f34501351e0 con 0x7f345006dc70 2023-11-13T11:30:38.508 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:38.492+0000 7f34578d6640 1 -- 172.21.15.102:0/853215805 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f34501344b0 con 0x7f345006dc70 2023-11-13T11:30:38.508 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:38.492+0000 7f34578d6640 1 -- 172.21.15.102:0/853215805 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3450068520 con 0x7f345006dc70 2023-11-13T11:30:38.509 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:38.496+0000 7f3445ffb640 1 -- 172.21.15.102:0/853215805 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f344000bd30 con 0x7f345006dc70 2023-11-13T11:30:38.509 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:38.496+0000 7f3445ffb640 1 --2- 172.21.15.102:0/853215805 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f3434066470 0x7f3434068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T11:30:38.509 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:38.496+0000 7f3445ffb640 1 -- 172.21.15.102:0/853215805 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f3440084410 con 0x7f345006dc70 2023-11-13T11:30:38.510 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:38.496+0000 7f3455672640 1 --2- 172.21.15.102:0/853215805 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f3434066470 0x7f3434068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T11:30:38.510 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:38.496+0000 7f3455672640 1 --2- 172.21.15.102:0/853215805 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f3434066470 0x7f3434068930 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f344c0af000 tx=0x7f344c008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-13T11:30:38.510 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:38.500+0000 7f3445ffb640 1 -- 172.21.15.102:0/853215805 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f3440051880 con 0x7f345006dc70 2023-11-13T11:30:38.711 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:38.704+0000 7f34578d6640 1 -- 172.21.15.102:0/853215805 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "auth get", "entity": "client.admin"} v 0) v1 -- 0x7f34500ce690 con 0x7f345006dc70 2023-11-13T11:30:38.711 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:38.704+0000 7f3445ffb640 1 -- 172.21.15.102:0/853215805 <== mon.0 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{"prefix": "auth get", "entity": "client.admin"}]=0 v11) v1 ==== 82+0+151 (secure 0 0 0) 0x7f3440054ea0 con 0x7f345006dc70 2023-11-13T11:30:38.712 INFO:teuthology.orchestra.run.smithi102.stdout:[client.admin] 2023-11-13T11:30:38.712 INFO:teuthology.orchestra.run.smithi102.stdout: key = AQA3CFJloHUXJBAAfS9vthrU8x6VhOXCTJgyLg== 2023-11-13T11:30:38.712 INFO:teuthology.orchestra.run.smithi102.stdout: caps mds = "allow *" 2023-11-13T11:30:38.713 INFO:teuthology.orchestra.run.smithi102.stdout: caps mgr = "allow *" 2023-11-13T11:30:38.713 INFO:teuthology.orchestra.run.smithi102.stdout: caps mon = "allow *" 2023-11-13T11:30:38.713 INFO:teuthology.orchestra.run.smithi102.stdout: caps osd = "allow *" 2023-11-13T11:30:38.714 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:38.704+0000 7f34578d6640 1 -- 172.21.15.102:0/853215805 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f3434066470 msgr2=0x7f3434068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:30:38.714 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:38.704+0000 7f34578d6640 1 --2- 172.21.15.102:0/853215805 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f3434066470 0x7f3434068930 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f344c0af000 tx=0x7f344c008040 comp rx=0 tx=0).stop 2023-11-13T11:30:38.714 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:38.704+0000 7f34578d6640 1 -- 172.21.15.102:0/853215805 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f345006dc70 msgr2=0x7f3450142010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T11:30:38.715 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:38.704+0000 7f34578d6640 1 --2- 172.21.15.102:0/853215805 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f345006dc70 0x7f3450142010 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f344000d7d0 tx=0x7f344000dc90 comp rx=0 tx=0).stop 2023-11-13T11:30:38.715 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:38.704+0000 7f34578d6640 1 -- 172.21.15.102:0/853215805 shutdown_connections 2023-11-13T11:30:38.715 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:38.704+0000 7f34578d6640 1 --2- 172.21.15.102:0/853215805 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f345013df40 0x7f3450142550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:30:38.715 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:38.704+0000 7f34578d6640 1 --2- 172.21.15.102:0/853215805 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f3434066470 0x7f3434068930 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:30:38.715 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:38.704+0000 7f34578d6640 1 --2- 172.21.15.102:0/853215805 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f345006dc70 0x7f3450142010 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:30:38.716 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:38.704+0000 7f34578d6640 1 --2- 172.21.15.102:0/853215805 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f345006bfd0 0x7f34501f8e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T11:30:38.716 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:38.704+0000 7f34578d6640 1 -- 172.21.15.102:0/853215805 >> 172.21.15.102:0/853215805 conn(0x7f34500b0870 msgr2=0x7f34500ae8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-13T11:30:38.716 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:38.704+0000 7f34578d6640 1 -- 172.21.15.102:0/853215805 shutdown_connections 2023-11-13T11:30:38.717 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T11:30:38.704+0000 7f34578d6640 1 -- 172.21.15.102:0/853215805 wait complete. 2023-11-13T11:30:38.733 DEBUG:teuthology.orchestra.run.smithi102:> mktemp 2023-11-13T11:30:38.744 INFO:teuthology.orchestra.run.smithi102.stdout:/tmp/tmp.kYyGQE1Sj7 2023-11-13T11:30:38.745 DEBUG:teuthology.orchestra.run.smithi102:> set -ex 2023-11-13T11:30:38.745 DEBUG:teuthology.orchestra.run.smithi102:> dd of=/tmp/tmp.kYyGQE1Sj7 2023-11-13T11:30:38.799 DEBUG:teuthology.orchestra.run.smithi102:> set -ex 2023-11-13T11:30:38.799 DEBUG:teuthology.orchestra.run.smithi102:> sudo dd of=/tmp/tmp.EnLPmcWJbzxfstests-dev/local.config 2023-11-13T11:30:38.862 INFO:tasks.cephfs.xfstests_dev:local.config's contents - export FSTYP=ceph-fuse export CEPH_FUSE_BIN_PATH=ceph-fuse export TEST_DEV=ceph-fuse # without this tests won't get started export TEST_DIR=/tmp/tmp.T3Y73qtatntest export SCRATCH_DEV= export SCRATCH_MNT=/tmp/tmp.74zbLM0RV4scratch export CEPHFS_MOUNT_OPTIONS="-m 172.21.15.102:6789 -k /tmp/tmp.kYyGQE1Sj7 --client_mountpoint /test" 2023-11-13T11:30:38.863 DEBUG:teuthology.orchestra.run.smithi102:> set -ex 2023-11-13T11:30:38.863 DEBUG:teuthology.orchestra.run.smithi102:> sudo dd of=/tmp/tmp.EnLPmcWJbzxfstests-dev/ceph.exclude 2023-11-13T11:30:38.926 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo make) 2023-11-13T11:30:38.991 INFO:teuthology.orchestra.run.smithi102.stdout:libtoolize -cfi 2023-11-13T11:30:39.350 INFO:teuthology.orchestra.run.smithi102.stdout:libtoolize: putting auxiliary files in '.'. 2023-11-13T11:30:39.351 INFO:teuthology.orchestra.run.smithi102.stdout:libtoolize: copying file './config.guess' 2023-11-13T11:30:39.360 INFO:teuthology.orchestra.run.smithi102.stdout:libtoolize: copying file './config.sub' 2023-11-13T11:30:39.373 INFO:teuthology.orchestra.run.smithi102.stdout:libtoolize: copying file './install-sh' 2023-11-13T11:30:39.385 INFO:teuthology.orchestra.run.smithi102.stdout:libtoolize: copying file './ltmain.sh' 2023-11-13T11:30:39.438 INFO:teuthology.orchestra.run.smithi102.stdout:libtoolize: putting macros in AC_CONFIG_MACRO_DIRS, 'm4'. 2023-11-13T11:30:39.438 INFO:teuthology.orchestra.run.smithi102.stdout:libtoolize: copying file 'm4/libtool.m4' 2023-11-13T11:30:39.449 INFO:teuthology.orchestra.run.smithi102.stdout:libtoolize: copying file 'm4/ltoptions.m4' 2023-11-13T11:30:39.460 INFO:teuthology.orchestra.run.smithi102.stdout:libtoolize: copying file 'm4/ltsugar.m4' 2023-11-13T11:30:39.471 INFO:teuthology.orchestra.run.smithi102.stdout:libtoolize: copying file 'm4/ltversion.m4' 2023-11-13T11:30:39.481 INFO:teuthology.orchestra.run.smithi102.stdout:libtoolize: copying file 'm4/lt~obsolete.m4' 2023-11-13T11:30:39.492 INFO:teuthology.orchestra.run.smithi102.stdout:libtoolize: Consider adding '-I m4' to ACLOCAL_AMFLAGS in Makefile.am. 2023-11-13T11:30:39.494 INFO:teuthology.orchestra.run.smithi102.stdout:cp include/install-sh . 2023-11-13T11:30:39.496 INFO:teuthology.orchestra.run.smithi102.stdout:aclocal -I m4 2023-11-13T11:30:40.529 INFO:teuthology.orchestra.run.smithi102.stdout:autoheader 2023-11-13T11:30:40.891 INFO:teuthology.orchestra.run.smithi102.stdout:autoconf 2023-11-13T11:30:41.295 INFO:teuthology.orchestra.run.smithi102.stdout:./configure \ 2023-11-13T11:30:41.295 INFO:teuthology.orchestra.run.smithi102.stdout: --libexecdir=/usr/lib \ 2023-11-13T11:30:41.295 INFO:teuthology.orchestra.run.smithi102.stdout: --exec_prefix=/var/lib 2023-11-13T11:30:41.840 INFO:teuthology.orchestra.run.smithi102.stdout:checking build system type... x86_64-pc-linux-gnu 2023-11-13T11:30:41.840 INFO:teuthology.orchestra.run.smithi102.stdout:checking host system type... x86_64-pc-linux-gnu 2023-11-13T11:30:41.896 INFO:teuthology.orchestra.run.smithi102.stdout:checking how to print strings... printf 2023-11-13T11:30:41.896 INFO:teuthology.orchestra.run.smithi102.stdout:checking for gcc... gcc 2023-11-13T11:30:42.112 INFO:teuthology.orchestra.run.smithi102.stdout:checking whether the C compiler works... yes 2023-11-13T11:30:42.112 INFO:teuthology.orchestra.run.smithi102.stdout:checking for C compiler default output file name... a.out 2023-11-13T11:30:42.155 INFO:teuthology.orchestra.run.smithi102.stdout:checking for suffix of executables... 2023-11-13T11:30:42.268 INFO:teuthology.orchestra.run.smithi102.stdout:checking whether we are cross compiling... no 2023-11-13T11:30:42.295 INFO:teuthology.orchestra.run.smithi102.stdout:checking for suffix of object files... o 2023-11-13T11:30:42.319 INFO:teuthology.orchestra.run.smithi102.stdout:checking whether the compiler supports GNU C... yes 2023-11-13T11:30:42.342 INFO:teuthology.orchestra.run.smithi102.stdout:checking whether gcc accepts -g... yes 2023-11-13T11:30:42.463 INFO:teuthology.orchestra.run.smithi102.stdout:checking for gcc option to enable C11 features... none needed 2023-11-13T11:30:42.469 INFO:teuthology.orchestra.run.smithi102.stdout:checking for a sed that does not truncate output... /usr/bin/sed 2023-11-13T11:30:42.474 INFO:teuthology.orchestra.run.smithi102.stdout:checking for grep that handles long lines and -e... /usr/bin/grep 2023-11-13T11:30:42.477 INFO:teuthology.orchestra.run.smithi102.stdout:checking for egrep... /usr/bin/grep -E 2023-11-13T11:30:42.480 INFO:teuthology.orchestra.run.smithi102.stdout:checking for fgrep... /usr/bin/grep -F 2023-11-13T11:30:42.487 INFO:teuthology.orchestra.run.smithi102.stdout:checking for ld used by gcc... /usr/bin/ld 2023-11-13T11:30:42.491 INFO:teuthology.orchestra.run.smithi102.stdout:checking if the linker (/usr/bin/ld) is GNU ld... yes 2023-11-13T11:30:42.510 INFO:teuthology.orchestra.run.smithi102.stdout:checking for BSD- or MS-compatible name lister (nm)... /usr/bin/nm -B 2023-11-13T11:30:42.539 INFO:teuthology.orchestra.run.smithi102.stdout:checking the name lister (/usr/bin/nm -B) interface... BSD nm 2023-11-13T11:30:42.540 INFO:teuthology.orchestra.run.smithi102.stdout:checking whether ln -s works... yes 2023-11-13T11:30:42.556 INFO:teuthology.orchestra.run.smithi102.stdout:checking the maximum length of command line arguments... 1572864 2023-11-13T11:30:42.562 INFO:teuthology.orchestra.run.smithi102.stdout:checking how to convert x86_64-pc-linux-gnu file names to x86_64-pc-linux-gnu format... func_convert_file_noop 2023-11-13T11:30:42.562 INFO:teuthology.orchestra.run.smithi102.stdout:checking how to convert x86_64-pc-linux-gnu file names to toolchain format... func_convert_file_noop 2023-11-13T11:30:42.562 INFO:teuthology.orchestra.run.smithi102.stdout:checking for /usr/bin/ld option to reload object files... -r 2023-11-13T11:30:42.564 INFO:teuthology.orchestra.run.smithi102.stdout:checking for objdump... objdump 2023-11-13T11:30:42.564 INFO:teuthology.orchestra.run.smithi102.stdout:checking how to recognize dependent libraries... pass_all 2023-11-13T11:30:42.564 INFO:teuthology.orchestra.run.smithi102.stdout:checking for dlltool... no 2023-11-13T11:30:42.565 INFO:teuthology.orchestra.run.smithi102.stdout:checking how to associate runtime and link libraries... printf %s\n 2023-11-13T11:30:42.565 INFO:teuthology.orchestra.run.smithi102.stdout:checking for ar... ar 2023-11-13T11:30:42.618 INFO:teuthology.orchestra.run.smithi102.stdout:checking for archiver @FILE support... @ 2023-11-13T11:30:42.618 INFO:teuthology.orchestra.run.smithi102.stdout:checking for strip... strip 2023-11-13T11:30:42.619 INFO:teuthology.orchestra.run.smithi102.stdout:checking for ranlib... ranlib 2023-11-13T11:30:42.619 INFO:teuthology.orchestra.run.smithi102.stdout:checking for gawk... gawk 2023-11-13T11:30:42.707 INFO:teuthology.orchestra.run.smithi102.stdout:checking command to parse /usr/bin/nm -B output from gcc object... ok 2023-11-13T11:30:42.713 INFO:teuthology.orchestra.run.smithi102.stdout:checking for sysroot... no 2023-11-13T11:30:42.718 INFO:teuthology.orchestra.run.smithi102.stdout:checking for a working dd... /usr/bin/dd 2023-11-13T11:30:42.725 INFO:teuthology.orchestra.run.smithi102.stdout:checking how to truncate binary pipes... /usr/bin/dd bs=4096 count=1 2023-11-13T11:30:42.745 INFO:teuthology.orchestra.run.smithi102.stdout:checking for mt... mt 2023-11-13T11:30:42.768 INFO:teuthology.orchestra.run.smithi102.stdout:checking if mt is a manifest tool... no 2023-11-13T11:30:42.799 INFO:teuthology.orchestra.run.smithi102.stdout:checking for stdio.h... yes 2023-11-13T11:30:42.852 INFO:teuthology.orchestra.run.smithi102.stdout:checking for stdlib.h... yes 2023-11-13T11:30:42.888 INFO:teuthology.orchestra.run.smithi102.stdout:checking for string.h... yes 2023-11-13T11:30:42.923 INFO:teuthology.orchestra.run.smithi102.stdout:checking for inttypes.h... yes 2023-11-13T11:30:42.980 INFO:teuthology.orchestra.run.smithi102.stdout:checking for stdint.h... yes 2023-11-13T11:30:43.013 INFO:teuthology.orchestra.run.smithi102.stdout:checking for strings.h... yes 2023-11-13T11:30:43.048 INFO:teuthology.orchestra.run.smithi102.stdout:checking for sys/stat.h... yes 2023-11-13T11:30:43.081 INFO:teuthology.orchestra.run.smithi102.stdout:checking for sys/types.h... yes 2023-11-13T11:30:43.122 INFO:teuthology.orchestra.run.smithi102.stdout:checking for unistd.h... yes 2023-11-13T11:30:43.164 INFO:teuthology.orchestra.run.smithi102.stdout:checking for dlfcn.h... yes 2023-11-13T11:30:43.170 INFO:teuthology.orchestra.run.smithi102.stdout:checking for objdir... .libs 2023-11-13T11:30:43.289 INFO:teuthology.orchestra.run.smithi102.stdout:checking if gcc supports -fno-rtti -fno-exceptions... no 2023-11-13T11:30:43.289 INFO:teuthology.orchestra.run.smithi102.stdout:checking for gcc option to produce PIC... -fPIC -DPIC 2023-11-13T11:30:43.317 INFO:teuthology.orchestra.run.smithi102.stdout:checking if gcc PIC flag -fPIC -DPIC works... yes 2023-11-13T11:30:43.534 INFO:teuthology.orchestra.run.smithi102.stdout:checking if gcc static flag -static works... yes 2023-11-13T11:30:43.576 INFO:teuthology.orchestra.run.smithi102.stdout:checking if gcc supports -c -o file.o... yes 2023-11-13T11:30:43.577 INFO:teuthology.orchestra.run.smithi102.stdout:checking if gcc supports -c -o file.o... (cached) yes 2023-11-13T11:30:43.591 INFO:teuthology.orchestra.run.smithi102.stdout:checking whether the gcc linker (/usr/bin/ld -m elf_x86_64) supports shared libraries... yes 2023-11-13T11:30:43.626 INFO:teuthology.orchestra.run.smithi102.stdout:checking whether -lc should be explicitly linked in... no 2023-11-13T11:30:43.734 INFO:teuthology.orchestra.run.smithi102.stdout:checking dynamic linker characteristics... GNU/Linux ld.so 2023-11-13T11:30:43.734 INFO:teuthology.orchestra.run.smithi102.stdout:checking how to hardcode library paths into programs... immediate 2023-11-13T11:30:43.748 INFO:teuthology.orchestra.run.smithi102.stdout:checking whether stripping libraries is possible... yes 2023-11-13T11:30:43.748 INFO:teuthology.orchestra.run.smithi102.stdout:checking if libtool supports shared libraries... yes 2023-11-13T11:30:43.748 INFO:teuthology.orchestra.run.smithi102.stdout:checking whether to build shared libraries... yes 2023-11-13T11:30:43.748 INFO:teuthology.orchestra.run.smithi102.stdout:checking whether to build static libraries... yes 2023-11-13T11:30:43.763 INFO:teuthology.orchestra.run.smithi102.stdout:checking for gcc... (cached) gcc 2023-11-13T11:30:43.806 INFO:teuthology.orchestra.run.smithi102.stdout:checking whether the compiler supports GNU C... (cached) yes 2023-11-13T11:30:43.806 INFO:teuthology.orchestra.run.smithi102.stdout:checking whether gcc accepts -g... (cached) yes 2023-11-13T11:30:43.807 INFO:teuthology.orchestra.run.smithi102.stdout:checking for gcc option to enable C11 features... (cached) none needed 2023-11-13T11:30:43.807 INFO:teuthology.orchestra.run.smithi102.stdout:checking for gmake... /usr/bin/gmake 2023-11-13T11:30:43.807 INFO:teuthology.orchestra.run.smithi102.stderr:./configure: line 12753: test: $(SHELL): binary operator expected 2023-11-13T11:30:43.808 INFO:teuthology.orchestra.run.smithi102.stdout:checking for tar... /bin/tar 2023-11-13T11:30:43.808 INFO:teuthology.orchestra.run.smithi102.stdout:checking for gzip... /bin/gzip 2023-11-13T11:30:43.822 INFO:teuthology.orchestra.run.smithi102.stdout:checking whether gcc -MM is supported... yes 2023-11-13T11:30:43.823 INFO:teuthology.orchestra.run.smithi102.stdout:checking for sort... /bin/sort 2023-11-13T11:30:43.823 INFO:teuthology.orchestra.run.smithi102.stdout:checking whether ln -s works... yes 2023-11-13T11:30:43.824 INFO:teuthology.orchestra.run.smithi102.stdout:checking for rpm... no 2023-11-13T11:30:43.863 INFO:teuthology.orchestra.run.smithi102.stdout:checking for assert.h... yes 2023-11-13T11:30:43.906 INFO:teuthology.orchestra.run.smithi102.stdout:checking for bstring.h... no 2023-11-13T11:30:43.944 INFO:teuthology.orchestra.run.smithi102.stdout:checking for libgen.h... yes 2023-11-13T11:30:44.016 INFO:teuthology.orchestra.run.smithi102.stdout:checking for dirent.h... yes 2023-11-13T11:30:44.111 INFO:teuthology.orchestra.run.smithi102.stdout:checking for errno.h... yes 2023-11-13T11:30:44.151 INFO:teuthology.orchestra.run.smithi102.stdout:checking for malloc.h... yes 2023-11-13T11:30:44.193 INFO:teuthology.orchestra.run.smithi102.stdout:checking for uuid.h... no 2023-11-13T11:30:44.255 INFO:teuthology.orchestra.run.smithi102.stdout:checking for uuid/uuid.h... yes 2023-11-13T11:30:44.296 INFO:teuthology.orchestra.run.smithi102.stdout:checking for sys/uuid.h... no 2023-11-13T11:30:44.337 INFO:teuthology.orchestra.run.smithi102.stdout:checking for sys/file.h... yes 2023-11-13T11:30:44.376 INFO:teuthology.orchestra.run.smithi102.stdout:checking for sys/fcntl.h... yes 2023-11-13T11:30:44.418 INFO:teuthology.orchestra.run.smithi102.stdout:checking for sys/syssgi.h... no 2023-11-13T11:30:44.488 INFO:teuthology.orchestra.run.smithi102.stdout:checking for sys/param.h... yes 2023-11-13T11:30:44.488 INFO:teuthology.orchestra.run.smithi102.stdout:checking for sys/stat.h... (cached) yes 2023-11-13T11:30:44.526 INFO:teuthology.orchestra.run.smithi102.stdout:checking for sys/statvfs.h... yes 2023-11-13T11:30:44.565 INFO:teuthology.orchestra.run.smithi102.stdout:checking for sys/time.h... yes 2023-11-13T11:30:44.631 INFO:teuthology.orchestra.run.smithi102.stdout:checking for sys/ioctl.h... yes 2023-11-13T11:30:44.677 INFO:teuthology.orchestra.run.smithi102.stdout:checking for sys/wait.h... yes 2023-11-13T11:30:44.677 INFO:teuthology.orchestra.run.smithi102.stdout:checking for sys/types.h... (cached) yes 2023-11-13T11:30:44.678 INFO:teuthology.orchestra.run.smithi102.stdout:checking for strings.h... (cached) yes 2023-11-13T11:30:44.716 INFO:teuthology.orchestra.run.smithi102.stdout:checking for err.h... yes 2023-11-13T11:30:44.756 INFO:teuthology.orchestra.run.smithi102.stdout:checking for linux/falloc.h... yes 2023-11-13T11:30:44.797 INFO:teuthology.orchestra.run.smithi102.stdout:checking for sys/fs/xfs_fsops.h... no 2023-11-13T11:30:44.838 INFO:teuthology.orchestra.run.smithi102.stdout:checking for sys/fs/xfs_itable.h... no 2023-11-13T11:30:44.887 INFO:teuthology.orchestra.run.smithi102.stdout:checking for xfs/platform_defs.h... no 2023-11-13T11:30:44.929 INFO:teuthology.orchestra.run.smithi102.stdout:checking for btrfs/ioctl.h... no 2023-11-13T11:30:44.972 INFO:teuthology.orchestra.run.smithi102.stdout:checking for cifs/ioctl.h... no 2023-11-13T11:30:45.020 INFO:teuthology.orchestra.run.smithi102.stdout:checking for sys/mman.h... yes 2023-11-13T11:30:45.044 INFO:teuthology.orchestra.run.smithi102.stdout:checking for xfs/xfs_log_format.h... no 2023-11-13T11:30:45.103 INFO:teuthology.orchestra.run.smithi102.stdout:checking for uuid_compare... no 2023-11-13T11:30:45.151 INFO:teuthology.orchestra.run.smithi102.stdout:checking for uuid_compare in -luuid... yes 2023-11-13T11:30:45.301 INFO:teuthology.orchestra.run.smithi102.stdout:checking for xfs/xfs.h... yes 2023-11-13T11:30:45.325 INFO:teuthology.orchestra.run.smithi102.stdout:checking for xfs/libxfs.h... no 2023-11-13T11:30:45.385 INFO:teuthology.orchestra.run.smithi102.stdout:checking for gcc options needed to detect all undeclared functions... none needed 2023-11-13T11:30:45.418 INFO:teuthology.orchestra.run.smithi102.stdout:checking whether xlog_assign_lsn is declared... no 2023-11-13T11:30:45.466 INFO:teuthology.orchestra.run.smithi102.stdout:checking for xfs/xqm.h... yes 2023-11-13T11:30:45.540 INFO:teuthology.orchestra.run.smithi102.stdout:checking xfsctl from xfs/xfs.h... ok 2023-11-13T11:30:45.580 INFO:teuthology.orchestra.run.smithi102.stdout:checking for xfs/handle.h... yes 2023-11-13T11:30:45.629 INFO:teuthology.orchestra.run.smithi102.stdout:checking for attr_list_by_handle in -lhandle... yes 2023-11-13T11:30:45.673 INFO:teuthology.orchestra.run.smithi102.stdout:checking for sys/acl.h... yes 2023-11-13T11:30:45.712 INFO:teuthology.orchestra.run.smithi102.stdout:checking for acl/libacl.h... yes 2023-11-13T11:30:45.762 INFO:teuthology.orchestra.run.smithi102.stdout:checking for acl_init in -lacl... yes 2023-11-13T11:30:45.803 INFO:teuthology.orchestra.run.smithi102.stdout:checking for gdbm-ndbm.h... no 2023-11-13T11:30:45.845 INFO:teuthology.orchestra.run.smithi102.stdout:checking for gdbm/ndbm.h... no 2023-11-13T11:30:45.887 INFO:teuthology.orchestra.run.smithi102.stdout:checking for ndbm.h... no 2023-11-13T11:30:45.928 INFO:teuthology.orchestra.run.smithi102.stdout:checking for libaio.h... yes 2023-11-13T11:30:45.992 INFO:teuthology.orchestra.run.smithi102.stdout:checking for liburing.h... yes 2023-11-13T11:30:46.039 INFO:teuthology.orchestra.run.smithi102.stdout:checking for sys/capability.h... yes 2023-11-13T11:30:46.079 INFO:teuthology.orchestra.run.smithi102.stdout:checking for linux/fiemap.h... yes 2023-11-13T11:30:46.129 INFO:teuthology.orchestra.run.smithi102.stdout:checking for fallocate... yes 2023-11-13T11:30:46.182 INFO:teuthology.orchestra.run.smithi102.stdout:checking for open_by_handle_at... yes 2023-11-13T11:30:46.224 INFO:teuthology.orchestra.run.smithi102.stdout:checking for sys/prctl.h... yes 2023-11-13T11:30:46.263 INFO:teuthology.orchestra.run.smithi102.stdout:checking for linux/fs.h... yes 2023-11-13T11:30:46.305 INFO:teuthology.orchestra.run.smithi102.stdout:checking for btrfsutil.h... no 2023-11-13T11:30:46.361 INFO:teuthology.orchestra.run.smithi102.stdout:checking for copy_file_range... yes 2023-11-13T11:30:46.419 INFO:teuthology.orchestra.run.smithi102.stdout:checking for SEEK_DATA... yes 2023-11-13T11:30:46.495 INFO:teuthology.orchestra.run.smithi102.stdout:checking for BMV_OF_SHARED... yes 2023-11-13T11:30:46.550 INFO:teuthology.orchestra.run.smithi102.stdout:checking for nftw... yes 2023-11-13T11:30:46.604 INFO:teuthology.orchestra.run.smithi102.stdout:checking for RLIMIT_NOFILE... yes 2023-11-13T11:30:46.641 INFO:teuthology.orchestra.run.smithi102.stdout:checking for FIEXCHANGE_RANGE... no 2023-11-13T11:30:46.694 INFO:teuthology.orchestra.run.smithi102.stdout:checking for renameat2... yes 2023-11-13T11:30:46.746 INFO:teuthology.orchestra.run.smithi102.stdout:checking for reallocarray... yes 2023-11-13T11:30:46.797 INFO:teuthology.orchestra.run.smithi102.stdout:checking for struct mount_attr... yes 2023-11-13T11:30:46.863 INFO:teuthology.orchestra.run.smithi102.stdout:checking for struct btrfs_qgroup_limit... yes 2023-11-13T11:30:46.916 INFO:teuthology.orchestra.run.smithi102.stdout:checking for struct btrfs_qgroup_inherit... yes 2023-11-13T11:30:46.970 INFO:teuthology.orchestra.run.smithi102.stdout:checking for struct btrfs_ioctl_vol_args... yes 2023-11-13T11:30:47.024 INFO:teuthology.orchestra.run.smithi102.stdout:checking for struct btrfs_ioctl_vol_args_v2... yes 2023-11-13T11:30:47.079 INFO:teuthology.orchestra.run.smithi102.stdout:checking for struct btrfs_ioctl_ino_lookup_args... yes 2023-11-13T11:30:47.133 INFO:teuthology.orchestra.run.smithi102.stdout:checking for struct btrfs_ioctl_ino_lookup_user_args... yes 2023-11-13T11:30:47.186 INFO:teuthology.orchestra.run.smithi102.stdout:checking for struct btrfs_ioctl_get_subvol_rootref_args... yes 2023-11-13T11:30:47.226 INFO:teuthology.orchestra.run.smithi102.stdout:checking for linux/btrfs.h... yes 2023-11-13T11:30:47.267 INFO:teuthology.orchestra.run.smithi102.stdout:checking for linux/btrfs_tree.h... yes 2023-11-13T11:30:47.294 INFO:teuthology.orchestra.run.smithi102.stdout:checking for struct btrfs_ioctl_vol_args_v2.subvolid... yes 2023-11-13T11:30:47.321 INFO:teuthology.orchestra.run.smithi102.stdout:configure: creating ./config.status 2023-11-13T11:30:48.166 INFO:teuthology.orchestra.run.smithi102.stdout:config.status: creating include/builddefs 2023-11-13T11:30:48.195 INFO:teuthology.orchestra.run.smithi102.stdout:config.status: creating include/config.h 2023-11-13T11:30:48.216 INFO:teuthology.orchestra.run.smithi102.stdout:config.status: executing libtool commands 2023-11-13T11:30:48.286 INFO:teuthology.orchestra.run.smithi102.stdout:Building include 2023-11-13T11:30:48.293 INFO:teuthology.orchestra.run.smithi102.stdout:Building lib 2023-11-13T11:30:48.298 INFO:teuthology.orchestra.run.smithi102.stdout: [LTDEP] 2023-11-13T11:30:48.494 INFO:teuthology.orchestra.run.smithi102.stdout: [CC] dataascii.lo 2023-11-13T11:30:48.641 INFO:teuthology.orchestra.run.smithi102.stdout: [CC] databin.lo 2023-11-13T11:30:48.830 INFO:teuthology.orchestra.run.smithi102.stdout: [CC] datapid.lo 2023-11-13T11:30:48.971 INFO:teuthology.orchestra.run.smithi102.stdout: [CC] file_lock.lo 2023-11-13T11:30:49.164 INFO:teuthology.orchestra.run.smithi102.stdout: [CC] forker.lo 2023-11-13T11:30:49.349 INFO:teuthology.orchestra.run.smithi102.stdout: [CC] pattern.lo 2023-11-13T11:30:49.493 INFO:teuthology.orchestra.run.smithi102.stdout: [CC] open_flags.lo 2023-11-13T11:30:49.675 INFO:teuthology.orchestra.run.smithi102.stdout: [CC] random_range.lo 2023-11-13T11:30:49.931 INFO:teuthology.orchestra.run.smithi102.stdout: [CC] string_to_tokens.lo 2023-11-13T11:30:49.967 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T11:30:49.971 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T11:30:50.083 INFO:teuthology.orchestra.run.smithi102.stdout: [CC] str_to_bytes.lo 2023-11-13T11:30:50.256 INFO:teuthology.orchestra.run.smithi102.stdout: [CC] tlibio.lo 2023-11-13T11:30:50.548 INFO:teuthology.orchestra.run.smithi102.stdout: [CC] write_log.lo 2023-11-13T11:30:50.636 INFO:teuthology.orchestra.run.smithi102.stderr:write_log.c: In function 'wlog_record_write': 2023-11-13T11:30:50.636 INFO:teuthology.orchestra.run.smithi102.stderr:write_log.c:205:13: warning: ignoring return value of 'write' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-11-13T11:30:50.636 INFO:teuthology.orchestra.run.smithi102.stderr: 205 | write(wfile->w_afd, wbuf, reclen); 2023-11-13T11:30:50.637 INFO:teuthology.orchestra.run.smithi102.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-11-13T11:30:50.637 INFO:teuthology.orchestra.run.smithi102.stderr:write_log.c:209:13: warning: ignoring return value of 'write' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-11-13T11:30:50.637 INFO:teuthology.orchestra.run.smithi102.stderr: 209 | write(wfile->w_rfd, wbuf, reclen); 2023-11-13T11:30:50.637 INFO:teuthology.orchestra.run.smithi102.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-11-13T11:30:50.826 INFO:teuthology.orchestra.run.smithi102.stdout: [CC] random.lo 2023-11-13T11:30:50.956 INFO:teuthology.orchestra.run.smithi102.stdout: [LD] 2023-11-13T11:30:51.081 INFO:teuthology.orchestra.run.smithi102.stdout:Building ltp 2023-11-13T11:30:51.086 INFO:teuthology.orchestra.run.smithi102.stdout: [DEP] 2023-11-13T11:30:51.295 INFO:teuthology.orchestra.run.smithi102.stdout: [CC] doio 2023-11-13T11:30:52.013 INFO:teuthology.orchestra.run.smithi102.stdout: [CC] fsstress 2023-11-13T11:30:53.570 INFO:teuthology.orchestra.run.smithi102.stdout: [CC] fsx 2023-11-13T11:30:54.398 INFO:teuthology.orchestra.run.smithi102.stdout: [CC] growfiles 2023-11-13T11:30:54.995 INFO:teuthology.orchestra.run.smithi102.stdout: [CC] iogen 2023-11-13T11:30:55.164 INFO:teuthology.orchestra.run.smithi102.stderr:iogen.c: In function 'main': 2023-11-13T11:30:55.165 INFO:teuthology.orchestra.run.smithi102.stderr:iogen.c:280:9: warning: ignoring return value of 'write' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-11-13T11:30:55.165 INFO:teuthology.orchestra.run.smithi102.stderr: 280 | write(outfd, (char *)&req, sizeof(req)); 2023-11-13T11:30:55.165 INFO:teuthology.orchestra.run.smithi102.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-11-13T11:30:55.167 INFO:teuthology.orchestra.run.smithi102.stderr:iogen.c: In function 'parse_cmdline': 2023-11-13T11:30:55.167 INFO:teuthology.orchestra.run.smithi102.stderr:iogen.c:1535:17: warning: ignoring return value of 'getcwd' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-11-13T11:30:55.167 INFO:teuthology.orchestra.run.smithi102.stderr: 1535 | getcwd(fptr->f_path, 2023-11-13T11:30:55.167 INFO:teuthology.orchestra.run.smithi102.stderr: | ^~~~~~~~~~~~~~~~~~~~ 2023-11-13T11:30:55.168 INFO:teuthology.orchestra.run.smithi102.stderr: 1536 | sizeof(fptr->f_path)-1); 2023-11-13T11:30:55.168 INFO:teuthology.orchestra.run.smithi102.stderr: | ~~~~~~~~~~~~~~~~~~~~~~~ 2023-11-13T11:30:55.441 INFO:teuthology.orchestra.run.smithi102.stdout: [CC] aio-stress 2023-11-13T11:30:55.605 INFO:teuthology.orchestra.run.smithi102.stderr:aio-stress.c: In function 'setup_shared_mem': 2023-11-13T11:30:55.605 INFO:teuthology.orchestra.run.smithi102.stderr:aio-stress.c:1013:9: warning: ignoring return value of 'ftruncate' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-11-13T11:30:55.605 INFO:teuthology.orchestra.run.smithi102.stderr: 1013 | ftruncate(fd, total_ram); 2023-11-13T11:30:55.605 INFO:teuthology.orchestra.run.smithi102.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~ 2023-11-13T11:30:55.926 INFO:teuthology.orchestra.run.smithi102.stdout:Building src 2023-11-13T11:30:55.935 INFO:teuthology.orchestra.run.smithi102.stdout: [DEP] 2023-11-13T11:30:58.402 INFO:teuthology.orchestra.run.smithi102.stdout: [DEP] 2023-11-13T11:30:58.450 INFO:teuthology.orchestra.run.smithi102.stdout: [DEP] 2023-11-13T11:30:58.464 INFO:teuthology.orchestra.run.smithi102.stdout: [DEP] 2023-11-13T11:30:58.796 INFO:teuthology.orchestra.run.smithi102.stdout: [DEP] 2023-11-13T11:30:58.831 INFO:teuthology.orchestra.run.smithi102.stdout: [CC] dirstress 2023-11-13T11:30:59.127 INFO:teuthology.orchestra.run.smithi102.stdout: [CC] fill 2023-11-13T11:30:59.322 INFO:teuthology.orchestra.run.smithi102.stdout: [CC] fill2 2023-11-13T11:30:59.600 INFO:teuthology.orchestra.run.smithi102.stdout: [CC] getpagesize 2023-11-13T11:30:59.776 INFO:teuthology.orchestra.run.smithi102.stdout: [CC] holes 2023-11-13T11:31:00.025 INFO:teuthology.orchestra.run.smithi102.stdout: [CC] lstat64 2023-11-13T11:31:00.256 INFO:teuthology.orchestra.run.smithi102.stdout: [CC] nametest 2023-11-13T11:31:00.422 INFO:teuthology.orchestra.run.smithi102.stderr:nametest.c: In function 'main': 2023-11-13T11:31:00.423 INFO:teuthology.orchestra.run.smithi102.stderr:nametest.c:236:33: warning: ignoring return value of 'write' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-11-13T11:31:00.423 INFO:teuthology.orchestra.run.smithi102.stderr: 236 | write(1, "\n", 1); 2023-11-13T11:31:00.423 INFO:teuthology.orchestra.run.smithi102.stderr: | ^~~~~~~~~~~~~~~~~ 2023-11-13T11:31:00.423 INFO:teuthology.orchestra.run.smithi102.stderr:nametest.c:238:25: warning: ignoring return value of 'write' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-11-13T11:31:00.424 INFO:teuthology.orchestra.run.smithi102.stderr: 238 | write(1, ".", 1); 2023-11-13T11:31:00.424 INFO:teuthology.orchestra.run.smithi102.stderr: | ^~~~~~~~~~~~~~~~ 2023-11-13T11:31:00.424 INFO:teuthology.orchestra.run.smithi102.stderr:nametest.c:288:33: warning: ignoring return value of 'write' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-11-13T11:31:00.424 INFO:teuthology.orchestra.run.smithi102.stderr: 288 | write(1, ".", 1); 2023-11-13T11:31:00.424 INFO:teuthology.orchestra.run.smithi102.stderr: | ^~~~~~~~~~~~~~~~ 2023-11-13T11:31:00.548 INFO:teuthology.orchestra.run.smithi102.stdout: [CC] permname 2023-11-13T11:31:00.799 INFO:teuthology.orchestra.run.smithi102.stdout: [CC] randholes 2023-11-13T11:31:01.097 INFO:teuthology.orchestra.run.smithi102.stdout: [CC] runas 2023-11-13T11:31:01.320 INFO:teuthology.orchestra.run.smithi102.stdout: [CC] truncfile 2023-11-13T11:31:01.546 INFO:teuthology.orchestra.run.smithi102.stdout: [CC] usemem 2023-11-13T11:31:01.740 INFO:teuthology.orchestra.run.smithi102.stdout: [CC] mmapcat 2023-11-13T11:31:01.890 INFO:teuthology.orchestra.run.smithi102.stderr:mmapcat.c: In function 'main': 2023-11-13T11:31:01.890 INFO:teuthology.orchestra.run.smithi102.stderr:mmapcat.c:29:9: warning: ignoring return value of 'write' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-11-13T11:31:01.890 INFO:teuthology.orchestra.run.smithi102.stderr: 29 | write(1,ptr2,ptr - ptr2); 2023-11-13T11:31:01.890 INFO:teuthology.orchestra.run.smithi102.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~ 2023-11-13T11:31:01.933 INFO:teuthology.orchestra.run.smithi102.stdout: [CC] append_reader 2023-11-13T11:31:02.131 INFO:teuthology.orchestra.run.smithi102.stdout: [CC] append_writer 2023-11-13T11:31:02.327 INFO:teuthology.orchestra.run.smithi102.stdout: [CC] dirperf 2023-11-13T11:31:02.596 INFO:teuthology.orchestra.run.smithi102.stdout: [CC] metaperf 2023-11-13T11:31:02.753 INFO:teuthology.orchestra.run.smithi102.stderr:metaperf.c: In function 'crfiles': 2023-11-13T11:31:02.754 INFO:teuthology.orchestra.run.smithi102.stderr:metaperf.c:166:25: warning: ignoring return value of 'write' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-11-13T11:31:02.754 INFO:teuthology.orchestra.run.smithi102.stderr: 166 | write(fd, buf, fsize); 2023-11-13T11:31:02.754 INFO:teuthology.orchestra.run.smithi102.stderr: | ^~~~~~~~~~~~~~~~~~~~~ 2023-11-13T11:31:02.755 INFO:teuthology.orchestra.run.smithi102.stderr:metaperf.c: In function 't_linkun': 2023-11-13T11:31:02.755 INFO:teuthology.orchestra.run.smithi102.stderr:metaperf.c:454:25: warning: ignoring return value of 'link' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-11-13T11:31:02.755 INFO:teuthology.orchestra.run.smithi102.stderr: 454 | link("a", *fnp); 2023-11-13T11:31:02.755 INFO:teuthology.orchestra.run.smithi102.stderr: | ^~~~~~~~~~~~~~~ 2023-11-13T11:31:02.755 INFO:teuthology.orchestra.run.smithi102.stderr:metaperf.c: In function 't_chown': 2023-11-13T11:31:02.756 INFO:teuthology.orchestra.run.smithi102.stderr:metaperf.c:404:33: warning: ignoring return value of 'chown' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-11-13T11:31:02.756 INFO:teuthology.orchestra.run.smithi102.stderr: 404 | chown(*fnp, 2, -1); 2023-11-13T11:31:02.756 INFO:teuthology.orchestra.run.smithi102.stderr: | ^~~~~~~~~~~~~~~~~~ 2023-11-13T11:31:02.756 INFO:teuthology.orchestra.run.smithi102.stderr:metaperf.c:406:33: warning: ignoring return value of 'chown' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-11-13T11:31:02.756 INFO:teuthology.orchestra.run.smithi102.stderr: 406 | chown(*fnp, 1, -1); 2023-11-13T11:31:02.757 INFO:teuthology.orchestra.run.smithi102.stderr: | ^~~~~~~~~~~~~~~~~~ 2023-11-13T11:31:02.757 INFO:teuthology.orchestra.run.smithi102.stderr:metaperf.c: In function 'i_chown': 2023-11-13T11:31:02.757 INFO:teuthology.orchestra.run.smithi102.stderr:metaperf.c:291:17: warning: ignoring return value of 'chown' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-11-13T11:31:02.757 INFO:teuthology.orchestra.run.smithi102.stderr: 291 | chown(*fnp, 1, -1); 2023-11-13T11:31:02.757 INFO:teuthology.orchestra.run.smithi102.stderr: | ^~~~~~~~~~~~~~~~~~ 2023-11-13T11:31:02.758 INFO:teuthology.orchestra.run.smithi102.stderr:metaperf.c: In function 'main': 2023-11-13T11:31:02.758 INFO:teuthology.orchestra.run.smithi102.stderr:metaperf.c:152:9: warning: ignoring return value of 'chdir' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-11-13T11:31:02.758 INFO:teuthology.orchestra.run.smithi102.stderr: 152 | chdir(".."); 2023-11-13T11:31:02.758 INFO:teuthology.orchestra.run.smithi102.stderr: | ^~~~~~~~~~~ 2023-11-13T11:31:02.926 INFO:teuthology.orchestra.run.smithi102.stdout: [CC] devzero 2023-11-13T11:31:03.153 INFO:teuthology.orchestra.run.smithi102.stdout: [CC] feature 2023-11-13T11:31:03.427 INFO:teuthology.orchestra.run.smithi102.stdout: [CC] alloc 2023-11-13T11:31:03.591 INFO:teuthology.orchestra.run.smithi102.stderr:alloc.c: In function 'main': 2023-11-13T11:31:03.591 INFO:teuthology.orchestra.run.smithi102.stderr:alloc.c:247:17: warning: ignoring return value of 'mkstemp' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-11-13T11:31:03.591 INFO:teuthology.orchestra.run.smithi102.stderr: 247 | mkstemp(tmpfile); 2023-11-13T11:31:03.592 INFO:teuthology.orchestra.run.smithi102.stderr: | ^~~~~~~~~~~~~~~~ 2023-11-13T11:31:03.689 INFO:teuthology.orchestra.run.smithi102.stdout: [CC] fault 2023-11-13T11:31:03.899 INFO:teuthology.orchestra.run.smithi102.stdout: [CC] fstest 2023-11-13T11:31:04.192 INFO:teuthology.orchestra.run.smithi102.stdout: [CC] t_access_root 2023-11-13T11:31:04.340 INFO:teuthology.orchestra.run.smithi102.stderr:t_access_root.c: In function 'main': 2023-11-13T11:31:04.341 INFO:teuthology.orchestra.run.smithi102.stderr:t_access_root.c:55:5: warning: ignoring return value of 'system' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-11-13T11:31:04.341 INFO:teuthology.orchestra.run.smithi102.stderr: 55 | system(cmd); 2023-11-13T11:31:04.341 INFO:teuthology.orchestra.run.smithi102.stderr: | ^~~~~~~~~~~ 2023-11-13T11:31:04.391 INFO:teuthology.orchestra.run.smithi102.stdout: [CC] godown 2023-11-13T11:31:04.609 INFO:teuthology.orchestra.run.smithi102.stdout: [CC] resvtest 2023-11-13T11:31:04.843 INFO:teuthology.orchestra.run.smithi102.stdout: [CC] writemod 2023-11-13T11:31:05.035 INFO:teuthology.orchestra.run.smithi102.stdout: [CC] writev_on_pagefault 2023-11-13T11:31:05.241 INFO:teuthology.orchestra.run.smithi102.stdout: [CC] makeextents 2023-11-13T11:31:05.470 INFO:teuthology.orchestra.run.smithi102.stdout: [CC] itrash 2023-11-13T11:31:05.666 INFO:teuthology.orchestra.run.smithi102.stdout: [CC] rename 2023-11-13T11:31:05.845 INFO:teuthology.orchestra.run.smithi102.stdout: [CC] multi_open_unlink 2023-11-13T11:31:06.057 INFO:teuthology.orchestra.run.smithi102.stdout: [CC] unwritten_sync 2023-11-13T11:31:06.284 INFO:teuthology.orchestra.run.smithi102.stdout: [CC] genhashnames 2023-11-13T11:31:06.515 INFO:teuthology.orchestra.run.smithi102.stdout: [CC] t_holes 2023-11-13T11:31:06.705 INFO:teuthology.orchestra.run.smithi102.stdout: [CC] t_mmap_writev 2023-11-13T11:31:06.899 INFO:teuthology.orchestra.run.smithi102.stdout: [CC] t_truncate_cmtime 2023-11-13T11:31:07.106 INFO:teuthology.orchestra.run.smithi102.stdout: [CC] dirhash_collide 2023-11-13T11:31:07.333 INFO:teuthology.orchestra.run.smithi102.stdout: [CC] t_rename_overwrite 2023-11-13T11:31:07.514 INFO:teuthology.orchestra.run.smithi102.stdout: [CC] holetest 2023-11-13T11:31:07.671 INFO:teuthology.orchestra.run.smithi102.stderr:holetest.c: In function 'pt_write_marker': 2023-11-13T11:31:07.671 INFO:teuthology.orchestra.run.smithi102.stderr:holetest.c:140:17: warning: ignoring return value of 'pwrite' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-11-13T11:31:07.672 INFO:teuthology.orchestra.run.smithi102.stderr: 140 | pwrite(fd, &tid, sizeof(tid), i * page_size + pgoff); 2023-11-13T11:31:07.672 INFO:teuthology.orchestra.run.smithi102.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-11-13T11:31:07.789 INFO:teuthology.orchestra.run.smithi102.stdout: [CC] t_truncate_self 2023-11-13T11:31:07.974 INFO:teuthology.orchestra.run.smithi102.stdout: [CC] af_unix 2023-11-13T11:31:08.173 INFO:teuthology.orchestra.run.smithi102.stdout: [CC] t_mmap_stale_pmd 2023-11-13T11:31:08.325 INFO:teuthology.orchestra.run.smithi102.stderr:t_mmap_stale_pmd.c: In function 'main': 2023-11-13T11:31:08.326 INFO:teuthology.orchestra.run.smithi102.stderr:t_mmap_stale_pmd.c:42:9: warning: ignoring return value of 'ftruncate' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-11-13T11:31:08.326 INFO:teuthology.orchestra.run.smithi102.stderr: 42 | ftruncate(fd, 0); 2023-11-13T11:31:08.326 INFO:teuthology.orchestra.run.smithi102.stderr: | ^~~~~~~~~~~~~~~~ 2023-11-13T11:31:08.327 INFO:teuthology.orchestra.run.smithi102.stderr:t_mmap_stale_pmd.c:43:9: warning: ignoring return value of 'ftruncate' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-11-13T11:31:08.327 INFO:teuthology.orchestra.run.smithi102.stderr: 43 | ftruncate(fd, MiB(4)); 2023-11-13T11:31:08.327 INFO:teuthology.orchestra.run.smithi102.stderr: | ^~~~~~~~~~~~~~~~~~~~~ 2023-11-13T11:31:08.327 INFO:teuthology.orchestra.run.smithi102.stderr:t_mmap_stale_pmd.c:55:9: warning: ignoring return value of 'pwrite' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-11-13T11:31:08.327 INFO:teuthology.orchestra.run.smithi102.stderr: 55 | pwrite(fd, buffer, strlen(buffer), MiB(2)); 2023-11-13T11:31:08.328 INFO:teuthology.orchestra.run.smithi102.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-11-13T11:31:08.371 INFO:teuthology.orchestra.run.smithi102.stdout: [CC] t_mmap_cow_race 2023-11-13T11:31:08.526 INFO:teuthology.orchestra.run.smithi102.stderr:t_mmap_cow_race.c: In function 'main': 2023-11-13T11:31:08.529 INFO:teuthology.orchestra.run.smithi102.stderr:t_mmap_cow_race.c:61:9: warning: ignoring return value of 'ftruncate' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-11-13T11:31:08.529 INFO:teuthology.orchestra.run.smithi102.stderr: 61 | ftruncate(fd, 0); 2023-11-13T11:31:08.529 INFO:teuthology.orchestra.run.smithi102.stderr: | ^~~~~~~~~~~~~~~~ 2023-11-13T11:31:08.530 INFO:teuthology.orchestra.run.smithi102.stderr:t_mmap_cow_race.c:62:9: warning: ignoring return value of 'ftruncate' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-11-13T11:31:08.530 INFO:teuthology.orchestra.run.smithi102.stderr: 62 | ftruncate(fd, MiB(2)); 2023-11-13T11:31:08.530 INFO:teuthology.orchestra.run.smithi102.stderr: | ^~~~~~~~~~~~~~~~~~~~~ 2023-11-13T11:31:08.585 INFO:teuthology.orchestra.run.smithi102.stdout: [CC] t_mmap_fallocate 2023-11-13T11:31:08.780 INFO:teuthology.orchestra.run.smithi102.stdout: [CC] fsync-err 2023-11-13T11:31:09.012 INFO:teuthology.orchestra.run.smithi102.stdout: [CC] t_mmap_write_ro 2023-11-13T11:31:09.210 INFO:teuthology.orchestra.run.smithi102.stdout: [CC] t_ext4_dax_journal_corruption 2023-11-13T11:31:09.361 INFO:teuthology.orchestra.run.smithi102.stderr:t_ext4_dax_journal_corruption.c: In function 'main': 2023-11-13T11:31:09.362 INFO:teuthology.orchestra.run.smithi102.stderr:t_ext4_dax_journal_corruption.c:61:9: warning: ignoring return value of 'ftruncate' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-11-13T11:31:09.362 INFO:teuthology.orchestra.run.smithi102.stderr: 61 | ftruncate(fd, 0); 2023-11-13T11:31:09.362 INFO:teuthology.orchestra.run.smithi102.stderr: | ^~~~~~~~~~~~~~~~ 2023-11-13T11:31:09.415 INFO:teuthology.orchestra.run.smithi102.stdout: [CC] t_ext4_dax_inline_corruption 2023-11-13T11:31:09.615 INFO:teuthology.orchestra.run.smithi102.stdout: [CC] t_ofd_locks 2023-11-13T11:31:09.859 INFO:teuthology.orchestra.run.smithi102.stdout: [CC] t_mmap_collision 2023-11-13T11:31:10.107 INFO:teuthology.orchestra.run.smithi102.stdout: [CC] mmap-write-concurrent 2023-11-13T11:31:10.324 INFO:teuthology.orchestra.run.smithi102.stdout: [CC] t_get_file_time 2023-11-13T11:31:10.666 INFO:teuthology.orchestra.run.smithi102.stdout: [CC] t_create_short_dirs 2023-11-13T11:31:10.881 INFO:teuthology.orchestra.run.smithi102.stdout: [CC] t_create_long_dirs 2023-11-13T11:31:11.091 INFO:teuthology.orchestra.run.smithi102.stdout: [CC] t_enospc 2023-11-13T11:31:11.345 INFO:teuthology.orchestra.run.smithi102.stdout: [CC] t_mmap_writev_overlap 2023-11-13T11:31:11.560 INFO:teuthology.orchestra.run.smithi102.stdout: [CC] checkpoint_journal 2023-11-13T11:31:11.761 INFO:teuthology.orchestra.run.smithi102.stdout: [CC] mmap-rw-fault 2023-11-13T11:31:11.993 INFO:teuthology.orchestra.run.smithi102.stdout: [CC] allocstale 2023-11-13T11:31:12.218 INFO:teuthology.orchestra.run.smithi102.stdout: [CC] t_mmap_cow_memory_failure 2023-11-13T11:31:12.434 INFO:teuthology.orchestra.run.smithi102.stdout: [CC] fake-dump-rootino 2023-11-13T11:31:12.628 INFO:teuthology.orchestra.run.smithi102.stdout: [CC] dio-buf-fault 2023-11-13T11:31:12.826 INFO:teuthology.orchestra.run.smithi102.stdout: [CC] rewinddir-test 2023-11-13T11:31:13.044 INFO:teuthology.orchestra.run.smithi102.stdout: [CC] xfsctl 2023-11-13T11:31:13.284 INFO:teuthology.orchestra.run.smithi102.stdout: [CC] bstat 2023-11-13T11:31:13.542 INFO:teuthology.orchestra.run.smithi102.stdout: [CC] t_mtab 2023-11-13T11:31:13.697 INFO:teuthology.orchestra.run.smithi102.stderr:t_mtab.c: In function 'update_mtab': 2023-11-13T11:31:13.697 INFO:teuthology.orchestra.run.smithi102.stderr:t_mtab.c:256:17: warning: ignoring return value of 'chown' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-11-13T11:31:13.697 INFO:teuthology.orchestra.run.smithi102.stderr: 256 | chown (mounted_temp, sbuf.st_uid, sbuf.st_gid); 2023-11-13T11:31:13.697 INFO:teuthology.orchestra.run.smithi102.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-11-13T11:31:13.777 INFO:teuthology.orchestra.run.smithi102.stdout: [CC] getdevicesize 2023-11-13T11:31:13.964 INFO:teuthology.orchestra.run.smithi102.stdout: [CC] preallo_rw_pattern_reader 2023-11-13T11:31:14.124 INFO:teuthology.orchestra.run.smithi102.stderr:In file included from preallo_rw_pattern_reader.c:2: 2023-11-13T11:31:14.125 INFO:teuthology.orchestra.run.smithi102.stderr:iopat.c: In function 'main': 2023-11-13T11:31:14.125 INFO:teuthology.orchestra.run.smithi102.stderr:iopat.c:38:4: warning: ignoring return value of 'read' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-11-13T11:31:14.125 INFO:teuthology.orchestra.run.smithi102.stderr: 38 | read(fd, &x, 1048576); 2023-11-13T11:31:14.125 INFO:teuthology.orchestra.run.smithi102.stderr: | ^~~~~~~~~~~~~~~~~~~~~ 2023-11-13T11:31:14.169 INFO:teuthology.orchestra.run.smithi102.stdout: [CC] preallo_rw_pattern_writer 2023-11-13T11:31:14.332 INFO:teuthology.orchestra.run.smithi102.stderr:In file included from preallo_rw_pattern_writer.c:2: 2023-11-13T11:31:14.333 INFO:teuthology.orchestra.run.smithi102.stderr:iopat.c: In function 'main': 2023-11-13T11:31:14.333 INFO:teuthology.orchestra.run.smithi102.stderr:iopat.c:34:4: warning: ignoring return value of 'write' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-11-13T11:31:14.333 INFO:teuthology.orchestra.run.smithi102.stderr: 34 | write(fd, &x, 1048576); 2023-11-13T11:31:14.333 INFO:teuthology.orchestra.run.smithi102.stderr: | ^~~~~~~~~~~~~~~~~~~~~~ 2023-11-13T11:31:14.375 INFO:teuthology.orchestra.run.smithi102.stdout: [CC] ftrunc 2023-11-13T11:31:14.568 INFO:teuthology.orchestra.run.smithi102.stdout: [CC] trunc 2023-11-13T11:31:14.777 INFO:teuthology.orchestra.run.smithi102.stdout: [CC] fs_perms 2023-11-13T11:31:14.932 INFO:teuthology.orchestra.run.smithi102.stderr:fs_perms.c: In function 'main': 2023-11-13T11:31:14.932 INFO:teuthology.orchestra.run.smithi102.stderr:fs_perms.c:54:4: warning: ignoring return value of 'system' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-11-13T11:31:14.932 INFO:teuthology.orchestra.run.smithi102.stderr: 54 | system("rm -f test.file"); 2023-11-13T11:31:14.933 INFO:teuthology.orchestra.run.smithi102.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~ 2023-11-13T11:31:14.933 INFO:teuthology.orchestra.run.smithi102.stderr:fs_perms.c: In function 'testsetup': 2023-11-13T11:31:14.933 INFO:teuthology.orchestra.run.smithi102.stderr:fs_perms.c:67:4: warning: ignoring return value of 'system' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-11-13T11:31:14.933 INFO:teuthology.orchestra.run.smithi102.stderr: 67 | system("cp testx.file test.file"); 2023-11-13T11:31:14.934 INFO:teuthology.orchestra.run.smithi102.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-11-13T11:31:14.934 INFO:teuthology.orchestra.run.smithi102.stderr:fs_perms.c:69:4: warning: ignoring return value of 'chown' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-11-13T11:31:14.934 INFO:teuthology.orchestra.run.smithi102.stderr: 69 | chown("test.file",cuserId,cgroupId); 2023-11-13T11:31:14.934 INFO:teuthology.orchestra.run.smithi102.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-11-13T11:31:14.934 INFO:teuthology.orchestra.run.smithi102.stderr:fs_perms.c: In function 'testfperm': 2023-11-13T11:31:14.935 INFO:teuthology.orchestra.run.smithi102.stderr:fs_perms.c:123:5: warning: ignoring return value of 'seteuid' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-11-13T11:31:14.935 INFO:teuthology.orchestra.run.smithi102.stderr: 123 | seteuid(0); 2023-11-13T11:31:14.935 INFO:teuthology.orchestra.run.smithi102.stderr: | ^~~~~~~~~~ 2023-11-13T11:31:14.935 INFO:teuthology.orchestra.run.smithi102.stderr:fs_perms.c:124:5: warning: ignoring return value of 'setegid' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-11-13T11:31:14.936 INFO:teuthology.orchestra.run.smithi102.stderr: 124 | setegid(0); 2023-11-13T11:31:14.936 INFO:teuthology.orchestra.run.smithi102.stderr: | ^~~~~~~~~~ 2023-11-13T11:31:14.988 INFO:teuthology.orchestra.run.smithi102.stdout: [CC] testx 2023-11-13T11:31:15.159 INFO:teuthology.orchestra.run.smithi102.stdout: [CC] looptest 2023-11-13T11:31:15.401 INFO:teuthology.orchestra.run.smithi102.stdout: [CC] locktest 2023-11-13T11:31:15.760 INFO:teuthology.orchestra.run.smithi102.stdout: [CC] unwritten_mmap 2023-11-13T11:31:15.970 INFO:teuthology.orchestra.run.smithi102.stdout: [CC] bulkstat_unlink_test 2023-11-13T11:31:16.134 INFO:teuthology.orchestra.run.smithi102.stderr:bulkstat_unlink_test.c: In function 'main': 2023-11-13T11:31:16.134 INFO:teuthology.orchestra.run.smithi102.stderr:bulkstat_unlink_test.c:106:25: warning: ignoring return value of 'write' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-11-13T11:31:16.134 INFO:teuthology.orchestra.run.smithi102.stderr: 106 | write(fd[i], fname, sizeof(fname)); 2023-11-13T11:31:16.134 INFO:teuthology.orchestra.run.smithi102.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-11-13T11:31:16.135 INFO:teuthology.orchestra.run.smithi102.stderr:bulkstat_unlink_test.c:178:17: warning: ignoring return value of 'system' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-11-13T11:31:16.135 INFO:teuthology.orchestra.run.smithi102.stderr: 178 | system(fname); 2023-11-13T11:31:16.135 INFO:teuthology.orchestra.run.smithi102.stderr: | ^~~~~~~~~~~~~ 2023-11-13T11:31:16.226 INFO:teuthology.orchestra.run.smithi102.stdout: [CC] deduperace 2023-11-13T11:31:16.469 INFO:teuthology.orchestra.run.smithi102.stdout: [CC] bulkstat_unlink_test_modified 2023-11-13T11:31:16.631 INFO:teuthology.orchestra.run.smithi102.stderr:bulkstat_unlink_test_modified.c: In function 'main': 2023-11-13T11:31:16.631 INFO:teuthology.orchestra.run.smithi102.stderr:bulkstat_unlink_test_modified.c:83:13: warning: ignoring return value of 'write' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-11-13T11:31:16.631 INFO:teuthology.orchestra.run.smithi102.stderr: 83 | write(fd, fname, sizeof(fname)); 2023-11-13T11:31:16.631 INFO:teuthology.orchestra.run.smithi102.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-11-13T11:31:16.631 INFO:teuthology.orchestra.run.smithi102.stderr:bulkstat_unlink_test_modified.c:139:13: warning: ignoring return value of 'write' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-11-13T11:31:16.632 INFO:teuthology.orchestra.run.smithi102.stderr: 139 | write(fd, fname, sizeof(fname)); 2023-11-13T11:31:16.632 INFO:teuthology.orchestra.run.smithi102.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-11-13T11:31:16.632 INFO:teuthology.orchestra.run.smithi102.stderr:bulkstat_unlink_test_modified.c:185:9: warning: ignoring return value of 'system' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-11-13T11:31:16.632 INFO:teuthology.orchestra.run.smithi102.stderr: 185 | system(fname); 2023-11-13T11:31:16.632 INFO:teuthology.orchestra.run.smithi102.stderr: | ^~~~~~~~~~~~~ 2023-11-13T11:31:16.717 INFO:teuthology.orchestra.run.smithi102.stdout: [CC] t_dir_offset 2023-11-13T11:31:16.909 INFO:teuthology.orchestra.run.smithi102.stdout: [CC] t_futimens 2023-11-13T11:31:17.092 INFO:teuthology.orchestra.run.smithi102.stdout: [CC] t_immutable 2023-11-13T11:31:17.269 INFO:teuthology.orchestra.run.smithi102.stderr:t_immutable.c: In function 'create_test_area': 2023-11-13T11:31:17.269 INFO:teuthology.orchestra.run.smithi102.stderr:t_immutable.c:2061:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-11-13T11:31:17.269 INFO:teuthology.orchestra.run.smithi102.stderr: 2061 | asprintf(&path, "%s/immutable.d", dir); 2023-11-13T11:31:17.270 INFO:teuthology.orchestra.run.smithi102.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-11-13T11:31:17.270 INFO:teuthology.orchestra.run.smithi102.stderr:t_immutable.c:2096:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-11-13T11:31:17.270 INFO:teuthology.orchestra.run.smithi102.stderr: 2096 | asprintf(&path, "%s/append-only.d", dir); 2023-11-13T11:31:17.270 INFO:teuthology.orchestra.run.smithi102.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-11-13T11:31:17.272 INFO:teuthology.orchestra.run.smithi102.stderr:t_immutable.c: In function 'remove_test_area': 2023-11-13T11:31:17.273 INFO:teuthology.orchestra.run.smithi102.stderr:t_immutable.c:2152:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-11-13T11:31:17.273 INFO:teuthology.orchestra.run.smithi102.stderr: 2152 | asprintf(&path, "%s/immutable.d", dir); 2023-11-13T11:31:17.274 INFO:teuthology.orchestra.run.smithi102.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-11-13T11:31:17.274 INFO:teuthology.orchestra.run.smithi102.stderr:t_immutable.c:2163:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-11-13T11:31:17.274 INFO:teuthology.orchestra.run.smithi102.stderr: 2163 | asprintf(&path, "%s/empty-immutable.d", dir); 2023-11-13T11:31:17.274 INFO:teuthology.orchestra.run.smithi102.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-11-13T11:31:17.275 INFO:teuthology.orchestra.run.smithi102.stderr:t_immutable.c:2175:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-11-13T11:31:17.275 INFO:teuthology.orchestra.run.smithi102.stderr: 2175 | asprintf(&path, "%s/append-only.d", dir); 2023-11-13T11:31:17.275 INFO:teuthology.orchestra.run.smithi102.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-11-13T11:31:17.275 INFO:teuthology.orchestra.run.smithi102.stderr:t_immutable.c:2186:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-11-13T11:31:17.275 INFO:teuthology.orchestra.run.smithi102.stderr: 2186 | asprintf(&path, "%s/empty-append-only.d", dir); 2023-11-13T11:31:17.276 INFO:teuthology.orchestra.run.smithi102.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-11-13T11:31:17.276 INFO:teuthology.orchestra.run.smithi102.stderr:t_immutable.c:2197:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-11-13T11:31:17.276 INFO:teuthology.orchestra.run.smithi102.stderr: 2197 | asprintf(&path, "%s/append-only.f", dir); 2023-11-13T11:31:17.276 INFO:teuthology.orchestra.run.smithi102.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-11-13T11:31:17.276 INFO:teuthology.orchestra.run.smithi102.stderr:t_immutable.c:2209:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-11-13T11:31:17.277 INFO:teuthology.orchestra.run.smithi102.stderr: 2209 | asprintf(&path, "%s/immutable.f", dir); 2023-11-13T11:31:17.277 INFO:teuthology.orchestra.run.smithi102.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-11-13T11:31:17.277 INFO:teuthology.orchestra.run.smithi102.stderr:t_immutable.c: In function 'check_test_area': 2023-11-13T11:31:17.278 INFO:teuthology.orchestra.run.smithi102.stderr:t_immutable.c:1788:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-11-13T11:31:17.278 INFO:teuthology.orchestra.run.smithi102.stderr: 1788 | asprintf(&path, "%s/", dir); 2023-11-13T11:31:17.278 INFO:teuthology.orchestra.run.smithi102.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-11-13T11:31:17.278 INFO:teuthology.orchestra.run.smithi102.stderr:t_immutable.c:1800:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-11-13T11:31:17.278 INFO:teuthology.orchestra.run.smithi102.stderr: 1800 | asprintf(&path, "%s/immutable.f", dir); 2023-11-13T11:31:17.279 INFO:teuthology.orchestra.run.smithi102.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-11-13T11:31:17.279 INFO:teuthology.orchestra.run.smithi102.stderr:t_immutable.c:1812:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-11-13T11:31:17.279 INFO:teuthology.orchestra.run.smithi102.stderr: 1812 | asprintf(&path, "%s/append-only.f", dir); 2023-11-13T11:31:17.279 INFO:teuthology.orchestra.run.smithi102.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-11-13T11:31:17.279 INFO:teuthology.orchestra.run.smithi102.stderr:t_immutable.c:1824:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-11-13T11:31:17.280 INFO:teuthology.orchestra.run.smithi102.stderr: 1824 | asprintf(&path, "%s/immutable.d", dir); 2023-11-13T11:31:17.280 INFO:teuthology.orchestra.run.smithi102.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-11-13T11:31:17.280 INFO:teuthology.orchestra.run.smithi102.stderr:t_immutable.c:1837:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-11-13T11:31:17.280 INFO:teuthology.orchestra.run.smithi102.stderr: 1837 | asprintf(&path, "%s/append-only.d", dir); 2023-11-13T11:31:17.280 INFO:teuthology.orchestra.run.smithi102.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-11-13T11:31:17.281 INFO:teuthology.orchestra.run.smithi102.stderr:t_immutable.c:1850:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-11-13T11:31:17.281 INFO:teuthology.orchestra.run.smithi102.stderr: 1850 | asprintf(&path, "%s/immutable.d/file", dir); 2023-11-13T11:31:17.281 INFO:teuthology.orchestra.run.smithi102.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-11-13T11:31:17.281 INFO:teuthology.orchestra.run.smithi102.stderr:t_immutable.c:1862:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-11-13T11:31:17.281 INFO:teuthology.orchestra.run.smithi102.stderr: 1862 | asprintf(&path, "%s/append-only.d/file", dir); 2023-11-13T11:31:17.282 INFO:teuthology.orchestra.run.smithi102.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-11-13T11:31:17.283 INFO:teuthology.orchestra.run.smithi102.stderr:t_immutable.c:1874:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-11-13T11:31:17.284 INFO:teuthology.orchestra.run.smithi102.stderr: 1874 | asprintf(&path, "%s/immutable.d/dir", dir); 2023-11-13T11:31:17.284 INFO:teuthology.orchestra.run.smithi102.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-11-13T11:31:17.285 INFO:teuthology.orchestra.run.smithi102.stderr:t_immutable.c:1887:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-11-13T11:31:17.285 INFO:teuthology.orchestra.run.smithi102.stderr: 1887 | asprintf(&path, "%s/append-only.d/dir", dir); 2023-11-13T11:31:17.285 INFO:teuthology.orchestra.run.smithi102.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-11-13T11:31:17.290 INFO:teuthology.orchestra.run.smithi102.stderr:t_immutable.c: In function 'test_immutable': 2023-11-13T11:31:17.291 INFO:teuthology.orchestra.run.smithi102.stderr:t_immutable.c:151:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-11-13T11:31:17.291 INFO:teuthology.orchestra.run.smithi102.stderr: 151 | asprintf(&path, "%s/immutable.f", dir); 2023-11-13T11:31:17.291 INFO:teuthology.orchestra.run.smithi102.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-11-13T11:31:17.291 INFO:teuthology.orchestra.run.smithi102.stderr:t_immutable.c:381:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-11-13T11:31:17.292 INFO:teuthology.orchestra.run.smithi102.stderr: 381 | asprintf(&linkpath, "%s/immutable.f.hardlink", dir); 2023-11-13T11:31:17.292 INFO:teuthology.orchestra.run.smithi102.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-11-13T11:31:17.292 INFO:teuthology.orchestra.run.smithi102.stderr:t_immutable.c:408:16: warning: ignoring return value of 'chown' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-11-13T11:31:17.292 INFO:teuthology.orchestra.run.smithi102.stderr: 408 | chown(path, 0, 0); 2023-11-13T11:31:17.292 INFO:teuthology.orchestra.run.smithi102.stderr: | ^~~~~~~~~~~~~~~~~ 2023-11-13T11:31:17.293 INFO:teuthology.orchestra.run.smithi102.stderr:t_immutable.c:485:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-11-13T11:31:17.293 INFO:teuthology.orchestra.run.smithi102.stderr: 485 | asprintf(&linkpath, "%s/immutable.f.newname", dir); 2023-11-13T11:31:17.293 INFO:teuthology.orchestra.run.smithi102.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-11-13T11:31:17.294 INFO:teuthology.orchestra.run.smithi102.stderr:t_immutable.c:532:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-11-13T11:31:17.294 INFO:teuthology.orchestra.run.smithi102.stderr: 532 | asprintf(&path, "%s/immutable.d/file", dir); 2023-11-13T11:31:17.295 INFO:teuthology.orchestra.run.smithi102.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-11-13T11:31:17.295 INFO:teuthology.orchestra.run.smithi102.stderr:t_immutable.c:553:16: warning: ignoring return value of 'chown' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-11-13T11:31:17.295 INFO:teuthology.orchestra.run.smithi102.stderr: 553 | chown(path, 0, 0); 2023-11-13T11:31:17.296 INFO:teuthology.orchestra.run.smithi102.stderr: | ^~~~~~~~~~~~~~~~~ 2023-11-13T11:31:17.296 INFO:teuthology.orchestra.run.smithi102.stderr:t_immutable.c:556:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-11-13T11:31:17.296 INFO:teuthology.orchestra.run.smithi102.stderr: 556 | asprintf(&linkpath, "%s/immutable.d/file.link", dir); 2023-11-13T11:31:17.296 INFO:teuthology.orchestra.run.smithi102.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-11-13T11:31:17.296 INFO:teuthology.orchestra.run.smithi102.stderr:t_immutable.c:575:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-11-13T11:31:17.297 INFO:teuthology.orchestra.run.smithi102.stderr: 575 | asprintf(&linkpath, "%s/immutable.d/file.newname", dir); 2023-11-13T11:31:17.297 INFO:teuthology.orchestra.run.smithi102.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-11-13T11:31:17.297 INFO:teuthology.orchestra.run.smithi102.stderr:t_immutable.c:595:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-11-13T11:31:17.297 INFO:teuthology.orchestra.run.smithi102.stderr: 595 | asprintf(&path, "%s/immutable.d/newfile", dir); 2023-11-13T11:31:17.298 INFO:teuthology.orchestra.run.smithi102.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-11-13T11:31:17.298 INFO:teuthology.orchestra.run.smithi102.stderr:t_immutable.c:619:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-11-13T11:31:17.298 INFO:teuthology.orchestra.run.smithi102.stderr: 619 | asprintf(&path, "%s/immutable.d/newdir", dir); 2023-11-13T11:31:17.298 INFO:teuthology.orchestra.run.smithi102.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-11-13T11:31:17.298 INFO:teuthology.orchestra.run.smithi102.stderr:t_immutable.c:631:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-11-13T11:31:17.299 INFO:teuthology.orchestra.run.smithi102.stderr: 631 | asprintf(&path, "%s/immutable.d/dir/newfile-%d", dir, getuid()); 2023-11-13T11:31:17.299 INFO:teuthology.orchestra.run.smithi102.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-11-13T11:31:17.300 INFO:teuthology.orchestra.run.smithi102.stderr:t_immutable.c:653:16: warning: ignoring return value of 'chown' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-11-13T11:31:17.300 INFO:teuthology.orchestra.run.smithi102.stderr: 653 | chown(path, 0, 0); 2023-11-13T11:31:17.301 INFO:teuthology.orchestra.run.smithi102.stderr: | ^~~~~~~~~~~~~~~~~ 2023-11-13T11:31:17.301 INFO:teuthology.orchestra.run.smithi102.stderr:t_immutable.c:657:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-11-13T11:31:17.301 INFO:teuthology.orchestra.run.smithi102.stderr: 657 | asprintf(&path, "%s/immutable.d/dir", dir); 2023-11-13T11:31:17.302 INFO:teuthology.orchestra.run.smithi102.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-11-13T11:31:17.302 INFO:teuthology.orchestra.run.smithi102.stderr:t_immutable.c:668:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-11-13T11:31:17.302 INFO:teuthology.orchestra.run.smithi102.stderr: 668 | asprintf(&path, "%s/immutable.d", dir); 2023-11-13T11:31:17.302 INFO:teuthology.orchestra.run.smithi102.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-11-13T11:31:17.302 INFO:teuthology.orchestra.run.smithi102.stderr:t_immutable.c:705:16: warning: ignoring return value of 'chown' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-11-13T11:31:17.303 INFO:teuthology.orchestra.run.smithi102.stderr: 705 | chown(path, 0, 0); 2023-11-13T11:31:17.303 INFO:teuthology.orchestra.run.smithi102.stderr: | ^~~~~~~~~~~~~~~~~ 2023-11-13T11:31:17.303 INFO:teuthology.orchestra.run.smithi102.stderr:t_immutable.c:782:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-11-13T11:31:17.303 INFO:teuthology.orchestra.run.smithi102.stderr: 782 | asprintf(&path, "%s/empty-immutable.d", dir); 2023-11-13T11:31:17.303 INFO:teuthology.orchestra.run.smithi102.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-11-13T11:31:17.304 INFO:teuthology.orchestra.run.smithi102.stderr:t_immutable.c: In function 'test_append': 2023-11-13T11:31:17.304 INFO:teuthology.orchestra.run.smithi102.stderr:t_immutable.c:822:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-11-13T11:31:17.304 INFO:teuthology.orchestra.run.smithi102.stderr: 822 | asprintf(&path, "%s/append-only.f", dir); 2023-11-13T11:31:17.304 INFO:teuthology.orchestra.run.smithi102.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-11-13T11:31:17.305 INFO:teuthology.orchestra.run.smithi102.stderr:t_immutable.c:1024:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-11-13T11:31:17.305 INFO:teuthology.orchestra.run.smithi102.stderr: 1024 | asprintf(&linkpath, "%s/append-only.f.hardlink", dir); 2023-11-13T11:31:17.306 INFO:teuthology.orchestra.run.smithi102.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-11-13T11:31:17.306 INFO:teuthology.orchestra.run.smithi102.stderr:t_immutable.c:1051:16: warning: ignoring return value of 'chown' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-11-13T11:31:17.306 INFO:teuthology.orchestra.run.smithi102.stderr: 1051 | chown(path, 0, 0); 2023-11-13T11:31:17.307 INFO:teuthology.orchestra.run.smithi102.stderr: | ^~~~~~~~~~~~~~~~~ 2023-11-13T11:31:17.307 INFO:teuthology.orchestra.run.smithi102.stderr:t_immutable.c:1126:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-11-13T11:31:17.307 INFO:teuthology.orchestra.run.smithi102.stderr: 1126 | asprintf(&linkpath, "%s/append-only.f.newname", dir); 2023-11-13T11:31:17.307 INFO:teuthology.orchestra.run.smithi102.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-11-13T11:31:17.307 INFO:teuthology.orchestra.run.smithi102.stderr:t_immutable.c:1495:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-11-13T11:31:17.308 INFO:teuthology.orchestra.run.smithi102.stderr: 1495 | asprintf(&path, "%s/append-only.d/file", dir); 2023-11-13T11:31:17.308 INFO:teuthology.orchestra.run.smithi102.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-11-13T11:31:17.308 INFO:teuthology.orchestra.run.smithi102.stderr:t_immutable.c:1516:16: warning: ignoring return value of 'chown' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-11-13T11:31:17.308 INFO:teuthology.orchestra.run.smithi102.stderr: 1516 | chown(path, 0, 0); 2023-11-13T11:31:17.308 INFO:teuthology.orchestra.run.smithi102.stderr: | ^~~~~~~~~~~~~~~~~ 2023-11-13T11:31:17.309 INFO:teuthology.orchestra.run.smithi102.stderr:t_immutable.c:1519:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-11-13T11:31:17.309 INFO:teuthology.orchestra.run.smithi102.stderr: 1519 | asprintf(&linkpath, "%s/append-only.d/file.link-%d", dir, getuid()); 2023-11-13T11:31:17.309 INFO:teuthology.orchestra.run.smithi102.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-11-13T11:31:17.309 INFO:teuthology.orchestra.run.smithi102.stderr:t_immutable.c:1529:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-11-13T11:31:17.309 INFO:teuthology.orchestra.run.smithi102.stderr: 1529 | asprintf(&linkpath, "%s/append-only.d/file.symlink-%d", dir, getuid()); 2023-11-13T11:31:17.310 INFO:teuthology.orchestra.run.smithi102.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-11-13T11:31:17.310 INFO:teuthology.orchestra.run.smithi102.stderr:t_immutable.c:1539:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-11-13T11:31:17.310 INFO:teuthology.orchestra.run.smithi102.stderr: 1539 | asprintf(&linkpath, "%s/append-only.d/file.newname", dir); 2023-11-13T11:31:17.310 INFO:teuthology.orchestra.run.smithi102.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-11-13T11:31:17.311 INFO:teuthology.orchestra.run.smithi102.stderr:t_immutable.c:1559:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-11-13T11:31:17.311 INFO:teuthology.orchestra.run.smithi102.stderr: 1559 | asprintf(&path, "%s/append-only.d/newfile-%d", dir, getuid()); 2023-11-13T11:31:17.311 INFO:teuthology.orchestra.run.smithi102.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-11-13T11:31:17.311 INFO:teuthology.orchestra.run.smithi102.stderr:t_immutable.c:1573:11: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-11-13T11:31:17.311 INFO:teuthology.orchestra.run.smithi102.stderr: 1573 | asprintf(&path, "%s/append-only.d/newdev-%d", dir, getuid()); 2023-11-13T11:31:17.312 INFO:teuthology.orchestra.run.smithi102.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-11-13T11:31:17.312 INFO:teuthology.orchestra.run.smithi102.stderr:t_immutable.c:1586:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-11-13T11:31:17.312 INFO:teuthology.orchestra.run.smithi102.stderr: 1586 | asprintf(&path, "%s/append-only.d/newdir-%d", dir, getuid()); 2023-11-13T11:31:17.312 INFO:teuthology.orchestra.run.smithi102.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-11-13T11:31:17.312 INFO:teuthology.orchestra.run.smithi102.stderr:t_immutable.c:1596:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-11-13T11:31:17.313 INFO:teuthology.orchestra.run.smithi102.stderr: 1596 | asprintf(&path, "%s/append-only.d/newdir-%d/newfile-%d", dir, getuid(), getuid()); 2023-11-13T11:31:17.313 INFO:teuthology.orchestra.run.smithi102.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-11-13T11:31:17.313 INFO:teuthology.orchestra.run.smithi102.stderr:t_immutable.c:1618:16: warning: ignoring return value of 'chown' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-11-13T11:31:17.313 INFO:teuthology.orchestra.run.smithi102.stderr: 1618 | chown(path, 0, 0); 2023-11-13T11:31:17.313 INFO:teuthology.orchestra.run.smithi102.stderr: | ^~~~~~~~~~~~~~~~~ 2023-11-13T11:31:17.314 INFO:teuthology.orchestra.run.smithi102.stderr:t_immutable.c:1622:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-11-13T11:31:17.314 INFO:teuthology.orchestra.run.smithi102.stderr: 1622 | asprintf(&path, "%s/append-only.d/dir/newfile-%d", dir, getuid()); 2023-11-13T11:31:17.314 INFO:teuthology.orchestra.run.smithi102.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-11-13T11:31:17.314 INFO:teuthology.orchestra.run.smithi102.stderr:t_immutable.c:1644:16: warning: ignoring return value of 'chown' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-11-13T11:31:17.314 INFO:teuthology.orchestra.run.smithi102.stderr: 1644 | chown(path, 0, 0); 2023-11-13T11:31:17.315 INFO:teuthology.orchestra.run.smithi102.stderr: | ^~~~~~~~~~~~~~~~~ 2023-11-13T11:31:17.315 INFO:teuthology.orchestra.run.smithi102.stderr:t_immutable.c:1648:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-11-13T11:31:17.315 INFO:teuthology.orchestra.run.smithi102.stderr: 1648 | asprintf(&path, "%s/append-only.d/dir", dir); 2023-11-13T11:31:17.315 INFO:teuthology.orchestra.run.smithi102.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-11-13T11:31:17.316 INFO:teuthology.orchestra.run.smithi102.stderr:t_immutable.c:1659:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-11-13T11:31:17.316 INFO:teuthology.orchestra.run.smithi102.stderr: 1659 | asprintf(&path, "%s/append-only.d", dir); 2023-11-13T11:31:17.316 INFO:teuthology.orchestra.run.smithi102.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-11-13T11:31:17.317 INFO:teuthology.orchestra.run.smithi102.stderr:t_immutable.c:1692:16: warning: ignoring return value of 'chown' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-11-13T11:31:17.317 INFO:teuthology.orchestra.run.smithi102.stderr: 1692 | chown(path, 0, 0); 2023-11-13T11:31:17.317 INFO:teuthology.orchestra.run.smithi102.stderr: | ^~~~~~~~~~~~~~~~~ 2023-11-13T11:31:17.317 INFO:teuthology.orchestra.run.smithi102.stderr:t_immutable.c:1769:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-11-13T11:31:17.318 INFO:teuthology.orchestra.run.smithi102.stderr: 1769 | asprintf(&path, "%s/empty-append-only.d", dir); 2023-11-13T11:31:17.318 INFO:teuthology.orchestra.run.smithi102.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-11-13T11:31:17.841 INFO:teuthology.orchestra.run.smithi102.stdout: [CC] stale_handle 2023-11-13T11:31:18.005 INFO:teuthology.orchestra.run.smithi102.stderr:stale_handle.c: In function 'main': 2023-11-13T11:31:18.005 INFO:teuthology.orchestra.run.smithi102.stderr:stale_handle.c:102:9: warning: ignoring return value of 'system' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-11-13T11:31:18.006 INFO:teuthology.orchestra.run.smithi102.stderr: 102 | system("echo 3 > /proc/sys/vm/drop_caches"); 2023-11-13T11:31:18.006 INFO:teuthology.orchestra.run.smithi102.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-11-13T11:31:18.061 INFO:teuthology.orchestra.run.smithi102.stdout: [CC] pwrite_mmap_blocked 2023-11-13T11:31:18.260 INFO:teuthology.orchestra.run.smithi102.stdout: [CC] t_dir_offset2 2023-11-13T11:31:18.500 INFO:teuthology.orchestra.run.smithi102.stdout: [CC] seek_sanity_test 2023-11-13T11:31:18.669 INFO:teuthology.orchestra.run.smithi102.stderr:seek_sanity_test.c: In function 'test18': 2023-11-13T11:31:18.669 INFO:teuthology.orchestra.run.smithi102.stderr:seek_sanity_test.c:460:9: warning: ignoring return value of 'ftruncate' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-11-13T11:31:18.669 INFO:teuthology.orchestra.run.smithi102.stderr: 460 | ftruncate(fd, 0); 2023-11-13T11:31:18.670 INFO:teuthology.orchestra.run.smithi102.stderr: | ^~~~~~~~~~~~~~~~ 2023-11-13T11:31:18.671 INFO:teuthology.orchestra.run.smithi102.stderr:seek_sanity_test.c: In function 'test_basic_support': 2023-11-13T11:31:18.671 INFO:teuthology.orchestra.run.smithi102.stderr:seek_sanity_test.c:1207:9: warning: ignoring return value of 'ftruncate' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-11-13T11:31:18.672 INFO:teuthology.orchestra.run.smithi102.stderr: 1207 | ftruncate(fd, 0); 2023-11-13T11:31:18.672 INFO:teuthology.orchestra.run.smithi102.stderr: | ^~~~~~~~~~~~~~~~ 2023-11-13T11:31:18.672 INFO:teuthology.orchestra.run.smithi102.stderr:seek_sanity_test.c:1256:9: warning: ignoring return value of 'ftruncate' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-11-13T11:31:18.672 INFO:teuthology.orchestra.run.smithi102.stderr: 1256 | ftruncate(fd, 0); 2023-11-13T11:31:18.672 INFO:teuthology.orchestra.run.smithi102.stderr: | ^~~~~~~~~~~~~~~~ 2023-11-13T11:31:18.673 INFO:teuthology.orchestra.run.smithi102.stderr:seek_sanity_test.c: In function 'get_io_sizes': 2023-11-13T11:31:18.673 INFO:teuthology.orchestra.run.smithi102.stderr:seek_sanity_test.c:88:17: warning: ignoring return value of 'ftruncate' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-11-13T11:31:18.673 INFO:teuthology.orchestra.run.smithi102.stderr: 88 | ftruncate(fd, 0); 2023-11-13T11:31:18.673 INFO:teuthology.orchestra.run.smithi102.stderr: | ^~~~~~~~~~~~~~~~ 2023-11-13T11:31:18.673 INFO:teuthology.orchestra.run.smithi102.stderr:seek_sanity_test.c:89:17: warning: ignoring return value of 'pwrite' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-11-13T11:31:18.674 INFO:teuthology.orchestra.run.smithi102.stderr: 89 | pwrite(fd, "a", 1, offset); 2023-11-13T11:31:18.674 INFO:teuthology.orchestra.run.smithi102.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-11-13T11:31:18.674 INFO:teuthology.orchestra.run.smithi102.stderr:seek_sanity_test.c:98:17: warning: ignoring return value of 'ftruncate' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-11-13T11:31:18.674 INFO:teuthology.orchestra.run.smithi102.stderr: 98 | ftruncate(fd, 0); 2023-11-13T11:31:18.674 INFO:teuthology.orchestra.run.smithi102.stderr: | ^~~~~~~~~~~~~~~~ 2023-11-13T11:31:18.675 INFO:teuthology.orchestra.run.smithi102.stderr:seek_sanity_test.c:99:17: warning: ignoring return value of 'pwrite' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-11-13T11:31:18.675 INFO:teuthology.orchestra.run.smithi102.stderr: 99 | pwrite(fd, "a", 1, offset); 2023-11-13T11:31:18.675 INFO:teuthology.orchestra.run.smithi102.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-11-13T11:31:18.984 INFO:teuthology.orchestra.run.smithi102.stdout: [CC] seek_copy_test 2023-11-13T11:31:19.210 INFO:teuthology.orchestra.run.smithi102.stdout: [CC] t_readdir_1 2023-11-13T11:31:19.361 INFO:teuthology.orchestra.run.smithi102.stderr:t_readdir_1.c: In function 'main': 2023-11-13T11:31:19.361 INFO:teuthology.orchestra.run.smithi102.stderr:t_readdir_1.c:30:25: warning: ignoring return value of 'read' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-11-13T11:31:19.361 INFO:teuthology.orchestra.run.smithi102.stderr: 30 | read(fd, buf, 100); 2023-11-13T11:31:19.361 INFO:teuthology.orchestra.run.smithi102.stderr: | ^~~~~~~~~~~~~~~~~~ 2023-11-13T11:31:19.403 INFO:teuthology.orchestra.run.smithi102.stdout: [CC] t_readdir_2 2023-11-13T11:31:19.597 INFO:teuthology.orchestra.run.smithi102.stdout: [CC] fsync-tester 2023-11-13T11:31:19.750 INFO:teuthology.orchestra.run.smithi102.stderr:fsync-tester.c: In function 'main': 2023-11-13T11:31:19.751 INFO:teuthology.orchestra.run.smithi102.stderr:fsync-tester.c:391:17: warning: ignoring return value of 'read' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-11-13T11:31:19.751 INFO:teuthology.orchestra.run.smithi102.stderr: 391 | read(fd, &seed, sizeof(seed)); 2023-11-13T11:31:19.751 INFO:teuthology.orchestra.run.smithi102.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-11-13T11:31:19.751 INFO:teuthology.orchestra.run.smithi102.stderr:fsync-tester.c:541:17: warning: ignoring return value of 'system' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-11-13T11:31:19.752 INFO:teuthology.orchestra.run.smithi102.stderr: 541 | system("reboot -fn"); 2023-11-13T11:31:19.752 INFO:teuthology.orchestra.run.smithi102.stderr: | ^~~~~~~~~~~~~~~~~~~~ 2023-11-13T11:31:19.753 INFO:teuthology.orchestra.run.smithi102.stderr:fsync-tester.c: In function 'drop_all_caches': 2023-11-13T11:31:19.753 INFO:teuthology.orchestra.run.smithi102.stderr:fsync-tester.c:90:9: warning: ignoring return value of 'write' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-11-13T11:31:19.753 INFO:teuthology.orchestra.run.smithi102.stderr: 90 | write(fd, value, sizeof(value)-1); 2023-11-13T11:31:19.753 INFO:teuthology.orchestra.run.smithi102.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-11-13T11:31:19.901 INFO:teuthology.orchestra.run.smithi102.stdout: [CC] nsexec 2023-11-13T11:31:20.044 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T11:31:20.049 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T11:31:20.130 INFO:teuthology.orchestra.run.smithi102.stdout: [CC] cloner 2023-11-13T11:31:20.355 INFO:teuthology.orchestra.run.smithi102.stdout: [CC] renameat2 2023-11-13T11:31:20.568 INFO:teuthology.orchestra.run.smithi102.stdout: [CC] t_getcwd 2023-11-13T11:31:20.719 INFO:teuthology.orchestra.run.smithi102.stderr:t_getcwd.c: In function 'test_getcwd': 2023-11-13T11:31:20.719 INFO:teuthology.orchestra.run.smithi102.stderr:t_getcwd.c:21:17: warning: ignoring return value of 'getcwd' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-11-13T11:31:20.719 INFO:teuthology.orchestra.run.smithi102.stderr: 21 | getcwd(cur_cwd, BUF_SIZE); 2023-11-13T11:31:20.719 INFO:teuthology.orchestra.run.smithi102.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~ 2023-11-13T11:31:20.773 INFO:teuthology.orchestra.run.smithi102.stdout: [CC] e4compact 2023-11-13T11:31:21.027 INFO:teuthology.orchestra.run.smithi102.stdout: [CC] test-nextquota 2023-11-13T11:31:21.250 INFO:teuthology.orchestra.run.smithi102.stdout: [CC] punch-alternating 2023-11-13T11:31:21.470 INFO:teuthology.orchestra.run.smithi102.stdout: [CC] attr-list-by-handle-cursor-test 2023-11-13T11:31:21.685 INFO:teuthology.orchestra.run.smithi102.stdout: [CC] listxattr 2023-11-13T11:31:21.875 INFO:teuthology.orchestra.run.smithi102.stdout: [CC] dio-interleaved 2023-11-13T11:31:22.084 INFO:teuthology.orchestra.run.smithi102.stdout: [CC] t_dir_type 2023-11-13T11:31:22.285 INFO:teuthology.orchestra.run.smithi102.stdout: [CC] dio-invalidate-cache 2023-11-13T11:31:22.437 INFO:teuthology.orchestra.run.smithi102.stderr:dio-invalidate-cache.c: In function 'main': 2023-11-13T11:31:22.438 INFO:teuthology.orchestra.run.smithi102.stderr:dio-invalidate-cache.c:286:17: warning: ignoring return value of 'write' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-11-13T11:31:22.438 INFO:teuthology.orchestra.run.smithi102.stderr: 286 | write(fd, buf, blksz * nr_child); 2023-11-13T11:31:22.438 INFO:teuthology.orchestra.run.smithi102.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-11-13T11:31:22.537 INFO:teuthology.orchestra.run.smithi102.stdout: [CC] stat_test 2023-11-13T11:31:22.875 INFO:teuthology.orchestra.run.smithi102.stdout: [CC] t_encrypted_d_revalidate 2023-11-13T11:31:23.086 INFO:teuthology.orchestra.run.smithi102.stdout: [CC] attr_replace_test 2023-11-13T11:31:23.297 INFO:teuthology.orchestra.run.smithi102.stdout: [CC] swapon 2023-11-13T11:31:23.509 INFO:teuthology.orchestra.run.smithi102.stdout: [CC] mkswap 2023-11-13T11:31:23.706 INFO:teuthology.orchestra.run.smithi102.stdout: [CC] t_attr_corruption 2023-11-13T11:31:23.901 INFO:teuthology.orchestra.run.smithi102.stdout: [CC] t_open_tmpfiles 2023-11-13T11:31:24.128 INFO:teuthology.orchestra.run.smithi102.stdout: [CC] fscrypt-crypt-util 2023-11-13T11:31:24.849 INFO:teuthology.orchestra.run.smithi102.stdout: [CC] bulkstat_null_ocount 2023-11-13T11:31:25.054 INFO:teuthology.orchestra.run.smithi102.stdout: [CC] splice-test 2023-11-13T11:31:25.285 INFO:teuthology.orchestra.run.smithi102.stdout: [CC] chprojid_fail 2023-11-13T11:31:25.495 INFO:teuthology.orchestra.run.smithi102.stdout: [CC] detached_mounts_propagation 2023-11-13T11:31:25.728 INFO:teuthology.orchestra.run.smithi102.stdout: [CC] ext4_resize 2023-11-13T11:31:25.926 INFO:teuthology.orchestra.run.smithi102.stdout: [CC] t_readdir_3 2023-11-13T11:31:26.167 INFO:teuthology.orchestra.run.smithi102.stdout: [CC] splice2pipe 2023-11-13T11:31:26.318 INFO:teuthology.orchestra.run.smithi102.stderr:splice2pipe.c: In function 'prepare_pipe': 2023-11-13T11:31:26.318 INFO:teuthology.orchestra.run.smithi102.stderr:splice2pipe.c:57:17: warning: ignoring return value of 'write' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-11-13T11:31:26.319 INFO:teuthology.orchestra.run.smithi102.stderr: 57 | write(p[1], buffer, n); 2023-11-13T11:31:26.319 INFO:teuthology.orchestra.run.smithi102.stderr: | ^~~~~~~~~~~~~~~~~~~~~~ 2023-11-13T11:31:26.319 INFO:teuthology.orchestra.run.smithi102.stderr:splice2pipe.c:65:17: warning: ignoring return value of 'read' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-11-13T11:31:26.319 INFO:teuthology.orchestra.run.smithi102.stderr: 65 | read(p[0], buffer, n); 2023-11-13T11:31:26.319 INFO:teuthology.orchestra.run.smithi102.stderr: | ^~~~~~~~~~~~~~~~~~~~~ 2023-11-13T11:31:26.376 INFO:teuthology.orchestra.run.smithi102.stdout: [CC] uuid_ioctl 2023-11-13T11:31:26.580 INFO:teuthology.orchestra.run.smithi102.stdout: [CC] fiemap-tester 2023-11-13T11:31:26.892 INFO:teuthology.orchestra.run.smithi102.stdout: [CC] t_stripealign 2023-11-13T11:31:27.093 INFO:teuthology.orchestra.run.smithi102.stdout: [CC] open_by_handle 2023-11-13T11:31:27.391 INFO:teuthology.orchestra.run.smithi102.stdout: [CC] t_mmap_dio 2023-11-13T11:31:27.600 INFO:teuthology.orchestra.run.smithi102.stdout: [CC] uring_read_fault 2023-11-13T11:31:27.832 INFO:teuthology.orchestra.run.smithi102.stdout: [CC] xfsfind 2023-11-13T11:31:28.081 INFO:teuthology.orchestra.run.smithi102.stdout: [CC] fssum 2023-11-13T11:31:28.567 INFO:teuthology.orchestra.run.smithi102.stdout:Building log-writes 2023-11-13T11:31:28.575 INFO:teuthology.orchestra.run.smithi102.stdout: [CC] replay-log 2023-11-13T11:31:28.959 INFO:teuthology.orchestra.run.smithi102.stdout:Building perf 2023-11-13T11:31:28.965 INFO:teuthology.orchestra.run.smithi102.stdout:Building aio-dio-regress 2023-11-13T11:31:28.975 INFO:teuthology.orchestra.run.smithi102.stdout: [CC] aiocp 2023-11-13T11:31:29.257 INFO:teuthology.orchestra.run.smithi102.stdout: [CC] aio-dio-append-write-fallocate-race 2023-11-13T11:31:29.479 INFO:teuthology.orchestra.run.smithi102.stdout: [CC] aio-dio-append-write-read-race 2023-11-13T11:31:29.708 INFO:teuthology.orchestra.run.smithi102.stdout: [CC] aio-dio-cow-race 2023-11-13T11:31:29.915 INFO:teuthology.orchestra.run.smithi102.stdout: [CC] aio-dio-cycle-write 2023-11-13T11:31:30.066 INFO:teuthology.orchestra.run.smithi102.stderr:aio-dio-cycle-write.c: In function 'init_test': 2023-11-13T11:31:30.070 INFO:teuthology.orchestra.run.smithi102.stderr:aio-dio-cycle-write.c:83:9: warning: ignoring return value of 'ftruncate' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-11-13T11:31:30.070 INFO:teuthology.orchestra.run.smithi102.stderr: 83 | ftruncate(fd, buf_size); 2023-11-13T11:31:30.070 INFO:teuthology.orchestra.run.smithi102.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~ 2023-11-13T11:31:30.157 INFO:teuthology.orchestra.run.smithi102.stdout: [CC] aio-dio-eof-race 2023-11-13T11:31:30.393 INFO:teuthology.orchestra.run.smithi102.stdout: [CC] aio-dio-extend-stat 2023-11-13T11:31:30.610 INFO:teuthology.orchestra.run.smithi102.stdout: [CC] aio-dio-fcntl-race 2023-11-13T11:31:30.824 INFO:teuthology.orchestra.run.smithi102.stdout: [CC] aio-dio-hole-filling-race 2023-11-13T11:31:31.027 INFO:teuthology.orchestra.run.smithi102.stdout: [CC] aio-dio-invalidate-failure 2023-11-13T11:31:31.237 INFO:teuthology.orchestra.run.smithi102.stdout: [CC] aio-dio-invalidate-readahead 2023-11-13T11:31:31.458 INFO:teuthology.orchestra.run.smithi102.stdout: [CC] aiodio_sparse2 2023-11-13T11:31:31.607 INFO:teuthology.orchestra.run.smithi102.stderr:aiodio_sparse2.c: In function 'aiodio_sparse': 2023-11-13T11:31:31.607 INFO:teuthology.orchestra.run.smithi102.stderr:aiodio_sparse2.c:111:17: warning: ignoring return value of 'ftruncate' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-11-13T11:31:31.607 INFO:teuthology.orchestra.run.smithi102.stderr: 111 | ftruncate(fd, filesize); 2023-11-13T11:31:31.608 INFO:teuthology.orchestra.run.smithi102.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~ 2023-11-13T11:31:31.608 INFO:teuthology.orchestra.run.smithi102.stderr:aiodio_sparse2.c: In function 'dirty_freeblocks': 2023-11-13T11:31:31.608 INFO:teuthology.orchestra.run.smithi102.stderr:aiodio_sparse2.c:274:9: warning: ignoring return value of 'ftruncate' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-11-13T11:31:31.608 INFO:teuthology.orchestra.run.smithi102.stderr: 274 | ftruncate(fd, size); 2023-11-13T11:31:31.609 INFO:teuthology.orchestra.run.smithi102.stderr: | ^~~~~~~~~~~~~~~~~~~ 2023-11-13T11:31:31.731 INFO:teuthology.orchestra.run.smithi102.stdout: [CC] aio-dio-subblock-eof-read 2023-11-13T11:31:31.928 INFO:teuthology.orchestra.run.smithi102.stdout: [CC] aio-dio-write-verify 2023-11-13T11:31:32.185 INFO:teuthology.orchestra.run.smithi102.stdout: [CC] aio-free-ring-with-bogus-nr-pages 2023-11-13T11:31:32.368 INFO:teuthology.orchestra.run.smithi102.stdout: [CC] aio-io-setup-with-nonwritable-context-pointer 2023-11-13T11:31:32.552 INFO:teuthology.orchestra.run.smithi102.stdout: [CC] aio-last-ref-held-by-io 2023-11-13T11:31:32.783 INFO:teuthology.orchestra.run.smithi102.stdout:Building vfs 2023-11-13T11:31:32.791 INFO:teuthology.orchestra.run.smithi102.stdout: [CC] vfstest 2023-11-13T11:31:37.107 INFO:teuthology.orchestra.run.smithi102.stdout: [CC] mount-idmapped 2023-11-13T11:31:37.588 INFO:teuthology.orchestra.run.smithi102.stdout:Building m4 2023-11-13T11:31:37.594 INFO:teuthology.orchestra.run.smithi102.stdout:Building common 2023-11-13T11:31:37.601 INFO:teuthology.orchestra.run.smithi102.stdout:Building tests 2023-11-13T11:31:37.610 INFO:teuthology.orchestra.run.smithi102.stdout:Building btrfs 2023-11-13T11:31:37.620 INFO:teuthology.orchestra.run.smithi102.stdout: [GROUP] /tmp/tmp.EnLPmcWJbzxfstests-dev/tests/btrfs/group.list 2023-11-13T11:31:37.752 INFO:teuthology.orchestra.run.smithi102.stdout:Building ceph 2023-11-13T11:31:37.760 INFO:teuthology.orchestra.run.smithi102.stdout: [GROUP] /tmp/tmp.EnLPmcWJbzxfstests-dev/tests/ceph/group.list 2023-11-13T11:31:37.793 INFO:teuthology.orchestra.run.smithi102.stdout:Building cifs 2023-11-13T11:31:37.801 INFO:teuthology.orchestra.run.smithi102.stdout: [GROUP] /tmp/tmp.EnLPmcWJbzxfstests-dev/tests/cifs/group.list 2023-11-13T11:31:37.830 INFO:teuthology.orchestra.run.smithi102.stdout:Building ext4 2023-11-13T11:31:37.839 INFO:teuthology.orchestra.run.smithi102.stdout: [GROUP] /tmp/tmp.EnLPmcWJbzxfstests-dev/tests/ext4/group.list 2023-11-13T11:31:37.925 INFO:teuthology.orchestra.run.smithi102.stdout:Building f2fs 2023-11-13T11:31:37.933 INFO:teuthology.orchestra.run.smithi102.stdout: [GROUP] /tmp/tmp.EnLPmcWJbzxfstests-dev/tests/f2fs/group.list 2023-11-13T11:31:37.971 INFO:teuthology.orchestra.run.smithi102.stdout:Building generic 2023-11-13T11:31:37.982 INFO:teuthology.orchestra.run.smithi102.stdout: [GROUP] /tmp/tmp.EnLPmcWJbzxfstests-dev/tests/generic/group.list 2023-11-13T11:31:38.199 INFO:teuthology.orchestra.run.smithi102.stdout:Building nfs 2023-11-13T11:31:38.207 INFO:teuthology.orchestra.run.smithi102.stdout: [GROUP] /tmp/tmp.EnLPmcWJbzxfstests-dev/tests/nfs/group.list 2023-11-13T11:31:38.240 INFO:teuthology.orchestra.run.smithi102.stdout:Building ocfs2 2023-11-13T11:31:38.248 INFO:teuthology.orchestra.run.smithi102.stdout: [GROUP] /tmp/tmp.EnLPmcWJbzxfstests-dev/tests/ocfs2/group.list 2023-11-13T11:31:38.279 INFO:teuthology.orchestra.run.smithi102.stdout:Building overlay 2023-11-13T11:31:38.287 INFO:teuthology.orchestra.run.smithi102.stdout: [GROUP] /tmp/tmp.EnLPmcWJbzxfstests-dev/tests/overlay/group.list 2023-11-13T11:31:38.377 INFO:teuthology.orchestra.run.smithi102.stdout:Building perf 2023-11-13T11:31:38.386 INFO:teuthology.orchestra.run.smithi102.stdout: [GROUP] /tmp/tmp.EnLPmcWJbzxfstests-dev/tests/perf/group.list 2023-11-13T11:31:38.412 INFO:teuthology.orchestra.run.smithi102.stdout:Building selftest 2023-11-13T11:31:38.421 INFO:teuthology.orchestra.run.smithi102.stdout: [GROUP] /tmp/tmp.EnLPmcWJbzxfstests-dev/tests/selftest/group.list 2023-11-13T11:31:38.449 INFO:teuthology.orchestra.run.smithi102.stdout:Building shared 2023-11-13T11:31:38.458 INFO:teuthology.orchestra.run.smithi102.stdout: [GROUP] /tmp/tmp.EnLPmcWJbzxfstests-dev/tests/shared/group.list 2023-11-13T11:31:38.496 INFO:teuthology.orchestra.run.smithi102.stdout:Building tmpfs 2023-11-13T11:31:38.505 INFO:teuthology.orchestra.run.smithi102.stdout: [GROUP] /tmp/tmp.EnLPmcWJbzxfstests-dev/tests/tmpfs/group.list 2023-11-13T11:31:38.535 INFO:teuthology.orchestra.run.smithi102.stdout:Building udf 2023-11-13T11:31:38.544 INFO:teuthology.orchestra.run.smithi102.stdout: [GROUP] /tmp/tmp.EnLPmcWJbzxfstests-dev/tests/udf/group.list 2023-11-13T11:31:38.570 INFO:teuthology.orchestra.run.smithi102.stdout:Building xfs 2023-11-13T11:31:38.580 INFO:teuthology.orchestra.run.smithi102.stdout: [GROUP] /tmp/tmp.EnLPmcWJbzxfstests-dev/tests/xfs/group.list 2023-11-13T11:31:38.799 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo make install) 2023-11-13T11:31:38.888 INFO:teuthology.orchestra.run.smithi102.stdout:Building include 2023-11-13T11:31:38.894 INFO:teuthology.orchestra.run.smithi102.stdout:Building lib 2023-11-13T11:31:38.901 INFO:teuthology.orchestra.run.smithi102.stdout:Building ltp 2023-11-13T11:31:38.908 INFO:teuthology.orchestra.run.smithi102.stdout:Building src 2023-11-13T11:31:38.964 INFO:teuthology.orchestra.run.smithi102.stdout:Building log-writes 2023-11-13T11:31:38.970 INFO:teuthology.orchestra.run.smithi102.stdout:Building perf 2023-11-13T11:31:38.977 INFO:teuthology.orchestra.run.smithi102.stdout:Building aio-dio-regress 2023-11-13T11:31:38.984 INFO:teuthology.orchestra.run.smithi102.stdout:Building vfs 2023-11-13T11:31:38.991 INFO:teuthology.orchestra.run.smithi102.stdout:Building m4 2023-11-13T11:31:38.997 INFO:teuthology.orchestra.run.smithi102.stdout:Building common 2023-11-13T11:31:39.004 INFO:teuthology.orchestra.run.smithi102.stdout:Building tests 2023-11-13T11:31:39.012 INFO:teuthology.orchestra.run.smithi102.stdout:Building btrfs 2023-11-13T11:31:39.022 INFO:teuthology.orchestra.run.smithi102.stdout: [GROUP] /tmp/tmp.EnLPmcWJbzxfstests-dev/tests/btrfs/group.list 2023-11-13T11:31:39.152 INFO:teuthology.orchestra.run.smithi102.stdout:Building ceph 2023-11-13T11:31:39.161 INFO:teuthology.orchestra.run.smithi102.stdout: [GROUP] /tmp/tmp.EnLPmcWJbzxfstests-dev/tests/ceph/group.list 2023-11-13T11:31:39.193 INFO:teuthology.orchestra.run.smithi102.stdout:Building cifs 2023-11-13T11:31:39.202 INFO:teuthology.orchestra.run.smithi102.stdout: [GROUP] /tmp/tmp.EnLPmcWJbzxfstests-dev/tests/cifs/group.list 2023-11-13T11:31:39.230 INFO:teuthology.orchestra.run.smithi102.stdout:Building ext4 2023-11-13T11:31:39.239 INFO:teuthology.orchestra.run.smithi102.stdout: [GROUP] /tmp/tmp.EnLPmcWJbzxfstests-dev/tests/ext4/group.list 2023-11-13T11:31:39.323 INFO:teuthology.orchestra.run.smithi102.stdout:Building f2fs 2023-11-13T11:31:39.332 INFO:teuthology.orchestra.run.smithi102.stdout: [GROUP] /tmp/tmp.EnLPmcWJbzxfstests-dev/tests/f2fs/group.list 2023-11-13T11:31:39.371 INFO:teuthology.orchestra.run.smithi102.stdout:Building generic 2023-11-13T11:31:39.382 INFO:teuthology.orchestra.run.smithi102.stdout: [GROUP] /tmp/tmp.EnLPmcWJbzxfstests-dev/tests/generic/group.list 2023-11-13T11:31:39.590 INFO:teuthology.orchestra.run.smithi102.stdout:Building nfs 2023-11-13T11:31:39.599 INFO:teuthology.orchestra.run.smithi102.stdout: [GROUP] /tmp/tmp.EnLPmcWJbzxfstests-dev/tests/nfs/group.list 2023-11-13T11:31:39.632 INFO:teuthology.orchestra.run.smithi102.stdout:Building ocfs2 2023-11-13T11:31:39.640 INFO:teuthology.orchestra.run.smithi102.stdout: [GROUP] /tmp/tmp.EnLPmcWJbzxfstests-dev/tests/ocfs2/group.list 2023-11-13T11:31:39.671 INFO:teuthology.orchestra.run.smithi102.stdout:Building overlay 2023-11-13T11:31:39.680 INFO:teuthology.orchestra.run.smithi102.stdout: [GROUP] /tmp/tmp.EnLPmcWJbzxfstests-dev/tests/overlay/group.list 2023-11-13T11:31:39.769 INFO:teuthology.orchestra.run.smithi102.stdout:Building perf 2023-11-13T11:31:39.778 INFO:teuthology.orchestra.run.smithi102.stdout: [GROUP] /tmp/tmp.EnLPmcWJbzxfstests-dev/tests/perf/group.list 2023-11-13T11:31:39.804 INFO:teuthology.orchestra.run.smithi102.stdout:Building selftest 2023-11-13T11:31:39.812 INFO:teuthology.orchestra.run.smithi102.stdout: [GROUP] /tmp/tmp.EnLPmcWJbzxfstests-dev/tests/selftest/group.list 2023-11-13T11:31:39.841 INFO:teuthology.orchestra.run.smithi102.stdout:Building shared 2023-11-13T11:31:39.850 INFO:teuthology.orchestra.run.smithi102.stdout: [GROUP] /tmp/tmp.EnLPmcWJbzxfstests-dev/tests/shared/group.list 2023-11-13T11:31:39.889 INFO:teuthology.orchestra.run.smithi102.stdout:Building tmpfs 2023-11-13T11:31:39.898 INFO:teuthology.orchestra.run.smithi102.stdout: [GROUP] /tmp/tmp.EnLPmcWJbzxfstests-dev/tests/tmpfs/group.list 2023-11-13T11:31:39.928 INFO:teuthology.orchestra.run.smithi102.stdout:Building udf 2023-11-13T11:31:39.937 INFO:teuthology.orchestra.run.smithi102.stdout: [GROUP] /tmp/tmp.EnLPmcWJbzxfstests-dev/tests/udf/group.list 2023-11-13T11:31:39.963 INFO:teuthology.orchestra.run.smithi102.stdout:Building xfs 2023-11-13T11:31:39.974 INFO:teuthology.orchestra.run.smithi102.stdout: [GROUP] /tmp/tmp.EnLPmcWJbzxfstests-dev/tests/xfs/group.list 2023-11-13T11:31:40.186 INFO:teuthology.orchestra.run.smithi102.stdout:/usr/bin/gmake --no-print-directory Q=@ -C include install 2023-11-13T11:31:40.190 INFO:teuthology.orchestra.run.smithi102.stdout:gmake[1]: Nothing to be done for 'install'. 2023-11-13T11:31:40.190 INFO:teuthology.orchestra.run.smithi102.stdout:/usr/bin/gmake --no-print-directory Q=@ -C lib install 2023-11-13T11:31:40.194 INFO:teuthology.orchestra.run.smithi102.stdout:gmake[1]: Nothing to be done for 'install'. 2023-11-13T11:31:40.195 INFO:teuthology.orchestra.run.smithi102.stdout:/usr/bin/gmake --no-print-directory Q=@ -C ltp install 2023-11-13T11:31:40.199 INFO:teuthology.orchestra.run.smithi102.stdout:../install-sh -o root -g root -m 755 -d /var/lib/xfstests/ltp 2023-11-13T11:31:40.220 INFO:teuthology.orchestra.run.smithi102.stdout:/bin/bash ../libtool --quiet --mode=install ../install-sh -o root -g root -m 755 doio fsstress fsx growfiles iogen aio-stress /var/lib/xfstests/ltp 2023-11-13T11:31:40.378 INFO:teuthology.orchestra.run.smithi102.stdout:../install-sh -o root -g root -m 755 rwtest.sh /var/lib/xfstests/ltp 2023-11-13T11:31:40.399 INFO:teuthology.orchestra.run.smithi102.stdout:/usr/bin/gmake --no-print-directory Q=@ -C src install 2023-11-13T11:31:40.428 INFO:teuthology.orchestra.run.smithi102.stdout:Building log-writes 2023-11-13T11:31:40.434 INFO:teuthology.orchestra.run.smithi102.stdout:Building perf 2023-11-13T11:31:40.440 INFO:teuthology.orchestra.run.smithi102.stdout:Building aio-dio-regress 2023-11-13T11:31:40.447 INFO:teuthology.orchestra.run.smithi102.stdout:Building vfs 2023-11-13T11:31:40.453 INFO:teuthology.orchestra.run.smithi102.stdout:/usr/bin/gmake -C log-writes install 2023-11-13T11:31:40.456 INFO:teuthology.orchestra.run.smithi102.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/src/log-writes 2023-11-13T11:31:40.477 INFO:teuthology.orchestra.run.smithi102.stdout:../../install-sh -o root -g root -m 755 replay-log /var/lib/xfstests/src/log-writes 2023-11-13T11:31:40.497 INFO:teuthology.orchestra.run.smithi102.stdout:/usr/bin/gmake -C perf install 2023-11-13T11:31:40.501 INFO:teuthology.orchestra.run.smithi102.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/src/perf 2023-11-13T11:31:40.521 INFO:teuthology.orchestra.run.smithi102.stdout:../../install-sh -o root -g root -m 755 FioCompare.py fio-insert-and-compare.py FioResultDecoder.py generate-schema.py ResultData.py fio-results.sql /var/lib/xfstests/src/perf 2023-11-13T11:31:40.571 INFO:teuthology.orchestra.run.smithi102.stdout:/usr/bin/gmake -C aio-dio-regress install 2023-11-13T11:31:40.575 INFO:teuthology.orchestra.run.smithi102.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/src/aio-dio-regress 2023-11-13T11:31:40.595 INFO:teuthology.orchestra.run.smithi102.stdout:../../install-sh -o root -g root -m 755 aiocp aio-dio-append-write-fallocate-race aio-dio-append-write-read-race aio-dio-cow-race aio-dio-cycle-write aio-dio-eof-race aio-dio-extend-stat aio-dio-fcntl-race aio-dio-hole-filling-race aio-dio-invalidate-failure aio-dio-invalidate-readahead aiodio_sparse2 aio-dio-subblock-eof-read aio-dio-write-verify aio-free-ring-with-bogus-nr-pages aio-io-setup-with-nonwritable-context-pointer aio-last-ref-held-by-io /var/lib/xfstests/src/aio-dio-regress 2023-11-13T11:31:40.711 INFO:teuthology.orchestra.run.smithi102.stdout:/usr/bin/gmake -C vfs install 2023-11-13T11:31:40.714 INFO:teuthology.orchestra.run.smithi102.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/src/vfs 2023-11-13T11:31:40.734 INFO:teuthology.orchestra.run.smithi102.stdout:../../install-sh -o root -g root -m 755 vfstest mount-idmapped /var/lib/xfstests/src/vfs 2023-11-13T11:31:40.763 INFO:teuthology.orchestra.run.smithi102.stdout:../install-sh -o root -g root -m 755 -d /var/lib/xfstests/src 2023-11-13T11:31:40.783 INFO:teuthology.orchestra.run.smithi102.stdout:/bin/bash ../libtool --quiet --mode=install ../install-sh -o root -g root -m 755 dirstress fill fill2 getpagesize holes lstat64 nametest permname randholes runas truncfile usemem mmapcat append_reader append_writer dirperf metaperf devzero feature alloc fault fstest t_access_root godown resvtest writemod writev_on_pagefault makeextents itrash rename multi_open_unlink unwritten_sync genhashnames t_holes t_mmap_writev t_truncate_cmtime dirhash_collide t_rename_overwrite holetest t_truncate_self af_unix t_mmap_stale_pmd t_mmap_cow_race t_mmap_fallocate fsync-err t_mmap_write_ro t_ext4_dax_journal_corruption t_ext4_dax_inline_corruption t_ofd_locks t_mmap_collision mmap-write-concurrent t_get_file_time t_create_short_dirs t_create_long_dirs t_enospc t_mmap_writev_overlap checkpoint_journal mmap-rw-fault allocstale t_mmap_cow_memory_failure fake-dump-rootino dio-buf-fault rewinddir-test xfsctl bstat t_mtab getdevicesize preallo_rw_pattern_reader preallo_rw_pattern_writer ftrunc trunc fs_perms testx looptest locktest unwritten_mmap bulkstat_unlink_test deduperace bulkstat_unlink_test_modified t_dir_offset t_futimens t_immutable stale_handle pwrite_mmap_blocked t_dir_offset2 seek_sanity_test seek_copy_test t_readdir_1 t_readdir_2 fsync-tester nsexec cloner renameat2 t_getcwd e4compact test-nextquota punch-alternating attr-list-by-handle-cursor-test listxattr dio-interleaved t_dir_type dio-invalidate-cache stat_test t_encrypted_d_revalidate attr_replace_test swapon mkswap t_attr_corruption t_open_tmpfiles fscrypt-crypt-util bulkstat_null_ocount splice-test chprojid_fail detached_mounts_propagation ext4_resize t_readdir_3 splice2pipe uuid_ioctl fiemap-tester t_stripealign open_by_handle t_mmap_dio uring_read_fault xfsfind fssum /var/lib/xfstests/src 2023-11-13T11:31:43.584 INFO:teuthology.orchestra.run.smithi102.stdout:/bin/bash ../libtool --quiet --mode=install ../install-sh -o root -g root -m 755 dmerror fill2attr fill2fs fill2fs_check scaleread.sh btrfs_crc32c_forged_name.py popdir.pl popattr.py soak_duration.awk /var/lib/xfstests/src 2023-11-13T11:31:43.808 INFO:teuthology.orchestra.run.smithi102.stdout:/bin/bash ../libtool --quiet --mode=install ../install-sh -o root -g root -m 644 dumpfile /var/lib/xfstests/src 2023-11-13T11:31:43.855 INFO:teuthology.orchestra.run.smithi102.stdout:/usr/bin/gmake --no-print-directory Q=@ -C m4 install 2023-11-13T11:31:43.859 INFO:teuthology.orchestra.run.smithi102.stdout:gmake[1]: Nothing to be done for 'install'. 2023-11-13T11:31:43.860 INFO:teuthology.orchestra.run.smithi102.stdout:/usr/bin/gmake --no-print-directory Q=@ -C common install 2023-11-13T11:31:43.863 INFO:teuthology.orchestra.run.smithi102.stdout:../install-sh -o root -g root -m 755 -d /var/lib/xfstests/common 2023-11-13T11:31:43.884 INFO:teuthology.orchestra.run.smithi102.stdout:../install-sh -o root -g root -m 644 * /var/lib/xfstests/common 2023-11-13T11:31:44.168 INFO:teuthology.orchestra.run.smithi102.stdout:/usr/bin/gmake --no-print-directory Q=@ -C tests install 2023-11-13T11:31:44.171 INFO:teuthology.orchestra.run.smithi102.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.EnLPmcWJbzxfstests-dev/tests/btrfs/ install 2023-11-13T11:31:44.177 INFO:teuthology.orchestra.run.smithi102.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/btrfs 2023-11-13T11:31:44.197 INFO:teuthology.orchestra.run.smithi102.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 006 007 008 009 010 011 012 013 014 015 016 017 018 019 020 021 022 023 024 025 026 027 028 029 030 031 032 033 034 035 036 037 038 039 040 041 042 043 044 045 046 047 048 049 050 051 052 053 054 055 056 057 058 059 060 061 062 063 064 065 066 067 068 069 070 071 072 073 074 075 076 077 078 079 080 081 082 083 084 085 086 087 088 089 090 091 092 093 094 095 096 097 098 099 100 101 102 103 104 105 106 107 108 109 110 111 112 113 114 115 116 117 118 119 120 121 122 123 124 125 126 127 128 129 130 131 132 133 134 135 136 137 138 139 140 141 142 143 144 145 146 147 148 149 150 151 152 153 154 155 156 157 158 159 160 161 162 163 164 165 166 167 168 169 170 171 172 173 174 175 176 177 178 179 180 181 182 183 184 185 186 187 188 189 190 191 192 193 194 195 196 197 198 199 200 201 202 203 204 205 206 207 208 209 210 211 212 213 214 215 216 217 218 219 220 221 222 223 224 225 226 227 228 229 230 231 232 233 234 235 236 237 238 239 240 241 242 243 244 245 246 247 248 249 250 251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300 301 /var/lib/xfstests/tests/btrfs 2023-11-13T11:31:45.935 INFO:teuthology.orchestra.run.smithi102.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/btrfs 2023-11-13T11:31:45.956 INFO:teuthology.orchestra.run.smithi102.stdout:../../install-sh -o root -g root -m 644 001.out 002.out 003.out 004.out 005.out 006.out 007.out 008.out 009.out 010.out 011.out 012.out 013.out 014.out 015.out 016.out 017.out 018.out 019.out 020.out 021.out 022.out 023.out 024.out 025.out 026.out 027.out 028.out 029.out 030.out 031.out 032.out 033.out 034.out 035.out 036.out 037.out 038.out 039.out 040.out 041.out 042.out 043.out 044.out 045.out 046.out 047.out 048.out 049.out 050.out 051.out 052.out 053.out 054.out 055.out 056.out 057.out 058.out 059.out 060.out 061.out 062.out 063.out 064.out 065.out 066.out 067.out 068.out 069.out 070.out 071.out 072.out 073.out 074.out 075.out 076.out 077.out 078.out 079.out 080.out 081.out 082.out 083.out 084.out 085.out 086.out 087.out 088.out 089.out 090.out 091.out 092.out 093.out 094.out 095.out 096.out 097.out 098.out 099.out 100.out 101.out 102.out 103.out 104.out 105.out 106.out 107.out 108.out 109.out 110.out 111.out 112.out 113.out 114.out 115.out 116.out 117.out 118.out 119.out 120.out 121.out 122.out 123.out 124.out 125.out 126.out 127.out 128.out 129.out 130.out 131.out 132.out 133.out 134.out 135.out 136.out 137.out 138.out 139.out 140.out 141.out 142.out 143.out 144.out 145.out 146.out 147.out 148.out 149.out 150.out 151.out 152.out 153.out 154.out 155.out 156.out 157.out 158.out 159.out 160.out 161.out 162.out 163.out 164.out 165.out 166.out 167.out 168.out 169.out 170.out 171.out 172.out 173.out 174.out 175.out 176.out 177.out 178.out 179.out 180.out 181.out 182.out 183.out 184.out 185.out 186.out 187.out 188.out 189.out 190.out 191.out 192.out 193.out 194.out 195.out 196.out 197.out 198.out 199.out 200.out 201.out 202.out 203.out 204.out 205.out 206.out 207.out 208.out 209.out 210.out 211.out 212.out 213.out 214.out 215.out 216.out 217.out 218.out 219.out 220.out 221.out 222.out 223.out 224.out 225.out 226.out 227.out 228.out 229.out 230.out 231.out 232.out 233.out 234.out 235.out 236.out 237.out 238.out 239.out 240.out 241.out 242.out 243.out 244.out 245.out 246.out 247.out 248.out 249.out 250.out 251.out 252.out 253.out 254.out 255.out 256.out 257.out 258.out 259.out 260.out 261.out 262.out 263.out 264.out 265.out 266.out 267.out 268.out 269.out 270.out 271.out 272.out 273.out 274.out 275.out 276.out 277.out 278.out 279.out 280.out 281.out 282.out 283.out 284.out 285.out 286.out 287.out 288.out 289.out 290.out 291.out 292.out 293.out 294.out 295.out 296.out 297.out 298.out 299.out 300.out 301.out /var/lib/xfstests/tests/btrfs 2023-11-13T11:31:47.701 INFO:teuthology.orchestra.run.smithi102.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.EnLPmcWJbzxfstests-dev/tests/ceph/ install 2023-11-13T11:31:47.705 INFO:teuthology.orchestra.run.smithi102.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/ceph 2023-11-13T11:31:47.725 INFO:teuthology.orchestra.run.smithi102.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 /var/lib/xfstests/tests/ceph 2023-11-13T11:31:47.768 INFO:teuthology.orchestra.run.smithi102.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/ceph 2023-11-13T11:31:47.788 INFO:teuthology.orchestra.run.smithi102.stdout:../../install-sh -o root -g root -m 644 001.out 002.out 003.out 004.out 005.out /var/lib/xfstests/tests/ceph 2023-11-13T11:31:47.831 INFO:teuthology.orchestra.run.smithi102.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.EnLPmcWJbzxfstests-dev/tests/cifs/ install 2023-11-13T11:31:47.835 INFO:teuthology.orchestra.run.smithi102.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/cifs 2023-11-13T11:31:47.855 INFO:teuthology.orchestra.run.smithi102.stdout:../../install-sh -o root -g root -m 755 001 /var/lib/xfstests/tests/cifs 2023-11-13T11:31:47.876 INFO:teuthology.orchestra.run.smithi102.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/cifs 2023-11-13T11:31:47.897 INFO:teuthology.orchestra.run.smithi102.stdout:../../install-sh -o root -g root -m 644 001.out /var/lib/xfstests/tests/cifs 2023-11-13T11:31:47.918 INFO:teuthology.orchestra.run.smithi102.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.EnLPmcWJbzxfstests-dev/tests/ext4/ install 2023-11-13T11:31:47.922 INFO:teuthology.orchestra.run.smithi102.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/ext4 2023-11-13T11:31:47.942 INFO:teuthology.orchestra.run.smithi102.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 006 007 008 009 010 011 012 013 014 015 016 017 018 019 020 021 022 023 024 025 026 027 028 029 030 031 032 033 034 035 036 037 038 039 040 041 042 043 044 045 046 047 048 049 050 051 052 053 054 055 056 057 058 059 271 301 302 303 304 305 306 307 308 /var/lib/xfstests/tests/ext4 2023-11-13T11:31:48.345 INFO:teuthology.orchestra.run.smithi102.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/ext4 2023-11-13T11:31:48.365 INFO:teuthology.orchestra.run.smithi102.stdout:../../install-sh -o root -g root -m 644 001.out.default 001.out.nodelalloc 001.out.nozero 001.cfg 002.out 003.out 004.out 005.out 006.out 007.out 008.out 009.out 010.out 011.out 012.out 013.out 014.out 015.out 016.out 017.out 018.out 019.out 020.out 021.out 022.out 023.out 024.out 025.out 026.out 027.out 028.out 029.out 030.out 031.out 032.out 033.out 034.out 035.out 036.out 037.out 038.out 039.out 040.out 041.out 042.out 043.out 044.out 045.out 046.out 047.out 048.out 049.out 050.out 051.out 052.out 053.out 054.out 055.out 056.out 057.out 058.out 059.out 271.out 301.out 302.out 303.out 304.out 305.out 306.out 307.out 308.out /var/lib/xfstests/tests/ext4 2023-11-13T11:31:48.792 INFO:teuthology.orchestra.run.smithi102.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.EnLPmcWJbzxfstests-dev/tests/f2fs/ install 2023-11-13T11:31:48.795 INFO:teuthology.orchestra.run.smithi102.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/f2fs 2023-11-13T11:31:48.816 INFO:teuthology.orchestra.run.smithi102.stdout:../../install-sh -o root -g root -m 755 001 002 /var/lib/xfstests/tests/f2fs 2023-11-13T11:31:48.842 INFO:teuthology.orchestra.run.smithi102.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/f2fs 2023-11-13T11:31:48.863 INFO:teuthology.orchestra.run.smithi102.stdout:../../install-sh -o root -g root -m 644 001.out 002.out /var/lib/xfstests/tests/f2fs 2023-11-13T11:31:48.889 INFO:teuthology.orchestra.run.smithi102.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.EnLPmcWJbzxfstests-dev/tests/generic/ install 2023-11-13T11:31:48.896 INFO:teuthology.orchestra.run.smithi102.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/generic 2023-11-13T11:31:48.917 INFO:teuthology.orchestra.run.smithi102.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 006 007 008 009 010 011 012 013 014 015 016 017 018 019 020 021 022 023 024 025 026 027 028 029 030 031 032 033 034 035 036 037 038 039 040 041 042 043 044 045 046 047 048 049 050 051 052 053 054 055 056 057 058 059 060 061 062 063 064 065 066 067 068 069 070 071 072 073 074 075 076 077 078 079 080 081 082 083 084 085 086 087 088 089 090 091 092 093 094 095 096 097 098 099 100 101 102 103 104 105 106 107 108 109 110 111 112 113 114 115 116 117 118 119 120 121 122 123 124 125 126 127 128 129 130 131 132 133 134 135 136 137 138 139 140 141 142 143 144 145 146 147 148 149 150 151 152 153 154 155 156 157 158 159 160 161 162 163 164 165 166 167 168 169 170 171 172 173 174 175 176 177 178 179 180 181 182 183 184 185 186 187 188 189 190 191 192 193 194 195 196 197 198 199 200 201 202 203 204 205 206 207 208 209 210 211 212 213 214 215 216 217 218 219 220 221 222 223 224 225 226 227 228 229 230 231 232 233 234 235 236 237 238 239 240 241 242 243 244 245 246 247 248 249 250 251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300 301 302 303 304 305 306 307 308 309 310 311 312 313 314 315 316 317 318 319 320 321 322 323 324 325 326 327 328 329 330 331 332 333 334 335 336 337 338 339 340 341 342 343 344 345 346 347 348 349 350 351 352 353 354 355 356 357 358 359 360 361 362 363 364 365 366 367 368 369 370 371 372 373 374 375 376 377 378 379 380 381 382 383 384 385 386 387 388 389 390 391 392 393 394 395 396 397 398 399 400 401 402 403 404 405 406 407 408 409 410 411 412 413 414 415 416 417 418 419 420 421 422 423 424 425 426 427 428 429 430 431 432 433 434 435 436 437 438 439 440 441 442 443 444 445 446 447 448 449 450 451 452 453 454 455 456 457 458 459 460 461 462 463 464 465 466 467 468 469 470 471 472 473 474 475 476 477 478 479 480 481 482 483 484 485 486 487 488 489 490 491 492 493 494 495 496 497 498 499 500 501 502 503 504 505 506 507 508 509 510 511 512 513 514 515 516 517 518 519 520 521 522 523 524 525 526 527 528 529 530 531 532 533 534 535 536 537 538 539 540 541 542 543 544 545 546 547 548 549 550 551 552 553 554 555 556 557 558 559 560 561 562 563 564 565 566 567 568 569 570 571 572 573 574 575 576 577 578 579 580 581 582 583 584 585 586 587 588 589 590 591 592 593 594 595 596 597 598 599 600 601 602 603 604 605 606 607 608 609 610 611 612 613 614 615 616 617 618 619 620 621 622 623 624 625 626 627 628 629 630 631 632 633 634 635 636 637 638 639 640 641 642 643 644 645 646 647 648 649 650 651 652 653 654 655 656 657 658 659 660 661 662 663 664 665 666 667 668 669 670 671 672 673 674 675 676 677 678 679 680 681 682 683 684 685 686 687 688 689 690 691 692 693 694 695 696 697 698 699 700 701 702 703 704 705 706 707 708 709 710 711 712 713 714 715 716 717 718 719 720 721 722 723 724 725 726 727 728 729 730 731 732 /var/lib/xfstests/tests/generic 2023-11-13T11:31:50.120 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T11:31:50.125 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T11:31:53.187 INFO:teuthology.orchestra.run.smithi102.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/generic 2023-11-13T11:31:53.209 INFO:teuthology.orchestra.run.smithi102.stdout:../../install-sh -o root -g root -m 644 035.out.default 035.out.nfs 050.out.default 050.out.nojournal 050.out.xfsquota 035.cfg 050.cfg 001.out 002.out 003.out 004.out 005.out 006.out 007.out 008.out 009.out 010.out 011.out 012.out 013.out 014.out 015.out 016.out 017.out 018.out 019.out 020.out 021.out 022.out 023.out 024.out 025.out 026.out 027.out 028.out 029.out 030.out 031.out 032.out 033.out 034.out 036.out 037.out 038.out 039.out 040.out 041.out 042.out 043.out 044.out 045.out 046.out 047.out 048.out 049.out 051.out 052.out 053.out 054.out 055.out 056.out 057.out 058.out 059.out 060.out 061.out 062.out 063.out 064.out 065.out 066.out 067.out 068.out 069.out 070.out 071.out 072.out 073.out 074.out 075.out 076.out 077.out 078.out 079.out 080.out 081.out 082.out 083.out 084.out 085.out 086.out 087.out 088.out 089.out 090.out 091.out 092.out 093.out 094.out 095.out 096.out 097.out 098.out 099.out 100.out 101.out 102.out 103.out 104.out 105.out 106.out 107.out 108.out 109.out 110.out 111.out 112.out 113.out 114.out 115.out 116.out 117.out 118.out 119.out 120.out 121.out 122.out 123.out 124.out 125.out 126.out 127.out 128.out 129.out 130.out 131.out 132.out 133.out 134.out 135.out 136.out 137.out 138.out 139.out 140.out 141.out 142.out 143.out 144.out 145.out 146.out 147.out 148.out 149.out 150.out 151.out 152.out 153.out 154.out 155.out 156.out 157.out 158.out 159.out 160.out 161.out 162.out 163.out 164.out 165.out 166.out 167.out 168.out 169.out 170.out 171.out 172.out 173.out 174.out 175.out 176.out 177.out 178.out 179.out 180.out 181.out 182.out 183.out 184.out 185.out 186.out 187.out 188.out 189.out 190.out 191.out 192.out 193.out 194.out 195.out 196.out 197.out 198.out 199.out 200.out 201.out 202.out 203.out 204.out 205.out 206.out 207.out 208.out 209.out 210.out 211.out 212.out 213.out 214.out 215.out 216.out 217.out 218.out 219.out 220.out 221.out 222.out 223.out 224.out 225.out 226.out 227.out 228.out 229.out 230.out 231.out 232.out 233.out 234.out 235.out 236.out 237.out 238.out 239.out 240.out 241.out 242.out 243.out 244.out 245.out 246.out 247.out 248.out 249.out 250.out 251.out 252.out 253.out 254.out 255.out 256.out 257.out 258.out 259.out 260.out 261.out 262.out 263.out 264.out 265.out 266.out 267.out 268.out 269.out 270.out 271.out 272.out 273.out 274.out 275.out 276.out 277.out 278.out 279.out 280.out 281.out 282.out 283.out 284.out 285.out 286.out 287.out 288.out 289.out 290.out 291.out 292.out 293.out 294.out 295.out 296.out 297.out 298.out 299.out 300.out 301.out 302.out 303.out 304.out 305.out 306.out 307.out 308.out 309.out 310.out 311.out 312.out 313.out 314.out 315.out 316.out 317.out 318.out 319.out 320.out 321.out 322.out 323.out 324.out 325.out 326.out 327.out 328.out 329.out 330.out 331.out 332.out 333.out 334.out 335.out 336.out 337.out 338.out 339.out 340.out 341.out 342.out 343.out 344.out 345.out 346.out 347.out 348.out 349.out 350.out 351.out 352.out 353.out 354.out 355.out 356.out 357.out 358.out 359.out 360.out 361.out 362.out 363.out 364.out 365.out 366.out 367.out 368.out 369.out 370.out 371.out 372.out 373.out 374.out 375.out 376.out 377.out 378.out 379.out 380.out 381.out 382.out 383.out 384.out 385.out 386.out 387.out 388.out 389.out 390.out 391.out 392.out 393.out 394.out 395.out 396.out 397.out 398.out 399.out 400.out 401.out 402.out 403.out 404.out 405.out 406.out 407.out 408.out 409.out 410.out 411.out 412.out 413.out 414.out 415.out 416.out 417.out 418.out 419.out 420.out 421.out 422.out 423.out 424.out 425.out 426.out 427.out 428.out 429.out 430.out 431.out 432.out 433.out 434.out 435.out 436.out 437.out 438.out 439.out 440.out 441.out 442.out 443.out 444.out 445.out 446.out 447.out 448.out 449.out 450.out 451.out 452.out 453.out 454.out 455.out 456.out 457.out 458.out 459.out 460.out 461.out 462.out 463.out 464.out 465.out 466.out 467.out 468.out 469.out 470.out 471.out 472.out 473.out 474.out 475.out 476.out 477.out 478.out 479.out 480.out 481.out 482.out 483.out 484.out 485.out 486.out 487.out 488.out 489.out 490.out 491.out 492.out 493.out 494.out 495.out 496.out 497.out 498.out 499.out 500.out 501.out 502.out 503.out 504.out 505.out 506.out 507.out 508.out 509.out 510.out 511.out 512.out 513.out 514.out 515.out 516.out 517.out 518.out 519.out 520.out 521.out 522.out 523.out 524.out 525.out 526.out 527.out 528.out 529.out 530.out 531.out 532.out 533.out 534.out 535.out 536.out 537.out 538.out 539.out 540.out 541.out 542.out 543.out 544.out 545.out 546.out 547.out 548.out 549.out 550.out 551.out 552.out 553.out 554.out 555.out 556.out 557.out 558.out 559.out 560.out 561.out 562.out 563.out 564.out 565.out 566.out 567.out 568.out 569.out 570.out 571.out 572.out 573.out 574.out 575.out 576.out 577.out 578.out 579.out 580.out 581.out 582.out 583.out 584.out 585.out 586.out 587.out 588.out 589.out 590.out 591.out 592.out 593.out 594.out 595.out 596.out 597.out 598.out 599.out 600.out 601.out 602.out 603.out 604.out 605.out 606.out 607.out 608.out 609.out 610.out 611.out 612.out 613.out 614.out 615.out 616.out 617.out 618.out 619.out 620.out 621.out 622.out 623.out 624.out 625.out 626.out 627.out 628.out 629.out 630.out 631.out 632.out 633.out 634.out 635.out 636.out 637.out 638.out 639.out 640.out 641.out 642.out 643.out 644.out 645.out 646.out 647.out 648.out 649.out 650.out 651.out 652.out 653.out 654.out 655.out 656.out 657.out 658.out 659.out 660.out 661.out 662.out 663.out 664.out 665.out 666.out 667.out 668.out 669.out 670.out 671.out 672.out 673.out 674.out 675.out 676.out 677.out 678.out 679.out 680.out 681.out 682.out 683.out 684.out 685.out 686.out 687.out 688.out 689.out 690.out 691.out 692.out 693.out 694.out 695.out 696.out 697.out 698.out 699.out 700.out 701.out 702.out 703.out 704.out 705.out 706.out 707.out 708.out 709.out 710.out 711.out 712.out 713.out 714.out 715.out 716.out 717.out 718.out 719.out 720.out 721.out 722.out 723.out 724.out 725.out 726.out 727.out 728.out 729.out 730.out 731.out 732.out /var/lib/xfstests/tests/generic 2023-11-13T11:31:57.486 INFO:teuthology.orchestra.run.smithi102.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.EnLPmcWJbzxfstests-dev/tests/nfs/ install 2023-11-13T11:31:57.490 INFO:teuthology.orchestra.run.smithi102.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/nfs 2023-11-13T11:31:57.510 INFO:teuthology.orchestra.run.smithi102.stdout:../../install-sh -o root -g root -m 755 001 /var/lib/xfstests/tests/nfs 2023-11-13T11:31:57.530 INFO:teuthology.orchestra.run.smithi102.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/nfs 2023-11-13T11:31:57.550 INFO:teuthology.orchestra.run.smithi102.stdout:../../install-sh -o root -g root -m 644 001.out /var/lib/xfstests/tests/nfs 2023-11-13T11:31:57.571 INFO:teuthology.orchestra.run.smithi102.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.EnLPmcWJbzxfstests-dev/tests/ocfs2/ install 2023-11-13T11:31:57.575 INFO:teuthology.orchestra.run.smithi102.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/ocfs2 2023-11-13T11:31:57.595 INFO:teuthology.orchestra.run.smithi102.stdout:../../install-sh -o root -g root -m 755 001 /var/lib/xfstests/tests/ocfs2 2023-11-13T11:31:57.615 INFO:teuthology.orchestra.run.smithi102.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/ocfs2 2023-11-13T11:31:57.636 INFO:teuthology.orchestra.run.smithi102.stdout:../../install-sh -o root -g root -m 644 001.out /var/lib/xfstests/tests/ocfs2 2023-11-13T11:31:57.656 INFO:teuthology.orchestra.run.smithi102.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.EnLPmcWJbzxfstests-dev/tests/overlay/ install 2023-11-13T11:31:57.660 INFO:teuthology.orchestra.run.smithi102.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/overlay 2023-11-13T11:31:57.680 INFO:teuthology.orchestra.run.smithi102.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 006 007 008 009 010 011 012 013 014 015 016 017 018 019 020 021 022 023 024 025 026 027 028 029 030 031 032 033 034 035 036 037 038 039 040 041 042 043 044 045 046 047 048 049 050 051 052 053 054 055 056 057 058 059 060 061 062 063 064 065 066 067 068 069 070 071 072 073 074 075 076 077 078 079 080 081 082 100 101 102 103 104 105 106 107 108 109 110 111 112 113 114 115 116 117 /var/lib/xfstests/tests/overlay 2023-11-13T11:31:58.272 INFO:teuthology.orchestra.run.smithi102.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/overlay 2023-11-13T11:31:58.292 INFO:teuthology.orchestra.run.smithi102.stdout:../../install-sh -o root -g root -m 644 001.out 002.out 003.out 004.out 005.out 006.out 007.out 008.out 009.out 010.out 011.out 012.out 013.out 014.out 015.out 016.out 017.out 018.out 019.out 020.out 021.out 022.out 023.out 024.out 025.out 026.out 027.out 028.out 029.out 030.out 031.out 032.out 033.out 034.out 035.out 036.out 037.out 038.out 039.out 040.out 041.out 042.out 043.out 044.out 045.out 046.out 047.out 048.out 049.out 050.out 051.out 052.out 053.out 054.out 055.out 056.out 057.out 058.out 059.out 060.out 061.out 062.out 063.out 064.out 065.out 066.out 067.out 068.out 069.out 070.out 071.out 072.out 073.out 074.out 075.out 076.out 077.out 078.out 079.out 080.out 081.out 082.out 100.out 101.out 102.out 103.out 104.out 105.out 106.out 107.out 108.out 109.out 110.out 111.out 112.out 113.out 114.out 115.out 116.out 117.out /var/lib/xfstests/tests/overlay 2023-11-13T11:31:58.882 INFO:teuthology.orchestra.run.smithi102.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.EnLPmcWJbzxfstests-dev/tests/perf/ install 2023-11-13T11:31:58.886 INFO:teuthology.orchestra.run.smithi102.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/perf 2023-11-13T11:31:58.906 INFO:teuthology.orchestra.run.smithi102.stdout:../../install-sh -o root -g root -m 755 001 /var/lib/xfstests/tests/perf 2023-11-13T11:31:58.926 INFO:teuthology.orchestra.run.smithi102.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/perf 2023-11-13T11:31:58.947 INFO:teuthology.orchestra.run.smithi102.stdout:../../install-sh -o root -g root -m 644 001.out /var/lib/xfstests/tests/perf 2023-11-13T11:31:58.968 INFO:teuthology.orchestra.run.smithi102.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.EnLPmcWJbzxfstests-dev/tests/selftest/ install 2023-11-13T11:31:58.972 INFO:teuthology.orchestra.run.smithi102.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/selftest 2023-11-13T11:31:58.992 INFO:teuthology.orchestra.run.smithi102.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 006 /var/lib/xfstests/tests/selftest 2023-11-13T11:31:59.041 INFO:teuthology.orchestra.run.smithi102.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/selftest 2023-11-13T11:31:59.061 INFO:teuthology.orchestra.run.smithi102.stdout:../../install-sh -o root -g root -m 644 001.out 002.out 003.out 004.out 005.out 006.out /var/lib/xfstests/tests/selftest 2023-11-13T11:31:59.111 INFO:teuthology.orchestra.run.smithi102.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.EnLPmcWJbzxfstests-dev/tests/shared/ install 2023-11-13T11:31:59.114 INFO:teuthology.orchestra.run.smithi102.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/shared 2023-11-13T11:31:59.135 INFO:teuthology.orchestra.run.smithi102.stdout:../../install-sh -o root -g root -m 755 002 032 298 /var/lib/xfstests/tests/shared 2023-11-13T11:31:59.166 INFO:teuthology.orchestra.run.smithi102.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/shared 2023-11-13T11:31:59.187 INFO:teuthology.orchestra.run.smithi102.stdout:../../install-sh -o root -g root -m 644 002.out 032.out 298.out /var/lib/xfstests/tests/shared 2023-11-13T11:31:59.219 INFO:teuthology.orchestra.run.smithi102.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.EnLPmcWJbzxfstests-dev/tests/tmpfs/ install 2023-11-13T11:31:59.222 INFO:teuthology.orchestra.run.smithi102.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/tmpfs 2023-11-13T11:31:59.242 INFO:teuthology.orchestra.run.smithi102.stdout:../../install-sh -o root -g root -m 755 001 /var/lib/xfstests/tests/tmpfs 2023-11-13T11:31:59.263 INFO:teuthology.orchestra.run.smithi102.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/tmpfs 2023-11-13T11:31:59.283 INFO:teuthology.orchestra.run.smithi102.stdout:../../install-sh -o root -g root -m 644 001.out /var/lib/xfstests/tests/tmpfs 2023-11-13T11:31:59.304 INFO:teuthology.orchestra.run.smithi102.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.EnLPmcWJbzxfstests-dev/tests/udf/ install 2023-11-13T11:31:59.308 INFO:teuthology.orchestra.run.smithi102.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/udf 2023-11-13T11:31:59.328 INFO:teuthology.orchestra.run.smithi102.stdout:../../install-sh -o root -g root -m 755 102 /var/lib/xfstests/tests/udf 2023-11-13T11:31:59.348 INFO:teuthology.orchestra.run.smithi102.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/udf 2023-11-13T11:31:59.369 INFO:teuthology.orchestra.run.smithi102.stdout:../../install-sh -o root -g root -m 644 102.out /var/lib/xfstests/tests/udf 2023-11-13T11:31:59.389 INFO:teuthology.orchestra.run.smithi102.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.EnLPmcWJbzxfstests-dev/tests/xfs/ install 2023-11-13T11:31:59.398 INFO:teuthology.orchestra.run.smithi102.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/xfs 2023-11-13T11:31:59.417 INFO:teuthology.orchestra.run.smithi102.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 006 007 008 009 010 011 012 013 014 015 016 017 018 019 020 021 022 023 024 025 026 027 028 029 030 031 032 033 034 035 036 037 038 039 040 041 042 043 044 045 046 047 048 049 050 051 052 053 054 055 056 057 058 059 060 061 062 063 064 065 066 067 068 069 070 071 072 073 074 075 076 077 078 079 080 081 082 083 084 085 086 087 088 089 090 091 092 093 094 095 096 097 098 099 100 101 102 103 104 105 106 107 108 109 110 111 112 113 114 115 116 117 118 119 120 121 122 123 124 125 126 127 128 129 130 131 132 133 134 135 136 137 138 139 140 141 142 143 144 145 146 147 148 149 150 151 152 153 154 155 156 157 158 159 160 161 162 163 164 165 166 167 168 169 170 171 172 173 174 175 176 177 178 179 180 181 182 183 184 185 186 187 188 189 190 191 192 193 194 195 196 197 198 199 200 201 202 203 204 205 206 207 208 209 210 211 212 213 214 215 216 217 218 219 220 221 222 223 224 225 226 227 228 229 230 231 232 233 234 235 236 237 238 239 240 241 242 243 244 245 246 247 248 249 250 251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300 301 302 303 304 305 306 307 308 309 310 311 312 313 314 315 316 317 318 319 320 321 322 323 324 325 326 327 328 329 330 331 332 333 334 335 336 337 338 339 340 341 342 343 344 345 346 347 348 349 350 351 352 353 354 355 356 357 358 359 360 361 362 363 364 365 366 367 368 369 370 371 372 373 374 375 376 377 378 379 380 381 382 383 384 385 386 387 388 389 390 391 392 393 394 395 396 397 398 399 400 401 402 403 404 405 406 407 408 409 410 411 412 413 414 415 416 417 418 419 420 421 422 423 424 425 426 427 428 429 430 431 432 433 434 435 436 437 438 439 440 441 442 443 444 445 446 447 448 449 450 451 452 453 454 455 456 457 458 459 460 461 462 463 464 465 466 467 468 469 470 471 472 473 474 475 476 477 478 479 480 481 482 483 484 485 486 487 488 489 490 491 492 493 494 495 496 497 498 499 500 501 502 503 504 505 506 507 508 509 510 511 512 513 514 515 516 517 518 519 520 521 522 523 524 525 526 527 528 529 530 531 532 533 534 535 536 537 538 539 540 541 542 543 544 545 546 547 548 549 550 551 552 553 554 555 556 557 558 559 560 561 562 563 564 565 566 567 568 569 570 571 572 573 574 575 576 577 578 579 580 581 582 583 584 585 586 587 588 589 590 591 592 593 594 595 596 597 598 599 600 708 709 710 711 712 713 714 715 716 717 718 719 720 721 722 723 724 725 726 727 728 729 730 731 732 733 734 735 736 737 738 739 740 741 742 743 744 745 746 747 748 749 750 751 752 753 754 755 756 757 758 759 760 761 762 763 764 765 766 767 768 769 770 771 772 773 774 775 776 777 778 779 780 781 782 783 784 785 786 787 788 789 790 791 792 793 794 795 796 797 798 799 800 /var/lib/xfstests/tests/xfs 2023-11-13T11:32:03.416 INFO:teuthology.orchestra.run.smithi102.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/xfs 2023-11-13T11:32:03.437 INFO:teuthology.orchestra.run.smithi102.stdout:../../install-sh -o root -g root -m 644 033.out.crc 033.out.default 071.out.32 071.out.64 096.out.external 096.out.internal 216.out.64mblog 216.out.classic 033.cfg 216.cfg 001.out 002.out 003.out 004.out 005.out 006.out 007.out 008.out 009.out 010.out 011.out 012.out 013.out 014.out 015.out 016.out 017.out 018.out 019.out 020.out 021.out 022.out 023.out 024.out 025.out 026.out 027.out 028.out 029.out 030.out 031.out 032.out 034.out 035.out 036.out 037.out 038.out 039.out 040.out 041.out 042.out 043.out 044.out 045.out 046.out 047.out 048.out 049.out 050.out 051.out 052.out 053.out 054.out 055.out 056.out 057.out 058.out 059.out 060.out 061.out 062.out 063.out 064.out 065.out 066.out 067.out 068.out 069.out 070.out 072.out 073.out 074.out 075.out 076.out 077.out 078.out 079.out 080.out 081.out 082.out 083.out 084.out 085.out 086.out 087.out 088.out 089.out 090.out 091.out 092.out 093.out 094.out 095.out 097.out 098.out 099.out 100.out 101.out 102.out 103.out 104.out 105.out 106.out 107.out 108.out 109.out 110.out 111.out 112.out 113.out 114.out 115.out 116.out 117.out 118.out 119.out 120.out 121.out 122.out 123.out 124.out 125.out 126.out 127.out 128.out 129.out 130.out 131.out 132.out 133.out 134.out 135.out 136.out 137.out 138.out 139.out 140.out 141.out 142.out 143.out 144.out 145.out 146.out 147.out 148.out 149.out 150.out 151.out 152.out 153.out 154.out 155.out 156.out 157.out 158.out 159.out 160.out 161.out 162.out 163.out 164.out 165.out 166.out 167.out 168.out 169.out 170.out 171.out 172.out 173.out 174.out 175.out 176.out 177.out 178.out 179.out 180.out 181.out 182.out 183.out 184.out 185.out 186.out 187.out 188.out 189.out 190.out 191.out 192.out 193.out 194.out 195.out 196.out 197.out 198.out 199.out 200.out 201.out 202.out 203.out 204.out 205.out 206.out 207.out 208.out 209.out 210.out 211.out 212.out 213.out 214.out 215.out 217.out 218.out 219.out 220.out 221.out 222.out 223.out 224.out 225.out 226.out 227.out 228.out 229.out 230.out 231.out 232.out 233.out 234.out 235.out 236.out 237.out 238.out 239.out 240.out 241.out 242.out 243.out 244.out 245.out 246.out 247.out 248.out 249.out 250.out 251.out 252.out 253.out 254.out 255.out 256.out 257.out 258.out 259.out 260.out 261.out 262.out 263.out 264.out 265.out 266.out 267.out 268.out 269.out 270.out 271.out 272.out 273.out 274.out 275.out 276.out 277.out 278.out 279.out 280.out 281.out 282.out 283.out 284.out 285.out 286.out 287.out 288.out 289.out 290.out 291.out 292.out 293.out 294.out 295.out 296.out 297.out 298.out 299.out 300.out 301.out 302.out 303.out 304.out 305.out 306.out 307.out 308.out 309.out 310.out 311.out 312.out 313.out 314.out 315.out 316.out 317.out 318.out 319.out 320.out 321.out 322.out 323.out 324.out 325.out 326.out 327.out 328.out 329.out 330.out 331.out 332.out 333.out 334.out 335.out 336.out 337.out 338.out 339.out 340.out 341.out 342.out 343.out 344.out 345.out 346.out 347.out 348.out 349.out 350.out 351.out 352.out 353.out 354.out 355.out 356.out 357.out 358.out 359.out 360.out 361.out 362.out 363.out 364.out 365.out 366.out 367.out 368.out 369.out 370.out 371.out 372.out 373.out 374.out 375.out 376.out 377.out 378.out 379.out 380.out 381.out 382.out 383.out 384.out 385.out 386.out 387.out 388.out 389.out 390.out 391.out 392.out 393.out 394.out 395.out 396.out 397.out 398.out 399.out 400.out 401.out 402.out 403.out 404.out 405.out 406.out 407.out 408.out 409.out 410.out 411.out 412.out 413.out 414.out 415.out 416.out 417.out 418.out 419.out 420.out 421.out 422.out 423.out 424.out 425.out 426.out 427.out 428.out 429.out 430.out 431.out 432.out 433.out 434.out 435.out 436.out 437.out 438.out 439.out 440.out 441.out 442.out 443.out 444.out 445.out 446.out 447.out 448.out 449.out 450.out 451.out 452.out 453.out 454.out 455.out 456.out 457.out 458.out 459.out 460.out 461.out 462.out 463.out 464.out 465.out 466.out 467.out 468.out 469.out 470.out 471.out 472.out 473.out 474.out 475.out 476.out 477.out 478.out 479.out 480.out 481.out 482.out 483.out 484.out 485.out 486.out 487.out 488.out 489.out 490.out 491.out 492.out 493.out 494.out 495.out 496.out 497.out 498.out 499.out 500.out 501.out 502.out 503.out 504.out 505.out 506.out 507.out 508.out 509.out 510.out 511.out 512.out 513.out 514.out 515.out 516.out 517.out 518.out 519.out 520.out 521.out 522.out 523.out 524.out 525.out 526.out 527.out 528.out 529.out 530.out 531.out 532.out 533.out 534.out 535.out 536.out 537.out 538.out 539.out 540.out 541.out 542.out 543.out 544.out 545.out 546.out 547.out 548.out 549.out 550.out 551.out 552.out 553.out 554.out 555.out 556.out 557.out 558.out 559.out 560.out 561.out 562.out 563.out 564.out 565.out 566.out 567.out 568.out 569.out 570.out 571.out 572.out 573.out 574.out 575.out 576.out 577.out 578.out 579.out 580.out 581.out 582.out 583.out 584.out 585.out 586.out 587.out 588.out 589.out 590.out 591.out 592.out 593.out 594.out 595.out 596.out 597.out 598.out 599.out 600.out 708.out 709.out 710.out 711.out 712.out 713.out 714.out 715.out 716.out 717.out 718.out 719.out 720.out 721.out 722.out 723.out 724.out 725.out 726.out 727.out 728.out 729.out 730.out 731.out 732.out 733.out 734.out 735.out 736.out 737.out 738.out 739.out 740.out 741.out 742.out 743.out 744.out 745.out 746.out 747.out 748.out 749.out 750.out 751.out 752.out 753.out 754.out 755.out 756.out 757.out 758.out 759.out 760.out 761.out 762.out 763.out 764.out 765.out 766.out 767.out 768.out 769.out 770.out 771.out 772.out 773.out 774.out 775.out 776.out 777.out 778.out 779.out 780.out 781.out 782.out 783.out 784.out 785.out 786.out 787.out 788.out 789.out 790.out 791.out 792.out 793.out 794.out 795.out 796.out 797.out 798.out 799.out 800.out /var/lib/xfstests/tests/xfs 2023-11-13T11:32:07.464 INFO:teuthology.orchestra.run.smithi102.stdout:../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests 2023-11-13T11:32:07.485 INFO:teuthology.orchestra.run.smithi102.stdout:./install-sh -o root -g root -m 755 -d /var/lib/xfstests 2023-11-13T11:32:07.504 INFO:teuthology.orchestra.run.smithi102.stdout:./install-sh -o root -g root -m 755 check /var/lib/xfstests 2023-11-13T11:32:07.524 INFO:teuthology.orchestra.run.smithi102.stdout:./install-sh -o root -g root -m 644 randomize.awk /var/lib/xfstests 2023-11-13T11:32:07.548 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-13T11:32:07.549 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec ls tests/generic) 2023-11-13T11:32:07.560 INFO:teuthology.orchestra.run.smithi102.stdout:001 2023-11-13T11:32:07.561 INFO:teuthology.orchestra.run.smithi102.stdout:001.out 2023-11-13T11:32:07.561 INFO:teuthology.orchestra.run.smithi102.stdout:002 2023-11-13T11:32:07.561 INFO:teuthology.orchestra.run.smithi102.stdout:002.out 2023-11-13T11:32:07.561 INFO:teuthology.orchestra.run.smithi102.stdout:003 2023-11-13T11:32:07.562 INFO:teuthology.orchestra.run.smithi102.stdout:003.out 2023-11-13T11:32:07.562 INFO:teuthology.orchestra.run.smithi102.stdout:004 2023-11-13T11:32:07.562 INFO:teuthology.orchestra.run.smithi102.stdout:004.out 2023-11-13T11:32:07.562 INFO:teuthology.orchestra.run.smithi102.stdout:005 2023-11-13T11:32:07.563 INFO:teuthology.orchestra.run.smithi102.stdout:005.out 2023-11-13T11:32:07.563 INFO:teuthology.orchestra.run.smithi102.stdout:006 2023-11-13T11:32:07.563 INFO:teuthology.orchestra.run.smithi102.stdout:006.out 2023-11-13T11:32:07.564 INFO:teuthology.orchestra.run.smithi102.stdout:007 2023-11-13T11:32:07.564 INFO:teuthology.orchestra.run.smithi102.stdout:007.out 2023-11-13T11:32:07.565 INFO:teuthology.orchestra.run.smithi102.stdout:008 2023-11-13T11:32:07.565 INFO:teuthology.orchestra.run.smithi102.stdout:008.out 2023-11-13T11:32:07.565 INFO:teuthology.orchestra.run.smithi102.stdout:009 2023-11-13T11:32:07.565 INFO:teuthology.orchestra.run.smithi102.stdout:009.out 2023-11-13T11:32:07.566 INFO:teuthology.orchestra.run.smithi102.stdout:010 2023-11-13T11:32:07.566 INFO:teuthology.orchestra.run.smithi102.stdout:010.out 2023-11-13T11:32:07.566 INFO:teuthology.orchestra.run.smithi102.stdout:011 2023-11-13T11:32:07.566 INFO:teuthology.orchestra.run.smithi102.stdout:011.out 2023-11-13T11:32:07.566 INFO:teuthology.orchestra.run.smithi102.stdout:012 2023-11-13T11:32:07.567 INFO:teuthology.orchestra.run.smithi102.stdout:012.out 2023-11-13T11:32:07.567 INFO:teuthology.orchestra.run.smithi102.stdout:013 2023-11-13T11:32:07.567 INFO:teuthology.orchestra.run.smithi102.stdout:013.out 2023-11-13T11:32:07.568 INFO:teuthology.orchestra.run.smithi102.stdout:014 2023-11-13T11:32:07.568 INFO:teuthology.orchestra.run.smithi102.stdout:014.out 2023-11-13T11:32:07.568 INFO:teuthology.orchestra.run.smithi102.stdout:015 2023-11-13T11:32:07.569 INFO:teuthology.orchestra.run.smithi102.stdout:015.out 2023-11-13T11:32:07.569 INFO:teuthology.orchestra.run.smithi102.stdout:016 2023-11-13T11:32:07.569 INFO:teuthology.orchestra.run.smithi102.stdout:016.out 2023-11-13T11:32:07.569 INFO:teuthology.orchestra.run.smithi102.stdout:017 2023-11-13T11:32:07.570 INFO:teuthology.orchestra.run.smithi102.stdout:017.out 2023-11-13T11:32:07.570 INFO:teuthology.orchestra.run.smithi102.stdout:018 2023-11-13T11:32:07.570 INFO:teuthology.orchestra.run.smithi102.stdout:018.out 2023-11-13T11:32:07.570 INFO:teuthology.orchestra.run.smithi102.stdout:019 2023-11-13T11:32:07.570 INFO:teuthology.orchestra.run.smithi102.stdout:019.out 2023-11-13T11:32:07.571 INFO:teuthology.orchestra.run.smithi102.stdout:020 2023-11-13T11:32:07.571 INFO:teuthology.orchestra.run.smithi102.stdout:020.out 2023-11-13T11:32:07.571 INFO:teuthology.orchestra.run.smithi102.stdout:021 2023-11-13T11:32:07.571 INFO:teuthology.orchestra.run.smithi102.stdout:021.out 2023-11-13T11:32:07.572 INFO:teuthology.orchestra.run.smithi102.stdout:022 2023-11-13T11:32:07.572 INFO:teuthology.orchestra.run.smithi102.stdout:022.out 2023-11-13T11:32:07.572 INFO:teuthology.orchestra.run.smithi102.stdout:023 2023-11-13T11:32:07.572 INFO:teuthology.orchestra.run.smithi102.stdout:023.out 2023-11-13T11:32:07.573 INFO:teuthology.orchestra.run.smithi102.stdout:024 2023-11-13T11:32:07.573 INFO:teuthology.orchestra.run.smithi102.stdout:024.out 2023-11-13T11:32:07.573 INFO:teuthology.orchestra.run.smithi102.stdout:025 2023-11-13T11:32:07.573 INFO:teuthology.orchestra.run.smithi102.stdout:025.out 2023-11-13T11:32:07.574 INFO:teuthology.orchestra.run.smithi102.stdout:026 2023-11-13T11:32:07.574 INFO:teuthology.orchestra.run.smithi102.stdout:026.out 2023-11-13T11:32:07.574 INFO:teuthology.orchestra.run.smithi102.stdout:027 2023-11-13T11:32:07.574 INFO:teuthology.orchestra.run.smithi102.stdout:027.out 2023-11-13T11:32:07.575 INFO:teuthology.orchestra.run.smithi102.stdout:028 2023-11-13T11:32:07.575 INFO:teuthology.orchestra.run.smithi102.stdout:028.out 2023-11-13T11:32:07.575 INFO:teuthology.orchestra.run.smithi102.stdout:029 2023-11-13T11:32:07.575 INFO:teuthology.orchestra.run.smithi102.stdout:029.out 2023-11-13T11:32:07.576 INFO:teuthology.orchestra.run.smithi102.stdout:030 2023-11-13T11:32:07.576 INFO:teuthology.orchestra.run.smithi102.stdout:030.out 2023-11-13T11:32:07.577 INFO:teuthology.orchestra.run.smithi102.stdout:031 2023-11-13T11:32:07.577 INFO:teuthology.orchestra.run.smithi102.stdout:031.out 2023-11-13T11:32:07.577 INFO:teuthology.orchestra.run.smithi102.stdout:032 2023-11-13T11:32:07.577 INFO:teuthology.orchestra.run.smithi102.stdout:032.out 2023-11-13T11:32:07.577 INFO:teuthology.orchestra.run.smithi102.stdout:033 2023-11-13T11:32:07.578 INFO:teuthology.orchestra.run.smithi102.stdout:033.out 2023-11-13T11:32:07.579 INFO:teuthology.orchestra.run.smithi102.stdout:034 2023-11-13T11:32:07.579 INFO:teuthology.orchestra.run.smithi102.stdout:034.out 2023-11-13T11:32:07.579 INFO:teuthology.orchestra.run.smithi102.stdout:035 2023-11-13T11:32:07.580 INFO:teuthology.orchestra.run.smithi102.stdout:035.cfg 2023-11-13T11:32:07.580 INFO:teuthology.orchestra.run.smithi102.stdout:035.out.default 2023-11-13T11:32:07.580 INFO:teuthology.orchestra.run.smithi102.stdout:035.out.nfs 2023-11-13T11:32:07.581 INFO:teuthology.orchestra.run.smithi102.stdout:036 2023-11-13T11:32:07.581 INFO:teuthology.orchestra.run.smithi102.stdout:036.out 2023-11-13T11:32:07.581 INFO:teuthology.orchestra.run.smithi102.stdout:037 2023-11-13T11:32:07.581 INFO:teuthology.orchestra.run.smithi102.stdout:037.out 2023-11-13T11:32:07.581 INFO:teuthology.orchestra.run.smithi102.stdout:038 2023-11-13T11:32:07.582 INFO:teuthology.orchestra.run.smithi102.stdout:038.out 2023-11-13T11:32:07.582 INFO:teuthology.orchestra.run.smithi102.stdout:039 2023-11-13T11:32:07.582 INFO:teuthology.orchestra.run.smithi102.stdout:039.out 2023-11-13T11:32:07.582 INFO:teuthology.orchestra.run.smithi102.stdout:040 2023-11-13T11:32:07.583 INFO:teuthology.orchestra.run.smithi102.stdout:040.out 2023-11-13T11:32:07.583 INFO:teuthology.orchestra.run.smithi102.stdout:041 2023-11-13T11:32:07.583 INFO:teuthology.orchestra.run.smithi102.stdout:041.out 2023-11-13T11:32:07.583 INFO:teuthology.orchestra.run.smithi102.stdout:042 2023-11-13T11:32:07.584 INFO:teuthology.orchestra.run.smithi102.stdout:042.out 2023-11-13T11:32:07.584 INFO:teuthology.orchestra.run.smithi102.stdout:043 2023-11-13T11:32:07.584 INFO:teuthology.orchestra.run.smithi102.stdout:043.out 2023-11-13T11:32:07.584 INFO:teuthology.orchestra.run.smithi102.stdout:044 2023-11-13T11:32:07.585 INFO:teuthology.orchestra.run.smithi102.stdout:044.out 2023-11-13T11:32:07.585 INFO:teuthology.orchestra.run.smithi102.stdout:045 2023-11-13T11:32:07.585 INFO:teuthology.orchestra.run.smithi102.stdout:045.out 2023-11-13T11:32:07.585 INFO:teuthology.orchestra.run.smithi102.stdout:046 2023-11-13T11:32:07.586 INFO:teuthology.orchestra.run.smithi102.stdout:046.out 2023-11-13T11:32:07.586 INFO:teuthology.orchestra.run.smithi102.stdout:047 2023-11-13T11:32:07.586 INFO:teuthology.orchestra.run.smithi102.stdout:047.out 2023-11-13T11:32:07.586 INFO:teuthology.orchestra.run.smithi102.stdout:048 2023-11-13T11:32:07.586 INFO:teuthology.orchestra.run.smithi102.stdout:048.out 2023-11-13T11:32:07.587 INFO:teuthology.orchestra.run.smithi102.stdout:049 2023-11-13T11:32:07.587 INFO:teuthology.orchestra.run.smithi102.stdout:049.out 2023-11-13T11:32:07.587 INFO:teuthology.orchestra.run.smithi102.stdout:050 2023-11-13T11:32:07.587 INFO:teuthology.orchestra.run.smithi102.stdout:050.cfg 2023-11-13T11:32:07.588 INFO:teuthology.orchestra.run.smithi102.stdout:050.out.default 2023-11-13T11:32:07.588 INFO:teuthology.orchestra.run.smithi102.stdout:050.out.nojournal 2023-11-13T11:32:07.588 INFO:teuthology.orchestra.run.smithi102.stdout:050.out.xfsquota 2023-11-13T11:32:07.588 INFO:teuthology.orchestra.run.smithi102.stdout:051 2023-11-13T11:32:07.588 INFO:teuthology.orchestra.run.smithi102.stdout:051.out 2023-11-13T11:32:07.589 INFO:teuthology.orchestra.run.smithi102.stdout:052 2023-11-13T11:32:07.589 INFO:teuthology.orchestra.run.smithi102.stdout:052.out 2023-11-13T11:32:07.590 INFO:teuthology.orchestra.run.smithi102.stdout:053 2023-11-13T11:32:07.590 INFO:teuthology.orchestra.run.smithi102.stdout:053.out 2023-11-13T11:32:07.590 INFO:teuthology.orchestra.run.smithi102.stdout:054 2023-11-13T11:32:07.591 INFO:teuthology.orchestra.run.smithi102.stdout:054.out 2023-11-13T11:32:07.591 INFO:teuthology.orchestra.run.smithi102.stdout:055 2023-11-13T11:32:07.591 INFO:teuthology.orchestra.run.smithi102.stdout:055.out 2023-11-13T11:32:07.591 INFO:teuthology.orchestra.run.smithi102.stdout:056 2023-11-13T11:32:07.592 INFO:teuthology.orchestra.run.smithi102.stdout:056.out 2023-11-13T11:32:07.592 INFO:teuthology.orchestra.run.smithi102.stdout:057 2023-11-13T11:32:07.592 INFO:teuthology.orchestra.run.smithi102.stdout:057.out 2023-11-13T11:32:07.592 INFO:teuthology.orchestra.run.smithi102.stdout:058 2023-11-13T11:32:07.592 INFO:teuthology.orchestra.run.smithi102.stdout:058.out 2023-11-13T11:32:07.593 INFO:teuthology.orchestra.run.smithi102.stdout:059 2023-11-13T11:32:07.593 INFO:teuthology.orchestra.run.smithi102.stdout:059.out 2023-11-13T11:32:07.593 INFO:teuthology.orchestra.run.smithi102.stdout:060 2023-11-13T11:32:07.593 INFO:teuthology.orchestra.run.smithi102.stdout:060.out 2023-11-13T11:32:07.594 INFO:teuthology.orchestra.run.smithi102.stdout:061 2023-11-13T11:32:07.594 INFO:teuthology.orchestra.run.smithi102.stdout:061.out 2023-11-13T11:32:07.594 INFO:teuthology.orchestra.run.smithi102.stdout:062 2023-11-13T11:32:07.594 INFO:teuthology.orchestra.run.smithi102.stdout:062.out 2023-11-13T11:32:07.594 INFO:teuthology.orchestra.run.smithi102.stdout:063 2023-11-13T11:32:07.595 INFO:teuthology.orchestra.run.smithi102.stdout:063.out 2023-11-13T11:32:07.595 INFO:teuthology.orchestra.run.smithi102.stdout:064 2023-11-13T11:32:07.595 INFO:teuthology.orchestra.run.smithi102.stdout:064.out 2023-11-13T11:32:07.595 INFO:teuthology.orchestra.run.smithi102.stdout:065 2023-11-13T11:32:07.595 INFO:teuthology.orchestra.run.smithi102.stdout:065.out 2023-11-13T11:32:07.596 INFO:teuthology.orchestra.run.smithi102.stdout:066 2023-11-13T11:32:07.596 INFO:teuthology.orchestra.run.smithi102.stdout:066.out 2023-11-13T11:32:07.596 INFO:teuthology.orchestra.run.smithi102.stdout:067 2023-11-13T11:32:07.596 INFO:teuthology.orchestra.run.smithi102.stdout:067.out 2023-11-13T11:32:07.596 INFO:teuthology.orchestra.run.smithi102.stdout:068 2023-11-13T11:32:07.597 INFO:teuthology.orchestra.run.smithi102.stdout:068.out 2023-11-13T11:32:07.597 INFO:teuthology.orchestra.run.smithi102.stdout:069 2023-11-13T11:32:07.597 INFO:teuthology.orchestra.run.smithi102.stdout:069.out 2023-11-13T11:32:07.597 INFO:teuthology.orchestra.run.smithi102.stdout:070 2023-11-13T11:32:07.598 INFO:teuthology.orchestra.run.smithi102.stdout:070.out 2023-11-13T11:32:07.598 INFO:teuthology.orchestra.run.smithi102.stdout:071 2023-11-13T11:32:07.598 INFO:teuthology.orchestra.run.smithi102.stdout:071.out 2023-11-13T11:32:07.598 INFO:teuthology.orchestra.run.smithi102.stdout:072 2023-11-13T11:32:07.598 INFO:teuthology.orchestra.run.smithi102.stdout:072.out 2023-11-13T11:32:07.599 INFO:teuthology.orchestra.run.smithi102.stdout:073 2023-11-13T11:32:07.599 INFO:teuthology.orchestra.run.smithi102.stdout:073.out 2023-11-13T11:32:07.599 INFO:teuthology.orchestra.run.smithi102.stdout:074 2023-11-13T11:32:07.600 INFO:teuthology.orchestra.run.smithi102.stdout:074.out 2023-11-13T11:32:07.600 INFO:teuthology.orchestra.run.smithi102.stdout:075 2023-11-13T11:32:07.600 INFO:teuthology.orchestra.run.smithi102.stdout:075.out 2023-11-13T11:32:07.601 INFO:teuthology.orchestra.run.smithi102.stdout:076 2023-11-13T11:32:07.601 INFO:teuthology.orchestra.run.smithi102.stdout:076.out 2023-11-13T11:32:07.601 INFO:teuthology.orchestra.run.smithi102.stdout:077 2023-11-13T11:32:07.601 INFO:teuthology.orchestra.run.smithi102.stdout:077.out 2023-11-13T11:32:07.601 INFO:teuthology.orchestra.run.smithi102.stdout:078 2023-11-13T11:32:07.602 INFO:teuthology.orchestra.run.smithi102.stdout:078.out 2023-11-13T11:32:07.602 INFO:teuthology.orchestra.run.smithi102.stdout:079 2023-11-13T11:32:07.602 INFO:teuthology.orchestra.run.smithi102.stdout:079.out 2023-11-13T11:32:07.602 INFO:teuthology.orchestra.run.smithi102.stdout:080 2023-11-13T11:32:07.603 INFO:teuthology.orchestra.run.smithi102.stdout:080.out 2023-11-13T11:32:07.603 INFO:teuthology.orchestra.run.smithi102.stdout:081 2023-11-13T11:32:07.603 INFO:teuthology.orchestra.run.smithi102.stdout:081.out 2023-11-13T11:32:07.603 INFO:teuthology.orchestra.run.smithi102.stdout:082 2023-11-13T11:32:07.603 INFO:teuthology.orchestra.run.smithi102.stdout:082.out 2023-11-13T11:32:07.604 INFO:teuthology.orchestra.run.smithi102.stdout:083 2023-11-13T11:32:07.604 INFO:teuthology.orchestra.run.smithi102.stdout:083.out 2023-11-13T11:32:07.604 INFO:teuthology.orchestra.run.smithi102.stdout:084 2023-11-13T11:32:07.604 INFO:teuthology.orchestra.run.smithi102.stdout:084.out 2023-11-13T11:32:07.605 INFO:teuthology.orchestra.run.smithi102.stdout:085 2023-11-13T11:32:07.605 INFO:teuthology.orchestra.run.smithi102.stdout:085.out 2023-11-13T11:32:07.605 INFO:teuthology.orchestra.run.smithi102.stdout:086 2023-11-13T11:32:07.605 INFO:teuthology.orchestra.run.smithi102.stdout:086.out 2023-11-13T11:32:07.605 INFO:teuthology.orchestra.run.smithi102.stdout:087 2023-11-13T11:32:07.606 INFO:teuthology.orchestra.run.smithi102.stdout:087.out 2023-11-13T11:32:07.606 INFO:teuthology.orchestra.run.smithi102.stdout:088 2023-11-13T11:32:07.606 INFO:teuthology.orchestra.run.smithi102.stdout:088.out 2023-11-13T11:32:07.606 INFO:teuthology.orchestra.run.smithi102.stdout:089 2023-11-13T11:32:07.607 INFO:teuthology.orchestra.run.smithi102.stdout:089.out 2023-11-13T11:32:07.607 INFO:teuthology.orchestra.run.smithi102.stdout:090 2023-11-13T11:32:07.607 INFO:teuthology.orchestra.run.smithi102.stdout:090.out 2023-11-13T11:32:07.607 INFO:teuthology.orchestra.run.smithi102.stdout:091 2023-11-13T11:32:07.607 INFO:teuthology.orchestra.run.smithi102.stdout:091.out 2023-11-13T11:32:07.608 INFO:teuthology.orchestra.run.smithi102.stdout:092 2023-11-13T11:32:07.608 INFO:teuthology.orchestra.run.smithi102.stdout:092.out 2023-11-13T11:32:07.608 INFO:teuthology.orchestra.run.smithi102.stdout:093 2023-11-13T11:32:07.608 INFO:teuthology.orchestra.run.smithi102.stdout:093.out 2023-11-13T11:32:07.609 INFO:teuthology.orchestra.run.smithi102.stdout:094 2023-11-13T11:32:07.609 INFO:teuthology.orchestra.run.smithi102.stdout:094.out 2023-11-13T11:32:07.609 INFO:teuthology.orchestra.run.smithi102.stdout:095 2023-11-13T11:32:07.609 INFO:teuthology.orchestra.run.smithi102.stdout:095.out 2023-11-13T11:32:07.609 INFO:teuthology.orchestra.run.smithi102.stdout:096 2023-11-13T11:32:07.610 INFO:teuthology.orchestra.run.smithi102.stdout:096.out 2023-11-13T11:32:07.610 INFO:teuthology.orchestra.run.smithi102.stdout:097 2023-11-13T11:32:07.610 INFO:teuthology.orchestra.run.smithi102.stdout:097.out 2023-11-13T11:32:07.611 INFO:teuthology.orchestra.run.smithi102.stdout:098 2023-11-13T11:32:07.611 INFO:teuthology.orchestra.run.smithi102.stdout:098.out 2023-11-13T11:32:07.611 INFO:teuthology.orchestra.run.smithi102.stdout:099 2023-11-13T11:32:07.611 INFO:teuthology.orchestra.run.smithi102.stdout:099.out 2023-11-13T11:32:07.612 INFO:teuthology.orchestra.run.smithi102.stdout:100 2023-11-13T11:32:07.612 INFO:teuthology.orchestra.run.smithi102.stdout:100.out 2023-11-13T11:32:07.612 INFO:teuthology.orchestra.run.smithi102.stdout:101 2023-11-13T11:32:07.612 INFO:teuthology.orchestra.run.smithi102.stdout:101.out 2023-11-13T11:32:07.612 INFO:teuthology.orchestra.run.smithi102.stdout:102 2023-11-13T11:32:07.613 INFO:teuthology.orchestra.run.smithi102.stdout:102.out 2023-11-13T11:32:07.613 INFO:teuthology.orchestra.run.smithi102.stdout:103 2023-11-13T11:32:07.613 INFO:teuthology.orchestra.run.smithi102.stdout:103.out 2023-11-13T11:32:07.613 INFO:teuthology.orchestra.run.smithi102.stdout:104 2023-11-13T11:32:07.613 INFO:teuthology.orchestra.run.smithi102.stdout:104.out 2023-11-13T11:32:07.614 INFO:teuthology.orchestra.run.smithi102.stdout:105 2023-11-13T11:32:07.614 INFO:teuthology.orchestra.run.smithi102.stdout:105.out 2023-11-13T11:32:07.614 INFO:teuthology.orchestra.run.smithi102.stdout:106 2023-11-13T11:32:07.614 INFO:teuthology.orchestra.run.smithi102.stdout:106.out 2023-11-13T11:32:07.614 INFO:teuthology.orchestra.run.smithi102.stdout:107 2023-11-13T11:32:07.615 INFO:teuthology.orchestra.run.smithi102.stdout:107.out 2023-11-13T11:32:07.615 INFO:teuthology.orchestra.run.smithi102.stdout:108 2023-11-13T11:32:07.615 INFO:teuthology.orchestra.run.smithi102.stdout:108.out 2023-11-13T11:32:07.616 INFO:teuthology.orchestra.run.smithi102.stdout:109 2023-11-13T11:32:07.616 INFO:teuthology.orchestra.run.smithi102.stdout:109.out 2023-11-13T11:32:07.616 INFO:teuthology.orchestra.run.smithi102.stdout:110 2023-11-13T11:32:07.616 INFO:teuthology.orchestra.run.smithi102.stdout:110.out 2023-11-13T11:32:07.616 INFO:teuthology.orchestra.run.smithi102.stdout:111 2023-11-13T11:32:07.617 INFO:teuthology.orchestra.run.smithi102.stdout:111.out 2023-11-13T11:32:07.617 INFO:teuthology.orchestra.run.smithi102.stdout:112 2023-11-13T11:32:07.617 INFO:teuthology.orchestra.run.smithi102.stdout:112.out 2023-11-13T11:32:07.618 INFO:teuthology.orchestra.run.smithi102.stdout:113 2023-11-13T11:32:07.618 INFO:teuthology.orchestra.run.smithi102.stdout:113.out 2023-11-13T11:32:07.619 INFO:teuthology.orchestra.run.smithi102.stdout:114 2023-11-13T11:32:07.619 INFO:teuthology.orchestra.run.smithi102.stdout:114.out 2023-11-13T11:32:07.619 INFO:teuthology.orchestra.run.smithi102.stdout:115 2023-11-13T11:32:07.619 INFO:teuthology.orchestra.run.smithi102.stdout:115.out 2023-11-13T11:32:07.620 INFO:teuthology.orchestra.run.smithi102.stdout:116 2023-11-13T11:32:07.620 INFO:teuthology.orchestra.run.smithi102.stdout:116.out 2023-11-13T11:32:07.620 INFO:teuthology.orchestra.run.smithi102.stdout:117 2023-11-13T11:32:07.621 INFO:teuthology.orchestra.run.smithi102.stdout:117.out 2023-11-13T11:32:07.621 INFO:teuthology.orchestra.run.smithi102.stdout:118 2023-11-13T11:32:07.621 INFO:teuthology.orchestra.run.smithi102.stdout:118.out 2023-11-13T11:32:07.621 INFO:teuthology.orchestra.run.smithi102.stdout:119 2023-11-13T11:32:07.622 INFO:teuthology.orchestra.run.smithi102.stdout:119.out 2023-11-13T11:32:07.622 INFO:teuthology.orchestra.run.smithi102.stdout:120 2023-11-13T11:32:07.622 INFO:teuthology.orchestra.run.smithi102.stdout:120.out 2023-11-13T11:32:07.622 INFO:teuthology.orchestra.run.smithi102.stdout:121 2023-11-13T11:32:07.622 INFO:teuthology.orchestra.run.smithi102.stdout:121.out 2023-11-13T11:32:07.623 INFO:teuthology.orchestra.run.smithi102.stdout:122 2023-11-13T11:32:07.623 INFO:teuthology.orchestra.run.smithi102.stdout:122.out 2023-11-13T11:32:07.623 INFO:teuthology.orchestra.run.smithi102.stdout:123 2023-11-13T11:32:07.623 INFO:teuthology.orchestra.run.smithi102.stdout:123.out 2023-11-13T11:32:07.624 INFO:teuthology.orchestra.run.smithi102.stdout:124 2023-11-13T11:32:07.624 INFO:teuthology.orchestra.run.smithi102.stdout:124.out 2023-11-13T11:32:07.624 INFO:teuthology.orchestra.run.smithi102.stdout:125 2023-11-13T11:32:07.624 INFO:teuthology.orchestra.run.smithi102.stdout:125.out 2023-11-13T11:32:07.624 INFO:teuthology.orchestra.run.smithi102.stdout:126 2023-11-13T11:32:07.625 INFO:teuthology.orchestra.run.smithi102.stdout:126.out 2023-11-13T11:32:07.625 INFO:teuthology.orchestra.run.smithi102.stdout:127 2023-11-13T11:32:07.625 INFO:teuthology.orchestra.run.smithi102.stdout:127.out 2023-11-13T11:32:07.625 INFO:teuthology.orchestra.run.smithi102.stdout:128 2023-11-13T11:32:07.625 INFO:teuthology.orchestra.run.smithi102.stdout:128.out 2023-11-13T11:32:07.626 INFO:teuthology.orchestra.run.smithi102.stdout:129 2023-11-13T11:32:07.626 INFO:teuthology.orchestra.run.smithi102.stdout:129.out 2023-11-13T11:32:07.626 INFO:teuthology.orchestra.run.smithi102.stdout:130 2023-11-13T11:32:07.626 INFO:teuthology.orchestra.run.smithi102.stdout:130.out 2023-11-13T11:32:07.627 INFO:teuthology.orchestra.run.smithi102.stdout:131 2023-11-13T11:32:07.627 INFO:teuthology.orchestra.run.smithi102.stdout:131.out 2023-11-13T11:32:07.627 INFO:teuthology.orchestra.run.smithi102.stdout:132 2023-11-13T11:32:07.627 INFO:teuthology.orchestra.run.smithi102.stdout:132.out 2023-11-13T11:32:07.627 INFO:teuthology.orchestra.run.smithi102.stdout:133 2023-11-13T11:32:07.628 INFO:teuthology.orchestra.run.smithi102.stdout:133.out 2023-11-13T11:32:07.628 INFO:teuthology.orchestra.run.smithi102.stdout:134 2023-11-13T11:32:07.628 INFO:teuthology.orchestra.run.smithi102.stdout:134.out 2023-11-13T11:32:07.628 INFO:teuthology.orchestra.run.smithi102.stdout:135 2023-11-13T11:32:07.628 INFO:teuthology.orchestra.run.smithi102.stdout:135.out 2023-11-13T11:32:07.629 INFO:teuthology.orchestra.run.smithi102.stdout:136 2023-11-13T11:32:07.629 INFO:teuthology.orchestra.run.smithi102.stdout:136.out 2023-11-13T11:32:07.629 INFO:teuthology.orchestra.run.smithi102.stdout:137 2023-11-13T11:32:07.629 INFO:teuthology.orchestra.run.smithi102.stdout:137.out 2023-11-13T11:32:07.629 INFO:teuthology.orchestra.run.smithi102.stdout:138 2023-11-13T11:32:07.630 INFO:teuthology.orchestra.run.smithi102.stdout:138.out 2023-11-13T11:32:07.630 INFO:teuthology.orchestra.run.smithi102.stdout:139 2023-11-13T11:32:07.630 INFO:teuthology.orchestra.run.smithi102.stdout:139.out 2023-11-13T11:32:07.631 INFO:teuthology.orchestra.run.smithi102.stdout:140 2023-11-13T11:32:07.631 INFO:teuthology.orchestra.run.smithi102.stdout:140.out 2023-11-13T11:32:07.632 INFO:teuthology.orchestra.run.smithi102.stdout:141 2023-11-13T11:32:07.632 INFO:teuthology.orchestra.run.smithi102.stdout:141.out 2023-11-13T11:32:07.632 INFO:teuthology.orchestra.run.smithi102.stdout:142 2023-11-13T11:32:07.632 INFO:teuthology.orchestra.run.smithi102.stdout:142.out 2023-11-13T11:32:07.632 INFO:teuthology.orchestra.run.smithi102.stdout:143 2023-11-13T11:32:07.633 INFO:teuthology.orchestra.run.smithi102.stdout:143.out 2023-11-13T11:32:07.633 INFO:teuthology.orchestra.run.smithi102.stdout:144 2023-11-13T11:32:07.633 INFO:teuthology.orchestra.run.smithi102.stdout:144.out 2023-11-13T11:32:07.633 INFO:teuthology.orchestra.run.smithi102.stdout:145 2023-11-13T11:32:07.634 INFO:teuthology.orchestra.run.smithi102.stdout:145.out 2023-11-13T11:32:07.634 INFO:teuthology.orchestra.run.smithi102.stdout:146 2023-11-13T11:32:07.634 INFO:teuthology.orchestra.run.smithi102.stdout:146.out 2023-11-13T11:32:07.634 INFO:teuthology.orchestra.run.smithi102.stdout:147 2023-11-13T11:32:07.634 INFO:teuthology.orchestra.run.smithi102.stdout:147.out 2023-11-13T11:32:07.635 INFO:teuthology.orchestra.run.smithi102.stdout:148 2023-11-13T11:32:07.635 INFO:teuthology.orchestra.run.smithi102.stdout:148.out 2023-11-13T11:32:07.635 INFO:teuthology.orchestra.run.smithi102.stdout:149 2023-11-13T11:32:07.635 INFO:teuthology.orchestra.run.smithi102.stdout:149.out 2023-11-13T11:32:07.635 INFO:teuthology.orchestra.run.smithi102.stdout:150 2023-11-13T11:32:07.636 INFO:teuthology.orchestra.run.smithi102.stdout:150.out 2023-11-13T11:32:07.636 INFO:teuthology.orchestra.run.smithi102.stdout:151 2023-11-13T11:32:07.636 INFO:teuthology.orchestra.run.smithi102.stdout:151.out 2023-11-13T11:32:07.636 INFO:teuthology.orchestra.run.smithi102.stdout:152 2023-11-13T11:32:07.637 INFO:teuthology.orchestra.run.smithi102.stdout:152.out 2023-11-13T11:32:07.637 INFO:teuthology.orchestra.run.smithi102.stdout:153 2023-11-13T11:32:07.637 INFO:teuthology.orchestra.run.smithi102.stdout:153.out 2023-11-13T11:32:07.637 INFO:teuthology.orchestra.run.smithi102.stdout:154 2023-11-13T11:32:07.637 INFO:teuthology.orchestra.run.smithi102.stdout:154.out 2023-11-13T11:32:07.638 INFO:teuthology.orchestra.run.smithi102.stdout:155 2023-11-13T11:32:07.638 INFO:teuthology.orchestra.run.smithi102.stdout:155.out 2023-11-13T11:32:07.638 INFO:teuthology.orchestra.run.smithi102.stdout:156 2023-11-13T11:32:07.638 INFO:teuthology.orchestra.run.smithi102.stdout:156.out 2023-11-13T11:32:07.639 INFO:teuthology.orchestra.run.smithi102.stdout:157 2023-11-13T11:32:07.639 INFO:teuthology.orchestra.run.smithi102.stdout:157.out 2023-11-13T11:32:07.639 INFO:teuthology.orchestra.run.smithi102.stdout:158 2023-11-13T11:32:07.639 INFO:teuthology.orchestra.run.smithi102.stdout:158.out 2023-11-13T11:32:07.639 INFO:teuthology.orchestra.run.smithi102.stdout:159 2023-11-13T11:32:07.640 INFO:teuthology.orchestra.run.smithi102.stdout:159.out 2023-11-13T11:32:07.640 INFO:teuthology.orchestra.run.smithi102.stdout:160 2023-11-13T11:32:07.640 INFO:teuthology.orchestra.run.smithi102.stdout:160.out 2023-11-13T11:32:07.640 INFO:teuthology.orchestra.run.smithi102.stdout:161 2023-11-13T11:32:07.640 INFO:teuthology.orchestra.run.smithi102.stdout:161.out 2023-11-13T11:32:07.641 INFO:teuthology.orchestra.run.smithi102.stdout:162 2023-11-13T11:32:07.641 INFO:teuthology.orchestra.run.smithi102.stdout:162.out 2023-11-13T11:32:07.641 INFO:teuthology.orchestra.run.smithi102.stdout:163 2023-11-13T11:32:07.641 INFO:teuthology.orchestra.run.smithi102.stdout:163.out 2023-11-13T11:32:07.641 INFO:teuthology.orchestra.run.smithi102.stdout:164 2023-11-13T11:32:07.642 INFO:teuthology.orchestra.run.smithi102.stdout:164.out 2023-11-13T11:32:07.642 INFO:teuthology.orchestra.run.smithi102.stdout:165 2023-11-13T11:32:07.642 INFO:teuthology.orchestra.run.smithi102.stdout:165.out 2023-11-13T11:32:07.642 INFO:teuthology.orchestra.run.smithi102.stdout:166 2023-11-13T11:32:07.643 INFO:teuthology.orchestra.run.smithi102.stdout:166.out 2023-11-13T11:32:07.643 INFO:teuthology.orchestra.run.smithi102.stdout:167 2023-11-13T11:32:07.643 INFO:teuthology.orchestra.run.smithi102.stdout:167.out 2023-11-13T11:32:07.643 INFO:teuthology.orchestra.run.smithi102.stdout:168 2023-11-13T11:32:07.643 INFO:teuthology.orchestra.run.smithi102.stdout:168.out 2023-11-13T11:32:07.644 INFO:teuthology.orchestra.run.smithi102.stdout:169 2023-11-13T11:32:07.644 INFO:teuthology.orchestra.run.smithi102.stdout:169.out 2023-11-13T11:32:07.644 INFO:teuthology.orchestra.run.smithi102.stdout:170 2023-11-13T11:32:07.644 INFO:teuthology.orchestra.run.smithi102.stdout:170.out 2023-11-13T11:32:07.644 INFO:teuthology.orchestra.run.smithi102.stdout:171 2023-11-13T11:32:07.645 INFO:teuthology.orchestra.run.smithi102.stdout:171.out 2023-11-13T11:32:07.645 INFO:teuthology.orchestra.run.smithi102.stdout:172 2023-11-13T11:32:07.645 INFO:teuthology.orchestra.run.smithi102.stdout:172.out 2023-11-13T11:32:07.645 INFO:teuthology.orchestra.run.smithi102.stdout:173 2023-11-13T11:32:07.645 INFO:teuthology.orchestra.run.smithi102.stdout:173.out 2023-11-13T11:32:07.646 INFO:teuthology.orchestra.run.smithi102.stdout:174 2023-11-13T11:32:07.646 INFO:teuthology.orchestra.run.smithi102.stdout:174.out 2023-11-13T11:32:07.646 INFO:teuthology.orchestra.run.smithi102.stdout:175 2023-11-13T11:32:07.646 INFO:teuthology.orchestra.run.smithi102.stdout:175.out 2023-11-13T11:32:07.647 INFO:teuthology.orchestra.run.smithi102.stdout:176 2023-11-13T11:32:07.647 INFO:teuthology.orchestra.run.smithi102.stdout:176.out 2023-11-13T11:32:07.647 INFO:teuthology.orchestra.run.smithi102.stdout:177 2023-11-13T11:32:07.647 INFO:teuthology.orchestra.run.smithi102.stdout:177.out 2023-11-13T11:32:07.648 INFO:teuthology.orchestra.run.smithi102.stdout:178 2023-11-13T11:32:07.648 INFO:teuthology.orchestra.run.smithi102.stdout:178.out 2023-11-13T11:32:07.648 INFO:teuthology.orchestra.run.smithi102.stdout:179 2023-11-13T11:32:07.648 INFO:teuthology.orchestra.run.smithi102.stdout:179.out 2023-11-13T11:32:07.649 INFO:teuthology.orchestra.run.smithi102.stdout:180 2023-11-13T11:32:07.649 INFO:teuthology.orchestra.run.smithi102.stdout:180.out 2023-11-13T11:32:07.649 INFO:teuthology.orchestra.run.smithi102.stdout:181 2023-11-13T11:32:07.649 INFO:teuthology.orchestra.run.smithi102.stdout:181.out 2023-11-13T11:32:07.649 INFO:teuthology.orchestra.run.smithi102.stdout:182 2023-11-13T11:32:07.650 INFO:teuthology.orchestra.run.smithi102.stdout:182.out 2023-11-13T11:32:07.650 INFO:teuthology.orchestra.run.smithi102.stdout:183 2023-11-13T11:32:07.650 INFO:teuthology.orchestra.run.smithi102.stdout:183.out 2023-11-13T11:32:07.650 INFO:teuthology.orchestra.run.smithi102.stdout:184 2023-11-13T11:32:07.651 INFO:teuthology.orchestra.run.smithi102.stdout:184.out 2023-11-13T11:32:07.651 INFO:teuthology.orchestra.run.smithi102.stdout:185 2023-11-13T11:32:07.651 INFO:teuthology.orchestra.run.smithi102.stdout:185.out 2023-11-13T11:32:07.651 INFO:teuthology.orchestra.run.smithi102.stdout:186 2023-11-13T11:32:07.651 INFO:teuthology.orchestra.run.smithi102.stdout:186.out 2023-11-13T11:32:07.652 INFO:teuthology.orchestra.run.smithi102.stdout:187 2023-11-13T11:32:07.652 INFO:teuthology.orchestra.run.smithi102.stdout:187.out 2023-11-13T11:32:07.652 INFO:teuthology.orchestra.run.smithi102.stdout:188 2023-11-13T11:32:07.652 INFO:teuthology.orchestra.run.smithi102.stdout:188.out 2023-11-13T11:32:07.653 INFO:teuthology.orchestra.run.smithi102.stdout:189 2023-11-13T11:32:07.653 INFO:teuthology.orchestra.run.smithi102.stdout:189.out 2023-11-13T11:32:07.653 INFO:teuthology.orchestra.run.smithi102.stdout:190 2023-11-13T11:32:07.653 INFO:teuthology.orchestra.run.smithi102.stdout:190.out 2023-11-13T11:32:07.654 INFO:teuthology.orchestra.run.smithi102.stdout:191 2023-11-13T11:32:07.654 INFO:teuthology.orchestra.run.smithi102.stdout:191.out 2023-11-13T11:32:07.654 INFO:teuthology.orchestra.run.smithi102.stdout:192 2023-11-13T11:32:07.654 INFO:teuthology.orchestra.run.smithi102.stdout:192.out 2023-11-13T11:32:07.655 INFO:teuthology.orchestra.run.smithi102.stdout:193 2023-11-13T11:32:07.655 INFO:teuthology.orchestra.run.smithi102.stdout:193.out 2023-11-13T11:32:07.655 INFO:teuthology.orchestra.run.smithi102.stdout:194 2023-11-13T11:32:07.655 INFO:teuthology.orchestra.run.smithi102.stdout:194.out 2023-11-13T11:32:07.656 INFO:teuthology.orchestra.run.smithi102.stdout:195 2023-11-13T11:32:07.656 INFO:teuthology.orchestra.run.smithi102.stdout:195.out 2023-11-13T11:32:07.656 INFO:teuthology.orchestra.run.smithi102.stdout:196 2023-11-13T11:32:07.656 INFO:teuthology.orchestra.run.smithi102.stdout:196.out 2023-11-13T11:32:07.657 INFO:teuthology.orchestra.run.smithi102.stdout:197 2023-11-13T11:32:07.657 INFO:teuthology.orchestra.run.smithi102.stdout:197.out 2023-11-13T11:32:07.657 INFO:teuthology.orchestra.run.smithi102.stdout:198 2023-11-13T11:32:07.657 INFO:teuthology.orchestra.run.smithi102.stdout:198.out 2023-11-13T11:32:07.658 INFO:teuthology.orchestra.run.smithi102.stdout:199 2023-11-13T11:32:07.658 INFO:teuthology.orchestra.run.smithi102.stdout:199.out 2023-11-13T11:32:07.658 INFO:teuthology.orchestra.run.smithi102.stdout:200 2023-11-13T11:32:07.658 INFO:teuthology.orchestra.run.smithi102.stdout:200.out 2023-11-13T11:32:07.658 INFO:teuthology.orchestra.run.smithi102.stdout:201 2023-11-13T11:32:07.659 INFO:teuthology.orchestra.run.smithi102.stdout:201.out 2023-11-13T11:32:07.659 INFO:teuthology.orchestra.run.smithi102.stdout:202 2023-11-13T11:32:07.659 INFO:teuthology.orchestra.run.smithi102.stdout:202.out 2023-11-13T11:32:07.659 INFO:teuthology.orchestra.run.smithi102.stdout:203 2023-11-13T11:32:07.660 INFO:teuthology.orchestra.run.smithi102.stdout:203.out 2023-11-13T11:32:07.660 INFO:teuthology.orchestra.run.smithi102.stdout:204 2023-11-13T11:32:07.660 INFO:teuthology.orchestra.run.smithi102.stdout:204.out 2023-11-13T11:32:07.660 INFO:teuthology.orchestra.run.smithi102.stdout:205 2023-11-13T11:32:07.660 INFO:teuthology.orchestra.run.smithi102.stdout:205.out 2023-11-13T11:32:07.661 INFO:teuthology.orchestra.run.smithi102.stdout:206 2023-11-13T11:32:07.661 INFO:teuthology.orchestra.run.smithi102.stdout:206.out 2023-11-13T11:32:07.661 INFO:teuthology.orchestra.run.smithi102.stdout:207 2023-11-13T11:32:07.661 INFO:teuthology.orchestra.run.smithi102.stdout:207.out 2023-11-13T11:32:07.662 INFO:teuthology.orchestra.run.smithi102.stdout:208 2023-11-13T11:32:07.662 INFO:teuthology.orchestra.run.smithi102.stdout:208.out 2023-11-13T11:32:07.662 INFO:teuthology.orchestra.run.smithi102.stdout:209 2023-11-13T11:32:07.662 INFO:teuthology.orchestra.run.smithi102.stdout:209.out 2023-11-13T11:32:07.662 INFO:teuthology.orchestra.run.smithi102.stdout:210 2023-11-13T11:32:07.663 INFO:teuthology.orchestra.run.smithi102.stdout:210.out 2023-11-13T11:32:07.663 INFO:teuthology.orchestra.run.smithi102.stdout:211 2023-11-13T11:32:07.663 INFO:teuthology.orchestra.run.smithi102.stdout:211.out 2023-11-13T11:32:07.663 INFO:teuthology.orchestra.run.smithi102.stdout:212 2023-11-13T11:32:07.664 INFO:teuthology.orchestra.run.smithi102.stdout:212.out 2023-11-13T11:32:07.664 INFO:teuthology.orchestra.run.smithi102.stdout:213 2023-11-13T11:32:07.664 INFO:teuthology.orchestra.run.smithi102.stdout:213.out 2023-11-13T11:32:07.664 INFO:teuthology.orchestra.run.smithi102.stdout:214 2023-11-13T11:32:07.664 INFO:teuthology.orchestra.run.smithi102.stdout:214.out 2023-11-13T11:32:07.665 INFO:teuthology.orchestra.run.smithi102.stdout:215 2023-11-13T11:32:07.665 INFO:teuthology.orchestra.run.smithi102.stdout:215.out 2023-11-13T11:32:07.665 INFO:teuthology.orchestra.run.smithi102.stdout:216 2023-11-13T11:32:07.665 INFO:teuthology.orchestra.run.smithi102.stdout:216.out 2023-11-13T11:32:07.666 INFO:teuthology.orchestra.run.smithi102.stdout:217 2023-11-13T11:32:07.666 INFO:teuthology.orchestra.run.smithi102.stdout:217.out 2023-11-13T11:32:07.666 INFO:teuthology.orchestra.run.smithi102.stdout:218 2023-11-13T11:32:07.666 INFO:teuthology.orchestra.run.smithi102.stdout:218.out 2023-11-13T11:32:07.666 INFO:teuthology.orchestra.run.smithi102.stdout:219 2023-11-13T11:32:07.667 INFO:teuthology.orchestra.run.smithi102.stdout:219.out 2023-11-13T11:32:07.667 INFO:teuthology.orchestra.run.smithi102.stdout:220 2023-11-13T11:32:07.667 INFO:teuthology.orchestra.run.smithi102.stdout:220.out 2023-11-13T11:32:07.667 INFO:teuthology.orchestra.run.smithi102.stdout:221 2023-11-13T11:32:07.667 INFO:teuthology.orchestra.run.smithi102.stdout:221.out 2023-11-13T11:32:07.668 INFO:teuthology.orchestra.run.smithi102.stdout:222 2023-11-13T11:32:07.668 INFO:teuthology.orchestra.run.smithi102.stdout:222.out 2023-11-13T11:32:07.668 INFO:teuthology.orchestra.run.smithi102.stdout:223 2023-11-13T11:32:07.668 INFO:teuthology.orchestra.run.smithi102.stdout:223.out 2023-11-13T11:32:07.668 INFO:teuthology.orchestra.run.smithi102.stdout:224 2023-11-13T11:32:07.669 INFO:teuthology.orchestra.run.smithi102.stdout:224.out 2023-11-13T11:32:07.669 INFO:teuthology.orchestra.run.smithi102.stdout:225 2023-11-13T11:32:07.669 INFO:teuthology.orchestra.run.smithi102.stdout:225.out 2023-11-13T11:32:07.669 INFO:teuthology.orchestra.run.smithi102.stdout:226 2023-11-13T11:32:07.670 INFO:teuthology.orchestra.run.smithi102.stdout:226.out 2023-11-13T11:32:07.670 INFO:teuthology.orchestra.run.smithi102.stdout:227 2023-11-13T11:32:07.670 INFO:teuthology.orchestra.run.smithi102.stdout:227.out 2023-11-13T11:32:07.670 INFO:teuthology.orchestra.run.smithi102.stdout:228 2023-11-13T11:32:07.670 INFO:teuthology.orchestra.run.smithi102.stdout:228.out 2023-11-13T11:32:07.671 INFO:teuthology.orchestra.run.smithi102.stdout:229 2023-11-13T11:32:07.671 INFO:teuthology.orchestra.run.smithi102.stdout:229.out 2023-11-13T11:32:07.671 INFO:teuthology.orchestra.run.smithi102.stdout:230 2023-11-13T11:32:07.671 INFO:teuthology.orchestra.run.smithi102.stdout:230.out 2023-11-13T11:32:07.671 INFO:teuthology.orchestra.run.smithi102.stdout:231 2023-11-13T11:32:07.672 INFO:teuthology.orchestra.run.smithi102.stdout:231.out 2023-11-13T11:32:07.672 INFO:teuthology.orchestra.run.smithi102.stdout:232 2023-11-13T11:32:07.672 INFO:teuthology.orchestra.run.smithi102.stdout:232.out 2023-11-13T11:32:07.672 INFO:teuthology.orchestra.run.smithi102.stdout:233 2023-11-13T11:32:07.673 INFO:teuthology.orchestra.run.smithi102.stdout:233.out 2023-11-13T11:32:07.673 INFO:teuthology.orchestra.run.smithi102.stdout:234 2023-11-13T11:32:07.673 INFO:teuthology.orchestra.run.smithi102.stdout:234.out 2023-11-13T11:32:07.673 INFO:teuthology.orchestra.run.smithi102.stdout:235 2023-11-13T11:32:07.674 INFO:teuthology.orchestra.run.smithi102.stdout:235.out 2023-11-13T11:32:07.674 INFO:teuthology.orchestra.run.smithi102.stdout:236 2023-11-13T11:32:07.674 INFO:teuthology.orchestra.run.smithi102.stdout:236.out 2023-11-13T11:32:07.674 INFO:teuthology.orchestra.run.smithi102.stdout:237 2023-11-13T11:32:07.674 INFO:teuthology.orchestra.run.smithi102.stdout:237.out 2023-11-13T11:32:07.675 INFO:teuthology.orchestra.run.smithi102.stdout:238 2023-11-13T11:32:07.675 INFO:teuthology.orchestra.run.smithi102.stdout:238.out 2023-11-13T11:32:07.675 INFO:teuthology.orchestra.run.smithi102.stdout:239 2023-11-13T11:32:07.675 INFO:teuthology.orchestra.run.smithi102.stdout:239.out 2023-11-13T11:32:07.675 INFO:teuthology.orchestra.run.smithi102.stdout:240 2023-11-13T11:32:07.676 INFO:teuthology.orchestra.run.smithi102.stdout:240.out 2023-11-13T11:32:07.676 INFO:teuthology.orchestra.run.smithi102.stdout:241 2023-11-13T11:32:07.676 INFO:teuthology.orchestra.run.smithi102.stdout:241.out 2023-11-13T11:32:07.676 INFO:teuthology.orchestra.run.smithi102.stdout:242 2023-11-13T11:32:07.676 INFO:teuthology.orchestra.run.smithi102.stdout:242.out 2023-11-13T11:32:07.677 INFO:teuthology.orchestra.run.smithi102.stdout:243 2023-11-13T11:32:07.677 INFO:teuthology.orchestra.run.smithi102.stdout:243.out 2023-11-13T11:32:07.677 INFO:teuthology.orchestra.run.smithi102.stdout:244 2023-11-13T11:32:07.677 INFO:teuthology.orchestra.run.smithi102.stdout:244.out 2023-11-13T11:32:07.677 INFO:teuthology.orchestra.run.smithi102.stdout:245 2023-11-13T11:32:07.678 INFO:teuthology.orchestra.run.smithi102.stdout:245.out 2023-11-13T11:32:07.678 INFO:teuthology.orchestra.run.smithi102.stdout:246 2023-11-13T11:32:07.678 INFO:teuthology.orchestra.run.smithi102.stdout:246.out 2023-11-13T11:32:07.678 INFO:teuthology.orchestra.run.smithi102.stdout:247 2023-11-13T11:32:07.679 INFO:teuthology.orchestra.run.smithi102.stdout:247.out 2023-11-13T11:32:07.679 INFO:teuthology.orchestra.run.smithi102.stdout:248 2023-11-13T11:32:07.679 INFO:teuthology.orchestra.run.smithi102.stdout:248.out 2023-11-13T11:32:07.679 INFO:teuthology.orchestra.run.smithi102.stdout:249 2023-11-13T11:32:07.679 INFO:teuthology.orchestra.run.smithi102.stdout:249.out 2023-11-13T11:32:07.680 INFO:teuthology.orchestra.run.smithi102.stdout:250 2023-11-13T11:32:07.680 INFO:teuthology.orchestra.run.smithi102.stdout:250.out 2023-11-13T11:32:07.680 INFO:teuthology.orchestra.run.smithi102.stdout:251 2023-11-13T11:32:07.680 INFO:teuthology.orchestra.run.smithi102.stdout:251.out 2023-11-13T11:32:07.680 INFO:teuthology.orchestra.run.smithi102.stdout:252 2023-11-13T11:32:07.681 INFO:teuthology.orchestra.run.smithi102.stdout:252.out 2023-11-13T11:32:07.681 INFO:teuthology.orchestra.run.smithi102.stdout:253 2023-11-13T11:32:07.681 INFO:teuthology.orchestra.run.smithi102.stdout:253.out 2023-11-13T11:32:07.681 INFO:teuthology.orchestra.run.smithi102.stdout:254 2023-11-13T11:32:07.682 INFO:teuthology.orchestra.run.smithi102.stdout:254.out 2023-11-13T11:32:07.682 INFO:teuthology.orchestra.run.smithi102.stdout:255 2023-11-13T11:32:07.682 INFO:teuthology.orchestra.run.smithi102.stdout:255.out 2023-11-13T11:32:07.682 INFO:teuthology.orchestra.run.smithi102.stdout:256 2023-11-13T11:32:07.683 INFO:teuthology.orchestra.run.smithi102.stdout:256.out 2023-11-13T11:32:07.683 INFO:teuthology.orchestra.run.smithi102.stdout:257 2023-11-13T11:32:07.683 INFO:teuthology.orchestra.run.smithi102.stdout:257.out 2023-11-13T11:32:07.683 INFO:teuthology.orchestra.run.smithi102.stdout:258 2023-11-13T11:32:07.683 INFO:teuthology.orchestra.run.smithi102.stdout:258.out 2023-11-13T11:32:07.684 INFO:teuthology.orchestra.run.smithi102.stdout:259 2023-11-13T11:32:07.684 INFO:teuthology.orchestra.run.smithi102.stdout:259.out 2023-11-13T11:32:07.684 INFO:teuthology.orchestra.run.smithi102.stdout:260 2023-11-13T11:32:07.684 INFO:teuthology.orchestra.run.smithi102.stdout:260.out 2023-11-13T11:32:07.684 INFO:teuthology.orchestra.run.smithi102.stdout:261 2023-11-13T11:32:07.685 INFO:teuthology.orchestra.run.smithi102.stdout:261.out 2023-11-13T11:32:07.685 INFO:teuthology.orchestra.run.smithi102.stdout:262 2023-11-13T11:32:07.685 INFO:teuthology.orchestra.run.smithi102.stdout:262.out 2023-11-13T11:32:07.685 INFO:teuthology.orchestra.run.smithi102.stdout:263 2023-11-13T11:32:07.685 INFO:teuthology.orchestra.run.smithi102.stdout:263.out 2023-11-13T11:32:07.686 INFO:teuthology.orchestra.run.smithi102.stdout:264 2023-11-13T11:32:07.686 INFO:teuthology.orchestra.run.smithi102.stdout:264.out 2023-11-13T11:32:07.686 INFO:teuthology.orchestra.run.smithi102.stdout:265 2023-11-13T11:32:07.686 INFO:teuthology.orchestra.run.smithi102.stdout:265.out 2023-11-13T11:32:07.686 INFO:teuthology.orchestra.run.smithi102.stdout:266 2023-11-13T11:32:07.687 INFO:teuthology.orchestra.run.smithi102.stdout:266.out 2023-11-13T11:32:07.687 INFO:teuthology.orchestra.run.smithi102.stdout:267 2023-11-13T11:32:07.687 INFO:teuthology.orchestra.run.smithi102.stdout:267.out 2023-11-13T11:32:07.687 INFO:teuthology.orchestra.run.smithi102.stdout:268 2023-11-13T11:32:07.688 INFO:teuthology.orchestra.run.smithi102.stdout:268.out 2023-11-13T11:32:07.688 INFO:teuthology.orchestra.run.smithi102.stdout:269 2023-11-13T11:32:07.688 INFO:teuthology.orchestra.run.smithi102.stdout:269.out 2023-11-13T11:32:07.688 INFO:teuthology.orchestra.run.smithi102.stdout:270 2023-11-13T11:32:07.688 INFO:teuthology.orchestra.run.smithi102.stdout:270.out 2023-11-13T11:32:07.689 INFO:teuthology.orchestra.run.smithi102.stdout:271 2023-11-13T11:32:07.689 INFO:teuthology.orchestra.run.smithi102.stdout:271.out 2023-11-13T11:32:07.689 INFO:teuthology.orchestra.run.smithi102.stdout:272 2023-11-13T11:32:07.689 INFO:teuthology.orchestra.run.smithi102.stdout:272.out 2023-11-13T11:32:07.689 INFO:teuthology.orchestra.run.smithi102.stdout:273 2023-11-13T11:32:07.690 INFO:teuthology.orchestra.run.smithi102.stdout:273.out 2023-11-13T11:32:07.690 INFO:teuthology.orchestra.run.smithi102.stdout:274 2023-11-13T11:32:07.690 INFO:teuthology.orchestra.run.smithi102.stdout:274.out 2023-11-13T11:32:07.690 INFO:teuthology.orchestra.run.smithi102.stdout:275 2023-11-13T11:32:07.690 INFO:teuthology.orchestra.run.smithi102.stdout:275.out 2023-11-13T11:32:07.691 INFO:teuthology.orchestra.run.smithi102.stdout:276 2023-11-13T11:32:07.691 INFO:teuthology.orchestra.run.smithi102.stdout:276.out 2023-11-13T11:32:07.691 INFO:teuthology.orchestra.run.smithi102.stdout:277 2023-11-13T11:32:07.691 INFO:teuthology.orchestra.run.smithi102.stdout:277.out 2023-11-13T11:32:07.691 INFO:teuthology.orchestra.run.smithi102.stdout:278 2023-11-13T11:32:07.692 INFO:teuthology.orchestra.run.smithi102.stdout:278.out 2023-11-13T11:32:07.692 INFO:teuthology.orchestra.run.smithi102.stdout:279 2023-11-13T11:32:07.692 INFO:teuthology.orchestra.run.smithi102.stdout:279.out 2023-11-13T11:32:07.692 INFO:teuthology.orchestra.run.smithi102.stdout:280 2023-11-13T11:32:07.693 INFO:teuthology.orchestra.run.smithi102.stdout:280.out 2023-11-13T11:32:07.693 INFO:teuthology.orchestra.run.smithi102.stdout:281 2023-11-13T11:32:07.693 INFO:teuthology.orchestra.run.smithi102.stdout:281.out 2023-11-13T11:32:07.693 INFO:teuthology.orchestra.run.smithi102.stdout:282 2023-11-13T11:32:07.693 INFO:teuthology.orchestra.run.smithi102.stdout:282.out 2023-11-13T11:32:07.694 INFO:teuthology.orchestra.run.smithi102.stdout:283 2023-11-13T11:32:07.694 INFO:teuthology.orchestra.run.smithi102.stdout:283.out 2023-11-13T11:32:07.694 INFO:teuthology.orchestra.run.smithi102.stdout:284 2023-11-13T11:32:07.694 INFO:teuthology.orchestra.run.smithi102.stdout:284.out 2023-11-13T11:32:07.695 INFO:teuthology.orchestra.run.smithi102.stdout:285 2023-11-13T11:32:07.695 INFO:teuthology.orchestra.run.smithi102.stdout:285.out 2023-11-13T11:32:07.695 INFO:teuthology.orchestra.run.smithi102.stdout:286 2023-11-13T11:32:07.695 INFO:teuthology.orchestra.run.smithi102.stdout:286.out 2023-11-13T11:32:07.695 INFO:teuthology.orchestra.run.smithi102.stdout:287 2023-11-13T11:32:07.696 INFO:teuthology.orchestra.run.smithi102.stdout:287.out 2023-11-13T11:32:07.696 INFO:teuthology.orchestra.run.smithi102.stdout:288 2023-11-13T11:32:07.696 INFO:teuthology.orchestra.run.smithi102.stdout:288.out 2023-11-13T11:32:07.697 INFO:teuthology.orchestra.run.smithi102.stdout:289 2023-11-13T11:32:07.697 INFO:teuthology.orchestra.run.smithi102.stdout:289.out 2023-11-13T11:32:07.697 INFO:teuthology.orchestra.run.smithi102.stdout:290 2023-11-13T11:32:07.697 INFO:teuthology.orchestra.run.smithi102.stdout:290.out 2023-11-13T11:32:07.697 INFO:teuthology.orchestra.run.smithi102.stdout:291 2023-11-13T11:32:07.698 INFO:teuthology.orchestra.run.smithi102.stdout:291.out 2023-11-13T11:32:07.698 INFO:teuthology.orchestra.run.smithi102.stdout:292 2023-11-13T11:32:07.698 INFO:teuthology.orchestra.run.smithi102.stdout:292.out 2023-11-13T11:32:07.698 INFO:teuthology.orchestra.run.smithi102.stdout:293 2023-11-13T11:32:07.699 INFO:teuthology.orchestra.run.smithi102.stdout:293.out 2023-11-13T11:32:07.699 INFO:teuthology.orchestra.run.smithi102.stdout:294 2023-11-13T11:32:07.699 INFO:teuthology.orchestra.run.smithi102.stdout:294.out 2023-11-13T11:32:07.699 INFO:teuthology.orchestra.run.smithi102.stdout:295 2023-11-13T11:32:07.699 INFO:teuthology.orchestra.run.smithi102.stdout:295.out 2023-11-13T11:32:07.700 INFO:teuthology.orchestra.run.smithi102.stdout:296 2023-11-13T11:32:07.700 INFO:teuthology.orchestra.run.smithi102.stdout:296.out 2023-11-13T11:32:07.700 INFO:teuthology.orchestra.run.smithi102.stdout:297 2023-11-13T11:32:07.700 INFO:teuthology.orchestra.run.smithi102.stdout:297.out 2023-11-13T11:32:07.700 INFO:teuthology.orchestra.run.smithi102.stdout:298 2023-11-13T11:32:07.701 INFO:teuthology.orchestra.run.smithi102.stdout:298.out 2023-11-13T11:32:07.701 INFO:teuthology.orchestra.run.smithi102.stdout:299 2023-11-13T11:32:07.701 INFO:teuthology.orchestra.run.smithi102.stdout:299.out 2023-11-13T11:32:07.701 INFO:teuthology.orchestra.run.smithi102.stdout:300 2023-11-13T11:32:07.701 INFO:teuthology.orchestra.run.smithi102.stdout:300.out 2023-11-13T11:32:07.702 INFO:teuthology.orchestra.run.smithi102.stdout:301 2023-11-13T11:32:07.702 INFO:teuthology.orchestra.run.smithi102.stdout:301.out 2023-11-13T11:32:07.702 INFO:teuthology.orchestra.run.smithi102.stdout:302 2023-11-13T11:32:07.702 INFO:teuthology.orchestra.run.smithi102.stdout:302.out 2023-11-13T11:32:07.702 INFO:teuthology.orchestra.run.smithi102.stdout:303 2023-11-13T11:32:07.703 INFO:teuthology.orchestra.run.smithi102.stdout:303.out 2023-11-13T11:32:07.703 INFO:teuthology.orchestra.run.smithi102.stdout:304 2023-11-13T11:32:07.703 INFO:teuthology.orchestra.run.smithi102.stdout:304.out 2023-11-13T11:32:07.703 INFO:teuthology.orchestra.run.smithi102.stdout:305 2023-11-13T11:32:07.704 INFO:teuthology.orchestra.run.smithi102.stdout:305.out 2023-11-13T11:32:07.704 INFO:teuthology.orchestra.run.smithi102.stdout:306 2023-11-13T11:32:07.704 INFO:teuthology.orchestra.run.smithi102.stdout:306.out 2023-11-13T11:32:07.704 INFO:teuthology.orchestra.run.smithi102.stdout:307 2023-11-13T11:32:07.704 INFO:teuthology.orchestra.run.smithi102.stdout:307.out 2023-11-13T11:32:07.705 INFO:teuthology.orchestra.run.smithi102.stdout:308 2023-11-13T11:32:07.705 INFO:teuthology.orchestra.run.smithi102.stdout:308.out 2023-11-13T11:32:07.705 INFO:teuthology.orchestra.run.smithi102.stdout:309 2023-11-13T11:32:07.705 INFO:teuthology.orchestra.run.smithi102.stdout:309.out 2023-11-13T11:32:07.705 INFO:teuthology.orchestra.run.smithi102.stdout:310 2023-11-13T11:32:07.706 INFO:teuthology.orchestra.run.smithi102.stdout:310.out 2023-11-13T11:32:07.706 INFO:teuthology.orchestra.run.smithi102.stdout:311 2023-11-13T11:32:07.706 INFO:teuthology.orchestra.run.smithi102.stdout:311.out 2023-11-13T11:32:07.706 INFO:teuthology.orchestra.run.smithi102.stdout:312 2023-11-13T11:32:07.707 INFO:teuthology.orchestra.run.smithi102.stdout:312.out 2023-11-13T11:32:07.707 INFO:teuthology.orchestra.run.smithi102.stdout:313 2023-11-13T11:32:07.707 INFO:teuthology.orchestra.run.smithi102.stdout:313.out 2023-11-13T11:32:07.707 INFO:teuthology.orchestra.run.smithi102.stdout:314 2023-11-13T11:32:07.707 INFO:teuthology.orchestra.run.smithi102.stdout:314.out 2023-11-13T11:32:07.708 INFO:teuthology.orchestra.run.smithi102.stdout:315 2023-11-13T11:32:07.708 INFO:teuthology.orchestra.run.smithi102.stdout:315.out 2023-11-13T11:32:07.708 INFO:teuthology.orchestra.run.smithi102.stdout:316 2023-11-13T11:32:07.708 INFO:teuthology.orchestra.run.smithi102.stdout:316.out 2023-11-13T11:32:07.709 INFO:teuthology.orchestra.run.smithi102.stdout:317 2023-11-13T11:32:07.709 INFO:teuthology.orchestra.run.smithi102.stdout:317.out 2023-11-13T11:32:07.709 INFO:teuthology.orchestra.run.smithi102.stdout:318 2023-11-13T11:32:07.709 INFO:teuthology.orchestra.run.smithi102.stdout:318.out 2023-11-13T11:32:07.710 INFO:teuthology.orchestra.run.smithi102.stdout:319 2023-11-13T11:32:07.710 INFO:teuthology.orchestra.run.smithi102.stdout:319.out 2023-11-13T11:32:07.710 INFO:teuthology.orchestra.run.smithi102.stdout:320 2023-11-13T11:32:07.710 INFO:teuthology.orchestra.run.smithi102.stdout:320.out 2023-11-13T11:32:07.710 INFO:teuthology.orchestra.run.smithi102.stdout:321 2023-11-13T11:32:07.711 INFO:teuthology.orchestra.run.smithi102.stdout:321.out 2023-11-13T11:32:07.711 INFO:teuthology.orchestra.run.smithi102.stdout:322 2023-11-13T11:32:07.711 INFO:teuthology.orchestra.run.smithi102.stdout:322.out 2023-11-13T11:32:07.711 INFO:teuthology.orchestra.run.smithi102.stdout:323 2023-11-13T11:32:07.712 INFO:teuthology.orchestra.run.smithi102.stdout:323.out 2023-11-13T11:32:07.712 INFO:teuthology.orchestra.run.smithi102.stdout:324 2023-11-13T11:32:07.712 INFO:teuthology.orchestra.run.smithi102.stdout:324.out 2023-11-13T11:32:07.712 INFO:teuthology.orchestra.run.smithi102.stdout:325 2023-11-13T11:32:07.713 INFO:teuthology.orchestra.run.smithi102.stdout:325.out 2023-11-13T11:32:07.713 INFO:teuthology.orchestra.run.smithi102.stdout:326 2023-11-13T11:32:07.713 INFO:teuthology.orchestra.run.smithi102.stdout:326.out 2023-11-13T11:32:07.713 INFO:teuthology.orchestra.run.smithi102.stdout:327 2023-11-13T11:32:07.713 INFO:teuthology.orchestra.run.smithi102.stdout:327.out 2023-11-13T11:32:07.714 INFO:teuthology.orchestra.run.smithi102.stdout:328 2023-11-13T11:32:07.714 INFO:teuthology.orchestra.run.smithi102.stdout:328.out 2023-11-13T11:32:07.714 INFO:teuthology.orchestra.run.smithi102.stdout:329 2023-11-13T11:32:07.714 INFO:teuthology.orchestra.run.smithi102.stdout:329.out 2023-11-13T11:32:07.715 INFO:teuthology.orchestra.run.smithi102.stdout:330 2023-11-13T11:32:07.715 INFO:teuthology.orchestra.run.smithi102.stdout:330.out 2023-11-13T11:32:07.715 INFO:teuthology.orchestra.run.smithi102.stdout:331 2023-11-13T11:32:07.715 INFO:teuthology.orchestra.run.smithi102.stdout:331.out 2023-11-13T11:32:07.716 INFO:teuthology.orchestra.run.smithi102.stdout:332 2023-11-13T11:32:07.716 INFO:teuthology.orchestra.run.smithi102.stdout:332.out 2023-11-13T11:32:07.716 INFO:teuthology.orchestra.run.smithi102.stdout:333 2023-11-13T11:32:07.716 INFO:teuthology.orchestra.run.smithi102.stdout:333.out 2023-11-13T11:32:07.717 INFO:teuthology.orchestra.run.smithi102.stdout:334 2023-11-13T11:32:07.717 INFO:teuthology.orchestra.run.smithi102.stdout:334.out 2023-11-13T11:32:07.717 INFO:teuthology.orchestra.run.smithi102.stdout:335 2023-11-13T11:32:07.717 INFO:teuthology.orchestra.run.smithi102.stdout:335.out 2023-11-13T11:32:07.718 INFO:teuthology.orchestra.run.smithi102.stdout:336 2023-11-13T11:32:07.718 INFO:teuthology.orchestra.run.smithi102.stdout:336.out 2023-11-13T11:32:07.718 INFO:teuthology.orchestra.run.smithi102.stdout:337 2023-11-13T11:32:07.718 INFO:teuthology.orchestra.run.smithi102.stdout:337.out 2023-11-13T11:32:07.719 INFO:teuthology.orchestra.run.smithi102.stdout:338 2023-11-13T11:32:07.719 INFO:teuthology.orchestra.run.smithi102.stdout:338.out 2023-11-13T11:32:07.719 INFO:teuthology.orchestra.run.smithi102.stdout:339 2023-11-13T11:32:07.719 INFO:teuthology.orchestra.run.smithi102.stdout:339.out 2023-11-13T11:32:07.719 INFO:teuthology.orchestra.run.smithi102.stdout:340 2023-11-13T11:32:07.720 INFO:teuthology.orchestra.run.smithi102.stdout:340.out 2023-11-13T11:32:07.720 INFO:teuthology.orchestra.run.smithi102.stdout:341 2023-11-13T11:32:07.720 INFO:teuthology.orchestra.run.smithi102.stdout:341.out 2023-11-13T11:32:07.720 INFO:teuthology.orchestra.run.smithi102.stdout:342 2023-11-13T11:32:07.721 INFO:teuthology.orchestra.run.smithi102.stdout:342.out 2023-11-13T11:32:07.721 INFO:teuthology.orchestra.run.smithi102.stdout:343 2023-11-13T11:32:07.721 INFO:teuthology.orchestra.run.smithi102.stdout:343.out 2023-11-13T11:32:07.721 INFO:teuthology.orchestra.run.smithi102.stdout:344 2023-11-13T11:32:07.721 INFO:teuthology.orchestra.run.smithi102.stdout:344.out 2023-11-13T11:32:07.722 INFO:teuthology.orchestra.run.smithi102.stdout:345 2023-11-13T11:32:07.722 INFO:teuthology.orchestra.run.smithi102.stdout:345.out 2023-11-13T11:32:07.722 INFO:teuthology.orchestra.run.smithi102.stdout:346 2023-11-13T11:32:07.722 INFO:teuthology.orchestra.run.smithi102.stdout:346.out 2023-11-13T11:32:07.722 INFO:teuthology.orchestra.run.smithi102.stdout:347 2023-11-13T11:32:07.723 INFO:teuthology.orchestra.run.smithi102.stdout:347.out 2023-11-13T11:32:07.723 INFO:teuthology.orchestra.run.smithi102.stdout:348 2023-11-13T11:32:07.723 INFO:teuthology.orchestra.run.smithi102.stdout:348.out 2023-11-13T11:32:07.723 INFO:teuthology.orchestra.run.smithi102.stdout:349 2023-11-13T11:32:07.724 INFO:teuthology.orchestra.run.smithi102.stdout:349.out 2023-11-13T11:32:07.724 INFO:teuthology.orchestra.run.smithi102.stdout:350 2023-11-13T11:32:07.724 INFO:teuthology.orchestra.run.smithi102.stdout:350.out 2023-11-13T11:32:07.724 INFO:teuthology.orchestra.run.smithi102.stdout:351 2023-11-13T11:32:07.724 INFO:teuthology.orchestra.run.smithi102.stdout:351.out 2023-11-13T11:32:07.725 INFO:teuthology.orchestra.run.smithi102.stdout:352 2023-11-13T11:32:07.725 INFO:teuthology.orchestra.run.smithi102.stdout:352.out 2023-11-13T11:32:07.725 INFO:teuthology.orchestra.run.smithi102.stdout:353 2023-11-13T11:32:07.725 INFO:teuthology.orchestra.run.smithi102.stdout:353.out 2023-11-13T11:32:07.725 INFO:teuthology.orchestra.run.smithi102.stdout:354 2023-11-13T11:32:07.726 INFO:teuthology.orchestra.run.smithi102.stdout:354.out 2023-11-13T11:32:07.726 INFO:teuthology.orchestra.run.smithi102.stdout:355 2023-11-13T11:32:07.726 INFO:teuthology.orchestra.run.smithi102.stdout:355.out 2023-11-13T11:32:07.726 INFO:teuthology.orchestra.run.smithi102.stdout:356 2023-11-13T11:32:07.727 INFO:teuthology.orchestra.run.smithi102.stdout:356.out 2023-11-13T11:32:07.727 INFO:teuthology.orchestra.run.smithi102.stdout:357 2023-11-13T11:32:07.727 INFO:teuthology.orchestra.run.smithi102.stdout:357.out 2023-11-13T11:32:07.727 INFO:teuthology.orchestra.run.smithi102.stdout:358 2023-11-13T11:32:07.727 INFO:teuthology.orchestra.run.smithi102.stdout:358.out 2023-11-13T11:32:07.728 INFO:teuthology.orchestra.run.smithi102.stdout:359 2023-11-13T11:32:07.728 INFO:teuthology.orchestra.run.smithi102.stdout:359.out 2023-11-13T11:32:07.728 INFO:teuthology.orchestra.run.smithi102.stdout:360 2023-11-13T11:32:07.728 INFO:teuthology.orchestra.run.smithi102.stdout:360.out 2023-11-13T11:32:07.728 INFO:teuthology.orchestra.run.smithi102.stdout:361 2023-11-13T11:32:07.729 INFO:teuthology.orchestra.run.smithi102.stdout:361.out 2023-11-13T11:32:07.729 INFO:teuthology.orchestra.run.smithi102.stdout:362 2023-11-13T11:32:07.729 INFO:teuthology.orchestra.run.smithi102.stdout:362.out 2023-11-13T11:32:07.729 INFO:teuthology.orchestra.run.smithi102.stdout:363 2023-11-13T11:32:07.729 INFO:teuthology.orchestra.run.smithi102.stdout:363.out 2023-11-13T11:32:07.730 INFO:teuthology.orchestra.run.smithi102.stdout:364 2023-11-13T11:32:07.730 INFO:teuthology.orchestra.run.smithi102.stdout:364.out 2023-11-13T11:32:07.730 INFO:teuthology.orchestra.run.smithi102.stdout:365 2023-11-13T11:32:07.731 INFO:teuthology.orchestra.run.smithi102.stdout:365.out 2023-11-13T11:32:07.731 INFO:teuthology.orchestra.run.smithi102.stdout:366 2023-11-13T11:32:07.731 INFO:teuthology.orchestra.run.smithi102.stdout:366.out 2023-11-13T11:32:07.731 INFO:teuthology.orchestra.run.smithi102.stdout:367 2023-11-13T11:32:07.731 INFO:teuthology.orchestra.run.smithi102.stdout:367.out 2023-11-13T11:32:07.732 INFO:teuthology.orchestra.run.smithi102.stdout:368 2023-11-13T11:32:07.732 INFO:teuthology.orchestra.run.smithi102.stdout:368.out 2023-11-13T11:32:07.732 INFO:teuthology.orchestra.run.smithi102.stdout:369 2023-11-13T11:32:07.732 INFO:teuthology.orchestra.run.smithi102.stdout:369.out 2023-11-13T11:32:07.732 INFO:teuthology.orchestra.run.smithi102.stdout:370 2023-11-13T11:32:07.733 INFO:teuthology.orchestra.run.smithi102.stdout:370.out 2023-11-13T11:32:07.733 INFO:teuthology.orchestra.run.smithi102.stdout:371 2023-11-13T11:32:07.733 INFO:teuthology.orchestra.run.smithi102.stdout:371.out 2023-11-13T11:32:07.733 INFO:teuthology.orchestra.run.smithi102.stdout:372 2023-11-13T11:32:07.733 INFO:teuthology.orchestra.run.smithi102.stdout:372.out 2023-11-13T11:32:07.734 INFO:teuthology.orchestra.run.smithi102.stdout:373 2023-11-13T11:32:07.734 INFO:teuthology.orchestra.run.smithi102.stdout:373.out 2023-11-13T11:32:07.734 INFO:teuthology.orchestra.run.smithi102.stdout:374 2023-11-13T11:32:07.734 INFO:teuthology.orchestra.run.smithi102.stdout:374.out 2023-11-13T11:32:07.734 INFO:teuthology.orchestra.run.smithi102.stdout:375 2023-11-13T11:32:07.735 INFO:teuthology.orchestra.run.smithi102.stdout:375.out 2023-11-13T11:32:07.735 INFO:teuthology.orchestra.run.smithi102.stdout:376 2023-11-13T11:32:07.735 INFO:teuthology.orchestra.run.smithi102.stdout:376.out 2023-11-13T11:32:07.735 INFO:teuthology.orchestra.run.smithi102.stdout:377 2023-11-13T11:32:07.736 INFO:teuthology.orchestra.run.smithi102.stdout:377.out 2023-11-13T11:32:07.736 INFO:teuthology.orchestra.run.smithi102.stdout:378 2023-11-13T11:32:07.736 INFO:teuthology.orchestra.run.smithi102.stdout:378.out 2023-11-13T11:32:07.736 INFO:teuthology.orchestra.run.smithi102.stdout:379 2023-11-13T11:32:07.736 INFO:teuthology.orchestra.run.smithi102.stdout:379.out 2023-11-13T11:32:07.737 INFO:teuthology.orchestra.run.smithi102.stdout:380 2023-11-13T11:32:07.737 INFO:teuthology.orchestra.run.smithi102.stdout:380.out 2023-11-13T11:32:07.737 INFO:teuthology.orchestra.run.smithi102.stdout:381 2023-11-13T11:32:07.737 INFO:teuthology.orchestra.run.smithi102.stdout:381.out 2023-11-13T11:32:07.737 INFO:teuthology.orchestra.run.smithi102.stdout:382 2023-11-13T11:32:07.738 INFO:teuthology.orchestra.run.smithi102.stdout:382.out 2023-11-13T11:32:07.738 INFO:teuthology.orchestra.run.smithi102.stdout:383 2023-11-13T11:32:07.738 INFO:teuthology.orchestra.run.smithi102.stdout:383.out 2023-11-13T11:32:07.738 INFO:teuthology.orchestra.run.smithi102.stdout:384 2023-11-13T11:32:07.739 INFO:teuthology.orchestra.run.smithi102.stdout:384.out 2023-11-13T11:32:07.739 INFO:teuthology.orchestra.run.smithi102.stdout:385 2023-11-13T11:32:07.739 INFO:teuthology.orchestra.run.smithi102.stdout:385.out 2023-11-13T11:32:07.739 INFO:teuthology.orchestra.run.smithi102.stdout:386 2023-11-13T11:32:07.739 INFO:teuthology.orchestra.run.smithi102.stdout:386.out 2023-11-13T11:32:07.740 INFO:teuthology.orchestra.run.smithi102.stdout:387 2023-11-13T11:32:07.740 INFO:teuthology.orchestra.run.smithi102.stdout:387.out 2023-11-13T11:32:07.740 INFO:teuthology.orchestra.run.smithi102.stdout:388 2023-11-13T11:32:07.740 INFO:teuthology.orchestra.run.smithi102.stdout:388.out 2023-11-13T11:32:07.740 INFO:teuthology.orchestra.run.smithi102.stdout:389 2023-11-13T11:32:07.741 INFO:teuthology.orchestra.run.smithi102.stdout:389.out 2023-11-13T11:32:07.741 INFO:teuthology.orchestra.run.smithi102.stdout:390 2023-11-13T11:32:07.741 INFO:teuthology.orchestra.run.smithi102.stdout:390.out 2023-11-13T11:32:07.741 INFO:teuthology.orchestra.run.smithi102.stdout:391 2023-11-13T11:32:07.741 INFO:teuthology.orchestra.run.smithi102.stdout:391.out 2023-11-13T11:32:07.742 INFO:teuthology.orchestra.run.smithi102.stdout:392 2023-11-13T11:32:07.742 INFO:teuthology.orchestra.run.smithi102.stdout:392.out 2023-11-13T11:32:07.742 INFO:teuthology.orchestra.run.smithi102.stdout:393 2023-11-13T11:32:07.742 INFO:teuthology.orchestra.run.smithi102.stdout:393.out 2023-11-13T11:32:07.743 INFO:teuthology.orchestra.run.smithi102.stdout:394 2023-11-13T11:32:07.743 INFO:teuthology.orchestra.run.smithi102.stdout:394.out 2023-11-13T11:32:07.743 INFO:teuthology.orchestra.run.smithi102.stdout:395 2023-11-13T11:32:07.743 INFO:teuthology.orchestra.run.smithi102.stdout:395.out 2023-11-13T11:32:07.743 INFO:teuthology.orchestra.run.smithi102.stdout:396 2023-11-13T11:32:07.744 INFO:teuthology.orchestra.run.smithi102.stdout:396.out 2023-11-13T11:32:07.744 INFO:teuthology.orchestra.run.smithi102.stdout:397 2023-11-13T11:32:07.744 INFO:teuthology.orchestra.run.smithi102.stdout:397.out 2023-11-13T11:32:07.744 INFO:teuthology.orchestra.run.smithi102.stdout:398 2023-11-13T11:32:07.745 INFO:teuthology.orchestra.run.smithi102.stdout:398.out 2023-11-13T11:32:07.745 INFO:teuthology.orchestra.run.smithi102.stdout:399 2023-11-13T11:32:07.745 INFO:teuthology.orchestra.run.smithi102.stdout:399.out 2023-11-13T11:32:07.745 INFO:teuthology.orchestra.run.smithi102.stdout:400 2023-11-13T11:32:07.746 INFO:teuthology.orchestra.run.smithi102.stdout:400.out 2023-11-13T11:32:07.746 INFO:teuthology.orchestra.run.smithi102.stdout:401 2023-11-13T11:32:07.746 INFO:teuthology.orchestra.run.smithi102.stdout:401.out 2023-11-13T11:32:07.746 INFO:teuthology.orchestra.run.smithi102.stdout:402 2023-11-13T11:32:07.746 INFO:teuthology.orchestra.run.smithi102.stdout:402.out 2023-11-13T11:32:07.747 INFO:teuthology.orchestra.run.smithi102.stdout:403 2023-11-13T11:32:07.747 INFO:teuthology.orchestra.run.smithi102.stdout:403.out 2023-11-13T11:32:07.747 INFO:teuthology.orchestra.run.smithi102.stdout:404 2023-11-13T11:32:07.747 INFO:teuthology.orchestra.run.smithi102.stdout:404.out 2023-11-13T11:32:07.748 INFO:teuthology.orchestra.run.smithi102.stdout:405 2023-11-13T11:32:07.748 INFO:teuthology.orchestra.run.smithi102.stdout:405.out 2023-11-13T11:32:07.748 INFO:teuthology.orchestra.run.smithi102.stdout:406 2023-11-13T11:32:07.748 INFO:teuthology.orchestra.run.smithi102.stdout:406.out 2023-11-13T11:32:07.749 INFO:teuthology.orchestra.run.smithi102.stdout:407 2023-11-13T11:32:07.749 INFO:teuthology.orchestra.run.smithi102.stdout:407.out 2023-11-13T11:32:07.749 INFO:teuthology.orchestra.run.smithi102.stdout:408 2023-11-13T11:32:07.749 INFO:teuthology.orchestra.run.smithi102.stdout:408.out 2023-11-13T11:32:07.750 INFO:teuthology.orchestra.run.smithi102.stdout:409 2023-11-13T11:32:07.750 INFO:teuthology.orchestra.run.smithi102.stdout:409.out 2023-11-13T11:32:07.750 INFO:teuthology.orchestra.run.smithi102.stdout:410 2023-11-13T11:32:07.750 INFO:teuthology.orchestra.run.smithi102.stdout:410.out 2023-11-13T11:32:07.751 INFO:teuthology.orchestra.run.smithi102.stdout:411 2023-11-13T11:32:07.751 INFO:teuthology.orchestra.run.smithi102.stdout:411.out 2023-11-13T11:32:07.751 INFO:teuthology.orchestra.run.smithi102.stdout:412 2023-11-13T11:32:07.751 INFO:teuthology.orchestra.run.smithi102.stdout:412.out 2023-11-13T11:32:07.752 INFO:teuthology.orchestra.run.smithi102.stdout:413 2023-11-13T11:32:07.752 INFO:teuthology.orchestra.run.smithi102.stdout:413.out 2023-11-13T11:32:07.752 INFO:teuthology.orchestra.run.smithi102.stdout:414 2023-11-13T11:32:07.752 INFO:teuthology.orchestra.run.smithi102.stdout:414.out 2023-11-13T11:32:07.752 INFO:teuthology.orchestra.run.smithi102.stdout:415 2023-11-13T11:32:07.753 INFO:teuthology.orchestra.run.smithi102.stdout:415.out 2023-11-13T11:32:07.753 INFO:teuthology.orchestra.run.smithi102.stdout:416 2023-11-13T11:32:07.753 INFO:teuthology.orchestra.run.smithi102.stdout:416.out 2023-11-13T11:32:07.753 INFO:teuthology.orchestra.run.smithi102.stdout:417 2023-11-13T11:32:07.753 INFO:teuthology.orchestra.run.smithi102.stdout:417.out 2023-11-13T11:32:07.754 INFO:teuthology.orchestra.run.smithi102.stdout:418 2023-11-13T11:32:07.754 INFO:teuthology.orchestra.run.smithi102.stdout:418.out 2023-11-13T11:32:07.754 INFO:teuthology.orchestra.run.smithi102.stdout:419 2023-11-13T11:32:07.754 INFO:teuthology.orchestra.run.smithi102.stdout:419.out 2023-11-13T11:32:07.755 INFO:teuthology.orchestra.run.smithi102.stdout:420 2023-11-13T11:32:07.755 INFO:teuthology.orchestra.run.smithi102.stdout:420.out 2023-11-13T11:32:07.755 INFO:teuthology.orchestra.run.smithi102.stdout:421 2023-11-13T11:32:07.755 INFO:teuthology.orchestra.run.smithi102.stdout:421.out 2023-11-13T11:32:07.755 INFO:teuthology.orchestra.run.smithi102.stdout:422 2023-11-13T11:32:07.756 INFO:teuthology.orchestra.run.smithi102.stdout:422.out 2023-11-13T11:32:07.756 INFO:teuthology.orchestra.run.smithi102.stdout:423 2023-11-13T11:32:07.756 INFO:teuthology.orchestra.run.smithi102.stdout:423.out 2023-11-13T11:32:07.756 INFO:teuthology.orchestra.run.smithi102.stdout:424 2023-11-13T11:32:07.757 INFO:teuthology.orchestra.run.smithi102.stdout:424.out 2023-11-13T11:32:07.757 INFO:teuthology.orchestra.run.smithi102.stdout:425 2023-11-13T11:32:07.757 INFO:teuthology.orchestra.run.smithi102.stdout:425.out 2023-11-13T11:32:07.757 INFO:teuthology.orchestra.run.smithi102.stdout:426 2023-11-13T11:32:07.758 INFO:teuthology.orchestra.run.smithi102.stdout:426.out 2023-11-13T11:32:07.758 INFO:teuthology.orchestra.run.smithi102.stdout:427 2023-11-13T11:32:07.758 INFO:teuthology.orchestra.run.smithi102.stdout:427.out 2023-11-13T11:32:07.758 INFO:teuthology.orchestra.run.smithi102.stdout:428 2023-11-13T11:32:07.759 INFO:teuthology.orchestra.run.smithi102.stdout:428.out 2023-11-13T11:32:07.759 INFO:teuthology.orchestra.run.smithi102.stdout:429 2023-11-13T11:32:07.759 INFO:teuthology.orchestra.run.smithi102.stdout:429.out 2023-11-13T11:32:07.759 INFO:teuthology.orchestra.run.smithi102.stdout:430 2023-11-13T11:32:07.760 INFO:teuthology.orchestra.run.smithi102.stdout:430.out 2023-11-13T11:32:07.760 INFO:teuthology.orchestra.run.smithi102.stdout:431 2023-11-13T11:32:07.760 INFO:teuthology.orchestra.run.smithi102.stdout:431.out 2023-11-13T11:32:07.760 INFO:teuthology.orchestra.run.smithi102.stdout:432 2023-11-13T11:32:07.761 INFO:teuthology.orchestra.run.smithi102.stdout:432.out 2023-11-13T11:32:07.761 INFO:teuthology.orchestra.run.smithi102.stdout:433 2023-11-13T11:32:07.761 INFO:teuthology.orchestra.run.smithi102.stdout:433.out 2023-11-13T11:32:07.761 INFO:teuthology.orchestra.run.smithi102.stdout:434 2023-11-13T11:32:07.762 INFO:teuthology.orchestra.run.smithi102.stdout:434.out 2023-11-13T11:32:07.762 INFO:teuthology.orchestra.run.smithi102.stdout:435 2023-11-13T11:32:07.762 INFO:teuthology.orchestra.run.smithi102.stdout:435.out 2023-11-13T11:32:07.762 INFO:teuthology.orchestra.run.smithi102.stdout:436 2023-11-13T11:32:07.762 INFO:teuthology.orchestra.run.smithi102.stdout:436.out 2023-11-13T11:32:07.763 INFO:teuthology.orchestra.run.smithi102.stdout:437 2023-11-13T11:32:07.763 INFO:teuthology.orchestra.run.smithi102.stdout:437.out 2023-11-13T11:32:07.763 INFO:teuthology.orchestra.run.smithi102.stdout:438 2023-11-13T11:32:07.763 INFO:teuthology.orchestra.run.smithi102.stdout:438.out 2023-11-13T11:32:07.764 INFO:teuthology.orchestra.run.smithi102.stdout:439 2023-11-13T11:32:07.764 INFO:teuthology.orchestra.run.smithi102.stdout:439.out 2023-11-13T11:32:07.764 INFO:teuthology.orchestra.run.smithi102.stdout:440 2023-11-13T11:32:07.764 INFO:teuthology.orchestra.run.smithi102.stdout:440.out 2023-11-13T11:32:07.764 INFO:teuthology.orchestra.run.smithi102.stdout:441 2023-11-13T11:32:07.765 INFO:teuthology.orchestra.run.smithi102.stdout:441.out 2023-11-13T11:32:07.765 INFO:teuthology.orchestra.run.smithi102.stdout:442 2023-11-13T11:32:07.765 INFO:teuthology.orchestra.run.smithi102.stdout:442.out 2023-11-13T11:32:07.765 INFO:teuthology.orchestra.run.smithi102.stdout:443 2023-11-13T11:32:07.765 INFO:teuthology.orchestra.run.smithi102.stdout:443.out 2023-11-13T11:32:07.766 INFO:teuthology.orchestra.run.smithi102.stdout:444 2023-11-13T11:32:07.766 INFO:teuthology.orchestra.run.smithi102.stdout:444.out 2023-11-13T11:32:07.766 INFO:teuthology.orchestra.run.smithi102.stdout:445 2023-11-13T11:32:07.766 INFO:teuthology.orchestra.run.smithi102.stdout:445.out 2023-11-13T11:32:07.767 INFO:teuthology.orchestra.run.smithi102.stdout:446 2023-11-13T11:32:07.767 INFO:teuthology.orchestra.run.smithi102.stdout:446.out 2023-11-13T11:32:07.767 INFO:teuthology.orchestra.run.smithi102.stdout:447 2023-11-13T11:32:07.767 INFO:teuthology.orchestra.run.smithi102.stdout:447.out 2023-11-13T11:32:07.767 INFO:teuthology.orchestra.run.smithi102.stdout:448 2023-11-13T11:32:07.768 INFO:teuthology.orchestra.run.smithi102.stdout:448.out 2023-11-13T11:32:07.768 INFO:teuthology.orchestra.run.smithi102.stdout:449 2023-11-13T11:32:07.768 INFO:teuthology.orchestra.run.smithi102.stdout:449.out 2023-11-13T11:32:07.768 INFO:teuthology.orchestra.run.smithi102.stdout:450 2023-11-13T11:32:07.769 INFO:teuthology.orchestra.run.smithi102.stdout:450.out 2023-11-13T11:32:07.769 INFO:teuthology.orchestra.run.smithi102.stdout:451 2023-11-13T11:32:07.769 INFO:teuthology.orchestra.run.smithi102.stdout:451.out 2023-11-13T11:32:07.769 INFO:teuthology.orchestra.run.smithi102.stdout:452 2023-11-13T11:32:07.769 INFO:teuthology.orchestra.run.smithi102.stdout:452.out 2023-11-13T11:32:07.770 INFO:teuthology.orchestra.run.smithi102.stdout:453 2023-11-13T11:32:07.770 INFO:teuthology.orchestra.run.smithi102.stdout:453.out 2023-11-13T11:32:07.770 INFO:teuthology.orchestra.run.smithi102.stdout:454 2023-11-13T11:32:07.770 INFO:teuthology.orchestra.run.smithi102.stdout:454.out 2023-11-13T11:32:07.771 INFO:teuthology.orchestra.run.smithi102.stdout:455 2023-11-13T11:32:07.771 INFO:teuthology.orchestra.run.smithi102.stdout:455.out 2023-11-13T11:32:07.771 INFO:teuthology.orchestra.run.smithi102.stdout:456 2023-11-13T11:32:07.771 INFO:teuthology.orchestra.run.smithi102.stdout:456.out 2023-11-13T11:32:07.771 INFO:teuthology.orchestra.run.smithi102.stdout:457 2023-11-13T11:32:07.772 INFO:teuthology.orchestra.run.smithi102.stdout:457.out 2023-11-13T11:32:07.772 INFO:teuthology.orchestra.run.smithi102.stdout:458 2023-11-13T11:32:07.772 INFO:teuthology.orchestra.run.smithi102.stdout:458.out 2023-11-13T11:32:07.772 INFO:teuthology.orchestra.run.smithi102.stdout:459 2023-11-13T11:32:07.772 INFO:teuthology.orchestra.run.smithi102.stdout:459.out 2023-11-13T11:32:07.773 INFO:teuthology.orchestra.run.smithi102.stdout:460 2023-11-13T11:32:07.773 INFO:teuthology.orchestra.run.smithi102.stdout:460.out 2023-11-13T11:32:07.773 INFO:teuthology.orchestra.run.smithi102.stdout:461 2023-11-13T11:32:07.773 INFO:teuthology.orchestra.run.smithi102.stdout:461.out 2023-11-13T11:32:07.774 INFO:teuthology.orchestra.run.smithi102.stdout:462 2023-11-13T11:32:07.774 INFO:teuthology.orchestra.run.smithi102.stdout:462.out 2023-11-13T11:32:07.774 INFO:teuthology.orchestra.run.smithi102.stdout:463 2023-11-13T11:32:07.774 INFO:teuthology.orchestra.run.smithi102.stdout:463.out 2023-11-13T11:32:07.775 INFO:teuthology.orchestra.run.smithi102.stdout:464 2023-11-13T11:32:07.775 INFO:teuthology.orchestra.run.smithi102.stdout:464.out 2023-11-13T11:32:07.775 INFO:teuthology.orchestra.run.smithi102.stdout:465 2023-11-13T11:32:07.775 INFO:teuthology.orchestra.run.smithi102.stdout:465.out 2023-11-13T11:32:07.776 INFO:teuthology.orchestra.run.smithi102.stdout:466 2023-11-13T11:32:07.776 INFO:teuthology.orchestra.run.smithi102.stdout:466.out 2023-11-13T11:32:07.776 INFO:teuthology.orchestra.run.smithi102.stdout:467 2023-11-13T11:32:07.776 INFO:teuthology.orchestra.run.smithi102.stdout:467.out 2023-11-13T11:32:07.776 INFO:teuthology.orchestra.run.smithi102.stdout:468 2023-11-13T11:32:07.777 INFO:teuthology.orchestra.run.smithi102.stdout:468.out 2023-11-13T11:32:07.777 INFO:teuthology.orchestra.run.smithi102.stdout:469 2023-11-13T11:32:07.777 INFO:teuthology.orchestra.run.smithi102.stdout:469.out 2023-11-13T11:32:07.777 INFO:teuthology.orchestra.run.smithi102.stdout:470 2023-11-13T11:32:07.778 INFO:teuthology.orchestra.run.smithi102.stdout:470.out 2023-11-13T11:32:07.778 INFO:teuthology.orchestra.run.smithi102.stdout:471 2023-11-13T11:32:07.778 INFO:teuthology.orchestra.run.smithi102.stdout:471.out 2023-11-13T11:32:07.778 INFO:teuthology.orchestra.run.smithi102.stdout:472 2023-11-13T11:32:07.778 INFO:teuthology.orchestra.run.smithi102.stdout:472.out 2023-11-13T11:32:07.779 INFO:teuthology.orchestra.run.smithi102.stdout:473 2023-11-13T11:32:07.779 INFO:teuthology.orchestra.run.smithi102.stdout:473.out 2023-11-13T11:32:07.779 INFO:teuthology.orchestra.run.smithi102.stdout:474 2023-11-13T11:32:07.779 INFO:teuthology.orchestra.run.smithi102.stdout:474.out 2023-11-13T11:32:07.779 INFO:teuthology.orchestra.run.smithi102.stdout:475 2023-11-13T11:32:07.780 INFO:teuthology.orchestra.run.smithi102.stdout:475.out 2023-11-13T11:32:07.780 INFO:teuthology.orchestra.run.smithi102.stdout:476 2023-11-13T11:32:07.780 INFO:teuthology.orchestra.run.smithi102.stdout:476.out 2023-11-13T11:32:07.780 INFO:teuthology.orchestra.run.smithi102.stdout:477 2023-11-13T11:32:07.780 INFO:teuthology.orchestra.run.smithi102.stdout:477.out 2023-11-13T11:32:07.781 INFO:teuthology.orchestra.run.smithi102.stdout:478 2023-11-13T11:32:07.781 INFO:teuthology.orchestra.run.smithi102.stdout:478.out 2023-11-13T11:32:07.781 INFO:teuthology.orchestra.run.smithi102.stdout:479 2023-11-13T11:32:07.781 INFO:teuthology.orchestra.run.smithi102.stdout:479.out 2023-11-13T11:32:07.782 INFO:teuthology.orchestra.run.smithi102.stdout:480 2023-11-13T11:32:07.782 INFO:teuthology.orchestra.run.smithi102.stdout:480.out 2023-11-13T11:32:07.782 INFO:teuthology.orchestra.run.smithi102.stdout:481 2023-11-13T11:32:07.782 INFO:teuthology.orchestra.run.smithi102.stdout:481.out 2023-11-13T11:32:07.782 INFO:teuthology.orchestra.run.smithi102.stdout:482 2023-11-13T11:32:07.783 INFO:teuthology.orchestra.run.smithi102.stdout:482.out 2023-11-13T11:32:07.783 INFO:teuthology.orchestra.run.smithi102.stdout:483 2023-11-13T11:32:07.783 INFO:teuthology.orchestra.run.smithi102.stdout:483.out 2023-11-13T11:32:07.783 INFO:teuthology.orchestra.run.smithi102.stdout:484 2023-11-13T11:32:07.783 INFO:teuthology.orchestra.run.smithi102.stdout:484.out 2023-11-13T11:32:07.784 INFO:teuthology.orchestra.run.smithi102.stdout:485 2023-11-13T11:32:07.784 INFO:teuthology.orchestra.run.smithi102.stdout:485.out 2023-11-13T11:32:07.784 INFO:teuthology.orchestra.run.smithi102.stdout:486 2023-11-13T11:32:07.784 INFO:teuthology.orchestra.run.smithi102.stdout:486.out 2023-11-13T11:32:07.785 INFO:teuthology.orchestra.run.smithi102.stdout:487 2023-11-13T11:32:07.785 INFO:teuthology.orchestra.run.smithi102.stdout:487.out 2023-11-13T11:32:07.785 INFO:teuthology.orchestra.run.smithi102.stdout:488 2023-11-13T11:32:07.785 INFO:teuthology.orchestra.run.smithi102.stdout:488.out 2023-11-13T11:32:07.785 INFO:teuthology.orchestra.run.smithi102.stdout:489 2023-11-13T11:32:07.786 INFO:teuthology.orchestra.run.smithi102.stdout:489.out 2023-11-13T11:32:07.786 INFO:teuthology.orchestra.run.smithi102.stdout:490 2023-11-13T11:32:07.786 INFO:teuthology.orchestra.run.smithi102.stdout:490.out 2023-11-13T11:32:07.786 INFO:teuthology.orchestra.run.smithi102.stdout:491 2023-11-13T11:32:07.786 INFO:teuthology.orchestra.run.smithi102.stdout:491.out 2023-11-13T11:32:07.787 INFO:teuthology.orchestra.run.smithi102.stdout:492 2023-11-13T11:32:07.787 INFO:teuthology.orchestra.run.smithi102.stdout:492.out 2023-11-13T11:32:07.787 INFO:teuthology.orchestra.run.smithi102.stdout:493 2023-11-13T11:32:07.787 INFO:teuthology.orchestra.run.smithi102.stdout:493.out 2023-11-13T11:32:07.788 INFO:teuthology.orchestra.run.smithi102.stdout:494 2023-11-13T11:32:07.789 INFO:teuthology.orchestra.run.smithi102.stdout:494.out 2023-11-13T11:32:07.790 INFO:teuthology.orchestra.run.smithi102.stdout:495 2023-11-13T11:32:07.790 INFO:teuthology.orchestra.run.smithi102.stdout:495.out 2023-11-13T11:32:07.790 INFO:teuthology.orchestra.run.smithi102.stdout:496 2023-11-13T11:32:07.790 INFO:teuthology.orchestra.run.smithi102.stdout:496.out 2023-11-13T11:32:07.791 INFO:teuthology.orchestra.run.smithi102.stdout:497 2023-11-13T11:32:07.791 INFO:teuthology.orchestra.run.smithi102.stdout:497.out 2023-11-13T11:32:07.791 INFO:teuthology.orchestra.run.smithi102.stdout:498 2023-11-13T11:32:07.791 INFO:teuthology.orchestra.run.smithi102.stdout:498.out 2023-11-13T11:32:07.792 INFO:teuthology.orchestra.run.smithi102.stdout:499 2023-11-13T11:32:07.792 INFO:teuthology.orchestra.run.smithi102.stdout:499.out 2023-11-13T11:32:07.792 INFO:teuthology.orchestra.run.smithi102.stdout:500 2023-11-13T11:32:07.792 INFO:teuthology.orchestra.run.smithi102.stdout:500.out 2023-11-13T11:32:07.792 INFO:teuthology.orchestra.run.smithi102.stdout:501 2023-11-13T11:32:07.793 INFO:teuthology.orchestra.run.smithi102.stdout:501.out 2023-11-13T11:32:07.793 INFO:teuthology.orchestra.run.smithi102.stdout:502 2023-11-13T11:32:07.793 INFO:teuthology.orchestra.run.smithi102.stdout:502.out 2023-11-13T11:32:07.793 INFO:teuthology.orchestra.run.smithi102.stdout:503 2023-11-13T11:32:07.794 INFO:teuthology.orchestra.run.smithi102.stdout:503.out 2023-11-13T11:32:07.794 INFO:teuthology.orchestra.run.smithi102.stdout:504 2023-11-13T11:32:07.794 INFO:teuthology.orchestra.run.smithi102.stdout:504.out 2023-11-13T11:32:07.794 INFO:teuthology.orchestra.run.smithi102.stdout:505 2023-11-13T11:32:07.794 INFO:teuthology.orchestra.run.smithi102.stdout:505.out 2023-11-13T11:32:07.795 INFO:teuthology.orchestra.run.smithi102.stdout:506 2023-11-13T11:32:07.795 INFO:teuthology.orchestra.run.smithi102.stdout:506.out 2023-11-13T11:32:07.795 INFO:teuthology.orchestra.run.smithi102.stdout:507 2023-11-13T11:32:07.795 INFO:teuthology.orchestra.run.smithi102.stdout:507.out 2023-11-13T11:32:07.796 INFO:teuthology.orchestra.run.smithi102.stdout:508 2023-11-13T11:32:07.796 INFO:teuthology.orchestra.run.smithi102.stdout:508.out 2023-11-13T11:32:07.796 INFO:teuthology.orchestra.run.smithi102.stdout:509 2023-11-13T11:32:07.796 INFO:teuthology.orchestra.run.smithi102.stdout:509.out 2023-11-13T11:32:07.796 INFO:teuthology.orchestra.run.smithi102.stdout:510 2023-11-13T11:32:07.797 INFO:teuthology.orchestra.run.smithi102.stdout:510.out 2023-11-13T11:32:07.797 INFO:teuthology.orchestra.run.smithi102.stdout:511 2023-11-13T11:32:07.798 INFO:teuthology.orchestra.run.smithi102.stdout:511.out 2023-11-13T11:32:07.798 INFO:teuthology.orchestra.run.smithi102.stdout:512 2023-11-13T11:32:07.798 INFO:teuthology.orchestra.run.smithi102.stdout:512.out 2023-11-13T11:32:07.798 INFO:teuthology.orchestra.run.smithi102.stdout:513 2023-11-13T11:32:07.799 INFO:teuthology.orchestra.run.smithi102.stdout:513.out 2023-11-13T11:32:07.799 INFO:teuthology.orchestra.run.smithi102.stdout:514 2023-11-13T11:32:07.799 INFO:teuthology.orchestra.run.smithi102.stdout:514.out 2023-11-13T11:32:07.799 INFO:teuthology.orchestra.run.smithi102.stdout:515 2023-11-13T11:32:07.800 INFO:teuthology.orchestra.run.smithi102.stdout:515.out 2023-11-13T11:32:07.800 INFO:teuthology.orchestra.run.smithi102.stdout:516 2023-11-13T11:32:07.800 INFO:teuthology.orchestra.run.smithi102.stdout:516.out 2023-11-13T11:32:07.800 INFO:teuthology.orchestra.run.smithi102.stdout:517 2023-11-13T11:32:07.800 INFO:teuthology.orchestra.run.smithi102.stdout:517.out 2023-11-13T11:32:07.801 INFO:teuthology.orchestra.run.smithi102.stdout:518 2023-11-13T11:32:07.801 INFO:teuthology.orchestra.run.smithi102.stdout:518.out 2023-11-13T11:32:07.801 INFO:teuthology.orchestra.run.smithi102.stdout:519 2023-11-13T11:32:07.801 INFO:teuthology.orchestra.run.smithi102.stdout:519.out 2023-11-13T11:32:07.802 INFO:teuthology.orchestra.run.smithi102.stdout:520 2023-11-13T11:32:07.802 INFO:teuthology.orchestra.run.smithi102.stdout:520.out 2023-11-13T11:32:07.802 INFO:teuthology.orchestra.run.smithi102.stdout:521 2023-11-13T11:32:07.802 INFO:teuthology.orchestra.run.smithi102.stdout:521.out 2023-11-13T11:32:07.803 INFO:teuthology.orchestra.run.smithi102.stdout:522 2023-11-13T11:32:07.803 INFO:teuthology.orchestra.run.smithi102.stdout:522.out 2023-11-13T11:32:07.803 INFO:teuthology.orchestra.run.smithi102.stdout:523 2023-11-13T11:32:07.803 INFO:teuthology.orchestra.run.smithi102.stdout:523.out 2023-11-13T11:32:07.803 INFO:teuthology.orchestra.run.smithi102.stdout:524 2023-11-13T11:32:07.804 INFO:teuthology.orchestra.run.smithi102.stdout:524.out 2023-11-13T11:32:07.804 INFO:teuthology.orchestra.run.smithi102.stdout:525 2023-11-13T11:32:07.804 INFO:teuthology.orchestra.run.smithi102.stdout:525.out 2023-11-13T11:32:07.804 INFO:teuthology.orchestra.run.smithi102.stdout:526 2023-11-13T11:32:07.805 INFO:teuthology.orchestra.run.smithi102.stdout:526.out 2023-11-13T11:32:07.805 INFO:teuthology.orchestra.run.smithi102.stdout:527 2023-11-13T11:32:07.805 INFO:teuthology.orchestra.run.smithi102.stdout:527.out 2023-11-13T11:32:07.805 INFO:teuthology.orchestra.run.smithi102.stdout:528 2023-11-13T11:32:07.805 INFO:teuthology.orchestra.run.smithi102.stdout:528.out 2023-11-13T11:32:07.806 INFO:teuthology.orchestra.run.smithi102.stdout:529 2023-11-13T11:32:07.806 INFO:teuthology.orchestra.run.smithi102.stdout:529.out 2023-11-13T11:32:07.806 INFO:teuthology.orchestra.run.smithi102.stdout:530 2023-11-13T11:32:07.806 INFO:teuthology.orchestra.run.smithi102.stdout:530.out 2023-11-13T11:32:07.807 INFO:teuthology.orchestra.run.smithi102.stdout:531 2023-11-13T11:32:07.807 INFO:teuthology.orchestra.run.smithi102.stdout:531.out 2023-11-13T11:32:07.807 INFO:teuthology.orchestra.run.smithi102.stdout:532 2023-11-13T11:32:07.807 INFO:teuthology.orchestra.run.smithi102.stdout:532.out 2023-11-13T11:32:07.808 INFO:teuthology.orchestra.run.smithi102.stdout:533 2023-11-13T11:32:07.808 INFO:teuthology.orchestra.run.smithi102.stdout:533.out 2023-11-13T11:32:07.808 INFO:teuthology.orchestra.run.smithi102.stdout:534 2023-11-13T11:32:07.808 INFO:teuthology.orchestra.run.smithi102.stdout:534.out 2023-11-13T11:32:07.809 INFO:teuthology.orchestra.run.smithi102.stdout:535 2023-11-13T11:32:07.809 INFO:teuthology.orchestra.run.smithi102.stdout:535.out 2023-11-13T11:32:07.809 INFO:teuthology.orchestra.run.smithi102.stdout:536 2023-11-13T11:32:07.809 INFO:teuthology.orchestra.run.smithi102.stdout:536.out 2023-11-13T11:32:07.810 INFO:teuthology.orchestra.run.smithi102.stdout:537 2023-11-13T11:32:07.810 INFO:teuthology.orchestra.run.smithi102.stdout:537.out 2023-11-13T11:32:07.810 INFO:teuthology.orchestra.run.smithi102.stdout:538 2023-11-13T11:32:07.810 INFO:teuthology.orchestra.run.smithi102.stdout:538.out 2023-11-13T11:32:07.810 INFO:teuthology.orchestra.run.smithi102.stdout:539 2023-11-13T11:32:07.811 INFO:teuthology.orchestra.run.smithi102.stdout:539.out 2023-11-13T11:32:07.811 INFO:teuthology.orchestra.run.smithi102.stdout:540 2023-11-13T11:32:07.811 INFO:teuthology.orchestra.run.smithi102.stdout:540.out 2023-11-13T11:32:07.811 INFO:teuthology.orchestra.run.smithi102.stdout:541 2023-11-13T11:32:07.812 INFO:teuthology.orchestra.run.smithi102.stdout:541.out 2023-11-13T11:32:07.812 INFO:teuthology.orchestra.run.smithi102.stdout:542 2023-11-13T11:32:07.812 INFO:teuthology.orchestra.run.smithi102.stdout:542.out 2023-11-13T11:32:07.812 INFO:teuthology.orchestra.run.smithi102.stdout:543 2023-11-13T11:32:07.813 INFO:teuthology.orchestra.run.smithi102.stdout:543.out 2023-11-13T11:32:07.813 INFO:teuthology.orchestra.run.smithi102.stdout:544 2023-11-13T11:32:07.813 INFO:teuthology.orchestra.run.smithi102.stdout:544.out 2023-11-13T11:32:07.813 INFO:teuthology.orchestra.run.smithi102.stdout:545 2023-11-13T11:32:07.813 INFO:teuthology.orchestra.run.smithi102.stdout:545.out 2023-11-13T11:32:07.814 INFO:teuthology.orchestra.run.smithi102.stdout:546 2023-11-13T11:32:07.814 INFO:teuthology.orchestra.run.smithi102.stdout:546.out 2023-11-13T11:32:07.814 INFO:teuthology.orchestra.run.smithi102.stdout:547 2023-11-13T11:32:07.814 INFO:teuthology.orchestra.run.smithi102.stdout:547.out 2023-11-13T11:32:07.815 INFO:teuthology.orchestra.run.smithi102.stdout:548 2023-11-13T11:32:07.815 INFO:teuthology.orchestra.run.smithi102.stdout:548.out 2023-11-13T11:32:07.815 INFO:teuthology.orchestra.run.smithi102.stdout:549 2023-11-13T11:32:07.815 INFO:teuthology.orchestra.run.smithi102.stdout:549.out 2023-11-13T11:32:07.815 INFO:teuthology.orchestra.run.smithi102.stdout:550 2023-11-13T11:32:07.816 INFO:teuthology.orchestra.run.smithi102.stdout:550.out 2023-11-13T11:32:07.816 INFO:teuthology.orchestra.run.smithi102.stdout:551 2023-11-13T11:32:07.816 INFO:teuthology.orchestra.run.smithi102.stdout:551.out 2023-11-13T11:32:07.816 INFO:teuthology.orchestra.run.smithi102.stdout:552 2023-11-13T11:32:07.816 INFO:teuthology.orchestra.run.smithi102.stdout:552.out 2023-11-13T11:32:07.817 INFO:teuthology.orchestra.run.smithi102.stdout:553 2023-11-13T11:32:07.817 INFO:teuthology.orchestra.run.smithi102.stdout:553.out 2023-11-13T11:32:07.817 INFO:teuthology.orchestra.run.smithi102.stdout:554 2023-11-13T11:32:07.817 INFO:teuthology.orchestra.run.smithi102.stdout:554.out 2023-11-13T11:32:07.817 INFO:teuthology.orchestra.run.smithi102.stdout:555 2023-11-13T11:32:07.818 INFO:teuthology.orchestra.run.smithi102.stdout:555.out 2023-11-13T11:32:07.818 INFO:teuthology.orchestra.run.smithi102.stdout:556 2023-11-13T11:32:07.818 INFO:teuthology.orchestra.run.smithi102.stdout:556.out 2023-11-13T11:32:07.818 INFO:teuthology.orchestra.run.smithi102.stdout:557 2023-11-13T11:32:07.818 INFO:teuthology.orchestra.run.smithi102.stdout:557.out 2023-11-13T11:32:07.819 INFO:teuthology.orchestra.run.smithi102.stdout:558 2023-11-13T11:32:07.819 INFO:teuthology.orchestra.run.smithi102.stdout:558.out 2023-11-13T11:32:07.819 INFO:teuthology.orchestra.run.smithi102.stdout:559 2023-11-13T11:32:07.819 INFO:teuthology.orchestra.run.smithi102.stdout:559.out 2023-11-13T11:32:07.820 INFO:teuthology.orchestra.run.smithi102.stdout:560 2023-11-13T11:32:07.820 INFO:teuthology.orchestra.run.smithi102.stdout:560.out 2023-11-13T11:32:07.820 INFO:teuthology.orchestra.run.smithi102.stdout:561 2023-11-13T11:32:07.820 INFO:teuthology.orchestra.run.smithi102.stdout:561.out 2023-11-13T11:32:07.820 INFO:teuthology.orchestra.run.smithi102.stdout:562 2023-11-13T11:32:07.821 INFO:teuthology.orchestra.run.smithi102.stdout:562.out 2023-11-13T11:32:07.821 INFO:teuthology.orchestra.run.smithi102.stdout:563 2023-11-13T11:32:07.821 INFO:teuthology.orchestra.run.smithi102.stdout:563.out 2023-11-13T11:32:07.821 INFO:teuthology.orchestra.run.smithi102.stdout:564 2023-11-13T11:32:07.821 INFO:teuthology.orchestra.run.smithi102.stdout:564.out 2023-11-13T11:32:07.822 INFO:teuthology.orchestra.run.smithi102.stdout:565 2023-11-13T11:32:07.822 INFO:teuthology.orchestra.run.smithi102.stdout:565.out 2023-11-13T11:32:07.822 INFO:teuthology.orchestra.run.smithi102.stdout:566 2023-11-13T11:32:07.822 INFO:teuthology.orchestra.run.smithi102.stdout:566.out 2023-11-13T11:32:07.822 INFO:teuthology.orchestra.run.smithi102.stdout:567 2023-11-13T11:32:07.823 INFO:teuthology.orchestra.run.smithi102.stdout:567.out 2023-11-13T11:32:07.823 INFO:teuthology.orchestra.run.smithi102.stdout:568 2023-11-13T11:32:07.823 INFO:teuthology.orchestra.run.smithi102.stdout:568.out 2023-11-13T11:32:07.823 INFO:teuthology.orchestra.run.smithi102.stdout:569 2023-11-13T11:32:07.823 INFO:teuthology.orchestra.run.smithi102.stdout:569.out 2023-11-13T11:32:07.824 INFO:teuthology.orchestra.run.smithi102.stdout:570 2023-11-13T11:32:07.824 INFO:teuthology.orchestra.run.smithi102.stdout:570.out 2023-11-13T11:32:07.824 INFO:teuthology.orchestra.run.smithi102.stdout:571 2023-11-13T11:32:07.824 INFO:teuthology.orchestra.run.smithi102.stdout:571.out 2023-11-13T11:32:07.824 INFO:teuthology.orchestra.run.smithi102.stdout:572 2023-11-13T11:32:07.825 INFO:teuthology.orchestra.run.smithi102.stdout:572.out 2023-11-13T11:32:07.825 INFO:teuthology.orchestra.run.smithi102.stdout:573 2023-11-13T11:32:07.825 INFO:teuthology.orchestra.run.smithi102.stdout:573.out 2023-11-13T11:32:07.825 INFO:teuthology.orchestra.run.smithi102.stdout:574 2023-11-13T11:32:07.826 INFO:teuthology.orchestra.run.smithi102.stdout:574.out 2023-11-13T11:32:07.826 INFO:teuthology.orchestra.run.smithi102.stdout:575 2023-11-13T11:32:07.826 INFO:teuthology.orchestra.run.smithi102.stdout:575.out 2023-11-13T11:32:07.826 INFO:teuthology.orchestra.run.smithi102.stdout:576 2023-11-13T11:32:07.826 INFO:teuthology.orchestra.run.smithi102.stdout:576.out 2023-11-13T11:32:07.827 INFO:teuthology.orchestra.run.smithi102.stdout:577 2023-11-13T11:32:07.827 INFO:teuthology.orchestra.run.smithi102.stdout:577.out 2023-11-13T11:32:07.827 INFO:teuthology.orchestra.run.smithi102.stdout:578 2023-11-13T11:32:07.827 INFO:teuthology.orchestra.run.smithi102.stdout:578.out 2023-11-13T11:32:07.828 INFO:teuthology.orchestra.run.smithi102.stdout:579 2023-11-13T11:32:07.828 INFO:teuthology.orchestra.run.smithi102.stdout:579.out 2023-11-13T11:32:07.828 INFO:teuthology.orchestra.run.smithi102.stdout:580 2023-11-13T11:32:07.828 INFO:teuthology.orchestra.run.smithi102.stdout:580.out 2023-11-13T11:32:07.828 INFO:teuthology.orchestra.run.smithi102.stdout:581 2023-11-13T11:32:07.829 INFO:teuthology.orchestra.run.smithi102.stdout:581.out 2023-11-13T11:32:07.829 INFO:teuthology.orchestra.run.smithi102.stdout:582 2023-11-13T11:32:07.829 INFO:teuthology.orchestra.run.smithi102.stdout:582.out 2023-11-13T11:32:07.829 INFO:teuthology.orchestra.run.smithi102.stdout:583 2023-11-13T11:32:07.829 INFO:teuthology.orchestra.run.smithi102.stdout:583.out 2023-11-13T11:32:07.830 INFO:teuthology.orchestra.run.smithi102.stdout:584 2023-11-13T11:32:07.830 INFO:teuthology.orchestra.run.smithi102.stdout:584.out 2023-11-13T11:32:07.830 INFO:teuthology.orchestra.run.smithi102.stdout:585 2023-11-13T11:32:07.830 INFO:teuthology.orchestra.run.smithi102.stdout:585.out 2023-11-13T11:32:07.831 INFO:teuthology.orchestra.run.smithi102.stdout:586 2023-11-13T11:32:07.831 INFO:teuthology.orchestra.run.smithi102.stdout:586.out 2023-11-13T11:32:07.831 INFO:teuthology.orchestra.run.smithi102.stdout:587 2023-11-13T11:32:07.831 INFO:teuthology.orchestra.run.smithi102.stdout:587.out 2023-11-13T11:32:07.832 INFO:teuthology.orchestra.run.smithi102.stdout:588 2023-11-13T11:32:07.832 INFO:teuthology.orchestra.run.smithi102.stdout:588.out 2023-11-13T11:32:07.832 INFO:teuthology.orchestra.run.smithi102.stdout:589 2023-11-13T11:32:07.832 INFO:teuthology.orchestra.run.smithi102.stdout:589.out 2023-11-13T11:32:07.833 INFO:teuthology.orchestra.run.smithi102.stdout:590 2023-11-13T11:32:07.833 INFO:teuthology.orchestra.run.smithi102.stdout:590.out 2023-11-13T11:32:07.833 INFO:teuthology.orchestra.run.smithi102.stdout:591 2023-11-13T11:32:07.833 INFO:teuthology.orchestra.run.smithi102.stdout:591.out 2023-11-13T11:32:07.834 INFO:teuthology.orchestra.run.smithi102.stdout:592 2023-11-13T11:32:07.834 INFO:teuthology.orchestra.run.smithi102.stdout:592.out 2023-11-13T11:32:07.834 INFO:teuthology.orchestra.run.smithi102.stdout:593 2023-11-13T11:32:07.834 INFO:teuthology.orchestra.run.smithi102.stdout:593.out 2023-11-13T11:32:07.835 INFO:teuthology.orchestra.run.smithi102.stdout:594 2023-11-13T11:32:07.835 INFO:teuthology.orchestra.run.smithi102.stdout:594.out 2023-11-13T11:32:07.835 INFO:teuthology.orchestra.run.smithi102.stdout:595 2023-11-13T11:32:07.835 INFO:teuthology.orchestra.run.smithi102.stdout:595.out 2023-11-13T11:32:07.835 INFO:teuthology.orchestra.run.smithi102.stdout:596 2023-11-13T11:32:07.836 INFO:teuthology.orchestra.run.smithi102.stdout:596.out 2023-11-13T11:32:07.836 INFO:teuthology.orchestra.run.smithi102.stdout:597 2023-11-13T11:32:07.836 INFO:teuthology.orchestra.run.smithi102.stdout:597.out 2023-11-13T11:32:07.836 INFO:teuthology.orchestra.run.smithi102.stdout:598 2023-11-13T11:32:07.837 INFO:teuthology.orchestra.run.smithi102.stdout:598.out 2023-11-13T11:32:07.837 INFO:teuthology.orchestra.run.smithi102.stdout:599 2023-11-13T11:32:07.837 INFO:teuthology.orchestra.run.smithi102.stdout:599.out 2023-11-13T11:32:07.837 INFO:teuthology.orchestra.run.smithi102.stdout:600 2023-11-13T11:32:07.838 INFO:teuthology.orchestra.run.smithi102.stdout:600.out 2023-11-13T11:32:07.838 INFO:teuthology.orchestra.run.smithi102.stdout:601 2023-11-13T11:32:07.838 INFO:teuthology.orchestra.run.smithi102.stdout:601.out 2023-11-13T11:32:07.838 INFO:teuthology.orchestra.run.smithi102.stdout:602 2023-11-13T11:32:07.838 INFO:teuthology.orchestra.run.smithi102.stdout:602.out 2023-11-13T11:32:07.839 INFO:teuthology.orchestra.run.smithi102.stdout:603 2023-11-13T11:32:07.839 INFO:teuthology.orchestra.run.smithi102.stdout:603.out 2023-11-13T11:32:07.839 INFO:teuthology.orchestra.run.smithi102.stdout:604 2023-11-13T11:32:07.839 INFO:teuthology.orchestra.run.smithi102.stdout:604.out 2023-11-13T11:32:07.840 INFO:teuthology.orchestra.run.smithi102.stdout:605 2023-11-13T11:32:07.840 INFO:teuthology.orchestra.run.smithi102.stdout:605.out 2023-11-13T11:32:07.840 INFO:teuthology.orchestra.run.smithi102.stdout:606 2023-11-13T11:32:07.840 INFO:teuthology.orchestra.run.smithi102.stdout:606.out 2023-11-13T11:32:07.841 INFO:teuthology.orchestra.run.smithi102.stdout:607 2023-11-13T11:32:07.841 INFO:teuthology.orchestra.run.smithi102.stdout:607.out 2023-11-13T11:32:07.841 INFO:teuthology.orchestra.run.smithi102.stdout:608 2023-11-13T11:32:07.841 INFO:teuthology.orchestra.run.smithi102.stdout:608.out 2023-11-13T11:32:07.842 INFO:teuthology.orchestra.run.smithi102.stdout:609 2023-11-13T11:32:07.842 INFO:teuthology.orchestra.run.smithi102.stdout:609.out 2023-11-13T11:32:07.842 INFO:teuthology.orchestra.run.smithi102.stdout:610 2023-11-13T11:32:07.842 INFO:teuthology.orchestra.run.smithi102.stdout:610.out 2023-11-13T11:32:07.842 INFO:teuthology.orchestra.run.smithi102.stdout:611 2023-11-13T11:32:07.843 INFO:teuthology.orchestra.run.smithi102.stdout:611.out 2023-11-13T11:32:07.843 INFO:teuthology.orchestra.run.smithi102.stdout:612 2023-11-13T11:32:07.843 INFO:teuthology.orchestra.run.smithi102.stdout:612.out 2023-11-13T11:32:07.843 INFO:teuthology.orchestra.run.smithi102.stdout:613 2023-11-13T11:32:07.843 INFO:teuthology.orchestra.run.smithi102.stdout:613.out 2023-11-13T11:32:07.844 INFO:teuthology.orchestra.run.smithi102.stdout:614 2023-11-13T11:32:07.844 INFO:teuthology.orchestra.run.smithi102.stdout:614.out 2023-11-13T11:32:07.844 INFO:teuthology.orchestra.run.smithi102.stdout:615 2023-11-13T11:32:07.844 INFO:teuthology.orchestra.run.smithi102.stdout:615.out 2023-11-13T11:32:07.845 INFO:teuthology.orchestra.run.smithi102.stdout:616 2023-11-13T11:32:07.845 INFO:teuthology.orchestra.run.smithi102.stdout:616.out 2023-11-13T11:32:07.845 INFO:teuthology.orchestra.run.smithi102.stdout:617 2023-11-13T11:32:07.845 INFO:teuthology.orchestra.run.smithi102.stdout:617.out 2023-11-13T11:32:07.845 INFO:teuthology.orchestra.run.smithi102.stdout:618 2023-11-13T11:32:07.846 INFO:teuthology.orchestra.run.smithi102.stdout:618.out 2023-11-13T11:32:07.846 INFO:teuthology.orchestra.run.smithi102.stdout:619 2023-11-13T11:32:07.846 INFO:teuthology.orchestra.run.smithi102.stdout:619.out 2023-11-13T11:32:07.846 INFO:teuthology.orchestra.run.smithi102.stdout:620 2023-11-13T11:32:07.847 INFO:teuthology.orchestra.run.smithi102.stdout:620.out 2023-11-13T11:32:07.847 INFO:teuthology.orchestra.run.smithi102.stdout:621 2023-11-13T11:32:07.847 INFO:teuthology.orchestra.run.smithi102.stdout:621.out 2023-11-13T11:32:07.847 INFO:teuthology.orchestra.run.smithi102.stdout:622 2023-11-13T11:32:07.847 INFO:teuthology.orchestra.run.smithi102.stdout:622.out 2023-11-13T11:32:07.848 INFO:teuthology.orchestra.run.smithi102.stdout:623 2023-11-13T11:32:07.848 INFO:teuthology.orchestra.run.smithi102.stdout:623.out 2023-11-13T11:32:07.848 INFO:teuthology.orchestra.run.smithi102.stdout:624 2023-11-13T11:32:07.848 INFO:teuthology.orchestra.run.smithi102.stdout:624.out 2023-11-13T11:32:07.848 INFO:teuthology.orchestra.run.smithi102.stdout:625 2023-11-13T11:32:07.849 INFO:teuthology.orchestra.run.smithi102.stdout:625.out 2023-11-13T11:32:07.849 INFO:teuthology.orchestra.run.smithi102.stdout:626 2023-11-13T11:32:07.849 INFO:teuthology.orchestra.run.smithi102.stdout:626.out 2023-11-13T11:32:07.849 INFO:teuthology.orchestra.run.smithi102.stdout:627 2023-11-13T11:32:07.849 INFO:teuthology.orchestra.run.smithi102.stdout:627.out 2023-11-13T11:32:07.850 INFO:teuthology.orchestra.run.smithi102.stdout:628 2023-11-13T11:32:07.850 INFO:teuthology.orchestra.run.smithi102.stdout:628.out 2023-11-13T11:32:07.850 INFO:teuthology.orchestra.run.smithi102.stdout:629 2023-11-13T11:32:07.850 INFO:teuthology.orchestra.run.smithi102.stdout:629.out 2023-11-13T11:32:07.851 INFO:teuthology.orchestra.run.smithi102.stdout:630 2023-11-13T11:32:07.851 INFO:teuthology.orchestra.run.smithi102.stdout:630.out 2023-11-13T11:32:07.851 INFO:teuthology.orchestra.run.smithi102.stdout:631 2023-11-13T11:32:07.851 INFO:teuthology.orchestra.run.smithi102.stdout:631.out 2023-11-13T11:32:07.851 INFO:teuthology.orchestra.run.smithi102.stdout:632 2023-11-13T11:32:07.852 INFO:teuthology.orchestra.run.smithi102.stdout:632.out 2023-11-13T11:32:07.852 INFO:teuthology.orchestra.run.smithi102.stdout:633 2023-11-13T11:32:07.852 INFO:teuthology.orchestra.run.smithi102.stdout:633.out 2023-11-13T11:32:07.852 INFO:teuthology.orchestra.run.smithi102.stdout:634 2023-11-13T11:32:07.853 INFO:teuthology.orchestra.run.smithi102.stdout:634.out 2023-11-13T11:32:07.853 INFO:teuthology.orchestra.run.smithi102.stdout:635 2023-11-13T11:32:07.853 INFO:teuthology.orchestra.run.smithi102.stdout:635.out 2023-11-13T11:32:07.853 INFO:teuthology.orchestra.run.smithi102.stdout:636 2023-11-13T11:32:07.854 INFO:teuthology.orchestra.run.smithi102.stdout:636.out 2023-11-13T11:32:07.854 INFO:teuthology.orchestra.run.smithi102.stdout:637 2023-11-13T11:32:07.854 INFO:teuthology.orchestra.run.smithi102.stdout:637.out 2023-11-13T11:32:07.854 INFO:teuthology.orchestra.run.smithi102.stdout:638 2023-11-13T11:32:07.854 INFO:teuthology.orchestra.run.smithi102.stdout:638.out 2023-11-13T11:32:07.855 INFO:teuthology.orchestra.run.smithi102.stdout:639 2023-11-13T11:32:07.855 INFO:teuthology.orchestra.run.smithi102.stdout:639.out 2023-11-13T11:32:07.855 INFO:teuthology.orchestra.run.smithi102.stdout:640 2023-11-13T11:32:07.855 INFO:teuthology.orchestra.run.smithi102.stdout:640.out 2023-11-13T11:32:07.856 INFO:teuthology.orchestra.run.smithi102.stdout:641 2023-11-13T11:32:07.856 INFO:teuthology.orchestra.run.smithi102.stdout:641.out 2023-11-13T11:32:07.856 INFO:teuthology.orchestra.run.smithi102.stdout:642 2023-11-13T11:32:07.856 INFO:teuthology.orchestra.run.smithi102.stdout:642.out 2023-11-13T11:32:07.857 INFO:teuthology.orchestra.run.smithi102.stdout:643 2023-11-13T11:32:07.857 INFO:teuthology.orchestra.run.smithi102.stdout:643.out 2023-11-13T11:32:07.857 INFO:teuthology.orchestra.run.smithi102.stdout:644 2023-11-13T11:32:07.857 INFO:teuthology.orchestra.run.smithi102.stdout:644.out 2023-11-13T11:32:07.857 INFO:teuthology.orchestra.run.smithi102.stdout:645 2023-11-13T11:32:07.858 INFO:teuthology.orchestra.run.smithi102.stdout:645.out 2023-11-13T11:32:07.858 INFO:teuthology.orchestra.run.smithi102.stdout:646 2023-11-13T11:32:07.858 INFO:teuthology.orchestra.run.smithi102.stdout:646.out 2023-11-13T11:32:07.858 INFO:teuthology.orchestra.run.smithi102.stdout:647 2023-11-13T11:32:07.858 INFO:teuthology.orchestra.run.smithi102.stdout:647.out 2023-11-13T11:32:07.859 INFO:teuthology.orchestra.run.smithi102.stdout:648 2023-11-13T11:32:07.859 INFO:teuthology.orchestra.run.smithi102.stdout:648.out 2023-11-13T11:32:07.859 INFO:teuthology.orchestra.run.smithi102.stdout:649 2023-11-13T11:32:07.859 INFO:teuthology.orchestra.run.smithi102.stdout:649.out 2023-11-13T11:32:07.859 INFO:teuthology.orchestra.run.smithi102.stdout:650 2023-11-13T11:32:07.860 INFO:teuthology.orchestra.run.smithi102.stdout:650.out 2023-11-13T11:32:07.860 INFO:teuthology.orchestra.run.smithi102.stdout:651 2023-11-13T11:32:07.860 INFO:teuthology.orchestra.run.smithi102.stdout:651.out 2023-11-13T11:32:07.860 INFO:teuthology.orchestra.run.smithi102.stdout:652 2023-11-13T11:32:07.861 INFO:teuthology.orchestra.run.smithi102.stdout:652.out 2023-11-13T11:32:07.861 INFO:teuthology.orchestra.run.smithi102.stdout:653 2023-11-13T11:32:07.861 INFO:teuthology.orchestra.run.smithi102.stdout:653.out 2023-11-13T11:32:07.861 INFO:teuthology.orchestra.run.smithi102.stdout:654 2023-11-13T11:32:07.861 INFO:teuthology.orchestra.run.smithi102.stdout:654.out 2023-11-13T11:32:07.862 INFO:teuthology.orchestra.run.smithi102.stdout:655 2023-11-13T11:32:07.862 INFO:teuthology.orchestra.run.smithi102.stdout:655.out 2023-11-13T11:32:07.862 INFO:teuthology.orchestra.run.smithi102.stdout:656 2023-11-13T11:32:07.862 INFO:teuthology.orchestra.run.smithi102.stdout:656.out 2023-11-13T11:32:07.863 INFO:teuthology.orchestra.run.smithi102.stdout:657 2023-11-13T11:32:07.863 INFO:teuthology.orchestra.run.smithi102.stdout:657.out 2023-11-13T11:32:07.863 INFO:teuthology.orchestra.run.smithi102.stdout:658 2023-11-13T11:32:07.863 INFO:teuthology.orchestra.run.smithi102.stdout:658.out 2023-11-13T11:32:07.863 INFO:teuthology.orchestra.run.smithi102.stdout:659 2023-11-13T11:32:07.864 INFO:teuthology.orchestra.run.smithi102.stdout:659.out 2023-11-13T11:32:07.864 INFO:teuthology.orchestra.run.smithi102.stdout:660 2023-11-13T11:32:07.864 INFO:teuthology.orchestra.run.smithi102.stdout:660.out 2023-11-13T11:32:07.864 INFO:teuthology.orchestra.run.smithi102.stdout:661 2023-11-13T11:32:07.864 INFO:teuthology.orchestra.run.smithi102.stdout:661.out 2023-11-13T11:32:07.865 INFO:teuthology.orchestra.run.smithi102.stdout:662 2023-11-13T11:32:07.865 INFO:teuthology.orchestra.run.smithi102.stdout:662.out 2023-11-13T11:32:07.865 INFO:teuthology.orchestra.run.smithi102.stdout:663 2023-11-13T11:32:07.865 INFO:teuthology.orchestra.run.smithi102.stdout:663.out 2023-11-13T11:32:07.865 INFO:teuthology.orchestra.run.smithi102.stdout:664 2023-11-13T11:32:07.866 INFO:teuthology.orchestra.run.smithi102.stdout:664.out 2023-11-13T11:32:07.866 INFO:teuthology.orchestra.run.smithi102.stdout:665 2023-11-13T11:32:07.866 INFO:teuthology.orchestra.run.smithi102.stdout:665.out 2023-11-13T11:32:07.866 INFO:teuthology.orchestra.run.smithi102.stdout:666 2023-11-13T11:32:07.866 INFO:teuthology.orchestra.run.smithi102.stdout:666.out 2023-11-13T11:32:07.867 INFO:teuthology.orchestra.run.smithi102.stdout:667 2023-11-13T11:32:07.867 INFO:teuthology.orchestra.run.smithi102.stdout:667.out 2023-11-13T11:32:07.867 INFO:teuthology.orchestra.run.smithi102.stdout:668 2023-11-13T11:32:07.867 INFO:teuthology.orchestra.run.smithi102.stdout:668.out 2023-11-13T11:32:07.868 INFO:teuthology.orchestra.run.smithi102.stdout:669 2023-11-13T11:32:07.868 INFO:teuthology.orchestra.run.smithi102.stdout:669.out 2023-11-13T11:32:07.868 INFO:teuthology.orchestra.run.smithi102.stdout:670 2023-11-13T11:32:07.868 INFO:teuthology.orchestra.run.smithi102.stdout:670.out 2023-11-13T11:32:07.868 INFO:teuthology.orchestra.run.smithi102.stdout:671 2023-11-13T11:32:07.869 INFO:teuthology.orchestra.run.smithi102.stdout:671.out 2023-11-13T11:32:07.869 INFO:teuthology.orchestra.run.smithi102.stdout:672 2023-11-13T11:32:07.869 INFO:teuthology.orchestra.run.smithi102.stdout:672.out 2023-11-13T11:32:07.869 INFO:teuthology.orchestra.run.smithi102.stdout:673 2023-11-13T11:32:07.869 INFO:teuthology.orchestra.run.smithi102.stdout:673.out 2023-11-13T11:32:07.870 INFO:teuthology.orchestra.run.smithi102.stdout:674 2023-11-13T11:32:07.870 INFO:teuthology.orchestra.run.smithi102.stdout:674.out 2023-11-13T11:32:07.870 INFO:teuthology.orchestra.run.smithi102.stdout:675 2023-11-13T11:32:07.870 INFO:teuthology.orchestra.run.smithi102.stdout:675.out 2023-11-13T11:32:07.871 INFO:teuthology.orchestra.run.smithi102.stdout:676 2023-11-13T11:32:07.871 INFO:teuthology.orchestra.run.smithi102.stdout:676.out 2023-11-13T11:32:07.871 INFO:teuthology.orchestra.run.smithi102.stdout:677 2023-11-13T11:32:07.871 INFO:teuthology.orchestra.run.smithi102.stdout:677.out 2023-11-13T11:32:07.871 INFO:teuthology.orchestra.run.smithi102.stdout:678 2023-11-13T11:32:07.872 INFO:teuthology.orchestra.run.smithi102.stdout:678.out 2023-11-13T11:32:07.872 INFO:teuthology.orchestra.run.smithi102.stdout:679 2023-11-13T11:32:07.872 INFO:teuthology.orchestra.run.smithi102.stdout:679.out 2023-11-13T11:32:07.872 INFO:teuthology.orchestra.run.smithi102.stdout:680 2023-11-13T11:32:07.873 INFO:teuthology.orchestra.run.smithi102.stdout:680.out 2023-11-13T11:32:07.873 INFO:teuthology.orchestra.run.smithi102.stdout:681 2023-11-13T11:32:07.873 INFO:teuthology.orchestra.run.smithi102.stdout:681.out 2023-11-13T11:32:07.873 INFO:teuthology.orchestra.run.smithi102.stdout:682 2023-11-13T11:32:07.873 INFO:teuthology.orchestra.run.smithi102.stdout:682.out 2023-11-13T11:32:07.874 INFO:teuthology.orchestra.run.smithi102.stdout:683 2023-11-13T11:32:07.874 INFO:teuthology.orchestra.run.smithi102.stdout:683.out 2023-11-13T11:32:07.874 INFO:teuthology.orchestra.run.smithi102.stdout:684 2023-11-13T11:32:07.874 INFO:teuthology.orchestra.run.smithi102.stdout:684.out 2023-11-13T11:32:07.874 INFO:teuthology.orchestra.run.smithi102.stdout:685 2023-11-13T11:32:07.875 INFO:teuthology.orchestra.run.smithi102.stdout:685.out 2023-11-13T11:32:07.875 INFO:teuthology.orchestra.run.smithi102.stdout:686 2023-11-13T11:32:07.875 INFO:teuthology.orchestra.run.smithi102.stdout:686.out 2023-11-13T11:32:07.875 INFO:teuthology.orchestra.run.smithi102.stdout:687 2023-11-13T11:32:07.876 INFO:teuthology.orchestra.run.smithi102.stdout:687.out 2023-11-13T11:32:07.876 INFO:teuthology.orchestra.run.smithi102.stdout:688 2023-11-13T11:32:07.876 INFO:teuthology.orchestra.run.smithi102.stdout:688.out 2023-11-13T11:32:07.876 INFO:teuthology.orchestra.run.smithi102.stdout:689 2023-11-13T11:32:07.876 INFO:teuthology.orchestra.run.smithi102.stdout:689.out 2023-11-13T11:32:07.877 INFO:teuthology.orchestra.run.smithi102.stdout:690 2023-11-13T11:32:07.877 INFO:teuthology.orchestra.run.smithi102.stdout:690.out 2023-11-13T11:32:07.877 INFO:teuthology.orchestra.run.smithi102.stdout:691 2023-11-13T11:32:07.877 INFO:teuthology.orchestra.run.smithi102.stdout:691.out 2023-11-13T11:32:07.877 INFO:teuthology.orchestra.run.smithi102.stdout:692 2023-11-13T11:32:07.878 INFO:teuthology.orchestra.run.smithi102.stdout:692.out 2023-11-13T11:32:07.878 INFO:teuthology.orchestra.run.smithi102.stdout:693 2023-11-13T11:32:07.878 INFO:teuthology.orchestra.run.smithi102.stdout:693.out 2023-11-13T11:32:07.878 INFO:teuthology.orchestra.run.smithi102.stdout:694 2023-11-13T11:32:07.879 INFO:teuthology.orchestra.run.smithi102.stdout:694.out 2023-11-13T11:32:07.879 INFO:teuthology.orchestra.run.smithi102.stdout:695 2023-11-13T11:32:07.879 INFO:teuthology.orchestra.run.smithi102.stdout:695.out 2023-11-13T11:32:07.879 INFO:teuthology.orchestra.run.smithi102.stdout:696 2023-11-13T11:32:07.879 INFO:teuthology.orchestra.run.smithi102.stdout:696.out 2023-11-13T11:32:07.880 INFO:teuthology.orchestra.run.smithi102.stdout:697 2023-11-13T11:32:07.880 INFO:teuthology.orchestra.run.smithi102.stdout:697.out 2023-11-13T11:32:07.880 INFO:teuthology.orchestra.run.smithi102.stdout:698 2023-11-13T11:32:07.880 INFO:teuthology.orchestra.run.smithi102.stdout:698.out 2023-11-13T11:32:07.881 INFO:teuthology.orchestra.run.smithi102.stdout:699 2023-11-13T11:32:07.881 INFO:teuthology.orchestra.run.smithi102.stdout:699.out 2023-11-13T11:32:07.881 INFO:teuthology.orchestra.run.smithi102.stdout:700 2023-11-13T11:32:07.881 INFO:teuthology.orchestra.run.smithi102.stdout:700.out 2023-11-13T11:32:07.881 INFO:teuthology.orchestra.run.smithi102.stdout:701 2023-11-13T11:32:07.882 INFO:teuthology.orchestra.run.smithi102.stdout:701.out 2023-11-13T11:32:07.882 INFO:teuthology.orchestra.run.smithi102.stdout:702 2023-11-13T11:32:07.882 INFO:teuthology.orchestra.run.smithi102.stdout:702.out 2023-11-13T11:32:07.882 INFO:teuthology.orchestra.run.smithi102.stdout:703 2023-11-13T11:32:07.883 INFO:teuthology.orchestra.run.smithi102.stdout:703.out 2023-11-13T11:32:07.883 INFO:teuthology.orchestra.run.smithi102.stdout:704 2023-11-13T11:32:07.883 INFO:teuthology.orchestra.run.smithi102.stdout:704.out 2023-11-13T11:32:07.883 INFO:teuthology.orchestra.run.smithi102.stdout:705 2023-11-13T11:32:07.884 INFO:teuthology.orchestra.run.smithi102.stdout:705.out 2023-11-13T11:32:07.884 INFO:teuthology.orchestra.run.smithi102.stdout:706 2023-11-13T11:32:07.884 INFO:teuthology.orchestra.run.smithi102.stdout:706.out 2023-11-13T11:32:07.884 INFO:teuthology.orchestra.run.smithi102.stdout:707 2023-11-13T11:32:07.884 INFO:teuthology.orchestra.run.smithi102.stdout:707.out 2023-11-13T11:32:07.885 INFO:teuthology.orchestra.run.smithi102.stdout:708 2023-11-13T11:32:07.885 INFO:teuthology.orchestra.run.smithi102.stdout:708.out 2023-11-13T11:32:07.885 INFO:teuthology.orchestra.run.smithi102.stdout:709 2023-11-13T11:32:07.885 INFO:teuthology.orchestra.run.smithi102.stdout:709.out 2023-11-13T11:32:07.885 INFO:teuthology.orchestra.run.smithi102.stdout:710 2023-11-13T11:32:07.886 INFO:teuthology.orchestra.run.smithi102.stdout:710.out 2023-11-13T11:32:07.886 INFO:teuthology.orchestra.run.smithi102.stdout:711 2023-11-13T11:32:07.886 INFO:teuthology.orchestra.run.smithi102.stdout:711.out 2023-11-13T11:32:07.886 INFO:teuthology.orchestra.run.smithi102.stdout:712 2023-11-13T11:32:07.887 INFO:teuthology.orchestra.run.smithi102.stdout:712.out 2023-11-13T11:32:07.887 INFO:teuthology.orchestra.run.smithi102.stdout:713 2023-11-13T11:32:07.887 INFO:teuthology.orchestra.run.smithi102.stdout:713.out 2023-11-13T11:32:07.887 INFO:teuthology.orchestra.run.smithi102.stdout:714 2023-11-13T11:32:07.887 INFO:teuthology.orchestra.run.smithi102.stdout:714.out 2023-11-13T11:32:07.888 INFO:teuthology.orchestra.run.smithi102.stdout:715 2023-11-13T11:32:07.888 INFO:teuthology.orchestra.run.smithi102.stdout:715.out 2023-11-13T11:32:07.888 INFO:teuthology.orchestra.run.smithi102.stdout:716 2023-11-13T11:32:07.888 INFO:teuthology.orchestra.run.smithi102.stdout:716.out 2023-11-13T11:32:07.888 INFO:teuthology.orchestra.run.smithi102.stdout:717 2023-11-13T11:32:07.889 INFO:teuthology.orchestra.run.smithi102.stdout:717.out 2023-11-13T11:32:07.889 INFO:teuthology.orchestra.run.smithi102.stdout:718 2023-11-13T11:32:07.889 INFO:teuthology.orchestra.run.smithi102.stdout:718.out 2023-11-13T11:32:07.889 INFO:teuthology.orchestra.run.smithi102.stdout:719 2023-11-13T11:32:07.889 INFO:teuthology.orchestra.run.smithi102.stdout:719.out 2023-11-13T11:32:07.890 INFO:teuthology.orchestra.run.smithi102.stdout:720 2023-11-13T11:32:07.890 INFO:teuthology.orchestra.run.smithi102.stdout:720.out 2023-11-13T11:32:07.890 INFO:teuthology.orchestra.run.smithi102.stdout:721 2023-11-13T11:32:07.890 INFO:teuthology.orchestra.run.smithi102.stdout:721.out 2023-11-13T11:32:07.890 INFO:teuthology.orchestra.run.smithi102.stdout:722 2023-11-13T11:32:07.891 INFO:teuthology.orchestra.run.smithi102.stdout:722.out 2023-11-13T11:32:07.891 INFO:teuthology.orchestra.run.smithi102.stdout:723 2023-11-13T11:32:07.891 INFO:teuthology.orchestra.run.smithi102.stdout:723.out 2023-11-13T11:32:07.891 INFO:teuthology.orchestra.run.smithi102.stdout:724 2023-11-13T11:32:07.892 INFO:teuthology.orchestra.run.smithi102.stdout:724.out 2023-11-13T11:32:07.892 INFO:teuthology.orchestra.run.smithi102.stdout:725 2023-11-13T11:32:07.892 INFO:teuthology.orchestra.run.smithi102.stdout:725.out 2023-11-13T11:32:07.892 INFO:teuthology.orchestra.run.smithi102.stdout:726 2023-11-13T11:32:07.892 INFO:teuthology.orchestra.run.smithi102.stdout:726.out 2023-11-13T11:32:07.893 INFO:teuthology.orchestra.run.smithi102.stdout:727 2023-11-13T11:32:07.893 INFO:teuthology.orchestra.run.smithi102.stdout:727.out 2023-11-13T11:32:07.893 INFO:teuthology.orchestra.run.smithi102.stdout:728 2023-11-13T11:32:07.893 INFO:teuthology.orchestra.run.smithi102.stdout:728.out 2023-11-13T11:32:07.894 INFO:teuthology.orchestra.run.smithi102.stdout:729 2023-11-13T11:32:07.894 INFO:teuthology.orchestra.run.smithi102.stdout:729.out 2023-11-13T11:32:07.894 INFO:teuthology.orchestra.run.smithi102.stdout:730 2023-11-13T11:32:07.894 INFO:teuthology.orchestra.run.smithi102.stdout:730.out 2023-11-13T11:32:07.895 INFO:teuthology.orchestra.run.smithi102.stdout:731 2023-11-13T11:32:07.895 INFO:teuthology.orchestra.run.smithi102.stdout:731.out 2023-11-13T11:32:07.895 INFO:teuthology.orchestra.run.smithi102.stdout:732 2023-11-13T11:32:07.895 INFO:teuthology.orchestra.run.smithi102.stdout:732.out 2023-11-13T11:32:07.895 INFO:teuthology.orchestra.run.smithi102.stdout:group.list 2023-11-13T11:32:07.896 INFO:teuthology.orchestra.run.smithi102.stdout:Makefile 2023-11-13T11:32:07.897 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/001) 2023-11-13T11:32:08.281 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T11:32:08.292 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T11:32:08.292 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T11:32:12.482 INFO:teuthology.orchestra.run.smithi102.stdout:generic/001 4s 2023-11-13T11:32:12.494 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/001 2023-11-13T11:32:12.494 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T11:32:12.502 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T11:32:12.503 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi102.stderr:ceph-fuse[48433]: fuse finished with error 0 and tester_r 0 2023-11-13T11:32:12.520 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T11:32:12.520 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/002) 2023-11-13T11:32:12.880 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T11:32:12.891 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T11:32:12.891 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T11:32:13.629 INFO:teuthology.orchestra.run.smithi102.stdout:generic/002 1s 2023-11-13T11:32:13.641 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/002 2023-11-13T11:32:13.641 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T11:32:13.647 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T11:32:13.671 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T11:32:13.671 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/003) 2023-11-13T11:32:14.061 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T11:32:14.071 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T11:32:14.072 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T11:32:14.333 INFO:teuthology.orchestra.run.smithi102.stdout:generic/003 [not run] this test requires a valid $SCRATCH_DEV 2023-11-13T11:32:14.341 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/003 2023-11-13T11:32:14.342 INFO:teuthology.orchestra.run.smithi102.stdout:Not run: generic/003 2023-11-13T11:32:14.342 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T11:32:14.348 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T11:32:14.368 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T11:32:14.368 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/004) 2023-11-13T11:32:14.730 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T11:32:14.741 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T11:32:14.741 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T11:32:15.052 INFO:teuthology.orchestra.run.smithi102.stdout:generic/004 [not run] O_TMPFILE is not supported 2023-11-13T11:32:15.060 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/004 2023-11-13T11:32:15.060 INFO:teuthology.orchestra.run.smithi102.stdout:Not run: generic/004 2023-11-13T11:32:15.060 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T11:32:15.066 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T11:32:15.085 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T11:32:15.086 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/005) 2023-11-13T11:32:15.452 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T11:32:15.463 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T11:32:15.463 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T11:32:16.370 INFO:teuthology.orchestra.run.smithi102.stdout:generic/005 1s 2023-11-13T11:32:16.382 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/005 2023-11-13T11:32:16.383 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T11:32:16.389 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T11:32:16.409 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T11:32:16.410 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/006) 2023-11-13T11:32:16.793 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T11:32:16.806 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T11:32:16.807 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T11:32:20.176 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T11:32:20.181 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T11:32:49.982 INFO:teuthology.orchestra.run.smithi102.stdout:generic/006 33s 2023-11-13T11:32:50.230 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T11:32:50.236 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T11:32:51.789 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/006 2023-11-13T11:32:51.790 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T11:32:51.796 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T11:32:51.845 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T11:32:51.846 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/007) 2023-11-13T11:32:52.534 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T11:32:52.544 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T11:32:52.544 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T11:33:23.288 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T11:33:23.294 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T11:33:53.350 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T11:33:53.355 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T11:34:11.583 INFO:teuthology.orchestra.run.smithi102.stdout:generic/007 79s 2023-11-13T11:34:11.595 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/007 2023-11-13T11:34:11.595 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T11:34:11.602 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T11:34:11.624 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T11:34:11.624 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/008) 2023-11-13T11:34:12.036 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T11:34:12.047 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T11:34:12.048 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T11:34:13.546 INFO:teuthology.orchestra.run.smithi102.stdout:generic/008 [not run] xfs_io fzero failed (old kernel/wrong fs?) 2023-11-13T11:34:13.554 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/008 2023-11-13T11:34:13.555 INFO:teuthology.orchestra.run.smithi102.stdout:Not run: generic/008 2023-11-13T11:34:13.555 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T11:34:13.561 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T11:34:13.582 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T11:34:13.583 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/009) 2023-11-13T11:34:13.935 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T11:34:13.946 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T11:34:13.946 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T11:34:15.320 INFO:teuthology.orchestra.run.smithi102.stdout:generic/009 [not run] xfs_io fzero failed (old kernel/wrong fs?) 2023-11-13T11:34:15.328 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/009 2023-11-13T11:34:15.329 INFO:teuthology.orchestra.run.smithi102.stdout:Not run: generic/009 2023-11-13T11:34:15.329 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T11:34:15.335 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T11:34:15.357 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T11:34:15.357 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/010) 2023-11-13T11:34:15.723 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T11:34:15.734 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T11:34:15.734 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T11:34:16.004 INFO:teuthology.orchestra.run.smithi102.stdout:generic/010 [not run] /tmp/tmp.EnLPmcWJbzxfstests-dev/src/dbtest not built 2023-11-13T11:34:16.013 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/010 2023-11-13T11:34:16.013 INFO:teuthology.orchestra.run.smithi102.stdout:Not run: generic/010 2023-11-13T11:34:16.013 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T11:34:16.019 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T11:34:16.039 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T11:34:16.040 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/011) 2023-11-13T11:34:16.409 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T11:34:16.420 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T11:34:16.420 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T11:34:23.423 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T11:34:23.427 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T11:34:53.490 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T11:34:53.494 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T11:34:59.118 INFO:teuthology.orchestra.run.smithi102.stdout:generic/011 43s 2023-11-13T11:34:59.135 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/011 2023-11-13T11:34:59.136 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T11:34:59.144 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T11:34:59.266 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T11:34:59.267 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/012) 2023-11-13T11:34:59.635 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T11:34:59.646 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T11:34:59.646 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T11:35:01.258 INFO:teuthology.orchestra.run.smithi102.stdout:generic/012 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2023-11-13T11:35:01.266 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/012 2023-11-13T11:35:01.266 INFO:teuthology.orchestra.run.smithi102.stdout:Not run: generic/012 2023-11-13T11:35:01.267 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T11:35:01.272 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T11:35:01.311 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T11:35:01.311 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/013) 2023-11-13T11:35:01.699 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T11:35:01.710 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T11:35:01.710 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T11:35:25.098 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T11:35:25.108 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T11:35:55.912 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T11:35:55.917 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T11:36:26.562 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T11:36:26.569 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T11:36:46.338 INFO:teuthology.orchestra.run.smithi102.stdout:generic/013 105s 2023-11-13T11:36:47.047 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/013 2023-11-13T11:36:47.047 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T11:36:47.058 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T11:36:47.090 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T11:36:47.091 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/014) 2023-11-13T11:36:47.906 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T11:36:47.930 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T11:36:47.930 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T11:36:56.630 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T11:36:56.635 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T11:37:26.712 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T11:37:26.718 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T11:37:26.792 INFO:tasks.ceph.mds.a.smithi102.stderr:2023-11-13T11:37:26.787+0000 7fd988155640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 92471) UID: 0 2023-11-13T11:37:26.793 INFO:tasks.ceph.mds.c.smithi102.stderr:2023-11-13T11:37:26.787+0000 7fe15259f640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 92471) UID: 0 2023-11-13T11:41:15.477 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T11:41:15.482 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T11:41:45.735 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T11:41:45.742 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T11:41:55.834 INFO:teuthology.orchestra.run.smithi102.stdout:generic/014 308s 2023-11-13T11:41:55.856 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/014 2023-11-13T11:41:55.856 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T11:41:55.866 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T11:41:55.901 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T11:41:55.902 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/015) 2023-11-13T11:41:56.452 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T11:41:56.469 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T11:41:56.469 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T11:41:56.896 INFO:teuthology.orchestra.run.smithi102.stdout:generic/015 [not run] this test requires a valid $SCRATCH_DEV 2023-11-13T11:41:56.910 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/015 2023-11-13T11:41:56.910 INFO:teuthology.orchestra.run.smithi102.stdout:Not run: generic/015 2023-11-13T11:41:56.911 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T11:41:56.922 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T11:41:56.952 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T11:41:56.952 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/016) 2023-11-13T11:41:57.545 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T11:41:57.560 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T11:41:57.561 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T11:42:00.118 INFO:teuthology.orchestra.run.smithi102.stdout:generic/016 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2023-11-13T11:42:00.131 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/016 2023-11-13T11:42:00.132 INFO:teuthology.orchestra.run.smithi102.stdout:Not run: generic/016 2023-11-13T11:42:00.132 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T11:42:00.142 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T11:42:00.177 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T11:42:00.178 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/017) 2023-11-13T11:42:00.973 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T11:42:00.990 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T11:42:00.991 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T11:42:01.405 INFO:teuthology.orchestra.run.smithi102.stdout:generic/017 [not run] this test requires a valid $SCRATCH_DEV 2023-11-13T11:42:01.418 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/017 2023-11-13T11:42:01.418 INFO:teuthology.orchestra.run.smithi102.stdout:Not run: generic/017 2023-11-13T11:42:01.418 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T11:42:01.426 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T11:42:01.461 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T11:42:01.462 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/018) 2023-11-13T11:42:02.017 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T11:42:02.034 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T11:42:02.035 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T11:42:02.461 INFO:teuthology.orchestra.run.smithi102.stdout:generic/018 [not run] this test requires a valid $SCRATCH_DEV 2023-11-13T11:42:02.473 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/018 2023-11-13T11:42:02.473 INFO:teuthology.orchestra.run.smithi102.stdout:Not run: generic/018 2023-11-13T11:42:02.474 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T11:42:02.484 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T11:42:02.515 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T11:42:02.516 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/019) 2023-11-13T11:42:03.072 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T11:42:03.089 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T11:42:03.089 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T11:42:03.489 INFO:teuthology.orchestra.run.smithi102.stdout:generic/019 [not run] this test requires a valid $SCRATCH_DEV 2023-11-13T11:42:03.501 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/019 2023-11-13T11:42:03.502 INFO:teuthology.orchestra.run.smithi102.stdout:Not run: generic/019 2023-11-13T11:42:03.502 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T11:42:03.512 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T11:42:03.544 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T11:42:03.545 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/020) 2023-11-13T11:42:04.102 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T11:42:04.119 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T11:42:04.120 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T11:42:15.816 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T11:42:15.822 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T11:42:21.629 INFO:teuthology.orchestra.run.smithi102.stdout:generic/020 - output mismatch (see /tmp/tmp.EnLPmcWJbzxfstests-dev/results//generic/020.out.bad) 2023-11-13T11:42:21.639 INFO:teuthology.orchestra.run.smithi102.stdout: --- tests/generic/020.out 2023-11-13 11:30:05.281486126 +0000 2023-11-13T11:42:21.639 INFO:teuthology.orchestra.run.smithi102.stdout: +++ /tmp/tmp.EnLPmcWJbzxfstests-dev/results//generic/020.out.bad 2023-11-13 11:42:21.623512024 +0000 2023-11-13T11:42:21.639 INFO:teuthology.orchestra.run.smithi102.stdout: @@ -47,9 +47,13 @@ 2023-11-13T11:42:21.640 INFO:teuthology.orchestra.run.smithi102.stdout: user.snrub="fish2\012" 2023-11-13T11:42:21.640 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T11:42:21.640 INFO:teuthology.orchestra.run.smithi102.stdout: *** really long value 2023-11-13T11:42:21.640 INFO:teuthology.orchestra.run.smithi102.stdout: -0000000 00 2023-11-13T11:42:21.641 INFO:teuthology.orchestra.run.smithi102.stdout: -* 2023-11-13T11:42:21.641 INFO:teuthology.orchestra.run.smithi102.stdout: -ATTRSIZE 2023-11-13T11:42:21.641 INFO:teuthology.orchestra.run.smithi102.stdout: +attr_set: No space left on device 2023-11-13T11:42:21.641 INFO:teuthology.orchestra.run.smithi102.stdout: +Could not set "long_attr" for 2023-11-13T11:42:21.641 INFO:teuthology.orchestra.run.smithi102.stdout: +attr_get: No data available 2023-11-13T11:42:21.642 INFO:teuthology.orchestra.run.smithi102.stdout: +Could not get "long_attr" for 2023-11-13T11:42:21.642 INFO:teuthology.orchestra.run.smithi102.stdout: +0000000 2023-11-13T11:42:21.642 INFO:teuthology.orchestra.run.smithi102.stdout: +attr_remove: No data available 2023-11-13T11:42:21.643 INFO:teuthology.orchestra.run.smithi102.stdout: +Could not remove "long_attr" for 2023-11-13T11:42:21.643 INFO:teuthology.orchestra.run.smithi102.stdout: *** set/get/remove really long names (expect failure) 2023-11-13T11:42:21.643 INFO:teuthology.orchestra.run.smithi102.stdout: attr_set: Invalid argument 2023-11-13T11:42:21.643 INFO:teuthology.orchestra.run.smithi102.stdout: Could not set "XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX" for 2023-11-13T11:42:21.647 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/020 2023-11-13T11:42:21.647 INFO:teuthology.orchestra.run.smithi102.stdout:Failures: generic/020 2023-11-13T11:42:21.647 INFO:teuthology.orchestra.run.smithi102.stdout:Failed 1 of 1 tests 2023-11-13T11:42:21.656 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T11:42:21.821 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-13T11:42:21.822 INFO:tasks.cephfs.xfstests_dev:Command failed 2023-11-13T11:42:21.822 INFO:tasks.cephfs.xfstests_dev:Command return value: 1 2023-11-13T11:42:21.823 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/021) 2023-11-13T11:42:22.501 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T11:42:22.517 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T11:42:22.517 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T11:42:25.280 INFO:teuthology.orchestra.run.smithi102.stdout:generic/021 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2023-11-13T11:42:25.292 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/021 2023-11-13T11:42:25.293 INFO:teuthology.orchestra.run.smithi102.stdout:Not run: generic/021 2023-11-13T11:42:25.293 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T11:42:25.304 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T11:42:25.340 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T11:42:25.341 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/022) 2023-11-13T11:42:26.149 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T11:42:26.169 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T11:42:26.169 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T11:42:28.845 INFO:teuthology.orchestra.run.smithi102.stdout:generic/022 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2023-11-13T11:42:28.858 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/022 2023-11-13T11:42:28.859 INFO:teuthology.orchestra.run.smithi102.stdout:Not run: generic/022 2023-11-13T11:42:28.859 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T11:42:28.868 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T11:42:29.025 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T11:42:29.026 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/023) 2023-11-13T11:42:29.761 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T11:42:29.778 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T11:42:29.778 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T11:42:33.008 INFO:teuthology.orchestra.run.smithi102.stdout:generic/023 3s 2023-11-13T11:42:33.029 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/023 2023-11-13T11:42:33.029 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T11:42:33.038 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T11:42:33.162 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T11:42:33.162 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/024) 2023-11-13T11:42:33.890 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T11:42:33.907 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T11:42:33.907 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T11:42:34.400 INFO:teuthology.orchestra.run.smithi102.stdout:generic/024 [not run] kernel doesn't support renameat2 syscall 2023-11-13T11:42:34.412 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/024 2023-11-13T11:42:34.413 INFO:teuthology.orchestra.run.smithi102.stdout:Not run: generic/024 2023-11-13T11:42:34.413 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T11:42:34.420 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T11:42:34.478 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T11:42:34.479 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/025) 2023-11-13T11:42:35.234 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T11:42:35.253 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T11:42:35.253 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T11:42:35.719 INFO:teuthology.orchestra.run.smithi102.stdout:generic/025 [not run] kernel doesn't support renameat2 syscall 2023-11-13T11:42:35.735 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/025 2023-11-13T11:42:35.735 INFO:teuthology.orchestra.run.smithi102.stdout:Not run: generic/025 2023-11-13T11:42:35.735 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T11:42:35.743 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T11:42:35.808 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T11:42:35.809 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/026) 2023-11-13T11:42:36.616 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T11:42:36.632 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T11:42:36.633 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T11:42:37.153 INFO:teuthology.orchestra.run.smithi102.stdout:generic/026 [not run] ACLs not supported by this filesystem type: ceph-fuse 2023-11-13T11:42:37.169 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/026 2023-11-13T11:42:37.169 INFO:teuthology.orchestra.run.smithi102.stdout:Not run: generic/026 2023-11-13T11:42:37.170 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T11:42:37.181 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T11:42:37.216 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T11:42:37.217 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/027) 2023-11-13T11:42:37.765 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T11:42:37.781 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T11:42:37.782 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T11:42:38.208 INFO:teuthology.orchestra.run.smithi102.stdout:generic/027 [not run] this test requires a valid $SCRATCH_DEV 2023-11-13T11:42:38.219 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/027 2023-11-13T11:42:38.220 INFO:teuthology.orchestra.run.smithi102.stdout:Not run: generic/027 2023-11-13T11:42:38.220 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T11:42:38.230 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T11:42:38.266 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T11:42:38.267 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/028) 2023-11-13T11:42:38.836 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T11:42:38.853 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T11:42:38.854 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T11:42:44.329 INFO:teuthology.orchestra.run.smithi102.stdout:generic/028 6s 2023-11-13T11:42:44.348 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/028 2023-11-13T11:42:44.349 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T11:42:44.357 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T11:42:44.393 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T11:42:44.394 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/029) 2023-11-13T11:42:44.952 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T11:42:44.967 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T11:42:44.967 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T11:42:45.381 INFO:teuthology.orchestra.run.smithi102.stdout:generic/029 [not run] this test requires a valid $SCRATCH_DEV 2023-11-13T11:42:45.394 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/029 2023-11-13T11:42:45.394 INFO:teuthology.orchestra.run.smithi102.stdout:Not run: generic/029 2023-11-13T11:42:45.394 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T11:42:45.404 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T11:42:45.436 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T11:42:45.437 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/030) 2023-11-13T11:42:46.017 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T11:42:46.034 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T11:42:46.035 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T11:42:46.442 INFO:teuthology.orchestra.run.smithi102.stdout:generic/030 [not run] this test requires a valid $SCRATCH_DEV 2023-11-13T11:42:46.456 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/030 2023-11-13T11:42:46.457 INFO:teuthology.orchestra.run.smithi102.stdout:Not run: generic/030 2023-11-13T11:42:46.457 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T11:42:46.466 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T11:42:46.493 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T11:42:46.493 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/031) 2023-11-13T11:42:46.649 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T11:42:46.657 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T11:42:47.043 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T11:42:47.060 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T11:42:47.060 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T11:42:47.458 INFO:teuthology.orchestra.run.smithi102.stdout:generic/031 [not run] this test requires a valid $SCRATCH_DEV 2023-11-13T11:42:47.469 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/031 2023-11-13T11:42:47.470 INFO:teuthology.orchestra.run.smithi102.stdout:Not run: generic/031 2023-11-13T11:42:47.470 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T11:42:47.477 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T11:42:47.514 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T11:42:47.515 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/032) 2023-11-13T11:42:48.107 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T11:42:48.124 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T11:42:48.125 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T11:42:48.564 INFO:teuthology.orchestra.run.smithi102.stdout:generic/032 [not run] this test requires a valid $SCRATCH_DEV 2023-11-13T11:42:48.574 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/032 2023-11-13T11:42:48.574 INFO:teuthology.orchestra.run.smithi102.stdout:Not run: generic/032 2023-11-13T11:42:48.574 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T11:42:48.583 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T11:42:48.614 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T11:42:48.615 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/033) 2023-11-13T11:42:49.168 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T11:42:49.182 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T11:42:49.183 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T11:42:49.596 INFO:teuthology.orchestra.run.smithi102.stdout:generic/033 [not run] this test requires a valid $SCRATCH_DEV 2023-11-13T11:42:49.607 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/033 2023-11-13T11:42:49.607 INFO:teuthology.orchestra.run.smithi102.stdout:Not run: generic/033 2023-11-13T11:42:49.608 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T11:42:49.617 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T11:42:49.640 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T11:42:49.641 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/034) 2023-11-13T11:42:50.232 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T11:42:50.247 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T11:42:50.247 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T11:42:50.696 INFO:teuthology.orchestra.run.smithi102.stdout:generic/034 [not run] this test requires a valid $SCRATCH_DEV 2023-11-13T11:42:50.714 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/034 2023-11-13T11:42:50.714 INFO:teuthology.orchestra.run.smithi102.stdout:Not run: generic/034 2023-11-13T11:42:50.715 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T11:42:50.724 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T11:42:50.786 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T11:42:50.786 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/035) 2023-11-13T11:42:51.345 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T11:42:51.362 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T11:42:51.363 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T11:42:52.077 INFO:teuthology.orchestra.run.smithi102.stdout:generic/035 1s 2023-11-13T11:42:52.611 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/035 2023-11-13T11:42:52.611 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T11:42:52.621 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T11:42:52.701 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T11:42:52.701 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/036) 2023-11-13T11:42:53.495 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T11:42:53.510 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T11:42:53.511 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T11:43:04.213 INFO:teuthology.orchestra.run.smithi102.stdout:generic/036 11s 2023-11-13T11:43:04.232 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/036 2023-11-13T11:43:04.233 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T11:43:04.241 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T11:43:04.451 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T11:43:04.452 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/037) 2023-11-13T11:43:05.127 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T11:43:05.142 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T11:43:05.143 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T11:43:05.539 INFO:teuthology.orchestra.run.smithi102.stdout:generic/037 [not run] this test requires a valid $SCRATCH_DEV 2023-11-13T11:43:05.550 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/037 2023-11-13T11:43:05.551 INFO:teuthology.orchestra.run.smithi102.stdout:Not run: generic/037 2023-11-13T11:43:05.551 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T11:43:05.560 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T11:43:05.590 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T11:43:05.591 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/038) 2023-11-13T11:43:06.187 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T11:43:06.203 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T11:43:06.203 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T11:43:06.615 INFO:teuthology.orchestra.run.smithi102.stdout:generic/038 [not run] this test requires a valid $SCRATCH_DEV 2023-11-13T11:43:06.629 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/038 2023-11-13T11:43:06.630 INFO:teuthology.orchestra.run.smithi102.stdout:Not run: generic/038 2023-11-13T11:43:06.630 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T11:43:06.641 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T11:43:06.678 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T11:43:06.678 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/039) 2023-11-13T11:43:07.252 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T11:43:07.267 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T11:43:07.268 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T11:43:07.715 INFO:teuthology.orchestra.run.smithi102.stdout:generic/039 [not run] this test requires a valid $SCRATCH_DEV 2023-11-13T11:43:07.727 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/039 2023-11-13T11:43:07.727 INFO:teuthology.orchestra.run.smithi102.stdout:Not run: generic/039 2023-11-13T11:43:07.728 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T11:43:07.737 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T11:43:07.768 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T11:43:07.769 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/040) 2023-11-13T11:43:08.322 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T11:43:08.335 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T11:43:08.335 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T11:43:08.792 INFO:teuthology.orchestra.run.smithi102.stdout:generic/040 [not run] this test requires a valid $SCRATCH_DEV 2023-11-13T11:43:08.806 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/040 2023-11-13T11:43:08.806 INFO:teuthology.orchestra.run.smithi102.stdout:Not run: generic/040 2023-11-13T11:43:08.806 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T11:43:08.815 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T11:43:08.844 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T11:43:08.845 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/041) 2023-11-13T11:43:09.429 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T11:43:09.447 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T11:43:09.447 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T11:43:09.877 INFO:teuthology.orchestra.run.smithi102.stdout:generic/041 [not run] this test requires a valid $SCRATCH_DEV 2023-11-13T11:43:09.893 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/041 2023-11-13T11:43:09.893 INFO:teuthology.orchestra.run.smithi102.stdout:Not run: generic/041 2023-11-13T11:43:09.894 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T11:43:09.901 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T11:43:09.934 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T11:43:09.935 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/042) 2023-11-13T11:43:10.501 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T11:43:10.518 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T11:43:10.518 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T11:43:10.922 INFO:teuthology.orchestra.run.smithi102.stdout:generic/042 [not run] this test requires a valid $SCRATCH_DEV 2023-11-13T11:43:10.939 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/042 2023-11-13T11:43:10.940 INFO:teuthology.orchestra.run.smithi102.stdout:Not run: generic/042 2023-11-13T11:43:10.940 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T11:43:10.948 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T11:43:10.982 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T11:43:10.983 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/043) 2023-11-13T11:43:11.544 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T11:43:11.559 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T11:43:11.559 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T11:43:11.960 INFO:teuthology.orchestra.run.smithi102.stdout:generic/043 [not run] this test requires a valid $SCRATCH_DEV 2023-11-13T11:43:11.975 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/043 2023-11-13T11:43:11.975 INFO:teuthology.orchestra.run.smithi102.stdout:Not run: generic/043 2023-11-13T11:43:11.976 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T11:43:11.988 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T11:43:12.020 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T11:43:12.020 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/044) 2023-11-13T11:43:12.584 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T11:43:12.600 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T11:43:12.601 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T11:43:13.013 INFO:teuthology.orchestra.run.smithi102.stdout:generic/044 [not run] this test requires a valid $SCRATCH_DEV 2023-11-13T11:43:13.028 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/044 2023-11-13T11:43:13.029 INFO:teuthology.orchestra.run.smithi102.stdout:Not run: generic/044 2023-11-13T11:43:13.029 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T11:43:13.039 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T11:43:13.107 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T11:43:13.108 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/045) 2023-11-13T11:43:13.674 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T11:43:13.688 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T11:43:13.689 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T11:43:14.107 INFO:teuthology.orchestra.run.smithi102.stdout:generic/045 [not run] this test requires a valid $SCRATCH_DEV 2023-11-13T11:43:14.119 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/045 2023-11-13T11:43:14.119 INFO:teuthology.orchestra.run.smithi102.stdout:Not run: generic/045 2023-11-13T11:43:14.120 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T11:43:14.128 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T11:43:14.158 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T11:43:14.159 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/046) 2023-11-13T11:43:14.752 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T11:43:14.769 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T11:43:14.770 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T11:43:15.206 INFO:teuthology.orchestra.run.smithi102.stdout:generic/046 [not run] this test requires a valid $SCRATCH_DEV 2023-11-13T11:43:15.223 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/046 2023-11-13T11:43:15.224 INFO:teuthology.orchestra.run.smithi102.stdout:Not run: generic/046 2023-11-13T11:43:15.224 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T11:43:15.233 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T11:43:15.272 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T11:43:15.273 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/047) 2023-11-13T11:43:15.862 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T11:43:15.878 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T11:43:15.878 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T11:43:16.280 INFO:teuthology.orchestra.run.smithi102.stdout:generic/047 [not run] this test requires a valid $SCRATCH_DEV 2023-11-13T11:43:16.292 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/047 2023-11-13T11:43:16.292 INFO:teuthology.orchestra.run.smithi102.stdout:Not run: generic/047 2023-11-13T11:43:16.292 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T11:43:16.301 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T11:43:16.331 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T11:43:16.332 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/048) 2023-11-13T11:43:16.717 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T11:43:16.722 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T11:43:16.856 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T11:43:16.870 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T11:43:16.871 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T11:43:17.278 INFO:teuthology.orchestra.run.smithi102.stdout:generic/048 [not run] this test requires a valid $SCRATCH_DEV 2023-11-13T11:43:17.292 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/048 2023-11-13T11:43:17.293 INFO:teuthology.orchestra.run.smithi102.stdout:Not run: generic/048 2023-11-13T11:43:17.293 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T11:43:17.302 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T11:43:17.374 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T11:43:17.374 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/049) 2023-11-13T11:43:17.825 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T11:43:17.840 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T11:43:17.840 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T11:43:18.273 INFO:teuthology.orchestra.run.smithi102.stdout:generic/049 [not run] this test requires a valid $SCRATCH_DEV 2023-11-13T11:43:18.289 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/049 2023-11-13T11:43:18.289 INFO:teuthology.orchestra.run.smithi102.stdout:Not run: generic/049 2023-11-13T11:43:18.289 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T11:43:18.299 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T11:43:18.371 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T11:43:18.372 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/050) 2023-11-13T11:43:18.943 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T11:43:18.959 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T11:43:18.960 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T11:43:19.390 INFO:teuthology.orchestra.run.smithi102.stdout:generic/050 [not run] this test requires a valid $SCRATCH_DEV 2023-11-13T11:43:19.407 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/050 2023-11-13T11:43:19.408 INFO:teuthology.orchestra.run.smithi102.stdout:Not run: generic/050 2023-11-13T11:43:19.408 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T11:43:19.417 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T11:43:19.492 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T11:43:19.492 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/051) 2023-11-13T11:43:20.061 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T11:43:20.080 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T11:43:20.080 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T11:43:20.499 INFO:teuthology.orchestra.run.smithi102.stdout:generic/051 [not run] this test requires a valid $SCRATCH_DEV 2023-11-13T11:43:20.510 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/051 2023-11-13T11:43:20.510 INFO:teuthology.orchestra.run.smithi102.stdout:Not run: generic/051 2023-11-13T11:43:20.510 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T11:43:20.520 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T11:43:20.550 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T11:43:20.551 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/052) 2023-11-13T11:43:21.120 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T11:43:21.134 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T11:43:21.134 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T11:43:21.545 INFO:teuthology.orchestra.run.smithi102.stdout:generic/052 [not run] this test requires a valid $SCRATCH_DEV 2023-11-13T11:43:21.558 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/052 2023-11-13T11:43:21.558 INFO:teuthology.orchestra.run.smithi102.stdout:Not run: generic/052 2023-11-13T11:43:21.558 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T11:43:21.569 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T11:43:21.603 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T11:43:21.604 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/053) 2023-11-13T11:43:22.184 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T11:43:22.198 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T11:43:22.198 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T11:43:22.630 INFO:teuthology.orchestra.run.smithi102.stdout:generic/053 [not run] this test requires a valid $SCRATCH_DEV 2023-11-13T11:43:22.641 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/053 2023-11-13T11:43:22.642 INFO:teuthology.orchestra.run.smithi102.stdout:Not run: generic/053 2023-11-13T11:43:22.642 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T11:43:22.650 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T11:43:22.693 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T11:43:22.694 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/054) 2023-11-13T11:43:23.306 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T11:43:23.321 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T11:43:23.322 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T11:43:23.722 INFO:teuthology.orchestra.run.smithi102.stdout:generic/054 [not run] this test requires a valid $SCRATCH_DEV 2023-11-13T11:43:23.736 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/054 2023-11-13T11:43:23.736 INFO:teuthology.orchestra.run.smithi102.stdout:Not run: generic/054 2023-11-13T11:43:23.737 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T11:43:23.744 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T11:43:23.780 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T11:43:23.781 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/055) 2023-11-13T11:43:24.347 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T11:43:24.362 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T11:43:24.362 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T11:43:24.770 INFO:teuthology.orchestra.run.smithi102.stdout:generic/055 [not run] this test requires a valid $SCRATCH_DEV 2023-11-13T11:43:24.786 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/055 2023-11-13T11:43:24.786 INFO:teuthology.orchestra.run.smithi102.stdout:Not run: generic/055 2023-11-13T11:43:24.787 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T11:43:24.795 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T11:43:24.830 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T11:43:24.831 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/056) 2023-11-13T11:43:25.416 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T11:43:25.434 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T11:43:25.434 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T11:43:25.874 INFO:teuthology.orchestra.run.smithi102.stdout:generic/056 [not run] this test requires a valid $SCRATCH_DEV 2023-11-13T11:43:25.888 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/056 2023-11-13T11:43:25.888 INFO:teuthology.orchestra.run.smithi102.stdout:Not run: generic/056 2023-11-13T11:43:25.888 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T11:43:25.895 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T11:43:25.921 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T11:43:25.921 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/057) 2023-11-13T11:43:26.504 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T11:43:26.518 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T11:43:26.518 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T11:43:26.953 INFO:teuthology.orchestra.run.smithi102.stdout:generic/057 [not run] this test requires a valid $SCRATCH_DEV 2023-11-13T11:43:26.965 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/057 2023-11-13T11:43:26.966 INFO:teuthology.orchestra.run.smithi102.stdout:Not run: generic/057 2023-11-13T11:43:26.966 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T11:43:26.976 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T11:43:27.009 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T11:43:27.009 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/058) 2023-11-13T11:43:27.574 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T11:43:27.589 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T11:43:27.589 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T11:43:30.407 INFO:teuthology.orchestra.run.smithi102.stdout:generic/058 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2023-11-13T11:43:30.418 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/058 2023-11-13T11:43:30.418 INFO:teuthology.orchestra.run.smithi102.stdout:Not run: generic/058 2023-11-13T11:43:30.418 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T11:43:30.428 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T11:43:30.518 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T11:43:30.518 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/059) 2023-11-13T11:43:31.318 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T11:43:31.335 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T11:43:31.336 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T11:43:31.776 INFO:teuthology.orchestra.run.smithi102.stdout:generic/059 [not run] this test requires a valid $SCRATCH_DEV 2023-11-13T11:43:31.789 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/059 2023-11-13T11:43:31.789 INFO:teuthology.orchestra.run.smithi102.stdout:Not run: generic/059 2023-11-13T11:43:31.789 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T11:43:31.798 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T11:43:31.861 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T11:43:31.862 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/060) 2023-11-13T11:43:32.416 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T11:43:32.432 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T11:43:32.432 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T11:43:35.426 INFO:teuthology.orchestra.run.smithi102.stdout:generic/060 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2023-11-13T11:43:35.439 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/060 2023-11-13T11:43:35.439 INFO:teuthology.orchestra.run.smithi102.stdout:Not run: generic/060 2023-11-13T11:43:35.440 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T11:43:35.449 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T11:43:35.571 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T11:43:35.571 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/061) 2023-11-13T11:43:36.306 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T11:43:36.321 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T11:43:36.352 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T11:43:38.580 INFO:teuthology.orchestra.run.smithi102.stdout:generic/061 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2023-11-13T11:43:38.588 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/061 2023-11-13T11:43:38.588 INFO:teuthology.orchestra.run.smithi102.stdout:Not run: generic/061 2023-11-13T11:43:38.588 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T11:43:38.594 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T11:43:38.668 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T11:43:38.669 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/062) 2023-11-13T11:43:39.263 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T11:43:39.273 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T11:43:39.274 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T11:43:39.535 INFO:teuthology.orchestra.run.smithi102.stdout:generic/062 [not run] this test requires a valid $SCRATCH_DEV 2023-11-13T11:43:39.543 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/062 2023-11-13T11:43:39.544 INFO:teuthology.orchestra.run.smithi102.stdout:Not run: generic/062 2023-11-13T11:43:39.544 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T11:43:39.549 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T11:43:39.577 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T11:43:39.577 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/063) 2023-11-13T11:43:39.936 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T11:43:39.946 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T11:43:39.947 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T11:43:41.419 INFO:teuthology.orchestra.run.smithi102.stdout:generic/063 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2023-11-13T11:43:41.427 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/063 2023-11-13T11:43:41.427 INFO:teuthology.orchestra.run.smithi102.stdout:Not run: generic/063 2023-11-13T11:43:41.427 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T11:43:41.433 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T11:43:41.463 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T11:43:41.464 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/064) 2023-11-13T11:43:42.090 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T11:43:42.100 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T11:43:42.101 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T11:43:42.386 INFO:teuthology.orchestra.run.smithi102.stdout:generic/064 [not run] this test requires a valid $SCRATCH_DEV 2023-11-13T11:43:42.394 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/064 2023-11-13T11:43:42.394 INFO:teuthology.orchestra.run.smithi102.stdout:Not run: generic/064 2023-11-13T11:43:42.395 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T11:43:42.401 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T11:43:42.420 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T11:43:42.420 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/065) 2023-11-13T11:43:42.780 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T11:43:42.790 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T11:43:42.790 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T11:43:43.077 INFO:teuthology.orchestra.run.smithi102.stdout:generic/065 [not run] this test requires a valid $SCRATCH_DEV 2023-11-13T11:43:43.086 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/065 2023-11-13T11:43:43.086 INFO:teuthology.orchestra.run.smithi102.stdout:Not run: generic/065 2023-11-13T11:43:43.086 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T11:43:43.092 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T11:43:43.111 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T11:43:43.112 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/066) 2023-11-13T11:43:43.476 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T11:43:43.487 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T11:43:43.487 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T11:43:43.828 INFO:teuthology.orchestra.run.smithi102.stdout:generic/066 [not run] this test requires a valid $SCRATCH_DEV 2023-11-13T11:43:43.836 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/066 2023-11-13T11:43:43.837 INFO:teuthology.orchestra.run.smithi102.stdout:Not run: generic/066 2023-11-13T11:43:43.837 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T11:43:43.842 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T11:43:43.862 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T11:43:43.863 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/067) 2023-11-13T11:43:44.228 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T11:43:44.238 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T11:43:44.239 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T11:43:44.544 INFO:teuthology.orchestra.run.smithi102.stdout:generic/067 [not run] this test requires a valid $SCRATCH_DEV 2023-11-13T11:43:44.553 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/067 2023-11-13T11:43:44.553 INFO:teuthology.orchestra.run.smithi102.stdout:Not run: generic/067 2023-11-13T11:43:44.553 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T11:43:44.559 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T11:43:44.579 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T11:43:44.579 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/068) 2023-11-13T11:43:44.952 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T11:43:44.965 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T11:43:44.965 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T11:43:45.275 INFO:teuthology.orchestra.run.smithi102.stdout:generic/068 [not run] this test requires a valid $SCRATCH_DEV 2023-11-13T11:43:45.283 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/068 2023-11-13T11:43:45.283 INFO:teuthology.orchestra.run.smithi102.stdout:Not run: generic/068 2023-11-13T11:43:45.284 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T11:43:45.289 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T11:43:45.309 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T11:43:45.310 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/069) 2023-11-13T11:43:45.679 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T11:43:45.689 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T11:43:45.689 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T11:43:45.958 INFO:teuthology.orchestra.run.smithi102.stdout:generic/069 [not run] this test requires a valid $SCRATCH_DEV 2023-11-13T11:43:45.966 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/069 2023-11-13T11:43:45.967 INFO:teuthology.orchestra.run.smithi102.stdout:Not run: generic/069 2023-11-13T11:43:45.967 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T11:43:45.972 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T11:43:45.992 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T11:43:45.993 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/070) 2023-11-13T11:43:46.352 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T11:43:46.363 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T11:43:46.363 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T11:43:47.596 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T11:43:47.600 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T11:44:18.713 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T11:44:18.718 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T11:44:48.772 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T11:44:48.777 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T11:44:57.724 INFO:teuthology.orchestra.run.smithi102.stdout:generic/070 71s 2023-11-13T11:44:57.736 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/070 2023-11-13T11:44:57.737 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T11:44:57.743 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T11:44:57.876 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T11:44:57.876 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/071) 2023-11-13T11:44:58.432 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T11:44:58.442 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T11:44:58.443 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T11:44:58.731 INFO:teuthology.orchestra.run.smithi102.stdout:generic/071 [not run] this test requires a valid $SCRATCH_DEV 2023-11-13T11:44:58.741 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/071 2023-11-13T11:44:58.742 INFO:teuthology.orchestra.run.smithi102.stdout:Not run: generic/071 2023-11-13T11:44:58.742 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T11:44:58.751 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T11:44:58.780 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T11:44:58.780 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/072) 2023-11-13T11:44:59.333 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T11:44:59.348 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T11:44:59.348 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T11:45:01.995 INFO:teuthology.orchestra.run.smithi102.stdout:generic/072 [not run] xfs_io fcollapse failed (old kernel/wrong fs?) 2023-11-13T11:45:02.007 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/072 2023-11-13T11:45:02.008 INFO:teuthology.orchestra.run.smithi102.stdout:Not run: generic/072 2023-11-13T11:45:02.008 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T11:45:02.017 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T11:45:02.047 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T11:45:02.048 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/073) 2023-11-13T11:45:02.596 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T11:45:02.614 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T11:45:02.614 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T11:45:03.066 INFO:teuthology.orchestra.run.smithi102.stdout:generic/073 [not run] this test requires a valid $SCRATCH_DEV 2023-11-13T11:45:03.075 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/073 2023-11-13T11:45:03.075 INFO:teuthology.orchestra.run.smithi102.stdout:Not run: generic/073 2023-11-13T11:45:03.076 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T11:45:03.083 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T11:45:03.114 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T11:45:03.115 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/074) 2023-11-13T11:45:03.658 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T11:45:03.671 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T11:45:03.672 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T11:45:19.176 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T11:45:19.182 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T11:45:49.412 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T11:45:49.426 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T11:46:19.526 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T11:46:19.533 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T11:46:49.601 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T11:46:49.610 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T11:47:19.821 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T11:47:19.826 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T11:47:50.067 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T11:47:50.101 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T11:48:20.256 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T11:48:20.263 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T11:48:50.333 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T11:48:50.339 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T11:49:20.408 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T11:49:20.414 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T11:49:50.481 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T11:49:50.488 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T11:50:20.545 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T11:50:20.551 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T11:50:50.609 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T11:50:50.619 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T11:51:20.692 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T11:51:20.700 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T11:51:50.799 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T11:51:50.806 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T11:52:20.878 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T11:52:20.886 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T11:52:51.024 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T11:52:51.028 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T11:53:22.005 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T11:53:22.012 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T11:53:52.123 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T11:53:52.128 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T11:54:22.193 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T11:54:22.199 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T11:54:52.374 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T11:54:52.380 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T11:55:22.439 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T11:55:22.453 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T11:55:52.549 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T11:55:52.555 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T11:56:22.673 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T11:56:22.678 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T11:56:52.952 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T11:56:52.959 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T11:57:23.128 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T11:57:23.136 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T11:57:53.266 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T11:57:53.276 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T11:58:23.417 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T11:58:23.424 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T11:58:53.533 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T11:58:53.539 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T11:59:23.620 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T11:59:23.625 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T11:59:53.696 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T11:59:53.702 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T12:00:23.765 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T12:00:23.772 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T12:00:53.844 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T12:00:53.850 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T12:01:23.909 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T12:01:23.914 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T12:01:54.858 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T12:01:54.864 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T12:02:24.936 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T12:02:24.942 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T12:02:55.056 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T12:02:55.061 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T12:03:25.373 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T12:03:25.378 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T12:03:55.468 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T12:03:55.481 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T12:04:26.593 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T12:04:26.601 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T12:04:56.693 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T12:04:56.699 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T12:05:26.767 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T12:05:26.779 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T12:05:56.868 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T12:05:56.875 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T12:06:26.957 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T12:06:26.966 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T12:06:57.054 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T12:06:57.060 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T12:07:27.134 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T12:07:27.139 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T12:07:57.972 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T12:07:57.984 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T12:08:28.077 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T12:08:28.083 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T12:08:58.158 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T12:08:58.164 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T12:09:29.155 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T12:09:29.161 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T12:09:59.262 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T12:09:59.270 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T12:10:29.358 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T12:10:29.373 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T12:10:29.449 INFO:tasks.ceph.osd.0.smithi102.stderr:2023-11-13T12:10:29.441+0000 7efed7bed640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 129327) UID: 0 2023-11-13T12:10:29.450 INFO:tasks.ceph.osd.2.smithi102.stderr:2023-11-13T12:10:29.441+0000 7f17fbe34640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 129327) UID: 0 2023-11-13T12:10:29.451 INFO:tasks.ceph.osd.3.smithi102.stderr:2023-11-13T12:10:29.445+0000 7f48d17a6640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 129327) UID: 0 2023-11-13T12:10:29.454 INFO:tasks.ceph.osd.1.smithi102.stderr:2023-11-13T12:10:29.449+0000 7f33d1116640 -1 Fail to open '/proc/129327/cmdline' error = (2) No such file or directory 2023-11-13T12:10:29.454 INFO:tasks.ceph.osd.1.smithi102.stderr:2023-11-13T12:10:29.449+0000 7f33d1116640 -1 received signal: Hangup from (PID: 129327) UID: 0 2023-11-13T12:12:22.646 INFO:teuthology.orchestra.run.smithi102.stdout:generic/074 1639s 2023-11-13T12:12:22.862 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/074 2023-11-13T12:12:22.862 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T12:12:22.886 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T12:12:22.907 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T12:12:22.908 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/075) 2023-11-13T12:12:24.074 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T12:12:24.085 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T12:12:24.085 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T12:13:10.815 INFO:teuthology.orchestra.run.smithi102.stdout:generic/075 46s 2023-11-13T12:13:10.827 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/075 2023-11-13T12:13:10.828 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T12:13:10.833 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T12:13:10.879 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T12:13:10.880 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/076) 2023-11-13T12:13:11.568 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T12:13:11.579 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T12:13:11.579 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T12:13:11.868 INFO:teuthology.orchestra.run.smithi102.stdout:generic/076 [not run] this test requires a valid $SCRATCH_DEV 2023-11-13T12:13:11.877 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/076 2023-11-13T12:13:11.877 INFO:teuthology.orchestra.run.smithi102.stdout:Not run: generic/076 2023-11-13T12:13:11.877 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T12:13:11.883 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T12:13:11.903 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T12:13:11.904 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/077) 2023-11-13T12:13:12.283 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T12:13:12.294 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T12:13:12.294 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T12:13:13.513 INFO:teuthology.orchestra.run.smithi102.stdout:generic/077 [not run] this test requires a valid $SCRATCH_DEV 2023-11-13T12:13:13.521 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/077 2023-11-13T12:13:13.522 INFO:teuthology.orchestra.run.smithi102.stdout:Not run: generic/077 2023-11-13T12:13:13.522 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T12:13:13.528 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T12:13:13.547 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T12:13:13.548 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/078) 2023-11-13T12:13:13.915 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T12:13:13.926 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T12:13:13.926 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T12:13:14.251 INFO:teuthology.orchestra.run.smithi102.stdout:generic/078 [not run] kernel doesn't support renameat2 syscall 2023-11-13T12:13:14.259 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/078 2023-11-13T12:13:14.259 INFO:teuthology.orchestra.run.smithi102.stdout:Not run: generic/078 2023-11-13T12:13:14.260 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T12:13:14.266 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T12:13:14.363 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T12:13:14.364 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/079) 2023-11-13T12:13:15.028 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T12:13:15.038 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T12:13:15.039 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T12:13:16.289 INFO:teuthology.orchestra.run.smithi102.stdout:generic/079 [not run] file system doesn't support chattr +ia 2023-11-13T12:13:16.297 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/079 2023-11-13T12:13:16.298 INFO:teuthology.orchestra.run.smithi102.stdout:Not run: generic/079 2023-11-13T12:13:16.298 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T12:13:16.304 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T12:13:16.325 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T12:13:16.325 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/080) 2023-11-13T12:13:16.695 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T12:13:16.706 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T12:13:16.706 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T12:13:19.118 INFO:teuthology.orchestra.run.smithi102.stdout:generic/080 3s 2023-11-13T12:13:19.131 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/080 2023-11-13T12:13:19.132 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T12:13:19.137 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T12:13:19.159 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T12:13:19.159 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/081) 2023-11-13T12:13:19.524 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T12:13:19.535 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T12:13:19.535 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T12:13:19.825 INFO:teuthology.orchestra.run.smithi102.stdout:generic/081 [not run] this test requires a valid $SCRATCH_DEV 2023-11-13T12:13:19.834 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/081 2023-11-13T12:13:19.835 INFO:teuthology.orchestra.run.smithi102.stdout:Not run: generic/081 2023-11-13T12:13:19.835 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T12:13:19.843 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T12:13:19.863 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T12:13:19.863 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/082) 2023-11-13T12:13:20.251 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T12:13:20.262 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T12:13:20.262 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T12:13:20.574 INFO:teuthology.orchestra.run.smithi102.stdout:generic/082 [not run] this test requires a valid $SCRATCH_DEV 2023-11-13T12:13:20.583 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/082 2023-11-13T12:13:20.584 INFO:teuthology.orchestra.run.smithi102.stdout:Not run: generic/082 2023-11-13T12:13:20.584 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T12:13:20.633 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T12:13:20.653 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T12:13:20.654 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/083) 2023-11-13T12:13:21.027 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T12:13:21.038 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T12:13:21.038 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T12:13:21.339 INFO:teuthology.orchestra.run.smithi102.stdout:generic/083 [not run] this test requires a valid $SCRATCH_DEV 2023-11-13T12:13:21.348 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/083 2023-11-13T12:13:21.349 INFO:teuthology.orchestra.run.smithi102.stdout:Not run: generic/083 2023-11-13T12:13:21.349 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T12:13:21.356 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T12:13:21.376 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T12:13:21.377 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/084) 2023-11-13T12:13:21.747 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T12:13:21.759 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T12:13:21.759 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T12:13:22.032 INFO:teuthology.orchestra.run.smithi102.stdout:generic/084 [not run] this test requires a valid $SCRATCH_DEV 2023-11-13T12:13:22.042 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/084 2023-11-13T12:13:22.042 INFO:teuthology.orchestra.run.smithi102.stdout:Not run: generic/084 2023-11-13T12:13:22.042 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T12:13:22.050 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T12:13:22.072 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T12:13:22.073 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/085) 2023-11-13T12:13:22.480 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T12:13:22.490 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T12:13:22.491 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T12:13:22.900 INFO:teuthology.orchestra.run.smithi102.stdout:generic/085 [not run] this test requires a valid $SCRATCH_DEV 2023-11-13T12:13:22.909 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/085 2023-11-13T12:13:22.910 INFO:teuthology.orchestra.run.smithi102.stdout:Not run: generic/085 2023-11-13T12:13:22.910 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T12:13:22.916 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T12:13:22.938 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T12:13:22.939 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/086) 2023-11-13T12:13:23.356 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T12:13:23.368 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T12:13:23.368 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T12:13:38.569 INFO:teuthology.orchestra.run.smithi102.stdout:generic/086 15s 2023-11-13T12:13:38.736 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/086 2023-11-13T12:13:38.737 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T12:13:38.742 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T12:13:38.806 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T12:13:38.807 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/087) 2023-11-13T12:13:40.437 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T12:13:40.447 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T12:13:40.448 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T12:13:40.994 INFO:teuthology.orchestra.run.smithi102.stdout:generic/087 0s 2023-11-13T12:13:41.006 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/087 2023-11-13T12:13:41.007 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T12:13:41.012 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T12:13:41.071 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T12:13:41.072 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/088) 2023-11-13T12:13:41.699 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T12:13:41.710 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T12:13:41.710 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T12:13:42.084 INFO:teuthology.orchestra.run.smithi102.stdout:generic/088 1s 2023-11-13T12:13:42.097 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/088 2023-11-13T12:13:42.097 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T12:13:42.103 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T12:13:42.145 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T12:13:42.146 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/089) 2023-11-13T12:13:42.791 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T12:13:42.802 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T12:13:42.802 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T12:13:53.514 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T12:13:53.520 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T12:14:24.982 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T12:14:24.987 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T12:14:55.437 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T12:14:55.442 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T12:15:25.494 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T12:15:25.499 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T12:15:55.559 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T12:15:55.565 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T12:16:25.993 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T12:16:25.997 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T12:16:56.049 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T12:16:56.061 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T12:16:56.102 INFO:tasks.ceph.mds.c.smithi102.stderr:2023-11-13T12:16:56.098+0000 7fe15259f640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 136879) UID: 0 2023-11-13T12:16:56.102 INFO:tasks.ceph.mds.a.smithi102.stderr:2023-11-13T12:16:56.098+0000 7fd988155640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 136879) UID: 0 2023-11-13T12:20:17.503 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T12:20:17.508 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T12:20:47.600 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T12:20:47.605 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T12:21:17.673 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T12:21:17.680 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T12:21:17.709 INFO:tasks.ceph.mds.c.smithi102.stderr:2023-11-13T12:21:17.705+0000 7fe15259f640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 137111) UID: 0 2023-11-13T12:21:17.710 INFO:tasks.ceph.mds.a.smithi102.stderr:2023-11-13T12:21:17.705+0000 7fd988155640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 137111) UID: 0 2023-11-13T12:24:11.501 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T12:24:11.505 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T12:24:41.934 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T12:24:41.939 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T12:25:13.347 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T12:25:13.352 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T12:25:43.430 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T12:25:43.434 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T12:26:13.509 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T12:26:13.514 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T12:26:13.542 INFO:tasks.ceph.mds.c.smithi102.stderr:2023-11-13T12:26:13.540+0000 7fe15259f640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 139143) UID: 0 2023-11-13T12:26:13.543 INFO:tasks.ceph.mds.a.smithi102.stderr:2023-11-13T12:26:13.540+0000 7fd988155640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 139143) UID: 0 2023-11-13T12:29:12.015 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T12:29:12.020 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T12:29:42.338 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T12:29:42.346 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T12:30:12.457 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T12:30:12.461 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T12:30:42.543 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T12:30:42.549 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T12:31:13.384 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T12:31:13.388 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T12:31:34.268 INFO:teuthology.orchestra.run.smithi102.stdout:generic/089 1072s 2023-11-13T12:31:34.343 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/089 2023-11-13T12:31:34.343 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T12:31:34.349 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T12:31:34.376 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T12:31:34.377 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/090) 2023-11-13T12:31:35.353 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T12:31:35.364 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T12:31:35.364 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T12:31:35.730 INFO:teuthology.orchestra.run.smithi102.stdout:generic/090 [not run] this test requires a valid $SCRATCH_DEV 2023-11-13T12:31:35.737 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/090 2023-11-13T12:31:35.738 INFO:teuthology.orchestra.run.smithi102.stdout:Not run: generic/090 2023-11-13T12:31:35.738 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T12:31:35.744 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T12:31:35.763 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T12:31:35.764 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/091) 2023-11-13T12:31:36.122 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T12:31:36.132 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T12:31:36.132 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T12:31:43.452 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T12:31:43.457 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T12:31:43.491 INFO:tasks.ceph.mds.c.smithi102.stderr:2023-11-13T12:31:43.485+0000 7fe15259f640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 140016) UID: 0 2023-11-13T12:31:43.491 INFO:tasks.ceph.mds.a.smithi102.stderr:2023-11-13T12:31:43.485+0000 7fd988155640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 140016) UID: 0 2023-11-13T12:34:00.214 INFO:teuthology.orchestra.run.smithi102.stdout:generic/091 144s 2023-11-13T12:34:00.227 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/091 2023-11-13T12:34:00.227 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T12:34:00.233 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T12:34:00.292 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T12:34:00.293 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/092) 2023-11-13T12:34:00.929 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T12:34:00.940 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T12:34:00.940 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T12:34:01.319 INFO:teuthology.orchestra.run.smithi102.stdout:generic/092 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2023-11-13T12:34:01.328 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/092 2023-11-13T12:34:01.328 INFO:teuthology.orchestra.run.smithi102.stdout:Not run: generic/092 2023-11-13T12:34:01.328 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T12:34:01.334 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T12:34:01.489 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T12:34:01.490 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/093) 2023-11-13T12:34:02.041 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T12:34:02.053 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T12:34:02.053 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T12:34:03.130 INFO:teuthology.orchestra.run.smithi102.stdout:generic/093 1s 2023-11-13T12:34:03.143 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/093 2023-11-13T12:34:03.143 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T12:34:03.149 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T12:34:03.188 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T12:34:03.188 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/094) 2023-11-13T12:34:03.848 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T12:34:03.859 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T12:34:03.859 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T12:34:04.127 INFO:teuthology.orchestra.run.smithi102.stdout:generic/094 [not run] this test requires a valid $SCRATCH_DEV 2023-11-13T12:34:04.135 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/094 2023-11-13T12:34:04.135 INFO:teuthology.orchestra.run.smithi102.stdout:Not run: generic/094 2023-11-13T12:34:04.135 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T12:34:04.141 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T12:34:04.161 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T12:34:04.162 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/095) 2023-11-13T12:34:04.538 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T12:34:04.548 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T12:34:04.548 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T12:34:04.822 INFO:teuthology.orchestra.run.smithi102.stdout:generic/095 [not run] this test requires a valid $SCRATCH_DEV 2023-11-13T12:34:04.830 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/095 2023-11-13T12:34:04.830 INFO:teuthology.orchestra.run.smithi102.stdout:Not run: generic/095 2023-11-13T12:34:04.831 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T12:34:04.836 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T12:34:04.858 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T12:34:04.859 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/096) 2023-11-13T12:34:05.235 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T12:34:05.245 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T12:34:05.246 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T12:34:05.553 INFO:teuthology.orchestra.run.smithi102.stdout:generic/096 [not run] this test requires a valid $SCRATCH_DEV 2023-11-13T12:34:05.561 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/096 2023-11-13T12:34:05.562 INFO:teuthology.orchestra.run.smithi102.stdout:Not run: generic/096 2023-11-13T12:34:05.562 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T12:34:05.567 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T12:34:05.589 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T12:34:05.589 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/097) 2023-11-13T12:34:05.945 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T12:34:05.956 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T12:34:05.956 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T12:34:06.861 INFO:teuthology.orchestra.run.smithi102.stdout:generic/097 1s 2023-11-13T12:34:06.874 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/097 2023-11-13T12:34:06.874 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T12:34:06.880 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T12:34:06.899 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T12:34:06.899 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/098) 2023-11-13T12:34:07.278 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T12:34:07.288 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T12:34:07.288 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T12:34:07.561 INFO:teuthology.orchestra.run.smithi102.stdout:generic/098 [not run] this test requires a valid $SCRATCH_DEV 2023-11-13T12:34:07.569 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/098 2023-11-13T12:34:07.569 INFO:teuthology.orchestra.run.smithi102.stdout:Not run: generic/098 2023-11-13T12:34:07.569 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T12:34:07.575 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T12:34:07.595 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T12:34:07.596 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/099) 2023-11-13T12:34:07.986 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T12:34:07.997 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T12:34:07.997 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T12:34:08.359 INFO:teuthology.orchestra.run.smithi102.stdout:generic/099 [not run] ACLs not supported by this filesystem type: ceph-fuse 2023-11-13T12:34:08.367 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/099 2023-11-13T12:34:08.367 INFO:teuthology.orchestra.run.smithi102.stdout:Not run: generic/099 2023-11-13T12:34:08.367 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T12:34:08.373 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T12:34:08.392 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T12:34:08.393 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/100) 2023-11-13T12:34:08.741 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T12:34:08.752 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T12:34:08.752 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T12:34:26.737 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T12:34:26.741 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T12:34:26.767 INFO:tasks.ceph.osd.0.smithi102.stderr:2023-11-13T12:34:26.762+0000 7efed7bed640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 157815) UID: 0 2023-11-13T12:34:26.767 INFO:tasks.ceph.osd.3.smithi102.stderr:2023-11-13T12:34:26.762+0000 7f48d17a6640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 157815) UID: 0 2023-11-13T12:34:26.768 INFO:tasks.ceph.osd.2.smithi102.stderr:2023-11-13T12:34:26.762+0000 7f17fbe34640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 157815) UID: 0 2023-11-13T12:34:26.768 INFO:tasks.ceph.osd.1.smithi102.stderr:2023-11-13T12:34:26.762+0000 7f33d1116640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 157815) UID: 0 2023-11-13T12:34:59.283 INFO:teuthology.orchestra.run.smithi102.stdout:generic/100 51s 2023-11-13T12:34:59.296 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/100 2023-11-13T12:34:59.296 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T12:34:59.303 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T12:34:59.362 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T12:34:59.363 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/101) 2023-11-13T12:35:00.181 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T12:35:00.191 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T12:35:00.192 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T12:35:00.538 INFO:teuthology.orchestra.run.smithi102.stdout:generic/101 [not run] this test requires a valid $SCRATCH_DEV 2023-11-13T12:35:00.546 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/101 2023-11-13T12:35:00.547 INFO:teuthology.orchestra.run.smithi102.stdout:Not run: generic/101 2023-11-13T12:35:00.547 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T12:35:00.553 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T12:35:00.573 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T12:35:00.573 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/102) 2023-11-13T12:35:00.946 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T12:35:00.956 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T12:35:00.957 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T12:35:01.387 INFO:teuthology.orchestra.run.smithi102.stdout:generic/102 [not run] this test requires a valid $SCRATCH_DEV 2023-11-13T12:35:01.395 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/102 2023-11-13T12:35:01.396 INFO:teuthology.orchestra.run.smithi102.stdout:Not run: generic/102 2023-11-13T12:35:01.396 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T12:35:01.402 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T12:35:01.421 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T12:35:01.421 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/103) 2023-11-13T12:35:01.795 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T12:35:01.806 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T12:35:01.806 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T12:35:02.581 INFO:teuthology.orchestra.run.smithi102.stdout:generic/103 [not run] this test requires a valid $SCRATCH_DEV 2023-11-13T12:35:02.589 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/103 2023-11-13T12:35:02.589 INFO:teuthology.orchestra.run.smithi102.stdout:Not run: generic/103 2023-11-13T12:35:02.589 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T12:35:02.595 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T12:35:02.614 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T12:35:02.615 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/104) 2023-11-13T12:35:03.157 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T12:35:03.168 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T12:35:03.168 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T12:35:03.783 INFO:teuthology.orchestra.run.smithi102.stdout:generic/104 [not run] this test requires a valid $SCRATCH_DEV 2023-11-13T12:35:03.791 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/104 2023-11-13T12:35:03.792 INFO:teuthology.orchestra.run.smithi102.stdout:Not run: generic/104 2023-11-13T12:35:03.792 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T12:35:03.798 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T12:35:03.819 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T12:35:03.819 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/105) 2023-11-13T12:35:04.195 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T12:35:04.206 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T12:35:04.206 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T12:35:04.508 INFO:teuthology.orchestra.run.smithi102.stdout:generic/105 [not run] this test requires a valid $SCRATCH_DEV 2023-11-13T12:35:04.516 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/105 2023-11-13T12:35:04.516 INFO:teuthology.orchestra.run.smithi102.stdout:Not run: generic/105 2023-11-13T12:35:04.517 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T12:35:04.523 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T12:35:04.542 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T12:35:04.542 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/106) 2023-11-13T12:35:04.931 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T12:35:04.942 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T12:35:04.942 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T12:35:05.256 INFO:teuthology.orchestra.run.smithi102.stdout:generic/106 [not run] this test requires a valid $SCRATCH_DEV 2023-11-13T12:35:05.264 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/106 2023-11-13T12:35:05.265 INFO:teuthology.orchestra.run.smithi102.stdout:Not run: generic/106 2023-11-13T12:35:05.265 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T12:35:05.271 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T12:35:05.291 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T12:35:05.292 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/107) 2023-11-13T12:35:05.669 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T12:35:05.680 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T12:35:05.681 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T12:35:06.006 INFO:teuthology.orchestra.run.smithi102.stdout:generic/107 [not run] this test requires a valid $SCRATCH_DEV 2023-11-13T12:35:06.014 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/107 2023-11-13T12:35:06.014 INFO:teuthology.orchestra.run.smithi102.stdout:Not run: generic/107 2023-11-13T12:35:06.014 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T12:35:06.020 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T12:35:06.039 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T12:35:06.040 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/108) 2023-11-13T12:35:06.402 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T12:35:06.413 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T12:35:06.413 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T12:35:07.090 INFO:teuthology.orchestra.run.smithi102.stdout:generic/108 [not run] this test requires a valid $SCRATCH_DEV 2023-11-13T12:35:07.098 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/108 2023-11-13T12:35:07.099 INFO:teuthology.orchestra.run.smithi102.stdout:Not run: generic/108 2023-11-13T12:35:07.099 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T12:35:07.105 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T12:35:07.126 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T12:35:07.127 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/109) 2023-11-13T12:35:07.541 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T12:35:07.552 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T12:35:07.553 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T12:35:07.844 INFO:teuthology.orchestra.run.smithi102.stdout:generic/109 [not run] this test requires a valid $SCRATCH_DEV 2023-11-13T12:35:07.852 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/109 2023-11-13T12:35:07.852 INFO:teuthology.orchestra.run.smithi102.stdout:Not run: generic/109 2023-11-13T12:35:07.853 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T12:35:07.859 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T12:35:07.913 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T12:35:07.913 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/110) 2023-11-13T12:35:08.293 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T12:35:08.304 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T12:35:08.304 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T12:35:08.684 INFO:teuthology.orchestra.run.smithi102.stdout:generic/110 [not run] Reflink not supported by test filesystem type: ceph-fuse 2023-11-13T12:35:08.692 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/110 2023-11-13T12:35:08.693 INFO:teuthology.orchestra.run.smithi102.stdout:Not run: generic/110 2023-11-13T12:35:08.693 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T12:35:08.699 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T12:35:08.771 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T12:35:08.772 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/111) 2023-11-13T12:35:09.427 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T12:35:09.439 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T12:35:09.439 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T12:35:09.810 INFO:teuthology.orchestra.run.smithi102.stdout:generic/111 [not run] Reflink not supported by test filesystem type: ceph-fuse 2023-11-13T12:35:09.818 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/111 2023-11-13T12:35:09.819 INFO:teuthology.orchestra.run.smithi102.stdout:Not run: generic/111 2023-11-13T12:35:09.819 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T12:35:09.825 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T12:35:09.886 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T12:35:09.886 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/112) 2023-11-13T12:35:10.570 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T12:35:10.581 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T12:35:10.581 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T12:36:00.117 INFO:teuthology.orchestra.run.smithi102.stdout:generic/112 50s 2023-11-13T12:36:00.130 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/112 2023-11-13T12:36:00.130 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T12:36:00.136 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T12:36:00.178 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T12:36:00.179 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/113) 2023-11-13T12:36:00.862 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T12:36:00.873 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T12:36:00.873 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T12:36:49.944 INFO:teuthology.orchestra.run.smithi102.stdout:generic/113 49s 2023-11-13T12:36:49.956 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/113 2023-11-13T12:36:49.957 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T12:36:49.963 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T12:36:50.080 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T12:36:50.081 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/114) 2023-11-13T12:36:51.042 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T12:36:51.052 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T12:36:51.053 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T12:36:51.508 INFO:teuthology.orchestra.run.smithi102.stdout:generic/114 [not run] device block size: 4096 greater than 512 2023-11-13T12:36:51.516 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/114 2023-11-13T12:36:51.516 INFO:teuthology.orchestra.run.smithi102.stdout:Not run: generic/114 2023-11-13T12:36:51.516 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T12:36:51.522 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T12:36:51.543 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T12:36:51.543 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/115) 2023-11-13T12:36:51.918 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T12:36:51.929 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T12:36:51.929 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T12:36:52.310 INFO:teuthology.orchestra.run.smithi102.stdout:generic/115 [not run] Reflink not supported by test filesystem type: ceph-fuse 2023-11-13T12:36:52.319 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/115 2023-11-13T12:36:52.319 INFO:teuthology.orchestra.run.smithi102.stdout:Not run: generic/115 2023-11-13T12:36:52.320 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T12:36:52.325 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T12:36:52.365 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T12:36:52.366 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/116) 2023-11-13T12:36:53.084 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T12:36:53.095 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T12:36:53.095 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T12:36:53.457 INFO:teuthology.orchestra.run.smithi102.stdout:generic/116 [not run] Reflink not supported by test filesystem type: ceph-fuse 2023-11-13T12:36:53.465 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/116 2023-11-13T12:36:53.466 INFO:teuthology.orchestra.run.smithi102.stdout:Not run: generic/116 2023-11-13T12:36:53.466 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T12:36:53.472 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T12:36:53.507 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T12:36:53.508 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/117) 2023-11-13T12:36:54.182 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T12:36:54.193 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T12:36:54.193 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T12:36:54.483 INFO:teuthology.orchestra.run.smithi102.stdout:generic/117 [not run] this test requires a valid $SCRATCH_DEV 2023-11-13T12:36:54.491 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/117 2023-11-13T12:36:54.492 INFO:teuthology.orchestra.run.smithi102.stdout:Not run: generic/117 2023-11-13T12:36:54.492 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T12:36:54.498 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T12:36:54.518 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T12:36:54.519 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/118) 2023-11-13T12:36:54.904 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T12:36:54.919 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T12:36:54.919 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T12:36:55.294 INFO:teuthology.orchestra.run.smithi102.stdout:generic/118 [not run] Reflink not supported by test filesystem type: ceph-fuse 2023-11-13T12:36:55.304 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/118 2023-11-13T12:36:55.304 INFO:teuthology.orchestra.run.smithi102.stdout:Not run: generic/118 2023-11-13T12:36:55.304 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T12:36:55.310 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T12:36:55.349 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T12:36:55.350 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/119) 2023-11-13T12:36:56.029 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T12:36:56.040 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T12:36:56.040 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T12:36:56.419 INFO:teuthology.orchestra.run.smithi102.stdout:generic/119 [not run] Reflink not supported by test filesystem type: ceph-fuse 2023-11-13T12:36:56.428 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/119 2023-11-13T12:36:56.428 INFO:teuthology.orchestra.run.smithi102.stdout:Not run: generic/119 2023-11-13T12:36:56.428 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T12:36:56.434 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T12:36:56.669 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T12:36:56.670 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/120) 2023-11-13T12:36:57.182 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T12:36:57.192 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T12:36:57.193 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T12:36:57.518 INFO:teuthology.orchestra.run.smithi102.stdout:generic/120 [not run] this test requires a valid $SCRATCH_DEV 2023-11-13T12:36:57.527 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/120 2023-11-13T12:36:57.527 INFO:teuthology.orchestra.run.smithi102.stdout:Not run: generic/120 2023-11-13T12:36:57.528 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T12:36:57.533 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T12:36:57.553 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T12:36:57.554 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/121) 2023-11-13T12:36:57.914 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T12:36:57.925 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T12:36:57.925 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T12:36:58.296 INFO:teuthology.orchestra.run.smithi102.stdout:generic/121 [not run] Dedupe not supported by test filesystem type: ceph-fuse 2023-11-13T12:36:58.305 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/121 2023-11-13T12:36:58.305 INFO:teuthology.orchestra.run.smithi102.stdout:Not run: generic/121 2023-11-13T12:36:58.305 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T12:36:58.311 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T12:36:58.391 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T12:36:58.392 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/122) 2023-11-13T12:36:59.115 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T12:36:59.126 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T12:36:59.127 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T12:36:59.551 INFO:teuthology.orchestra.run.smithi102.stdout:generic/122 [not run] Dedupe not supported by test filesystem type: ceph-fuse 2023-11-13T12:36:59.561 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/122 2023-11-13T12:36:59.562 INFO:teuthology.orchestra.run.smithi102.stdout:Not run: generic/122 2023-11-13T12:36:59.562 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T12:36:59.569 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T12:36:59.776 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T12:36:59.777 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/123) 2023-11-13T12:37:00.424 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T12:37:00.436 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T12:37:00.436 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T12:37:01.473 INFO:teuthology.orchestra.run.smithi102.stdout:generic/123 1s 2023-11-13T12:37:01.486 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/123 2023-11-13T12:37:01.486 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T12:37:01.492 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T12:37:01.519 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T12:37:01.519 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/124) 2023-11-13T12:37:02.174 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T12:37:02.185 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T12:37:02.185 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T12:37:02.474 INFO:teuthology.orchestra.run.smithi102.stdout:generic/124 [not run] this test requires a valid $SCRATCH_DEV 2023-11-13T12:37:02.482 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/124 2023-11-13T12:37:02.482 INFO:teuthology.orchestra.run.smithi102.stdout:Not run: generic/124 2023-11-13T12:37:02.482 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T12:37:02.488 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T12:37:02.509 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T12:37:02.509 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/125) 2023-11-13T12:37:02.885 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T12:37:02.896 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T12:37:02.896 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T12:37:31.737 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T12:37:31.745 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T12:37:31.827 INFO:tasks.ceph.osd.5.smithi154.stderr:2023-11-13T12:37:31.820+0000 7f77ec91b640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 44456) UID: 0 2023-11-13T12:37:31.827 INFO:tasks.ceph.osd.6.smithi154.stderr:2023-11-13T12:37:31.820+0000 7f3c803e2640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 44456) UID: 0 2023-11-13T12:37:31.828 INFO:tasks.ceph.osd.7.smithi154.stderr:2023-11-13T12:37:31.820+0000 7f10baf5d640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 44456) UID: 0 2023-11-13T12:37:31.828 INFO:tasks.ceph.osd.4.smithi154.stderr:2023-11-13T12:37:31.820+0000 7fce06bbb640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 44456) UID: 0 2023-11-13T12:38:04.718 INFO:teuthology.orchestra.run.smithi102.stdout:generic/125 62s 2023-11-13T12:38:04.731 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/125 2023-11-13T12:38:04.732 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T12:38:04.738 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T12:38:04.804 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T12:38:04.805 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/126) 2023-11-13T12:38:05.446 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T12:38:05.457 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T12:38:05.457 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T12:38:06.330 INFO:teuthology.orchestra.run.smithi102.stdout:generic/126 - output mismatch (see /tmp/tmp.EnLPmcWJbzxfstests-dev/results//generic/126.out.bad) 2023-11-13T12:38:06.336 INFO:teuthology.orchestra.run.smithi102.stdout: --- tests/generic/126.out 2023-11-13 11:30:05.293485876 +0000 2023-11-13T12:38:06.336 INFO:teuthology.orchestra.run.smithi102.stdout: +++ /tmp/tmp.EnLPmcWJbzxfstests-dev/results//generic/126.out.bad 2023-11-13 12:38:06.322040366 +0000 2023-11-13T12:38:06.336 INFO:teuthology.orchestra.run.smithi102.stdout: @@ -1,7 +1,7 @@ 2023-11-13T12:38:06.336 INFO:teuthology.orchestra.run.smithi102.stdout: QA output created by 126 2023-11-13T12:38:06.337 INFO:teuthology.orchestra.run.smithi102.stdout: -x a 001 file owned by (99/99) as user/group(12/100) PASS 2023-11-13T12:38:06.337 INFO:teuthology.orchestra.run.smithi102.stdout: -x a 010 file owned by (99/99) as user/group(200/99) PASS 2023-11-13T12:38:06.337 INFO:teuthology.orchestra.run.smithi102.stdout: -x a 100 file owned by (99/99) as user/group(99/500) PASS 2023-11-13T12:38:06.337 INFO:teuthology.orchestra.run.smithi102.stdout: +x a 001 file owned by (99/99) as user/group(12/100) FAIL 2023-11-13T12:38:06.337 INFO:teuthology.orchestra.run.smithi102.stdout: +x a 010 file owned by (99/99) as user/group(200/99) FAIL 2023-11-13T12:38:06.338 INFO:teuthology.orchestra.run.smithi102.stdout: +x a 100 file owned by (99/99) as user/group(99/500) FAIL 2023-11-13T12:38:06.338 INFO:teuthology.orchestra.run.smithi102.stdout: w a 002 file owned by (99/99) as user/group(12/100) PASS 2023-11-13T12:38:06.338 INFO:teuthology.orchestra.run.smithi102.stdout: w a 020 file owned by (99/99) as user/group(200/99) PASS 2023-11-13T12:38:06.338 INFO:teuthology.orchestra.run.smithi102.stdout: w a 200 file owned by (99/99) as user/group(99/500) PASS 2023-11-13T12:38:06.341 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/126 2023-11-13T12:38:06.342 INFO:teuthology.orchestra.run.smithi102.stdout:Failures: generic/126 2023-11-13T12:38:06.342 INFO:teuthology.orchestra.run.smithi102.stdout:Failed 1 of 1 tests 2023-11-13T12:38:06.347 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T12:38:06.367 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-13T12:38:06.367 INFO:tasks.cephfs.xfstests_dev:Command failed 2023-11-13T12:38:06.368 INFO:tasks.cephfs.xfstests_dev:Command return value: 1 2023-11-13T12:38:06.368 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/127) 2023-11-13T12:38:07.038 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T12:38:07.048 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T12:38:07.048 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T12:40:03.876 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T12:40:03.880 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T12:40:33.954 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T12:40:33.958 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T12:41:04.047 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T12:41:04.051 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T12:41:34.190 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T12:41:34.194 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T12:42:04.310 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T12:42:04.315 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T12:42:34.443 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T12:42:34.447 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T12:43:04.566 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T12:43:04.571 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T12:43:34.698 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T12:43:34.704 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T12:44:04.813 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T12:44:04.817 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T12:44:34.945 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T12:44:34.950 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T12:45:05.002 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T12:45:05.007 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T12:45:35.086 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T12:45:35.091 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T12:46:05.140 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T12:46:05.145 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T12:46:35.273 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T12:46:35.277 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T12:47:05.504 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T12:47:05.510 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T12:47:35.620 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T12:47:35.625 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T12:48:05.702 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T12:48:05.707 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T12:48:35.968 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T12:48:35.973 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T12:49:06.031 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T12:49:06.037 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T12:49:36.131 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T12:49:36.135 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T12:50:06.262 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T12:50:06.266 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T12:50:36.369 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T12:50:36.373 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T12:51:06.475 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T12:51:06.480 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T12:51:36.674 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T12:51:36.679 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T12:52:06.723 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T12:52:06.727 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T12:52:36.847 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T12:52:36.852 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T12:53:06.921 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T12:53:06.925 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T12:53:30.662 INFO:teuthology.orchestra.run.smithi102.stdout:generic/127 923s 2023-11-13T12:53:30.675 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/127 2023-11-13T12:53:30.675 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T12:53:30.681 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T12:53:30.748 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T12:53:30.749 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/128) 2023-11-13T12:53:31.372 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T12:53:31.383 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T12:53:31.383 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T12:53:31.655 INFO:teuthology.orchestra.run.smithi102.stdout:generic/128 [not run] this test requires a valid $SCRATCH_DEV 2023-11-13T12:53:31.663 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/128 2023-11-13T12:53:31.664 INFO:teuthology.orchestra.run.smithi102.stdout:Not run: generic/128 2023-11-13T12:53:31.664 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T12:53:31.670 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T12:53:31.689 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T12:53:31.690 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/129) 2023-11-13T12:53:32.057 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T12:53:32.067 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T12:53:32.067 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T12:53:32.345 INFO:teuthology.orchestra.run.smithi102.stdout:generic/129 [not run] this test requires a valid $SCRATCH_DEV 2023-11-13T12:53:32.354 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/129 2023-11-13T12:53:32.354 INFO:teuthology.orchestra.run.smithi102.stdout:Not run: generic/129 2023-11-13T12:53:32.355 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T12:53:32.360 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T12:53:32.379 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T12:53:32.379 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/130) 2023-11-13T12:53:32.745 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T12:53:32.756 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T12:53:32.756 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T12:53:33.027 INFO:teuthology.orchestra.run.smithi102.stdout:generic/130 [not run] this test requires a valid $SCRATCH_DEV 2023-11-13T12:53:33.036 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/130 2023-11-13T12:53:33.036 INFO:teuthology.orchestra.run.smithi102.stdout:Not run: generic/130 2023-11-13T12:53:33.036 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T12:53:33.042 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T12:53:33.062 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T12:53:33.063 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/131) 2023-11-13T12:53:33.424 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T12:53:33.435 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T12:53:33.435 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T12:53:34.956 INFO:teuthology.orchestra.run.smithi102.stdout:generic/131 1s 2023-11-13T12:53:34.969 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/131 2023-11-13T12:53:34.969 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T12:53:34.975 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T12:53:35.006 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T12:53:35.007 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/132) 2023-11-13T12:53:35.649 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T12:53:35.660 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T12:53:35.660 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T12:53:35.933 INFO:teuthology.orchestra.run.smithi102.stdout:generic/132 [not run] this test requires a valid $SCRATCH_DEV 2023-11-13T12:53:35.941 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/132 2023-11-13T12:53:35.941 INFO:teuthology.orchestra.run.smithi102.stdout:Not run: generic/132 2023-11-13T12:53:35.942 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T12:53:35.948 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T12:53:35.967 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T12:53:35.967 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/133) 2023-11-13T12:53:36.353 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T12:53:36.363 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T12:53:36.364 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T12:53:38.026 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T12:53:38.031 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T12:54:08.081 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T12:54:08.086 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T12:54:38.143 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T12:54:38.147 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T12:55:08.916 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T12:55:08.920 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T12:55:39.005 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T12:55:39.009 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T12:56:09.078 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T12:56:09.082 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T12:56:39.229 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T12:56:39.233 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T12:57:09.352 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T12:57:09.357 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T12:57:38.746 INFO:teuthology.orchestra.run.smithi102.stdout:generic/133 242s 2023-11-13T12:57:38.759 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/133 2023-11-13T12:57:38.759 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T12:57:38.765 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T12:57:38.812 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T12:57:38.813 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/134) 2023-11-13T12:57:39.476 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T12:57:39.480 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T12:57:39.508 INFO:tasks.ceph.osd.5.smithi154.stderr:2023-11-13T12:57:39.502+0000 7f77ec91b640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 44575) UID: 0 2023-11-13T12:57:39.508 INFO:tasks.ceph.osd.6.smithi154.stderr:2023-11-13T12:57:39.502+0000 7f3c803e2640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 44575) UID: 0 2023-11-13T12:57:39.509 INFO:tasks.ceph.osd.4.smithi154.stderr:2023-11-13T12:57:39.502+0000 7fce06bbb640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 44575) UID: 0 2023-11-13T12:57:39.509 INFO:tasks.ceph.osd.7.smithi154.stderr:2023-11-13T12:57:39.502+0000 7f10baf5d640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 44575) UID: 0 2023-11-13T12:57:39.544 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T12:57:39.555 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T12:57:39.555 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T12:57:39.912 INFO:teuthology.orchestra.run.smithi102.stdout:generic/134 [not run] Reflink not supported by test filesystem type: ceph-fuse 2023-11-13T12:57:39.921 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/134 2023-11-13T12:57:39.921 INFO:teuthology.orchestra.run.smithi102.stdout:Not run: generic/134 2023-11-13T12:57:39.921 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T12:57:39.928 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T12:57:39.979 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T12:57:39.980 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/135) 2023-11-13T12:57:40.597 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T12:57:40.607 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T12:57:40.608 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T12:57:40.955 INFO:teuthology.orchestra.run.smithi102.stdout:generic/135 [not run] this test requires a valid $SCRATCH_DEV 2023-11-13T12:57:40.963 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/135 2023-11-13T12:57:40.964 INFO:teuthology.orchestra.run.smithi102.stdout:Not run: generic/135 2023-11-13T12:57:40.964 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T12:57:40.970 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T12:57:40.990 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T12:57:40.991 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/136) 2023-11-13T12:57:41.345 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T12:57:41.355 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T12:57:41.355 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T12:57:41.713 INFO:teuthology.orchestra.run.smithi102.stdout:generic/136 [not run] Dedupe not supported by test filesystem type: ceph-fuse 2023-11-13T12:57:41.721 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/136 2023-11-13T12:57:41.721 INFO:teuthology.orchestra.run.smithi102.stdout:Not run: generic/136 2023-11-13T12:57:41.721 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T12:57:41.727 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T12:57:41.761 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T12:57:41.762 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/137) 2023-11-13T12:57:42.416 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T12:57:42.427 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T12:57:42.427 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T12:57:42.794 INFO:teuthology.orchestra.run.smithi102.stdout:generic/137 [not run] Reflink not supported by test filesystem type: ceph-fuse 2023-11-13T12:57:42.802 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/137 2023-11-13T12:57:42.802 INFO:teuthology.orchestra.run.smithi102.stdout:Not run: generic/137 2023-11-13T12:57:42.802 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T12:57:42.808 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T12:57:42.851 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T12:57:42.852 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/138) 2023-11-13T12:57:43.497 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T12:57:43.508 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T12:57:43.508 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T12:57:43.857 INFO:teuthology.orchestra.run.smithi102.stdout:generic/138 [not run] Reflink not supported by test filesystem type: ceph-fuse 2023-11-13T12:57:43.865 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/138 2023-11-13T12:57:43.866 INFO:teuthology.orchestra.run.smithi102.stdout:Not run: generic/138 2023-11-13T12:57:43.866 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T12:57:43.872 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T12:57:43.900 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T12:57:43.901 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/139) 2023-11-13T12:57:44.552 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T12:57:44.562 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T12:57:44.563 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T12:57:44.950 INFO:teuthology.orchestra.run.smithi102.stdout:generic/139 [not run] Reflink not supported by test filesystem type: ceph-fuse 2023-11-13T12:57:44.958 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/139 2023-11-13T12:57:44.959 INFO:teuthology.orchestra.run.smithi102.stdout:Not run: generic/139 2023-11-13T12:57:44.959 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T12:57:44.965 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T12:57:45.121 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T12:57:45.122 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/140) 2023-11-13T12:57:45.677 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T12:57:45.687 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T12:57:45.687 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T12:57:46.048 INFO:teuthology.orchestra.run.smithi102.stdout:generic/140 [not run] Reflink not supported by test filesystem type: ceph-fuse 2023-11-13T12:57:46.056 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/140 2023-11-13T12:57:46.056 INFO:teuthology.orchestra.run.smithi102.stdout:Not run: generic/140 2023-11-13T12:57:46.056 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T12:57:46.062 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T12:57:46.123 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T12:57:46.124 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/141) 2023-11-13T12:57:46.761 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T12:57:46.771 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T12:57:46.772 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T12:57:47.048 INFO:teuthology.orchestra.run.smithi102.stdout:generic/141 [not run] this test requires a valid $SCRATCH_DEV 2023-11-13T12:57:47.056 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/141 2023-11-13T12:57:47.056 INFO:teuthology.orchestra.run.smithi102.stdout:Not run: generic/141 2023-11-13T12:57:47.056 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T12:57:47.062 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T12:57:47.081 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T12:57:47.081 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/142) 2023-11-13T12:57:47.466 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T12:57:47.477 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T12:57:47.477 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T12:57:48.014 INFO:teuthology.orchestra.run.smithi102.stdout:generic/142 [not run] Reflink not supported by test filesystem type: ceph-fuse 2023-11-13T12:57:48.022 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/142 2023-11-13T12:57:48.023 INFO:teuthology.orchestra.run.smithi102.stdout:Not run: generic/142 2023-11-13T12:57:48.023 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T12:57:48.029 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T12:57:48.220 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T12:57:48.220 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/143) 2023-11-13T12:57:48.745 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T12:57:48.755 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T12:57:48.756 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T12:57:49.105 INFO:teuthology.orchestra.run.smithi102.stdout:generic/143 [not run] Reflink not supported by test filesystem type: ceph-fuse 2023-11-13T12:57:49.113 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/143 2023-11-13T12:57:49.113 INFO:teuthology.orchestra.run.smithi102.stdout:Not run: generic/143 2023-11-13T12:57:49.113 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T12:57:49.119 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T12:57:49.151 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T12:57:49.152 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/144) 2023-11-13T12:57:49.829 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T12:57:49.839 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T12:57:49.839 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T12:57:50.201 INFO:teuthology.orchestra.run.smithi102.stdout:generic/144 [not run] Reflink not supported by test filesystem type: ceph-fuse 2023-11-13T12:57:50.209 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/144 2023-11-13T12:57:50.210 INFO:teuthology.orchestra.run.smithi102.stdout:Not run: generic/144 2023-11-13T12:57:50.210 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T12:57:50.216 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T12:57:50.267 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T12:57:50.268 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/145) 2023-11-13T12:57:50.933 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T12:57:50.943 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T12:57:50.944 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T12:57:51.276 INFO:teuthology.orchestra.run.smithi102.stdout:generic/145 [not run] Reflink not supported by test filesystem type: ceph-fuse 2023-11-13T12:57:51.284 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/145 2023-11-13T12:57:51.284 INFO:teuthology.orchestra.run.smithi102.stdout:Not run: generic/145 2023-11-13T12:57:51.284 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T12:57:51.290 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T12:57:51.324 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T12:57:51.325 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/146) 2023-11-13T12:57:51.960 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T12:57:51.971 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T12:57:51.971 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T12:57:52.328 INFO:teuthology.orchestra.run.smithi102.stdout:generic/146 [not run] Reflink not supported by test filesystem type: ceph-fuse 2023-11-13T12:57:52.336 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/146 2023-11-13T12:57:52.336 INFO:teuthology.orchestra.run.smithi102.stdout:Not run: generic/146 2023-11-13T12:57:52.336 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T12:57:52.342 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T12:57:52.374 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T12:57:52.375 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/147) 2023-11-13T12:57:53.036 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T12:57:53.047 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T12:57:53.047 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T12:57:53.419 INFO:teuthology.orchestra.run.smithi102.stdout:generic/147 [not run] Reflink not supported by test filesystem type: ceph-fuse 2023-11-13T12:57:53.427 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/147 2023-11-13T12:57:53.427 INFO:teuthology.orchestra.run.smithi102.stdout:Not run: generic/147 2023-11-13T12:57:53.427 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T12:57:53.433 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T12:57:53.467 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T12:57:53.468 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/148) 2023-11-13T12:57:54.157 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T12:57:54.168 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T12:57:54.168 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T12:57:54.528 INFO:teuthology.orchestra.run.smithi102.stdout:generic/148 [not run] Reflink not supported by test filesystem type: ceph-fuse 2023-11-13T12:57:54.536 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/148 2023-11-13T12:57:54.536 INFO:teuthology.orchestra.run.smithi102.stdout:Not run: generic/148 2023-11-13T12:57:54.536 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T12:57:54.542 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T12:57:54.587 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T12:57:54.588 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/149) 2023-11-13T12:57:55.252 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T12:57:55.262 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T12:57:55.263 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T12:57:55.607 INFO:teuthology.orchestra.run.smithi102.stdout:generic/149 [not run] Reflink not supported by test filesystem type: ceph-fuse 2023-11-13T12:57:55.615 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/149 2023-11-13T12:57:55.616 INFO:teuthology.orchestra.run.smithi102.stdout:Not run: generic/149 2023-11-13T12:57:55.616 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T12:57:55.622 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T12:57:55.684 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T12:57:55.685 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/150) 2023-11-13T12:57:56.316 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T12:57:56.327 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T12:57:56.327 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T12:57:56.675 INFO:teuthology.orchestra.run.smithi102.stdout:generic/150 [not run] Reflink not supported by test filesystem type: ceph-fuse 2023-11-13T12:57:56.683 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/150 2023-11-13T12:57:56.684 INFO:teuthology.orchestra.run.smithi102.stdout:Not run: generic/150 2023-11-13T12:57:56.684 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T12:57:56.690 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T12:57:56.728 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T12:57:56.729 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/151) 2023-11-13T12:57:57.385 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T12:57:57.395 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T12:57:57.395 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T12:57:57.749 INFO:teuthology.orchestra.run.smithi102.stdout:generic/151 [not run] Reflink not supported by test filesystem type: ceph-fuse 2023-11-13T12:57:57.757 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/151 2023-11-13T12:57:57.758 INFO:teuthology.orchestra.run.smithi102.stdout:Not run: generic/151 2023-11-13T12:57:57.758 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T12:57:57.764 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T12:57:57.792 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T12:57:57.792 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/152) 2023-11-13T12:57:58.488 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T12:57:58.499 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T12:57:58.499 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T12:57:58.846 INFO:teuthology.orchestra.run.smithi102.stdout:generic/152 [not run] Reflink not supported by test filesystem type: ceph-fuse 2023-11-13T12:57:58.854 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/152 2023-11-13T12:57:58.854 INFO:teuthology.orchestra.run.smithi102.stdout:Not run: generic/152 2023-11-13T12:57:58.854 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T12:57:58.860 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T12:57:58.892 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T12:57:58.892 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/153) 2023-11-13T12:57:59.568 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T12:57:59.579 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T12:57:59.579 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T12:57:59.932 INFO:teuthology.orchestra.run.smithi102.stdout:generic/153 [not run] Reflink not supported by test filesystem type: ceph-fuse 2023-11-13T12:57:59.940 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/153 2023-11-13T12:57:59.940 INFO:teuthology.orchestra.run.smithi102.stdout:Not run: generic/153 2023-11-13T12:57:59.940 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T12:57:59.946 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T12:57:59.997 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T12:57:59.998 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/154) 2023-11-13T12:58:00.655 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T12:58:00.666 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T12:58:00.666 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T12:58:01.016 INFO:teuthology.orchestra.run.smithi102.stdout:generic/154 [not run] Reflink not supported by test filesystem type: ceph-fuse 2023-11-13T12:58:01.024 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/154 2023-11-13T12:58:01.024 INFO:teuthology.orchestra.run.smithi102.stdout:Not run: generic/154 2023-11-13T12:58:01.024 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T12:58:01.029 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T12:58:01.079 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T12:58:01.080 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/155) 2023-11-13T12:58:01.736 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T12:58:01.747 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T12:58:01.747 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T12:58:02.100 INFO:teuthology.orchestra.run.smithi102.stdout:generic/155 [not run] Reflink not supported by test filesystem type: ceph-fuse 2023-11-13T12:58:02.108 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/155 2023-11-13T12:58:02.108 INFO:teuthology.orchestra.run.smithi102.stdout:Not run: generic/155 2023-11-13T12:58:02.109 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T12:58:02.115 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T12:58:02.141 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T12:58:02.142 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/156) 2023-11-13T12:58:02.836 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T12:58:02.846 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T12:58:02.847 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T12:58:03.201 INFO:teuthology.orchestra.run.smithi102.stdout:generic/156 [not run] Reflink not supported by test filesystem type: ceph-fuse 2023-11-13T12:58:03.209 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/156 2023-11-13T12:58:03.209 INFO:teuthology.orchestra.run.smithi102.stdout:Not run: generic/156 2023-11-13T12:58:03.209 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T12:58:03.215 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T12:58:03.240 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T12:58:03.240 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/157) 2023-11-13T12:58:03.924 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T12:58:03.935 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T12:58:03.935 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T12:58:04.298 INFO:teuthology.orchestra.run.smithi102.stdout:generic/157 [not run] Reflink not supported by test filesystem type: ceph-fuse 2023-11-13T12:58:04.306 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/157 2023-11-13T12:58:04.307 INFO:teuthology.orchestra.run.smithi102.stdout:Not run: generic/157 2023-11-13T12:58:04.307 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T12:58:04.313 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T12:58:04.351 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T12:58:04.351 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/158) 2023-11-13T12:58:05.056 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T12:58:05.066 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T12:58:05.067 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T12:58:05.442 INFO:teuthology.orchestra.run.smithi102.stdout:generic/158 [not run] Dedupe not supported by test filesystem type: ceph-fuse 2023-11-13T12:58:05.450 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/158 2023-11-13T12:58:05.451 INFO:teuthology.orchestra.run.smithi102.stdout:Not run: generic/158 2023-11-13T12:58:05.451 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T12:58:05.457 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T12:58:05.495 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T12:58:05.496 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/159) 2023-11-13T12:58:06.172 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T12:58:06.183 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T12:58:06.184 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T12:58:06.502 INFO:teuthology.orchestra.run.smithi102.stdout:generic/159 [not run] file system doesn't support chattr +i 2023-11-13T12:58:06.510 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/159 2023-11-13T12:58:06.510 INFO:teuthology.orchestra.run.smithi102.stdout:Not run: generic/159 2023-11-13T12:58:06.511 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T12:58:06.516 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T12:58:06.537 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T12:58:06.538 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/160) 2023-11-13T12:58:06.915 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T12:58:06.926 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T12:58:06.926 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T12:58:07.243 INFO:teuthology.orchestra.run.smithi102.stdout:generic/160 [not run] file system doesn't support chattr +i 2023-11-13T12:58:07.251 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/160 2023-11-13T12:58:07.251 INFO:teuthology.orchestra.run.smithi102.stdout:Not run: generic/160 2023-11-13T12:58:07.251 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T12:58:07.257 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T12:58:07.277 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T12:58:07.278 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/161) 2023-11-13T12:58:07.641 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T12:58:07.651 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T12:58:07.651 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T12:58:07.919 INFO:teuthology.orchestra.run.smithi102.stdout:generic/161 [not run] this test requires a valid $SCRATCH_DEV 2023-11-13T12:58:07.927 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/161 2023-11-13T12:58:07.928 INFO:teuthology.orchestra.run.smithi102.stdout:Not run: generic/161 2023-11-13T12:58:07.928 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T12:58:07.934 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T12:58:07.954 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T12:58:07.955 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/162) 2023-11-13T12:58:08.336 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T12:58:08.347 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T12:58:08.347 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T12:58:08.623 INFO:teuthology.orchestra.run.smithi102.stdout:generic/162 [not run] this test requires a valid $SCRATCH_DEV 2023-11-13T12:58:08.632 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/162 2023-11-13T12:58:08.632 INFO:teuthology.orchestra.run.smithi102.stdout:Not run: generic/162 2023-11-13T12:58:08.632 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T12:58:08.638 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T12:58:08.658 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T12:58:08.659 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/163) 2023-11-13T12:58:09.024 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T12:58:09.034 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T12:58:09.035 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T12:58:09.322 INFO:teuthology.orchestra.run.smithi102.stdout:generic/163 [not run] this test requires a valid $SCRATCH_DEV 2023-11-13T12:58:09.330 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/163 2023-11-13T12:58:09.330 INFO:teuthology.orchestra.run.smithi102.stdout:Not run: generic/163 2023-11-13T12:58:09.331 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T12:58:09.337 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T12:58:09.399 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T12:58:09.399 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/164) 2023-11-13T12:58:09.752 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T12:58:09.763 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T12:58:09.763 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T12:58:10.041 INFO:teuthology.orchestra.run.smithi102.stdout:generic/164 [not run] this test requires a valid $SCRATCH_DEV 2023-11-13T12:58:10.049 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/164 2023-11-13T12:58:10.049 INFO:teuthology.orchestra.run.smithi102.stdout:Not run: generic/164 2023-11-13T12:58:10.050 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T12:58:10.055 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T12:58:10.075 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T12:58:10.075 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/165) 2023-11-13T12:58:10.427 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T12:58:10.438 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T12:58:10.438 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T12:58:10.723 INFO:teuthology.orchestra.run.smithi102.stdout:generic/165 [not run] this test requires a valid $SCRATCH_DEV 2023-11-13T12:58:10.731 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/165 2023-11-13T12:58:10.731 INFO:teuthology.orchestra.run.smithi102.stdout:Not run: generic/165 2023-11-13T12:58:10.731 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T12:58:10.737 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T12:58:10.758 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T12:58:10.758 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/166) 2023-11-13T12:58:11.140 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T12:58:11.150 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T12:58:11.151 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T12:58:11.412 INFO:teuthology.orchestra.run.smithi102.stdout:generic/166 [not run] this test requires a valid $SCRATCH_DEV 2023-11-13T12:58:11.421 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/166 2023-11-13T12:58:11.421 INFO:teuthology.orchestra.run.smithi102.stdout:Not run: generic/166 2023-11-13T12:58:11.421 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T12:58:11.427 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T12:58:11.447 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T12:58:11.448 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/167) 2023-11-13T12:58:11.806 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T12:58:11.816 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T12:58:11.816 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T12:58:12.089 INFO:teuthology.orchestra.run.smithi102.stdout:generic/167 [not run] this test requires a valid $SCRATCH_DEV 2023-11-13T12:58:12.094 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/167 2023-11-13T12:58:12.094 INFO:teuthology.orchestra.run.smithi102.stdout:Not run: generic/167 2023-11-13T12:58:12.095 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T12:58:12.101 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T12:58:12.120 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T12:58:12.121 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/168) 2023-11-13T12:58:12.513 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T12:58:12.523 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T12:58:12.524 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T12:58:12.799 INFO:teuthology.orchestra.run.smithi102.stdout:generic/168 [not run] this test requires a valid $SCRATCH_DEV 2023-11-13T12:58:12.807 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/168 2023-11-13T12:58:12.808 INFO:teuthology.orchestra.run.smithi102.stdout:Not run: generic/168 2023-11-13T12:58:12.808 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T12:58:12.813 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T12:58:12.832 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T12:58:12.833 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/169) 2023-11-13T12:58:13.198 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T12:58:13.208 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T12:58:13.208 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T12:58:13.499 INFO:teuthology.orchestra.run.smithi102.stdout:generic/169 [not run] this test requires a valid $SCRATCH_DEV 2023-11-13T12:58:13.507 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/169 2023-11-13T12:58:13.508 INFO:teuthology.orchestra.run.smithi102.stdout:Not run: generic/169 2023-11-13T12:58:13.508 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T12:58:13.514 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T12:58:13.534 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T12:58:13.535 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/170) 2023-11-13T12:58:13.913 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T12:58:13.924 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T12:58:13.924 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T12:58:14.206 INFO:teuthology.orchestra.run.smithi102.stdout:generic/170 [not run] this test requires a valid $SCRATCH_DEV 2023-11-13T12:58:14.214 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/170 2023-11-13T12:58:14.214 INFO:teuthology.orchestra.run.smithi102.stdout:Not run: generic/170 2023-11-13T12:58:14.214 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T12:58:14.220 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T12:58:14.240 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T12:58:14.241 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/171) 2023-11-13T12:58:14.613 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T12:58:14.623 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T12:58:14.624 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T12:58:14.915 INFO:teuthology.orchestra.run.smithi102.stdout:generic/171 [not run] this test requires a valid $SCRATCH_DEV 2023-11-13T12:58:14.923 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/171 2023-11-13T12:58:14.923 INFO:teuthology.orchestra.run.smithi102.stdout:Not run: generic/171 2023-11-13T12:58:14.924 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T12:58:14.930 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T12:58:14.950 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T12:58:14.950 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/172) 2023-11-13T12:58:15.332 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T12:58:15.343 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T12:58:15.343 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T12:58:15.623 INFO:teuthology.orchestra.run.smithi102.stdout:generic/172 [not run] this test requires a valid $SCRATCH_DEV 2023-11-13T12:58:15.631 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/172 2023-11-13T12:58:15.631 INFO:teuthology.orchestra.run.smithi102.stdout:Not run: generic/172 2023-11-13T12:58:15.631 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T12:58:15.637 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T12:58:15.657 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T12:58:15.658 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/173) 2023-11-13T12:58:16.024 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T12:58:16.034 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T12:58:16.034 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T12:58:16.313 INFO:teuthology.orchestra.run.smithi102.stdout:generic/173 [not run] this test requires a valid $SCRATCH_DEV 2023-11-13T12:58:16.322 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/173 2023-11-13T12:58:16.322 INFO:teuthology.orchestra.run.smithi102.stdout:Not run: generic/173 2023-11-13T12:58:16.322 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T12:58:16.328 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T12:58:16.347 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T12:58:16.348 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/174) 2023-11-13T12:58:16.708 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T12:58:16.718 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T12:58:16.719 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T12:58:17.012 INFO:teuthology.orchestra.run.smithi102.stdout:generic/174 [not run] this test requires a valid $SCRATCH_DEV 2023-11-13T12:58:17.020 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/174 2023-11-13T12:58:17.020 INFO:teuthology.orchestra.run.smithi102.stdout:Not run: generic/174 2023-11-13T12:58:17.021 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T12:58:17.026 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T12:58:17.047 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T12:58:17.047 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/175) 2023-11-13T12:58:17.404 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T12:58:17.414 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T12:58:17.414 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T12:58:17.703 INFO:teuthology.orchestra.run.smithi102.stdout:generic/175 [not run] this test requires a valid $SCRATCH_DEV 2023-11-13T12:58:17.711 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/175 2023-11-13T12:58:17.712 INFO:teuthology.orchestra.run.smithi102.stdout:Not run: generic/175 2023-11-13T12:58:17.712 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T12:58:17.718 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T12:58:17.739 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T12:58:17.739 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/176) 2023-11-13T12:58:18.126 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T12:58:18.136 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T12:58:18.137 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T12:58:18.424 INFO:teuthology.orchestra.run.smithi102.stdout:generic/176 [not run] this test requires a valid $SCRATCH_DEV 2023-11-13T12:58:18.432 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/176 2023-11-13T12:58:18.433 INFO:teuthology.orchestra.run.smithi102.stdout:Not run: generic/176 2023-11-13T12:58:18.433 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T12:58:18.439 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T12:58:18.458 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T12:58:18.459 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/177) 2023-11-13T12:58:18.841 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T12:58:18.851 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T12:58:18.852 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T12:58:19.416 INFO:teuthology.orchestra.run.smithi102.stdout:generic/177 [not run] this test requires a valid $SCRATCH_DEV 2023-11-13T12:58:19.424 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/177 2023-11-13T12:58:19.424 INFO:teuthology.orchestra.run.smithi102.stdout:Not run: generic/177 2023-11-13T12:58:19.424 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T12:58:19.430 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T12:58:19.449 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T12:58:19.450 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/178) 2023-11-13T12:58:19.808 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T12:58:19.819 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T12:58:19.819 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T12:58:20.170 INFO:teuthology.orchestra.run.smithi102.stdout:generic/178 [not run] Reflink not supported by test filesystem type: ceph-fuse 2023-11-13T12:58:20.178 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/178 2023-11-13T12:58:20.179 INFO:teuthology.orchestra.run.smithi102.stdout:Not run: generic/178 2023-11-13T12:58:20.179 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T12:58:20.184 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T12:58:20.227 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T12:58:20.227 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/179) 2023-11-13T12:58:20.909 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T12:58:20.919 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T12:58:20.919 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T12:58:21.264 INFO:teuthology.orchestra.run.smithi102.stdout:generic/179 [not run] Reflink not supported by test filesystem type: ceph-fuse 2023-11-13T12:58:21.272 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/179 2023-11-13T12:58:21.273 INFO:teuthology.orchestra.run.smithi102.stdout:Not run: generic/179 2023-11-13T12:58:21.273 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T12:58:21.279 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T12:58:21.311 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T12:58:21.312 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/180) 2023-11-13T12:58:21.972 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T12:58:21.983 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T12:58:21.983 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T12:58:22.338 INFO:teuthology.orchestra.run.smithi102.stdout:generic/180 [not run] Reflink not supported by test filesystem type: ceph-fuse 2023-11-13T12:58:22.346 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/180 2023-11-13T12:58:22.346 INFO:teuthology.orchestra.run.smithi102.stdout:Not run: generic/180 2023-11-13T12:58:22.347 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T12:58:22.352 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T12:58:22.383 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T12:58:22.384 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/181) 2023-11-13T12:58:23.031 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T12:58:23.042 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T12:58:23.042 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T12:58:23.403 INFO:teuthology.orchestra.run.smithi102.stdout:generic/181 [not run] Reflink not supported by test filesystem type: ceph-fuse 2023-11-13T12:58:23.411 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/181 2023-11-13T12:58:23.412 INFO:teuthology.orchestra.run.smithi102.stdout:Not run: generic/181 2023-11-13T12:58:23.412 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T12:58:23.417 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T12:58:23.449 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T12:58:23.450 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/182) 2023-11-13T12:58:24.120 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T12:58:24.131 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T12:58:24.131 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T12:58:24.492 INFO:teuthology.orchestra.run.smithi102.stdout:generic/182 [not run] Dedupe not supported by test filesystem type: ceph-fuse 2023-11-13T12:58:24.500 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/182 2023-11-13T12:58:24.500 INFO:teuthology.orchestra.run.smithi102.stdout:Not run: generic/182 2023-11-13T12:58:24.500 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T12:58:24.506 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T12:58:24.530 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T12:58:24.531 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/183) 2023-11-13T12:58:25.206 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T12:58:25.217 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T12:58:25.217 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T12:58:25.509 INFO:teuthology.orchestra.run.smithi102.stdout:generic/183 [not run] this test requires a valid $SCRATCH_DEV 2023-11-13T12:58:25.517 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/183 2023-11-13T12:58:25.518 INFO:teuthology.orchestra.run.smithi102.stdout:Not run: generic/183 2023-11-13T12:58:25.518 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T12:58:25.524 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T12:58:25.544 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T12:58:25.545 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/184) 2023-11-13T12:58:25.920 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T12:58:25.930 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T12:58:25.931 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T12:58:26.283 INFO:teuthology.orchestra.run.smithi102.stdout:generic/184 [failed, exit status 1]- output mismatch (see /tmp/tmp.EnLPmcWJbzxfstests-dev/results//generic/184.out.bad) 2023-11-13T12:58:26.288 INFO:teuthology.orchestra.run.smithi102.stdout: --- tests/generic/184.out 2023-11-13 11:30:05.301485707 +0000 2023-11-13T12:58:26.289 INFO:teuthology.orchestra.run.smithi102.stdout: +++ /tmp/tmp.EnLPmcWJbzxfstests-dev/results//generic/184.out.bad 2023-11-13 12:58:26.279018998 +0000 2023-11-13T12:58:26.289 INFO:teuthology.orchestra.run.smithi102.stdout: @@ -1 +1,2 @@ 2023-11-13T12:58:26.289 INFO:teuthology.orchestra.run.smithi102.stdout: QA output created by 184 2023-11-13T12:58:26.289 INFO:teuthology.orchestra.run.smithi102.stdout: +/tmp/tmp.EnLPmcWJbzxfstests-dev/tests/generic/184: line 23: /tmp/tmp.T3Y73qtatntest/null: Permission denied 2023-11-13T12:58:26.294 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/184 2023-11-13T12:58:26.294 INFO:teuthology.orchestra.run.smithi102.stdout:Failures: generic/184 2023-11-13T12:58:26.295 INFO:teuthology.orchestra.run.smithi102.stdout:Failed 1 of 1 tests 2023-11-13T12:58:26.300 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T12:58:26.318 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-13T12:58:26.319 INFO:tasks.cephfs.xfstests_dev:Command failed 2023-11-13T12:58:26.319 INFO:tasks.cephfs.xfstests_dev:Command return value: 1 2023-11-13T12:58:26.320 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/185) 2023-11-13T12:58:26.691 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T12:58:26.702 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T12:58:26.702 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T12:58:26.991 INFO:teuthology.orchestra.run.smithi102.stdout:generic/185 [not run] this test requires a valid $SCRATCH_DEV 2023-11-13T12:58:26.999 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/185 2023-11-13T12:58:27.000 INFO:teuthology.orchestra.run.smithi102.stdout:Not run: generic/185 2023-11-13T12:58:27.000 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T12:58:27.006 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T12:58:27.025 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T12:58:27.026 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/186) 2023-11-13T12:58:27.384 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T12:58:27.394 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T12:58:27.395 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T12:58:27.686 INFO:teuthology.orchestra.run.smithi102.stdout:generic/186 [not run] this test requires a valid $SCRATCH_DEV 2023-11-13T12:58:27.694 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/186 2023-11-13T12:58:27.694 INFO:teuthology.orchestra.run.smithi102.stdout:Not run: generic/186 2023-11-13T12:58:27.694 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T12:58:27.700 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T12:58:27.721 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T12:58:27.721 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/187) 2023-11-13T12:58:28.084 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T12:58:28.095 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T12:58:28.095 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T12:58:28.371 INFO:teuthology.orchestra.run.smithi102.stdout:generic/187 [not run] this test requires a valid $SCRATCH_DEV 2023-11-13T12:58:28.379 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/187 2023-11-13T12:58:28.379 INFO:teuthology.orchestra.run.smithi102.stdout:Not run: generic/187 2023-11-13T12:58:28.379 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T12:58:28.385 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T12:58:28.447 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T12:58:28.447 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/188) 2023-11-13T12:58:28.824 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T12:58:28.835 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T12:58:28.835 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T12:58:29.109 INFO:teuthology.orchestra.run.smithi102.stdout:generic/188 [not run] this test requires a valid $SCRATCH_DEV 2023-11-13T12:58:29.118 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/188 2023-11-13T12:58:29.118 INFO:teuthology.orchestra.run.smithi102.stdout:Not run: generic/188 2023-11-13T12:58:29.118 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T12:58:29.125 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T12:58:29.145 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T12:58:29.146 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/189) 2023-11-13T12:58:29.496 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T12:58:29.507 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T12:58:29.508 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T12:58:29.789 INFO:teuthology.orchestra.run.smithi102.stdout:generic/189 [not run] this test requires a valid $SCRATCH_DEV 2023-11-13T12:58:29.797 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/189 2023-11-13T12:58:29.798 INFO:teuthology.orchestra.run.smithi102.stdout:Not run: generic/189 2023-11-13T12:58:29.798 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T12:58:29.804 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T12:58:29.824 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T12:58:29.825 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/190) 2023-11-13T12:58:30.193 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T12:58:30.203 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T12:58:30.203 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T12:58:30.464 INFO:teuthology.orchestra.run.smithi102.stdout:generic/190 [not run] this test requires a valid $SCRATCH_DEV 2023-11-13T12:58:30.472 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/190 2023-11-13T12:58:30.472 INFO:teuthology.orchestra.run.smithi102.stdout:Not run: generic/190 2023-11-13T12:58:30.473 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T12:58:30.479 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T12:58:30.500 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T12:58:30.500 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/191) 2023-11-13T12:58:30.852 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T12:58:30.862 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T12:58:30.863 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T12:58:31.165 INFO:teuthology.orchestra.run.smithi102.stdout:generic/191 [not run] this test requires a valid $SCRATCH_DEV 2023-11-13T12:58:31.173 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/191 2023-11-13T12:58:31.173 INFO:teuthology.orchestra.run.smithi102.stdout:Not run: generic/191 2023-11-13T12:58:31.173 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T12:58:31.179 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T12:58:31.200 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T12:58:31.200 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/192) 2023-11-13T12:58:31.554 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T12:58:31.564 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T12:58:31.565 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T12:58:31.846 INFO:teuthology.orchestra.run.smithi102.stdout:generic/192 [not run] atime not maintained by ceph-fuse 2023-11-13T12:58:31.854 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/192 2023-11-13T12:58:31.854 INFO:teuthology.orchestra.run.smithi102.stdout:Not run: generic/192 2023-11-13T12:58:31.855 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T12:58:31.861 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T12:58:31.880 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T12:58:31.881 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/193) 2023-11-13T12:58:32.244 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T12:58:32.254 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T12:58:32.255 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T12:58:33.793 INFO:teuthology.orchestra.run.smithi102.stdout:generic/193 - output mismatch (see /tmp/tmp.EnLPmcWJbzxfstests-dev/results//generic/193.out.bad) 2023-11-13T12:58:33.799 INFO:teuthology.orchestra.run.smithi102.stdout: --- tests/generic/193.out 2023-11-13 11:30:05.301485707 +0000 2023-11-13T12:58:33.799 INFO:teuthology.orchestra.run.smithi102.stdout: +++ /tmp/tmp.EnLPmcWJbzxfstests-dev/results//generic/193.out.bad 2023-11-13 12:58:33.786884758 +0000 2023-11-13T12:58:33.799 INFO:teuthology.orchestra.run.smithi102.stdout: @@ -24,7 +24,6 @@ 2023-11-13T12:58:33.800 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T12:58:33.800 INFO:teuthology.orchestra.run.smithi102.stdout: user: chmod a+r on qa_user owned file (should succeed) 2023-11-13T12:58:33.800 INFO:teuthology.orchestra.run.smithi102.stdout: user: chmod a+r on root owned file (should fail) 2023-11-13T12:58:33.800 INFO:teuthology.orchestra.run.smithi102.stdout: -chmod: changing permissions of 'test.root': Operation not permitted 2023-11-13T12:58:33.800 INFO:teuthology.orchestra.run.smithi102.stdout: check that the sgid bit is cleared 2023-11-13T12:58:33.801 INFO:teuthology.orchestra.run.smithi102.stdout: -rw-rw-rw- 2023-11-13T12:58:33.801 INFO:teuthology.orchestra.run.smithi102.stdout: check that suid bit is not cleared 2023-11-13T12:58:33.804 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/193 2023-11-13T12:58:33.805 INFO:teuthology.orchestra.run.smithi102.stdout:Failures: generic/193 2023-11-13T12:58:33.805 INFO:teuthology.orchestra.run.smithi102.stdout:Failed 1 of 1 tests 2023-11-13T12:58:33.811 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T12:58:33.848 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-13T12:58:33.849 INFO:tasks.cephfs.xfstests_dev:Command failed 2023-11-13T12:58:33.849 INFO:tasks.cephfs.xfstests_dev:Command return value: 1 2023-11-13T12:58:33.849 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/194) 2023-11-13T12:58:34.528 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T12:58:34.539 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T12:58:34.539 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T12:58:34.825 INFO:teuthology.orchestra.run.smithi102.stdout:generic/194 [not run] this test requires a valid $SCRATCH_DEV 2023-11-13T12:58:34.833 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/194 2023-11-13T12:58:34.834 INFO:teuthology.orchestra.run.smithi102.stdout:Not run: generic/194 2023-11-13T12:58:34.834 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T12:58:34.840 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T12:58:34.860 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T12:58:34.861 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/195) 2023-11-13T12:58:35.215 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T12:58:35.225 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T12:58:35.225 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T12:58:35.509 INFO:teuthology.orchestra.run.smithi102.stdout:generic/195 [not run] this test requires a valid $SCRATCH_DEV 2023-11-13T12:58:35.517 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/195 2023-11-13T12:58:35.517 INFO:teuthology.orchestra.run.smithi102.stdout:Not run: generic/195 2023-11-13T12:58:35.518 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T12:58:35.523 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T12:58:35.544 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T12:58:35.544 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/196) 2023-11-13T12:58:35.922 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T12:58:35.932 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T12:58:35.933 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T12:58:36.237 INFO:teuthology.orchestra.run.smithi102.stdout:generic/196 [not run] this test requires a valid $SCRATCH_DEV 2023-11-13T12:58:36.245 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/196 2023-11-13T12:58:36.246 INFO:teuthology.orchestra.run.smithi102.stdout:Not run: generic/196 2023-11-13T12:58:36.246 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T12:58:36.251 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T12:58:36.272 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T12:58:36.273 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/197) 2023-11-13T12:58:36.648 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T12:58:36.659 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T12:58:36.659 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T12:58:36.935 INFO:teuthology.orchestra.run.smithi102.stdout:generic/197 [not run] this test requires a valid $SCRATCH_DEV 2023-11-13T12:58:36.943 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/197 2023-11-13T12:58:36.944 INFO:teuthology.orchestra.run.smithi102.stdout:Not run: generic/197 2023-11-13T12:58:36.944 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T12:58:36.950 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T12:58:36.970 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T12:58:36.971 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/198) 2023-11-13T12:58:37.332 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T12:58:37.342 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T12:58:37.343 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T12:58:38.626 INFO:teuthology.orchestra.run.smithi102.stdout:generic/198 1s 2023-11-13T12:58:38.639 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/198 2023-11-13T12:58:38.639 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T12:58:38.645 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T12:58:38.666 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T12:58:38.667 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/199) 2023-11-13T12:58:39.394 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T12:58:39.404 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T12:58:39.404 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T12:58:39.679 INFO:teuthology.orchestra.run.smithi102.stdout:generic/199 [not run] this test requires a valid $SCRATCH_DEV 2023-11-13T12:58:39.687 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/199 2023-11-13T12:58:39.687 INFO:teuthology.orchestra.run.smithi102.stdout:Not run: generic/199 2023-11-13T12:58:39.687 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T12:58:39.693 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T12:58:39.771 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T12:58:39.772 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/200) 2023-11-13T12:58:40.133 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T12:58:40.144 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T12:58:40.144 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T12:58:40.455 INFO:teuthology.orchestra.run.smithi102.stdout:generic/200 [not run] this test requires a valid $SCRATCH_DEV 2023-11-13T12:58:40.464 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/200 2023-11-13T12:58:40.464 INFO:teuthology.orchestra.run.smithi102.stdout:Not run: generic/200 2023-11-13T12:58:40.464 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T12:58:40.470 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T12:58:40.490 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T12:58:40.491 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/201) 2023-11-13T12:58:40.860 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T12:58:40.871 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T12:58:40.871 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T12:58:41.165 INFO:teuthology.orchestra.run.smithi102.stdout:generic/201 [not run] this test requires a valid $SCRATCH_DEV 2023-11-13T12:58:41.173 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/201 2023-11-13T12:58:41.173 INFO:teuthology.orchestra.run.smithi102.stdout:Not run: generic/201 2023-11-13T12:58:41.173 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T12:58:41.179 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T12:58:41.199 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T12:58:41.199 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/202) 2023-11-13T12:58:41.584 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T12:58:41.595 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T12:58:41.595 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T12:58:41.862 INFO:teuthology.orchestra.run.smithi102.stdout:generic/202 [not run] this test requires a valid $SCRATCH_DEV 2023-11-13T12:58:41.870 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/202 2023-11-13T12:58:41.870 INFO:teuthology.orchestra.run.smithi102.stdout:Not run: generic/202 2023-11-13T12:58:41.870 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T12:58:41.876 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T12:58:41.896 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T12:58:41.897 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/203) 2023-11-13T12:58:42.268 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T12:58:42.279 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T12:58:42.279 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T12:58:42.547 INFO:teuthology.orchestra.run.smithi102.stdout:generic/203 [not run] this test requires a valid $SCRATCH_DEV 2023-11-13T12:58:42.555 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/203 2023-11-13T12:58:42.556 INFO:teuthology.orchestra.run.smithi102.stdout:Not run: generic/203 2023-11-13T12:58:42.556 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T12:58:42.562 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T12:58:42.583 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T12:58:42.583 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/204) 2023-11-13T12:58:42.962 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T12:58:42.973 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T12:58:42.973 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T12:58:44.136 INFO:teuthology.orchestra.run.smithi102.stdout:generic/204 [not run] this test requires a valid $SCRATCH_DEV 2023-11-13T12:58:44.145 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/204 2023-11-13T12:58:44.145 INFO:teuthology.orchestra.run.smithi102.stdout:Not run: generic/204 2023-11-13T12:58:44.146 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T12:58:44.153 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T12:58:44.175 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T12:58:44.175 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/205) 2023-11-13T12:58:44.580 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T12:58:44.591 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T12:58:44.591 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T12:58:44.872 INFO:teuthology.orchestra.run.smithi102.stdout:generic/205 [not run] this test requires a valid $SCRATCH_DEV 2023-11-13T12:58:44.880 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/205 2023-11-13T12:58:44.881 INFO:teuthology.orchestra.run.smithi102.stdout:Not run: generic/205 2023-11-13T12:58:44.881 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T12:58:44.886 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T12:58:44.914 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T12:58:44.915 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/206) 2023-11-13T12:58:45.305 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T12:58:45.315 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T12:58:45.316 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T12:58:45.590 INFO:teuthology.orchestra.run.smithi102.stdout:generic/206 [not run] this test requires a valid $SCRATCH_DEV 2023-11-13T12:58:45.598 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/206 2023-11-13T12:58:45.598 INFO:teuthology.orchestra.run.smithi102.stdout:Not run: generic/206 2023-11-13T12:58:45.599 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T12:58:45.605 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T12:58:45.626 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T12:58:45.627 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/207) 2023-11-13T12:58:45.997 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T12:58:46.007 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T12:58:46.007 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T12:59:06.186 INFO:teuthology.orchestra.run.smithi102.stdout:generic/207 20s 2023-11-13T12:59:06.199 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/207 2023-11-13T12:59:06.199 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T12:59:06.205 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T12:59:06.239 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T12:59:06.240 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/208) 2023-11-13T12:59:06.916 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T12:59:06.926 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T12:59:06.927 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T13:00:12.748 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T13:00:12.753 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T13:00:42.960 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T13:00:42.965 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T13:01:13.025 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T13:01:13.030 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T13:01:43.198 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T13:01:43.203 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T13:02:13.266 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T13:02:13.271 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T13:02:27.553 INFO:teuthology.orchestra.run.smithi102.stdout:generic/208 201s 2023-11-13T13:02:27.565 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/208 2023-11-13T13:02:27.566 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T13:02:27.571 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T13:02:27.605 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T13:02:27.606 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/209) 2023-11-13T13:02:28.303 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T13:02:28.313 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T13:02:28.314 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T13:02:38.773 INFO:teuthology.orchestra.run.smithi102.stdout:generic/209 [failed, exit status 1]- output mismatch (see /tmp/tmp.EnLPmcWJbzxfstests-dev/results//generic/209.out.bad) 2023-11-13T13:02:38.801 INFO:teuthology.orchestra.run.smithi102.stdout: --- tests/generic/209.out 2023-11-13 11:30:05.305485623 +0000 2023-11-13T13:02:38.801 INFO:teuthology.orchestra.run.smithi102.stdout: +++ /tmp/tmp.EnLPmcWJbzxfstests-dev/results//generic/209.out.bad 2023-11-13 13:02:38.742041429 +0000 2023-11-13T13:02:38.801 INFO:teuthology.orchestra.run.smithi102.stdout: @@ -1,2 +1,2 @@ 2023-11-13T13:02:38.802 INFO:teuthology.orchestra.run.smithi102.stdout: QA output created by 209 2023-11-13T13:02:38.802 INFO:teuthology.orchestra.run.smithi102.stdout: -test ran for 30 seconds without error 2023-11-13T13:02:38.802 INFO:teuthology.orchestra.run.smithi102.stdout: +reader found old byte at pos 4096 2023-11-13T13:02:38.802 INFO:teuthology.orchestra.run.smithi102.stdout: \ No newline at end of file 2023-11-13T13:02:38.834 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/209 2023-11-13T13:02:38.834 INFO:teuthology.orchestra.run.smithi102.stdout:Failures: generic/209 2023-11-13T13:02:38.835 INFO:teuthology.orchestra.run.smithi102.stdout:Failed 1 of 1 tests 2023-11-13T13:02:38.862 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T13:02:38.938 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-13T13:02:38.939 INFO:tasks.cephfs.xfstests_dev:Command failed 2023-11-13T13:02:38.939 INFO:tasks.cephfs.xfstests_dev:Command return value: 1 2023-11-13T13:02:38.940 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/210) 2023-11-13T13:02:39.322 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T13:02:39.332 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T13:02:39.333 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T13:02:39.838 INFO:teuthology.orchestra.run.smithi102.stdout:generic/210 0s 2023-11-13T13:02:39.851 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/210 2023-11-13T13:02:39.851 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T13:02:39.857 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T13:02:39.905 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T13:02:39.906 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/211) 2023-11-13T13:02:40.560 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T13:02:40.570 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T13:02:40.571 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T13:02:41.434 INFO:teuthology.orchestra.run.smithi102.stdout:generic/211 1s 2023-11-13T13:02:41.446 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/211 2023-11-13T13:02:41.447 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T13:02:41.454 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T13:02:41.473 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T13:02:41.474 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/212) 2023-11-13T13:02:41.852 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T13:02:41.863 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T13:02:41.863 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T13:02:42.301 INFO:teuthology.orchestra.run.smithi102.stdout:generic/212 1s 2023-11-13T13:02:42.313 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/212 2023-11-13T13:02:42.314 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T13:02:42.321 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T13:02:42.342 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T13:02:42.342 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/213) 2023-11-13T13:02:42.713 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T13:02:42.723 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T13:02:42.723 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T13:02:43.329 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T13:02:43.333 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T13:02:43.339 INFO:teuthology.orchestra.run.smithi102.stdout:generic/213 - output mismatch (see /tmp/tmp.EnLPmcWJbzxfstests-dev/results//generic/213.out.bad) 2023-11-13T13:02:43.345 INFO:teuthology.orchestra.run.smithi102.stdout: --- tests/generic/213.out 2023-11-13 11:30:05.305485623 +0000 2023-11-13T13:02:43.345 INFO:teuthology.orchestra.run.smithi102.stdout: +++ /tmp/tmp.EnLPmcWJbzxfstests-dev/results//generic/213.out.bad 2023-11-13 13:02:43.333949555 +0000 2023-11-13T13:02:43.345 INFO:teuthology.orchestra.run.smithi102.stdout: @@ -1,4 +1,3 @@ 2023-11-13T13:02:43.345 INFO:teuthology.orchestra.run.smithi102.stdout: QA output created by 213 2023-11-13T13:02:43.345 INFO:teuthology.orchestra.run.smithi102.stdout: We should get: fallocate: No space left on device 2023-11-13T13:02:43.346 INFO:teuthology.orchestra.run.smithi102.stdout: Strangely, xfs_io sometimes says "Success" when something went wrong, FYI 2023-11-13T13:02:43.346 INFO:teuthology.orchestra.run.smithi102.stdout: -fallocate: No space left on device 2023-11-13T13:02:43.351 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/213 2023-11-13T13:02:43.351 INFO:teuthology.orchestra.run.smithi102.stdout:Failures: generic/213 2023-11-13T13:02:43.351 INFO:teuthology.orchestra.run.smithi102.stdout:Failed 1 of 1 tests 2023-11-13T13:02:43.358 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T13:02:43.361 INFO:tasks.ceph.osd.0.smithi102.stderr:2023-11-13T13:02:43.357+0000 7efed7bed640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 205995) UID: 0 2023-11-13T13:02:43.361 INFO:tasks.ceph.osd.2.smithi102.stderr:2023-11-13T13:02:43.357+0000 7f17fbe34640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 205995) UID: 0 2023-11-13T13:02:43.361 INFO:tasks.ceph.osd.3.smithi102.stderr:2023-11-13T13:02:43.357+0000 7f48d17a6640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 205995) UID: 0 2023-11-13T13:02:43.362 INFO:tasks.ceph.osd.1.smithi102.stderr:2023-11-13T13:02:43.357+0000 7f33d1116640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 205995) UID: 0 2023-11-13T13:02:43.459 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-13T13:02:43.459 INFO:tasks.cephfs.xfstests_dev:Command failed 2023-11-13T13:02:43.460 INFO:tasks.cephfs.xfstests_dev:Command return value: 1 2023-11-13T13:02:43.460 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/214) 2023-11-13T13:02:44.347 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T13:02:44.368 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T13:02:44.369 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T13:02:45.464 INFO:teuthology.orchestra.run.smithi102.stdout:generic/214 1s 2023-11-13T13:02:45.488 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/214 2023-11-13T13:02:45.488 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T13:02:45.498 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T13:02:45.531 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T13:02:45.531 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/215) 2023-11-13T13:02:46.444 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T13:02:46.458 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T13:02:46.458 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T13:02:50.803 INFO:teuthology.orchestra.run.smithi102.stdout:generic/215 4s 2023-11-13T13:02:50.827 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/215 2023-11-13T13:02:50.827 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T13:02:50.842 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T13:02:50.877 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T13:02:50.878 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/216) 2023-11-13T13:02:51.468 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T13:02:51.484 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T13:02:51.484 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T13:02:51.988 INFO:teuthology.orchestra.run.smithi102.stdout:generic/216 [not run] this test requires a valid $SCRATCH_DEV 2023-11-13T13:02:52.003 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/216 2023-11-13T13:02:52.003 INFO:teuthology.orchestra.run.smithi102.stdout:Not run: generic/216 2023-11-13T13:02:52.004 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T13:02:52.020 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T13:02:52.177 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T13:02:52.178 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/217) 2023-11-13T13:02:52.699 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T13:02:52.710 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T13:02:52.710 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T13:02:53.110 INFO:teuthology.orchestra.run.smithi102.stdout:generic/217 [not run] this test requires a valid $SCRATCH_DEV 2023-11-13T13:02:53.123 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/217 2023-11-13T13:02:53.123 INFO:teuthology.orchestra.run.smithi102.stdout:Not run: generic/217 2023-11-13T13:02:53.124 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T13:02:53.134 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T13:02:53.167 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T13:02:53.168 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/218) 2023-11-13T13:02:53.749 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T13:02:53.768 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T13:02:53.769 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T13:02:54.216 INFO:teuthology.orchestra.run.smithi102.stdout:generic/218 [not run] this test requires a valid $SCRATCH_DEV 2023-11-13T13:02:54.229 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/218 2023-11-13T13:02:54.231 INFO:teuthology.orchestra.run.smithi102.stdout:Not run: generic/218 2023-11-13T13:02:54.231 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T13:02:54.241 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T13:02:54.281 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T13:02:54.281 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/219) 2023-11-13T13:02:54.913 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T13:02:54.933 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T13:02:54.934 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T13:02:55.364 INFO:teuthology.orchestra.run.smithi102.stdout:generic/219 [not run] this test requires a valid $SCRATCH_DEV 2023-11-13T13:02:55.377 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/219 2023-11-13T13:02:55.377 INFO:teuthology.orchestra.run.smithi102.stdout:Not run: generic/219 2023-11-13T13:02:55.377 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T13:02:55.389 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T13:02:55.428 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T13:02:55.429 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/220) 2023-11-13T13:02:56.036 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T13:02:56.054 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T13:02:56.054 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T13:02:56.499 INFO:teuthology.orchestra.run.smithi102.stdout:generic/220 [not run] this test requires a valid $SCRATCH_DEV 2023-11-13T13:02:56.513 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/220 2023-11-13T13:02:56.513 INFO:teuthology.orchestra.run.smithi102.stdout:Not run: generic/220 2023-11-13T13:02:56.514 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T13:02:56.527 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T13:02:56.573 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T13:02:56.573 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/221) 2023-11-13T13:02:57.197 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T13:02:57.215 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T13:02:57.216 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T13:02:59.058 INFO:teuthology.orchestra.run.smithi102.stdout:generic/221 2s 2023-11-13T13:02:59.078 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/221 2023-11-13T13:02:59.079 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T13:02:59.089 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T13:02:59.128 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T13:02:59.129 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/222) 2023-11-13T13:02:59.783 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T13:02:59.801 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T13:02:59.801 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T13:03:00.258 INFO:teuthology.orchestra.run.smithi102.stdout:generic/222 [not run] this test requires a valid $SCRATCH_DEV 2023-11-13T13:03:00.277 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/222 2023-11-13T13:03:00.277 INFO:teuthology.orchestra.run.smithi102.stdout:Not run: generic/222 2023-11-13T13:03:00.278 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T13:03:00.285 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T13:03:00.320 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T13:03:00.320 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/223) 2023-11-13T13:03:00.926 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T13:03:00.942 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T13:03:00.942 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T13:03:01.382 INFO:teuthology.orchestra.run.smithi102.stdout:generic/223 [not run] this test requires a valid $SCRATCH_DEV 2023-11-13T13:03:01.411 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/223 2023-11-13T13:03:01.411 INFO:teuthology.orchestra.run.smithi102.stdout:Not run: generic/223 2023-11-13T13:03:01.411 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T13:03:01.422 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T13:03:01.454 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T13:03:01.455 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/224) 2023-11-13T13:03:02.076 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T13:03:02.099 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T13:03:02.100 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T13:03:02.555 INFO:teuthology.orchestra.run.smithi102.stdout:generic/224 [not run] this test requires a valid $SCRATCH_DEV 2023-11-13T13:03:02.569 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/224 2023-11-13T13:03:02.569 INFO:teuthology.orchestra.run.smithi102.stdout:Not run: generic/224 2023-11-13T13:03:02.569 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T13:03:02.581 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T13:03:02.617 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T13:03:02.617 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/225) 2023-11-13T13:03:03.203 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T13:03:03.217 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T13:03:03.217 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T13:03:03.671 INFO:teuthology.orchestra.run.smithi102.stdout:generic/225 [not run] this test requires a valid $SCRATCH_DEV 2023-11-13T13:03:03.686 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/225 2023-11-13T13:03:03.687 INFO:teuthology.orchestra.run.smithi102.stdout:Not run: generic/225 2023-11-13T13:03:03.687 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T13:03:03.694 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T13:03:03.725 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T13:03:03.725 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/226) 2023-11-13T13:03:04.318 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T13:03:04.335 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T13:03:04.335 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T13:03:04.781 INFO:teuthology.orchestra.run.smithi102.stdout:generic/226 [not run] this test requires a valid $SCRATCH_DEV 2023-11-13T13:03:04.795 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/226 2023-11-13T13:03:04.796 INFO:teuthology.orchestra.run.smithi102.stdout:Not run: generic/226 2023-11-13T13:03:04.796 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T13:03:04.813 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T13:03:04.846 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T13:03:04.846 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/227) 2023-11-13T13:03:05.460 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T13:03:05.475 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T13:03:05.475 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T13:03:05.926 INFO:teuthology.orchestra.run.smithi102.stdout:generic/227 [not run] this test requires a valid $SCRATCH_DEV 2023-11-13T13:03:05.937 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/227 2023-11-13T13:03:05.938 INFO:teuthology.orchestra.run.smithi102.stdout:Not run: generic/227 2023-11-13T13:03:05.938 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T13:03:05.946 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T13:03:05.981 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T13:03:05.981 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/228) 2023-11-13T13:03:06.628 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T13:03:06.643 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T13:03:06.643 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T13:03:07.559 INFO:teuthology.orchestra.run.smithi102.stdout:generic/228 1s 2023-11-13T13:03:07.579 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/228 2023-11-13T13:03:07.580 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T13:03:07.590 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T13:03:07.687 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T13:03:07.687 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/229) 2023-11-13T13:03:08.552 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T13:03:08.574 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T13:03:08.574 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T13:03:09.059 INFO:teuthology.orchestra.run.smithi102.stdout:generic/229 [not run] this test requires a valid $SCRATCH_DEV 2023-11-13T13:03:09.074 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/229 2023-11-13T13:03:09.074 INFO:teuthology.orchestra.run.smithi102.stdout:Not run: generic/229 2023-11-13T13:03:09.074 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T13:03:09.082 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T13:03:09.120 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T13:03:09.121 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/230) 2023-11-13T13:03:09.780 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T13:03:09.795 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T13:03:09.796 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T13:03:10.260 INFO:teuthology.orchestra.run.smithi102.stdout:generic/230 [not run] this test requires a valid $SCRATCH_DEV 2023-11-13T13:03:10.273 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/230 2023-11-13T13:03:10.273 INFO:teuthology.orchestra.run.smithi102.stdout:Not run: generic/230 2023-11-13T13:03:10.273 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T13:03:10.281 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T13:03:10.312 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T13:03:10.312 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/231) 2023-11-13T13:03:10.941 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T13:03:10.956 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T13:03:10.956 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T13:03:11.389 INFO:teuthology.orchestra.run.smithi102.stdout:generic/231 [not run] this test requires a valid $SCRATCH_DEV 2023-11-13T13:03:11.404 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/231 2023-11-13T13:03:11.404 INFO:teuthology.orchestra.run.smithi102.stdout:Not run: generic/231 2023-11-13T13:03:11.404 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T13:03:11.417 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T13:03:11.458 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T13:03:11.459 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/232) 2023-11-13T13:03:12.104 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T13:03:12.121 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T13:03:12.122 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T13:03:12.639 INFO:teuthology.orchestra.run.smithi102.stdout:generic/232 [not run] this test requires a valid $SCRATCH_DEV 2023-11-13T13:03:12.651 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/232 2023-11-13T13:03:12.652 INFO:teuthology.orchestra.run.smithi102.stdout:Not run: generic/232 2023-11-13T13:03:12.652 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T13:03:12.662 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T13:03:12.735 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T13:03:12.736 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/233) 2023-11-13T13:03:13.216 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T13:03:13.232 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T13:03:13.232 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T13:03:13.747 INFO:teuthology.orchestra.run.smithi102.stdout:generic/233 [not run] this test requires a valid $SCRATCH_DEV 2023-11-13T13:03:13.765 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/233 2023-11-13T13:03:13.765 INFO:teuthology.orchestra.run.smithi102.stdout:Not run: generic/233 2023-11-13T13:03:13.766 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T13:03:13.776 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T13:03:13.833 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T13:03:13.834 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/234) 2023-11-13T13:03:14.444 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T13:03:14.461 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T13:03:14.462 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T13:03:14.955 INFO:teuthology.orchestra.run.smithi102.stdout:generic/234 [not run] this test requires a valid $SCRATCH_DEV 2023-11-13T13:03:14.968 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/234 2023-11-13T13:03:14.968 INFO:teuthology.orchestra.run.smithi102.stdout:Not run: generic/234 2023-11-13T13:03:14.969 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T13:03:14.978 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T13:03:15.007 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T13:03:15.007 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/235) 2023-11-13T13:03:15.618 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T13:03:15.631 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T13:03:15.632 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T13:03:16.084 INFO:teuthology.orchestra.run.smithi102.stdout:generic/235 [not run] this test requires a valid $SCRATCH_DEV 2023-11-13T13:03:16.102 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/235 2023-11-13T13:03:16.102 INFO:teuthology.orchestra.run.smithi102.stdout:Not run: generic/235 2023-11-13T13:03:16.102 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T13:03:16.110 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T13:03:16.152 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T13:03:16.153 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/236) 2023-11-13T13:03:16.792 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T13:03:16.813 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T13:03:16.813 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T13:03:18.648 INFO:teuthology.orchestra.run.smithi102.stdout:generic/236 2s 2023-11-13T13:03:18.670 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/236 2023-11-13T13:03:18.670 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T13:03:18.678 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T13:03:18.726 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T13:03:18.727 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/237) 2023-11-13T13:03:19.655 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T13:03:19.670 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T13:03:19.671 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T13:03:20.343 INFO:teuthology.orchestra.run.smithi102.stdout:generic/237 [not run] ACLs not supported by this filesystem type: ceph-fuse 2023-11-13T13:03:20.354 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/237 2023-11-13T13:03:20.354 INFO:teuthology.orchestra.run.smithi102.stdout:Not run: generic/237 2023-11-13T13:03:20.354 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T13:03:20.363 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T13:03:20.401 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T13:03:20.401 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/238) 2023-11-13T13:03:21.069 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T13:03:21.090 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T13:03:21.091 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T13:03:21.533 INFO:teuthology.orchestra.run.smithi102.stdout:generic/238 [not run] this test requires a valid $SCRATCH_DEV 2023-11-13T13:03:21.547 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/238 2023-11-13T13:03:21.548 INFO:teuthology.orchestra.run.smithi102.stdout:Not run: generic/238 2023-11-13T13:03:21.548 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T13:03:21.560 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T13:03:21.589 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T13:03:21.589 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/239) 2023-11-13T13:03:22.232 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T13:03:22.253 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T13:03:22.253 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T13:06:19.252 INFO:teuthology.orchestra.run.smithi102.stdout:generic/239 177s 2023-11-13T13:06:19.270 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/239 2023-11-13T13:06:19.270 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T13:06:19.282 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T13:06:19.317 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T13:06:19.317 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/240) 2023-11-13T13:06:20.244 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T13:06:20.262 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T13:06:20.262 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T13:06:24.787 INFO:teuthology.orchestra.run.smithi102.stdout:generic/240 4s 2023-11-13T13:06:24.809 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/240 2023-11-13T13:06:24.809 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T13:06:24.818 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T13:06:24.855 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T13:06:24.856 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/241) 2023-11-13T13:06:25.819 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T13:06:25.843 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T13:06:25.843 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T13:07:39.155 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T13:07:39.170 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T13:07:39.765 INFO:teuthology.orchestra.run.smithi102.stdout:generic/241 74s 2023-11-13T13:07:39.786 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/241 2023-11-13T13:07:39.786 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T13:07:39.795 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T13:07:39.833 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T13:07:39.833 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/242) 2023-11-13T13:07:40.734 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T13:07:40.751 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T13:07:40.751 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T13:07:41.428 INFO:teuthology.orchestra.run.smithi102.stdout:generic/242 [not run] this test requires a valid $SCRATCH_DEV 2023-11-13T13:07:41.440 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/242 2023-11-13T13:07:41.440 INFO:teuthology.orchestra.run.smithi102.stdout:Not run: generic/242 2023-11-13T13:07:41.440 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T13:07:41.450 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T13:07:41.483 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T13:07:41.484 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/243) 2023-11-13T13:07:42.077 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T13:07:42.094 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T13:07:42.094 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T13:07:42.909 INFO:teuthology.orchestra.run.smithi102.stdout:generic/243 [not run] this test requires a valid $SCRATCH_DEV 2023-11-13T13:07:42.920 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/243 2023-11-13T13:07:42.920 INFO:teuthology.orchestra.run.smithi102.stdout:Not run: generic/243 2023-11-13T13:07:42.920 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T13:07:42.930 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T13:07:42.959 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T13:07:42.959 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/244) 2023-11-13T13:07:43.518 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T13:07:43.534 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T13:07:43.535 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T13:07:44.432 INFO:teuthology.orchestra.run.smithi102.stdout:generic/244 [not run] disk quotas not supported by this filesystem type: ceph-fuse 2023-11-13T13:07:44.444 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/244 2023-11-13T13:07:44.445 INFO:teuthology.orchestra.run.smithi102.stdout:Not run: generic/244 2023-11-13T13:07:44.445 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T13:07:44.454 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T13:07:44.482 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T13:07:44.482 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/245) 2023-11-13T13:07:45.072 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T13:07:45.091 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T13:07:45.092 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T13:07:46.541 INFO:teuthology.orchestra.run.smithi102.stdout:generic/245 1s 2023-11-13T13:07:47.088 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/245 2023-11-13T13:07:47.089 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T13:07:47.096 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T13:07:47.125 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T13:07:47.125 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/246) 2023-11-13T13:07:48.051 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T13:07:48.067 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T13:07:48.067 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T13:07:49.431 INFO:teuthology.orchestra.run.smithi102.stdout:generic/246 1s 2023-11-13T13:07:49.451 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/246 2023-11-13T13:07:49.451 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T13:07:49.463 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T13:07:49.493 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T13:07:49.494 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/247) 2023-11-13T13:07:50.441 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T13:07:50.457 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T13:07:50.457 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T13:08:09.237 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T13:08:09.242 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T13:08:09.282 INFO:tasks.ceph.osd.5.smithi154.stderr:2023-11-13T13:08:09.277+0000 7f77ec91b640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 44618) UID: 0 2023-11-13T13:08:09.283 INFO:tasks.ceph.osd.6.smithi154.stderr:2023-11-13T13:08:09.273+0000 7f3c803e2640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 44618) UID: 0 2023-11-13T13:08:09.283 INFO:tasks.ceph.osd.7.smithi154.stderr:2023-11-13T13:08:09.273+0000 7f10baf5d640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 44618) UID: 0 2023-11-13T13:08:09.283 INFO:tasks.ceph.osd.4.smithi154.stderr:2023-11-13T13:08:09.277+0000 7fce06bbb640 -1 Fail to open '/proc/44618/cmdline' error = (2) No such file or directory 2023-11-13T13:08:09.283 INFO:tasks.ceph.osd.4.smithi154.stderr:2023-11-13T13:08:09.277+0000 7fce06bbb640 -1 received signal: Hangup from (PID: 44618) UID: 0 2023-11-13T13:08:40.231 INFO:teuthology.orchestra.run.smithi102.stdout:generic/247 50s 2023-11-13T13:08:40.253 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/247 2023-11-13T13:08:40.253 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T13:08:40.265 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T13:08:40.298 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T13:08:40.299 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/248) 2023-11-13T13:08:40.843 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T13:08:40.862 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T13:08:40.862 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T13:08:41.335 INFO:teuthology.orchestra.run.smithi102.stdout:generic/248 1s 2023-11-13T13:08:41.352 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/248 2023-11-13T13:08:41.352 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T13:08:41.366 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T13:08:41.396 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T13:08:41.397 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/249) 2023-11-13T13:08:41.950 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T13:08:41.963 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T13:08:41.963 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T13:08:46.133 INFO:teuthology.orchestra.run.smithi102.stdout:generic/249 5s 2023-11-13T13:08:46.157 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/249 2023-11-13T13:08:46.157 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T13:08:46.168 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T13:08:46.205 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T13:08:46.206 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/250) 2023-11-13T13:08:47.084 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T13:08:47.099 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T13:08:47.099 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T13:08:47.539 INFO:teuthology.orchestra.run.smithi102.stdout:generic/250 [not run] this test requires a valid $SCRATCH_DEV 2023-11-13T13:08:47.550 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/250 2023-11-13T13:08:47.551 INFO:teuthology.orchestra.run.smithi102.stdout:Not run: generic/250 2023-11-13T13:08:47.551 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T13:08:47.561 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T13:08:47.634 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T13:08:47.634 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/251) 2023-11-13T13:08:48.178 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T13:08:48.191 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T13:08:48.192 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T13:08:48.638 INFO:teuthology.orchestra.run.smithi102.stdout:generic/251 [not run] this test requires a valid $SCRATCH_DEV 2023-11-13T13:08:48.650 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/251 2023-11-13T13:08:48.651 INFO:teuthology.orchestra.run.smithi102.stdout:Not run: generic/251 2023-11-13T13:08:48.651 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T13:08:48.659 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T13:08:48.684 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T13:08:48.685 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/252) 2023-11-13T13:08:49.229 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T13:08:49.250 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T13:08:49.250 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T13:08:50.131 INFO:teuthology.orchestra.run.smithi102.stdout:generic/252 [not run] this test requires a valid $SCRATCH_DEV 2023-11-13T13:08:50.140 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/252 2023-11-13T13:08:50.141 INFO:teuthology.orchestra.run.smithi102.stdout:Not run: generic/252 2023-11-13T13:08:50.141 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T13:08:50.155 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T13:08:50.195 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T13:08:50.196 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/253) 2023-11-13T13:08:50.754 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T13:08:50.768 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T13:08:50.768 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T13:08:51.213 INFO:teuthology.orchestra.run.smithi102.stdout:generic/253 [not run] this test requires a valid $SCRATCH_DEV 2023-11-13T13:08:51.225 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/253 2023-11-13T13:08:51.226 INFO:teuthology.orchestra.run.smithi102.stdout:Not run: generic/253 2023-11-13T13:08:51.226 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T13:08:51.235 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T13:08:51.270 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T13:08:51.271 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/254) 2023-11-13T13:08:51.795 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T13:08:51.809 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T13:08:51.810 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T13:08:52.216 INFO:teuthology.orchestra.run.smithi102.stdout:generic/254 [not run] this test requires a valid $SCRATCH_DEV 2023-11-13T13:08:52.227 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/254 2023-11-13T13:08:52.227 INFO:teuthology.orchestra.run.smithi102.stdout:Not run: generic/254 2023-11-13T13:08:52.228 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T13:08:52.234 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T13:08:52.261 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T13:08:52.262 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/255) 2023-11-13T13:08:52.827 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T13:08:52.844 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T13:08:52.844 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T13:08:55.564 INFO:teuthology.orchestra.run.smithi102.stdout:generic/255 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2023-11-13T13:08:55.572 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/255 2023-11-13T13:08:55.572 INFO:teuthology.orchestra.run.smithi102.stdout:Not run: generic/255 2023-11-13T13:08:55.573 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T13:08:55.579 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T13:08:55.608 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T13:08:55.608 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/256) 2023-11-13T13:08:56.320 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T13:08:56.331 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T13:08:56.331 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T13:08:57.769 INFO:teuthology.orchestra.run.smithi102.stdout:generic/256 [not run] this test requires a valid $SCRATCH_DEV 2023-11-13T13:08:57.778 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/256 2023-11-13T13:08:57.778 INFO:teuthology.orchestra.run.smithi102.stdout:Not run: generic/256 2023-11-13T13:08:57.778 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T13:08:57.784 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T13:08:57.854 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T13:08:57.855 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/257) 2023-11-13T13:08:58.224 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T13:08:58.234 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T13:08:58.235 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T13:08:59.796 INFO:teuthology.orchestra.run.smithi102.stdout:generic/257 1s 2023-11-13T13:08:59.808 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/257 2023-11-13T13:08:59.809 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T13:08:59.814 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T13:08:59.835 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T13:08:59.835 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/258) 2023-11-13T13:09:00.480 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T13:09:00.490 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T13:09:00.491 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T13:09:00.945 INFO:teuthology.orchestra.run.smithi102.stdout:generic/258 [failed, exit status 1]- output mismatch (see /tmp/tmp.EnLPmcWJbzxfstests-dev/results//generic/258.out.bad) 2023-11-13T13:09:00.951 INFO:teuthology.orchestra.run.smithi102.stdout: --- tests/generic/258.out 2023-11-13 11:30:05.313485457 +0000 2023-11-13T13:09:00.951 INFO:teuthology.orchestra.run.smithi102.stdout: +++ /tmp/tmp.EnLPmcWJbzxfstests-dev/results//generic/258.out.bad 2023-11-13 13:09:00.938532490 +0000 2023-11-13T13:09:00.951 INFO:teuthology.orchestra.run.smithi102.stdout: @@ -1,5 +1,6 @@ 2023-11-13T13:09:00.951 INFO:teuthology.orchestra.run.smithi102.stdout: QA output created by 258 2023-11-13T13:09:00.952 INFO:teuthology.orchestra.run.smithi102.stdout: Creating file with timestamp of Jan 1, 1960 2023-11-13T13:09:00.952 INFO:teuthology.orchestra.run.smithi102.stdout: Testing for negative seconds since epoch 2023-11-13T13:09:00.952 INFO:teuthology.orchestra.run.smithi102.stdout: -Remounting to flush cache 2023-11-13T13:09:00.952 INFO:teuthology.orchestra.run.smithi102.stdout: -Testing for negative seconds since epoch 2023-11-13T13:09:00.952 INFO:teuthology.orchestra.run.smithi102.stdout: +Timestamp wrapped: 3979351756 2023-11-13T13:09:00.952 INFO:teuthology.orchestra.run.smithi102.stdout: +Timestamp wrapped 2023-11-13T13:09:00.953 INFO:teuthology.orchestra.run.smithi102.stdout: +(see /tmp/tmp.EnLPmcWJbzxfstests-dev/results//generic/258.full for details) 2023-11-13T13:09:00.956 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/258 2023-11-13T13:09:00.957 INFO:teuthology.orchestra.run.smithi102.stdout:Failures: generic/258 2023-11-13T13:09:00.957 INFO:teuthology.orchestra.run.smithi102.stdout:Failed 1 of 1 tests 2023-11-13T13:09:00.963 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T13:09:00.980 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-13T13:09:00.981 INFO:tasks.cephfs.xfstests_dev:Command failed 2023-11-13T13:09:00.981 INFO:tasks.cephfs.xfstests_dev:Command return value: 1 2023-11-13T13:09:00.982 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/259) 2023-11-13T13:09:01.364 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T13:09:01.374 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T13:09:01.375 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T13:09:01.649 INFO:teuthology.orchestra.run.smithi102.stdout:generic/259 [not run] this test requires a valid $SCRATCH_DEV 2023-11-13T13:09:01.657 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/259 2023-11-13T13:09:01.658 INFO:teuthology.orchestra.run.smithi102.stdout:Not run: generic/259 2023-11-13T13:09:01.658 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T13:09:01.664 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T13:09:01.685 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T13:09:01.686 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/260) 2023-11-13T13:09:02.080 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T13:09:02.090 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T13:09:02.090 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T13:09:02.365 INFO:teuthology.orchestra.run.smithi102.stdout:generic/260 [not run] this test requires a valid $SCRATCH_DEV 2023-11-13T13:09:02.373 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/260 2023-11-13T13:09:02.373 INFO:teuthology.orchestra.run.smithi102.stdout:Not run: generic/260 2023-11-13T13:09:02.373 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T13:09:02.379 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T13:09:02.399 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T13:09:02.399 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/261) 2023-11-13T13:09:02.777 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T13:09:02.787 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T13:09:02.787 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T13:09:03.056 INFO:teuthology.orchestra.run.smithi102.stdout:generic/261 [not run] this test requires a valid $SCRATCH_DEV 2023-11-13T13:09:03.064 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/261 2023-11-13T13:09:03.064 INFO:teuthology.orchestra.run.smithi102.stdout:Not run: generic/261 2023-11-13T13:09:03.064 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T13:09:03.070 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T13:09:03.090 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T13:09:03.090 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/262) 2023-11-13T13:09:03.460 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T13:09:03.470 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T13:09:03.471 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T13:09:03.748 INFO:teuthology.orchestra.run.smithi102.stdout:generic/262 [not run] this test requires a valid $SCRATCH_DEV 2023-11-13T13:09:03.756 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/262 2023-11-13T13:09:03.756 INFO:teuthology.orchestra.run.smithi102.stdout:Not run: generic/262 2023-11-13T13:09:03.756 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T13:09:03.763 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T13:09:03.783 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T13:09:03.783 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/263) 2023-11-13T13:09:04.177 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T13:09:04.188 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T13:09:04.188 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T13:09:58.821 INFO:teuthology.orchestra.run.smithi102.stdout:generic/263 54s 2023-11-13T13:09:58.833 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/263 2023-11-13T13:09:58.833 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T13:09:58.839 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T13:09:59.022 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T13:09:59.023 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/264) 2023-11-13T13:09:59.560 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T13:09:59.571 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T13:09:59.571 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T13:09:59.861 INFO:teuthology.orchestra.run.smithi102.stdout:generic/264 [not run] this test requires a valid $SCRATCH_DEV 2023-11-13T13:09:59.869 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/264 2023-11-13T13:09:59.870 INFO:teuthology.orchestra.run.smithi102.stdout:Not run: generic/264 2023-11-13T13:09:59.870 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T13:09:59.875 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T13:09:59.895 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T13:09:59.896 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/265) 2023-11-13T13:10:00.655 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T13:10:00.667 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T13:10:00.667 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T13:10:00.961 INFO:teuthology.orchestra.run.smithi102.stdout:generic/265 [not run] this test requires a valid $SCRATCH_DEV 2023-11-13T13:10:00.969 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/265 2023-11-13T13:10:00.969 INFO:teuthology.orchestra.run.smithi102.stdout:Not run: generic/265 2023-11-13T13:10:00.969 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T13:10:00.975 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T13:10:00.994 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T13:10:00.995 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/266) 2023-11-13T13:10:01.351 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T13:10:01.361 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T13:10:01.362 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T13:10:01.655 INFO:teuthology.orchestra.run.smithi102.stdout:generic/266 [not run] this test requires a valid $SCRATCH_DEV 2023-11-13T13:10:01.663 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/266 2023-11-13T13:10:01.663 INFO:teuthology.orchestra.run.smithi102.stdout:Not run: generic/266 2023-11-13T13:10:01.664 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T13:10:01.669 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T13:10:01.688 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T13:10:01.689 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/267) 2023-11-13T13:10:02.073 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T13:10:02.084 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T13:10:02.084 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T13:10:02.394 INFO:teuthology.orchestra.run.smithi102.stdout:generic/267 [not run] this test requires a valid $SCRATCH_DEV 2023-11-13T13:10:02.402 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/267 2023-11-13T13:10:02.402 INFO:teuthology.orchestra.run.smithi102.stdout:Not run: generic/267 2023-11-13T13:10:02.403 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T13:10:02.409 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T13:10:02.428 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T13:10:02.429 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/268) 2023-11-13T13:10:02.800 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T13:10:02.811 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T13:10:02.811 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T13:10:03.146 INFO:teuthology.orchestra.run.smithi102.stdout:generic/268 [not run] this test requires a valid $SCRATCH_DEV 2023-11-13T13:10:03.154 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/268 2023-11-13T13:10:03.154 INFO:teuthology.orchestra.run.smithi102.stdout:Not run: generic/268 2023-11-13T13:10:03.155 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T13:10:03.160 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T13:10:03.180 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T13:10:03.181 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/269) 2023-11-13T13:10:03.555 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T13:10:03.566 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T13:10:03.566 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T13:10:03.848 INFO:teuthology.orchestra.run.smithi102.stdout:generic/269 [not run] this test requires a valid $SCRATCH_DEV 2023-11-13T13:10:03.856 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/269 2023-11-13T13:10:03.857 INFO:teuthology.orchestra.run.smithi102.stdout:Not run: generic/269 2023-11-13T13:10:03.857 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T13:10:03.863 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T13:10:03.883 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T13:10:03.884 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/270) 2023-11-13T13:10:04.244 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T13:10:04.254 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T13:10:04.255 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T13:10:04.543 INFO:teuthology.orchestra.run.smithi102.stdout:generic/270 [not run] disk quotas not supported by this filesystem type: ceph-fuse 2023-11-13T13:10:04.551 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/270 2023-11-13T13:10:04.551 INFO:teuthology.orchestra.run.smithi102.stdout:Not run: generic/270 2023-11-13T13:10:04.552 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T13:10:04.557 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T13:10:04.577 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T13:10:04.578 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/271) 2023-11-13T13:10:04.948 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T13:10:04.958 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T13:10:04.958 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T13:10:05.271 INFO:teuthology.orchestra.run.smithi102.stdout:generic/271 [not run] this test requires a valid $SCRATCH_DEV 2023-11-13T13:10:05.280 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/271 2023-11-13T13:10:05.280 INFO:teuthology.orchestra.run.smithi102.stdout:Not run: generic/271 2023-11-13T13:10:05.280 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T13:10:05.286 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T13:10:05.306 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T13:10:05.306 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/272) 2023-11-13T13:10:05.688 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T13:10:05.698 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T13:10:05.698 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T13:10:06.006 INFO:teuthology.orchestra.run.smithi102.stdout:generic/272 [not run] this test requires a valid $SCRATCH_DEV 2023-11-13T13:10:06.014 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/272 2023-11-13T13:10:06.015 INFO:teuthology.orchestra.run.smithi102.stdout:Not run: generic/272 2023-11-13T13:10:06.015 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T13:10:06.021 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T13:10:06.041 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T13:10:06.042 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/273) 2023-11-13T13:10:06.404 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T13:10:06.414 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T13:10:06.414 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T13:10:06.714 INFO:teuthology.orchestra.run.smithi102.stdout:generic/273 [not run] this test requires a valid $SCRATCH_DEV 2023-11-13T13:10:06.722 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/273 2023-11-13T13:10:06.723 INFO:teuthology.orchestra.run.smithi102.stdout:Not run: generic/273 2023-11-13T13:10:06.723 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T13:10:06.729 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T13:10:06.748 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T13:10:06.749 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/274) 2023-11-13T13:10:07.123 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T13:10:07.134 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T13:10:07.134 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T13:10:07.403 INFO:teuthology.orchestra.run.smithi102.stdout:generic/274 [not run] this test requires a valid $SCRATCH_DEV 2023-11-13T13:10:07.411 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/274 2023-11-13T13:10:07.411 INFO:teuthology.orchestra.run.smithi102.stdout:Not run: generic/274 2023-11-13T13:10:07.411 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T13:10:07.417 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T13:10:07.436 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T13:10:07.437 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/275) 2023-11-13T13:10:07.812 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T13:10:07.833 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T13:10:07.834 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T13:10:08.101 INFO:teuthology.orchestra.run.smithi102.stdout:generic/275 [not run] this test requires a valid $SCRATCH_DEV 2023-11-13T13:10:08.110 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/275 2023-11-13T13:10:08.110 INFO:teuthology.orchestra.run.smithi102.stdout:Not run: generic/275 2023-11-13T13:10:08.110 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T13:10:08.115 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T13:10:08.137 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T13:10:08.137 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/276) 2023-11-13T13:10:08.528 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T13:10:08.538 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T13:10:08.539 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T13:10:08.838 INFO:teuthology.orchestra.run.smithi102.stdout:generic/276 [not run] this test requires a valid $SCRATCH_DEV 2023-11-13T13:10:08.848 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/276 2023-11-13T13:10:08.848 INFO:teuthology.orchestra.run.smithi102.stdout:Not run: generic/276 2023-11-13T13:10:08.849 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T13:10:08.853 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T13:10:08.872 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T13:10:08.873 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/277) 2023-11-13T13:10:09.244 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T13:10:09.255 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T13:10:09.255 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T13:10:09.550 INFO:teuthology.orchestra.run.smithi102.stdout:generic/277 [not run] this test requires a valid $SCRATCH_DEV 2023-11-13T13:10:09.558 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/277 2023-11-13T13:10:09.558 INFO:teuthology.orchestra.run.smithi102.stdout:Not run: generic/277 2023-11-13T13:10:09.559 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T13:10:09.565 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T13:10:09.584 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T13:10:09.585 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/278) 2023-11-13T13:10:09.964 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T13:10:09.975 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T13:10:09.975 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T13:10:10.281 INFO:teuthology.orchestra.run.smithi102.stdout:generic/278 [not run] this test requires a valid $SCRATCH_DEV 2023-11-13T13:10:10.289 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/278 2023-11-13T13:10:10.289 INFO:teuthology.orchestra.run.smithi102.stdout:Not run: generic/278 2023-11-13T13:10:10.289 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T13:10:10.295 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T13:10:10.314 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T13:10:10.315 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/279) 2023-11-13T13:10:10.668 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T13:10:10.678 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T13:10:10.678 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T13:10:10.968 INFO:teuthology.orchestra.run.smithi102.stdout:generic/279 [not run] this test requires a valid $SCRATCH_DEV 2023-11-13T13:10:10.976 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/279 2023-11-13T13:10:10.977 INFO:teuthology.orchestra.run.smithi102.stdout:Not run: generic/279 2023-11-13T13:10:10.977 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T13:10:10.983 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T13:10:11.038 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T13:10:11.039 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/280) 2023-11-13T13:10:11.403 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T13:10:11.413 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T13:10:11.414 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T13:10:11.743 INFO:teuthology.orchestra.run.smithi102.stdout:generic/280 [not run] this test requires a valid $SCRATCH_DEV 2023-11-13T13:10:11.751 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/280 2023-11-13T13:10:11.751 INFO:teuthology.orchestra.run.smithi102.stdout:Not run: generic/280 2023-11-13T13:10:11.752 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T13:10:11.758 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T13:10:11.778 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T13:10:11.778 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/281) 2023-11-13T13:10:12.152 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T13:10:12.162 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T13:10:12.162 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T13:10:12.464 INFO:teuthology.orchestra.run.smithi102.stdout:generic/281 [not run] this test requires a valid $SCRATCH_DEV 2023-11-13T13:10:12.473 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/281 2023-11-13T13:10:12.473 INFO:teuthology.orchestra.run.smithi102.stdout:Not run: generic/281 2023-11-13T13:10:12.473 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T13:10:12.479 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T13:10:12.499 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T13:10:12.499 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/282) 2023-11-13T13:10:12.877 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T13:10:12.887 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T13:10:12.888 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T13:10:13.170 INFO:teuthology.orchestra.run.smithi102.stdout:generic/282 [not run] this test requires a valid $SCRATCH_DEV 2023-11-13T13:10:13.179 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/282 2023-11-13T13:10:13.179 INFO:teuthology.orchestra.run.smithi102.stdout:Not run: generic/282 2023-11-13T13:10:13.180 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T13:10:13.185 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T13:10:13.204 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T13:10:13.205 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/283) 2023-11-13T13:10:13.596 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T13:10:13.606 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T13:10:13.607 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T13:10:13.898 INFO:teuthology.orchestra.run.smithi102.stdout:generic/283 [not run] this test requires a valid $SCRATCH_DEV 2023-11-13T13:10:13.906 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/283 2023-11-13T13:10:13.906 INFO:teuthology.orchestra.run.smithi102.stdout:Not run: generic/283 2023-11-13T13:10:13.906 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T13:10:13.912 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T13:10:13.974 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T13:10:13.975 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/284) 2023-11-13T13:10:14.328 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T13:10:14.338 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T13:10:14.338 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T13:10:14.617 INFO:teuthology.orchestra.run.smithi102.stdout:generic/284 [not run] this test requires a valid $SCRATCH_DEV 2023-11-13T13:10:14.625 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/284 2023-11-13T13:10:14.626 INFO:teuthology.orchestra.run.smithi102.stdout:Not run: generic/284 2023-11-13T13:10:14.626 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T13:10:14.631 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T13:10:14.694 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T13:10:14.695 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/285) 2023-11-13T13:10:15.063 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T13:10:15.074 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T13:10:15.074 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T13:10:17.173 INFO:teuthology.orchestra.run.smithi102.stdout:generic/285 2s 2023-11-13T13:10:17.186 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/285 2023-11-13T13:10:17.186 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T13:10:17.192 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T13:10:17.214 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T13:10:17.215 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/286) 2023-11-13T13:10:18.033 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T13:10:18.049 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T13:10:18.049 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T13:10:56.030 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T13:10:56.037 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T13:10:56.077 INFO:tasks.ceph.osd.0.smithi102.stderr:2023-11-13T13:10:56.076+0000 7efed7bed640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 238611) UID: 0 2023-11-13T13:10:56.077 INFO:tasks.ceph.osd.2.smithi102.stderr:2023-11-13T13:10:56.076+0000 7f17fbe34640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 238611) UID: 0 2023-11-13T13:10:56.078 INFO:tasks.ceph.osd.1.smithi102.stderr:2023-11-13T13:10:56.076+0000 7f33d1116640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 238611) UID: 0 2023-11-13T13:10:56.078 INFO:tasks.ceph.osd.3.smithi102.stderr:2023-11-13T13:10:56.076+0000 7f48d17a6640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 238611) UID: 0 2023-11-13T13:11:06.504 INFO:teuthology.orchestra.run.smithi102.stdout:generic/286 48s 2023-11-13T13:11:06.517 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/286 2023-11-13T13:11:06.517 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T13:11:06.524 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T13:11:06.674 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T13:11:06.675 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/287) 2023-11-13T13:11:07.488 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T13:11:07.499 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T13:11:07.499 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T13:11:07.788 INFO:teuthology.orchestra.run.smithi102.stdout:generic/287 [not run] this test requires a valid $SCRATCH_DEV 2023-11-13T13:11:07.798 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/287 2023-11-13T13:11:07.798 INFO:teuthology.orchestra.run.smithi102.stdout:Not run: generic/287 2023-11-13T13:11:07.798 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T13:11:07.805 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T13:11:07.827 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T13:11:07.828 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/288) 2023-11-13T13:11:08.212 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T13:11:08.223 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T13:11:08.223 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T13:11:08.505 INFO:teuthology.orchestra.run.smithi102.stdout:generic/288 [not run] this test requires a valid $SCRATCH_DEV 2023-11-13T13:11:08.513 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/288 2023-11-13T13:11:08.513 INFO:teuthology.orchestra.run.smithi102.stdout:Not run: generic/288 2023-11-13T13:11:08.513 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T13:11:08.520 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T13:11:08.540 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T13:11:08.540 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/289) 2023-11-13T13:11:08.912 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T13:11:08.923 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T13:11:08.923 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T13:11:09.217 INFO:teuthology.orchestra.run.smithi102.stdout:generic/289 [not run] this test requires a valid $SCRATCH_DEV 2023-11-13T13:11:09.226 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/289 2023-11-13T13:11:09.226 INFO:teuthology.orchestra.run.smithi102.stdout:Not run: generic/289 2023-11-13T13:11:09.227 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T13:11:09.233 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T13:11:09.254 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T13:11:09.254 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/290) 2023-11-13T13:11:09.644 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T13:11:09.655 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T13:11:09.655 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T13:11:09.941 INFO:teuthology.orchestra.run.smithi102.stdout:generic/290 [not run] this test requires a valid $SCRATCH_DEV 2023-11-13T13:11:09.949 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/290 2023-11-13T13:11:09.949 INFO:teuthology.orchestra.run.smithi102.stdout:Not run: generic/290 2023-11-13T13:11:09.950 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T13:11:09.956 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T13:11:09.977 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T13:11:09.978 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/291) 2023-11-13T13:11:10.344 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T13:11:10.355 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T13:11:10.355 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T13:11:10.631 INFO:teuthology.orchestra.run.smithi102.stdout:generic/291 [not run] this test requires a valid $SCRATCH_DEV 2023-11-13T13:11:10.639 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/291 2023-11-13T13:11:10.640 INFO:teuthology.orchestra.run.smithi102.stdout:Not run: generic/291 2023-11-13T13:11:10.640 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T13:11:10.646 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T13:11:10.667 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T13:11:10.668 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/292) 2023-11-13T13:11:11.079 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T13:11:11.090 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T13:11:11.091 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T13:11:11.404 INFO:teuthology.orchestra.run.smithi102.stdout:generic/292 [not run] this test requires a valid $SCRATCH_DEV 2023-11-13T13:11:11.413 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/292 2023-11-13T13:11:11.414 INFO:teuthology.orchestra.run.smithi102.stdout:Not run: generic/292 2023-11-13T13:11:11.414 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T13:11:11.420 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T13:11:11.441 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T13:11:11.441 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/293) 2023-11-13T13:11:11.840 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T13:11:11.851 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T13:11:11.851 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T13:11:12.155 INFO:teuthology.orchestra.run.smithi102.stdout:generic/293 [not run] this test requires a valid $SCRATCH_DEV 2023-11-13T13:11:12.163 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/293 2023-11-13T13:11:12.164 INFO:teuthology.orchestra.run.smithi102.stdout:Not run: generic/293 2023-11-13T13:11:12.164 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T13:11:12.170 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T13:11:12.190 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T13:11:12.191 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/294) 2023-11-13T13:11:12.560 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T13:11:12.572 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T13:11:12.572 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T13:11:12.848 INFO:teuthology.orchestra.run.smithi102.stdout:generic/294 [not run] this test requires a valid $SCRATCH_DEV 2023-11-13T13:11:12.857 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/294 2023-11-13T13:11:12.857 INFO:teuthology.orchestra.run.smithi102.stdout:Not run: generic/294 2023-11-13T13:11:12.857 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T13:11:12.863 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T13:11:12.884 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T13:11:12.885 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/295) 2023-11-13T13:11:13.268 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T13:11:13.278 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T13:11:13.278 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T13:11:13.587 INFO:teuthology.orchestra.run.smithi102.stdout:generic/295 [not run] this test requires a valid $SCRATCH_DEV 2023-11-13T13:11:13.595 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/295 2023-11-13T13:11:13.596 INFO:teuthology.orchestra.run.smithi102.stdout:Not run: generic/295 2023-11-13T13:11:13.596 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T13:11:13.602 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T13:11:13.623 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T13:11:13.623 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/296) 2023-11-13T13:11:14.004 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T13:11:14.015 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T13:11:14.015 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T13:11:14.295 INFO:teuthology.orchestra.run.smithi102.stdout:generic/296 [not run] this test requires a valid $SCRATCH_DEV 2023-11-13T13:11:14.304 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/296 2023-11-13T13:11:14.304 INFO:teuthology.orchestra.run.smithi102.stdout:Not run: generic/296 2023-11-13T13:11:14.304 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T13:11:14.310 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T13:11:14.370 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T13:11:14.371 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/297) 2023-11-13T13:11:14.734 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T13:11:14.745 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T13:11:14.745 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T13:11:15.033 INFO:teuthology.orchestra.run.smithi102.stdout:generic/297 [not run] this test requires a valid $SCRATCH_DEV 2023-11-13T13:11:15.041 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/297 2023-11-13T13:11:15.041 INFO:teuthology.orchestra.run.smithi102.stdout:Not run: generic/297 2023-11-13T13:11:15.041 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T13:11:15.047 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T13:11:15.114 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T13:11:15.115 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/298) 2023-11-13T13:11:15.489 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T13:11:15.499 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T13:11:15.500 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T13:11:15.790 INFO:teuthology.orchestra.run.smithi102.stdout:generic/298 [not run] this test requires a valid $SCRATCH_DEV 2023-11-13T13:11:15.798 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/298 2023-11-13T13:11:15.798 INFO:teuthology.orchestra.run.smithi102.stdout:Not run: generic/298 2023-11-13T13:11:15.799 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T13:11:15.805 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T13:11:15.825 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T13:11:15.826 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/299) 2023-11-13T13:11:16.200 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T13:11:16.210 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T13:11:16.211 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T13:11:16.510 INFO:teuthology.orchestra.run.smithi102.stdout:generic/299 [not run] this test requires a valid $SCRATCH_DEV 2023-11-13T13:11:16.518 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/299 2023-11-13T13:11:16.518 INFO:teuthology.orchestra.run.smithi102.stdout:Not run: generic/299 2023-11-13T13:11:16.519 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T13:11:16.525 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T13:11:16.545 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T13:11:16.546 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/300) 2023-11-13T13:11:16.945 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T13:11:16.955 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T13:11:16.956 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T13:11:17.285 INFO:teuthology.orchestra.run.smithi102.stdout:generic/300 [not run] this test requires a valid $SCRATCH_DEV 2023-11-13T13:11:17.294 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/300 2023-11-13T13:11:17.294 INFO:teuthology.orchestra.run.smithi102.stdout:Not run: generic/300 2023-11-13T13:11:17.294 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T13:11:17.301 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T13:11:17.322 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T13:11:17.323 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/301) 2023-11-13T13:11:17.706 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T13:11:17.717 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T13:11:17.717 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T13:11:18.020 INFO:teuthology.orchestra.run.smithi102.stdout:generic/301 [not run] this test requires a valid $SCRATCH_DEV 2023-11-13T13:11:18.029 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/301 2023-11-13T13:11:18.029 INFO:teuthology.orchestra.run.smithi102.stdout:Not run: generic/301 2023-11-13T13:11:18.029 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T13:11:18.036 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T13:11:18.055 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T13:11:18.056 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/302) 2023-11-13T13:11:18.444 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T13:11:18.455 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T13:11:18.455 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T13:11:18.740 INFO:teuthology.orchestra.run.smithi102.stdout:generic/302 [not run] this test requires a valid $SCRATCH_DEV 2023-11-13T13:11:18.748 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/302 2023-11-13T13:11:18.748 INFO:teuthology.orchestra.run.smithi102.stdout:Not run: generic/302 2023-11-13T13:11:18.749 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T13:11:18.755 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T13:11:18.774 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T13:11:18.775 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/303) 2023-11-13T13:11:19.156 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T13:11:19.166 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T13:11:19.166 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T13:11:19.548 INFO:teuthology.orchestra.run.smithi102.stdout:generic/303 [not run] Reflink not supported by test filesystem type: ceph-fuse 2023-11-13T13:11:19.556 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/303 2023-11-13T13:11:19.557 INFO:teuthology.orchestra.run.smithi102.stdout:Not run: generic/303 2023-11-13T13:11:19.557 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T13:11:19.563 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T13:11:19.611 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T13:11:19.611 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/304) 2023-11-13T13:11:20.325 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T13:11:20.336 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T13:11:20.336 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T13:11:20.709 INFO:teuthology.orchestra.run.smithi102.stdout:generic/304 [not run] Dedupe not supported by test filesystem type: ceph-fuse 2023-11-13T13:11:20.717 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/304 2023-11-13T13:11:20.718 INFO:teuthology.orchestra.run.smithi102.stdout:Not run: generic/304 2023-11-13T13:11:20.718 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T13:11:20.723 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T13:11:20.807 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T13:11:20.808 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/305) 2023-11-13T13:11:21.452 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T13:11:21.462 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T13:11:21.463 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T13:11:21.755 INFO:teuthology.orchestra.run.smithi102.stdout:generic/305 [not run] this test requires a valid $SCRATCH_DEV 2023-11-13T13:11:21.763 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/305 2023-11-13T13:11:21.764 INFO:teuthology.orchestra.run.smithi102.stdout:Not run: generic/305 2023-11-13T13:11:21.764 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T13:11:21.770 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T13:11:21.789 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T13:11:21.790 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/306) 2023-11-13T13:11:22.180 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T13:11:22.191 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T13:11:22.191 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T13:11:22.471 INFO:teuthology.orchestra.run.smithi102.stdout:generic/306 [not run] this test requires a valid $SCRATCH_DEV 2023-11-13T13:11:22.480 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/306 2023-11-13T13:11:22.480 INFO:teuthology.orchestra.run.smithi102.stdout:Not run: generic/306 2023-11-13T13:11:22.480 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T13:11:22.486 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T13:11:22.506 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T13:11:22.507 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/307) 2023-11-13T13:11:22.892 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T13:11:22.902 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T13:11:22.902 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T13:11:23.183 INFO:teuthology.orchestra.run.smithi102.stdout:generic/307 [not run] this test requires a valid $SCRATCH_DEV 2023-11-13T13:11:23.192 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/307 2023-11-13T13:11:23.192 INFO:teuthology.orchestra.run.smithi102.stdout:Not run: generic/307 2023-11-13T13:11:23.192 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T13:11:23.198 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T13:11:23.217 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T13:11:23.218 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/308) 2023-11-13T13:11:23.592 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T13:11:23.602 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T13:11:23.603 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T13:11:23.946 INFO:teuthology.orchestra.run.smithi102.stdout:generic/308 0s 2023-11-13T13:11:23.960 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/308 2023-11-13T13:11:23.960 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T13:11:23.966 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T13:11:23.987 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T13:11:23.988 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/309) 2023-11-13T13:11:24.361 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T13:11:24.372 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T13:11:24.373 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T13:11:25.774 INFO:teuthology.orchestra.run.smithi102.stdout:generic/309 1s 2023-11-13T13:11:25.787 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/309 2023-11-13T13:11:25.787 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T13:11:25.793 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T13:11:25.946 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T13:11:25.946 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/310) 2023-11-13T13:11:26.551 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T13:11:26.562 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T13:11:26.562 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T13:12:56.009 INFO:teuthology.orchestra.run.smithi102.stdout:generic/310 89s 2023-11-13T13:12:56.063 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/310 2023-11-13T13:12:56.063 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T13:12:56.095 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T13:12:56.238 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T13:12:56.239 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/311) 2023-11-13T13:12:57.049 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T13:12:57.079 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T13:12:57.079 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T13:12:57.730 INFO:teuthology.orchestra.run.smithi102.stdout:generic/311 [not run] this test requires a valid $SCRATCH_DEV 2023-11-13T13:12:57.738 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/311 2023-11-13T13:12:57.739 INFO:teuthology.orchestra.run.smithi102.stdout:Not run: generic/311 2023-11-13T13:12:57.739 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T13:12:57.745 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T13:12:57.768 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T13:12:57.769 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/312) 2023-11-13T13:12:58.152 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T13:12:58.163 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T13:12:58.163 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T13:12:58.492 INFO:teuthology.orchestra.run.smithi102.stdout:generic/312 [not run] this test requires a valid $SCRATCH_DEV 2023-11-13T13:12:58.503 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/312 2023-11-13T13:12:58.504 INFO:teuthology.orchestra.run.smithi102.stdout:Not run: generic/312 2023-11-13T13:12:58.504 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T13:12:58.507 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T13:12:58.528 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T13:12:58.529 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/313) 2023-11-13T13:12:58.908 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T13:12:58.919 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T13:12:58.919 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T13:13:04.723 INFO:teuthology.orchestra.run.smithi102.stdout:generic/313 6s 2023-11-13T13:13:04.738 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/313 2023-11-13T13:13:04.738 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T13:13:04.746 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T13:13:04.767 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T13:13:04.768 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/314) 2023-11-13T13:13:05.159 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T13:13:05.169 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T13:13:05.169 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T13:13:06.601 INFO:teuthology.orchestra.run.smithi102.stdout:generic/314 1s 2023-11-13T13:13:06.614 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/314 2023-11-13T13:13:06.614 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T13:13:06.621 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T13:13:06.644 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T13:13:06.645 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/315) 2023-11-13T13:13:07.031 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T13:13:07.042 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T13:13:07.043 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T13:13:08.111 INFO:teuthology.orchestra.run.smithi102.stdout:generic/315 1s 2023-11-13T13:13:08.123 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/315 2023-11-13T13:13:08.124 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T13:13:08.129 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T13:13:08.339 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T13:13:08.339 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/316) 2023-11-13T13:13:08.901 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T13:13:08.912 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T13:13:08.912 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T13:13:10.494 INFO:teuthology.orchestra.run.smithi102.stdout:generic/316 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2023-11-13T13:13:10.503 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/316 2023-11-13T13:13:10.503 INFO:teuthology.orchestra.run.smithi102.stdout:Not run: generic/316 2023-11-13T13:13:10.503 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T13:13:10.509 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T13:13:10.542 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T13:13:10.543 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/317) 2023-11-13T13:13:11.251 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T13:13:11.262 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T13:13:11.263 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T13:13:11.570 INFO:teuthology.orchestra.run.smithi102.stdout:generic/317 [not run] this test requires a valid $SCRATCH_DEV 2023-11-13T13:13:11.579 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/317 2023-11-13T13:13:11.579 INFO:teuthology.orchestra.run.smithi102.stdout:Not run: generic/317 2023-11-13T13:13:11.579 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T13:13:11.585 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T13:13:11.606 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T13:13:11.606 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/318) 2023-11-13T13:13:12.000 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T13:13:12.011 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T13:13:12.011 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T13:13:12.317 INFO:teuthology.orchestra.run.smithi102.stdout:generic/318 [not run] this test requires a valid $SCRATCH_DEV 2023-11-13T13:13:12.325 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/318 2023-11-13T13:13:12.325 INFO:teuthology.orchestra.run.smithi102.stdout:Not run: generic/318 2023-11-13T13:13:12.325 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T13:13:12.331 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T13:13:12.352 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T13:13:12.353 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/319) 2023-11-13T13:13:12.714 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T13:13:12.725 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T13:13:12.726 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T13:13:13.233 INFO:teuthology.orchestra.run.smithi102.stdout:generic/319 [not run] ACLs not supported by this filesystem type: ceph-fuse 2023-11-13T13:13:13.241 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/319 2023-11-13T13:13:13.241 INFO:teuthology.orchestra.run.smithi102.stdout:Not run: generic/319 2023-11-13T13:13:13.241 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T13:13:13.248 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T13:13:13.267 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T13:13:13.267 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/320) 2023-11-13T13:13:13.656 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T13:13:13.666 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T13:13:13.667 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T13:13:13.958 INFO:teuthology.orchestra.run.smithi102.stdout:generic/320 [not run] this test requires a valid $SCRATCH_DEV 2023-11-13T13:13:13.967 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/320 2023-11-13T13:13:13.967 INFO:teuthology.orchestra.run.smithi102.stdout:Not run: generic/320 2023-11-13T13:13:13.968 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T13:13:13.973 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T13:13:13.994 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T13:13:13.995 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/321) 2023-11-13T13:13:14.370 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T13:13:14.381 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T13:13:14.381 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T13:13:14.787 INFO:teuthology.orchestra.run.smithi102.stdout:generic/321 [not run] this test requires a valid $SCRATCH_DEV 2023-11-13T13:13:14.796 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/321 2023-11-13T13:13:14.796 INFO:teuthology.orchestra.run.smithi102.stdout:Not run: generic/321 2023-11-13T13:13:14.796 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T13:13:14.802 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T13:13:14.823 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T13:13:14.824 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/322) 2023-11-13T13:13:15.188 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T13:13:15.199 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T13:13:15.199 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T13:13:15.517 INFO:teuthology.orchestra.run.smithi102.stdout:generic/322 [not run] this test requires a valid $SCRATCH_DEV 2023-11-13T13:13:15.525 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/322 2023-11-13T13:13:15.525 INFO:teuthology.orchestra.run.smithi102.stdout:Not run: generic/322 2023-11-13T13:13:15.526 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T13:13:15.532 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T13:13:15.552 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T13:13:15.553 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/323) 2023-11-13T13:13:15.936 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T13:13:15.946 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T13:13:15.947 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T13:14:42.555 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T13:14:42.559 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T13:14:42.588 INFO:tasks.ceph.osd.4.smithi154.stderr:2023-11-13T13:14:42.583+0000 7fce06bbb640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 44638) UID: 0 2023-11-13T13:14:42.588 INFO:tasks.ceph.osd.5.smithi154.stderr:2023-11-13T13:14:42.583+0000 7f77ec91b640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 44638) UID: 0 2023-11-13T13:14:42.589 INFO:tasks.ceph.osd.6.smithi154.stderr:2023-11-13T13:14:42.583+0000 7f3c803e2640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 44638) UID: 0 2023-11-13T13:14:42.589 INFO:tasks.ceph.osd.7.smithi154.stderr:2023-11-13T13:14:42.583+0000 7f10baf5d640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 44638) UID: 0 2023-11-13T13:15:17.498 INFO:teuthology.orchestra.run.smithi102.stdout:generic/323 122s 2023-11-13T13:15:17.543 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/323 2023-11-13T13:15:17.544 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T13:15:17.544 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T13:15:17.616 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T13:15:17.617 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/324) 2023-11-13T13:15:18.240 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T13:15:18.251 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T13:15:18.251 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T13:15:18.577 INFO:teuthology.orchestra.run.smithi102.stdout:generic/324 [not run] this test requires a valid $SCRATCH_DEV 2023-11-13T13:15:18.585 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/324 2023-11-13T13:15:18.585 INFO:teuthology.orchestra.run.smithi102.stdout:Not run: generic/324 2023-11-13T13:15:18.585 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T13:15:18.591 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T13:15:18.611 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T13:15:18.612 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/325) 2023-11-13T13:15:18.988 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T13:15:18.998 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T13:15:18.999 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T13:15:19.354 INFO:teuthology.orchestra.run.smithi102.stdout:generic/325 [not run] this test requires a valid $SCRATCH_DEV 2023-11-13T13:15:19.362 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/325 2023-11-13T13:15:19.362 INFO:teuthology.orchestra.run.smithi102.stdout:Not run: generic/325 2023-11-13T13:15:19.363 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T13:15:19.368 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T13:15:19.388 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T13:15:19.389 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/326) 2023-11-13T13:15:19.756 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T13:15:19.766 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T13:15:19.766 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T13:15:20.055 INFO:teuthology.orchestra.run.smithi102.stdout:generic/326 [not run] this test requires a valid $SCRATCH_DEV 2023-11-13T13:15:20.063 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/326 2023-11-13T13:15:20.063 INFO:teuthology.orchestra.run.smithi102.stdout:Not run: generic/326 2023-11-13T13:15:20.064 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T13:15:20.070 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T13:15:20.090 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T13:15:20.091 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/327) 2023-11-13T13:15:20.481 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T13:15:20.492 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T13:15:20.492 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T13:15:22.391 INFO:teuthology.orchestra.run.smithi102.stdout:generic/327 [not run] this test requires a valid $SCRATCH_DEV 2023-11-13T13:15:22.399 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/327 2023-11-13T13:15:22.399 INFO:teuthology.orchestra.run.smithi102.stdout:Not run: generic/327 2023-11-13T13:15:22.399 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T13:15:22.405 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T13:15:22.426 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T13:15:22.426 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/328) 2023-11-13T13:15:22.817 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T13:15:22.828 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T13:15:22.828 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T13:15:23.185 INFO:teuthology.orchestra.run.smithi102.stdout:generic/328 [not run] this test requires a valid $SCRATCH_DEV 2023-11-13T13:15:23.193 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/328 2023-11-13T13:15:23.194 INFO:teuthology.orchestra.run.smithi102.stdout:Not run: generic/328 2023-11-13T13:15:23.194 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T13:15:23.200 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T13:15:23.220 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T13:15:23.221 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/329) 2023-11-13T13:15:23.591 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T13:15:23.601 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T13:15:23.602 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T13:15:23.933 INFO:teuthology.orchestra.run.smithi102.stdout:generic/329 [not run] this test requires a valid $SCRATCH_DEV 2023-11-13T13:15:23.942 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/329 2023-11-13T13:15:23.942 INFO:teuthology.orchestra.run.smithi102.stdout:Not run: generic/329 2023-11-13T13:15:23.942 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T13:15:23.948 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T13:15:23.968 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T13:15:23.968 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/330) 2023-11-13T13:15:24.329 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T13:15:24.339 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T13:15:24.339 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T13:15:24.638 INFO:teuthology.orchestra.run.smithi102.stdout:generic/330 [not run] this test requires a valid $SCRATCH_DEV 2023-11-13T13:15:24.646 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/330 2023-11-13T13:15:24.646 INFO:teuthology.orchestra.run.smithi102.stdout:Not run: generic/330 2023-11-13T13:15:24.647 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T13:15:24.652 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T13:15:24.673 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T13:15:24.674 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/331) 2023-11-13T13:15:25.056 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T13:15:25.066 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T13:15:25.067 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T13:15:25.378 INFO:teuthology.orchestra.run.smithi102.stdout:generic/331 [not run] this test requires a valid $SCRATCH_DEV 2023-11-13T13:15:25.386 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/331 2023-11-13T13:15:25.386 INFO:teuthology.orchestra.run.smithi102.stdout:Not run: generic/331 2023-11-13T13:15:25.387 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T13:15:25.393 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T13:15:25.412 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T13:15:25.413 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/332) 2023-11-13T13:15:25.767 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T13:15:25.777 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T13:15:25.778 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T13:15:26.109 INFO:teuthology.orchestra.run.smithi102.stdout:generic/332 [not run] this test requires a valid $SCRATCH_DEV 2023-11-13T13:15:26.117 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/332 2023-11-13T13:15:26.117 INFO:teuthology.orchestra.run.smithi102.stdout:Not run: generic/332 2023-11-13T13:15:26.117 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T13:15:26.123 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T13:15:26.142 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T13:15:26.143 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/333) 2023-11-13T13:15:26.509 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T13:15:26.519 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T13:15:26.519 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T13:15:26.787 INFO:teuthology.orchestra.run.smithi102.stdout:generic/333 [not run] this test requires a valid $SCRATCH_DEV 2023-11-13T13:15:26.795 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/333 2023-11-13T13:15:26.795 INFO:teuthology.orchestra.run.smithi102.stdout:Not run: generic/333 2023-11-13T13:15:26.796 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T13:15:26.801 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T13:15:26.822 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T13:15:26.822 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/334) 2023-11-13T13:15:27.187 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T13:15:27.197 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T13:15:27.198 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T13:15:27.484 INFO:teuthology.orchestra.run.smithi102.stdout:generic/334 [not run] this test requires a valid $SCRATCH_DEV 2023-11-13T13:15:27.492 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/334 2023-11-13T13:15:27.492 INFO:teuthology.orchestra.run.smithi102.stdout:Not run: generic/334 2023-11-13T13:15:27.493 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T13:15:27.499 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T13:15:27.518 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T13:15:27.519 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/335) 2023-11-13T13:15:27.872 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T13:15:27.883 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T13:15:27.883 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T13:15:28.180 INFO:teuthology.orchestra.run.smithi102.stdout:generic/335 [not run] this test requires a valid $SCRATCH_DEV 2023-11-13T13:15:28.188 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/335 2023-11-13T13:15:28.189 INFO:teuthology.orchestra.run.smithi102.stdout:Not run: generic/335 2023-11-13T13:15:28.189 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T13:15:28.195 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T13:15:28.215 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T13:15:28.215 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/336) 2023-11-13T13:15:28.564 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T13:15:28.574 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T13:15:28.575 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T13:15:28.911 INFO:teuthology.orchestra.run.smithi102.stdout:generic/336 [not run] this test requires a valid $SCRATCH_DEV 2023-11-13T13:15:28.920 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/336 2023-11-13T13:15:28.920 INFO:teuthology.orchestra.run.smithi102.stdout:Not run: generic/336 2023-11-13T13:15:28.920 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T13:15:28.926 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T13:15:28.990 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T13:15:28.991 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/337) 2023-11-13T13:15:29.347 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T13:15:29.358 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T13:15:29.358 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T13:15:29.635 INFO:teuthology.orchestra.run.smithi102.stdout:generic/337 [not run] this test requires a valid $SCRATCH_DEV 2023-11-13T13:15:29.643 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/337 2023-11-13T13:15:29.643 INFO:teuthology.orchestra.run.smithi102.stdout:Not run: generic/337 2023-11-13T13:15:29.643 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T13:15:29.649 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T13:15:29.668 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T13:15:29.669 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/338) 2023-11-13T13:15:30.028 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T13:15:30.039 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T13:15:30.039 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T13:15:30.338 INFO:teuthology.orchestra.run.smithi102.stdout:generic/338 [not run] this test requires a valid $SCRATCH_DEV 2023-11-13T13:15:30.346 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/338 2023-11-13T13:15:30.346 INFO:teuthology.orchestra.run.smithi102.stdout:Not run: generic/338 2023-11-13T13:15:30.346 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T13:15:30.352 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T13:15:30.372 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T13:15:30.372 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/339) 2023-11-13T13:15:30.751 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T13:15:30.761 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T13:15:30.762 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T13:15:31.038 INFO:teuthology.orchestra.run.smithi102.stdout:generic/339 [not run] this test requires a valid $SCRATCH_DEV 2023-11-13T13:15:31.046 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/339 2023-11-13T13:15:31.046 INFO:teuthology.orchestra.run.smithi102.stdout:Not run: generic/339 2023-11-13T13:15:31.047 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T13:15:31.052 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T13:15:31.072 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T13:15:31.072 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/340) 2023-11-13T13:15:31.455 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T13:15:31.465 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T13:15:31.466 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T13:15:31.723 INFO:teuthology.orchestra.run.smithi102.stdout:generic/340 [not run] this test requires a valid $SCRATCH_DEV 2023-11-13T13:15:31.732 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/340 2023-11-13T13:15:31.732 INFO:teuthology.orchestra.run.smithi102.stdout:Not run: generic/340 2023-11-13T13:15:31.732 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T13:15:31.738 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T13:15:31.758 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T13:15:31.758 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/341) 2023-11-13T13:15:32.130 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T13:15:32.141 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T13:15:32.141 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T13:15:32.443 INFO:teuthology.orchestra.run.smithi102.stdout:generic/341 [not run] this test requires a valid $SCRATCH_DEV 2023-11-13T13:15:32.451 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/341 2023-11-13T13:15:32.451 INFO:teuthology.orchestra.run.smithi102.stdout:Not run: generic/341 2023-11-13T13:15:32.452 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T13:15:32.458 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T13:15:32.478 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T13:15:32.478 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/342) 2023-11-13T13:15:32.851 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T13:15:32.861 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T13:15:32.862 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T13:15:33.172 INFO:teuthology.orchestra.run.smithi102.stdout:generic/342 [not run] this test requires a valid $SCRATCH_DEV 2023-11-13T13:15:33.180 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/342 2023-11-13T13:15:33.180 INFO:teuthology.orchestra.run.smithi102.stdout:Not run: generic/342 2023-11-13T13:15:33.180 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T13:15:33.186 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T13:15:33.207 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T13:15:33.207 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/343) 2023-11-13T13:15:33.576 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T13:15:33.586 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T13:15:33.586 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T13:15:33.893 INFO:teuthology.orchestra.run.smithi102.stdout:generic/343 [not run] this test requires a valid $SCRATCH_DEV 2023-11-13T13:15:33.901 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/343 2023-11-13T13:15:33.901 INFO:teuthology.orchestra.run.smithi102.stdout:Not run: generic/343 2023-11-13T13:15:33.902 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T13:15:33.907 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T13:15:33.928 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T13:15:33.929 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/344) 2023-11-13T13:15:34.320 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T13:15:34.330 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T13:15:34.330 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T13:15:34.632 INFO:teuthology.orchestra.run.smithi102.stdout:generic/344 [not run] this test requires a valid $SCRATCH_DEV 2023-11-13T13:15:34.640 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/344 2023-11-13T13:15:34.641 INFO:teuthology.orchestra.run.smithi102.stdout:Not run: generic/344 2023-11-13T13:15:34.641 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T13:15:34.646 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T13:15:34.667 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T13:15:34.667 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/345) 2023-11-13T13:15:35.039 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T13:15:35.050 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T13:15:35.050 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T13:15:35.339 INFO:teuthology.orchestra.run.smithi102.stdout:generic/345 [not run] this test requires a valid $SCRATCH_DEV 2023-11-13T13:15:35.347 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/345 2023-11-13T13:15:35.347 INFO:teuthology.orchestra.run.smithi102.stdout:Not run: generic/345 2023-11-13T13:15:35.348 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T13:15:35.353 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T13:15:35.374 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T13:15:35.374 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/346) 2023-11-13T13:15:35.751 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T13:15:35.761 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T13:15:35.762 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T13:15:36.037 INFO:teuthology.orchestra.run.smithi102.stdout:generic/346 [not run] this test requires a valid $SCRATCH_DEV 2023-11-13T13:15:36.045 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/346 2023-11-13T13:15:36.045 INFO:teuthology.orchestra.run.smithi102.stdout:Not run: generic/346 2023-11-13T13:15:36.046 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T13:15:36.051 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T13:15:36.070 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T13:15:36.071 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/347) 2023-11-13T13:15:36.466 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T13:15:36.476 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T13:15:36.476 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T13:15:36.828 INFO:teuthology.orchestra.run.smithi102.stdout:generic/347 [not run] this test requires a valid $SCRATCH_DEV 2023-11-13T13:15:36.836 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/347 2023-11-13T13:15:36.837 INFO:teuthology.orchestra.run.smithi102.stdout:Not run: generic/347 2023-11-13T13:15:36.837 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T13:15:36.842 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T13:15:36.863 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T13:15:36.863 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/348) 2023-11-13T13:15:37.224 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T13:15:37.234 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T13:15:37.234 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T13:15:37.531 INFO:teuthology.orchestra.run.smithi102.stdout:generic/348 [not run] this test requires a valid $SCRATCH_DEV 2023-11-13T13:15:37.539 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/348 2023-11-13T13:15:37.539 INFO:teuthology.orchestra.run.smithi102.stdout:Not run: generic/348 2023-11-13T13:15:37.539 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T13:15:37.545 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T13:15:37.565 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T13:15:37.566 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/349) 2023-11-13T13:15:37.947 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T13:15:37.958 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T13:15:37.958 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T13:15:39.494 INFO:teuthology.orchestra.run.smithi102.stdout:generic/349 [not run] xfs_io fzero failed (old kernel/wrong fs?) 2023-11-13T13:15:39.502 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/349 2023-11-13T13:15:39.503 INFO:teuthology.orchestra.run.smithi102.stdout:Not run: generic/349 2023-11-13T13:15:39.503 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T13:15:39.509 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T13:15:39.530 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T13:15:39.531 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/350) 2023-11-13T13:15:39.903 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T13:15:39.914 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T13:15:39.914 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T13:15:42.444 INFO:teuthology.orchestra.run.smithi102.stdout:generic/350 3s 2023-11-13T13:15:42.457 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/350 2023-11-13T13:15:42.457 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T13:15:42.464 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T13:15:42.482 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T13:15:42.482 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/351) 2023-11-13T13:15:42.856 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T13:15:42.867 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T13:15:42.867 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T13:15:44.367 INFO:teuthology.orchestra.run.smithi102.stdout:generic/351 [not run] xfs_io finsert failed (old kernel/wrong fs?) 2023-11-13T13:15:44.375 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/351 2023-11-13T13:15:44.375 INFO:teuthology.orchestra.run.smithi102.stdout:Not run: generic/351 2023-11-13T13:15:44.376 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T13:15:44.381 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T13:15:44.435 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T13:15:44.435 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/352) 2023-11-13T13:15:45.120 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T13:15:45.130 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T13:15:45.131 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T13:15:45.426 INFO:teuthology.orchestra.run.smithi102.stdout:generic/352 [not run] this test requires a valid $SCRATCH_DEV 2023-11-13T13:15:45.434 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/352 2023-11-13T13:15:45.434 INFO:teuthology.orchestra.run.smithi102.stdout:Not run: generic/352 2023-11-13T13:15:45.435 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T13:15:45.440 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T13:15:45.510 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T13:15:45.510 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/353) 2023-11-13T13:15:45.868 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T13:15:45.878 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T13:15:45.878 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T13:15:46.168 INFO:teuthology.orchestra.run.smithi102.stdout:generic/353 [not run] this test requires a valid $SCRATCH_DEV 2023-11-13T13:15:46.177 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/353 2023-11-13T13:15:46.177 INFO:teuthology.orchestra.run.smithi102.stdout:Not run: generic/353 2023-11-13T13:15:46.177 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T13:15:46.183 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T13:15:46.203 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T13:15:46.204 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/354) 2023-11-13T13:15:46.596 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T13:15:46.606 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T13:15:46.607 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T13:15:46.883 INFO:teuthology.orchestra.run.smithi102.stdout:generic/354 [not run] this test requires a valid $SCRATCH_DEV 2023-11-13T13:15:46.891 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/354 2023-11-13T13:15:46.891 INFO:teuthology.orchestra.run.smithi102.stdout:Not run: generic/354 2023-11-13T13:15:46.891 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T13:15:46.897 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T13:15:46.917 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T13:15:46.917 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/355) 2023-11-13T13:15:47.271 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T13:15:47.281 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T13:15:47.282 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T13:15:48.396 INFO:teuthology.orchestra.run.smithi102.stdout:generic/355 1s 2023-11-13T13:15:48.409 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/355 2023-11-13T13:15:48.409 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T13:15:48.415 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T13:15:48.437 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T13:15:48.437 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/356) 2023-11-13T13:15:49.136 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T13:15:49.252 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T13:15:49.252 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T13:15:49.436 INFO:teuthology.orchestra.run.smithi102.stdout:generic/356 [not run] this test requires a valid $SCRATCH_DEV 2023-11-13T13:15:49.444 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/356 2023-11-13T13:15:49.445 INFO:teuthology.orchestra.run.smithi102.stdout:Not run: generic/356 2023-11-13T13:15:49.445 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T13:15:49.451 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T13:15:49.471 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T13:15:49.472 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/357) 2023-11-13T13:15:49.871 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T13:15:49.881 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T13:15:49.882 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T13:15:50.179 INFO:teuthology.orchestra.run.smithi102.stdout:generic/357 [not run] this test requires a valid $SCRATCH_DEV 2023-11-13T13:15:50.187 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/357 2023-11-13T13:15:50.188 INFO:teuthology.orchestra.run.smithi102.stdout:Not run: generic/357 2023-11-13T13:15:50.188 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T13:15:50.194 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T13:15:50.214 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T13:15:50.215 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/358) 2023-11-13T13:15:50.567 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T13:15:50.578 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T13:15:50.578 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T13:15:50.859 INFO:teuthology.orchestra.run.smithi102.stdout:generic/358 [not run] this test requires a valid $SCRATCH_DEV 2023-11-13T13:15:50.868 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/358 2023-11-13T13:15:50.868 INFO:teuthology.orchestra.run.smithi102.stdout:Not run: generic/358 2023-11-13T13:15:50.868 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T13:15:50.874 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T13:15:50.893 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T13:15:50.894 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/359) 2023-11-13T13:15:51.264 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T13:15:51.275 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T13:15:51.275 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T13:15:51.540 INFO:teuthology.orchestra.run.smithi102.stdout:generic/359 [not run] this test requires a valid $SCRATCH_DEV 2023-11-13T13:15:51.548 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/359 2023-11-13T13:15:51.548 INFO:teuthology.orchestra.run.smithi102.stdout:Not run: generic/359 2023-11-13T13:15:51.548 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T13:15:51.554 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T13:15:51.575 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T13:15:51.576 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/360) 2023-11-13T13:15:51.962 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T13:15:51.973 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T13:15:51.973 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T13:15:52.368 INFO:teuthology.orchestra.run.smithi102.stdout:generic/360 1s 2023-11-13T13:15:52.381 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/360 2023-11-13T13:15:52.381 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T13:15:52.387 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T13:15:52.408 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T13:15:52.409 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/361) 2023-11-13T13:15:52.783 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T13:15:52.794 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T13:15:52.794 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T13:15:53.091 INFO:teuthology.orchestra.run.smithi102.stdout:generic/361 [not run] this test requires a valid $SCRATCH_DEV 2023-11-13T13:15:53.099 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/361 2023-11-13T13:15:53.100 INFO:teuthology.orchestra.run.smithi102.stdout:Not run: generic/361 2023-11-13T13:15:53.100 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T13:15:53.106 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T13:15:53.125 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T13:15:53.125 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/362) 2023-11-13T13:15:53.523 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T13:15:53.533 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T13:15:53.533 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T13:15:53.817 INFO:teuthology.orchestra.run.smithi102.stdout:generic/362 [not run] this test requires a valid $SCRATCH_DEV 2023-11-13T13:15:53.825 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/362 2023-11-13T13:15:53.826 INFO:teuthology.orchestra.run.smithi102.stdout:Not run: generic/362 2023-11-13T13:15:53.826 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T13:15:53.832 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T13:15:53.853 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T13:15:53.853 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/363) 2023-11-13T13:15:54.232 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T13:15:54.241 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T13:15:54.242 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T13:15:54.498 INFO:teuthology.orchestra.run.smithi102.stdout:generic/363 [not run] this test requires a valid $SCRATCH_DEV 2023-11-13T13:15:54.506 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/363 2023-11-13T13:15:54.506 INFO:teuthology.orchestra.run.smithi102.stdout:Not run: generic/363 2023-11-13T13:15:54.506 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T13:15:54.512 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T13:15:54.532 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T13:15:54.533 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/364) 2023-11-13T13:15:54.900 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T13:15:54.911 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T13:15:54.911 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T13:15:55.198 INFO:teuthology.orchestra.run.smithi102.stdout:generic/364 [not run] this test requires a valid $SCRATCH_DEV 2023-11-13T13:15:55.206 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/364 2023-11-13T13:15:55.206 INFO:teuthology.orchestra.run.smithi102.stdout:Not run: generic/364 2023-11-13T13:15:55.206 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T13:15:55.212 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T13:15:55.232 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T13:15:55.232 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/365) 2023-11-13T13:15:55.601 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T13:15:55.611 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T13:15:55.612 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T13:15:55.904 INFO:teuthology.orchestra.run.smithi102.stdout:generic/365 [not run] this test requires a valid $SCRATCH_DEV 2023-11-13T13:15:55.912 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/365 2023-11-13T13:15:55.912 INFO:teuthology.orchestra.run.smithi102.stdout:Not run: generic/365 2023-11-13T13:15:55.913 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T13:15:55.918 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T13:15:55.938 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T13:15:55.939 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/366) 2023-11-13T13:15:56.323 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T13:15:56.334 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T13:15:56.334 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T13:15:56.619 INFO:teuthology.orchestra.run.smithi102.stdout:generic/366 [not run] this test requires a valid $SCRATCH_DEV 2023-11-13T13:15:56.627 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/366 2023-11-13T13:15:56.628 INFO:teuthology.orchestra.run.smithi102.stdout:Not run: generic/366 2023-11-13T13:15:56.628 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T13:15:56.634 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T13:15:56.654 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T13:15:56.655 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/367) 2023-11-13T13:15:57.035 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T13:15:57.045 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T13:15:57.046 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T13:15:57.321 INFO:teuthology.orchestra.run.smithi102.stdout:generic/367 [not run] this test requires a valid $SCRATCH_DEV 2023-11-13T13:15:57.330 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/367 2023-11-13T13:15:57.330 INFO:teuthology.orchestra.run.smithi102.stdout:Not run: generic/367 2023-11-13T13:15:57.330 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T13:15:57.336 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T13:15:57.355 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T13:15:57.356 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/368) 2023-11-13T13:15:57.749 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T13:15:57.759 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T13:15:57.759 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T13:15:58.044 INFO:teuthology.orchestra.run.smithi102.stdout:generic/368 [not run] this test requires a valid $SCRATCH_DEV 2023-11-13T13:15:58.052 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/368 2023-11-13T13:15:58.053 INFO:teuthology.orchestra.run.smithi102.stdout:Not run: generic/368 2023-11-13T13:15:58.053 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T13:15:58.059 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T13:15:58.078 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T13:15:58.079 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/369) 2023-11-13T13:15:58.434 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T13:15:58.445 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T13:15:58.445 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T13:15:58.688 INFO:teuthology.orchestra.run.smithi102.stdout:generic/369 [not run] this test requires a valid $SCRATCH_DEV 2023-11-13T13:15:58.696 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/369 2023-11-13T13:15:58.696 INFO:teuthology.orchestra.run.smithi102.stdout:Not run: generic/369 2023-11-13T13:15:58.696 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T13:15:58.702 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T13:15:58.721 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T13:15:58.722 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/370) 2023-11-13T13:15:59.104 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T13:15:59.114 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T13:15:59.114 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T13:15:59.383 INFO:teuthology.orchestra.run.smithi102.stdout:generic/370 [not run] this test requires a valid $SCRATCH_DEV 2023-11-13T13:15:59.391 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/370 2023-11-13T13:15:59.391 INFO:teuthology.orchestra.run.smithi102.stdout:Not run: generic/370 2023-11-13T13:15:59.392 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T13:15:59.397 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T13:15:59.417 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T13:15:59.417 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/371) 2023-11-13T13:15:59.773 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T13:15:59.783 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T13:15:59.783 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T13:16:00.079 INFO:teuthology.orchestra.run.smithi102.stdout:generic/371 [not run] this test requires a valid $SCRATCH_DEV 2023-11-13T13:16:00.087 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/371 2023-11-13T13:16:00.087 INFO:teuthology.orchestra.run.smithi102.stdout:Not run: generic/371 2023-11-13T13:16:00.088 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T13:16:00.093 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T13:16:00.114 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T13:16:00.115 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/372) 2023-11-13T13:16:00.481 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T13:16:00.490 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T13:16:00.490 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T13:16:00.749 INFO:teuthology.orchestra.run.smithi102.stdout:generic/372 [not run] this test requires a valid $SCRATCH_DEV 2023-11-13T13:16:00.757 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/372 2023-11-13T13:16:00.757 INFO:teuthology.orchestra.run.smithi102.stdout:Not run: generic/372 2023-11-13T13:16:00.757 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T13:16:00.763 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T13:16:00.782 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T13:16:00.783 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/373) 2023-11-13T13:16:01.167 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T13:16:01.178 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T13:16:01.178 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T13:16:01.460 INFO:teuthology.orchestra.run.smithi102.stdout:generic/373 [not run] this test requires a valid $SCRATCH_DEV 2023-11-13T13:16:01.468 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/373 2023-11-13T13:16:01.468 INFO:teuthology.orchestra.run.smithi102.stdout:Not run: generic/373 2023-11-13T13:16:01.468 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T13:16:01.474 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T13:16:01.495 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T13:16:01.496 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/374) 2023-11-13T13:16:01.863 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T13:16:01.873 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T13:16:01.874 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T13:16:02.149 INFO:teuthology.orchestra.run.smithi102.stdout:generic/374 [not run] this test requires a valid $SCRATCH_DEV 2023-11-13T13:16:02.157 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/374 2023-11-13T13:16:02.157 INFO:teuthology.orchestra.run.smithi102.stdout:Not run: generic/374 2023-11-13T13:16:02.158 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T13:16:02.163 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T13:16:02.184 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T13:16:02.184 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/375) 2023-11-13T13:16:02.559 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T13:16:02.569 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T13:16:02.570 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T13:16:02.900 INFO:teuthology.orchestra.run.smithi102.stdout:generic/375 [not run] ACLs not supported by this filesystem type: ceph-fuse 2023-11-13T13:16:02.907 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/375 2023-11-13T13:16:02.908 INFO:teuthology.orchestra.run.smithi102.stdout:Not run: generic/375 2023-11-13T13:16:02.908 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T13:16:02.914 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T13:16:02.932 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T13:16:02.933 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/376) 2023-11-13T13:16:03.287 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T13:16:03.297 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T13:16:03.298 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T13:16:03.636 INFO:teuthology.orchestra.run.smithi102.stdout:generic/376 [not run] this test requires a valid $SCRATCH_DEV 2023-11-13T13:16:03.644 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/376 2023-11-13T13:16:03.644 INFO:teuthology.orchestra.run.smithi102.stdout:Not run: generic/376 2023-11-13T13:16:03.644 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T13:16:03.650 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T13:16:03.672 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T13:16:03.672 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/377) 2023-11-13T13:16:04.039 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T13:16:04.050 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T13:16:04.050 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T13:16:04.322 INFO:teuthology.orchestra.run.smithi102.stdout:generic/377 [not run] this test requires a valid $SCRATCH_DEV 2023-11-13T13:16:04.330 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/377 2023-11-13T13:16:04.330 INFO:teuthology.orchestra.run.smithi102.stdout:Not run: generic/377 2023-11-13T13:16:04.330 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T13:16:04.336 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T13:16:04.357 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T13:16:04.357 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/378) 2023-11-13T13:16:04.709 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T13:16:04.719 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T13:16:04.720 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T13:16:05.388 INFO:teuthology.orchestra.run.smithi102.stdout:generic/378 1s 2023-11-13T13:16:05.400 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/378 2023-11-13T13:16:05.401 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T13:16:05.407 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T13:16:05.446 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T13:16:05.447 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/379) 2023-11-13T13:16:06.127 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T13:16:06.138 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T13:16:06.138 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T13:16:06.427 INFO:teuthology.orchestra.run.smithi102.stdout:generic/379 [not run] this test requires a valid $SCRATCH_DEV 2023-11-13T13:16:06.435 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/379 2023-11-13T13:16:06.435 INFO:teuthology.orchestra.run.smithi102.stdout:Not run: generic/379 2023-11-13T13:16:06.435 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T13:16:06.441 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T13:16:06.461 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T13:16:06.462 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/380) 2023-11-13T13:16:06.835 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T13:16:06.846 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T13:16:06.846 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T13:16:07.123 INFO:teuthology.orchestra.run.smithi102.stdout:generic/380 [not run] this test requires a valid $SCRATCH_DEV 2023-11-13T13:16:07.131 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/380 2023-11-13T13:16:07.131 INFO:teuthology.orchestra.run.smithi102.stdout:Not run: generic/380 2023-11-13T13:16:07.131 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T13:16:07.137 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T13:16:07.157 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T13:16:07.158 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/381) 2023-11-13T13:16:07.549 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T13:16:07.559 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T13:16:07.560 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T13:16:07.830 INFO:teuthology.orchestra.run.smithi102.stdout:generic/381 [not run] this test requires a valid $SCRATCH_DEV 2023-11-13T13:16:07.839 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/381 2023-11-13T13:16:07.839 INFO:teuthology.orchestra.run.smithi102.stdout:Not run: generic/381 2023-11-13T13:16:07.839 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T13:16:07.845 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T13:16:07.865 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T13:16:07.865 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/382) 2023-11-13T13:16:08.239 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T13:16:08.249 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T13:16:08.250 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T13:16:08.531 INFO:teuthology.orchestra.run.smithi102.stdout:generic/382 [not run] this test requires a valid $SCRATCH_DEV 2023-11-13T13:16:08.539 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/382 2023-11-13T13:16:08.539 INFO:teuthology.orchestra.run.smithi102.stdout:Not run: generic/382 2023-11-13T13:16:08.539 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T13:16:08.545 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T13:16:08.565 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T13:16:08.566 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/383) 2023-11-13T13:16:08.932 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T13:16:08.942 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T13:16:08.943 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T13:16:09.268 INFO:teuthology.orchestra.run.smithi102.stdout:generic/383 [not run] this test requires a valid $SCRATCH_DEV 2023-11-13T13:16:09.276 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/383 2023-11-13T13:16:09.276 INFO:teuthology.orchestra.run.smithi102.stdout:Not run: generic/383 2023-11-13T13:16:09.277 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T13:16:09.282 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T13:16:09.302 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T13:16:09.303 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/384) 2023-11-13T13:16:09.668 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T13:16:09.678 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T13:16:09.678 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T13:16:09.961 INFO:teuthology.orchestra.run.smithi102.stdout:generic/384 [not run] disk quotas not supported by this filesystem type: ceph-fuse 2023-11-13T13:16:09.969 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/384 2023-11-13T13:16:09.970 INFO:teuthology.orchestra.run.smithi102.stdout:Not run: generic/384 2023-11-13T13:16:09.970 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T13:16:09.976 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T13:16:09.996 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T13:16:09.997 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/385) 2023-11-13T13:16:10.360 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T13:16:10.370 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T13:16:10.370 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T13:16:10.672 INFO:teuthology.orchestra.run.smithi102.stdout:generic/385 [not run] this test requires a valid $SCRATCH_DEV 2023-11-13T13:16:10.680 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/385 2023-11-13T13:16:10.680 INFO:teuthology.orchestra.run.smithi102.stdout:Not run: generic/385 2023-11-13T13:16:10.680 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T13:16:10.686 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T13:16:10.707 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T13:16:10.708 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/386) 2023-11-13T13:16:11.072 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T13:16:11.082 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T13:16:11.082 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T13:16:11.354 INFO:teuthology.orchestra.run.smithi102.stdout:generic/386 [not run] disk quotas not supported by this filesystem type: ceph-fuse 2023-11-13T13:16:11.362 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/386 2023-11-13T13:16:11.362 INFO:teuthology.orchestra.run.smithi102.stdout:Not run: generic/386 2023-11-13T13:16:11.362 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T13:16:11.368 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T13:16:11.390 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T13:16:11.390 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/387) 2023-11-13T13:16:11.765 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T13:16:11.775 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T13:16:11.775 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T13:16:12.070 INFO:teuthology.orchestra.run.smithi102.stdout:generic/387 [not run] this test requires a valid $SCRATCH_DEV 2023-11-13T13:16:12.079 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/387 2023-11-13T13:16:12.079 INFO:teuthology.orchestra.run.smithi102.stdout:Not run: generic/387 2023-11-13T13:16:12.079 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T13:16:12.085 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T13:16:12.105 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T13:16:12.106 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/388) 2023-11-13T13:16:12.476 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T13:16:12.487 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T13:16:12.487 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T13:16:12.781 INFO:teuthology.orchestra.run.smithi102.stdout:generic/388 [not run] this test requires a valid $SCRATCH_DEV 2023-11-13T13:16:12.789 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/388 2023-11-13T13:16:12.789 INFO:teuthology.orchestra.run.smithi102.stdout:Not run: generic/388 2023-11-13T13:16:12.789 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T13:16:12.796 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T13:16:12.817 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T13:16:12.818 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/389) 2023-11-13T13:16:13.192 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T13:16:13.202 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T13:16:13.202 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T13:16:13.505 INFO:teuthology.orchestra.run.smithi102.stdout:generic/389 [not run] O_TMPFILE is not supported 2023-11-13T13:16:13.514 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/389 2023-11-13T13:16:13.514 INFO:teuthology.orchestra.run.smithi102.stdout:Not run: generic/389 2023-11-13T13:16:13.514 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T13:16:13.520 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T13:16:13.578 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T13:16:13.578 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/390) 2023-11-13T13:16:13.937 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T13:16:13.947 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T13:16:13.947 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T13:16:14.443 INFO:teuthology.orchestra.run.smithi102.stdout:generic/390 [not run] this test requires a valid $SCRATCH_DEV 2023-11-13T13:16:14.451 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/390 2023-11-13T13:16:14.451 INFO:teuthology.orchestra.run.smithi102.stdout:Not run: generic/390 2023-11-13T13:16:14.451 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T13:16:14.457 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T13:16:14.522 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T13:16:14.523 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/391) 2023-11-13T13:16:14.900 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T13:16:14.910 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T13:16:14.911 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T13:16:47.625 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T13:16:47.630 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T13:16:50.185 INFO:teuthology.orchestra.run.smithi102.stdout:generic/391 36s 2023-11-13T13:16:50.318 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/391 2023-11-13T13:16:50.319 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T13:16:50.325 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T13:16:50.439 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T13:16:50.439 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/392) 2023-11-13T13:16:51.612 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T13:16:51.629 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T13:16:51.629 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T13:16:52.114 INFO:teuthology.orchestra.run.smithi102.stdout:generic/392 [not run] this test requires a valid $SCRATCH_DEV 2023-11-13T13:16:52.127 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/392 2023-11-13T13:16:52.127 INFO:teuthology.orchestra.run.smithi102.stdout:Not run: generic/392 2023-11-13T13:16:52.127 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T13:16:52.137 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T13:16:52.174 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T13:16:52.174 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/393) 2023-11-13T13:16:52.711 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T13:16:52.730 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T13:16:52.733 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T13:16:53.123 INFO:teuthology.orchestra.run.smithi102.stdout:generic/393 [not run] this test requires a valid $SCRATCH_DEV 2023-11-13T13:16:53.137 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/393 2023-11-13T13:16:53.137 INFO:teuthology.orchestra.run.smithi102.stdout:Not run: generic/393 2023-11-13T13:16:53.137 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T13:16:53.147 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T13:16:53.177 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T13:16:53.177 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/394) 2023-11-13T13:16:53.925 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T13:16:53.940 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T13:16:53.941 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T13:16:54.699 INFO:teuthology.orchestra.run.smithi102.stdout:generic/394 0s 2023-11-13T13:16:55.067 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/394 2023-11-13T13:16:55.067 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T13:16:55.073 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T13:16:55.134 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T13:16:55.134 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/395) 2023-11-13T13:16:55.977 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T13:16:55.989 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T13:16:55.990 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T13:16:56.400 INFO:teuthology.orchestra.run.smithi102.stdout:generic/395 [not run] this test requires a valid $SCRATCH_DEV 2023-11-13T13:16:56.408 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/395 2023-11-13T13:16:56.408 INFO:teuthology.orchestra.run.smithi102.stdout:Not run: generic/395 2023-11-13T13:16:56.408 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T13:16:56.414 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T13:16:56.434 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T13:16:56.435 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/396) 2023-11-13T13:16:56.824 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T13:16:56.834 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T13:16:56.834 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T13:16:57.180 INFO:teuthology.orchestra.run.smithi102.stdout:generic/396 [not run] this test requires a valid $SCRATCH_DEV 2023-11-13T13:16:57.188 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/396 2023-11-13T13:16:57.188 INFO:teuthology.orchestra.run.smithi102.stdout:Not run: generic/396 2023-11-13T13:16:57.189 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T13:16:57.195 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T13:16:57.215 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T13:16:57.216 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/397) 2023-11-13T13:16:57.591 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T13:16:57.601 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T13:16:57.602 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T13:16:57.983 INFO:teuthology.orchestra.run.smithi102.stdout:generic/397 [not run] this test requires a valid $SCRATCH_DEV 2023-11-13T13:16:57.991 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/397 2023-11-13T13:16:57.992 INFO:teuthology.orchestra.run.smithi102.stdout:Not run: generic/397 2023-11-13T13:16:57.992 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T13:16:57.998 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T13:16:58.021 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T13:16:58.022 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/398) 2023-11-13T13:16:58.412 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T13:16:58.422 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T13:16:58.422 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T13:16:58.782 INFO:teuthology.orchestra.run.smithi102.stdout:generic/398 [not run] this test requires a valid $SCRATCH_DEV 2023-11-13T13:16:58.790 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/398 2023-11-13T13:16:58.791 INFO:teuthology.orchestra.run.smithi102.stdout:Not run: generic/398 2023-11-13T13:16:58.791 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T13:16:58.797 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T13:16:58.817 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T13:16:58.818 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/399) 2023-11-13T13:16:59.203 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T13:16:59.214 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T13:16:59.214 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T13:16:59.557 INFO:teuthology.orchestra.run.smithi102.stdout:generic/399 [not run] this test requires a valid $SCRATCH_DEV 2023-11-13T13:16:59.566 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/399 2023-11-13T13:16:59.566 INFO:teuthology.orchestra.run.smithi102.stdout:Not run: generic/399 2023-11-13T13:16:59.566 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T13:16:59.572 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T13:16:59.592 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T13:16:59.593 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/400) 2023-11-13T13:16:59.975 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T13:16:59.985 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T13:16:59.986 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T13:17:00.253 INFO:teuthology.orchestra.run.smithi102.stdout:generic/400 [not run] disk quotas not supported by this filesystem type: ceph-fuse 2023-11-13T13:17:00.261 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/400 2023-11-13T13:17:00.262 INFO:teuthology.orchestra.run.smithi102.stdout:Not run: generic/400 2023-11-13T13:17:00.262 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T13:17:00.267 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T13:17:00.288 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T13:17:00.288 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/401) 2023-11-13T13:17:00.647 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T13:17:00.657 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T13:17:00.657 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T13:17:00.940 INFO:teuthology.orchestra.run.smithi102.stdout:generic/401 [not run] this test requires a valid $SCRATCH_DEV 2023-11-13T13:17:00.948 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/401 2023-11-13T13:17:00.948 INFO:teuthology.orchestra.run.smithi102.stdout:Not run: generic/401 2023-11-13T13:17:00.949 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T13:17:00.954 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T13:17:00.975 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T13:17:00.975 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/402) 2023-11-13T13:17:01.360 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T13:17:01.370 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T13:17:01.370 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T13:17:01.648 INFO:teuthology.orchestra.run.smithi102.stdout:generic/402 [not run] this test requires a valid $SCRATCH_DEV 2023-11-13T13:17:01.656 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/402 2023-11-13T13:17:01.656 INFO:teuthology.orchestra.run.smithi102.stdout:Not run: generic/402 2023-11-13T13:17:01.656 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T13:17:01.662 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T13:17:01.681 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T13:17:01.682 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/403) 2023-11-13T13:17:02.039 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T13:17:02.049 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T13:17:02.050 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T13:17:02.340 INFO:teuthology.orchestra.run.smithi102.stdout:generic/403 [not run] this test requires a valid $SCRATCH_DEV 2023-11-13T13:17:02.348 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/403 2023-11-13T13:17:02.349 INFO:teuthology.orchestra.run.smithi102.stdout:Not run: generic/403 2023-11-13T13:17:02.349 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T13:17:02.355 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T13:17:02.376 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T13:17:02.377 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/404) 2023-11-13T13:17:02.735 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T13:17:02.745 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T13:17:02.746 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T13:17:04.203 INFO:teuthology.orchestra.run.smithi102.stdout:generic/404 [not run] xfs_io finsert failed (old kernel/wrong fs?) 2023-11-13T13:17:04.211 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/404 2023-11-13T13:17:04.211 INFO:teuthology.orchestra.run.smithi102.stdout:Not run: generic/404 2023-11-13T13:17:04.212 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T13:17:04.217 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T13:17:04.238 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T13:17:04.238 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/405) 2023-11-13T13:17:04.932 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T13:17:04.942 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T13:17:04.942 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T13:17:05.332 INFO:teuthology.orchestra.run.smithi102.stdout:generic/405 [not run] this test requires a valid $SCRATCH_DEV 2023-11-13T13:17:05.340 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/405 2023-11-13T13:17:05.340 INFO:teuthology.orchestra.run.smithi102.stdout:Not run: generic/405 2023-11-13T13:17:05.341 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T13:17:05.346 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T13:17:05.367 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T13:17:05.367 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/406) 2023-11-13T13:17:05.743 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T13:17:05.754 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T13:17:05.754 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T13:17:06.027 INFO:teuthology.orchestra.run.smithi102.stdout:generic/406 [not run] this test requires a valid $SCRATCH_DEV 2023-11-13T13:17:06.035 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/406 2023-11-13T13:17:06.035 INFO:teuthology.orchestra.run.smithi102.stdout:Not run: generic/406 2023-11-13T13:17:06.036 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T13:17:06.041 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T13:17:06.062 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T13:17:06.063 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/407) 2023-11-13T13:17:06.432 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T13:17:06.443 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T13:17:06.443 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T13:17:06.830 INFO:teuthology.orchestra.run.smithi102.stdout:generic/407 [not run] Reflink not supported by test filesystem type: ceph-fuse 2023-11-13T13:17:06.839 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/407 2023-11-13T13:17:06.839 INFO:teuthology.orchestra.run.smithi102.stdout:Not run: generic/407 2023-11-13T13:17:06.839 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T13:17:06.845 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T13:17:06.902 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T13:17:06.903 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/408) 2023-11-13T13:17:07.575 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T13:17:07.585 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T13:17:07.585 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T13:17:07.979 INFO:teuthology.orchestra.run.smithi102.stdout:generic/408 [not run] Dedupe not supported by test filesystem type: ceph-fuse 2023-11-13T13:17:07.987 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/408 2023-11-13T13:17:07.987 INFO:teuthology.orchestra.run.smithi102.stdout:Not run: generic/408 2023-11-13T13:17:07.987 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T13:17:07.993 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T13:17:08.052 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T13:17:08.053 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/409) 2023-11-13T13:17:08.707 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T13:17:08.718 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T13:17:08.718 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T13:17:09.009 INFO:teuthology.orchestra.run.smithi102.stdout:generic/409 [not run] this test requires a valid $SCRATCH_DEV 2023-11-13T13:17:09.017 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/409 2023-11-13T13:17:09.017 INFO:teuthology.orchestra.run.smithi102.stdout:Not run: generic/409 2023-11-13T13:17:09.017 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T13:17:09.023 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T13:17:09.043 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T13:17:09.043 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/410) 2023-11-13T13:17:09.392 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T13:17:09.402 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T13:17:09.402 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T13:17:09.677 INFO:teuthology.orchestra.run.smithi102.stdout:generic/410 [not run] this test requires a valid $SCRATCH_DEV 2023-11-13T13:17:09.686 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/410 2023-11-13T13:17:09.686 INFO:teuthology.orchestra.run.smithi102.stdout:Not run: generic/410 2023-11-13T13:17:09.686 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T13:17:09.692 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T13:17:09.712 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T13:17:09.713 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/411) 2023-11-13T13:17:10.087 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T13:17:10.098 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T13:17:10.098 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T13:17:10.375 INFO:teuthology.orchestra.run.smithi102.stdout:generic/411 [not run] this test requires a valid $SCRATCH_DEV 2023-11-13T13:17:10.384 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/411 2023-11-13T13:17:10.384 INFO:teuthology.orchestra.run.smithi102.stdout:Not run: generic/411 2023-11-13T13:17:10.384 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T13:17:10.390 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T13:17:10.410 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T13:17:10.410 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/412) 2023-11-13T13:17:10.781 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T13:17:10.792 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T13:17:10.792 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T13:17:11.069 INFO:teuthology.orchestra.run.smithi102.stdout:generic/412 [not run] this test requires a valid $SCRATCH_DEV 2023-11-13T13:17:11.077 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/412 2023-11-13T13:17:11.077 INFO:teuthology.orchestra.run.smithi102.stdout:Not run: generic/412 2023-11-13T13:17:11.077 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T13:17:11.083 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T13:17:11.102 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T13:17:11.103 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/413) 2023-11-13T13:17:11.477 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T13:17:11.487 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T13:17:11.487 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T13:17:11.773 INFO:teuthology.orchestra.run.smithi102.stdout:generic/413 [not run] this test requires a valid $SCRATCH_DEV 2023-11-13T13:17:11.781 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/413 2023-11-13T13:17:11.781 INFO:teuthology.orchestra.run.smithi102.stdout:Not run: generic/413 2023-11-13T13:17:11.782 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T13:17:11.787 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T13:17:11.808 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T13:17:11.808 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/414) 2023-11-13T13:17:12.175 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T13:17:12.185 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T13:17:12.186 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T13:17:12.456 INFO:teuthology.orchestra.run.smithi102.stdout:generic/414 [not run] this test requires a valid $SCRATCH_DEV 2023-11-13T13:17:12.464 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/414 2023-11-13T13:17:12.464 INFO:teuthology.orchestra.run.smithi102.stdout:Not run: generic/414 2023-11-13T13:17:12.464 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T13:17:12.470 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T13:17:12.491 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T13:17:12.491 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/415) 2023-11-13T13:17:12.862 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T13:17:12.872 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T13:17:12.872 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T13:17:13.145 INFO:teuthology.orchestra.run.smithi102.stdout:generic/415 [not run] this test requires a valid $SCRATCH_DEV 2023-11-13T13:17:13.153 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/415 2023-11-13T13:17:13.153 INFO:teuthology.orchestra.run.smithi102.stdout:Not run: generic/415 2023-11-13T13:17:13.153 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T13:17:13.159 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T13:17:13.179 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T13:17:13.179 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/416) 2023-11-13T13:17:13.571 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T13:17:13.582 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T13:17:13.582 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T13:17:13.868 INFO:teuthology.orchestra.run.smithi102.stdout:generic/416 [not run] this test requires a valid $SCRATCH_DEV 2023-11-13T13:17:13.877 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/416 2023-11-13T13:17:13.877 INFO:teuthology.orchestra.run.smithi102.stdout:Not run: generic/416 2023-11-13T13:17:13.877 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T13:17:13.883 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T13:17:13.902 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T13:17:13.903 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/417) 2023-11-13T13:17:14.268 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T13:17:14.278 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T13:17:14.278 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T13:17:14.567 INFO:teuthology.orchestra.run.smithi102.stdout:generic/417 [not run] this test requires a valid $SCRATCH_DEV 2023-11-13T13:17:14.575 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/417 2023-11-13T13:17:14.576 INFO:teuthology.orchestra.run.smithi102.stdout:Not run: generic/417 2023-11-13T13:17:14.576 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T13:17:14.582 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T13:17:14.601 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T13:17:14.601 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/418) 2023-11-13T13:17:15.001 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T13:17:15.012 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T13:17:15.012 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T13:17:15.349 INFO:teuthology.orchestra.run.smithi102.stdout:generic/418 [not run] require ceph-fuse to be valid block disk 2023-11-13T13:17:15.357 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/418 2023-11-13T13:17:15.357 INFO:teuthology.orchestra.run.smithi102.stdout:Not run: generic/418 2023-11-13T13:17:15.357 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T13:17:15.363 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T13:17:15.434 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T13:17:15.435 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/419) 2023-11-13T13:17:15.804 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T13:17:15.814 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T13:17:15.815 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T13:17:16.179 INFO:teuthology.orchestra.run.smithi102.stdout:generic/419 [not run] this test requires a valid $SCRATCH_DEV 2023-11-13T13:17:16.188 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/419 2023-11-13T13:17:16.188 INFO:teuthology.orchestra.run.smithi102.stdout:Not run: generic/419 2023-11-13T13:17:16.188 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T13:17:16.194 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T13:17:16.254 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T13:17:16.254 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/420) 2023-11-13T13:17:16.616 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T13:17:16.626 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T13:17:16.626 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T13:17:18.124 INFO:teuthology.orchestra.run.smithi102.stdout:generic/420 2s 2023-11-13T13:17:18.136 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/420 2023-11-13T13:17:18.137 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T13:17:18.143 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T13:17:18.311 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T13:17:18.311 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/421) 2023-11-13T13:17:18.627 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T13:17:18.631 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T13:17:18.899 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T13:17:18.910 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T13:17:18.910 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T13:17:19.262 INFO:teuthology.orchestra.run.smithi102.stdout:generic/421 [not run] this test requires a valid $SCRATCH_DEV 2023-11-13T13:17:19.269 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/421 2023-11-13T13:17:19.270 INFO:teuthology.orchestra.run.smithi102.stdout:Not run: generic/421 2023-11-13T13:17:19.270 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T13:17:19.276 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T13:17:19.295 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T13:17:19.296 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/422) 2023-11-13T13:17:19.655 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T13:17:19.665 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T13:17:19.666 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T13:17:19.957 INFO:teuthology.orchestra.run.smithi102.stdout:generic/422 [not run] this test requires a valid $SCRATCH_DEV 2023-11-13T13:17:19.965 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/422 2023-11-13T13:17:19.965 INFO:teuthology.orchestra.run.smithi102.stdout:Not run: generic/422 2023-11-13T13:17:19.965 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T13:17:19.971 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T13:17:19.991 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T13:17:19.992 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/423) 2023-11-13T13:17:20.365 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T13:17:20.376 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T13:17:20.376 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T13:17:20.881 INFO:teuthology.orchestra.run.smithi102.stdout:generic/423 0s 2023-11-13T13:17:20.893 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/423 2023-11-13T13:17:20.894 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T13:17:20.900 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T13:17:20.930 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T13:17:20.931 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/424) 2023-11-13T13:17:21.620 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T13:17:21.630 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T13:17:21.631 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T13:17:21.982 INFO:teuthology.orchestra.run.smithi102.stdout:generic/424 [not run] file system doesn't support any of /usr/bin/chattr +a/+c/+d/+i 2023-11-13T13:17:21.990 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/424 2023-11-13T13:17:21.990 INFO:teuthology.orchestra.run.smithi102.stdout:Not run: generic/424 2023-11-13T13:17:21.991 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T13:17:21.998 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T13:17:22.017 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T13:17:22.019 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/425) 2023-11-13T13:17:22.387 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T13:17:22.399 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T13:17:22.399 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T13:17:22.676 INFO:teuthology.orchestra.run.smithi102.stdout:generic/425 [not run] this test requires a valid $SCRATCH_DEV 2023-11-13T13:17:22.684 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/425 2023-11-13T13:17:22.685 INFO:teuthology.orchestra.run.smithi102.stdout:Not run: generic/425 2023-11-13T13:17:22.685 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T13:17:22.690 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T13:17:22.711 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T13:17:22.711 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/426) 2023-11-13T13:17:23.108 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T13:17:23.118 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T13:17:23.119 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T13:17:48.683 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T13:17:48.688 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T13:17:59.914 INFO:teuthology.orchestra.run.smithi102.stdout:generic/426 - output mismatch (see /tmp/tmp.EnLPmcWJbzxfstests-dev/results//generic/426.out.bad) 2023-11-13T13:17:59.949 INFO:teuthology.orchestra.run.smithi102.stdout: --- tests/generic/426.out 2023-11-13 11:30:05.333485037 +0000 2023-11-13T13:17:59.950 INFO:teuthology.orchestra.run.smithi102.stdout: +++ /tmp/tmp.EnLPmcWJbzxfstests-dev/results//generic/426.out.bad 2023-11-13 13:17:59.896300358 +0000 2023-11-13T13:17:59.950 INFO:teuthology.orchestra.run.smithi102.stdout: @@ -1,5 +1,117 @@ 2023-11-13T13:17:59.950 INFO:teuthology.orchestra.run.smithi102.stdout: QA output created by 426 2023-11-13T13:17:59.950 INFO:teuthology.orchestra.run.smithi102.stdout: test_file_handles TEST_DIR/426-dir -d 2023-11-13T13:17:59.950 INFO:teuthology.orchestra.run.smithi102.stdout: +open_by_handle(/tmp/tmp.T3Y73qtatntest/426-dir/file000912) opened an unlinked file! 2023-11-13T13:17:59.951 INFO:teuthology.orchestra.run.smithi102.stdout: +open_by_handle(/tmp/tmp.T3Y73qtatntest/426-dir/file000913) opened an unlinked file! 2023-11-13T13:17:59.951 INFO:teuthology.orchestra.run.smithi102.stdout: +open_by_handle(/tmp/tmp.T3Y73qtatntest/426-dir/file000914) opened an unlinked file! 2023-11-13T13:17:59.951 INFO:teuthology.orchestra.run.smithi102.stdout: +open_by_handle(/tmp/tmp.T3Y73qtatntest/426-dir/file000915) opened an unlinked file! 2023-11-13T13:17:59.951 INFO:teuthology.orchestra.run.smithi102.stdout: +open_by_handle(/tmp/tmp.T3Y73qtatntest/426-dir/file000916) opened an unlinked file! 2023-11-13T13:17:59.951 INFO:teuthology.orchestra.run.smithi102.stdout: +open_by_handle(/tmp/tmp.T3Y73qtatntest/426-dir/file000917) opened an unlinked file! 2023-11-13T13:17:59.952 INFO:teuthology.orchestra.run.smithi102.stdout: +open_by_handle(/tmp/tmp.T3Y73qtatntest/426-dir/file000918) opened an unlinked file! 2023-11-13T13:17:59.952 INFO:teuthology.orchestra.run.smithi102.stdout: +open_by_handle(/tmp/tmp.T3Y73qtatntest/426-dir/file000919) opened an unlinked file! 2023-11-13T13:17:59.952 INFO:teuthology.orchestra.run.smithi102.stdout: +open_by_handle(/tmp/tmp.T3Y73qtatntest/426-dir/file000920) opened an unlinked file! 2023-11-13T13:17:59.952 INFO:teuthology.orchestra.run.smithi102.stdout: +open_by_handle(/tmp/tmp.T3Y73qtatntest/426-dir/file000921) opened an unlinked file! 2023-11-13T13:17:59.952 INFO:teuthology.orchestra.run.smithi102.stdout: +open_by_handle(/tmp/tmp.T3Y73qtatntest/426-dir/file000922) opened an unlinked file! 2023-11-13T13:17:59.953 INFO:teuthology.orchestra.run.smithi102.stdout: +open_by_handle(/tmp/tmp.T3Y73qtatntest/426-dir/file000923) opened an unlinked file! 2023-11-13T13:17:59.953 INFO:teuthology.orchestra.run.smithi102.stdout: +open_by_handle(/tmp/tmp.T3Y73qtatntest/426-dir/file000924) opened an unlinked file! 2023-11-13T13:17:59.953 INFO:teuthology.orchestra.run.smithi102.stdout: +open_by_handle(/tmp/tmp.T3Y73qtatntest/426-dir/file000925) opened an unlinked file! 2023-11-13T13:17:59.953 INFO:teuthology.orchestra.run.smithi102.stdout: +open_by_handle(/tmp/tmp.T3Y73qtatntest/426-dir/file000926) opened an unlinked file! 2023-11-13T13:17:59.953 INFO:teuthology.orchestra.run.smithi102.stdout: +open_by_handle(/tmp/tmp.T3Y73qtatntest/426-dir/file000927) opened an unlinked file! 2023-11-13T13:17:59.953 INFO:teuthology.orchestra.run.smithi102.stdout: +open_by_handle(/tmp/tmp.T3Y73qtatntest/426-dir/file000928) opened an unlinked file! 2023-11-13T13:17:59.954 INFO:teuthology.orchestra.run.smithi102.stdout: +open_by_handle(/tmp/tmp.T3Y73qtatntest/426-dir/file000929) opened an unlinked file! 2023-11-13T13:17:59.954 INFO:teuthology.orchestra.run.smithi102.stdout: +open_by_handle(/tmp/tmp.T3Y73qtatntest/426-dir/file000930) opened an unlinked file! 2023-11-13T13:17:59.954 INFO:teuthology.orchestra.run.smithi102.stdout: +open_by_handle(/tmp/tmp.T3Y73qtatntest/426-dir/file000931) opened an unlinked file! 2023-11-13T13:17:59.954 INFO:teuthology.orchestra.run.smithi102.stdout: +open_by_handle(/tmp/tmp.T3Y73qtatntest/426-dir/file000932) opened an unlinked file! 2023-11-13T13:17:59.954 INFO:teuthology.orchestra.run.smithi102.stdout: +open_by_handle(/tmp/tmp.T3Y73qtatntest/426-dir/file000933) opened an unlinked file! 2023-11-13T13:17:59.955 INFO:teuthology.orchestra.run.smithi102.stdout: +open_by_handle(/tmp/tmp.T3Y73qtatntest/426-dir/file000934) opened an unlinked file! 2023-11-13T13:17:59.955 INFO:teuthology.orchestra.run.smithi102.stdout: +open_by_handle(/tmp/tmp.T3Y73qtatntest/426-dir/file000935) opened an unlinked file! 2023-11-13T13:17:59.955 INFO:teuthology.orchestra.run.smithi102.stdout: +open_by_handle(/tmp/tmp.T3Y73qtatntest/426-dir/file000936) opened an unlinked file! 2023-11-13T13:17:59.955 INFO:teuthology.orchestra.run.smithi102.stdout: +open_by_handle(/tmp/tmp.T3Y73qtatntest/426-dir/file000937) opened an unlinked file! 2023-11-13T13:17:59.955 INFO:teuthology.orchestra.run.smithi102.stdout: +open_by_handle(/tmp/tmp.T3Y73qtatntest/426-dir/file000938) opened an unlinked file! 2023-11-13T13:17:59.956 INFO:teuthology.orchestra.run.smithi102.stdout: +open_by_handle(/tmp/tmp.T3Y73qtatntest/426-dir/file000939) opened an unlinked file! 2023-11-13T13:17:59.956 INFO:teuthology.orchestra.run.smithi102.stdout: +open_by_handle(/tmp/tmp.T3Y73qtatntest/426-dir/file000940) opened an unlinked file! 2023-11-13T13:17:59.956 INFO:teuthology.orchestra.run.smithi102.stdout: +open_by_handle(/tmp/tmp.T3Y73qtatntest/426-dir/file000941) opened an unlinked file! 2023-11-13T13:17:59.956 INFO:teuthology.orchestra.run.smithi102.stdout: +open_by_handle(/tmp/tmp.T3Y73qtatntest/426-dir/file000942) opened an unlinked file! 2023-11-13T13:17:59.956 INFO:teuthology.orchestra.run.smithi102.stdout: +open_by_handle(/tmp/tmp.T3Y73qtatntest/426-dir/file000943) opened an unlinked file! 2023-11-13T13:17:59.956 INFO:teuthology.orchestra.run.smithi102.stdout: +open_by_handle(/tmp/tmp.T3Y73qtatntest/426-dir/file000944) opened an unlinked file! 2023-11-13T13:17:59.957 INFO:teuthology.orchestra.run.smithi102.stdout: +open_by_handle(/tmp/tmp.T3Y73qtatntest/426-dir/file000945) opened an unlinked file! 2023-11-13T13:17:59.957 INFO:teuthology.orchestra.run.smithi102.stdout: +open_by_handle(/tmp/tmp.T3Y73qtatntest/426-dir/file000946) opened an unlinked file! 2023-11-13T13:17:59.957 INFO:teuthology.orchestra.run.smithi102.stdout: +open_by_handle(/tmp/tmp.T3Y73qtatntest/426-dir/file000947) opened an unlinked file! 2023-11-13T13:17:59.957 INFO:teuthology.orchestra.run.smithi102.stdout: +open_by_handle(/tmp/tmp.T3Y73qtatntest/426-dir/file000948) opened an unlinked file! 2023-11-13T13:17:59.957 INFO:teuthology.orchestra.run.smithi102.stdout: +open_by_handle(/tmp/tmp.T3Y73qtatntest/426-dir/file000949) opened an unlinked file! 2023-11-13T13:17:59.957 INFO:teuthology.orchestra.run.smithi102.stdout: +open_by_handle(/tmp/tmp.T3Y73qtatntest/426-dir/file000950) opened an unlinked file! 2023-11-13T13:17:59.958 INFO:teuthology.orchestra.run.smithi102.stdout: +open_by_handle(/tmp/tmp.T3Y73qtatntest/426-dir/file000951) opened an unlinked file! 2023-11-13T13:17:59.958 INFO:teuthology.orchestra.run.smithi102.stdout: +open_by_handle(/tmp/tmp.T3Y73qtatntest/426-dir/file000952) opened an unlinked file! 2023-11-13T13:17:59.958 INFO:teuthology.orchestra.run.smithi102.stdout: +open_by_handle(/tmp/tmp.T3Y73qtatntest/426-dir/file000953) opened an unlinked file! 2023-11-13T13:17:59.958 INFO:teuthology.orchestra.run.smithi102.stdout: +open_by_handle(/tmp/tmp.T3Y73qtatntest/426-dir/file000954) opened an unlinked file! 2023-11-13T13:17:59.958 INFO:teuthology.orchestra.run.smithi102.stdout: +open_by_handle(/tmp/tmp.T3Y73qtatntest/426-dir/file000955) opened an unlinked file! 2023-11-13T13:17:59.959 INFO:teuthology.orchestra.run.smithi102.stdout: +open_by_handle(/tmp/tmp.T3Y73qtatntest/426-dir/file000956) opened an unlinked file! 2023-11-13T13:17:59.959 INFO:teuthology.orchestra.run.smithi102.stdout: +open_by_handle(/tmp/tmp.T3Y73qtatntest/426-dir/file000957) opened an unlinked file! 2023-11-13T13:17:59.959 INFO:teuthology.orchestra.run.smithi102.stdout: +open_by_handle(/tmp/tmp.T3Y73qtatntest/426-dir/file000958) opened an unlinked file! 2023-11-13T13:17:59.959 INFO:teuthology.orchestra.run.smithi102.stdout: +open_by_handle(/tmp/tmp.T3Y73qtatntest/426-dir/file000959) opened an unlinked file! 2023-11-13T13:17:59.959 INFO:teuthology.orchestra.run.smithi102.stdout: +open_by_handle(/tmp/tmp.T3Y73qtatntest/426-dir/file000960) opened an unlinked file! 2023-11-13T13:17:59.960 INFO:teuthology.orchestra.run.smithi102.stdout: +open_by_handle(/tmp/tmp.T3Y73qtatntest/426-dir/file000961) opened an unlinked file! 2023-11-13T13:17:59.960 INFO:teuthology.orchestra.run.smithi102.stdout: +open_by_handle(/tmp/tmp.T3Y73qtatntest/426-dir/file000962) opened an unlinked file! 2023-11-13T13:17:59.960 INFO:teuthology.orchestra.run.smithi102.stdout: +open_by_handle(/tmp/tmp.T3Y73qtatntest/426-dir/file000963) opened an unlinked file! 2023-11-13T13:17:59.960 INFO:teuthology.orchestra.run.smithi102.stdout: +open_by_handle(/tmp/tmp.T3Y73qtatntest/426-dir/file000964) opened an unlinked file! 2023-11-13T13:17:59.960 INFO:teuthology.orchestra.run.smithi102.stdout: +open_by_handle(/tmp/tmp.T3Y73qtatntest/426-dir/file000965) opened an unlinked file! 2023-11-13T13:17:59.960 INFO:teuthology.orchestra.run.smithi102.stdout: +open_by_handle(/tmp/tmp.T3Y73qtatntest/426-dir/file000966) opened an unlinked file! 2023-11-13T13:17:59.961 INFO:teuthology.orchestra.run.smithi102.stdout: +open_by_handle(/tmp/tmp.T3Y73qtatntest/426-dir/file000967) opened an unlinked file! 2023-11-13T13:17:59.961 INFO:teuthology.orchestra.run.smithi102.stdout: +open_by_handle(/tmp/tmp.T3Y73qtatntest/426-dir/file000968) opened an unlinked file! 2023-11-13T13:17:59.961 INFO:teuthology.orchestra.run.smithi102.stdout: +open_by_handle(/tmp/tmp.T3Y73qtatntest/426-dir/file000969) opened an unlinked file! 2023-11-13T13:17:59.961 INFO:teuthology.orchestra.run.smithi102.stdout: +open_by_handle(/tmp/tmp.T3Y73qtatntest/426-dir/file000970) opened an unlinked file! 2023-11-13T13:17:59.961 INFO:teuthology.orchestra.run.smithi102.stdout: +open_by_handle(/tmp/tmp.T3Y73qtatntest/426-dir/file000971) opened an unlinked file! 2023-11-13T13:17:59.962 INFO:teuthology.orchestra.run.smithi102.stdout: +open_by_handle(/tmp/tmp.T3Y73qtatntest/426-dir/file000972) opened an unlinked file! 2023-11-13T13:17:59.962 INFO:teuthology.orchestra.run.smithi102.stdout: +open_by_handle(/tmp/tmp.T3Y73qtatntest/426-dir/file000973) opened an unlinked file! 2023-11-13T13:17:59.962 INFO:teuthology.orchestra.run.smithi102.stdout: +open_by_handle(/tmp/tmp.T3Y73qtatntest/426-dir/file000974) opened an unlinked file! 2023-11-13T13:17:59.962 INFO:teuthology.orchestra.run.smithi102.stdout: +open_by_handle(/tmp/tmp.T3Y73qtatntest/426-dir/file000975) opened an unlinked file! 2023-11-13T13:17:59.962 INFO:teuthology.orchestra.run.smithi102.stdout: +open_by_handle(/tmp/tmp.T3Y73qtatntest/426-dir/file000976) opened an unlinked file! 2023-11-13T13:17:59.962 INFO:teuthology.orchestra.run.smithi102.stdout: +open_by_handle(/tmp/tmp.T3Y73qtatntest/426-dir/file000977) opened an unlinked file! 2023-11-13T13:17:59.963 INFO:teuthology.orchestra.run.smithi102.stdout: +open_by_handle(/tmp/tmp.T3Y73qtatntest/426-dir/file000978) opened an unlinked file! 2023-11-13T13:17:59.963 INFO:teuthology.orchestra.run.smithi102.stdout: +open_by_handle(/tmp/tmp.T3Y73qtatntest/426-dir/file000979) opened an unlinked file! 2023-11-13T13:17:59.963 INFO:teuthology.orchestra.run.smithi102.stdout: +open_by_handle(/tmp/tmp.T3Y73qtatntest/426-dir/file000980) opened an unlinked file! 2023-11-13T13:17:59.963 INFO:teuthology.orchestra.run.smithi102.stdout: +open_by_handle(/tmp/tmp.T3Y73qtatntest/426-dir/file000981) opened an unlinked file! 2023-11-13T13:17:59.963 INFO:teuthology.orchestra.run.smithi102.stdout: +open_by_handle(/tmp/tmp.T3Y73qtatntest/426-dir/file000982) opened an unlinked file! 2023-11-13T13:17:59.964 INFO:teuthology.orchestra.run.smithi102.stdout: +open_by_handle(/tmp/tmp.T3Y73qtatntest/426-dir/file000983) opened an unlinked file! 2023-11-13T13:17:59.964 INFO:teuthology.orchestra.run.smithi102.stdout: +open_by_handle(/tmp/tmp.T3Y73qtatntest/426-dir/file000984) opened an unlinked file! 2023-11-13T13:17:59.964 INFO:teuthology.orchestra.run.smithi102.stdout: +open_by_handle(/tmp/tmp.T3Y73qtatntest/426-dir/file000985) opened an unlinked file! 2023-11-13T13:17:59.964 INFO:teuthology.orchestra.run.smithi102.stdout: +open_by_handle(/tmp/tmp.T3Y73qtatntest/426-dir/file000986) opened an unlinked file! 2023-11-13T13:17:59.964 INFO:teuthology.orchestra.run.smithi102.stdout: +open_by_handle(/tmp/tmp.T3Y73qtatntest/426-dir/file000987) opened an unlinked file! 2023-11-13T13:17:59.964 INFO:teuthology.orchestra.run.smithi102.stdout: +open_by_handle(/tmp/tmp.T3Y73qtatntest/426-dir/file000988) opened an unlinked file! 2023-11-13T13:17:59.965 INFO:teuthology.orchestra.run.smithi102.stdout: +open_by_handle(/tmp/tmp.T3Y73qtatntest/426-dir/file000989) opened an unlinked file! 2023-11-13T13:17:59.965 INFO:teuthology.orchestra.run.smithi102.stdout: +open_by_handle(/tmp/tmp.T3Y73qtatntest/426-dir/file000990) opened an unlinked file! 2023-11-13T13:17:59.965 INFO:teuthology.orchestra.run.smithi102.stdout: +open_by_handle(/tmp/tmp.T3Y73qtatntest/426-dir/file000991) opened an unlinked file! 2023-11-13T13:17:59.965 INFO:teuthology.orchestra.run.smithi102.stdout: +open_by_handle(/tmp/tmp.T3Y73qtatntest/426-dir/file000992) opened an unlinked file! 2023-11-13T13:17:59.965 INFO:teuthology.orchestra.run.smithi102.stdout: +open_by_handle(/tmp/tmp.T3Y73qtatntest/426-dir/file000993) opened an unlinked file! 2023-11-13T13:17:59.966 INFO:teuthology.orchestra.run.smithi102.stdout: +open_by_handle(/tmp/tmp.T3Y73qtatntest/426-dir/file000994) opened an unlinked file! 2023-11-13T13:17:59.966 INFO:teuthology.orchestra.run.smithi102.stdout: +open_by_handle(/tmp/tmp.T3Y73qtatntest/426-dir/file000995) opened an unlinked file! 2023-11-13T13:17:59.966 INFO:teuthology.orchestra.run.smithi102.stdout: +open_by_handle(/tmp/tmp.T3Y73qtatntest/426-dir/file000996) opened an unlinked file! 2023-11-13T13:17:59.966 INFO:teuthology.orchestra.run.smithi102.stdout: +open_by_handle(/tmp/tmp.T3Y73qtatntest/426-dir/file000997) opened an unlinked file! 2023-11-13T13:17:59.966 INFO:teuthology.orchestra.run.smithi102.stdout: +open_by_handle(/tmp/tmp.T3Y73qtatntest/426-dir/file000998) opened an unlinked file! 2023-11-13T13:17:59.966 INFO:teuthology.orchestra.run.smithi102.stdout: +open_by_handle(/tmp/tmp.T3Y73qtatntest/426-dir/file000999) opened an unlinked file! 2023-11-13T13:17:59.967 INFO:teuthology.orchestra.run.smithi102.stdout: +open_by_handle(/tmp/tmp.T3Y73qtatntest/426-dir/file001000) opened an unlinked file! 2023-11-13T13:17:59.967 INFO:teuthology.orchestra.run.smithi102.stdout: +open_by_handle(/tmp/tmp.T3Y73qtatntest/426-dir/file001001) opened an unlinked file! 2023-11-13T13:17:59.967 INFO:teuthology.orchestra.run.smithi102.stdout: +open_by_handle(/tmp/tmp.T3Y73qtatntest/426-dir/file001002) opened an unlinked file! 2023-11-13T13:17:59.967 INFO:teuthology.orchestra.run.smithi102.stdout: +open_by_handle(/tmp/tmp.T3Y73qtatntest/426-dir/file001003) opened an unlinked file! 2023-11-13T13:17:59.967 INFO:teuthology.orchestra.run.smithi102.stdout: +open_by_handle(/tmp/tmp.T3Y73qtatntest/426-dir/file001004) opened an unlinked file! 2023-11-13T13:17:59.968 INFO:teuthology.orchestra.run.smithi102.stdout: +open_by_handle(/tmp/tmp.T3Y73qtatntest/426-dir/file001005) opened an unlinked file! 2023-11-13T13:17:59.968 INFO:teuthology.orchestra.run.smithi102.stdout: +open_by_handle(/tmp/tmp.T3Y73qtatntest/426-dir/file001006) opened an unlinked file! 2023-11-13T13:17:59.968 INFO:teuthology.orchestra.run.smithi102.stdout: +open_by_handle(/tmp/tmp.T3Y73qtatntest/426-dir/file001007) opened an unlinked file! 2023-11-13T13:17:59.968 INFO:teuthology.orchestra.run.smithi102.stdout: +open_by_handle(/tmp/tmp.T3Y73qtatntest/426-dir/file001008) opened an unlinked file! 2023-11-13T13:17:59.968 INFO:teuthology.orchestra.run.smithi102.stdout: +open_by_handle(/tmp/tmp.T3Y73qtatntest/426-dir/file001009) opened an unlinked file! 2023-11-13T13:17:59.968 INFO:teuthology.orchestra.run.smithi102.stdout: +open_by_handle(/tmp/tmp.T3Y73qtatntest/426-dir/file001010) opened an unlinked file! 2023-11-13T13:17:59.969 INFO:teuthology.orchestra.run.smithi102.stdout: +open_by_handle(/tmp/tmp.T3Y73qtatntest/426-dir/file001011) opened an unlinked file! 2023-11-13T13:17:59.969 INFO:teuthology.orchestra.run.smithi102.stdout: +open_by_handle(/tmp/tmp.T3Y73qtatntest/426-dir/file001012) opened an unlinked file! 2023-11-13T13:17:59.969 INFO:teuthology.orchestra.run.smithi102.stdout: +open_by_handle(/tmp/tmp.T3Y73qtatntest/426-dir/file001013) opened an unlinked file! 2023-11-13T13:17:59.969 INFO:teuthology.orchestra.run.smithi102.stdout: +open_by_handle(/tmp/tmp.T3Y73qtatntest/426-dir/file001014) opened an unlinked file! 2023-11-13T13:17:59.969 INFO:teuthology.orchestra.run.smithi102.stdout: +open_by_handle(/tmp/tmp.T3Y73qtatntest/426-dir/file001015) opened an unlinked file! 2023-11-13T13:17:59.970 INFO:teuthology.orchestra.run.smithi102.stdout: +open_by_handle(/tmp/tmp.T3Y73qtatntest/426-dir/file001016) opened an unlinked file! 2023-11-13T13:17:59.970 INFO:teuthology.orchestra.run.smithi102.stdout: +open_by_handle(/tmp/tmp.T3Y73qtatntest/426-dir/file001017) opened an unlinked file! 2023-11-13T13:17:59.970 INFO:teuthology.orchestra.run.smithi102.stdout: +open_by_handle(/tmp/tmp.T3Y73qtatntest/426-dir/file001018) opened an unlinked file! 2023-11-13T13:17:59.970 INFO:teuthology.orchestra.run.smithi102.stdout: +open_by_handle(/tmp/tmp.T3Y73qtatntest/426-dir/file001019) opened an unlinked file! 2023-11-13T13:17:59.970 INFO:teuthology.orchestra.run.smithi102.stdout: +open_by_handle(/tmp/tmp.T3Y73qtatntest/426-dir/file001020) opened an unlinked file! 2023-11-13T13:17:59.970 INFO:teuthology.orchestra.run.smithi102.stdout: +open_by_handle(/tmp/tmp.T3Y73qtatntest/426-dir/file001021) opened an unlinked file! 2023-11-13T13:17:59.971 INFO:teuthology.orchestra.run.smithi102.stdout: +open_by_handle(/tmp/tmp.T3Y73qtatntest/426-dir/file001022) opened an unlinked file! 2023-11-13T13:17:59.971 INFO:teuthology.orchestra.run.smithi102.stdout: +open_by_handle(/tmp/tmp.T3Y73qtatntest/426-dir/file001023) opened an unlinked file! 2023-11-13T13:17:59.971 INFO:teuthology.orchestra.run.smithi102.stdout: test_file_handles TEST_DIR/426-dir 2023-11-13T13:17:59.971 INFO:teuthology.orchestra.run.smithi102.stdout: test_file_handles TEST_DIR/426-dir -l 2023-11-13T13:17:59.971 INFO:teuthology.orchestra.run.smithi102.stdout: test_file_handles TEST_DIR/426-dir -u 2023-11-13T13:17:59.975 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/426 2023-11-13T13:17:59.975 INFO:teuthology.orchestra.run.smithi102.stdout:Failures: generic/426 2023-11-13T13:17:59.975 INFO:teuthology.orchestra.run.smithi102.stdout:Failed 1 of 1 tests 2023-11-13T13:18:00.002 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T13:18:00.087 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-13T13:18:00.087 INFO:tasks.cephfs.xfstests_dev:Command failed 2023-11-13T13:18:00.088 INFO:tasks.cephfs.xfstests_dev:Command return value: 1 2023-11-13T13:18:00.088 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/427) 2023-11-13T13:18:01.927 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T13:18:01.937 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T13:18:01.938 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T13:18:02.266 INFO:teuthology.orchestra.run.smithi102.stdout:generic/427 [not run] this test requires a valid $SCRATCH_DEV 2023-11-13T13:18:02.274 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/427 2023-11-13T13:18:02.275 INFO:teuthology.orchestra.run.smithi102.stdout:Not run: generic/427 2023-11-13T13:18:02.275 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T13:18:02.280 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T13:18:02.299 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T13:18:02.300 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/428) 2023-11-13T13:18:02.691 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T13:18:02.701 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T13:18:02.702 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T13:18:03.093 INFO:teuthology.orchestra.run.smithi102.stdout:generic/428 1s 2023-11-13T13:18:03.106 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/428 2023-11-13T13:18:03.106 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T13:18:03.112 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T13:18:03.132 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T13:18:03.132 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/429) 2023-11-13T13:18:03.519 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T13:18:03.530 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T13:18:03.530 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T13:18:03.898 INFO:teuthology.orchestra.run.smithi102.stdout:generic/429 [not run] this test requires a valid $SCRATCH_DEV 2023-11-13T13:18:03.906 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/429 2023-11-13T13:18:03.906 INFO:teuthology.orchestra.run.smithi102.stdout:Not run: generic/429 2023-11-13T13:18:03.906 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T13:18:03.912 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T13:18:03.931 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T13:18:03.932 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/430) 2023-11-13T13:18:04.292 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T13:18:04.302 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T13:18:04.303 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T13:18:04.836 INFO:teuthology.orchestra.run.smithi102.stdout:generic/430 0s 2023-11-13T13:18:04.849 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/430 2023-11-13T13:18:04.849 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T13:18:04.855 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T13:18:04.875 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T13:18:04.876 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/431) 2023-11-13T13:18:05.579 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T13:18:05.589 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T13:18:05.589 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T13:18:06.067 INFO:teuthology.orchestra.run.smithi102.stdout:generic/431 1s 2023-11-13T13:18:06.080 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/431 2023-11-13T13:18:06.080 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T13:18:06.086 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T13:18:06.107 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T13:18:06.107 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/432) 2023-11-13T13:18:06.783 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T13:18:06.793 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T13:18:06.794 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T13:18:07.320 INFO:teuthology.orchestra.run.smithi102.stdout:generic/432 1s 2023-11-13T13:18:07.332 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/432 2023-11-13T13:18:07.333 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T13:18:07.339 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T13:18:07.484 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T13:18:07.485 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/433) 2023-11-13T13:18:08.083 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T13:18:08.094 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T13:18:08.095 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T13:18:08.573 INFO:teuthology.orchestra.run.smithi102.stdout:generic/433 0s 2023-11-13T13:18:08.585 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/433 2023-11-13T13:18:08.586 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T13:18:08.592 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T13:18:08.611 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T13:18:08.612 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/434) 2023-11-13T13:18:09.299 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T13:18:09.309 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T13:18:09.309 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T13:18:09.806 INFO:teuthology.orchestra.run.smithi102.stdout:generic/434 - output mismatch (see /tmp/tmp.EnLPmcWJbzxfstests-dev/results//generic/434.out.bad) 2023-11-13T13:18:09.811 INFO:teuthology.orchestra.run.smithi102.stdout: --- tests/generic/434.out 2023-11-13 11:30:05.333485037 +0000 2023-11-13T13:18:09.812 INFO:teuthology.orchestra.run.smithi102.stdout: +++ /tmp/tmp.EnLPmcWJbzxfstests-dev/results//generic/434.out.bad 2023-11-13 13:18:09.804115117 +0000 2023-11-13T13:18:09.812 INFO:teuthology.orchestra.run.smithi102.stdout: @@ -9,6 +9,6 @@ 2023-11-13T13:18:09.812 INFO:teuthology.orchestra.run.smithi102.stdout: copy_range: Bad file descriptor 2023-11-13T13:18:09.812 INFO:teuthology.orchestra.run.smithi102.stdout: d41d8cd98f00b204e9800998ecf8427e TEST_DIR/test-434/copy 2023-11-13T13:18:09.813 INFO:teuthology.orchestra.run.smithi102.stdout: Try to copy to a device 2023-11-13T13:18:09.813 INFO:teuthology.orchestra.run.smithi102.stdout: -copy_range: Invalid argument 2023-11-13T13:18:09.813 INFO:teuthology.orchestra.run.smithi102.stdout: +/tmp/tmp.T3Y73qtatntest/test-434/dev1: Permission denied 2023-11-13T13:18:09.813 INFO:teuthology.orchestra.run.smithi102.stdout: Try to copy to a fifo 2023-11-13T13:18:09.814 INFO:teuthology.orchestra.run.smithi102.stdout: copy_range: Invalid argument 2023-11-13T13:18:09.817 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/434 2023-11-13T13:18:09.817 INFO:teuthology.orchestra.run.smithi102.stdout:Failures: generic/434 2023-11-13T13:18:09.817 INFO:teuthology.orchestra.run.smithi102.stdout:Failed 1 of 1 tests 2023-11-13T13:18:09.823 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T13:18:09.944 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-13T13:18:09.945 INFO:tasks.cephfs.xfstests_dev:Command failed 2023-11-13T13:18:09.946 INFO:tasks.cephfs.xfstests_dev:Command return value: 1 2023-11-13T13:18:09.946 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/435) 2023-11-13T13:18:10.573 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T13:18:10.583 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T13:18:10.584 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T13:18:10.943 INFO:teuthology.orchestra.run.smithi102.stdout:generic/435 [not run] this test requires a valid $SCRATCH_DEV 2023-11-13T13:18:10.952 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/435 2023-11-13T13:18:10.952 INFO:teuthology.orchestra.run.smithi102.stdout:Not run: generic/435 2023-11-13T13:18:10.952 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T13:18:10.958 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T13:18:10.978 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T13:18:10.979 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/436) 2023-11-13T13:18:11.347 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T13:18:11.358 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T13:18:11.358 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T13:18:12.662 INFO:teuthology.orchestra.run.smithi102.stdout:generic/436 1s 2023-11-13T13:18:12.675 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/436 2023-11-13T13:18:12.675 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T13:18:12.681 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T13:18:12.867 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T13:18:12.868 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/437) 2023-11-13T13:18:13.419 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T13:18:13.430 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T13:18:13.430 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T13:18:14.565 INFO:teuthology.orchestra.run.smithi102.stdout:generic/437 1s 2023-11-13T13:18:14.577 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/437 2023-11-13T13:18:14.577 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T13:18:14.583 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T13:18:14.603 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T13:18:14.603 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/438) 2023-11-13T13:18:14.967 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T13:18:14.977 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T13:18:14.978 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T13:18:20.897 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T13:18:20.901 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T13:18:51.017 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T13:18:51.021 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T13:19:21.081 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T13:19:21.086 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T13:19:51.536 INFO:teuthology.orchestra.run.smithi102.stdout:generic/438 97s 2023-11-13T13:19:51.548 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/438 2023-11-13T13:19:51.549 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T13:19:51.555 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T13:19:51.576 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T13:19:51.576 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/439) 2023-11-13T13:19:51.754 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T13:19:51.758 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T13:19:51.951 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T13:19:51.961 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T13:19:51.962 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T13:19:52.249 INFO:teuthology.orchestra.run.smithi102.stdout:generic/439 [not run] this test requires a valid $SCRATCH_DEV 2023-11-13T13:19:52.257 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/439 2023-11-13T13:19:52.258 INFO:teuthology.orchestra.run.smithi102.stdout:Not run: generic/439 2023-11-13T13:19:52.258 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T13:19:52.264 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T13:19:52.283 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T13:19:52.283 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/440) 2023-11-13T13:19:52.667 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T13:19:52.678 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T13:19:52.678 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T13:19:53.035 INFO:teuthology.orchestra.run.smithi102.stdout:generic/440 [not run] this test requires a valid $SCRATCH_DEV 2023-11-13T13:19:53.043 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/440 2023-11-13T13:19:53.043 INFO:teuthology.orchestra.run.smithi102.stdout:Not run: generic/440 2023-11-13T13:19:53.044 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T13:19:53.050 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T13:19:53.069 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T13:19:53.070 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/441) 2023-11-13T13:19:53.427 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T13:19:53.437 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T13:19:53.438 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T13:19:53.794 INFO:teuthology.orchestra.run.smithi102.stdout:generic/441 [not run] this test requires a valid $SCRATCH_DEV 2023-11-13T13:19:53.802 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/441 2023-11-13T13:19:53.803 INFO:teuthology.orchestra.run.smithi102.stdout:Not run: generic/441 2023-11-13T13:19:53.803 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T13:19:53.809 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T13:19:53.829 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T13:19:53.829 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/442) 2023-11-13T13:19:54.199 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T13:19:54.210 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T13:19:54.210 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T13:19:55.187 INFO:teuthology.orchestra.run.smithi102.stdout:generic/442 [not run] this test requires a valid $SCRATCH_DEV 2023-11-13T13:19:55.195 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/442 2023-11-13T13:19:55.196 INFO:teuthology.orchestra.run.smithi102.stdout:Not run: generic/442 2023-11-13T13:19:55.196 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T13:19:55.202 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T13:19:55.223 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T13:19:55.223 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/443) 2023-11-13T13:19:55.600 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T13:19:55.611 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T13:19:55.611 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T13:19:56.186 INFO:teuthology.orchestra.run.smithi102.stdout:generic/443 1s 2023-11-13T13:19:56.199 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/443 2023-11-13T13:19:56.199 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T13:19:56.205 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T13:19:56.226 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T13:19:56.226 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/444) 2023-11-13T13:19:56.587 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T13:19:56.597 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T13:19:56.598 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T13:19:57.034 INFO:teuthology.orchestra.run.smithi102.stdout:generic/444 [not run] ACLs not supported by this filesystem type: ceph-fuse 2023-11-13T13:19:57.042 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/444 2023-11-13T13:19:57.042 INFO:teuthology.orchestra.run.smithi102.stdout:Not run: generic/444 2023-11-13T13:19:57.042 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T13:19:57.048 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T13:19:57.067 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T13:19:57.067 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/445) 2023-11-13T13:19:57.439 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T13:19:57.450 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T13:19:57.450 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T13:19:58.716 INFO:teuthology.orchestra.run.smithi102.stdout:generic/445 1s 2023-11-13T13:19:58.729 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/445 2023-11-13T13:19:58.729 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T13:19:58.735 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T13:19:58.967 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T13:19:58.967 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/446) 2023-11-13T13:19:59.483 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T13:19:59.493 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T13:19:59.493 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T13:19:59.755 INFO:teuthology.orchestra.run.smithi102.stdout:generic/446 [not run] this test requires a valid $SCRATCH_DEV 2023-11-13T13:19:59.764 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/446 2023-11-13T13:19:59.764 INFO:teuthology.orchestra.run.smithi102.stdout:Not run: generic/446 2023-11-13T13:19:59.764 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T13:19:59.770 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T13:19:59.790 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T13:19:59.791 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/447) 2023-11-13T13:20:00.143 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T13:20:00.154 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T13:20:00.154 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T13:20:00.420 INFO:teuthology.orchestra.run.smithi102.stdout:generic/447 [not run] this test requires a valid $SCRATCH_DEV 2023-11-13T13:20:00.428 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/447 2023-11-13T13:20:00.428 INFO:teuthology.orchestra.run.smithi102.stdout:Not run: generic/447 2023-11-13T13:20:00.429 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T13:20:00.434 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T13:20:00.454 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T13:20:00.455 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/448) 2023-11-13T13:20:00.840 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T13:20:00.851 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T13:20:00.851 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T13:20:02.056 INFO:teuthology.orchestra.run.smithi102.stdout:generic/448 2s 2023-11-13T13:20:02.068 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/448 2023-11-13T13:20:02.069 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T13:20:02.075 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T13:20:02.280 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T13:20:02.280 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/449) 2023-11-13T13:20:02.810 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T13:20:02.821 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T13:20:02.821 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T13:20:03.116 INFO:teuthology.orchestra.run.smithi102.stdout:generic/449 [not run] this test requires a valid $SCRATCH_DEV 2023-11-13T13:20:03.124 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/449 2023-11-13T13:20:03.124 INFO:teuthology.orchestra.run.smithi102.stdout:Not run: generic/449 2023-11-13T13:20:03.125 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T13:20:03.131 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T13:20:03.150 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T13:20:03.151 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/450) 2023-11-13T13:20:03.543 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T13:20:03.554 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T13:20:03.554 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T13:20:04.913 INFO:teuthology.orchestra.run.smithi102.stdout:generic/450 1s 2023-11-13T13:20:04.926 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/450 2023-11-13T13:20:04.926 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T13:20:04.932 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T13:20:05.131 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T13:20:05.132 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/451) 2023-11-13T13:20:05.659 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T13:20:05.669 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T13:20:05.670 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T13:20:06.314 INFO:teuthology.orchestra.run.smithi102.stdout:generic/451 - output mismatch (see /tmp/tmp.EnLPmcWJbzxfstests-dev/results//generic/451.out.bad) 2023-11-13T13:20:06.320 INFO:teuthology.orchestra.run.smithi102.stdout: --- tests/generic/451.out 2023-11-13 11:30:05.337484954 +0000 2023-11-13T13:20:06.321 INFO:teuthology.orchestra.run.smithi102.stdout: +++ /tmp/tmp.EnLPmcWJbzxfstests-dev/results//generic/451.out.bad 2023-11-13 13:20:06.309943060 +0000 2023-11-13T13:20:06.321 INFO:teuthology.orchestra.run.smithi102.stdout: @@ -1,2 +1,5 @@ 2023-11-13T13:20:06.321 INFO:teuthology.orchestra.run.smithi102.stdout: QA output created by 451 2023-11-13T13:20:06.321 INFO:teuthology.orchestra.run.smithi102.stdout: +get stale data from buffer read 2023-11-13T13:20:06.322 INFO:teuthology.orchestra.run.smithi102.stdout: +00000000 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 ................ 2023-11-13T13:20:06.322 INFO:teuthology.orchestra.run.smithi102.stdout: +000a0000 2023-11-13T13:20:06.322 INFO:teuthology.orchestra.run.smithi102.stdout: Silence is golden 2023-11-13T13:20:06.326 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/451 2023-11-13T13:20:06.326 INFO:teuthology.orchestra.run.smithi102.stdout:Failures: generic/451 2023-11-13T13:20:06.327 INFO:teuthology.orchestra.run.smithi102.stdout:Failed 1 of 1 tests 2023-11-13T13:20:06.332 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T13:20:06.425 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-13T13:20:06.426 INFO:tasks.cephfs.xfstests_dev:Command failed 2023-11-13T13:20:06.426 INFO:tasks.cephfs.xfstests_dev:Command return value: 1 2023-11-13T13:20:06.427 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/452) 2023-11-13T13:20:07.118 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T13:20:07.130 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T13:20:07.131 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T13:20:07.412 INFO:teuthology.orchestra.run.smithi102.stdout:generic/452 [not run] this test requires a valid $SCRATCH_DEV 2023-11-13T13:20:07.420 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/452 2023-11-13T13:20:07.421 INFO:teuthology.orchestra.run.smithi102.stdout:Not run: generic/452 2023-11-13T13:20:07.421 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T13:20:07.427 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T13:20:07.447 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T13:20:07.447 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/453) 2023-11-13T13:20:07.827 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T13:20:07.838 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T13:20:07.838 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T13:20:08.132 INFO:teuthology.orchestra.run.smithi102.stdout:generic/453 [not run] this test requires a valid $SCRATCH_DEV 2023-11-13T13:20:08.140 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/453 2023-11-13T13:20:08.141 INFO:teuthology.orchestra.run.smithi102.stdout:Not run: generic/453 2023-11-13T13:20:08.141 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T13:20:08.147 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T13:20:08.209 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T13:20:08.210 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/454) 2023-11-13T13:20:08.580 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T13:20:08.590 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T13:20:08.591 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T13:20:08.848 INFO:teuthology.orchestra.run.smithi102.stdout:generic/454 [not run] this test requires a valid $SCRATCH_DEV 2023-11-13T13:20:08.856 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/454 2023-11-13T13:20:08.856 INFO:teuthology.orchestra.run.smithi102.stdout:Not run: generic/454 2023-11-13T13:20:08.856 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T13:20:08.862 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T13:20:08.882 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T13:20:08.882 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/455) 2023-11-13T13:20:09.243 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T13:20:09.253 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T13:20:09.254 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T13:20:09.673 INFO:teuthology.orchestra.run.smithi102.stdout:generic/455 [not run] this test requires a valid $SCRATCH_DEV 2023-11-13T13:20:09.681 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/455 2023-11-13T13:20:09.681 INFO:teuthology.orchestra.run.smithi102.stdout:Not run: generic/455 2023-11-13T13:20:09.682 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T13:20:09.687 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T13:20:09.708 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T13:20:09.708 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/456) 2023-11-13T13:20:10.088 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T13:20:10.099 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T13:20:10.099 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T13:20:10.389 INFO:teuthology.orchestra.run.smithi102.stdout:generic/456 [not run] this test requires a valid $SCRATCH_DEV 2023-11-13T13:20:10.397 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/456 2023-11-13T13:20:10.397 INFO:teuthology.orchestra.run.smithi102.stdout:Not run: generic/456 2023-11-13T13:20:10.398 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T13:20:10.403 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T13:20:10.423 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T13:20:10.423 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/457) 2023-11-13T13:20:10.789 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T13:20:10.799 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T13:20:10.799 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T13:20:11.168 INFO:teuthology.orchestra.run.smithi102.stdout:generic/457 [not run] this test requires a valid $SCRATCH_DEV 2023-11-13T13:20:11.176 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/457 2023-11-13T13:20:11.176 INFO:teuthology.orchestra.run.smithi102.stdout:Not run: generic/457 2023-11-13T13:20:11.176 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T13:20:11.182 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T13:20:11.203 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T13:20:11.203 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/458) 2023-11-13T13:20:11.583 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T13:20:11.594 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T13:20:11.595 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T13:20:11.881 INFO:teuthology.orchestra.run.smithi102.stdout:generic/458 [not run] this test requires a valid $SCRATCH_DEV 2023-11-13T13:20:11.889 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/458 2023-11-13T13:20:11.890 INFO:teuthology.orchestra.run.smithi102.stdout:Not run: generic/458 2023-11-13T13:20:11.890 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T13:20:11.896 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T13:20:11.916 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T13:20:11.917 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/459) 2023-11-13T13:20:12.295 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T13:20:12.305 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T13:20:12.306 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T13:20:12.800 INFO:teuthology.orchestra.run.smithi102.stdout:generic/459 [not run] this test requires a valid $SCRATCH_DEV 2023-11-13T13:20:12.808 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/459 2023-11-13T13:20:12.808 INFO:teuthology.orchestra.run.smithi102.stdout:Not run: generic/459 2023-11-13T13:20:12.808 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T13:20:12.814 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T13:20:12.834 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T13:20:12.834 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/460) 2023-11-13T13:20:13.211 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T13:20:13.222 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T13:20:13.222 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T13:20:13.500 INFO:teuthology.orchestra.run.smithi102.stdout:generic/460 [not run] this test requires a valid $SCRATCH_DEV 2023-11-13T13:20:13.509 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/460 2023-11-13T13:20:13.509 INFO:teuthology.orchestra.run.smithi102.stdout:Not run: generic/460 2023-11-13T13:20:13.509 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T13:20:13.515 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T13:20:13.535 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T13:20:13.536 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/461) 2023-11-13T13:20:13.895 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T13:20:13.906 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T13:20:13.906 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T13:20:14.194 INFO:teuthology.orchestra.run.smithi102.stdout:generic/461 [not run] this test requires a valid $SCRATCH_DEV 2023-11-13T13:20:14.203 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/461 2023-11-13T13:20:14.203 INFO:teuthology.orchestra.run.smithi102.stdout:Not run: generic/461 2023-11-13T13:20:14.203 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T13:20:14.209 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T13:20:14.229 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T13:20:14.230 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/462) 2023-11-13T13:20:14.591 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T13:20:14.601 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T13:20:14.602 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T13:20:14.895 INFO:teuthology.orchestra.run.smithi102.stdout:generic/462 [not run] this test requires a valid $SCRATCH_DEV 2023-11-13T13:20:14.903 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/462 2023-11-13T13:20:14.903 INFO:teuthology.orchestra.run.smithi102.stdout:Not run: generic/462 2023-11-13T13:20:14.903 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T13:20:14.909 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T13:20:14.929 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T13:20:14.929 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/463) 2023-11-13T13:20:15.292 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T13:20:15.303 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T13:20:15.303 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T13:20:15.659 INFO:teuthology.orchestra.run.smithi102.stdout:generic/463 [not run] Reflink not supported by test filesystem type: ceph-fuse 2023-11-13T13:20:15.667 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/463 2023-11-13T13:20:15.667 INFO:teuthology.orchestra.run.smithi102.stdout:Not run: generic/463 2023-11-13T13:20:15.668 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T13:20:15.673 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T13:20:15.710 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T13:20:15.711 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/464) 2023-11-13T13:20:16.391 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T13:20:16.402 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T13:20:16.402 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T13:20:16.672 INFO:teuthology.orchestra.run.smithi102.stdout:generic/464 [not run] this test requires a valid $SCRATCH_DEV 2023-11-13T13:20:16.680 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/464 2023-11-13T13:20:16.680 INFO:teuthology.orchestra.run.smithi102.stdout:Not run: generic/464 2023-11-13T13:20:16.681 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T13:20:16.687 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T13:20:16.706 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T13:20:16.707 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/465) 2023-11-13T13:20:17.091 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T13:20:17.101 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T13:20:17.102 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T13:20:21.899 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T13:20:21.903 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T13:20:32.481 INFO:teuthology.orchestra.run.smithi102.stdout:generic/465 15s 2023-11-13T13:20:32.532 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/465 2023-11-13T13:20:32.533 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T13:20:32.583 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T13:20:32.675 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T13:20:32.676 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/466) 2023-11-13T13:20:33.120 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T13:20:33.130 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T13:20:33.131 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T13:20:33.424 INFO:teuthology.orchestra.run.smithi102.stdout:generic/466 [not run] this test requires a valid $SCRATCH_DEV 2023-11-13T13:20:33.432 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/466 2023-11-13T13:20:33.432 INFO:teuthology.orchestra.run.smithi102.stdout:Not run: generic/466 2023-11-13T13:20:33.432 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T13:20:33.438 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T13:20:33.459 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T13:20:33.460 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/467) 2023-11-13T13:20:33.843 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T13:20:33.853 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T13:20:33.854 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T13:20:41.378 INFO:teuthology.orchestra.run.smithi102.stdout:generic/467 - output mismatch (see /tmp/tmp.EnLPmcWJbzxfstests-dev/results//generic/467.out.bad) 2023-11-13T13:20:41.395 INFO:teuthology.orchestra.run.smithi102.stdout: --- tests/generic/467.out 2023-11-13 11:30:05.341484870 +0000 2023-11-13T13:20:41.395 INFO:teuthology.orchestra.run.smithi102.stdout: +++ /tmp/tmp.EnLPmcWJbzxfstests-dev/results//generic/467.out.bad 2023-11-13 13:20:41.361291705 +0000 2023-11-13T13:20:41.395 INFO:teuthology.orchestra.run.smithi102.stdout: @@ -1,5 +1,15 @@ 2023-11-13T13:20:41.396 INFO:teuthology.orchestra.run.smithi102.stdout: QA output created by 467 2023-11-13T13:20:41.396 INFO:teuthology.orchestra.run.smithi102.stdout: test_file_handles TEST_DIR/467-dir -dp 2023-11-13T13:20:41.396 INFO:teuthology.orchestra.run.smithi102.stdout: +open_by_handle(/tmp/tmp.T3Y73qtatntest/467-dir/file000000) opened an unlinked file! 2023-11-13T13:20:41.396 INFO:teuthology.orchestra.run.smithi102.stdout: +open_by_handle(/tmp/tmp.T3Y73qtatntest/467-dir/file000001) opened an unlinked file! 2023-11-13T13:20:41.396 INFO:teuthology.orchestra.run.smithi102.stdout: +open_by_handle(/tmp/tmp.T3Y73qtatntest/467-dir/file000002) opened an unlinked file! 2023-11-13T13:20:41.397 INFO:teuthology.orchestra.run.smithi102.stdout: +open_by_handle(/tmp/tmp.T3Y73qtatntest/467-dir/file000003) opened an unlinked file! 2023-11-13T13:20:41.397 INFO:teuthology.orchestra.run.smithi102.stdout: +open_by_handle(/tmp/tmp.T3Y73qtatntest/467-dir/file000004) opened an unlinked file! 2023-11-13T13:20:41.397 INFO:teuthology.orchestra.run.smithi102.stdout: +open_by_handle(/tmp/tmp.T3Y73qtatntest/467-dir/file000005) opened an unlinked file! 2023-11-13T13:20:41.397 INFO:teuthology.orchestra.run.smithi102.stdout: +open_by_handle(/tmp/tmp.T3Y73qtatntest/467-dir/file000006) opened an unlinked file! 2023-11-13T13:20:41.397 INFO:teuthology.orchestra.run.smithi102.stdout: +open_by_handle(/tmp/tmp.T3Y73qtatntest/467-dir/file000007) opened an unlinked file! 2023-11-13T13:20:41.398 INFO:teuthology.orchestra.run.smithi102.stdout: +open_by_handle(/tmp/tmp.T3Y73qtatntest/467-dir/file000008) opened an unlinked file! 2023-11-13T13:20:41.398 INFO:teuthology.orchestra.run.smithi102.stdout: +open_by_handle(/tmp/tmp.T3Y73qtatntest/467-dir/file000009) opened an unlinked file! 2023-11-13T13:20:41.398 INFO:teuthology.orchestra.run.smithi102.stdout: test_file_handles TEST_DIR/467-dir -rp 2023-11-13T13:20:41.398 INFO:teuthology.orchestra.run.smithi102.stdout: test_file_handles TEST_DIR/467-dir -dkr 2023-11-13T13:20:41.398 INFO:teuthology.orchestra.run.smithi102.stdout: test_file_handles TEST_DIR/467-dir -lr 2023-11-13T13:20:41.409 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/467 2023-11-13T13:20:41.409 INFO:teuthology.orchestra.run.smithi102.stdout:Failures: generic/467 2023-11-13T13:20:41.410 INFO:teuthology.orchestra.run.smithi102.stdout:Failed 1 of 1 tests 2023-11-13T13:20:41.431 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T13:20:41.543 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-13T13:20:41.544 INFO:tasks.cephfs.xfstests_dev:Command failed 2023-11-13T13:20:41.544 INFO:tasks.cephfs.xfstests_dev:Command return value: 1 2023-11-13T13:20:41.545 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/468) 2023-11-13T13:20:43.171 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T13:20:43.182 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T13:20:43.182 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T13:20:43.528 INFO:teuthology.orchestra.run.smithi102.stdout:generic/468 [not run] this test requires a valid $SCRATCH_DEV 2023-11-13T13:20:43.536 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/468 2023-11-13T13:20:43.536 INFO:teuthology.orchestra.run.smithi102.stdout:Not run: generic/468 2023-11-13T13:20:43.536 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T13:20:43.542 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T13:20:43.562 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T13:20:43.562 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/469) 2023-11-13T13:20:43.940 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T13:20:43.950 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T13:20:43.951 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T13:20:46.478 INFO:teuthology.orchestra.run.smithi102.stdout:generic/469 [not run] xfs_io fzero failed (old kernel/wrong fs?) 2023-11-13T13:20:46.486 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/469 2023-11-13T13:20:46.487 INFO:teuthology.orchestra.run.smithi102.stdout:Not run: generic/469 2023-11-13T13:20:46.487 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T13:20:46.492 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T13:20:46.519 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T13:20:46.520 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/470) 2023-11-13T13:20:47.216 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T13:20:47.226 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T13:20:47.227 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T13:20:47.573 INFO:teuthology.orchestra.run.smithi102.stdout:generic/470 [not run] this test requires a valid $SCRATCH_DEV 2023-11-13T13:20:47.581 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/470 2023-11-13T13:20:47.582 INFO:teuthology.orchestra.run.smithi102.stdout:Not run: generic/470 2023-11-13T13:20:47.582 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T13:20:47.588 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T13:20:47.608 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T13:20:47.609 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/471) 2023-11-13T13:20:47.979 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T13:20:47.990 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T13:20:47.990 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T13:20:52.029 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T13:20:52.033 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T13:21:22.217 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T13:21:22.221 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T13:21:51.580 INFO:teuthology.orchestra.run.smithi102.stdout:generic/471 63s 2023-11-13T13:21:51.593 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/471 2023-11-13T13:21:51.593 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T13:21:51.599 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T13:21:51.623 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T13:21:51.623 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/472) 2023-11-13T13:21:52.437 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T13:21:52.444 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T13:21:52.581 INFO:tasks.ceph.mds.a.smithi102.stderr:2023-11-13T13:21:52.575+0000 7fd988155640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 378738) UID: 0 2023-11-13T13:21:52.584 INFO:tasks.ceph.mds.c.smithi102.stderr:2023-11-13T13:21:52.583+0000 7fe15259f640 -1 Fail to open '/proc/378738/cmdline' error = (2) No such file or directory 2023-11-13T13:21:52.584 INFO:tasks.ceph.mds.c.smithi102.stderr:2023-11-13T13:21:52.583+0000 7fe15259f640 -1 received signal: Hangup from (PID: 378738) UID: 0 2023-11-13T13:21:53.080 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T13:21:53.110 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T13:21:53.111 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T13:21:53.645 INFO:teuthology.orchestra.run.smithi102.stdout:generic/472 [not run] this test requires a valid $SCRATCH_DEV 2023-11-13T13:21:53.653 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/472 2023-11-13T13:21:53.653 INFO:teuthology.orchestra.run.smithi102.stdout:Not run: generic/472 2023-11-13T13:21:53.653 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T13:21:53.659 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T13:21:53.680 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T13:21:53.681 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/473) 2023-11-13T13:21:54.067 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T13:21:54.078 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T13:21:54.078 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T13:21:54.472 INFO:teuthology.orchestra.run.smithi102.stdout:generic/473 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2023-11-13T13:21:54.481 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/473 2023-11-13T13:21:54.481 INFO:teuthology.orchestra.run.smithi102.stdout:Not run: generic/473 2023-11-13T13:21:54.481 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T13:21:54.488 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T13:21:54.510 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T13:21:54.511 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/474) 2023-11-13T13:21:54.891 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T13:21:54.902 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T13:21:54.902 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T13:21:55.240 INFO:teuthology.orchestra.run.smithi102.stdout:generic/474 [not run] this test requires a valid $SCRATCH_DEV 2023-11-13T13:21:55.250 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/474 2023-11-13T13:21:55.250 INFO:teuthology.orchestra.run.smithi102.stdout:Not run: generic/474 2023-11-13T13:21:55.250 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T13:21:55.257 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T13:21:55.280 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T13:21:55.281 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/475) 2023-11-13T13:21:55.682 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T13:21:55.693 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T13:21:55.694 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T13:21:56.027 INFO:teuthology.orchestra.run.smithi102.stdout:generic/475 [not run] this test requires a valid $SCRATCH_DEV 2023-11-13T13:21:56.035 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/475 2023-11-13T13:21:56.036 INFO:teuthology.orchestra.run.smithi102.stdout:Not run: generic/475 2023-11-13T13:21:56.036 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T13:21:56.042 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T13:21:56.063 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T13:21:56.064 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/476) 2023-11-13T13:21:56.446 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T13:21:56.458 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T13:21:56.458 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T13:21:56.762 INFO:teuthology.orchestra.run.smithi102.stdout:generic/476 [not run] this test requires a valid $SCRATCH_DEV 2023-11-13T13:21:56.770 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/476 2023-11-13T13:21:56.771 INFO:teuthology.orchestra.run.smithi102.stdout:Not run: generic/476 2023-11-13T13:21:56.771 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T13:21:56.777 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T13:21:56.797 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T13:21:56.797 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/477) 2023-11-13T13:21:57.208 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T13:21:57.219 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T13:21:57.219 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T13:22:17.955 INFO:teuthology.orchestra.run.smithi102.stdout:generic/477 20s 2023-11-13T13:22:18.247 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/477 2023-11-13T13:22:18.247 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T13:22:18.255 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T13:22:18.326 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T13:22:18.327 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/478) 2023-11-13T13:22:21.487 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T13:22:21.498 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T13:22:21.498 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T13:22:32.415 INFO:teuthology.orchestra.run.smithi102.stdout:generic/478 - output mismatch (see /tmp/tmp.EnLPmcWJbzxfstests-dev/results//generic/478.out.bad) 2023-11-13T13:22:32.421 INFO:teuthology.orchestra.run.smithi102.stdout: --- tests/generic/478.out 2023-11-13 11:30:05.341484870 +0000 2023-11-13T13:22:32.422 INFO:teuthology.orchestra.run.smithi102.stdout: +++ /tmp/tmp.EnLPmcWJbzxfstests-dev/results//generic/478.out.bad 2023-11-13 13:22:32.411234003 +0000 2023-11-13T13:22:32.422 INFO:teuthology.orchestra.run.smithi102.stdout: @@ -10,7 +10,7 @@ 2023-11-13T13:22:32.422 INFO:teuthology.orchestra.run.smithi102.stdout: lock could be placed 2023-11-13T13:22:32.422 INFO:teuthology.orchestra.run.smithi102.stdout: get wrlck 2023-11-13T13:22:32.422 INFO:teuthology.orchestra.run.smithi102.stdout: lock could be placed 2023-11-13T13:22:32.423 INFO:teuthology.orchestra.run.smithi102.stdout: -lock could be placed 2023-11-13T13:22:32.423 INFO:teuthology.orchestra.run.smithi102.stdout: +get wrlck 2023-11-13T13:22:32.423 INFO:teuthology.orchestra.run.smithi102.stdout: lock could be placed 2023-11-13T13:22:32.423 INFO:teuthology.orchestra.run.smithi102.stdout: lock could be placed 2023-11-13T13:22:32.423 INFO:teuthology.orchestra.run.smithi102.stdout: lock could be placed 2023-11-13T13:22:32.424 INFO:teuthology.orchestra.run.smithi102.stdout: @@ -24,8 +24,8 @@ 2023-11-13T13:22:32.424 INFO:teuthology.orchestra.run.smithi102.stdout: lock could be placed 2023-11-13T13:22:32.424 INFO:teuthology.orchestra.run.smithi102.stdout: lock could be placed 2023-11-13T13:22:32.424 INFO:teuthology.orchestra.run.smithi102.stdout: get wrlck 2023-11-13T13:22:32.424 INFO:teuthology.orchestra.run.smithi102.stdout: -lock could be placed 2023-11-13T13:22:32.425 INFO:teuthology.orchestra.run.smithi102.stdout: -lock could be placed 2023-11-13T13:22:32.425 INFO:teuthology.orchestra.run.smithi102.stdout: +get wrlck 2023-11-13T13:22:32.425 INFO:teuthology.orchestra.run.smithi102.stdout: +get wrlck 2023-11-13T13:22:32.425 INFO:teuthology.orchestra.run.smithi102.stdout: lock could be placed 2023-11-13T13:22:32.425 INFO:teuthology.orchestra.run.smithi102.stdout: lock could be placed 2023-11-13T13:22:32.425 INFO:teuthology.orchestra.run.smithi102.stdout: lock could be placed 2023-11-13T13:22:32.426 INFO:teuthology.orchestra.run.smithi102.stdout: @@ -37,7 +37,7 @@ 2023-11-13T13:22:32.426 INFO:teuthology.orchestra.run.smithi102.stdout: get rdlck 2023-11-13T13:22:32.426 INFO:teuthology.orchestra.run.smithi102.stdout: get rdlck 2023-11-13T13:22:32.426 INFO:teuthology.orchestra.run.smithi102.stdout: lock could be placed 2023-11-13T13:22:32.427 INFO:teuthology.orchestra.run.smithi102.stdout: -lock could be placed 2023-11-13T13:22:32.427 INFO:teuthology.orchestra.run.smithi102.stdout: +get rdlck 2023-11-13T13:22:32.427 INFO:teuthology.orchestra.run.smithi102.stdout: get rdlck 2023-11-13T13:22:32.427 INFO:teuthology.orchestra.run.smithi102.stdout: lock could be placed 2023-11-13T13:22:32.427 INFO:teuthology.orchestra.run.smithi102.stdout: get rdlck 2023-11-13T13:22:32.428 INFO:teuthology.orchestra.run.smithi102.stdout: @@ -46,7 +46,7 @@ 2023-11-13T13:22:32.428 INFO:teuthology.orchestra.run.smithi102.stdout: get rdlck 2023-11-13T13:22:32.428 INFO:teuthology.orchestra.run.smithi102.stdout: get rdlck 2023-11-13T13:22:32.428 INFO:teuthology.orchestra.run.smithi102.stdout: lock could be placed 2023-11-13T13:22:32.428 INFO:teuthology.orchestra.run.smithi102.stdout: -lock could be placed 2023-11-13T13:22:32.428 INFO:teuthology.orchestra.run.smithi102.stdout: +get rdlck 2023-11-13T13:22:32.429 INFO:teuthology.orchestra.run.smithi102.stdout: lock could be placed 2023-11-13T13:22:32.429 INFO:teuthology.orchestra.run.smithi102.stdout: lock could be placed 2023-11-13T13:22:32.429 INFO:teuthology.orchestra.run.smithi102.stdout: lock could be placed 2023-11-13T13:22:32.429 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/478 2023-11-13T13:22:32.430 INFO:teuthology.orchestra.run.smithi102.stdout:Failures: generic/478 2023-11-13T13:22:32.430 INFO:teuthology.orchestra.run.smithi102.stdout:Failed 1 of 1 tests 2023-11-13T13:22:32.433 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T13:22:32.454 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-13T13:22:32.455 INFO:tasks.cephfs.xfstests_dev:Command failed 2023-11-13T13:22:32.455 INFO:tasks.cephfs.xfstests_dev:Command return value: 1 2023-11-13T13:22:32.456 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/479) 2023-11-13T13:22:32.883 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T13:22:32.894 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T13:22:32.894 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T13:22:33.382 INFO:teuthology.orchestra.run.smithi102.stdout:generic/479 [not run] this test requires a valid $SCRATCH_DEV 2023-11-13T13:22:33.390 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/479 2023-11-13T13:22:33.390 INFO:teuthology.orchestra.run.smithi102.stdout:Not run: generic/479 2023-11-13T13:22:33.391 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T13:22:33.396 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T13:22:33.419 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T13:22:33.419 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/480) 2023-11-13T13:22:33.814 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T13:22:33.825 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T13:22:33.825 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T13:22:34.126 INFO:teuthology.orchestra.run.smithi102.stdout:generic/480 [not run] this test requires a valid $SCRATCH_DEV 2023-11-13T13:22:34.134 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/480 2023-11-13T13:22:34.134 INFO:teuthology.orchestra.run.smithi102.stdout:Not run: generic/480 2023-11-13T13:22:34.135 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T13:22:34.141 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T13:22:34.161 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T13:22:34.162 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/481) 2023-11-13T13:22:34.555 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T13:22:34.566 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T13:22:34.567 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T13:22:34.891 INFO:teuthology.orchestra.run.smithi102.stdout:generic/481 [not run] this test requires a valid $SCRATCH_DEV 2023-11-13T13:22:34.899 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/481 2023-11-13T13:22:34.899 INFO:teuthology.orchestra.run.smithi102.stdout:Not run: generic/481 2023-11-13T13:22:34.900 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T13:22:34.906 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T13:22:34.928 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T13:22:34.928 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/482) 2023-11-13T13:22:35.320 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T13:22:35.331 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T13:22:35.331 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T13:22:35.743 INFO:teuthology.orchestra.run.smithi102.stdout:generic/482 [not run] this test requires a valid $SCRATCH_DEV 2023-11-13T13:22:35.752 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/482 2023-11-13T13:22:35.752 INFO:teuthology.orchestra.run.smithi102.stdout:Not run: generic/482 2023-11-13T13:22:35.752 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T13:22:35.758 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T13:22:35.779 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T13:22:35.780 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/483) 2023-11-13T13:22:36.166 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T13:22:36.177 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T13:22:36.177 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T13:22:36.495 INFO:teuthology.orchestra.run.smithi102.stdout:generic/483 [not run] this test requires a valid $SCRATCH_DEV 2023-11-13T13:22:36.503 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/483 2023-11-13T13:22:36.503 INFO:teuthology.orchestra.run.smithi102.stdout:Not run: generic/483 2023-11-13T13:22:36.504 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T13:22:36.509 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T13:22:36.531 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T13:22:36.532 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/484) 2023-11-13T13:22:36.914 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T13:22:36.926 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T13:22:36.926 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T13:22:37.258 INFO:teuthology.orchestra.run.smithi102.stdout:generic/484 [not run] this test requires a valid $SCRATCH_DEV 2023-11-13T13:22:37.266 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/484 2023-11-13T13:22:37.267 INFO:teuthology.orchestra.run.smithi102.stdout:Not run: generic/484 2023-11-13T13:22:37.267 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T13:22:37.273 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T13:22:37.293 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T13:22:37.294 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/485) 2023-11-13T13:22:37.675 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T13:22:37.686 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T13:22:37.686 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T13:22:39.282 INFO:teuthology.orchestra.run.smithi102.stdout:generic/485 [not run] xfs_io finsert failed (old kernel/wrong fs?) 2023-11-13T13:22:39.290 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/485 2023-11-13T13:22:39.291 INFO:teuthology.orchestra.run.smithi102.stdout:Not run: generic/485 2023-11-13T13:22:39.291 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T13:22:39.297 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T13:22:39.514 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T13:22:39.515 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/486) 2023-11-13T13:22:40.091 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T13:22:40.102 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T13:22:40.103 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T13:22:40.434 INFO:teuthology.orchestra.run.smithi102.stdout:generic/486 [not run] this test requires a valid $SCRATCH_DEV 2023-11-13T13:22:40.442 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/486 2023-11-13T13:22:40.443 INFO:teuthology.orchestra.run.smithi102.stdout:Not run: generic/486 2023-11-13T13:22:40.443 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T13:22:40.449 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T13:22:40.471 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T13:22:40.471 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/487) 2023-11-13T13:22:40.872 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T13:22:40.883 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T13:22:40.883 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T13:22:41.207 INFO:teuthology.orchestra.run.smithi102.stdout:generic/487 [not run] this test requires a valid $SCRATCH_DEV 2023-11-13T13:22:41.215 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/487 2023-11-13T13:22:41.215 INFO:teuthology.orchestra.run.smithi102.stdout:Not run: generic/487 2023-11-13T13:22:41.216 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T13:22:41.222 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T13:22:41.246 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T13:22:41.246 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/488) 2023-11-13T13:22:41.658 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T13:22:41.669 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T13:22:41.669 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T13:22:41.954 INFO:teuthology.orchestra.run.smithi102.stdout:generic/488 [not run] this test requires a valid $SCRATCH_DEV 2023-11-13T13:22:41.962 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/488 2023-11-13T13:22:41.962 INFO:teuthology.orchestra.run.smithi102.stdout:Not run: generic/488 2023-11-13T13:22:41.962 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T13:22:41.968 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T13:22:41.987 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T13:22:41.988 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/489) 2023-11-13T13:22:42.371 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T13:22:42.381 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T13:22:42.381 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T13:22:42.687 INFO:teuthology.orchestra.run.smithi102.stdout:generic/489 [not run] this test requires a valid $SCRATCH_DEV 2023-11-13T13:22:42.695 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/489 2023-11-13T13:22:42.695 INFO:teuthology.orchestra.run.smithi102.stdout:Not run: generic/489 2023-11-13T13:22:42.696 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T13:22:42.702 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T13:22:42.722 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T13:22:42.722 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/490) 2023-11-13T13:22:43.109 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T13:22:43.120 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T13:22:43.120 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T13:22:44.559 INFO:teuthology.orchestra.run.smithi102.stdout:generic/490 1s 2023-11-13T13:22:44.571 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/490 2023-11-13T13:22:44.572 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T13:22:44.578 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T13:22:44.600 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T13:22:44.600 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/491) 2023-11-13T13:22:45.359 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T13:22:45.369 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T13:22:45.369 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T13:22:45.701 INFO:teuthology.orchestra.run.smithi102.stdout:generic/491 [not run] this test requires a valid $SCRATCH_DEV 2023-11-13T13:22:45.710 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/491 2023-11-13T13:22:45.710 INFO:teuthology.orchestra.run.smithi102.stdout:Not run: generic/491 2023-11-13T13:22:45.710 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T13:22:45.716 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T13:22:45.737 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T13:22:45.738 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/492) 2023-11-13T13:22:46.107 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T13:22:46.118 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T13:22:46.118 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T13:22:46.421 INFO:teuthology.orchestra.run.smithi102.stdout:generic/492 [not run] this test requires a valid $SCRATCH_DEV 2023-11-13T13:22:46.430 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/492 2023-11-13T13:22:46.430 INFO:teuthology.orchestra.run.smithi102.stdout:Not run: generic/492 2023-11-13T13:22:46.430 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T13:22:46.436 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T13:22:46.457 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T13:22:46.457 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/493) 2023-11-13T13:22:46.831 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T13:22:46.842 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T13:22:46.842 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T13:22:47.378 INFO:teuthology.orchestra.run.smithi102.stdout:generic/493 [not run] this test requires a valid $SCRATCH_DEV 2023-11-13T13:22:47.386 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/493 2023-11-13T13:22:47.386 INFO:teuthology.orchestra.run.smithi102.stdout:Not run: generic/493 2023-11-13T13:22:47.387 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T13:22:47.393 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T13:22:47.414 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T13:22:47.414 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/494) 2023-11-13T13:22:47.799 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T13:22:47.810 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T13:22:47.810 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T13:22:48.250 INFO:teuthology.orchestra.run.smithi102.stdout:generic/494 [not run] this test requires a valid $SCRATCH_DEV 2023-11-13T13:22:48.258 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/494 2023-11-13T13:22:48.259 INFO:teuthology.orchestra.run.smithi102.stdout:Not run: generic/494 2023-11-13T13:22:48.259 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T13:22:48.265 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T13:22:48.285 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T13:22:48.285 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/495) 2023-11-13T13:22:48.715 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T13:22:48.726 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T13:22:48.726 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T13:22:49.055 INFO:teuthology.orchestra.run.smithi102.stdout:generic/495 [not run] this test requires a valid $SCRATCH_DEV 2023-11-13T13:22:49.064 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/495 2023-11-13T13:22:49.064 INFO:teuthology.orchestra.run.smithi102.stdout:Not run: generic/495 2023-11-13T13:22:49.064 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T13:22:49.070 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T13:22:49.091 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T13:22:49.091 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/496) 2023-11-13T13:22:49.462 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T13:22:49.472 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T13:22:49.473 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T13:22:49.864 INFO:teuthology.orchestra.run.smithi102.stdout:generic/496 [not run] this test requires a valid $SCRATCH_DEV 2023-11-13T13:22:49.873 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/496 2023-11-13T13:22:49.873 INFO:teuthology.orchestra.run.smithi102.stdout:Not run: generic/496 2023-11-13T13:22:49.873 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T13:22:49.879 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T13:22:49.898 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T13:22:49.899 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/497) 2023-11-13T13:22:50.303 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T13:22:50.314 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T13:22:50.314 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T13:22:50.588 INFO:teuthology.orchestra.run.smithi102.stdout:generic/497 [not run] this test requires a valid $SCRATCH_DEV 2023-11-13T13:22:50.596 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/497 2023-11-13T13:22:50.596 INFO:teuthology.orchestra.run.smithi102.stdout:Not run: generic/497 2023-11-13T13:22:50.597 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T13:22:50.602 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T13:22:50.622 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T13:22:50.623 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/498) 2023-11-13T13:22:51.031 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T13:22:51.042 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T13:22:51.042 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T13:22:51.359 INFO:teuthology.orchestra.run.smithi102.stdout:generic/498 [not run] this test requires a valid $SCRATCH_DEV 2023-11-13T13:22:51.367 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/498 2023-11-13T13:22:51.368 INFO:teuthology.orchestra.run.smithi102.stdout:Not run: generic/498 2023-11-13T13:22:51.368 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T13:22:51.374 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T13:22:51.395 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T13:22:51.395 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/499) 2023-11-13T13:22:51.782 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T13:22:51.793 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T13:22:51.793 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T13:22:52.067 INFO:teuthology.orchestra.run.smithi102.stdout:generic/499 [not run] this test requires a valid $SCRATCH_DEV 2023-11-13T13:22:52.075 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/499 2023-11-13T13:22:52.075 INFO:teuthology.orchestra.run.smithi102.stdout:Not run: generic/499 2023-11-13T13:22:52.076 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T13:22:52.082 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T13:22:52.102 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T13:22:52.103 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/500) 2023-11-13T13:22:52.489 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T13:22:52.500 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T13:22:52.500 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T13:22:52.849 INFO:teuthology.orchestra.run.smithi102.stdout:generic/500 [not run] this test requires a valid $SCRATCH_DEV 2023-11-13T13:22:52.857 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/500 2023-11-13T13:22:52.857 INFO:teuthology.orchestra.run.smithi102.stdout:Not run: generic/500 2023-11-13T13:22:52.858 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T13:22:52.864 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T13:22:52.885 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T13:22:52.885 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/501) 2023-11-13T13:22:53.255 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T13:22:53.266 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T13:22:53.267 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T13:22:53.600 INFO:teuthology.orchestra.run.smithi102.stdout:generic/501 [not run] this test requires a valid $SCRATCH_DEV 2023-11-13T13:22:53.608 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/501 2023-11-13T13:22:53.608 INFO:teuthology.orchestra.run.smithi102.stdout:Not run: generic/501 2023-11-13T13:22:53.609 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T13:22:53.614 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T13:22:53.635 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T13:22:53.636 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/502) 2023-11-13T13:22:54.027 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T13:22:54.037 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T13:22:54.038 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T13:22:54.349 INFO:teuthology.orchestra.run.smithi102.stdout:generic/502 [not run] this test requires a valid $SCRATCH_DEV 2023-11-13T13:22:54.358 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/502 2023-11-13T13:22:54.358 INFO:teuthology.orchestra.run.smithi102.stdout:Not run: generic/502 2023-11-13T13:22:54.358 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T13:22:54.364 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T13:22:54.386 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T13:22:54.386 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/503) 2023-11-13T13:22:54.759 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T13:22:54.770 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T13:22:54.770 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T13:22:55.071 INFO:teuthology.orchestra.run.smithi102.stdout:generic/503 [not run] this test requires a valid $SCRATCH_DEV 2023-11-13T13:22:55.079 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/503 2023-11-13T13:22:55.079 INFO:teuthology.orchestra.run.smithi102.stdout:Not run: generic/503 2023-11-13T13:22:55.079 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T13:22:55.085 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T13:22:55.141 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T13:22:55.142 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/504) 2023-11-13T13:22:55.524 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T13:22:55.534 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T13:22:55.534 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T13:22:55.947 INFO:teuthology.orchestra.run.smithi102.stdout:generic/504 - output mismatch (see /tmp/tmp.EnLPmcWJbzxfstests-dev/results//generic/504.out.bad) 2023-11-13T13:22:55.953 INFO:teuthology.orchestra.run.smithi102.stdout: --- tests/generic/504.out 2023-11-13 11:30:05.345484787 +0000 2023-11-13T13:22:55.953 INFO:teuthology.orchestra.run.smithi102.stdout: +++ /tmp/tmp.EnLPmcWJbzxfstests-dev/results//generic/504.out.bad 2023-11-13 13:22:55.942799072 +0000 2023-11-13T13:22:55.953 INFO:teuthology.orchestra.run.smithi102.stdout: @@ -1,2 +1,3 @@ 2023-11-13T13:22:55.953 INFO:teuthology.orchestra.run.smithi102.stdout: QA output created by 504 2023-11-13T13:22:55.954 INFO:teuthology.orchestra.run.smithi102.stdout: +lock info not found 2023-11-13T13:22:55.954 INFO:teuthology.orchestra.run.smithi102.stdout: Silence is golden 2023-11-13T13:22:55.958 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/504 2023-11-13T13:22:55.959 INFO:teuthology.orchestra.run.smithi102.stdout:Failures: generic/504 2023-11-13T13:22:55.959 INFO:teuthology.orchestra.run.smithi102.stdout:Failed 1 of 1 tests 2023-11-13T13:22:55.965 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T13:22:55.985 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-13T13:22:55.985 INFO:tasks.cephfs.xfstests_dev:Command failed 2023-11-13T13:22:55.986 INFO:tasks.cephfs.xfstests_dev:Command return value: 1 2023-11-13T13:22:55.986 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/505) 2023-11-13T13:22:56.376 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T13:22:56.387 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T13:22:56.387 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T13:22:56.675 INFO:teuthology.orchestra.run.smithi102.stdout:generic/505 [not run] this test requires a valid $SCRATCH_DEV 2023-11-13T13:22:56.684 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/505 2023-11-13T13:22:56.684 INFO:teuthology.orchestra.run.smithi102.stdout:Not run: generic/505 2023-11-13T13:22:56.684 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T13:22:56.690 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T13:22:56.713 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T13:22:56.713 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/506) 2023-11-13T13:22:57.107 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T13:22:57.118 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T13:22:57.119 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T13:22:57.420 INFO:teuthology.orchestra.run.smithi102.stdout:generic/506 [not run] this test requires a valid $SCRATCH_DEV 2023-11-13T13:22:57.429 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/506 2023-11-13T13:22:57.429 INFO:teuthology.orchestra.run.smithi102.stdout:Not run: generic/506 2023-11-13T13:22:57.429 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T13:22:57.435 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T13:22:57.456 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T13:22:57.457 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/507) 2023-11-13T13:22:57.855 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T13:22:57.866 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T13:22:57.866 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T13:22:58.249 INFO:teuthology.orchestra.run.smithi102.stdout:generic/507 [not run] file system doesn't support chattr +ASai 2023-11-13T13:22:58.258 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/507 2023-11-13T13:22:58.258 INFO:teuthology.orchestra.run.smithi102.stdout:Not run: generic/507 2023-11-13T13:22:58.258 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T13:22:58.264 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T13:22:58.285 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T13:22:58.286 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/508) 2023-11-13T13:22:58.691 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T13:22:58.702 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T13:22:58.702 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T13:22:59.018 INFO:teuthology.orchestra.run.smithi102.stdout:generic/508 [not run] lsattr not supported by test filesystem type: ceph-fuse 2023-11-13T13:22:59.026 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/508 2023-11-13T13:22:59.027 INFO:teuthology.orchestra.run.smithi102.stdout:Not run: generic/508 2023-11-13T13:22:59.027 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T13:22:59.033 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T13:22:59.054 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T13:22:59.055 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/509) 2023-11-13T13:22:59.438 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T13:22:59.448 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T13:22:59.449 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T13:22:59.759 INFO:teuthology.orchestra.run.smithi102.stdout:generic/509 [not run] this test requires a valid $SCRATCH_DEV 2023-11-13T13:22:59.768 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/509 2023-11-13T13:22:59.768 INFO:teuthology.orchestra.run.smithi102.stdout:Not run: generic/509 2023-11-13T13:22:59.768 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T13:22:59.775 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T13:22:59.799 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T13:22:59.799 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/510) 2023-11-13T13:23:00.167 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T13:23:00.178 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T13:23:00.178 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T13:23:00.482 INFO:teuthology.orchestra.run.smithi102.stdout:generic/510 [not run] this test requires a valid $SCRATCH_DEV 2023-11-13T13:23:00.490 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/510 2023-11-13T13:23:00.491 INFO:teuthology.orchestra.run.smithi102.stdout:Not run: generic/510 2023-11-13T13:23:00.491 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T13:23:00.496 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T13:23:00.519 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T13:23:00.520 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/511) 2023-11-13T13:23:00.900 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T13:23:00.911 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T13:23:00.911 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T13:23:01.204 INFO:teuthology.orchestra.run.smithi102.stdout:generic/511 [not run] this test requires a valid $SCRATCH_DEV 2023-11-13T13:23:01.213 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/511 2023-11-13T13:23:01.213 INFO:teuthology.orchestra.run.smithi102.stdout:Not run: generic/511 2023-11-13T13:23:01.213 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T13:23:01.219 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T13:23:01.241 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T13:23:01.242 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/512) 2023-11-13T13:23:01.608 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T13:23:01.619 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T13:23:01.619 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T13:23:01.932 INFO:teuthology.orchestra.run.smithi102.stdout:generic/512 [not run] this test requires a valid $SCRATCH_DEV 2023-11-13T13:23:01.940 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/512 2023-11-13T13:23:01.940 INFO:teuthology.orchestra.run.smithi102.stdout:Not run: generic/512 2023-11-13T13:23:01.940 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T13:23:01.946 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T13:23:01.966 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T13:23:01.966 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/513) 2023-11-13T13:23:02.339 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T13:23:02.350 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T13:23:02.350 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T13:23:02.650 INFO:teuthology.orchestra.run.smithi102.stdout:generic/513 [not run] this test requires a valid $SCRATCH_DEV 2023-11-13T13:23:02.658 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/513 2023-11-13T13:23:02.658 INFO:teuthology.orchestra.run.smithi102.stdout:Not run: generic/513 2023-11-13T13:23:02.658 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T13:23:02.664 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T13:23:02.717 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T13:23:02.718 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/514) 2023-11-13T13:23:03.095 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T13:23:03.105 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T13:23:03.105 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T13:23:03.407 INFO:teuthology.orchestra.run.smithi102.stdout:generic/514 [not run] this test requires a valid $SCRATCH_DEV 2023-11-13T13:23:03.415 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/514 2023-11-13T13:23:03.416 INFO:teuthology.orchestra.run.smithi102.stdout:Not run: generic/514 2023-11-13T13:23:03.416 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T13:23:03.422 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T13:23:03.443 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T13:23:03.444 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/515) 2023-11-13T13:23:03.847 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T13:23:03.858 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T13:23:03.858 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T13:23:04.149 INFO:teuthology.orchestra.run.smithi102.stdout:generic/515 [not run] this test requires a valid $SCRATCH_DEV 2023-11-13T13:23:04.158 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/515 2023-11-13T13:23:04.158 INFO:teuthology.orchestra.run.smithi102.stdout:Not run: generic/515 2023-11-13T13:23:04.159 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T13:23:04.165 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T13:23:04.188 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T13:23:04.189 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/516) 2023-11-13T13:23:04.587 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T13:23:04.597 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T13:23:04.598 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T13:23:04.991 INFO:teuthology.orchestra.run.smithi102.stdout:generic/516 [not run] Dedupe not supported by test filesystem type: ceph-fuse 2023-11-13T13:23:04.999 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/516 2023-11-13T13:23:04.999 INFO:teuthology.orchestra.run.smithi102.stdout:Not run: generic/516 2023-11-13T13:23:05.000 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T13:23:05.006 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T13:23:05.035 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T13:23:05.036 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/517) 2023-11-13T13:23:05.774 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T13:23:05.785 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T13:23:05.785 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T13:23:06.082 INFO:teuthology.orchestra.run.smithi102.stdout:generic/517 [not run] this test requires a valid $SCRATCH_DEV 2023-11-13T13:23:06.091 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/517 2023-11-13T13:23:06.091 INFO:teuthology.orchestra.run.smithi102.stdout:Not run: generic/517 2023-11-13T13:23:06.091 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T13:23:06.098 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T13:23:06.157 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T13:23:06.160 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/518) 2023-11-13T13:23:06.542 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T13:23:06.553 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T13:23:06.553 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T13:23:06.829 INFO:teuthology.orchestra.run.smithi102.stdout:generic/518 [not run] this test requires a valid $SCRATCH_DEV 2023-11-13T13:23:06.838 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/518 2023-11-13T13:23:06.838 INFO:teuthology.orchestra.run.smithi102.stdout:Not run: generic/518 2023-11-13T13:23:06.839 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T13:23:06.844 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T13:23:06.865 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T13:23:06.866 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/519) 2023-11-13T13:23:07.266 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T13:23:07.277 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T13:23:07.278 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T13:23:07.566 INFO:teuthology.orchestra.run.smithi102.stdout:generic/519 [not run] this test requires a valid $SCRATCH_DEV 2023-11-13T13:23:07.575 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/519 2023-11-13T13:23:07.575 INFO:teuthology.orchestra.run.smithi102.stdout:Not run: generic/519 2023-11-13T13:23:07.575 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T13:23:07.581 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T13:23:07.601 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T13:23:07.602 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/520) 2023-11-13T13:23:08.002 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T13:23:08.013 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T13:23:08.013 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T13:23:08.336 INFO:teuthology.orchestra.run.smithi102.stdout:generic/520 [not run] this test requires a valid $SCRATCH_DEV 2023-11-13T13:23:08.344 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/520 2023-11-13T13:23:08.345 INFO:teuthology.orchestra.run.smithi102.stdout:Not run: generic/520 2023-11-13T13:23:08.345 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T13:23:08.351 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T13:23:08.373 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T13:23:08.373 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/521) 2023-11-13T13:23:08.752 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T13:23:08.763 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T13:23:08.763 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T13:25:11.251 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T13:25:11.256 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T13:25:41.384 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T13:25:41.389 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T13:26:11.505 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T13:26:11.511 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T13:26:41.661 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T13:26:41.665 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T13:27:11.718 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T13:27:11.722 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T13:27:41.868 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T13:27:41.872 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T13:28:11.992 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T13:28:11.996 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T13:28:42.105 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T13:28:42.111 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T13:29:12.235 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T13:29:12.239 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T13:29:42.315 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T13:29:42.320 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T13:30:12.462 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T13:30:12.467 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T13:30:42.524 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T13:30:42.530 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T13:31:13.233 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T13:31:13.239 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T13:31:43.293 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T13:31:43.298 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T13:32:13.431 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T13:32:13.435 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T13:32:43.504 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T13:32:43.508 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T13:33:13.611 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T13:33:13.616 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T13:33:43.736 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T13:33:43.740 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T13:34:13.833 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T13:34:13.837 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T13:34:43.971 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T13:34:43.974 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T13:35:14.093 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T13:35:14.098 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T13:35:44.371 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T13:35:44.376 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T13:36:14.462 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T13:36:14.467 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T13:36:44.575 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T13:36:44.581 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T13:37:14.713 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T13:37:14.719 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T13:37:44.843 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T13:37:44.847 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T13:38:15.932 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T13:38:15.939 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T13:38:47.564 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T13:38:47.568 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T13:39:17.623 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T13:39:17.628 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T13:39:47.861 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T13:39:47.866 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T13:39:47.897 INFO:tasks.ceph.osd.5.smithi154.stderr:2023-11-13T13:39:47.892+0000 7f77ec91b640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 44777) UID: 0 2023-11-13T13:39:47.898 INFO:tasks.ceph.osd.4.smithi154.stderr:2023-11-13T13:39:47.892+0000 7fce06bbb640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 44777) UID: 0 2023-11-13T13:39:47.899 INFO:tasks.ceph.osd.6.smithi154.stderr:2023-11-13T13:39:47.892+0000 7f3c803e2640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 44777) UID: 0 2023-11-13T13:39:47.899 INFO:tasks.ceph.osd.7.smithi154.stderr:2023-11-13T13:39:47.896+0000 7f10baf5d640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 44777) UID: 0 2023-11-13T13:42:12.018 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T13:42:12.023 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T13:42:42.150 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T13:42:42.155 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T13:43:12.307 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T13:43:12.311 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T13:43:42.406 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T13:43:42.411 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T13:44:12.504 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T13:44:12.508 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T13:44:43.053 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T13:44:43.056 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T13:45:13.143 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T13:45:13.149 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T13:45:43.318 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T13:45:43.322 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T13:46:13.374 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T13:46:13.380 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T13:46:43.486 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T13:46:43.491 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T13:47:13.649 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T13:47:13.655 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T13:47:43.704 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T13:47:43.708 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T13:48:13.861 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T13:48:13.866 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T13:48:44.031 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T13:48:44.036 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T13:49:14.144 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T13:49:14.149 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T13:49:44.282 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T13:49:44.287 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T13:50:14.371 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T13:50:14.375 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T13:50:44.500 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T13:50:44.504 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T13:51:14.605 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T13:51:14.610 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T13:51:44.752 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T13:51:44.757 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T13:52:14.911 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T13:52:14.915 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T13:52:45.010 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T13:52:45.015 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T13:53:15.092 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T13:53:15.098 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T13:53:45.188 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T13:53:45.193 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T13:54:15.310 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T13:54:15.316 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T13:54:45.371 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T13:54:45.376 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T13:55:15.478 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T13:55:15.482 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T13:55:45.625 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T13:55:45.629 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T13:56:16.654 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T13:56:16.658 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T13:56:46.716 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T13:56:46.723 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T13:57:16.876 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T13:57:16.880 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T13:57:16.908 INFO:tasks.ceph.osd.3.smithi102.stderr:2023-11-13T13:57:16.904+0000 7f48d17a6640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 400606) UID: 0 2023-11-13T13:57:16.908 INFO:tasks.ceph.osd.1.smithi102.stderr:2023-11-13T13:57:16.904+0000 7f33d1116640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 400606) UID: 0 2023-11-13T13:57:16.909 INFO:tasks.ceph.osd.0.smithi102.stderr:2023-11-13T13:57:16.904+0000 7efed7bed640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 400606) UID: 0 2023-11-13T13:57:16.909 INFO:tasks.ceph.osd.2.smithi102.stderr:2023-11-13T13:57:16.904+0000 7f17fbe34640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 400606) UID: 0 2023-11-13T13:59:40.813 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T13:59:40.819 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T14:00:10.952 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T14:00:10.957 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T14:00:41.015 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T14:00:41.020 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T14:01:11.137 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T14:01:11.143 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T14:01:41.206 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T14:01:41.211 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T14:02:11.339 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T14:02:11.345 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T14:02:11.373 INFO:tasks.ceph.osd.0.smithi102.stderr:2023-11-13T14:02:11.371+0000 7efed7bed640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 400631) UID: 0 2023-11-13T14:02:11.374 INFO:tasks.ceph.osd.3.smithi102.stderr:2023-11-13T14:02:11.371+0000 7f48d17a6640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 400631) UID: 0 2023-11-13T14:02:11.374 INFO:tasks.ceph.osd.2.smithi102.stderr:2023-11-13T14:02:11.371+0000 7f17fbe34640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 400631) UID: 0 2023-11-13T14:02:11.472 INFO:tasks.ceph.osd.1.smithi102.stderr:2023-11-13T14:02:11.371+0000 7f33d1116640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 400631) UID: 0 2023-11-13T14:04:50.864 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T14:04:50.868 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T14:05:21.152 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T14:05:21.157 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T14:05:51.210 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T14:05:51.214 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T14:06:21.334 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T14:06:21.339 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T14:06:51.396 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T14:06:51.400 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T14:07:21.534 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T14:07:21.539 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T14:07:51.614 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T14:07:51.619 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T14:08:21.711 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T14:08:21.716 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T14:08:51.770 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T14:08:51.777 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T14:09:21.905 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T14:09:21.910 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T14:09:52.143 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T14:09:52.147 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T14:10:22.273 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T14:10:22.278 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T14:10:52.395 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T14:10:52.400 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T14:11:22.508 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T14:11:22.514 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T14:11:52.655 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T14:11:52.659 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T14:12:23.660 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T14:12:23.665 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T14:12:53.740 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T14:12:53.744 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T14:13:23.878 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T14:13:23.882 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T14:13:53.974 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T14:13:53.978 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T14:14:24.030 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T14:14:24.034 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T14:14:54.172 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T14:14:54.178 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T14:15:24.311 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T14:15:24.317 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T14:15:54.436 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T14:15:54.441 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T14:16:03.713 INFO:teuthology.orchestra.run.smithi102.stdout:generic/521 3175s 2023-11-13T14:16:03.778 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/521 2023-11-13T14:16:03.779 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T14:16:03.785 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T14:16:03.847 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T14:16:03.848 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/522) 2023-11-13T14:16:04.814 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T14:16:04.825 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T14:16:04.825 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T14:16:24.558 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T14:16:24.564 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T14:16:54.613 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T14:16:54.618 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T14:17:24.751 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T14:17:24.756 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T14:17:54.824 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T14:17:54.829 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T14:18:24.938 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T14:18:24.942 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T14:18:55.074 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T14:18:55.079 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T14:19:25.180 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T14:19:25.185 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T14:19:55.301 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T14:19:55.305 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T14:20:25.350 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T14:20:25.355 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T14:20:55.549 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T14:20:55.555 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T14:21:26.023 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T14:21:26.028 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T14:21:56.137 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T14:21:56.141 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T14:22:26.203 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T14:22:26.209 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T14:22:56.447 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T14:22:56.453 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T14:23:26.508 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T14:23:26.512 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T14:23:56.632 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T14:23:56.639 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T14:24:26.701 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T14:24:26.719 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T14:24:56.793 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T14:24:56.799 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T14:25:26.897 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T14:25:26.901 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T14:25:57.036 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T14:25:57.041 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T14:26:27.092 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T14:26:27.096 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T14:26:57.203 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T14:26:57.207 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T14:27:27.318 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T14:27:27.322 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T14:27:57.389 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T14:27:57.393 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T14:28:27.512 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T14:28:27.516 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T14:28:57.577 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T14:28:57.582 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T14:29:27.662 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T14:29:27.667 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T14:29:58.567 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T14:29:58.572 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T14:30:28.629 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T14:30:28.633 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T14:30:58.935 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T14:30:58.940 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T14:31:29.112 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T14:31:29.117 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T14:31:59.235 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T14:31:59.239 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T14:32:29.333 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T14:32:29.338 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T14:32:59.497 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T14:32:59.501 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T14:33:29.551 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T14:33:29.555 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T14:33:59.691 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T14:33:59.695 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T14:34:29.746 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T14:34:29.751 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T14:34:29.847 INFO:tasks.ceph.mds.c.smithi102.stderr:2023-11-13T14:34:29.844+0000 7fe15259f640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 401261) UID: 0 2023-11-13T14:34:29.847 INFO:tasks.ceph.mds.a.smithi102.stderr:2023-11-13T14:34:29.844+0000 7fd988155640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 401261) UID: 0 2023-11-13T14:37:18.821 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T14:37:18.827 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T14:37:48.939 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T14:37:48.945 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T14:38:19.088 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T14:38:19.093 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T14:38:49.199 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T14:38:49.204 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T14:39:19.262 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T14:39:19.268 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T14:39:49.376 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T14:39:49.382 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T14:40:19.529 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T14:40:19.533 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T14:40:49.760 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T14:40:49.765 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T14:41:19.892 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T14:41:19.897 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T14:41:50.021 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T14:41:50.028 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T14:42:20.142 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T14:42:20.147 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T14:42:50.256 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T14:42:50.261 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T14:43:20.327 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T14:43:20.332 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T14:43:20.361 INFO:tasks.ceph.osd.4.smithi154.stderr:2023-11-13T14:43:20.355+0000 7fce06bbb640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 45136) UID: 0 2023-11-13T14:43:20.361 INFO:tasks.ceph.osd.5.smithi154.stderr:2023-11-13T14:43:20.355+0000 7f77ec91b640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 45136) UID: 0 2023-11-13T14:43:20.362 INFO:tasks.ceph.osd.6.smithi154.stderr:2023-11-13T14:43:20.355+0000 7f3c803e2640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 45136) UID: 0 2023-11-13T14:43:20.362 INFO:tasks.ceph.osd.7.smithi154.stderr:2023-11-13T14:43:20.355+0000 7f10baf5d640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 45136) UID: 0 2023-11-13T14:45:29.485 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T14:45:29.490 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T14:45:59.880 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T14:45:59.885 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T14:46:29.936 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T14:46:29.941 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T14:47:00.048 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T14:47:00.052 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T14:47:30.186 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T14:47:30.192 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T14:48:00.309 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T14:48:00.315 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T14:48:30.455 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T14:48:30.460 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T14:49:00.560 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T14:49:00.565 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T14:49:30.707 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T14:49:30.713 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T14:50:00.771 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T14:50:00.776 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T14:50:30.909 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T14:50:30.915 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T14:51:01.057 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T14:51:01.061 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T14:51:31.181 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T14:51:31.186 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T14:52:01.262 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T14:52:01.266 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T14:52:02.800 INFO:teuthology.orchestra.run.smithi102.stdout:generic/522 2158s 2023-11-13T14:52:02.813 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/522 2023-11-13T14:52:02.813 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T14:52:02.819 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T14:52:02.871 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T14:52:02.872 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/523) 2023-11-13T14:52:03.236 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T14:52:03.246 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T14:52:03.247 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T14:52:03.538 INFO:teuthology.orchestra.run.smithi102.stdout:generic/523 [not run] this test requires a valid $SCRATCH_DEV 2023-11-13T14:52:03.547 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/523 2023-11-13T14:52:03.547 INFO:teuthology.orchestra.run.smithi102.stdout:Not run: generic/523 2023-11-13T14:52:03.547 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T14:52:03.552 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T14:52:03.571 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T14:52:03.572 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/524) 2023-11-13T14:52:03.936 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T14:52:03.947 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T14:52:03.947 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T14:52:04.212 INFO:teuthology.orchestra.run.smithi102.stdout:generic/524 [not run] this test requires a valid $SCRATCH_DEV 2023-11-13T14:52:04.221 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/524 2023-11-13T14:52:04.221 INFO:teuthology.orchestra.run.smithi102.stdout:Not run: generic/524 2023-11-13T14:52:04.221 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T14:52:04.227 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T14:52:04.246 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T14:52:04.246 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/525) 2023-11-13T14:52:04.612 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T14:52:04.623 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T14:52:04.623 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T14:52:04.897 INFO:teuthology.orchestra.run.smithi102.stdout:generic/525 [not run] this test requires a valid $SCRATCH_DEV 2023-11-13T14:52:04.905 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/525 2023-11-13T14:52:04.905 INFO:teuthology.orchestra.run.smithi102.stdout:Not run: generic/525 2023-11-13T14:52:04.906 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T14:52:04.912 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T14:52:04.930 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T14:52:04.931 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/526) 2023-11-13T14:52:05.324 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T14:52:05.335 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T14:52:05.335 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T14:52:05.685 INFO:teuthology.orchestra.run.smithi102.stdout:generic/526 [not run] this test requires a valid $SCRATCH_DEV 2023-11-13T14:52:05.693 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/526 2023-11-13T14:52:05.693 INFO:teuthology.orchestra.run.smithi102.stdout:Not run: generic/526 2023-11-13T14:52:05.693 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T14:52:05.699 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T14:52:05.718 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T14:52:05.718 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/527) 2023-11-13T14:52:06.084 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T14:52:06.094 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T14:52:06.095 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T14:52:06.408 INFO:teuthology.orchestra.run.smithi102.stdout:generic/527 [not run] this test requires a valid $SCRATCH_DEV 2023-11-13T14:52:06.416 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/527 2023-11-13T14:52:06.416 INFO:teuthology.orchestra.run.smithi102.stdout:Not run: generic/527 2023-11-13T14:52:06.417 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T14:52:06.422 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T14:52:06.442 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T14:52:06.443 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/528) 2023-11-13T14:52:06.836 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T14:52:06.847 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T14:52:06.847 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T14:52:07.194 INFO:teuthology.orchestra.run.smithi102.stdout:generic/528 [not run] inode creation time not supported by this filesystem 2023-11-13T14:52:07.202 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/528 2023-11-13T14:52:07.202 INFO:teuthology.orchestra.run.smithi102.stdout:Not run: generic/528 2023-11-13T14:52:07.202 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T14:52:07.208 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T14:52:07.227 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T14:52:07.227 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/529) 2023-11-13T14:52:07.604 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T14:52:07.614 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T14:52:07.615 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T14:52:07.917 INFO:teuthology.orchestra.run.smithi102.stdout:generic/529 [not run] ACLs not supported by this filesystem type: ceph-fuse 2023-11-13T14:52:07.925 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/529 2023-11-13T14:52:07.926 INFO:teuthology.orchestra.run.smithi102.stdout:Not run: generic/529 2023-11-13T14:52:07.926 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T14:52:07.932 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T14:52:07.952 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T14:52:07.953 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/530) 2023-11-13T14:52:08.336 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T14:52:08.347 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T14:52:08.347 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T14:52:08.634 INFO:teuthology.orchestra.run.smithi102.stdout:generic/530 [not run] this test requires a valid $SCRATCH_DEV 2023-11-13T14:52:08.642 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/530 2023-11-13T14:52:08.643 INFO:teuthology.orchestra.run.smithi102.stdout:Not run: generic/530 2023-11-13T14:52:08.643 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T14:52:08.649 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T14:52:08.727 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T14:52:08.728 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/531) 2023-11-13T14:52:09.100 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T14:52:09.111 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T14:52:09.111 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T14:52:09.387 INFO:teuthology.orchestra.run.smithi102.stdout:generic/531 [not run] this test requires a valid $SCRATCH_DEV 2023-11-13T14:52:09.396 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/531 2023-11-13T14:52:09.396 INFO:teuthology.orchestra.run.smithi102.stdout:Not run: generic/531 2023-11-13T14:52:09.396 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T14:52:09.402 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T14:52:09.421 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T14:52:09.421 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/532) 2023-11-13T14:52:09.784 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T14:52:09.795 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T14:52:09.795 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T14:52:10.147 INFO:teuthology.orchestra.run.smithi102.stdout:generic/532 1s 2023-11-13T14:52:10.160 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/532 2023-11-13T14:52:10.160 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T14:52:10.167 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T14:52:10.186 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T14:52:10.187 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/533) 2023-11-13T14:52:10.543 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T14:52:10.553 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T14:52:10.554 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T14:52:11.233 INFO:teuthology.orchestra.run.smithi102.stdout:generic/533 1s 2023-11-13T14:52:11.246 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/533 2023-11-13T14:52:11.246 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T14:52:11.252 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T14:52:11.271 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T14:52:11.272 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/534) 2023-11-13T14:52:11.637 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T14:52:11.647 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T14:52:11.647 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T14:52:11.951 INFO:teuthology.orchestra.run.smithi102.stdout:generic/534 [not run] this test requires a valid $SCRATCH_DEV 2023-11-13T14:52:11.959 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/534 2023-11-13T14:52:11.959 INFO:teuthology.orchestra.run.smithi102.stdout:Not run: generic/534 2023-11-13T14:52:11.959 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T14:52:11.965 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T14:52:11.985 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T14:52:11.986 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/535) 2023-11-13T14:52:12.357 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T14:52:12.369 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T14:52:12.369 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T14:52:12.773 INFO:teuthology.orchestra.run.smithi102.stdout:generic/535 [not run] this test requires a valid $SCRATCH_DEV 2023-11-13T14:52:12.781 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/535 2023-11-13T14:52:12.781 INFO:teuthology.orchestra.run.smithi102.stdout:Not run: generic/535 2023-11-13T14:52:12.781 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T14:52:12.787 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T14:52:12.807 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T14:52:12.807 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/536) 2023-11-13T14:52:13.193 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T14:52:13.203 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T14:52:13.203 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T14:52:13.490 INFO:teuthology.orchestra.run.smithi102.stdout:generic/536 [not run] this test requires a valid $SCRATCH_DEV 2023-11-13T14:52:13.498 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/536 2023-11-13T14:52:13.499 INFO:teuthology.orchestra.run.smithi102.stdout:Not run: generic/536 2023-11-13T14:52:13.499 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T14:52:13.504 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T14:52:13.523 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T14:52:13.524 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/537) 2023-11-13T14:52:13.900 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T14:52:13.911 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T14:52:13.911 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T14:52:14.185 INFO:teuthology.orchestra.run.smithi102.stdout:generic/537 [not run] this test requires a valid $SCRATCH_DEV 2023-11-13T14:52:14.194 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/537 2023-11-13T14:52:14.194 INFO:teuthology.orchestra.run.smithi102.stdout:Not run: generic/537 2023-11-13T14:52:14.194 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T14:52:14.200 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T14:52:14.219 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T14:52:14.220 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/538) 2023-11-13T14:52:14.598 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T14:52:14.608 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T14:52:14.608 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T14:52:31.379 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T14:52:31.384 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T14:53:01.501 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T14:53:01.506 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T14:53:31.581 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T14:53:31.591 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T14:54:01.643 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T14:54:01.647 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T14:54:31.700 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T14:54:31.704 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T14:55:01.833 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T14:55:01.837 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T14:55:31.957 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T14:55:31.962 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T14:56:02.091 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T14:56:02.095 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T14:56:32.179 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T14:56:32.183 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T14:57:02.295 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T14:57:02.300 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T14:57:32.423 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T14:57:32.427 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T14:58:02.569 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T14:58:02.573 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T14:58:32.649 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T14:58:32.653 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T14:59:02.704 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T14:59:02.709 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T14:59:32.780 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T14:59:32.784 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T15:00:02.903 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T15:00:02.908 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T15:00:33.011 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T15:00:33.016 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T15:01:03.385 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T15:01:03.390 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T15:01:33.464 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T15:01:33.470 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T15:02:03.586 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T15:02:03.590 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T15:02:33.690 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T15:02:33.695 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T15:03:03.813 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T15:03:03.817 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T15:03:34.548 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T15:03:34.552 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T15:04:04.618 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T15:04:04.623 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T15:04:34.745 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T15:04:34.750 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T15:05:04.891 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T15:05:04.896 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T15:05:35.030 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T15:05:35.035 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T15:06:05.104 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T15:06:05.109 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T15:06:35.158 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T15:06:35.163 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T15:07:05.281 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T15:07:05.286 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T15:07:35.394 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T15:07:35.399 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T15:08:05.449 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T15:08:05.454 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T15:08:35.613 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T15:08:35.619 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T15:09:05.735 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T15:09:05.740 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T15:09:35.890 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T15:09:35.895 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T15:10:06.020 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T15:10:06.025 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T15:10:36.175 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T15:10:36.181 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T15:11:06.249 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T15:11:06.254 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T15:11:36.369 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T15:11:36.374 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T15:12:06.649 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T15:12:06.654 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T15:12:36.798 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T15:12:36.803 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T15:13:06.935 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T15:13:06.939 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T15:13:37.224 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T15:13:37.227 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T15:14:07.328 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T15:14:07.333 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T15:14:37.442 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T15:14:37.447 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T15:15:07.564 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T15:15:07.569 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T15:15:37.637 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T15:15:37.641 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T15:16:07.757 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T15:16:07.762 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T15:16:37.889 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T15:16:37.896 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T15:17:08.019 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T15:17:08.025 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T15:17:38.380 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T15:17:38.385 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T15:18:08.437 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T15:18:08.441 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T15:18:38.510 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T15:18:38.514 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T15:19:08.657 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T15:19:08.661 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T15:19:38.787 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T15:19:38.792 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T15:20:09.073 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T15:20:09.078 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T15:20:39.129 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T15:20:39.133 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T15:21:09.279 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T15:21:09.284 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T15:21:39.408 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T15:21:39.412 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T15:22:09.538 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T15:22:09.544 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T15:22:39.601 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T15:22:39.606 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T15:23:09.740 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T15:23:09.745 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T15:23:39.855 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T15:23:39.860 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T15:24:09.959 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T15:24:09.963 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T15:24:40.048 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T15:24:40.054 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T15:25:10.178 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T15:25:10.183 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T15:25:40.301 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T15:25:40.305 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T15:26:10.431 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T15:26:10.436 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T15:26:40.561 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T15:26:40.566 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T15:27:10.693 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T15:27:10.700 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T15:27:40.763 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T15:27:40.767 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T15:28:11.152 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T15:28:11.159 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T15:28:41.490 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T15:28:41.495 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T15:29:11.544 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T15:29:11.549 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T15:29:41.667 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T15:29:41.672 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T15:30:11.846 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T15:30:11.850 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T15:30:41.903 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T15:30:41.909 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T15:31:12.033 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T15:31:12.038 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T15:31:42.171 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T15:31:42.176 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T15:32:12.284 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T15:32:12.291 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T15:32:42.389 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T15:32:42.394 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T15:33:12.465 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T15:33:12.470 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T15:33:42.826 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T15:33:42.831 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T15:34:12.887 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T15:34:12.892 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T15:34:43.037 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T15:34:43.043 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T15:35:13.191 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T15:35:13.196 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T15:35:43.255 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T15:35:43.260 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T15:36:13.560 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T15:36:13.565 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T15:36:37.673 INFO:teuthology.orchestra.run.smithi102.stdout:generic/538 2663s 2023-11-13T15:36:37.696 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/538 2023-11-13T15:36:37.697 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T15:36:37.703 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T15:36:37.739 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T15:36:37.740 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/539) 2023-11-13T15:36:38.448 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T15:36:38.459 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T15:36:38.459 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T15:36:40.917 INFO:teuthology.orchestra.run.smithi102.stdout:generic/539 2s 2023-11-13T15:36:40.930 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/539 2023-11-13T15:36:40.930 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T15:36:40.936 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T15:36:40.956 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T15:36:40.958 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/540) 2023-11-13T15:36:41.669 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T15:36:41.679 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T15:36:41.679 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T15:36:41.976 INFO:teuthology.orchestra.run.smithi102.stdout:generic/540 [not run] this test requires a valid $SCRATCH_DEV 2023-11-13T15:36:41.984 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/540 2023-11-13T15:36:41.985 INFO:teuthology.orchestra.run.smithi102.stdout:Not run: generic/540 2023-11-13T15:36:41.985 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T15:36:41.990 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T15:36:42.009 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T15:36:42.010 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/541) 2023-11-13T15:36:42.364 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T15:36:42.374 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T15:36:42.374 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T15:36:42.656 INFO:teuthology.orchestra.run.smithi102.stdout:generic/541 [not run] this test requires a valid $SCRATCH_DEV 2023-11-13T15:36:42.664 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/541 2023-11-13T15:36:42.664 INFO:teuthology.orchestra.run.smithi102.stdout:Not run: generic/541 2023-11-13T15:36:42.664 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T15:36:42.670 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T15:36:42.690 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T15:36:42.690 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/542) 2023-11-13T15:36:43.078 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T15:36:43.089 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T15:36:43.089 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T15:36:43.364 INFO:teuthology.orchestra.run.smithi102.stdout:generic/542 [not run] this test requires a valid $SCRATCH_DEV 2023-11-13T15:36:43.372 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/542 2023-11-13T15:36:43.373 INFO:teuthology.orchestra.run.smithi102.stdout:Not run: generic/542 2023-11-13T15:36:43.373 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T15:36:43.379 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T15:36:43.397 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T15:36:43.398 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/543) 2023-11-13T15:36:43.690 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T15:36:43.695 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T15:36:43.776 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T15:36:43.787 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T15:36:43.787 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T15:36:44.065 INFO:teuthology.orchestra.run.smithi102.stdout:generic/543 [not run] this test requires a valid $SCRATCH_DEV 2023-11-13T15:36:44.073 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/543 2023-11-13T15:36:44.073 INFO:teuthology.orchestra.run.smithi102.stdout:Not run: generic/543 2023-11-13T15:36:44.073 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T15:36:44.079 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T15:36:44.099 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T15:36:44.099 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/544) 2023-11-13T15:36:44.529 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T15:36:44.539 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T15:36:44.539 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T15:36:44.817 INFO:teuthology.orchestra.run.smithi102.stdout:generic/544 [not run] this test requires a valid $SCRATCH_DEV 2023-11-13T15:36:44.825 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/544 2023-11-13T15:36:44.826 INFO:teuthology.orchestra.run.smithi102.stdout:Not run: generic/544 2023-11-13T15:36:44.826 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T15:36:44.832 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T15:36:44.852 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T15:36:44.852 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/545) 2023-11-13T15:36:45.233 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T15:36:45.243 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T15:36:45.243 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T15:36:45.629 INFO:teuthology.orchestra.run.smithi102.stdout:generic/545 [not run] file system doesn't support chattr +i 2023-11-13T15:36:45.637 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/545 2023-11-13T15:36:45.637 INFO:teuthology.orchestra.run.smithi102.stdout:Not run: generic/545 2023-11-13T15:36:45.637 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T15:36:45.643 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T15:36:45.665 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T15:36:45.666 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/546) 2023-11-13T15:36:46.021 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T15:36:46.031 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T15:36:46.032 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T15:36:46.400 INFO:teuthology.orchestra.run.smithi102.stdout:generic/546 [not run] this test requires a valid $SCRATCH_DEV 2023-11-13T15:36:46.408 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/546 2023-11-13T15:36:46.408 INFO:teuthology.orchestra.run.smithi102.stdout:Not run: generic/546 2023-11-13T15:36:46.409 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T15:36:46.414 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T15:36:46.436 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T15:36:46.436 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/547) 2023-11-13T15:36:46.820 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T15:36:46.831 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T15:36:46.831 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T15:36:47.132 INFO:teuthology.orchestra.run.smithi102.stdout:generic/547 [not run] this test requires a valid $SCRATCH_DEV 2023-11-13T15:36:47.141 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/547 2023-11-13T15:36:47.141 INFO:teuthology.orchestra.run.smithi102.stdout:Not run: generic/547 2023-11-13T15:36:47.141 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T15:36:47.148 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T15:36:47.169 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T15:36:47.169 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/548) 2023-11-13T15:36:47.544 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T15:36:47.555 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T15:36:47.555 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T15:36:47.889 INFO:teuthology.orchestra.run.smithi102.stdout:generic/548 [not run] this test requires a valid $SCRATCH_DEV 2023-11-13T15:36:47.897 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/548 2023-11-13T15:36:47.897 INFO:teuthology.orchestra.run.smithi102.stdout:Not run: generic/548 2023-11-13T15:36:47.898 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T15:36:47.903 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T15:36:47.924 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T15:36:47.924 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/549) 2023-11-13T15:36:48.289 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T15:36:48.299 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T15:36:48.300 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T15:36:48.646 INFO:teuthology.orchestra.run.smithi102.stdout:generic/549 [not run] this test requires a valid $SCRATCH_DEV 2023-11-13T15:36:48.654 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/549 2023-11-13T15:36:48.654 INFO:teuthology.orchestra.run.smithi102.stdout:Not run: generic/549 2023-11-13T15:36:48.654 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T15:36:48.660 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T15:36:48.739 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T15:36:48.740 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/550) 2023-11-13T15:36:49.133 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T15:36:49.144 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T15:36:49.144 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T15:36:49.494 INFO:teuthology.orchestra.run.smithi102.stdout:generic/550 [not run] this test requires a valid $SCRATCH_DEV 2023-11-13T15:36:49.502 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/550 2023-11-13T15:36:49.502 INFO:teuthology.orchestra.run.smithi102.stdout:Not run: generic/550 2023-11-13T15:36:49.502 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T15:36:49.509 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T15:36:49.528 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T15:36:49.529 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/551) 2023-11-13T15:36:49.880 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T15:36:49.891 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T15:36:49.891 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T15:36:50.184 INFO:teuthology.orchestra.run.smithi102.stdout:generic/551 [not run] this test requires a valid $SCRATCH_DEV 2023-11-13T15:36:50.192 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/551 2023-11-13T15:36:50.192 INFO:teuthology.orchestra.run.smithi102.stdout:Not run: generic/551 2023-11-13T15:36:50.193 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T15:36:50.199 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T15:36:50.220 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T15:36:50.220 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/552) 2023-11-13T15:36:50.608 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T15:36:50.619 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T15:36:50.619 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T15:36:50.912 INFO:teuthology.orchestra.run.smithi102.stdout:generic/552 [not run] this test requires a valid $SCRATCH_DEV 2023-11-13T15:36:50.920 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/552 2023-11-13T15:36:50.920 INFO:teuthology.orchestra.run.smithi102.stdout:Not run: generic/552 2023-11-13T15:36:50.921 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T15:36:50.927 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T15:36:50.947 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T15:36:50.947 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/553) 2023-11-13T15:36:51.320 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T15:36:51.330 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T15:36:51.331 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T15:36:51.746 INFO:teuthology.orchestra.run.smithi102.stdout:generic/553 [not run] xfs_io chattr +i failed (old kernel/wrong fs/bad args?) 2023-11-13T15:36:51.754 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/553 2023-11-13T15:36:51.755 INFO:teuthology.orchestra.run.smithi102.stdout:Not run: generic/553 2023-11-13T15:36:51.755 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T15:36:51.761 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T15:36:51.804 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T15:36:51.805 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/554) 2023-11-13T15:36:52.461 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T15:36:52.472 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T15:36:52.472 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T15:36:52.764 INFO:teuthology.orchestra.run.smithi102.stdout:generic/554 [not run] this test requires a valid $SCRATCH_DEV 2023-11-13T15:36:52.772 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/554 2023-11-13T15:36:52.772 INFO:teuthology.orchestra.run.smithi102.stdout:Not run: generic/554 2023-11-13T15:36:52.773 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T15:36:52.778 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T15:36:52.839 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T15:36:52.840 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/555) 2023-11-13T15:36:53.209 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T15:36:53.219 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T15:36:53.219 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T15:36:53.587 INFO:teuthology.orchestra.run.smithi102.stdout:generic/555 [not run] xfs_io chattr +ia failed (old kernel/wrong fs/bad args?) 2023-11-13T15:36:53.596 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/555 2023-11-13T15:36:53.596 INFO:teuthology.orchestra.run.smithi102.stdout:Not run: generic/555 2023-11-13T15:36:53.596 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T15:36:53.602 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T15:36:53.673 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T15:36:53.674 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/556) 2023-11-13T15:36:54.332 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T15:36:54.342 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T15:36:54.343 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T15:36:54.625 INFO:teuthology.orchestra.run.smithi102.stdout:generic/556 [not run] this test requires a valid $SCRATCH_DEV 2023-11-13T15:36:54.633 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/556 2023-11-13T15:36:54.634 INFO:teuthology.orchestra.run.smithi102.stdout:Not run: generic/556 2023-11-13T15:36:54.634 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T15:36:54.640 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T15:36:54.663 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T15:36:54.664 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/557) 2023-11-13T15:36:55.057 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T15:36:55.068 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T15:36:55.068 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T15:36:55.380 INFO:teuthology.orchestra.run.smithi102.stdout:generic/557 [not run] this test requires a valid $SCRATCH_DEV 2023-11-13T15:36:55.388 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/557 2023-11-13T15:36:55.389 INFO:teuthology.orchestra.run.smithi102.stdout:Not run: generic/557 2023-11-13T15:36:55.389 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T15:36:55.395 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T15:36:55.415 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T15:36:55.415 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/558) 2023-11-13T15:36:55.792 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T15:36:55.803 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T15:36:55.803 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T15:36:56.097 INFO:teuthology.orchestra.run.smithi102.stdout:generic/558 [not run] this test requires a valid $SCRATCH_DEV 2023-11-13T15:36:56.105 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/558 2023-11-13T15:36:56.105 INFO:teuthology.orchestra.run.smithi102.stdout:Not run: generic/558 2023-11-13T15:36:56.106 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T15:36:56.112 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T15:36:56.133 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T15:36:56.134 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/559) 2023-11-13T15:36:56.492 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T15:36:56.503 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T15:36:56.503 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T15:36:56.797 INFO:teuthology.orchestra.run.smithi102.stdout:generic/559 [not run] this test requires a valid $SCRATCH_DEV 2023-11-13T15:36:56.805 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/559 2023-11-13T15:36:56.805 INFO:teuthology.orchestra.run.smithi102.stdout:Not run: generic/559 2023-11-13T15:36:56.806 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T15:36:56.811 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T15:36:56.884 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T15:36:56.884 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/560) 2023-11-13T15:36:57.269 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T15:36:57.280 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T15:36:57.280 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T15:36:57.575 INFO:teuthology.orchestra.run.smithi102.stdout:generic/560 [not run] this test requires a valid $SCRATCH_DEV 2023-11-13T15:36:57.583 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/560 2023-11-13T15:36:57.583 INFO:teuthology.orchestra.run.smithi102.stdout:Not run: generic/560 2023-11-13T15:36:57.583 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T15:36:57.589 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T15:36:57.609 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T15:36:57.610 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/561) 2023-11-13T15:36:57.977 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T15:36:57.987 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T15:36:57.988 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T15:36:58.271 INFO:teuthology.orchestra.run.smithi102.stdout:generic/561 [not run] this test requires a valid $SCRATCH_DEV 2023-11-13T15:36:58.280 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/561 2023-11-13T15:36:58.280 INFO:teuthology.orchestra.run.smithi102.stdout:Not run: generic/561 2023-11-13T15:36:58.280 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T15:36:58.286 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T15:36:58.307 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T15:36:58.307 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/562) 2023-11-13T15:36:58.673 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T15:36:58.683 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T15:36:58.684 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T15:36:58.973 INFO:teuthology.orchestra.run.smithi102.stdout:generic/562 [not run] this test requires a valid $SCRATCH_DEV 2023-11-13T15:36:58.981 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/562 2023-11-13T15:36:58.981 INFO:teuthology.orchestra.run.smithi102.stdout:Not run: generic/562 2023-11-13T15:36:58.981 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T15:36:58.987 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T15:36:59.008 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T15:36:59.009 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/563) 2023-11-13T15:36:59.388 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T15:36:59.398 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T15:36:59.398 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T15:36:59.713 INFO:teuthology.orchestra.run.smithi102.stdout:generic/563 [not run] this test requires a valid $SCRATCH_DEV 2023-11-13T15:36:59.721 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/563 2023-11-13T15:36:59.721 INFO:teuthology.orchestra.run.smithi102.stdout:Not run: generic/563 2023-11-13T15:36:59.722 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T15:36:59.727 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T15:36:59.747 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T15:36:59.748 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/564) 2023-11-13T15:37:00.100 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T15:37:00.111 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T15:37:00.111 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T15:37:00.923 INFO:teuthology.orchestra.run.smithi102.stdout:generic/564 0s 2023-11-13T15:37:00.935 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/564 2023-11-13T15:37:00.936 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T15:37:00.942 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T15:37:01.156 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T15:37:01.156 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/565) 2023-11-13T15:37:01.689 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T15:37:01.700 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T15:37:01.700 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T15:37:01.994 INFO:teuthology.orchestra.run.smithi102.stdout:generic/565 [not run] this test requires a valid $SCRATCH_DEV 2023-11-13T15:37:02.002 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/565 2023-11-13T15:37:02.003 INFO:teuthology.orchestra.run.smithi102.stdout:Not run: generic/565 2023-11-13T15:37:02.003 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T15:37:02.009 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T15:37:02.030 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T15:37:02.031 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/566) 2023-11-13T15:37:02.409 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T15:37:02.420 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T15:37:02.420 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T15:37:02.685 INFO:teuthology.orchestra.run.smithi102.stdout:generic/566 [not run] this test requires a valid $SCRATCH_DEV 2023-11-13T15:37:02.693 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/566 2023-11-13T15:37:02.693 INFO:teuthology.orchestra.run.smithi102.stdout:Not run: generic/566 2023-11-13T15:37:02.693 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T15:37:02.699 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T15:37:02.719 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T15:37:02.720 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/567) 2023-11-13T15:37:03.097 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T15:37:03.107 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T15:37:03.108 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T15:37:03.381 INFO:teuthology.orchestra.run.smithi102.stdout:generic/567 [not run] this test requires a valid $SCRATCH_DEV 2023-11-13T15:37:03.389 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/567 2023-11-13T15:37:03.390 INFO:teuthology.orchestra.run.smithi102.stdout:Not run: generic/567 2023-11-13T15:37:03.390 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T15:37:03.396 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T15:37:03.416 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T15:37:03.417 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/568) 2023-11-13T15:37:03.774 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T15:37:03.785 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T15:37:03.785 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T15:37:04.338 INFO:teuthology.orchestra.run.smithi102.stdout:generic/568 1s 2023-11-13T15:37:04.420 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/568 2023-11-13T15:37:04.421 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T15:37:04.450 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T15:37:04.540 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T15:37:04.541 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/569) 2023-11-13T15:37:04.929 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T15:37:04.939 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T15:37:04.939 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T15:37:05.280 INFO:teuthology.orchestra.run.smithi102.stdout:generic/569 [not run] this test requires a valid $SCRATCH_DEV 2023-11-13T15:37:05.288 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/569 2023-11-13T15:37:05.288 INFO:teuthology.orchestra.run.smithi102.stdout:Not run: generic/569 2023-11-13T15:37:05.289 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T15:37:05.294 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T15:37:05.315 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T15:37:05.315 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/570) 2023-11-13T15:37:05.689 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T15:37:05.699 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T15:37:05.699 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T15:37:05.971 INFO:teuthology.orchestra.run.smithi102.stdout:generic/570 [not run] this test requires a valid $SCRATCH_DEV 2023-11-13T15:37:05.980 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/570 2023-11-13T15:37:05.980 INFO:teuthology.orchestra.run.smithi102.stdout:Not run: generic/570 2023-11-13T15:37:05.981 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T15:37:05.986 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T15:37:06.006 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T15:37:06.007 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/571) 2023-11-13T15:37:06.372 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T15:37:06.383 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T15:37:06.383 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T15:37:12.815 INFO:teuthology.orchestra.run.smithi102.stdout:generic/571 6s 2023-11-13T15:37:12.829 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/571 2023-11-13T15:37:12.829 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T15:37:12.835 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T15:37:13.033 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T15:37:13.034 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/572) 2023-11-13T15:37:13.576 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T15:37:13.586 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T15:37:13.587 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T15:37:13.762 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T15:37:13.766 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T15:37:13.887 INFO:teuthology.orchestra.run.smithi102.stdout:generic/572 [not run] this test requires a valid $SCRATCH_DEV 2023-11-13T15:37:13.895 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/572 2023-11-13T15:37:13.896 INFO:teuthology.orchestra.run.smithi102.stdout:Not run: generic/572 2023-11-13T15:37:13.896 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T15:37:13.902 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T15:37:13.921 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T15:37:13.922 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/573) 2023-11-13T15:37:14.288 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T15:37:14.298 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T15:37:14.299 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T15:37:14.582 INFO:teuthology.orchestra.run.smithi102.stdout:generic/573 [not run] this test requires a valid $SCRATCH_DEV 2023-11-13T15:37:14.590 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/573 2023-11-13T15:37:14.590 INFO:teuthology.orchestra.run.smithi102.stdout:Not run: generic/573 2023-11-13T15:37:14.590 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T15:37:14.596 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T15:37:14.615 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T15:37:14.616 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/574) 2023-11-13T15:37:14.986 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T15:37:14.997 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T15:37:14.997 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T15:37:15.285 INFO:teuthology.orchestra.run.smithi102.stdout:generic/574 [not run] this test requires a valid $SCRATCH_DEV 2023-11-13T15:37:15.293 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/574 2023-11-13T15:37:15.294 INFO:teuthology.orchestra.run.smithi102.stdout:Not run: generic/574 2023-11-13T15:37:15.294 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T15:37:15.300 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T15:37:15.321 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T15:37:15.322 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/575) 2023-11-13T15:37:15.688 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T15:37:15.698 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T15:37:15.699 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T15:37:15.980 INFO:teuthology.orchestra.run.smithi102.stdout:generic/575 [not run] this test requires a valid $SCRATCH_DEV 2023-11-13T15:37:15.988 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/575 2023-11-13T15:37:15.989 INFO:teuthology.orchestra.run.smithi102.stdout:Not run: generic/575 2023-11-13T15:37:15.989 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T15:37:15.995 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T15:37:16.014 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T15:37:16.014 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/576) 2023-11-13T15:37:16.372 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T15:37:16.382 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T15:37:16.382 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T15:37:16.764 INFO:teuthology.orchestra.run.smithi102.stdout:generic/576 [not run] this test requires a valid $SCRATCH_DEV 2023-11-13T15:37:16.772 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/576 2023-11-13T15:37:16.772 INFO:teuthology.orchestra.run.smithi102.stdout:Not run: generic/576 2023-11-13T15:37:16.772 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T15:37:16.778 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T15:37:16.799 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T15:37:16.800 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/577) 2023-11-13T15:37:17.161 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T15:37:17.171 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T15:37:17.171 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T15:37:17.452 INFO:teuthology.orchestra.run.smithi102.stdout:generic/577 [not run] this test requires a valid $SCRATCH_DEV 2023-11-13T15:37:17.461 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/577 2023-11-13T15:37:17.461 INFO:teuthology.orchestra.run.smithi102.stdout:Not run: generic/577 2023-11-13T15:37:17.461 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T15:37:17.467 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T15:37:17.487 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T15:37:17.488 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/578) 2023-11-13T15:37:17.881 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T15:37:17.892 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T15:37:17.892 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T15:37:18.247 INFO:teuthology.orchestra.run.smithi102.stdout:generic/578 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2023-11-13T15:37:18.255 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/578 2023-11-13T15:37:18.256 INFO:teuthology.orchestra.run.smithi102.stdout:Not run: generic/578 2023-11-13T15:37:18.256 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T15:37:18.262 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T15:37:18.284 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T15:37:18.284 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/579) 2023-11-13T15:37:18.649 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T15:37:18.659 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T15:37:18.660 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T15:37:18.975 INFO:teuthology.orchestra.run.smithi102.stdout:generic/579 [not run] this test requires a valid $SCRATCH_DEV 2023-11-13T15:37:18.983 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/579 2023-11-13T15:37:18.984 INFO:teuthology.orchestra.run.smithi102.stdout:Not run: generic/579 2023-11-13T15:37:18.984 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T15:37:18.990 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T15:37:19.009 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T15:37:19.010 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/580) 2023-11-13T15:37:19.372 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T15:37:19.383 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T15:37:19.383 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T15:37:19.726 INFO:teuthology.orchestra.run.smithi102.stdout:generic/580 [not run] this test requires a valid $SCRATCH_DEV 2023-11-13T15:37:19.735 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/580 2023-11-13T15:37:19.735 INFO:teuthology.orchestra.run.smithi102.stdout:Not run: generic/580 2023-11-13T15:37:19.735 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T15:37:19.741 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T15:37:19.811 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T15:37:19.811 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/581) 2023-11-13T15:37:20.165 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T15:37:20.176 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T15:37:20.176 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T15:37:21.045 INFO:teuthology.orchestra.run.smithi102.stdout:generic/581 [not run] this test requires a valid $SCRATCH_DEV 2023-11-13T15:37:21.053 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/581 2023-11-13T15:37:21.053 INFO:teuthology.orchestra.run.smithi102.stdout:Not run: generic/581 2023-11-13T15:37:21.054 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T15:37:21.059 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T15:37:21.080 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T15:37:21.080 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/582) 2023-11-13T15:37:21.448 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T15:37:21.459 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T15:37:21.459 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T15:37:21.871 INFO:teuthology.orchestra.run.smithi102.stdout:generic/582 [not run] this test requires a valid $SCRATCH_DEV 2023-11-13T15:37:21.879 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/582 2023-11-13T15:37:21.879 INFO:teuthology.orchestra.run.smithi102.stdout:Not run: generic/582 2023-11-13T15:37:21.879 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T15:37:21.885 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T15:37:21.955 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T15:37:21.956 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/583) 2023-11-13T15:37:22.313 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T15:37:22.323 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T15:37:22.323 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T15:37:22.667 INFO:teuthology.orchestra.run.smithi102.stdout:generic/583 [not run] this test requires a valid $SCRATCH_DEV 2023-11-13T15:37:22.675 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/583 2023-11-13T15:37:22.676 INFO:teuthology.orchestra.run.smithi102.stdout:Not run: generic/583 2023-11-13T15:37:22.676 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T15:37:22.682 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T15:37:22.702 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T15:37:22.703 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/584) 2023-11-13T15:37:23.077 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T15:37:23.087 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T15:37:23.087 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T15:37:23.438 INFO:teuthology.orchestra.run.smithi102.stdout:generic/584 [not run] this test requires a valid $SCRATCH_DEV 2023-11-13T15:37:23.446 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/584 2023-11-13T15:37:23.446 INFO:teuthology.orchestra.run.smithi102.stdout:Not run: generic/584 2023-11-13T15:37:23.447 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T15:37:23.452 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T15:37:23.473 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T15:37:23.473 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/585) 2023-11-13T15:37:23.861 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T15:37:23.872 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T15:37:23.872 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T15:37:24.136 INFO:teuthology.orchestra.run.smithi102.stdout:generic/585 [not run] this test requires a valid $SCRATCH_DEV 2023-11-13T15:37:24.144 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/585 2023-11-13T15:37:24.144 INFO:teuthology.orchestra.run.smithi102.stdout:Not run: generic/585 2023-11-13T15:37:24.144 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T15:37:24.151 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T15:37:24.170 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T15:37:24.171 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/586) 2023-11-13T15:37:24.531 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T15:37:24.542 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T15:37:24.542 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T15:37:43.883 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T15:37:43.887 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T15:37:49.794 INFO:teuthology.orchestra.run.smithi102.stdout:generic/586 25s 2023-11-13T15:37:49.807 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/586 2023-11-13T15:37:49.808 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T15:37:49.813 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T15:37:49.839 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T15:37:49.839 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/587) 2023-11-13T15:37:50.544 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T15:37:50.555 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T15:37:50.555 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T15:37:51.164 INFO:teuthology.orchestra.run.smithi102.stdout:generic/587 [not run] disk quotas not supported by this filesystem type: ceph-fuse 2023-11-13T15:37:51.172 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/587 2023-11-13T15:37:51.172 INFO:teuthology.orchestra.run.smithi102.stdout:Not run: generic/587 2023-11-13T15:37:51.172 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T15:37:51.178 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T15:37:51.199 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T15:37:51.200 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/588) 2023-11-13T15:37:51.548 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T15:37:51.559 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T15:37:51.559 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T15:37:51.888 INFO:teuthology.orchestra.run.smithi102.stdout:generic/588 [not run] this test requires a valid $SCRATCH_DEV 2023-11-13T15:37:51.897 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/588 2023-11-13T15:37:51.897 INFO:teuthology.orchestra.run.smithi102.stdout:Not run: generic/588 2023-11-13T15:37:51.898 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T15:37:51.903 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T15:37:51.924 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T15:37:51.925 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/589) 2023-11-13T15:37:52.286 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T15:37:52.297 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T15:37:52.297 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T15:37:52.586 INFO:teuthology.orchestra.run.smithi102.stdout:generic/589 [not run] this test requires a valid $SCRATCH_DEV 2023-11-13T15:37:52.594 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/589 2023-11-13T15:37:52.595 INFO:teuthology.orchestra.run.smithi102.stdout:Not run: generic/589 2023-11-13T15:37:52.595 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T15:37:52.600 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T15:37:52.621 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T15:37:52.621 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/590) 2023-11-13T15:37:53.008 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T15:37:53.018 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T15:37:53.019 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T15:37:53.315 INFO:teuthology.orchestra.run.smithi102.stdout:generic/590 [not run] this test requires a valid $SCRATCH_DEV 2023-11-13T15:37:53.324 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/590 2023-11-13T15:37:53.324 INFO:teuthology.orchestra.run.smithi102.stdout:Not run: generic/590 2023-11-13T15:37:53.324 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T15:37:53.330 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T15:37:53.350 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T15:37:53.351 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/591) 2023-11-13T15:37:53.717 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T15:37:53.727 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T15:37:53.727 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T15:37:54.197 INFO:teuthology.orchestra.run.smithi102.stdout:generic/591 1s 2023-11-13T15:37:54.209 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/591 2023-11-13T15:37:54.210 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T15:37:54.215 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T15:37:54.236 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T15:37:54.237 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/592) 2023-11-13T15:37:54.938 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T15:37:54.948 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T15:37:54.948 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T15:37:55.292 INFO:teuthology.orchestra.run.smithi102.stdout:generic/592 [not run] this test requires a valid $SCRATCH_DEV 2023-11-13T15:37:55.300 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/592 2023-11-13T15:37:55.300 INFO:teuthology.orchestra.run.smithi102.stdout:Not run: generic/592 2023-11-13T15:37:55.301 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T15:37:55.306 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T15:37:55.327 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T15:37:55.328 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/593) 2023-11-13T15:37:55.697 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T15:37:55.708 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T15:37:55.708 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T15:37:56.055 INFO:teuthology.orchestra.run.smithi102.stdout:generic/593 [not run] this test requires a valid $SCRATCH_DEV 2023-11-13T15:37:56.064 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/593 2023-11-13T15:37:56.064 INFO:teuthology.orchestra.run.smithi102.stdout:Not run: generic/593 2023-11-13T15:37:56.064 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T15:37:56.070 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T15:37:56.091 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T15:37:56.091 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/594) 2023-11-13T15:37:56.468 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T15:37:56.479 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T15:37:56.479 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T15:37:56.762 INFO:teuthology.orchestra.run.smithi102.stdout:generic/594 [not run] this test requires a valid $SCRATCH_DEV 2023-11-13T15:37:56.770 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/594 2023-11-13T15:37:56.770 INFO:teuthology.orchestra.run.smithi102.stdout:Not run: generic/594 2023-11-13T15:37:56.771 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T15:37:56.776 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T15:37:56.840 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T15:37:56.841 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/595) 2023-11-13T15:37:57.208 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T15:37:57.219 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T15:37:57.219 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T15:37:57.546 INFO:teuthology.orchestra.run.smithi102.stdout:generic/595 [not run] this test requires a valid $SCRATCH_DEV 2023-11-13T15:37:57.554 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/595 2023-11-13T15:37:57.554 INFO:teuthology.orchestra.run.smithi102.stdout:Not run: generic/595 2023-11-13T15:37:57.554 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T15:37:57.560 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T15:37:57.581 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T15:37:57.581 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/596) 2023-11-13T15:37:57.937 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T15:37:57.948 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T15:37:57.948 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T15:37:58.241 INFO:teuthology.orchestra.run.smithi102.stdout:generic/596 [not run] accton utility required, skipped this test 2023-11-13T15:37:58.249 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/596 2023-11-13T15:37:58.249 INFO:teuthology.orchestra.run.smithi102.stdout:Not run: generic/596 2023-11-13T15:37:58.249 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T15:37:58.255 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T15:37:58.275 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T15:37:58.276 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/597) 2023-11-13T15:37:58.650 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T15:37:58.660 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T15:37:58.660 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T15:37:59.685 INFO:teuthology.orchestra.run.smithi102.stdout:generic/597 - output mismatch (see /tmp/tmp.EnLPmcWJbzxfstests-dev/results//generic/597.out.bad) 2023-11-13T15:37:59.690 INFO:teuthology.orchestra.run.smithi102.stdout: --- tests/generic/597.out 2023-11-13 11:30:05.357484535 +0000 2023-11-13T15:37:59.690 INFO:teuthology.orchestra.run.smithi102.stdout: +++ /tmp/tmp.EnLPmcWJbzxfstests-dev/results//generic/597.out.bad 2023-11-13 15:37:59.675009315 +0000 2023-11-13T15:37:59.691 INFO:teuthology.orchestra.run.smithi102.stdout: @@ -4,11 +4,11 @@ 2023-11-13T15:37:59.691 INFO:teuthology.orchestra.run.smithi102.stdout: fs.protected_symlinks = 0 2023-11-13T15:37:59.691 INFO:teuthology.orchestra.run.smithi102.stdout: successfully followed symlink 2023-11-13T15:37:59.691 INFO:teuthology.orchestra.run.smithi102.stdout: fs.protected_symlinks = 1 2023-11-13T15:37:59.691 INFO:teuthology.orchestra.run.smithi102.stdout: -Permission denied 2023-11-13T15:37:59.692 INFO:teuthology.orchestra.run.smithi102.stdout: +successfully followed symlink 2023-11-13T15:37:59.692 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T15:37:59.692 INFO:teuthology.orchestra.run.smithi102.stdout: == Test hardlink create protection when 2023-11-13T15:37:59.692 INFO:teuthology.orchestra.run.smithi102.stdout: == process != target owner and process cannot read target 2023-11-13T15:37:59.693 INFO:teuthology.orchestra.run.smithi102.stdout: fs.protected_hardlinks = 0 2023-11-13T15:37:59.693 INFO:teuthology.orchestra.run.smithi102.stdout: -successfully created hardlink 2023-11-13T15:37:59.693 INFO:teuthology.orchestra.run.smithi102.stdout: +Permission denied 2023-11-13T15:37:59.693 INFO:teuthology.orchestra.run.smithi102.stdout: fs.protected_hardlinks = 1 2023-11-13T15:37:59.693 INFO:teuthology.orchestra.run.smithi102.stdout: -ln: failed to create hard link 'TEST_DIR/597/sticky_dir/hardlink' => 'TEST_DIR/597/target': Operation not permitted 2023-11-13T15:37:59.694 INFO:teuthology.orchestra.run.smithi102.stdout: +Permission denied 2023-11-13T15:37:59.696 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/597 2023-11-13T15:37:59.696 INFO:teuthology.orchestra.run.smithi102.stdout:Failures: generic/597 2023-11-13T15:37:59.696 INFO:teuthology.orchestra.run.smithi102.stdout:Failed 1 of 1 tests 2023-11-13T15:37:59.702 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T15:37:59.755 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-13T15:37:59.756 INFO:tasks.cephfs.xfstests_dev:Command failed 2023-11-13T15:37:59.756 INFO:tasks.cephfs.xfstests_dev:Command return value: 1 2023-11-13T15:37:59.757 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/598) 2023-11-13T15:38:00.445 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T15:38:00.455 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T15:38:00.455 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T15:38:01.509 INFO:teuthology.orchestra.run.smithi102.stdout:generic/598 - output mismatch (see /tmp/tmp.EnLPmcWJbzxfstests-dev/results//generic/598.out.bad) 2023-11-13T15:38:01.515 INFO:teuthology.orchestra.run.smithi102.stdout: --- tests/generic/598.out 2023-11-13 11:30:05.357484535 +0000 2023-11-13T15:38:01.515 INFO:teuthology.orchestra.run.smithi102.stdout: +++ /tmp/tmp.EnLPmcWJbzxfstests-dev/results//generic/598.out.bad 2023-11-13 15:38:01.498972872 +0000 2023-11-13T15:38:01.515 INFO:teuthology.orchestra.run.smithi102.stdout: @@ -5,13 +5,10 @@ 2023-11-13T15:38:01.515 INFO:teuthology.orchestra.run.smithi102.stdout: = only group writable dir 2023-11-13T15:38:01.516 INFO:teuthology.orchestra.run.smithi102.stdout: fs.protected_regular = 1 2023-11-13T15:38:01.516 INFO:teuthology.orchestra.run.smithi102.stdout: = group & world writable dir 2023-11-13T15:38:01.516 INFO:teuthology.orchestra.run.smithi102.stdout: -Permission denied 2023-11-13T15:38:01.516 INFO:teuthology.orchestra.run.smithi102.stdout: = only group writable dir 2023-11-13T15:38:01.516 INFO:teuthology.orchestra.run.smithi102.stdout: fs.protected_regular = 2 2023-11-13T15:38:01.517 INFO:teuthology.orchestra.run.smithi102.stdout: = group & world writable dir 2023-11-13T15:38:01.517 INFO:teuthology.orchestra.run.smithi102.stdout: -Permission denied 2023-11-13T15:38:01.517 INFO:teuthology.orchestra.run.smithi102.stdout: = only group writable dir 2023-11-13T15:38:01.517 INFO:teuthology.orchestra.run.smithi102.stdout: -Permission denied 2023-11-13T15:38:01.517 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T15:38:01.518 INFO:teuthology.orchestra.run.smithi102.stdout: == Test fifo open when owned by another and fifo owner != dir owner 2023-11-13T15:38:01.518 INFO:teuthology.orchestra.run.smithi102.stdout: fs.protected_fifos = 0 2023-11-13T15:38:01.518 INFO:teuthology.orchestra.run.smithi102.stdout: @@ -19,10 +16,7 @@ 2023-11-13T15:38:01.518 INFO:teuthology.orchestra.run.smithi102.stdout: = only group writable dir 2023-11-13T15:38:01.518 INFO:teuthology.orchestra.run.smithi102.stdout: fs.protected_fifos = 1 2023-11-13T15:38:01.519 INFO:teuthology.orchestra.run.smithi102.stdout: = group & world writable dir 2023-11-13T15:38:01.519 INFO:teuthology.orchestra.run.smithi102.stdout: -Permission denied 2023-11-13T15:38:01.519 INFO:teuthology.orchestra.run.smithi102.stdout: = only group writable dir 2023-11-13T15:38:01.519 INFO:teuthology.orchestra.run.smithi102.stdout: fs.protected_fifos = 2 2023-11-13T15:38:01.519 INFO:teuthology.orchestra.run.smithi102.stdout: = group & world writable dir 2023-11-13T15:38:01.519 INFO:teuthology.orchestra.run.smithi102.stdout: -Permission denied 2023-11-13T15:38:01.520 INFO:teuthology.orchestra.run.smithi102.stdout: = only group writable dir 2023-11-13T15:38:01.520 INFO:teuthology.orchestra.run.smithi102.stdout: -Permission denied 2023-11-13T15:38:01.520 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/598 2023-11-13T15:38:01.521 INFO:teuthology.orchestra.run.smithi102.stdout:Failures: generic/598 2023-11-13T15:38:01.521 INFO:teuthology.orchestra.run.smithi102.stdout:Failed 1 of 1 tests 2023-11-13T15:38:01.527 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T15:38:01.549 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-13T15:38:01.549 INFO:tasks.cephfs.xfstests_dev:Command failed 2023-11-13T15:38:01.550 INFO:tasks.cephfs.xfstests_dev:Command return value: 1 2023-11-13T15:38:01.550 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/599) 2023-11-13T15:38:02.260 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T15:38:02.270 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T15:38:02.271 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T15:38:02.578 INFO:teuthology.orchestra.run.smithi102.stdout:generic/599 [not run] this test requires a valid $SCRATCH_DEV 2023-11-13T15:38:02.586 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/599 2023-11-13T15:38:02.586 INFO:teuthology.orchestra.run.smithi102.stdout:Not run: generic/599 2023-11-13T15:38:02.587 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T15:38:02.592 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T15:38:02.614 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T15:38:02.615 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/600) 2023-11-13T15:38:03.014 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T15:38:03.025 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T15:38:03.025 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T15:38:03.317 INFO:teuthology.orchestra.run.smithi102.stdout:generic/600 [not run] this test requires a valid $SCRATCH_DEV 2023-11-13T15:38:03.325 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/600 2023-11-13T15:38:03.325 INFO:teuthology.orchestra.run.smithi102.stdout:Not run: generic/600 2023-11-13T15:38:03.325 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T15:38:03.331 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T15:38:03.351 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T15:38:03.351 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/601) 2023-11-13T15:38:03.725 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T15:38:03.736 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T15:38:03.736 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T15:38:04.033 INFO:teuthology.orchestra.run.smithi102.stdout:generic/601 [not run] this test requires a valid $SCRATCH_DEV 2023-11-13T15:38:04.041 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/601 2023-11-13T15:38:04.041 INFO:teuthology.orchestra.run.smithi102.stdout:Not run: generic/601 2023-11-13T15:38:04.042 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T15:38:04.048 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T15:38:04.069 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T15:38:04.069 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/602) 2023-11-13T15:38:04.535 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T15:38:04.546 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T15:38:04.546 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T15:38:04.940 INFO:teuthology.orchestra.run.smithi102.stdout:generic/602 [not run] this test requires a valid $SCRATCH_DEV 2023-11-13T15:38:04.948 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/602 2023-11-13T15:38:04.948 INFO:teuthology.orchestra.run.smithi102.stdout:Not run: generic/602 2023-11-13T15:38:04.948 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T15:38:04.954 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T15:38:04.976 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T15:38:04.977 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/603) 2023-11-13T15:38:05.337 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T15:38:05.347 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T15:38:05.348 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T15:38:05.642 INFO:teuthology.orchestra.run.smithi102.stdout:generic/603 [not run] this test requires a valid $SCRATCH_DEV 2023-11-13T15:38:05.651 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/603 2023-11-13T15:38:05.651 INFO:teuthology.orchestra.run.smithi102.stdout:Not run: generic/603 2023-11-13T15:38:05.651 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T15:38:05.657 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T15:38:05.678 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T15:38:05.679 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/604) 2023-11-13T15:38:06.058 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T15:38:06.068 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T15:38:06.069 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T15:38:06.334 INFO:teuthology.orchestra.run.smithi102.stdout:generic/604 [not run] this test requires a valid $SCRATCH_DEV 2023-11-13T15:38:06.343 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/604 2023-11-13T15:38:06.343 INFO:teuthology.orchestra.run.smithi102.stdout:Not run: generic/604 2023-11-13T15:38:06.343 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T15:38:06.350 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T15:38:06.411 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T15:38:06.412 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/605) 2023-11-13T15:38:06.792 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T15:38:06.803 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T15:38:06.803 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T15:38:07.097 INFO:teuthology.orchestra.run.smithi102.stdout:generic/605 [not run] this test requires a valid $SCRATCH_DEV 2023-11-13T15:38:07.105 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/605 2023-11-13T15:38:07.105 INFO:teuthology.orchestra.run.smithi102.stdout:Not run: generic/605 2023-11-13T15:38:07.105 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T15:38:07.112 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T15:38:07.132 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T15:38:07.133 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/606) 2023-11-13T15:38:07.497 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T15:38:07.508 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T15:38:07.508 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T15:38:07.781 INFO:teuthology.orchestra.run.smithi102.stdout:generic/606 [not run] this test requires a valid $SCRATCH_DEV 2023-11-13T15:38:07.790 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/606 2023-11-13T15:38:07.790 INFO:teuthology.orchestra.run.smithi102.stdout:Not run: generic/606 2023-11-13T15:38:07.791 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T15:38:07.796 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T15:38:07.817 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T15:38:07.818 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/607) 2023-11-13T15:38:08.190 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T15:38:08.200 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T15:38:08.200 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T15:38:08.478 INFO:teuthology.orchestra.run.smithi102.stdout:generic/607 [not run] this test requires a valid $SCRATCH_DEV 2023-11-13T15:38:08.487 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/607 2023-11-13T15:38:08.487 INFO:teuthology.orchestra.run.smithi102.stdout:Not run: generic/607 2023-11-13T15:38:08.487 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T15:38:08.493 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T15:38:08.513 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T15:38:08.514 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/608) 2023-11-13T15:38:08.877 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T15:38:08.888 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T15:38:08.888 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T15:38:09.174 INFO:teuthology.orchestra.run.smithi102.stdout:generic/608 [not run] this test requires a valid $SCRATCH_DEV 2023-11-13T15:38:09.182 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/608 2023-11-13T15:38:09.182 INFO:teuthology.orchestra.run.smithi102.stdout:Not run: generic/608 2023-11-13T15:38:09.182 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T15:38:09.188 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T15:38:09.210 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T15:38:09.211 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/609) 2023-11-13T15:38:09.593 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T15:38:09.604 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T15:38:09.604 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T15:38:10.197 INFO:teuthology.orchestra.run.smithi102.stdout:generic/609 1s 2023-11-13T15:38:10.210 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/609 2023-11-13T15:38:10.210 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T15:38:10.216 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T15:38:10.239 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T15:38:10.240 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/610) 2023-11-13T15:38:10.954 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T15:38:10.965 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T15:38:10.965 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T15:38:11.252 INFO:teuthology.orchestra.run.smithi102.stdout:generic/610 [not run] this test requires a valid $SCRATCH_DEV 2023-11-13T15:38:11.260 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/610 2023-11-13T15:38:11.261 INFO:teuthology.orchestra.run.smithi102.stdout:Not run: generic/610 2023-11-13T15:38:11.261 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T15:38:11.267 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T15:38:11.287 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T15:38:11.287 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/611) 2023-11-13T15:38:11.649 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T15:38:11.659 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T15:38:11.659 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T15:38:11.953 INFO:teuthology.orchestra.run.smithi102.stdout:generic/611 [not run] this test requires a valid $SCRATCH_DEV 2023-11-13T15:38:11.961 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/611 2023-11-13T15:38:11.961 INFO:teuthology.orchestra.run.smithi102.stdout:Not run: generic/611 2023-11-13T15:38:11.961 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T15:38:11.967 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T15:38:11.987 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T15:38:11.988 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/612) 2023-11-13T15:38:12.362 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T15:38:12.373 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T15:38:12.373 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T15:38:12.748 INFO:teuthology.orchestra.run.smithi102.stdout:generic/612 [not run] Reflink not supported by test filesystem type: ceph-fuse 2023-11-13T15:38:12.756 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/612 2023-11-13T15:38:12.757 INFO:teuthology.orchestra.run.smithi102.stdout:Not run: generic/612 2023-11-13T15:38:12.757 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T15:38:12.763 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T15:38:12.783 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T15:38:12.784 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/613) 2023-11-13T15:38:13.498 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T15:38:13.507 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T15:38:13.508 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T15:38:13.843 INFO:teuthology.orchestra.run.smithi102.stdout:generic/613 [not run] this test requires a valid $SCRATCH_DEV 2023-11-13T15:38:13.852 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/613 2023-11-13T15:38:13.852 INFO:teuthology.orchestra.run.smithi102.stdout:Not run: generic/613 2023-11-13T15:38:13.852 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T15:38:13.858 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T15:38:13.878 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T15:38:13.878 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/614) 2023-11-13T15:38:14.089 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T15:38:14.094 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T15:38:14.278 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T15:38:14.288 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T15:38:14.288 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T15:38:14.585 INFO:teuthology.orchestra.run.smithi102.stdout:generic/614 [not run] this test requires a valid $SCRATCH_DEV 2023-11-13T15:38:14.594 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/614 2023-11-13T15:38:14.594 INFO:teuthology.orchestra.run.smithi102.stdout:Not run: generic/614 2023-11-13T15:38:14.594 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T15:38:14.600 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T15:38:14.621 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T15:38:14.621 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/615) 2023-11-13T15:38:14.997 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T15:38:15.008 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T15:38:15.008 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T15:38:15.286 INFO:teuthology.orchestra.run.smithi102.stdout:generic/615 [not run] this test requires a valid $SCRATCH_DEV 2023-11-13T15:38:15.295 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/615 2023-11-13T15:38:15.295 INFO:teuthology.orchestra.run.smithi102.stdout:Not run: generic/615 2023-11-13T15:38:15.295 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T15:38:15.301 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T15:38:15.321 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T15:38:15.321 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/616) 2023-11-13T15:38:15.674 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T15:38:15.684 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T15:38:15.684 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T15:38:44.169 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T15:38:44.173 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T15:39:14.497 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T15:39:14.502 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T15:39:44.613 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T15:39:44.618 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T15:40:14.752 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T15:40:14.756 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T15:40:45.645 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T15:40:45.649 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T15:41:15.717 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T15:41:15.721 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T15:41:45.867 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T15:41:45.872 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T15:42:09.122 INFO:teuthology.orchestra.run.smithi102.stdout:generic/616 234s 2023-11-13T15:42:09.172 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/616 2023-11-13T15:42:09.173 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T15:42:09.179 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T15:42:09.201 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T15:42:09.202 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/617) 2023-11-13T15:42:09.906 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T15:42:09.917 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T15:42:09.918 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T15:42:16.005 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T15:42:16.010 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T15:42:46.135 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T15:42:46.139 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T15:43:13.208 INFO:teuthology.orchestra.run.smithi102.stdout:generic/617 64s 2023-11-13T15:43:13.220 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/617 2023-11-13T15:43:13.221 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T15:43:13.227 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T15:43:13.293 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T15:43:13.293 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/618) 2023-11-13T15:43:13.937 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T15:43:13.948 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T15:43:13.948 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T15:43:14.604 INFO:teuthology.orchestra.run.smithi102.stdout:generic/618 [not run] this test requires a valid $SCRATCH_DEV 2023-11-13T15:43:14.612 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/618 2023-11-13T15:43:14.613 INFO:teuthology.orchestra.run.smithi102.stdout:Not run: generic/618 2023-11-13T15:43:14.613 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T15:43:14.619 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T15:43:14.639 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T15:43:14.639 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/619) 2023-11-13T15:43:15.013 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T15:43:15.023 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T15:43:15.023 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T15:43:15.286 INFO:teuthology.orchestra.run.smithi102.stdout:generic/619 [not run] this test requires a valid $SCRATCH_DEV 2023-11-13T15:43:15.294 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/619 2023-11-13T15:43:15.295 INFO:teuthology.orchestra.run.smithi102.stdout:Not run: generic/619 2023-11-13T15:43:15.295 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T15:43:15.301 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T15:43:15.321 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T15:43:15.321 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/620) 2023-11-13T15:43:15.706 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T15:43:15.716 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T15:43:15.716 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T15:43:16.072 INFO:teuthology.orchestra.run.smithi102.stdout:generic/620 [not run] this test requires a valid $SCRATCH_DEV 2023-11-13T15:43:16.080 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/620 2023-11-13T15:43:16.081 INFO:teuthology.orchestra.run.smithi102.stdout:Not run: generic/620 2023-11-13T15:43:16.081 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T15:43:16.086 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T15:43:16.107 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T15:43:16.107 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/621) 2023-11-13T15:43:16.190 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T15:43:16.194 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T15:43:16.496 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T15:43:16.506 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T15:43:16.507 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T15:43:16.865 INFO:teuthology.orchestra.run.smithi102.stdout:generic/621 [not run] this test requires a valid $SCRATCH_DEV 2023-11-13T15:43:16.873 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/621 2023-11-13T15:43:16.873 INFO:teuthology.orchestra.run.smithi102.stdout:Not run: generic/621 2023-11-13T15:43:16.874 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T15:43:16.879 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T15:43:16.898 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T15:43:16.899 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/622) 2023-11-13T15:43:17.265 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T15:43:17.275 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T15:43:17.275 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T15:43:17.550 INFO:teuthology.orchestra.run.smithi102.stdout:generic/622 [not run] this test requires a valid $SCRATCH_DEV 2023-11-13T15:43:17.558 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/622 2023-11-13T15:43:17.558 INFO:teuthology.orchestra.run.smithi102.stdout:Not run: generic/622 2023-11-13T15:43:17.559 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T15:43:17.564 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T15:43:17.584 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T15:43:17.585 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/623) 2023-11-13T15:43:17.958 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T15:43:17.968 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T15:43:17.969 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T15:43:18.268 INFO:teuthology.orchestra.run.smithi102.stdout:generic/623 [not run] this test requires a valid $SCRATCH_DEV 2023-11-13T15:43:18.276 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/623 2023-11-13T15:43:18.276 INFO:teuthology.orchestra.run.smithi102.stdout:Not run: generic/623 2023-11-13T15:43:18.277 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T15:43:18.282 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T15:43:18.302 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T15:43:18.302 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/624) 2023-11-13T15:43:18.661 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T15:43:18.672 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T15:43:18.672 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T15:43:18.973 INFO:teuthology.orchestra.run.smithi102.stdout:generic/624 [not run] this test requires a valid $SCRATCH_DEV 2023-11-13T15:43:18.981 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/624 2023-11-13T15:43:18.982 INFO:teuthology.orchestra.run.smithi102.stdout:Not run: generic/624 2023-11-13T15:43:18.982 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T15:43:18.988 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T15:43:19.007 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T15:43:19.008 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/625) 2023-11-13T15:43:19.365 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T15:43:19.375 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T15:43:19.375 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T15:43:19.658 INFO:teuthology.orchestra.run.smithi102.stdout:generic/625 [not run] this test requires a valid $SCRATCH_DEV 2023-11-13T15:43:19.666 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/625 2023-11-13T15:43:19.666 INFO:teuthology.orchestra.run.smithi102.stdout:Not run: generic/625 2023-11-13T15:43:19.666 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T15:43:19.672 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T15:43:19.692 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T15:43:19.692 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/626) 2023-11-13T15:43:20.054 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T15:43:20.065 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T15:43:20.065 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T15:43:20.357 INFO:teuthology.orchestra.run.smithi102.stdout:generic/626 [not run] this test requires a valid $SCRATCH_DEV 2023-11-13T15:43:20.365 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/626 2023-11-13T15:43:20.365 INFO:teuthology.orchestra.run.smithi102.stdout:Not run: generic/626 2023-11-13T15:43:20.365 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T15:43:20.371 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T15:43:20.391 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T15:43:20.391 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/627) 2023-11-13T15:43:20.760 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T15:43:20.770 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T15:43:20.771 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T15:43:21.057 INFO:teuthology.orchestra.run.smithi102.stdout:generic/627 [not run] this test requires a valid $SCRATCH_DEV 2023-11-13T15:43:21.065 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/627 2023-11-13T15:43:21.065 INFO:teuthology.orchestra.run.smithi102.stdout:Not run: generic/627 2023-11-13T15:43:21.065 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T15:43:21.071 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T15:43:21.151 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T15:43:21.152 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/628) 2023-11-13T15:43:21.524 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T15:43:21.535 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T15:43:21.535 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T15:43:21.835 INFO:teuthology.orchestra.run.smithi102.stdout:generic/628 [not run] this test requires a valid $SCRATCH_DEV 2023-11-13T15:43:21.843 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/628 2023-11-13T15:43:21.843 INFO:teuthology.orchestra.run.smithi102.stdout:Not run: generic/628 2023-11-13T15:43:21.843 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T15:43:21.849 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T15:43:21.907 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T15:43:21.908 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/629) 2023-11-13T15:43:22.280 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T15:43:22.291 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T15:43:22.291 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T15:43:22.584 INFO:teuthology.orchestra.run.smithi102.stdout:generic/629 [not run] this test requires a valid $SCRATCH_DEV 2023-11-13T15:43:22.592 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/629 2023-11-13T15:43:22.592 INFO:teuthology.orchestra.run.smithi102.stdout:Not run: generic/629 2023-11-13T15:43:22.592 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T15:43:22.598 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T15:43:22.675 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T15:43:22.676 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/630) 2023-11-13T15:43:23.069 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T15:43:23.079 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T15:43:23.080 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T15:43:23.355 INFO:teuthology.orchestra.run.smithi102.stdout:generic/630 [not run] this test requires a valid $SCRATCH_DEV 2023-11-13T15:43:23.363 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/630 2023-11-13T15:43:23.364 INFO:teuthology.orchestra.run.smithi102.stdout:Not run: generic/630 2023-11-13T15:43:23.364 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T15:43:23.370 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T15:43:23.443 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T15:43:23.444 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/631) 2023-11-13T15:43:23.821 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T15:43:23.831 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T15:43:23.831 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T15:43:24.115 INFO:teuthology.orchestra.run.smithi102.stdout:generic/631 [not run] this test requires a valid $SCRATCH_DEV 2023-11-13T15:43:24.123 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/631 2023-11-13T15:43:24.123 INFO:teuthology.orchestra.run.smithi102.stdout:Not run: generic/631 2023-11-13T15:43:24.123 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T15:43:24.129 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T15:43:24.149 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T15:43:24.149 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/632) 2023-11-13T15:43:24.509 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T15:43:24.520 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T15:43:24.520 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T15:43:30.744 INFO:teuthology.orchestra.run.smithi102.stdout:generic/632 6s 2023-11-13T15:43:30.757 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/632 2023-11-13T15:43:30.757 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T15:43:30.763 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T15:43:30.835 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T15:43:30.836 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/633) 2023-11-13T15:43:31.197 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T15:43:31.208 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T15:43:31.208 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T15:43:31.960 INFO:teuthology.orchestra.run.smithi102.stdout:generic/633 [failed, exit status 1]- output mismatch (see /tmp/tmp.EnLPmcWJbzxfstests-dev/results//generic/633.out.bad) 2023-11-13T15:43:32.003 INFO:teuthology.orchestra.run.smithi102.stdout: --- tests/generic/633.out 2023-11-13 11:30:05.361484451 +0000 2023-11-13T15:43:32.003 INFO:teuthology.orchestra.run.smithi102.stdout: +++ /tmp/tmp.EnLPmcWJbzxfstests-dev/results//generic/633.out.bad 2023-11-13 15:43:31.924368913 +0000 2023-11-13T15:43:32.003 INFO:teuthology.orchestra.run.smithi102.stdout: @@ -1,2 +1,5 @@ 2023-11-13T15:43:32.004 INFO:teuthology.orchestra.run.smithi102.stdout: QA output created by 633 2023-11-13T15:43:32.004 INFO:teuthology.orchestra.run.smithi102.stdout: Silence is golden 2023-11-13T15:43:32.004 INFO:teuthology.orchestra.run.smithi102.stdout: +vfstest.c: 1164: protected_symlinks - Success - failure: openat 2023-11-13T15:43:32.004 INFO:teuthology.orchestra.run.smithi102.stdout: +vfstest.c: 1171: protected_symlinks - Success - failure: wait_for_pid 2023-11-13T15:43:32.004 INFO:teuthology.orchestra.run.smithi102.stdout: +vfstest.c: 2418: run_test - Success - failure: following protected symlinks on regular mounts 2023-11-13T15:43:32.062 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/633 2023-11-13T15:43:32.062 INFO:teuthology.orchestra.run.smithi102.stdout:Failures: generic/633 2023-11-13T15:43:32.062 INFO:teuthology.orchestra.run.smithi102.stdout:Failed 1 of 1 tests 2023-11-13T15:43:32.107 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T15:43:32.162 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-13T15:43:32.163 INFO:tasks.cephfs.xfstests_dev:Command failed 2023-11-13T15:43:32.164 INFO:tasks.cephfs.xfstests_dev:Command return value: 1 2023-11-13T15:43:32.164 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/634) 2023-11-13T15:43:32.553 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T15:43:32.564 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T15:43:32.564 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T15:43:32.838 INFO:teuthology.orchestra.run.smithi102.stdout:generic/634 [not run] this test requires a valid $SCRATCH_DEV 2023-11-13T15:43:32.846 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/634 2023-11-13T15:43:32.846 INFO:teuthology.orchestra.run.smithi102.stdout:Not run: generic/634 2023-11-13T15:43:32.846 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T15:43:32.852 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T15:43:32.872 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T15:43:32.872 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/635) 2023-11-13T15:43:33.236 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T15:43:33.247 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T15:43:33.247 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T15:43:33.549 INFO:teuthology.orchestra.run.smithi102.stdout:generic/635 [not run] this test requires a valid $SCRATCH_DEV 2023-11-13T15:43:33.558 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/635 2023-11-13T15:43:33.558 INFO:teuthology.orchestra.run.smithi102.stdout:Not run: generic/635 2023-11-13T15:43:33.559 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T15:43:33.564 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T15:43:33.584 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T15:43:33.584 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/636) 2023-11-13T15:43:33.961 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T15:43:33.972 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T15:43:33.972 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T15:43:34.265 INFO:teuthology.orchestra.run.smithi102.stdout:generic/636 [not run] this test requires a valid $SCRATCH_DEV 2023-11-13T15:43:34.273 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/636 2023-11-13T15:43:34.274 INFO:teuthology.orchestra.run.smithi102.stdout:Not run: generic/636 2023-11-13T15:43:34.274 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T15:43:34.280 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T15:43:34.299 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T15:43:34.299 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/637) 2023-11-13T15:43:34.669 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T15:43:34.679 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T15:43:34.680 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T15:43:36.104 INFO:teuthology.orchestra.run.smithi102.stdout:generic/637 2s 2023-11-13T15:43:36.117 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/637 2023-11-13T15:43:36.118 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T15:43:36.124 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T15:43:36.190 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T15:43:36.191 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/638) 2023-11-13T15:43:36.894 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T15:43:36.904 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T15:43:36.904 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T15:43:37.306 INFO:teuthology.orchestra.run.smithi102.stdout:generic/638 1s 2023-11-13T15:43:37.318 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/638 2023-11-13T15:43:37.319 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T15:43:37.325 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T15:43:37.345 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T15:43:37.346 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/639) 2023-11-13T15:43:37.716 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T15:43:37.727 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T15:43:37.727 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T15:43:40.466 INFO:teuthology.orchestra.run.smithi102.stdout:generic/639 3s 2023-11-13T15:43:40.479 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/639 2023-11-13T15:43:40.480 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T15:43:40.486 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T15:43:40.505 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T15:43:40.506 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/640) 2023-11-13T15:43:40.877 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T15:43:40.888 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T15:43:40.888 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T15:43:41.203 INFO:teuthology.orchestra.run.smithi102.stdout:generic/640 [not run] this test requires a valid $SCRATCH_DEV 2023-11-13T15:43:41.211 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/640 2023-11-13T15:43:41.212 INFO:teuthology.orchestra.run.smithi102.stdout:Not run: generic/640 2023-11-13T15:43:41.212 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T15:43:41.218 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T15:43:41.238 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T15:43:41.238 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/641) 2023-11-13T15:43:41.614 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T15:43:41.624 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T15:43:41.624 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T15:43:41.919 INFO:teuthology.orchestra.run.smithi102.stdout:generic/641 [not run] this test requires a valid $SCRATCH_DEV 2023-11-13T15:43:41.928 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/641 2023-11-13T15:43:41.928 INFO:teuthology.orchestra.run.smithi102.stdout:Not run: generic/641 2023-11-13T15:43:41.929 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T15:43:41.934 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T15:43:41.953 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T15:43:41.954 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/642) 2023-11-13T15:43:42.336 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T15:43:42.347 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T15:43:42.347 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T15:43:42.654 INFO:teuthology.orchestra.run.smithi102.stdout:generic/642 [not run] this test requires a valid $SCRATCH_DEV 2023-11-13T15:43:42.662 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/642 2023-11-13T15:43:42.662 INFO:teuthology.orchestra.run.smithi102.stdout:Not run: generic/642 2023-11-13T15:43:42.662 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T15:43:42.668 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T15:43:42.689 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T15:43:42.690 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/643) 2023-11-13T15:43:43.069 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T15:43:43.079 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T15:43:43.079 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T15:43:43.360 INFO:teuthology.orchestra.run.smithi102.stdout:generic/643 [not run] this test requires a valid $SCRATCH_DEV 2023-11-13T15:43:43.368 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/643 2023-11-13T15:43:43.369 INFO:teuthology.orchestra.run.smithi102.stdout:Not run: generic/643 2023-11-13T15:43:43.369 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T15:43:43.374 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T15:43:43.394 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T15:43:43.394 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/644) 2023-11-13T15:43:43.748 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T15:43:43.759 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T15:43:43.759 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T15:43:44.064 INFO:teuthology.orchestra.run.smithi102.stdout:generic/644 [not run] vfstest not support by ceph-fuse 2023-11-13T15:43:44.073 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/644 2023-11-13T15:43:44.073 INFO:teuthology.orchestra.run.smithi102.stdout:Not run: generic/644 2023-11-13T15:43:44.073 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T15:43:44.079 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T15:43:44.099 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T15:43:44.100 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/645) 2023-11-13T15:43:44.493 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T15:43:44.504 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T15:43:44.504 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T15:43:44.784 INFO:teuthology.orchestra.run.smithi102.stdout:generic/645 [not run] vfstest not support by ceph-fuse 2023-11-13T15:43:44.793 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/645 2023-11-13T15:43:44.793 INFO:teuthology.orchestra.run.smithi102.stdout:Not run: generic/645 2023-11-13T15:43:44.793 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T15:43:44.799 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T15:43:44.818 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T15:43:44.819 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/646) 2023-11-13T15:43:45.193 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T15:43:45.204 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T15:43:45.204 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T15:43:45.477 INFO:teuthology.orchestra.run.smithi102.stdout:generic/646 [not run] this test requires a valid $SCRATCH_DEV 2023-11-13T15:43:45.486 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/646 2023-11-13T15:43:45.486 INFO:teuthology.orchestra.run.smithi102.stdout:Not run: generic/646 2023-11-13T15:43:45.486 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T15:43:45.492 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T15:43:45.512 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T15:43:45.513 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/647) 2023-11-13T15:43:45.878 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T15:43:45.889 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T15:43:45.889 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T15:43:46.330 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T15:43:46.334 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T15:43:46.386 INFO:teuthology.orchestra.run.smithi102.stdout:generic/647 1s 2023-11-13T15:43:46.399 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/647 2023-11-13T15:43:46.400 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T15:43:46.406 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T15:43:46.427 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T15:43:46.427 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/648) 2023-11-13T15:43:47.167 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T15:43:47.178 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T15:43:47.178 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T15:43:47.511 INFO:teuthology.orchestra.run.smithi102.stdout:generic/648 [not run] this test requires a valid $SCRATCH_DEV 2023-11-13T15:43:47.519 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/648 2023-11-13T15:43:47.519 INFO:teuthology.orchestra.run.smithi102.stdout:Not run: generic/648 2023-11-13T15:43:47.520 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T15:43:47.525 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T15:43:47.545 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T15:43:47.545 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/649) 2023-11-13T15:43:47.908 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T15:43:47.918 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T15:43:47.918 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T15:43:48.281 INFO:teuthology.orchestra.run.smithi102.stdout:generic/649 [not run] Reflink not supported by test filesystem type: ceph-fuse 2023-11-13T15:43:48.289 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/649 2023-11-13T15:43:48.289 INFO:teuthology.orchestra.run.smithi102.stdout:Not run: generic/649 2023-11-13T15:43:48.289 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T15:43:48.295 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T15:43:48.324 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T15:43:48.324 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/650) 2023-11-13T15:43:49.033 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T15:43:49.043 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T15:43:49.044 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T15:44:16.459 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T15:44:16.498 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T15:44:46.807 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T15:44:46.819 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T15:45:17.196 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T15:45:17.212 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T15:45:47.557 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T15:45:47.563 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T15:46:17.689 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T15:46:17.695 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T15:46:48.291 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T15:46:48.317 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T15:47:18.545 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T15:47:18.564 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T15:47:49.157 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T15:47:49.163 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T15:48:19.545 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T15:48:19.550 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T15:48:49.946 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T15:48:49.951 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T15:49:20.104 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T15:49:20.127 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T15:49:50.728 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T15:49:50.739 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T15:50:21.194 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T15:50:21.205 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T15:50:51.280 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T15:50:51.287 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T15:51:21.719 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T15:51:21.725 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T15:51:51.816 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T15:51:51.824 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T15:52:21.960 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T15:52:21.976 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T15:52:52.182 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T15:52:52.195 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T15:53:22.330 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T15:53:22.346 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T15:53:52.488 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T15:53:52.507 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T15:54:23.041 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T15:54:23.046 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T15:54:53.132 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T15:54:53.143 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T15:55:23.205 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T15:55:23.213 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T15:55:53.448 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T15:55:53.467 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T15:55:53.815 INFO:tasks.ceph.osd.0.smithi102.stderr:2023-11-13T15:55:53.809+0000 7efed7bed640 -1 received signal: Hangup from (PID: 465519) UID: 0 2023-11-13T15:55:53.816 INFO:tasks.ceph.osd.2.smithi102.stderr:2023-11-13T15:55:53.809+0000 7f17fbe34640 -1 received signal: Hangup from (PID: 465519) UID: 0 2023-11-13T15:55:53.816 INFO:tasks.ceph.osd.1.smithi102.stderr:2023-11-13T15:55:53.809+0000 7f33d1116640 -1 received signal: Hangup from (PID: 465519) UID: 0 2023-11-13T15:55:53.818 INFO:tasks.ceph.osd.3.smithi102.stderr:2023-11-13T15:55:53.809+0000 7f48d17a6640 -1 Fail to open '/proc/465519/cmdline' error = (2) No such file or directory 2023-11-13T15:55:53.818 INFO:tasks.ceph.osd.3.smithi102.stderr:2023-11-13T15:55:53.809+0000 7f48d17a6640 -1 received signal: Hangup from (PID: 465519) UID: 0 2023-11-13T16:02:29.677 INFO:teuthology.orchestra.run.smithi102.stderr:error: Compressing program wrote following message to stderr when compressing log /var/log/ceph/ceph-osd.3.log.1: 2023-11-13T16:02:29.678 INFO:teuthology.orchestra.run.smithi102.stderr:gzip: stdin: file size changed while zipping 2023-11-13T16:03:07.351 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T16:03:07.361 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T16:03:07.708 INFO:tasks.ceph.mds.c.smithi102.stderr:2023-11-13T16:03:07.700+0000 7fe15259f640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 466495) UID: 0 2023-11-13T16:03:07.709 INFO:tasks.ceph.mds.a.smithi102.stderr:2023-11-13T16:03:07.696+0000 7fd988155640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 466495) UID: 0 2023-11-13T16:11:09.142 INFO:tasks.ceph.osd.0.smithi102.stderr:2023-11-13T16:11:09.135+0000 7efed7bed640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 467429) UID: 0 2023-11-13T16:11:09.143 INFO:tasks.ceph.osd.1.smithi102.stderr:2023-11-13T16:11:09.135+0000 7f33d1116640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 467429) UID: 0 2023-11-13T16:11:09.144 INFO:tasks.ceph.osd.3.smithi102.stderr:2023-11-13T16:11:09.135+0000 7f48d17a6640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 467429) UID: 0 2023-11-13T16:11:09.144 INFO:tasks.ceph.osd.2.smithi102.stderr:2023-11-13T16:11:09.135+0000 7f17fbe34640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 467429) UID: 0 2023-11-13T16:19:55.745 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T16:19:55.818 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T16:20:26.319 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T16:20:26.348 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T16:20:56.669 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T16:20:56.682 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T16:21:26.934 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T16:21:26.941 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T16:21:57.038 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T16:21:57.071 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T16:22:27.637 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T16:22:27.642 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T16:22:57.697 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T16:22:57.774 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T16:23:27.889 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T16:23:27.910 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T16:23:58.095 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T16:23:58.102 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T16:24:28.278 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T16:24:28.312 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T16:24:58.509 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T16:24:58.574 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T16:25:28.808 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T16:25:28.895 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T16:25:59.279 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T16:25:59.343 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T16:25:59.463 INFO:tasks.ceph.osd.1.smithi102.stderr:2023-11-13T16:25:59.457+0000 7f33d1116640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 469325) UID: 0 2023-11-13T16:25:59.463 INFO:tasks.ceph.osd.0.smithi102.stderr:2023-11-13T16:25:59.457+0000 7efed7bed640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 469325) UID: 0 2023-11-13T16:25:59.464 INFO:tasks.ceph.osd.3.smithi102.stderr:2023-11-13T16:25:59.457+0000 7f48d17a6640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 469325) UID: 0 2023-11-13T16:25:59.464 INFO:tasks.ceph.osd.2.smithi102.stderr:2023-11-13T16:25:59.457+0000 7f17fbe34640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 469325) UID: 0 2023-11-13T16:33:24.322 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T16:33:24.362 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T16:33:24.423 INFO:tasks.ceph.osd.6.smithi154.stderr:2023-11-13T16:33:24.415+0000 7f3c803e2640 -1 received signal: Hangup from (PID: 45750) UID: 0 2023-11-13T16:33:24.424 INFO:tasks.ceph.osd.5.smithi154.stderr:2023-11-13T16:33:24.415+0000 7f77ec91b640 -1 Fail to open '/proc/45750/cmdline' error = (2) No such file or directory 2023-11-13T16:33:24.425 INFO:tasks.ceph.osd.4.smithi154.stderr:2023-11-13T16:33:24.415+0000 7fce06bbb640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 45750) UID: 0 2023-11-13T16:33:24.425 INFO:tasks.ceph.osd.5.smithi154.stderr:2023-11-13T16:33:24.415+0000 7f77ec91b640 -1 received signal: Hangup from (PID: 45750) UID: 0 2023-11-13T16:33:24.426 INFO:tasks.ceph.osd.7.smithi154.stderr:2023-11-13T16:33:24.415+0000 7f10baf5d640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 45750) UID: 0 2023-11-13T16:38:16.136 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T16:38:16.150 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T16:38:16.428 INFO:tasks.ceph.mds.c.smithi102.stderr:2023-11-13T16:38:16.422+0000 7fe15259f640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 470840) UID: 0 2023-11-13T16:38:16.460 INFO:tasks.ceph.mds.a.smithi102.stderr:2023-11-13T16:38:16.422+0000 7fd988155640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 470840) UID: 0 2023-11-13T16:46:41.484 INFO:teuthology.orchestra.run.smithi102.stderr:error: Compressing program wrote following message to stderr when compressing log /var/log/ceph/ceph-mds.a.log.1: 2023-11-13T16:46:41.484 INFO:teuthology.orchestra.run.smithi102.stderr:gzip: stdin: file size changed while zipping 2023-11-13T16:47:24.226 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T16:47:24.234 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T16:47:54.596 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T16:47:54.612 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T16:48:24.691 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T16:48:24.714 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T16:48:55.098 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T16:48:55.111 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T16:49:25.259 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T16:49:25.281 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T16:49:55.582 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T16:49:55.619 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T16:50:25.879 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T16:50:25.909 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T16:50:56.358 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T16:50:56.370 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T16:51:26.499 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T16:51:26.508 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T16:51:56.977 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T16:51:56.992 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T16:52:27.146 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T16:52:27.156 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T16:52:57.384 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T16:52:57.412 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T16:53:27.798 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T16:53:27.809 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T16:53:57.979 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T16:53:57.995 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T16:54:28.235 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T16:54:28.243 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T16:54:58.410 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T16:54:58.426 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T16:55:28.795 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T16:55:28.829 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T16:55:59.012 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T16:55:59.038 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T16:56:29.273 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T16:56:29.279 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T16:56:59.588 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T16:56:59.606 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T16:57:29.791 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T16:57:29.802 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T16:58:00.337 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T16:58:00.383 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T16:58:30.641 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T16:58:30.654 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T16:59:00.885 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T16:59:00.891 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T16:59:31.147 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T16:59:31.207 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T17:00:01.404 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T17:00:01.459 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T17:00:31.561 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T17:00:31.565 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T17:01:01.891 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T17:01:01.896 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T17:01:32.680 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T17:01:32.685 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T17:02:02.871 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T17:02:02.885 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T17:02:33.444 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T17:02:33.455 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T17:03:03.636 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T17:03:03.673 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T17:03:33.913 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T17:03:33.923 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T17:04:04.021 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T17:04:04.028 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T17:04:34.690 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T17:04:34.696 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T17:05:04.822 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T17:05:04.844 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T17:05:35.056 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T17:05:35.067 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T17:06:05.332 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T17:06:05.406 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T17:06:35.734 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T17:06:35.740 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T17:07:06.961 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T17:07:06.966 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T17:07:37.481 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T17:07:37.502 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T17:08:07.845 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T17:08:07.887 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T17:08:38.682 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T17:08:38.693 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T17:09:10.176 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T17:09:10.218 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T17:09:10.247 INFO:tasks.ceph.osd.4.smithi154.stderr:2023-11-13T17:09:10.239+0000 7fce06bbb640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 45988) UID: 0 2023-11-13T17:09:10.248 INFO:tasks.ceph.osd.6.smithi154.stderr:2023-11-13T17:09:10.239+0000 7f3c803e2640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 45988) UID: 0 2023-11-13T17:09:10.248 INFO:tasks.ceph.osd.7.smithi154.stderr:2023-11-13T17:09:10.239+0000 7f10baf5d640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 45988) UID: 0 2023-11-13T17:09:10.249 INFO:tasks.ceph.osd.5.smithi154.stderr:2023-11-13T17:09:10.239+0000 7f77ec91b640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 45988) UID: 0 2023-11-13T17:11:47.077 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T17:11:47.096 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T17:11:47.553 INFO:tasks.ceph.mds.c.smithi102.stderr:2023-11-13T17:11:47.526+0000 7fe15259f640 -1 Fail to open '/proc/475167/cmdline' error = (2) No such file or directory 2023-11-13T17:11:47.553 INFO:tasks.ceph.mds.c.smithi102.stderr:2023-11-13T17:11:47.542+0000 7fe15259f640 -1 received signal: Hangup from (PID: 475167) UID: 0 2023-11-13T17:11:47.553 INFO:tasks.ceph.mds.a.smithi102.stderr:2023-11-13T17:11:47.546+0000 7fd988155640 -1 Fail to open '/proc/475167/cmdline' error = (2) No such file or directory 2023-11-13T17:11:47.554 INFO:tasks.ceph.mds.a.smithi102.stderr:2023-11-13T17:11:47.546+0000 7fd988155640 -1 received signal: Hangup from (PID: 475167) UID: 0 2023-11-13T17:20:26.700 INFO:tasks.ceph.osd.1.smithi102.stderr:2023-11-13T17:20:26.696+0000 7f33d1116640 -1 Fail to open '/proc/476211/cmdline' error = (2) No such file or directory 2023-11-13T17:20:26.702 INFO:tasks.ceph.osd.2.smithi102.stderr:2023-11-13T17:20:26.696+0000 7f17fbe34640 -1 Fail to open '/proc/476211/cmdline' error = (2) No such file or directory 2023-11-13T17:20:26.702 INFO:tasks.ceph.osd.2.smithi102.stderr:2023-11-13T17:20:26.696+0000 7f17fbe34640 -1 received signal: Hangup from (PID: 476211) UID: 0 2023-11-13T17:20:26.703 INFO:tasks.ceph.osd.1.smithi102.stderr:2023-11-13T17:20:26.696+0000 7f33d1116640 -1 received signal: Hangup from (PID: 476211) UID: 0 2023-11-13T17:20:26.703 INFO:tasks.ceph.osd.0.smithi102.stderr:2023-11-13T17:20:26.696+0000 7efed7bed640 -1 Fail to open '/proc/476211/cmdline' error = (2) No such file or directory 2023-11-13T17:20:26.704 INFO:tasks.ceph.osd.0.smithi102.stderr:2023-11-13T17:20:26.696+0000 7efed7bed640 -1 received signal: Hangup from (PID: 476211) UID: 0 2023-11-13T17:20:26.705 INFO:tasks.ceph.osd.3.smithi102.stderr:2023-11-13T17:20:26.696+0000 7f48d17a6640 -1 Fail to open '/proc/476211/cmdline' error = (2) No such file or directory 2023-11-13T17:20:26.705 INFO:tasks.ceph.osd.3.smithi102.stderr:2023-11-13T17:20:26.696+0000 7f48d17a6640 -1 received signal: Hangup from (PID: 476211) UID: 0 2023-11-13T17:26:12.302 INFO:teuthology.orchestra.run.smithi102.stderr:error: Compressing program wrote following message to stderr when compressing log /var/log/ceph/ceph-osd.0.log.1: 2023-11-13T17:26:12.302 INFO:teuthology.orchestra.run.smithi102.stderr:gzip: stdin: file size changed while zipping 2023-11-13T17:26:47.825 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T17:26:47.832 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T17:26:47.867 INFO:tasks.ceph.osd.4.smithi154.stderr:2023-11-13T17:26:47.860+0000 7fce06bbb640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 46055) UID: 0 2023-11-13T17:26:47.868 INFO:tasks.ceph.osd.5.smithi154.stderr:2023-11-13T17:26:47.860+0000 7f77ec91b640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 46055) UID: 0 2023-11-13T17:26:47.869 INFO:tasks.ceph.osd.6.smithi154.stderr:2023-11-13T17:26:47.860+0000 7f3c803e2640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 46055) UID: 0 2023-11-13T17:26:47.869 INFO:tasks.ceph.osd.7.smithi154.stderr:2023-11-13T17:26:47.860+0000 7f10baf5d640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 46055) UID: 0 2023-11-13T17:28:47.604 INFO:teuthology.orchestra.run.smithi102.stdout:generic/650 6298s 2023-11-13T17:28:47.770 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/650 2023-11-13T17:28:47.770 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T17:28:47.794 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T17:28:47.840 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T17:28:47.841 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/651) 2023-11-13T17:28:49.316 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T17:28:49.343 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T17:28:49.343 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T17:28:50.275 INFO:teuthology.orchestra.run.smithi102.stdout:generic/651 [not run] this test requires a valid $SCRATCH_DEV 2023-11-13T17:28:50.308 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/651 2023-11-13T17:28:50.308 INFO:teuthology.orchestra.run.smithi102.stdout:Not run: generic/651 2023-11-13T17:28:50.309 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T17:28:50.321 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T17:28:50.362 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T17:28:50.363 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/652) 2023-11-13T17:28:51.539 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T17:28:51.578 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T17:28:51.579 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T17:28:52.485 INFO:teuthology.orchestra.run.smithi102.stdout:generic/652 [not run] this test requires a valid $SCRATCH_DEV 2023-11-13T17:28:52.521 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/652 2023-11-13T17:28:52.521 INFO:teuthology.orchestra.run.smithi102.stdout:Not run: generic/652 2023-11-13T17:28:52.522 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T17:28:52.536 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T17:28:52.587 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T17:28:52.587 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/653) 2023-11-13T17:28:53.765 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T17:28:53.814 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T17:28:53.814 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T17:28:54.822 INFO:teuthology.orchestra.run.smithi102.stdout:generic/653 [not run] this test requires a valid $SCRATCH_DEV 2023-11-13T17:28:54.835 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/653 2023-11-13T17:28:54.836 INFO:teuthology.orchestra.run.smithi102.stdout:Not run: generic/653 2023-11-13T17:28:54.837 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T17:28:54.851 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T17:28:54.928 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T17:28:54.929 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/654) 2023-11-13T17:28:56.209 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T17:28:56.232 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T17:28:56.232 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T17:28:57.110 INFO:teuthology.orchestra.run.smithi102.stdout:generic/654 [not run] this test requires a valid $SCRATCH_DEV 2023-11-13T17:28:57.148 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/654 2023-11-13T17:28:57.148 INFO:teuthology.orchestra.run.smithi102.stdout:Not run: generic/654 2023-11-13T17:28:57.149 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T17:28:57.180 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T17:28:57.248 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T17:28:57.248 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/655) 2023-11-13T17:28:58.393 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T17:28:58.430 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T17:28:58.430 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T17:28:59.428 INFO:teuthology.orchestra.run.smithi102.stdout:generic/655 [not run] this test requires a valid $SCRATCH_DEV 2023-11-13T17:28:59.470 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/655 2023-11-13T17:28:59.471 INFO:teuthology.orchestra.run.smithi102.stdout:Not run: generic/655 2023-11-13T17:28:59.471 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T17:28:59.486 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T17:28:59.553 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T17:28:59.554 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/656) 2023-11-13T17:29:00.813 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T17:29:00.862 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T17:29:00.863 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T17:29:01.881 INFO:teuthology.orchestra.run.smithi102.stdout:generic/656 [not run] vfstest not support by ceph-fuse 2023-11-13T17:29:01.916 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/656 2023-11-13T17:29:01.917 INFO:teuthology.orchestra.run.smithi102.stdout:Not run: generic/656 2023-11-13T17:29:01.917 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T17:29:01.943 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T17:29:02.004 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T17:29:02.005 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/657) 2023-11-13T17:29:04.672 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T17:29:04.720 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T17:29:04.721 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T17:29:05.579 INFO:teuthology.orchestra.run.smithi102.stdout:generic/657 [not run] this test requires a valid $SCRATCH_DEV 2023-11-13T17:29:05.609 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/657 2023-11-13T17:29:05.610 INFO:teuthology.orchestra.run.smithi102.stdout:Not run: generic/657 2023-11-13T17:29:05.610 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T17:29:05.622 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T17:29:05.691 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T17:29:05.692 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/658) 2023-11-13T17:29:06.861 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T17:29:06.891 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T17:29:06.891 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T17:29:07.794 INFO:teuthology.orchestra.run.smithi102.stdout:generic/658 [not run] this test requires a valid $SCRATCH_DEV 2023-11-13T17:29:07.831 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/658 2023-11-13T17:29:07.831 INFO:teuthology.orchestra.run.smithi102.stdout:Not run: generic/658 2023-11-13T17:29:07.831 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T17:29:07.847 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T17:29:07.897 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T17:29:07.898 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/659) 2023-11-13T17:29:09.084 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T17:29:09.118 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T17:29:09.118 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T17:29:10.077 INFO:teuthology.orchestra.run.smithi102.stdout:generic/659 [not run] this test requires a valid $SCRATCH_DEV 2023-11-13T17:29:10.098 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/659 2023-11-13T17:29:10.099 INFO:teuthology.orchestra.run.smithi102.stdout:Not run: generic/659 2023-11-13T17:29:10.099 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T17:29:10.108 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T17:29:10.199 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T17:29:10.199 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/660) 2023-11-13T17:29:11.519 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T17:29:11.544 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T17:29:11.545 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T17:29:12.564 INFO:teuthology.orchestra.run.smithi102.stdout:generic/660 [not run] this test requires a valid $SCRATCH_DEV 2023-11-13T17:29:12.588 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/660 2023-11-13T17:29:12.588 INFO:teuthology.orchestra.run.smithi102.stdout:Not run: generic/660 2023-11-13T17:29:12.588 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T17:29:12.600 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T17:29:12.637 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T17:29:12.638 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/661) 2023-11-13T17:29:13.794 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T17:29:13.827 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T17:29:13.827 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T17:29:14.756 INFO:teuthology.orchestra.run.smithi102.stdout:generic/661 [not run] this test requires a valid $SCRATCH_DEV 2023-11-13T17:29:14.786 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/661 2023-11-13T17:29:14.786 INFO:teuthology.orchestra.run.smithi102.stdout:Not run: generic/661 2023-11-13T17:29:14.786 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T17:29:14.799 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T17:29:14.842 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T17:29:14.843 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/662) 2023-11-13T17:29:15.878 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T17:29:15.910 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T17:29:15.911 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T17:29:16.928 INFO:teuthology.orchestra.run.smithi102.stdout:generic/662 [not run] this test requires a valid $SCRATCH_DEV 2023-11-13T17:29:16.940 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/662 2023-11-13T17:29:16.940 INFO:teuthology.orchestra.run.smithi102.stdout:Not run: generic/662 2023-11-13T17:29:16.940 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T17:29:16.963 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T17:29:17.058 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T17:29:17.059 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/663) 2023-11-13T17:29:18.292 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T17:29:18.323 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T17:29:18.323 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T17:29:19.198 INFO:teuthology.orchestra.run.smithi102.stdout:generic/663 [not run] this test requires a valid $SCRATCH_DEV 2023-11-13T17:29:19.211 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/663 2023-11-13T17:29:19.211 INFO:teuthology.orchestra.run.smithi102.stdout:Not run: generic/663 2023-11-13T17:29:19.212 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T17:29:19.222 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T17:29:19.301 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T17:29:19.302 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/664) 2023-11-13T17:29:20.482 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T17:29:20.506 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T17:29:20.506 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T17:29:21.453 INFO:teuthology.orchestra.run.smithi102.stdout:generic/664 [not run] this test requires a valid $SCRATCH_DEV 2023-11-13T17:29:21.480 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/664 2023-11-13T17:29:21.480 INFO:teuthology.orchestra.run.smithi102.stdout:Not run: generic/664 2023-11-13T17:29:21.480 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T17:29:21.493 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T17:29:21.542 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T17:29:21.543 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/665) 2023-11-13T17:29:22.705 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T17:29:22.759 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T17:29:22.759 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T17:29:23.644 INFO:teuthology.orchestra.run.smithi102.stdout:generic/665 [not run] this test requires a valid $SCRATCH_DEV 2023-11-13T17:29:23.678 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/665 2023-11-13T17:29:23.679 INFO:teuthology.orchestra.run.smithi102.stdout:Not run: generic/665 2023-11-13T17:29:23.679 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T17:29:23.695 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T17:29:23.763 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T17:29:23.764 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/666) 2023-11-13T17:29:24.967 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T17:29:24.983 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T17:29:24.984 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T17:29:25.876 INFO:teuthology.orchestra.run.smithi102.stdout:generic/666 [not run] this test requires a valid $SCRATCH_DEV 2023-11-13T17:29:25.902 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/666 2023-11-13T17:29:25.902 INFO:teuthology.orchestra.run.smithi102.stdout:Not run: generic/666 2023-11-13T17:29:25.903 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T17:29:25.930 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T17:29:25.980 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T17:29:25.981 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/667) 2023-11-13T17:29:27.195 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T17:29:27.248 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T17:29:27.249 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T17:29:28.237 INFO:teuthology.orchestra.run.smithi102.stdout:generic/667 [not run] this test requires a valid $SCRATCH_DEV 2023-11-13T17:29:28.268 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/667 2023-11-13T17:29:28.269 INFO:teuthology.orchestra.run.smithi102.stdout:Not run: generic/667 2023-11-13T17:29:28.269 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T17:29:28.300 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T17:29:28.389 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T17:29:28.390 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/668) 2023-11-13T17:29:29.548 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T17:29:29.596 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T17:29:29.596 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T17:29:30.447 INFO:teuthology.orchestra.run.smithi102.stdout:generic/668 [not run] this test requires a valid $SCRATCH_DEV 2023-11-13T17:29:30.485 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/668 2023-11-13T17:29:30.486 INFO:teuthology.orchestra.run.smithi102.stdout:Not run: generic/668 2023-11-13T17:29:30.486 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T17:29:30.505 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T17:29:30.558 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T17:29:30.559 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/669) 2023-11-13T17:29:31.693 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T17:29:31.725 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T17:29:31.726 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T17:29:32.553 INFO:teuthology.orchestra.run.smithi102.stdout:generic/669 [not run] this test requires a valid $SCRATCH_DEV 2023-11-13T17:29:32.584 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/669 2023-11-13T17:29:32.584 INFO:teuthology.orchestra.run.smithi102.stdout:Not run: generic/669 2023-11-13T17:29:32.585 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T17:29:32.609 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T17:29:32.661 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T17:29:32.662 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/670) 2023-11-13T17:29:33.770 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T17:29:33.810 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T17:29:33.811 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T17:29:34.775 INFO:teuthology.orchestra.run.smithi102.stdout:generic/670 [not run] this test requires a valid $SCRATCH_DEV 2023-11-13T17:29:34.808 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/670 2023-11-13T17:29:34.808 INFO:teuthology.orchestra.run.smithi102.stdout:Not run: generic/670 2023-11-13T17:29:34.808 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T17:29:34.834 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T17:29:34.900 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T17:29:34.902 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/671) 2023-11-13T17:29:36.146 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T17:29:36.196 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T17:29:36.196 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T17:29:37.136 INFO:teuthology.orchestra.run.smithi102.stdout:generic/671 [not run] this test requires a valid $SCRATCH_DEV 2023-11-13T17:29:37.172 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/671 2023-11-13T17:29:37.173 INFO:teuthology.orchestra.run.smithi102.stdout:Not run: generic/671 2023-11-13T17:29:37.173 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T17:29:37.184 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T17:29:37.251 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T17:29:37.252 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/672) 2023-11-13T17:29:37.843 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T17:29:37.853 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T17:29:38.496 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T17:29:38.540 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T17:29:38.540 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T17:29:39.528 INFO:teuthology.orchestra.run.smithi102.stdout:generic/672 [not run] this test requires a valid $SCRATCH_DEV 2023-11-13T17:29:39.547 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/672 2023-11-13T17:29:39.547 INFO:teuthology.orchestra.run.smithi102.stdout:Not run: generic/672 2023-11-13T17:29:39.548 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T17:29:39.558 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T17:29:39.601 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T17:29:39.601 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/673) 2023-11-13T17:29:40.883 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T17:29:40.908 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T17:29:40.908 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T17:29:42.646 INFO:teuthology.orchestra.run.smithi102.stdout:generic/673 [not run] this test requires a valid $SCRATCH_DEV 2023-11-13T17:29:42.665 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/673 2023-11-13T17:29:42.666 INFO:teuthology.orchestra.run.smithi102.stdout:Not run: generic/673 2023-11-13T17:29:42.666 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T17:29:42.686 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T17:29:42.739 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T17:29:42.739 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/674) 2023-11-13T17:29:44.176 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T17:29:44.211 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T17:29:44.211 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T17:29:45.246 INFO:teuthology.orchestra.run.smithi102.stdout:generic/674 [not run] this test requires a valid $SCRATCH_DEV 2023-11-13T17:29:45.261 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/674 2023-11-13T17:29:45.261 INFO:teuthology.orchestra.run.smithi102.stdout:Not run: generic/674 2023-11-13T17:29:45.261 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T17:29:45.274 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T17:29:45.361 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T17:29:45.362 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/675) 2023-11-13T17:29:46.740 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T17:29:46.772 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T17:29:46.773 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T17:29:48.064 INFO:teuthology.orchestra.run.smithi102.stdout:generic/675 [not run] this test requires a valid $SCRATCH_DEV 2023-11-13T17:29:48.079 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/675 2023-11-13T17:29:48.080 INFO:teuthology.orchestra.run.smithi102.stdout:Not run: generic/675 2023-11-13T17:29:48.080 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T17:29:48.098 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T17:29:48.134 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T17:29:48.134 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/676) 2023-11-13T17:29:49.302 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T17:29:49.351 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T17:29:49.351 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T17:30:08.048 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T17:30:08.055 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T17:30:39.318 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T17:30:39.325 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T17:31:09.599 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T17:31:09.617 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T17:31:39.752 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T17:31:39.778 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T17:32:09.897 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T17:32:09.911 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T17:32:40.056 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T17:32:40.072 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T17:33:10.191 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T17:33:10.197 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T17:33:10.602 INFO:tasks.ceph.mds.c.smithi102.stderr:2023-11-13T17:33:10.596+0000 7fe15259f640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 486998) UID: 0 2023-11-13T17:33:10.603 INFO:tasks.ceph.mds.a.smithi102.stderr:2023-11-13T17:33:10.596+0000 7fd988155640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 486998) UID: 0 2023-11-13T17:40:00.711 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T17:40:00.725 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T17:40:30.858 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T17:40:30.882 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T17:41:01.023 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T17:41:01.039 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T17:41:31.202 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T17:41:31.208 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T17:41:31.435 INFO:tasks.ceph.osd.0.smithi102.stderr:2023-11-13T17:41:31.430+0000 7efed7bed640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 487025) UID: 0 2023-11-13T17:41:31.436 INFO:tasks.ceph.osd.2.smithi102.stderr:2023-11-13T17:41:31.430+0000 7f17fbe34640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 487025) UID: 0 2023-11-13T17:41:31.436 INFO:tasks.ceph.osd.3.smithi102.stderr:2023-11-13T17:41:31.430+0000 7f48d17a6640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 487025) UID: 0 2023-11-13T17:41:31.438 INFO:tasks.ceph.osd.1.smithi102.stderr:2023-11-13T17:41:31.430+0000 7f33d1116640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 487025) UID: 0 2023-11-13T17:48:25.836 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T17:48:25.848 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T17:48:56.457 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T17:48:56.466 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T17:49:26.549 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T17:49:26.577 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T17:49:56.694 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T17:49:56.700 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T17:49:56.786 INFO:tasks.ceph.mds.c.smithi102.stderr:2023-11-13T17:49:56.784+0000 7fe15259f640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 487059) UID: 0 2023-11-13T17:49:56.792 INFO:tasks.ceph.mds.a.smithi102.stderr:2023-11-13T17:49:56.784+0000 7fd988155640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 487059) UID: 0 2023-11-13T17:55:46.219 INFO:tasks.ceph.osd.2.smithi102.stderr:2023-11-13T17:55:46.208+0000 7f17fbe34640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 487076) UID: 0 2023-11-13T17:55:46.221 INFO:tasks.ceph.osd.3.smithi102.stderr:2023-11-13T17:55:46.208+0000 7f48d17a6640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 487076) UID: 0 2023-11-13T17:55:46.221 INFO:tasks.ceph.osd.0.smithi102.stderr:2023-11-13T17:55:46.208+0000 7efed7bed640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 487076) UID: 0 2023-11-13T17:55:46.230 INFO:tasks.ceph.osd.1.smithi102.stderr:2023-11-13T17:55:46.208+0000 7f33d1116640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 487076) UID: 0 2023-11-13T18:03:34.015 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T18:03:34.020 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T18:03:34.108 INFO:tasks.ceph.osd.4.smithi154.stderr:2023-11-13T18:03:34.099+0000 7fce06bbb640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 46166) UID: 0 2023-11-13T18:03:34.108 INFO:tasks.ceph.osd.5.smithi154.stderr:2023-11-13T18:03:34.099+0000 7f77ec91b640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 46166) UID: 0 2023-11-13T18:03:34.109 INFO:tasks.ceph.osd.6.smithi154.stderr:2023-11-13T18:03:34.099+0000 7f3c803e2640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 46166) UID: 0 2023-11-13T18:03:34.109 INFO:tasks.ceph.osd.7.smithi154.stderr:2023-11-13T18:03:34.099+0000 7f10baf5d640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 46166) UID: 0 2023-11-13T18:06:29.486 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T18:06:29.495 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T18:06:29.692 INFO:tasks.ceph.mds.c.smithi102.stderr:2023-11-13T18:06:29.687+0000 7fe15259f640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 487102) UID: 0 2023-11-13T18:06:29.692 INFO:tasks.ceph.mds.a.smithi102.stderr:2023-11-13T18:06:29.687+0000 7fd988155640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 487102) UID: 0 2023-11-13T18:13:00.695 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T18:13:00.710 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T18:13:31.011 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T18:13:31.032 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T18:14:01.095 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T18:14:01.105 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T18:14:31.189 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T18:14:31.211 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T18:15:01.350 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T18:15:01.371 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T18:15:31.554 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T18:15:31.567 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T18:16:01.719 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T18:16:01.734 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T18:16:31.871 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T18:16:31.887 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T18:17:03.052 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T18:17:03.060 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T18:17:33.396 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T18:17:33.414 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T18:18:03.717 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T18:18:03.724 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T18:18:33.831 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T18:18:33.836 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T18:19:04.811 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T18:19:04.817 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T18:19:04.967 INFO:tasks.ceph.osd.1.smithi102.stderr:2023-11-13T18:19:04.960+0000 7f33d1116640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 487156) UID: 0 2023-11-13T18:19:04.968 INFO:tasks.ceph.osd.2.smithi102.stderr:2023-11-13T18:19:04.960+0000 7f17fbe34640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 487156) UID: 0 2023-11-13T18:19:04.968 INFO:tasks.ceph.osd.0.smithi102.stderr:2023-11-13T18:19:04.960+0000 7efed7bed640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 487156) UID: 0 2023-11-13T18:19:04.969 INFO:tasks.ceph.osd.3.smithi102.stderr:2023-11-13T18:19:04.964+0000 7f48d17a6640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 487156) UID: 0 2023-11-13T18:26:05.543 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T18:26:05.550 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T18:26:05.670 INFO:tasks.ceph.mds.c.smithi102.stderr:2023-11-13T18:26:05.663+0000 7fe15259f640 -1 Fail to open '/proc/487176/cmdline' error = (2) No such file or directory 2023-11-13T18:26:05.671 INFO:tasks.ceph.mds.c.smithi102.stderr:2023-11-13T18:26:05.663+0000 7fe15259f640 -1 received signal: Hangup from (PID: 487176) UID: 0 2023-11-13T18:26:05.671 INFO:tasks.ceph.mds.a.smithi102.stderr:2023-11-13T18:26:05.663+0000 7fd988155640 -1 Fail to open '/proc/487176/cmdline' error = (2) No such file or directory 2023-11-13T18:26:05.671 INFO:tasks.ceph.mds.a.smithi102.stderr:2023-11-13T18:26:05.663+0000 7fd988155640 -1 received signal: Hangup from (PID: 487176) UID: 0 2023-11-13T18:26:05.675 INFO:tasks.ceph.osd.4.smithi154.stderr:2023-11-13T18:26:05.668+0000 7fce06bbb640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 46257) UID: 0 2023-11-13T18:26:05.675 INFO:tasks.ceph.osd.5.smithi154.stderr:2023-11-13T18:26:05.668+0000 7f77ec91b640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 46257) UID: 0 2023-11-13T18:26:05.676 INFO:tasks.ceph.osd.7.smithi154.stderr:2023-11-13T18:26:05.668+0000 7f10baf5d640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 46257) UID: 0 2023-11-13T18:26:05.677 INFO:tasks.ceph.osd.6.smithi154.stderr:2023-11-13T18:26:05.668+0000 7f3c803e2640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 46257) UID: 0 2023-11-13T18:33:22.554 INFO:teuthology.orchestra.run.smithi102.stderr:error: Compressing program wrote following message to stderr when compressing log /var/log/ceph/ceph-mds.a.log.1: 2023-11-13T18:33:22.555 INFO:teuthology.orchestra.run.smithi102.stderr:gzip: stdin: file size changed while zipping 2023-11-13T18:33:57.827 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T18:33:57.833 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T18:34:28.133 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T18:34:28.140 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T18:34:58.240 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T18:34:58.246 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T18:35:28.305 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T18:35:28.311 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T18:35:58.446 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T18:35:58.452 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T18:36:29.590 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T18:36:29.604 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T18:36:59.910 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T18:36:59.923 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T18:37:30.015 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T18:37:30.034 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T18:37:55.206 INFO:teuthology.orchestra.run.smithi102.stdout:generic/676 4086s 2023-11-13T18:37:55.354 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/676 2023-11-13T18:37:55.354 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T18:37:55.379 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T18:37:55.496 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T18:37:55.497 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/677) 2023-11-13T18:37:57.968 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T18:37:58.011 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T18:37:58.011 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T18:38:00.167 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T18:38:00.179 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T18:38:02.235 INFO:teuthology.orchestra.run.smithi102.stdout:generic/677 [not run] this test requires a valid $SCRATCH_DEV 2023-11-13T18:38:02.271 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/677 2023-11-13T18:38:02.272 INFO:teuthology.orchestra.run.smithi102.stdout:Not run: generic/677 2023-11-13T18:38:02.272 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T18:38:02.295 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T18:38:02.356 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T18:38:02.357 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/678) 2023-11-13T18:38:03.571 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T18:38:03.597 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T18:38:03.598 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T18:38:05.084 INFO:teuthology.orchestra.run.smithi102.stdout:generic/678 2s 2023-11-13T18:38:05.141 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/678 2023-11-13T18:38:05.141 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T18:38:05.150 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T18:38:05.212 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T18:38:05.212 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/679) 2023-11-13T18:38:06.964 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T18:38:06.989 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T18:38:06.989 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T18:38:08.209 INFO:teuthology.orchestra.run.smithi102.stdout:generic/679 [not run] this test requires a valid $SCRATCH_DEV 2023-11-13T18:38:08.235 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/679 2023-11-13T18:38:08.235 INFO:teuthology.orchestra.run.smithi102.stdout:Not run: generic/679 2023-11-13T18:38:08.235 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T18:38:08.265 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T18:38:08.353 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T18:38:08.354 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/680) 2023-11-13T18:38:09.487 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T18:38:09.502 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T18:38:09.503 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T18:38:11.926 INFO:teuthology.orchestra.run.smithi102.stdout:generic/680 2s 2023-11-13T18:38:11.984 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/680 2023-11-13T18:38:11.985 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T18:38:12.011 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T18:38:12.061 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T18:38:12.062 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/681) 2023-11-13T18:38:13.880 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T18:38:13.912 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T18:38:13.912 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T18:38:14.849 INFO:teuthology.orchestra.run.smithi102.stdout:generic/681 [not run] disk quotas not supported by this filesystem type: ceph-fuse 2023-11-13T18:38:14.864 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/681 2023-11-13T18:38:14.864 INFO:teuthology.orchestra.run.smithi102.stdout:Not run: generic/681 2023-11-13T18:38:14.864 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T18:38:14.879 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T18:38:14.911 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T18:38:14.912 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/682) 2023-11-13T18:38:16.126 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T18:38:16.157 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T18:38:16.157 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T18:38:17.066 INFO:teuthology.orchestra.run.smithi102.stdout:generic/682 [not run] disk quotas not supported by this filesystem type: ceph-fuse 2023-11-13T18:38:17.091 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/682 2023-11-13T18:38:17.092 INFO:teuthology.orchestra.run.smithi102.stdout:Not run: generic/682 2023-11-13T18:38:17.092 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T18:38:17.102 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T18:38:17.171 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T18:38:17.172 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/683) 2023-11-13T18:38:18.311 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T18:38:18.342 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T18:38:18.342 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T18:38:19.592 INFO:teuthology.orchestra.run.smithi102.stdout:generic/683 [not run] /tmp/tmp.T3Y73qtatntest: file alloc unit 4194304 larger than op length 65536 2023-11-13T18:38:19.613 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/683 2023-11-13T18:38:19.613 INFO:teuthology.orchestra.run.smithi102.stdout:Not run: generic/683 2023-11-13T18:38:19.613 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T18:38:19.629 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T18:38:19.704 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T18:38:19.704 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/684) 2023-11-13T18:38:20.943 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T18:38:20.986 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T18:38:20.986 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T18:38:26.702 INFO:teuthology.orchestra.run.smithi102.stdout:generic/684 [not run] /tmp/tmp.T3Y73qtatntest: file alloc unit 4194304 larger than op length 65536 2023-11-13T18:38:26.730 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/684 2023-11-13T18:38:26.731 INFO:teuthology.orchestra.run.smithi102.stdout:Not run: generic/684 2023-11-13T18:38:26.731 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T18:38:26.749 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T18:38:26.815 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T18:38:26.815 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/685) 2023-11-13T18:38:28.049 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T18:38:28.082 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T18:38:28.086 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T18:38:31.552 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T18:38:31.565 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T18:38:33.459 INFO:teuthology.orchestra.run.smithi102.stdout:generic/685 [not run] xfs_io fzero failed (old kernel/wrong fs?) 2023-11-13T18:38:33.503 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/685 2023-11-13T18:38:33.504 INFO:teuthology.orchestra.run.smithi102.stdout:Not run: generic/685 2023-11-13T18:38:33.505 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T18:38:33.533 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T18:38:33.573 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T18:38:33.574 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/686) 2023-11-13T18:38:34.818 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T18:38:34.852 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T18:38:34.853 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T18:38:40.537 INFO:teuthology.orchestra.run.smithi102.stdout:generic/686 [not run] xfs_io finsert failed (old kernel/wrong fs?) 2023-11-13T18:38:40.558 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/686 2023-11-13T18:38:40.559 INFO:teuthology.orchestra.run.smithi102.stdout:Not run: generic/686 2023-11-13T18:38:40.559 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T18:38:40.588 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T18:38:40.658 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T18:38:40.659 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/687) 2023-11-13T18:38:41.932 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T18:38:41.974 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T18:38:41.975 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T18:38:47.572 INFO:teuthology.orchestra.run.smithi102.stdout:generic/687 [not run] xfs_io fcollapse failed (old kernel/wrong fs?) 2023-11-13T18:38:47.587 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/687 2023-11-13T18:38:47.587 INFO:teuthology.orchestra.run.smithi102.stdout:Not run: generic/687 2023-11-13T18:38:47.588 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T18:38:47.605 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T18:38:47.688 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T18:38:47.688 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/688) 2023-11-13T18:38:49.002 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T18:38:49.053 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T18:38:49.053 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T18:38:50.404 INFO:teuthology.orchestra.run.smithi102.stdout:generic/688 [not run] /tmp/tmp.T3Y73qtatntest: file alloc unit 4194304 larger than op length 65536 2023-11-13T18:38:50.420 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/688 2023-11-13T18:38:50.420 INFO:teuthology.orchestra.run.smithi102.stdout:Not run: generic/688 2023-11-13T18:38:50.420 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T18:38:50.441 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T18:38:50.493 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T18:38:50.493 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/689) 2023-11-13T18:38:51.742 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T18:38:51.789 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T18:38:51.791 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T18:38:52.755 INFO:teuthology.orchestra.run.smithi102.stdout:generic/689 [not run] vfstest not support by ceph-fuse 2023-11-13T18:38:52.787 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/689 2023-11-13T18:38:52.787 INFO:teuthology.orchestra.run.smithi102.stdout:Not run: generic/689 2023-11-13T18:38:52.787 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T18:38:52.814 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T18:38:52.895 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T18:38:52.896 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/690) 2023-11-13T18:38:53.961 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T18:38:54.005 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T18:38:54.005 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T18:38:54.955 INFO:teuthology.orchestra.run.smithi102.stdout:generic/690 [not run] this test requires a valid $SCRATCH_DEV 2023-11-13T18:38:54.970 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/690 2023-11-13T18:38:54.970 INFO:teuthology.orchestra.run.smithi102.stdout:Not run: generic/690 2023-11-13T18:38:54.970 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T18:38:54.987 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T18:38:55.091 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T18:38:55.092 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/691) 2023-11-13T18:38:56.423 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T18:38:56.462 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T18:38:56.463 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T18:38:57.347 INFO:teuthology.orchestra.run.smithi102.stdout:generic/691 [not run] this test requires a valid $SCRATCH_DEV 2023-11-13T18:38:57.367 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/691 2023-11-13T18:38:57.368 INFO:teuthology.orchestra.run.smithi102.stdout:Not run: generic/691 2023-11-13T18:38:57.368 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T18:38:57.390 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T18:38:57.457 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T18:38:57.458 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/692) 2023-11-13T18:38:58.683 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T18:38:58.714 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T18:38:58.714 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T18:38:59.679 INFO:teuthology.orchestra.run.smithi102.stdout:generic/692 [not run] this test requires a valid $SCRATCH_DEV 2023-11-13T18:38:59.693 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/692 2023-11-13T18:38:59.693 INFO:teuthology.orchestra.run.smithi102.stdout:Not run: generic/692 2023-11-13T18:38:59.694 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T18:38:59.706 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T18:38:59.750 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T18:38:59.751 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/693) 2023-11-13T18:39:01.094 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T18:39:01.126 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T18:39:01.126 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T18:39:01.714 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T18:39:01.719 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T18:39:02.405 INFO:teuthology.orchestra.run.smithi102.stdout:generic/693 [not run] this test requires a valid $SCRATCH_DEV 2023-11-13T18:39:02.437 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/693 2023-11-13T18:39:02.437 INFO:teuthology.orchestra.run.smithi102.stdout:Not run: generic/693 2023-11-13T18:39:02.437 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T18:39:02.446 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T18:39:02.550 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T18:39:02.551 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/694) 2023-11-13T18:39:03.732 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T18:39:03.781 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T18:39:03.782 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T18:39:06.020 INFO:teuthology.orchestra.run.smithi102.stdout:generic/694 2s 2023-11-13T18:39:06.151 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/694 2023-11-13T18:39:06.151 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T18:39:06.175 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T18:39:06.229 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T18:39:06.230 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/695) 2023-11-13T18:39:07.457 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T18:39:07.481 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T18:39:07.481 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T18:39:08.519 INFO:teuthology.orchestra.run.smithi102.stdout:generic/695 [not run] this test requires a valid $SCRATCH_DEV 2023-11-13T18:39:08.553 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/695 2023-11-13T18:39:08.553 INFO:teuthology.orchestra.run.smithi102.stdout:Not run: generic/695 2023-11-13T18:39:08.553 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T18:39:08.571 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T18:39:08.649 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T18:39:08.650 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/696) 2023-11-13T18:39:09.823 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T18:39:09.868 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T18:39:09.868 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T18:39:10.970 INFO:teuthology.orchestra.run.smithi102.stdout:generic/696 [not run] this test requires a valid $SCRATCH_DEV 2023-11-13T18:39:11.000 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/696 2023-11-13T18:39:11.000 INFO:teuthology.orchestra.run.smithi102.stdout:Not run: generic/696 2023-11-13T18:39:11.000 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T18:39:11.018 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T18:39:11.083 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T18:39:11.083 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/697) 2023-11-13T18:39:12.423 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T18:39:12.458 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T18:39:12.458 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T18:39:13.511 INFO:teuthology.orchestra.run.smithi102.stdout:generic/697 [not run] ACLs not supported by this filesystem type: ceph-fuse 2023-11-13T18:39:13.532 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/697 2023-11-13T18:39:13.532 INFO:teuthology.orchestra.run.smithi102.stdout:Not run: generic/697 2023-11-13T18:39:13.532 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T18:39:13.546 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T18:39:13.660 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T18:39:13.661 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/698) 2023-11-13T18:39:15.015 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T18:39:15.055 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T18:39:15.056 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T18:39:16.011 INFO:teuthology.orchestra.run.smithi102.stdout:generic/698 [not run] this test requires a valid $SCRATCH_DEV 2023-11-13T18:39:16.052 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/698 2023-11-13T18:39:16.053 INFO:teuthology.orchestra.run.smithi102.stdout:Not run: generic/698 2023-11-13T18:39:16.053 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T18:39:16.074 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T18:39:16.161 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T18:39:16.162 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/699) 2023-11-13T18:39:17.400 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T18:39:17.442 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T18:39:17.442 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T18:39:18.545 INFO:teuthology.orchestra.run.smithi102.stdout:generic/699 [not run] this test requires a valid $SCRATCH_DEV 2023-11-13T18:39:18.557 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/699 2023-11-13T18:39:18.559 INFO:teuthology.orchestra.run.smithi102.stdout:Not run: generic/699 2023-11-13T18:39:18.560 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T18:39:18.576 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T18:39:18.666 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T18:39:18.667 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/700) 2023-11-13T18:39:19.834 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T18:39:19.862 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T18:39:19.862 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T18:39:20.717 INFO:teuthology.orchestra.run.smithi102.stdout:generic/700 [not run] this test requires a valid $SCRATCH_DEV 2023-11-13T18:39:20.740 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/700 2023-11-13T18:39:20.740 INFO:teuthology.orchestra.run.smithi102.stdout:Not run: generic/700 2023-11-13T18:39:20.740 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T18:39:20.751 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T18:39:20.803 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T18:39:20.804 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/701) 2023-11-13T18:39:21.963 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T18:39:21.991 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T18:39:21.991 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T18:39:23.994 INFO:teuthology.orchestra.run.smithi102.stdout:generic/701 1s 2023-11-13T18:39:24.046 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/701 2023-11-13T18:39:24.046 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T18:39:24.061 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T18:39:24.258 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T18:39:24.258 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/702) 2023-11-13T18:39:25.828 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T18:39:25.838 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T18:39:25.838 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T18:39:26.791 INFO:teuthology.orchestra.run.smithi102.stdout:generic/702 [not run] this test requires a valid $SCRATCH_DEV 2023-11-13T18:39:26.814 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/702 2023-11-13T18:39:26.814 INFO:teuthology.orchestra.run.smithi102.stdout:Not run: generic/702 2023-11-13T18:39:26.815 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T18:39:26.829 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T18:39:26.877 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T18:39:26.878 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/703) 2023-11-13T18:39:28.175 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T18:39:28.219 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T18:39:28.220 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T18:39:29.286 INFO:teuthology.orchestra.run.smithi102.stdout:generic/703 [not run] this test requires a valid $SCRATCH_DEV 2023-11-13T18:39:29.303 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/703 2023-11-13T18:39:29.305 INFO:teuthology.orchestra.run.smithi102.stdout:Not run: generic/703 2023-11-13T18:39:29.305 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T18:39:29.327 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T18:39:29.407 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T18:39:29.408 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/704) 2023-11-13T18:39:30.663 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T18:39:30.701 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T18:39:30.701 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T18:39:31.902 INFO:teuthology.orchestra.run.smithi102.stdout:generic/704 [not run] require ceph-fuse to be valid block disk 2023-11-13T18:39:31.949 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/704 2023-11-13T18:39:31.950 INFO:teuthology.orchestra.run.smithi102.stdout:Not run: generic/704 2023-11-13T18:39:31.950 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T18:39:31.964 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T18:39:31.971 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T18:39:31.976 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T18:39:32.052 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T18:39:32.052 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/705) 2023-11-13T18:39:33.365 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T18:39:33.407 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T18:39:33.408 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T18:39:34.460 INFO:teuthology.orchestra.run.smithi102.stdout:generic/705 [not run] this test requires a valid $SCRATCH_DEV 2023-11-13T18:39:34.477 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/705 2023-11-13T18:39:34.478 INFO:teuthology.orchestra.run.smithi102.stdout:Not run: generic/705 2023-11-13T18:39:34.478 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T18:39:34.503 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T18:39:34.567 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T18:39:34.567 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/706) 2023-11-13T18:39:35.725 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T18:39:35.777 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T18:39:35.777 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T18:39:39.976 INFO:teuthology.orchestra.run.smithi102.stdout:generic/706 4s 2023-11-13T18:39:40.019 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/706 2023-11-13T18:39:40.019 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T18:39:40.038 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T18:39:40.093 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T18:39:40.094 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/707) 2023-11-13T18:39:41.850 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T18:39:41.897 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T18:39:41.897 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T18:39:42.775 INFO:teuthology.orchestra.run.smithi102.stdout:generic/707 [not run] this test requires a valid $SCRATCH_DEV 2023-11-13T18:39:42.792 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/707 2023-11-13T18:39:42.792 INFO:teuthology.orchestra.run.smithi102.stdout:Not run: generic/707 2023-11-13T18:39:42.792 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T18:39:42.814 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T18:39:42.867 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T18:39:42.868 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/708) 2023-11-13T18:39:44.132 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T18:39:44.187 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T18:39:44.188 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T18:39:46.544 INFO:teuthology.orchestra.run.smithi102.stdout:generic/708 2s 2023-11-13T18:39:46.594 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/708 2023-11-13T18:39:46.594 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T18:39:46.607 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T18:39:46.686 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T18:39:46.687 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/709) 2023-11-13T18:39:48.558 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T18:39:48.599 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T18:39:48.599 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T18:39:49.964 INFO:teuthology.orchestra.run.smithi102.stdout:generic/709 [not run] xfs_io swapext -v vfs not supported on ceph-fuse 2023-11-13T18:39:49.993 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/709 2023-11-13T18:39:49.994 INFO:teuthology.orchestra.run.smithi102.stdout:Not run: generic/709 2023-11-13T18:39:49.994 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T18:39:50.028 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T18:39:50.114 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T18:39:50.115 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/710) 2023-11-13T18:39:51.920 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T18:39:51.961 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T18:39:51.962 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T18:39:53.209 INFO:teuthology.orchestra.run.smithi102.stdout:generic/710 [not run] xfs_io swapext -v vfs not supported on ceph-fuse 2023-11-13T18:39:53.246 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/710 2023-11-13T18:39:53.247 INFO:teuthology.orchestra.run.smithi102.stdout:Not run: generic/710 2023-11-13T18:39:53.247 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T18:39:53.266 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T18:39:53.300 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T18:39:53.300 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/711) 2023-11-13T18:39:55.254 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T18:39:55.283 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T18:39:55.283 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T18:39:56.479 INFO:teuthology.orchestra.run.smithi102.stdout:generic/711 [not run] xfs_io swapext -v vfs not supported on ceph-fuse 2023-11-13T18:39:56.499 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/711 2023-11-13T18:39:56.500 INFO:teuthology.orchestra.run.smithi102.stdout:Not run: generic/711 2023-11-13T18:39:56.500 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T18:39:56.532 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T18:39:56.701 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T18:39:56.702 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/712) 2023-11-13T18:39:58.442 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T18:39:58.484 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T18:39:58.484 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T18:39:59.652 INFO:teuthology.orchestra.run.smithi102.stdout:generic/712 [not run] xfs_io swapext -v vfs not supported on ceph-fuse 2023-11-13T18:39:59.672 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/712 2023-11-13T18:39:59.672 INFO:teuthology.orchestra.run.smithi102.stdout:Not run: generic/712 2023-11-13T18:39:59.673 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T18:39:59.688 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T18:39:59.830 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T18:39:59.831 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/713) 2023-11-13T18:40:01.504 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T18:40:01.553 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T18:40:01.554 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T18:40:02.086 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T18:40:02.094 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T18:40:02.781 INFO:teuthology.orchestra.run.smithi102.stdout:generic/713 [not run] xfs_io swapext -v vfs -s 64k -l 64k not supported on ceph-fuse 2023-11-13T18:40:02.799 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/713 2023-11-13T18:40:02.799 INFO:teuthology.orchestra.run.smithi102.stdout:Not run: generic/713 2023-11-13T18:40:02.800 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T18:40:02.827 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T18:40:02.936 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T18:40:02.937 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/714) 2023-11-13T18:40:04.555 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T18:40:04.599 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T18:40:04.599 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T18:40:05.853 INFO:teuthology.orchestra.run.smithi102.stdout:generic/714 [not run] xfs_io swapext -v vfs not supported on ceph-fuse 2023-11-13T18:40:05.869 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/714 2023-11-13T18:40:05.869 INFO:teuthology.orchestra.run.smithi102.stdout:Not run: generic/714 2023-11-13T18:40:05.870 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T18:40:05.885 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T18:40:06.072 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T18:40:06.072 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/715) 2023-11-13T18:40:07.867 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T18:40:07.905 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T18:40:07.905 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T18:40:09.496 INFO:teuthology.orchestra.run.smithi102.stdout:generic/715 [not run] xfs_io swapext -v vfs -s 64k -l 64k not supported on ceph-fuse 2023-11-13T18:40:09.507 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/715 2023-11-13T18:40:09.508 INFO:teuthology.orchestra.run.smithi102.stdout:Not run: generic/715 2023-11-13T18:40:09.509 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T18:40:09.534 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T18:40:09.722 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T18:40:09.723 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/716) 2023-11-13T18:40:11.410 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T18:40:11.447 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T18:40:11.447 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T18:40:12.649 INFO:teuthology.orchestra.run.smithi102.stdout:generic/716 [not run] xfs_io swapext -v vfs not supported on ceph-fuse 2023-11-13T18:40:12.674 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/716 2023-11-13T18:40:12.674 INFO:teuthology.orchestra.run.smithi102.stdout:Not run: generic/716 2023-11-13T18:40:12.674 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T18:40:12.683 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T18:40:12.714 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T18:40:12.715 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/717) 2023-11-13T18:40:14.464 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T18:40:14.506 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T18:40:14.506 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T18:40:15.637 INFO:teuthology.orchestra.run.smithi102.stdout:generic/717 [not run] xfs_io swapext -v vfs not supported on ceph-fuse 2023-11-13T18:40:15.651 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/717 2023-11-13T18:40:15.652 INFO:teuthology.orchestra.run.smithi102.stdout:Not run: generic/717 2023-11-13T18:40:15.652 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T18:40:15.666 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T18:40:15.982 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T18:40:15.982 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/718) 2023-11-13T18:40:17.477 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T18:40:17.499 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T18:40:17.500 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T18:40:18.664 INFO:teuthology.orchestra.run.smithi102.stdout:generic/718 [not run] xfs_io swapext -v vfs not supported on ceph-fuse 2023-11-13T18:40:18.696 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/718 2023-11-13T18:40:18.696 INFO:teuthology.orchestra.run.smithi102.stdout:Not run: generic/718 2023-11-13T18:40:18.697 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T18:40:18.706 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T18:40:18.817 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T18:40:18.818 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/719) 2023-11-13T18:40:20.539 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T18:40:20.565 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T18:40:20.565 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T18:40:21.854 INFO:teuthology.orchestra.run.smithi102.stdout:generic/719 [not run] xfs_io swapext -v vfs not supported on ceph-fuse 2023-11-13T18:40:21.868 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/719 2023-11-13T18:40:21.868 INFO:teuthology.orchestra.run.smithi102.stdout:Not run: generic/719 2023-11-13T18:40:21.869 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T18:40:21.886 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T18:40:21.977 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T18:40:21.977 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/720) 2023-11-13T18:40:23.622 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T18:40:23.659 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T18:40:23.660 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T18:40:24.918 INFO:teuthology.orchestra.run.smithi102.stdout:generic/720 [not run] xfs_io swapext -v vfs not supported on ceph-fuse 2023-11-13T18:40:24.939 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/720 2023-11-13T18:40:24.939 INFO:teuthology.orchestra.run.smithi102.stdout:Not run: generic/720 2023-11-13T18:40:24.939 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T18:40:24.958 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T18:40:24.992 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T18:40:24.993 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/721) 2023-11-13T18:40:26.752 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T18:40:26.796 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T18:40:26.796 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T18:40:27.908 INFO:teuthology.orchestra.run.smithi102.stdout:generic/721 [not run] xfs_io startupdate support is missing 2023-11-13T18:40:27.944 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/721 2023-11-13T18:40:27.944 INFO:teuthology.orchestra.run.smithi102.stdout:Not run: generic/721 2023-11-13T18:40:27.944 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T18:40:27.968 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T18:40:28.038 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T18:40:28.039 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/722) 2023-11-13T18:40:29.223 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T18:40:29.263 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T18:40:29.263 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T18:40:30.455 INFO:teuthology.orchestra.run.smithi102.stdout:generic/722 [not run] xfs_io swapext -v vfs -a not supported on ceph-fuse 2023-11-13T18:40:30.492 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/722 2023-11-13T18:40:30.492 INFO:teuthology.orchestra.run.smithi102.stdout:Not run: generic/722 2023-11-13T18:40:30.492 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T18:40:30.516 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T18:40:30.587 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T18:40:30.587 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/723) 2023-11-13T18:40:32.243 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T18:40:32.248 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T18:40:32.444 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T18:40:32.494 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T18:40:32.494 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T18:40:33.634 INFO:teuthology.orchestra.run.smithi102.stdout:generic/723 [not run] xfs_io swapext -v vfs not supported on ceph-fuse 2023-11-13T18:40:33.670 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/723 2023-11-13T18:40:33.671 INFO:teuthology.orchestra.run.smithi102.stdout:Not run: generic/723 2023-11-13T18:40:33.671 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T18:40:33.697 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T18:40:33.813 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T18:40:33.814 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/724) 2023-11-13T18:40:35.693 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T18:40:35.739 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T18:40:35.739 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T18:40:37.038 INFO:teuthology.orchestra.run.smithi102.stdout:generic/724 [not run] xfs_io swapext -v vfs -a not supported on ceph-fuse 2023-11-13T18:40:37.065 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/724 2023-11-13T18:40:37.065 INFO:teuthology.orchestra.run.smithi102.stdout:Not run: generic/724 2023-11-13T18:40:37.066 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T18:40:37.087 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T18:40:37.233 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T18:40:37.234 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/725) 2023-11-13T18:40:38.970 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T18:40:38.987 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T18:40:38.987 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T18:40:40.152 INFO:teuthology.orchestra.run.smithi102.stdout:generic/725 [not run] xfs_io swapext -v vfs -a not supported on ceph-fuse 2023-11-13T18:40:40.198 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/725 2023-11-13T18:40:40.199 INFO:teuthology.orchestra.run.smithi102.stdout:Not run: generic/725 2023-11-13T18:40:40.199 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T18:40:40.219 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T18:40:40.308 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T18:40:40.309 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/726) 2023-11-13T18:40:41.961 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T18:40:41.996 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T18:40:41.997 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T18:40:43.904 INFO:teuthology.orchestra.run.smithi102.stdout:generic/726 [not run] xfs_io swapext -v vfs -a not supported on ceph-fuse 2023-11-13T18:40:43.938 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/726 2023-11-13T18:40:43.938 INFO:teuthology.orchestra.run.smithi102.stdout:Not run: generic/726 2023-11-13T18:40:43.939 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T18:40:43.971 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T18:40:44.020 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T18:40:44.021 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/727) 2023-11-13T18:40:45.782 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T18:40:45.824 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T18:40:45.827 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T18:40:47.323 INFO:teuthology.orchestra.run.smithi102.stdout:generic/727 [not run] xfs_io swapext -v vfs -a not supported on ceph-fuse 2023-11-13T18:40:47.363 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/727 2023-11-13T18:40:47.364 INFO:teuthology.orchestra.run.smithi102.stdout:Not run: generic/727 2023-11-13T18:40:47.365 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T18:40:47.396 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T18:40:47.459 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T18:40:47.460 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/728) 2023-11-13T18:40:49.201 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T18:40:49.230 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T18:40:49.231 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T18:40:54.627 INFO:teuthology.orchestra.run.smithi102.stdout:generic/728 5s 2023-11-13T18:40:54.680 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/728 2023-11-13T18:40:54.680 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T18:40:54.694 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T18:40:54.748 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T18:40:54.748 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/729) 2023-11-13T18:40:55.990 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T18:40:56.043 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T18:40:56.043 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T18:40:57.831 INFO:teuthology.orchestra.run.smithi102.stdout:generic/729 1s 2023-11-13T18:40:57.874 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/729 2023-11-13T18:40:57.874 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T18:40:57.897 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T18:40:58.046 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T18:40:58.047 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/730) 2023-11-13T18:40:59.872 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T18:40:59.919 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T18:40:59.920 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T18:41:00.966 INFO:teuthology.orchestra.run.smithi102.stdout:generic/730 [not run] require ceph-fuse to be valid block disk 2023-11-13T18:41:00.992 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/730 2023-11-13T18:41:00.993 INFO:teuthology.orchestra.run.smithi102.stdout:Not run: generic/730 2023-11-13T18:41:00.993 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T18:41:01.018 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T18:41:01.091 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T18:41:01.092 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/731) 2023-11-13T18:41:02.328 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T18:41:02.339 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T18:41:02.344 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T18:41:02.388 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T18:41:02.388 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T18:41:03.389 INFO:teuthology.orchestra.run.smithi102.stdout:generic/731 [not run] require ceph-fuse to be valid block disk 2023-11-13T18:41:03.431 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/731 2023-11-13T18:41:03.431 INFO:teuthology.orchestra.run.smithi102.stdout:Not run: generic/731 2023-11-13T18:41:03.432 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T18:41:03.449 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T18:41:03.541 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T18:41:03.542 DEBUG:teuthology.orchestra.run.smithi102:> (cd /tmp/tmp.EnLPmcWJbzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/732) 2023-11-13T18:41:04.727 INFO:teuthology.orchestra.run.smithi102.stdout:FSTYP -- ceph-fuse 2023-11-13T18:41:04.775 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM -- Linux/x86_64 smithi102 6.6.0-rc5-g5b73517e0e2f #1 SMP PREEMPT_DYNAMIC Wed Oct 25 03:23:34 UTC 2023 2023-11-13T18:41:04.775 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T18:41:05.747 INFO:teuthology.orchestra.run.smithi102.stdout:generic/732 [not run] this test requires a valid $SCRATCH_DEV 2023-11-13T18:41:05.761 INFO:teuthology.orchestra.run.smithi102.stdout:Ran: generic/732 2023-11-13T18:41:05.761 INFO:teuthology.orchestra.run.smithi102.stdout:Not run: generic/732 2023-11-13T18:41:05.762 INFO:teuthology.orchestra.run.smithi102.stdout:Passed all 1 tests 2023-11-13T18:41:05.776 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T18:41:05.857 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-13T18:41:05.857 INFO:tasks.cephfs.xfstests_dev:=========================================================Total number of tests failed = 16========================================================= 2023-11-13T18:41:05.858 DEBUG:teuthology.orchestra.run.smithi102:> sudo userdel --force --remove fsgqa 2023-11-13T18:41:06.228 INFO:teuthology.orchestra.run.smithi102.stderr:userdel: fsgqa mail spool (/var/mail/fsgqa) not found 2023-11-13T18:41:06.615 DEBUG:teuthology.orchestra.run.smithi102:> sudo userdel --force --remove 123456-fsgqa 2023-11-13T18:41:06.676 INFO:teuthology.orchestra.run.smithi102.stderr:userdel: 123456-fsgqa mail spool (/var/mail/123456-fsgqa) not found 2023-11-13T18:41:06.676 INFO:teuthology.orchestra.run.smithi102.stderr:userdel: 123456-fsgqa home directory (/home/123456-fsgqa) not found 2023-11-13T18:41:07.050 DEBUG:teuthology.orchestra.run.smithi102:> sudo groupdel fsgqa 2023-11-13T18:41:07.170 INFO:teuthology.orchestra.run.smithi102.stderr:groupdel: group 'fsgqa' does not exist 2023-11-13T18:41:07.177 DEBUG:teuthology.orchestra.run:got remote process result: 6 2023-11-13T18:41:07.178 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-13T18:41:07.179 DEBUG:teuthology.orchestra.run.smithi102:> (cd /home/ubuntu/cephtest/mnt.0 && exec sudo stat /tmp/tmp.EnLPmcWJbzxfstests-dev/results) 2023-11-13T18:41:07.246 INFO:teuthology.orchestra.run.smithi102.stderr:bash: line 1: cd: /home/ubuntu/cephtest/mnt.0: Permission denied 2023-11-13T18:41:07.248 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-13T18:41:07.249 INFO:tasks.cephfs.xfstests_dev:xfstests-dev repo contains not directory named "results". repo location: /tmp/tmp.EnLPmcWJbzxfstests-dev 2023-11-13T18:41:07.249 DEBUG:teuthology.orchestra.run.smithi102:> sudo rm -rf /tmp/tmp.EnLPmcWJbzxfstests-dev 2023-11-13T18:41:07.930 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-11-13T18:41:07.949 DEBUG:teuthology.orchestra.run.smithi102:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-11-13T18:41:08.239 DEBUG:teuthology.orchestra.run.smithi154:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-11-13T18:41:08.363 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-11-13T18:41:08.363 DEBUG:teuthology.orchestra.run.smithi102:> set -ex 2023-11-13T18:41:08.364 DEBUG:teuthology.orchestra.run.smithi102:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-13T18:41:08.419 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354660k,nr_inodes=4088665,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275384k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=880 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275380k,nr_inodes=818845,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275384k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-11-13T18:41:08.420 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi102.front.sepia.ceph.com 2023-11-13T18:41:08.420 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-13T18:41:08.420 DEBUG:teuthology.orchestra.run.smithi102:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-11-13T18:41:08.514 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2023-11-13T18:41:08.515 DEBUG:teuthology.orchestra.run.smithi154:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-13T18:41:08.528 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354672k,nr_inodes=4088668,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275388k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=7632 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275384k,nr_inodes=818846,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275388k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-11-13T18:41:08.528 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi154.front.sepia.ceph.com 2023-11-13T18:41:08.528 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-13T18:41:08.529 DEBUG:teuthology.orchestra.run.smithi154:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-11-13T18:41:08.590 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-13T18:41:08.590 INFO:teuthology.orchestra.run.smithi154.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.1': No such file or directory 2023-11-13T18:41:08.591 DEBUG:teuthology.orchestra.run.smithi102:> set -ex 2023-11-13T18:41:08.591 DEBUG:teuthology.orchestra.run.smithi102:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-13T18:41:08.631 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354660k,nr_inodes=4088665,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275384k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=880 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275380k,nr_inodes=818845,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275384k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-11-13T18:41:08.631 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi102.front.sepia.ceph.com 2023-11-13T18:41:08.632 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-13T18:41:08.632 DEBUG:teuthology.orchestra.run.smithi102:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2023-11-13T18:41:08.693 INFO:teuthology.orchestra.run.smithi102.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.2': No such file or directory 2023-11-13T18:41:08.695 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-13T18:41:08.696 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2023-11-13T18:41:08.697 DEBUG:teuthology.orchestra.run.smithi154:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-13T18:41:08.708 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354672k,nr_inodes=4088668,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275388k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=7632 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275384k,nr_inodes=818846,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275388k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-11-13T18:41:08.709 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi154.front.sepia.ceph.com 2023-11-13T18:41:08.709 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-13T18:41:08.710 DEBUG:teuthology.orchestra.run.smithi154:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2023-11-13T18:41:08.760 INFO:teuthology.orchestra.run.smithi154.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.3': No such file or directory 2023-11-13T18:41:08.761 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-13T18:41:08.762 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-13T18:41:10.187 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:10.177+0000 7f9e59faa640 1 Processor -- start 2023-11-13T18:41:10.189 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:10.181+0000 7f9e59faa640 1 -- start start 2023-11-13T18:41:10.195 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:10.185+0000 7f9e59faa640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f9e540adec0 0x7f9e5406e190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T18:41:10.196 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:10.185+0000 7f9e59faa640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9e540ce0e0 0x7f9e540b2ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T18:41:10.196 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:10.185+0000 7f9e59faa640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9e540b2b60 con 0x7f9e54141d00 2023-11-13T18:41:10.208 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:10.185+0000 7f9e537fe640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f9e540adec0 0x7f9e5406e190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T18:41:10.208 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:10.185+0000 7f9e59faa640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9e5406e6d0 con 0x7f9e540adec0 2023-11-13T18:41:10.208 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:10.185+0000 7f9e59faa640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9e540b1f50 con 0x7f9e540ce0e0 2023-11-13T18:41:10.209 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:10.185+0000 7f9e537fe640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f9e540adec0 0x7f9e5406e190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.102:53002/0 (socket says 172.21.15.102:53002) 2023-11-13T18:41:10.209 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:10.185+0000 7f9e537fe640 1 -- 172.21.15.102:0/2281460291 learned_addr learned my addr 172.21.15.102:0/2281460291 (peer_addr_for_me v2:172.21.15.102:0/0) 2023-11-13T18:41:10.210 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:10.189+0000 7f9e53fff640 1 --2- 172.21.15.102:0/2281460291 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9e540ce0e0 0x7f9e540b2ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T18:41:10.210 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:10.189+0000 7f9e537fe640 1 -- 172.21.15.102:0/2281460291 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9e540ce0e0 msgr2=0x7f9e540b2ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-13T18:41:10.210 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:10.189+0000 7f9e537fe640 1 --2- 172.21.15.102:0/2281460291 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9e540ce0e0 0x7f9e540b2ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T18:41:10.210 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:10.189+0000 7f9e537fe640 1 -- 172.21.15.102:0/2281460291 >> v1:172.21.15.102:6789/0 conn(0x7f9e54141d00 legacy=0x7f9e540cd9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-13T18:41:10.211 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:10.189+0000 7f9e537fe640 1 -- 172.21.15.102:0/2281460291 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e540b2230 con 0x7f9e540adec0 2023-11-13T18:41:10.211 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:10.189+0000 7f9e53fff640 1 --2- 172.21.15.102:0/2281460291 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9e540ce0e0 0x7f9e540b2ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-13T18:41:10.211 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:10.193+0000 7f9e537fe640 1 --2- 172.21.15.102:0/2281460291 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9e540adec0 0x7f9e5406e190 secure :-1 s=READY pgs=886 cs=0 l=1 rev1=1 crypto rx=0x7f9e440098d0 tx=0x7f9e4401c4d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=69967b9e86c7230 server_cookie=0 in_seq=0 out_seq=0 2023-11-13T18:41:10.212 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:10.193+0000 7f9e527fc640 1 -- 172.21.15.102:0/2281460291 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e440aa3f0 con 0x7f9e540adec0 2023-11-13T18:41:10.212 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:10.193+0000 7f9e527fc640 1 -- 172.21.15.102:0/2281460291 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e440aa550 con 0x7f9e540adec0 2023-11-13T18:41:10.212 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:10.193+0000 7f9e527fc640 1 -- 172.21.15.102:0/2281460291 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e440aa8e0 con 0x7f9e540adec0 2023-11-13T18:41:10.213 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:10.197+0000 7f9e59faa640 1 -- 172.21.15.102:0/2281460291 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9e540adec0 msgr2=0x7f9e5406e190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T18:41:10.213 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:10.197+0000 7f9e59faa640 1 --2- 172.21.15.102:0/2281460291 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9e540adec0 0x7f9e5406e190 secure :-1 s=READY pgs=886 cs=0 l=1 rev1=1 crypto rx=0x7f9e440098d0 tx=0x7f9e4401c4d0 comp rx=0 tx=0).stop 2023-11-13T18:41:10.213 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:10.197+0000 7f9e59faa640 1 -- 172.21.15.102:0/2281460291 shutdown_connections 2023-11-13T18:41:10.213 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:10.197+0000 7f9e59faa640 1 --2- 172.21.15.102:0/2281460291 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9e540ce0e0 0x7f9e540b2ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T18:41:10.214 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:10.197+0000 7f9e59faa640 1 --2- 172.21.15.102:0/2281460291 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9e540adec0 0x7f9e5406e190 unknown :-1 s=CLOSED pgs=886 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T18:41:10.214 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:10.197+0000 7f9e59faa640 1 -- 172.21.15.102:0/2281460291 >> 172.21.15.102:0/2281460291 conn(0x7f9e540cb5c0 msgr2=0x7f9e540cb9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-13T18:41:10.214 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:10.197+0000 7f9e59faa640 1 -- 172.21.15.102:0/2281460291 shutdown_connections 2023-11-13T18:41:10.215 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:10.205+0000 7f9e59faa640 1 -- 172.21.15.102:0/2281460291 wait complete. 2023-11-13T18:41:10.216 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:10.205+0000 7f9e59faa640 1 Processor -- start 2023-11-13T18:41:10.216 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:10.205+0000 7f9e59faa640 1 -- start start 2023-11-13T18:41:10.217 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:10.209+0000 7f9e59faa640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9e540adec0 0x7f9e540a8f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T18:41:10.217 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:10.209+0000 7f9e59faa640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9e540ce0e0 0x7f9e540a95c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T18:41:10.218 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:10.209+0000 7f9e59faa640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9e54141d00 0x7f9e54143850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T18:41:10.218 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:10.209+0000 7f9e59faa640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e540aa9b0 con 0x7f9e540adec0 2023-11-13T18:41:10.219 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:10.209+0000 7f9e59faa640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e540a9b00 con 0x7f9e54141d00 2023-11-13T18:41:10.219 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:10.209+0000 7f9e59faa640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9e540a9d30 con 0x7f9e540ce0e0 2023-11-13T18:41:10.220 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:10.209+0000 7f9e53fff640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9e54141d00 0x7f9e54143850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T18:41:10.221 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:10.209+0000 7f9e53fff640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9e54141d00 0x7f9e54143850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.102:53018/0 (socket says 172.21.15.102:53018) 2023-11-13T18:41:10.221 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:10.209+0000 7f9e53fff640 1 -- 172.21.15.102:0/3524437425 learned_addr learned my addr 172.21.15.102:0/3524437425 (peer_addr_for_me v2:172.21.15.102:0/0) 2023-11-13T18:41:10.221 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:10.209+0000 7f9e52ffd640 1 --2- 172.21.15.102:0/3524437425 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9e540ce0e0 0x7f9e540a95c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T18:41:10.221 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:10.209+0000 7f9e52ffd640 1 -- 172.21.15.102:0/3524437425 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9e54141d00 msgr2=0x7f9e54143850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T18:41:10.222 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:10.209+0000 7f9e52ffd640 1 --2- 172.21.15.102:0/3524437425 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9e54141d00 0x7f9e54143850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T18:41:10.222 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:10.209+0000 7f9e52ffd640 1 -- 172.21.15.102:0/3524437425 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9e540adec0 msgr2=0x7f9e540a8f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T18:41:10.222 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:10.209+0000 7f9e52ffd640 1 --2- 172.21.15.102:0/3524437425 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9e540adec0 0x7f9e540a8f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T18:41:10.223 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:10.209+0000 7f9e52ffd640 1 -- 172.21.15.102:0/3524437425 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e440094d0 con 0x7f9e540ce0e0 2023-11-13T18:41:10.223 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:10.209+0000 7f9e53fff640 1 --2- 172.21.15.102:0/3524437425 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9e54141d00 0x7f9e54143850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-13T18:41:10.223 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:10.209+0000 7f9e52ffd640 1 --2- 172.21.15.102:0/3524437425 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9e540ce0e0 0x7f9e540a95c0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f9e4800b3e0 tx=0x7f9e4800b8a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-13T18:41:10.224 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:10.209+0000 7f9e3bfff640 1 -- 172.21.15.102:0/3524437425 <== mon.2 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e48011830 con 0x7f9e540ce0e0 2023-11-13T18:41:10.224 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:10.209+0000 7f9e3bfff640 1 -- 172.21.15.102:0/3524437425 <== mon.2 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e48011990 con 0x7f9e540ce0e0 2023-11-13T18:41:10.224 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:10.209+0000 7f9e3bfff640 1 -- 172.21.15.102:0/3524437425 <== mon.2 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e48011d20 con 0x7f9e540ce0e0 2023-11-13T18:41:10.225 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:10.213+0000 7f9e59faa640 1 -- 172.21.15.102:0/3524437425 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9e540aa010 con 0x7f9e540ce0e0 2023-11-13T18:41:10.225 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:10.217+0000 7f9e59faa640 1 -- 172.21.15.102:0/3524437425 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9e540aa5d0 con 0x7f9e540ce0e0 2023-11-13T18:41:10.231 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:10.221+0000 7f9e3bfff640 1 -- 172.21.15.102:0/3524437425 <== mon.2 v2:172.21.15.154:3301/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f9e4801a400 con 0x7f9e540ce0e0 2023-11-13T18:41:10.235 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:10.225+0000 7f9e3bfff640 1 --2- 172.21.15.102:0/3524437425 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f9e40066540 0x7f9e40068a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T18:41:10.236 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:10.229+0000 7f9e3bfff640 1 -- 172.21.15.102:0/3524437425 <== mon.2 v2:172.21.15.154:3301/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f9e48083e50 con 0x7f9e540ce0e0 2023-11-13T18:41:10.237 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:10.229+0000 7f9e537fe640 1 --2- 172.21.15.102:0/3524437425 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f9e40066540 0x7f9e40068a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T18:41:10.342 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:10.221+0000 7f9e59faa640 1 -- 172.21.15.102:0/3524437425 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9e540aaaf0 con 0x7f9e540ce0e0 2023-11-13T18:41:10.347 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:10.337+0000 7f9e537fe640 1 --2- 172.21.15.102:0/3524437425 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f9e40066540 0x7f9e40068a00 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7f9e440ae000 tx=0x7f9e44008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-13T18:41:10.547 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:10.537+0000 7f9e3bfff640 1 -- 172.21.15.102:0/3524437425 <== mon.2 v2:172.21.15.154:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f9e540aaaf0 con 0x7f9e540ce0e0 2023-11-13T18:41:10.847 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:10.837+0000 7f9e59faa640 1 -- 172.21.15.102:0/3524437425 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f9e54068520 con 0x7f9e540ce0e0 2023-11-13T18:41:10.886 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:10.877+0000 7f9e3bfff640 1 -- 172.21.15.102:0/3524437425 <== mon.2 v2:172.21.15.154:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) v1 ==== 94+0+4922 (secure 0 0 0) 0x7f9e540aaaf0 con 0x7f9e540ce0e0 2023-11-13T18:41:10.887 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T18:41:10.888 INFO:teuthology.orchestra.run.smithi102.stdout:{"epoch":16,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4826,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6834/3121803929","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6832","nonce":3121803929},{"type":"v1","addr":"172.21.15.154:6834","nonce":3121803929}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":4829,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6835/2990283260","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6833","nonce":2990283260},{"type":"v1","addr":"172.21.15.154:6835","nonce":2990283260}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":5271,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.102:6836/868460192","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6834","nonce":868460192},{"type":"v1","addr":"172.21.15.102:6836","nonce":868460192}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-13T11:29:56.498042+0000","modified":"2023-11-13T11:29:59.519487+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5274},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5274":{"gid":5274,"name":"a","rank":0,"incarnation":12,"state":"up:active","state_seq":3,"addr":"172.21.15.102:6837/3869977039","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6835","nonce":3869977039},{"type":"v1","addr":"172.21.15.102:6837","nonce":3869977039}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-11-13T18:41:10.888 INFO:teuthology.orchestra.run.smithi102.stderr:dumped fsmap epoch 16 2023-11-13T18:41:10.892 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:10.885+0000 7f9e59faa640 1 -- 172.21.15.102:0/3524437425 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f9e40066540 msgr2=0x7f9e40068a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T18:41:10.892 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:10.885+0000 7f9e59faa640 1 --2- 172.21.15.102:0/3524437425 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f9e40066540 0x7f9e40068a00 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7f9e440ae000 tx=0x7f9e44008040 comp rx=0 tx=0).stop 2023-11-13T18:41:10.893 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:10.885+0000 7f9e59faa640 1 -- 172.21.15.102:0/3524437425 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9e540ce0e0 msgr2=0x7f9e540a95c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T18:41:10.893 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:10.885+0000 7f9e59faa640 1 --2- 172.21.15.102:0/3524437425 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9e540ce0e0 0x7f9e540a95c0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f9e4800b3e0 tx=0x7f9e4800b8a0 comp rx=0 tx=0).stop 2023-11-13T18:41:10.894 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:10.885+0000 7f9e59faa640 1 -- 172.21.15.102:0/3524437425 shutdown_connections 2023-11-13T18:41:10.894 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:10.885+0000 7f9e59faa640 1 --2- 172.21.15.102:0/3524437425 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9e54141d00 0x7f9e54143850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T18:41:10.895 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:10.885+0000 7f9e59faa640 1 --2- 172.21.15.102:0/3524437425 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9e540ce0e0 0x7f9e540a95c0 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T18:41:10.895 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:10.885+0000 7f9e59faa640 1 --2- 172.21.15.102:0/3524437425 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f9e40066540 0x7f9e40068a00 unknown :-1 s=CLOSED pgs=733 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T18:41:10.895 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:10.885+0000 7f9e59faa640 1 --2- 172.21.15.102:0/3524437425 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9e540adec0 0x7f9e540a8f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T18:41:10.896 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:10.885+0000 7f9e59faa640 1 -- 172.21.15.102:0/3524437425 >> 172.21.15.102:0/3524437425 conn(0x7f9e540cb5c0 msgr2=0x7f9e540afe70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-13T18:41:10.896 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:10.885+0000 7f9e59faa640 1 -- 172.21.15.102:0/3524437425 shutdown_connections 2023-11-13T18:41:10.896 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:10.885+0000 7f9e59faa640 1 -- 172.21.15.102:0/3524437425 wait complete. 2023-11-13T18:41:10.989 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-13T18:41:11.601 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:11.593+0000 7f3fc6b48640 1 Processor -- start 2023-11-13T18:41:11.602 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:11.593+0000 7f3fc6b48640 1 -- start start 2023-11-13T18:41:11.609 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:11.601+0000 7f3fc6b48640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f3fc006fb80 0x7f3fc015df80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T18:41:11.609 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:11.601+0000 7f3fc6b48640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3fc00ac8a0 con 0x7f3fc0071850 2023-11-13T18:41:11.610 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:11.601+0000 7f3fc6b48640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3fc00b3470 con 0x7f3fc006cbf0 2023-11-13T18:41:11.610 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:11.601+0000 7f3fc6b48640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3fc00b3750 con 0x7f3fc006fb80 2023-11-13T18:41:11.611 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:11.601+0000 7f3fc5345640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f3fc006fb80 0x7f3fc015df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T18:41:11.611 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:11.601+0000 7f3fc5345640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f3fc006fb80 0x7f3fc015df80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.102:53032/0 (socket says 172.21.15.102:53032) 2023-11-13T18:41:11.612 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:11.601+0000 7f3fc5345640 1 -- 172.21.15.102:0/1782219750 learned_addr learned my addr 172.21.15.102:0/1782219750 (peer_addr_for_me v2:172.21.15.102:0/0) 2023-11-13T18:41:11.612 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:11.601+0000 7f3fc5345640 1 -- 172.21.15.102:0/1782219750 >> v1:172.21.15.154:6789/0 conn(0x7f3fc006cbf0 legacy=0x7f3fc006d000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-13T18:41:11.612 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:11.601+0000 7f3fc5345640 1 -- 172.21.15.102:0/1782219750 >> v1:172.21.15.102:6789/0 conn(0x7f3fc0071850 legacy=0x7f3fc00b2bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-13T18:41:11.613 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:11.601+0000 7f3fc5345640 1 -- 172.21.15.102:0/1782219750 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3fc00b3a30 con 0x7f3fc006fb80 2023-11-13T18:41:11.615 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:11.605+0000 7f3fc5345640 1 --2- 172.21.15.102:0/1782219750 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3fc006fb80 0x7f3fc015df80 secure :-1 s=READY pgs=888 cs=0 l=1 rev1=1 crypto rx=0x7f3fb0009870 tx=0x7f3fb001c400 comp rx=0 tx=0).ready entity=mon.1 client_cookie=20e8961a880b9837 server_cookie=0 in_seq=0 out_seq=0 2023-11-13T18:41:11.615 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:11.605+0000 7f3fc4b44640 1 -- 172.21.15.102:0/1782219750 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fb00ab620 con 0x7f3fc006fb80 2023-11-13T18:41:11.616 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:11.605+0000 7f3fc4b44640 1 -- 172.21.15.102:0/1782219750 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3fb00ab780 con 0x7f3fc006fb80 2023-11-13T18:41:11.616 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:11.605+0000 7f3fc4b44640 1 -- 172.21.15.102:0/1782219750 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fb00abb10 con 0x7f3fc006fb80 2023-11-13T18:41:11.617 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:11.609+0000 7f3fc6b48640 1 -- 172.21.15.102:0/1782219750 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3fc006fb80 msgr2=0x7f3fc015df80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T18:41:11.617 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:11.609+0000 7f3fc6b48640 1 --2- 172.21.15.102:0/1782219750 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3fc006fb80 0x7f3fc015df80 secure :-1 s=READY pgs=888 cs=0 l=1 rev1=1 crypto rx=0x7f3fb0009870 tx=0x7f3fb001c400 comp rx=0 tx=0).stop 2023-11-13T18:41:11.618 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:11.609+0000 7f3fc6b48640 1 -- 172.21.15.102:0/1782219750 shutdown_connections 2023-11-13T18:41:11.619 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:11.609+0000 7f3fc6b48640 1 --2- 172.21.15.102:0/1782219750 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3fc006fb80 0x7f3fc015df80 unknown :-1 s=CLOSED pgs=888 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T18:41:11.619 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:11.609+0000 7f3fc6b48640 1 -- 172.21.15.102:0/1782219750 >> 172.21.15.102:0/1782219750 conn(0x7f3fc00b0690 msgr2=0x7f3fc00b0aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-13T18:41:11.620 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:11.609+0000 7f3fc6b48640 1 -- 172.21.15.102:0/1782219750 shutdown_connections 2023-11-13T18:41:11.620 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:11.609+0000 7f3fc6b48640 1 -- 172.21.15.102:0/1782219750 wait complete. 2023-11-13T18:41:11.627 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:11.617+0000 7f3fc6b48640 1 Processor -- start 2023-11-13T18:41:11.627 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:11.617+0000 7f3fc6b48640 1 -- start start 2023-11-13T18:41:11.632 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:11.625+0000 7f3fc6b48640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3fc006cbf0 0x7f3fc014cb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T18:41:11.633 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:11.625+0000 7f3fc6b48640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3fc006fb80 0x7f3fc0146cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T18:41:11.633 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:11.625+0000 7f3fc6b48640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3fc0071850 0x7f3fc00cb730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T18:41:11.635 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:11.625+0000 7f3fc5345640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3fc006fb80 0x7f3fc0146cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T18:41:11.635 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:11.625+0000 7f3fc5345640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3fc006fb80 0x7f3fc0146cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.102:55108/0 (socket says 172.21.15.102:55108) 2023-11-13T18:41:11.636 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:11.625+0000 7f3fc5345640 1 -- 172.21.15.102:0/2430660107 learned_addr learned my addr 172.21.15.102:0/2430660107 (peer_addr_for_me v2:172.21.15.102:0/0) 2023-11-13T18:41:11.636 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:11.625+0000 7f3fc6b48640 1 -- 172.21.15.102:0/2430660107 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3fc0147ba0 con 0x7f3fc0071850 2023-11-13T18:41:11.636 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:11.625+0000 7f3fc6b48640 1 -- 172.21.15.102:0/2430660107 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3fc014ec70 con 0x7f3fc006cbf0 2023-11-13T18:41:11.637 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:11.625+0000 7f3fc6b48640 1 -- 172.21.15.102:0/2430660107 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3fc014e990 con 0x7f3fc006fb80 2023-11-13T18:41:11.638 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:11.629+0000 7f3fc5b46640 1 --2- 172.21.15.102:0/2430660107 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3fc006cbf0 0x7f3fc014cb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T18:41:11.638 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:11.629+0000 7f3fc5345640 1 -- 172.21.15.102:0/2430660107 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3fc006cbf0 msgr2=0x7f3fc014cb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T18:41:11.639 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:11.629+0000 7f3fc5345640 1 --2- 172.21.15.102:0/2430660107 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3fc006cbf0 0x7f3fc014cb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T18:41:11.640 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:11.629+0000 7f3fc5345640 1 -- 172.21.15.102:0/2430660107 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3fc0071850 msgr2=0x7f3fc00cb730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T18:41:11.640 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:11.629+0000 7f3fc5345640 1 --2- 172.21.15.102:0/2430660107 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3fc0071850 0x7f3fc00cb730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T18:41:11.640 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:11.629+0000 7f3fc5345640 1 -- 172.21.15.102:0/2430660107 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3fb00094d0 con 0x7f3fc006fb80 2023-11-13T18:41:11.641 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:11.629+0000 7f3fc5b46640 1 --2- 172.21.15.102:0/2430660107 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3fc006cbf0 0x7f3fc014cb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-13T18:41:11.641 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:11.633+0000 7f3fc5345640 1 --2- 172.21.15.102:0/2430660107 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3fc006fb80 0x7f3fc0146cd0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f3fb00ad040 tx=0x7f3fb001ac40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-13T18:41:11.642 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:11.633+0000 7f3fb67fc640 1 -- 172.21.15.102:0/2430660107 <== mon.2 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fb00be3f0 con 0x7f3fc006fb80 2023-11-13T18:41:11.643 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:11.633+0000 7f3fc6b48640 1 -- 172.21.15.102:0/2430660107 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3fc01474e0 con 0x7f3fc006fb80 2023-11-13T18:41:11.643 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:11.633+0000 7f3fc6b48640 1 -- 172.21.15.102:0/2430660107 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3fc0149bb0 con 0x7f3fc006fb80 2023-11-13T18:41:11.644 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:11.633+0000 7f3fb67fc640 1 -- 172.21.15.102:0/2430660107 <== mon.2 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3fb00be550 con 0x7f3fc006fb80 2023-11-13T18:41:11.644 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:11.633+0000 7f3fb67fc640 1 -- 172.21.15.102:0/2430660107 <== mon.2 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fb00be900 con 0x7f3fc006fb80 2023-11-13T18:41:11.648 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:11.637+0000 7f3fc6b48640 1 -- 172.21.15.102:0/2430660107 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3fa8005260 con 0x7f3fc006fb80 2023-11-13T18:41:11.650 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:11.641+0000 7f3fb67fc640 1 -- 172.21.15.102:0/2430660107 <== mon.2 v2:172.21.15.154:3301/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f3fb00b43f0 con 0x7f3fc006fb80 2023-11-13T18:41:11.654 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:11.645+0000 7f3fb67fc640 1 --2- 172.21.15.102:0/2430660107 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f3fa4066470 0x7f3fa4068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T18:41:11.654 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:11.645+0000 7f3fb67fc640 1 -- 172.21.15.102:0/2430660107 <== mon.2 v2:172.21.15.154:3301/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f3fb011e3a0 con 0x7f3fc006fb80 2023-11-13T18:41:11.655 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:11.645+0000 7f3fc5b46640 1 --2- 172.21.15.102:0/2430660107 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f3fa4066470 0x7f3fa4068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T18:41:11.658 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:11.649+0000 7f3fc5b46640 1 --2- 172.21.15.102:0/2430660107 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f3fa4066470 0x7f3fa4068930 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7f3fbc009890 tx=0x7f3fbc008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-13T18:41:11.659 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:11.649+0000 7f3fb67fc640 1 -- 172.21.15.102:0/2430660107 <== mon.2 v2:172.21.15.154:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f3fb00eb960 con 0x7f3fc006fb80 2023-11-13T18:41:12.384 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:12.373+0000 7f3fc6b48640 1 -- 172.21.15.102:0/2430660107 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f3fa8005510 con 0x7f3fc006fb80 2023-11-13T18:41:12.436 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:12.429+0000 7f3fb67fc640 1 -- 172.21.15.102:0/2430660107 <== mon.2 v2:172.21.15.154:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v38) v1 ==== 74+0+16793 (secure 0 0 0) 0x7f3fb00eef80 con 0x7f3fc006fb80 2023-11-13T18:41:12.462 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T18:41:12.463 INFO:teuthology.orchestra.run.smithi102.stdout:{"epoch":38,"fsid":"97b3eb2b-7ccf-4aae-8d92-bff986c671ea","created":"2023-11-13T11:28:31.836724+0000","modified":"2023-11-13T11:30:39.704184+0000","last_up_change":"2023-11-13T11:28:44.876638+0000","last_in_change":"2023-11-13T11:28:35.312740+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-13T11:28:44.981356+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2023-11-13T11:29:54.890079+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"35","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2023-11-13T11:29:55.482816+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"36","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"bdefaa17-fcca-4c86-aa40-27dc33a789af","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6800","nonce":53303834},{"type":"v1","addr":"172.21.15.102:6801","nonce":53303834}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6802","nonce":53303834},{"type":"v1","addr":"172.21.15.102:6803","nonce":53303834}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6806","nonce":53303834},{"type":"v1","addr":"172.21.15.102:6807","nonce":53303834}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6804","nonce":53303834},{"type":"v1","addr":"172.21.15.102:6805","nonce":53303834}]},"public_addr":"172.21.15.102:6801/53303834","cluster_addr":"172.21.15.102:6803/53303834","heartbeat_back_addr":"172.21.15.102:6807/53303834","heartbeat_front_addr":"172.21.15.102:6805/53303834","state":["exists","up"]},{"osd":1,"uuid":"f0033196-dec9-4ae9-945e-6aeef6dbb47f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6808","nonce":1732708348},{"type":"v1","addr":"172.21.15.102:6809","nonce":1732708348}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6811","nonce":1732708348},{"type":"v1","addr":"172.21.15.102:6813","nonce":1732708348}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6818","nonce":1732708348},{"type":"v1","addr":"172.21.15.102:6820","nonce":1732708348}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6815","nonce":1732708348},{"type":"v1","addr":"172.21.15.102:6817","nonce":1732708348}]},"public_addr":"172.21.15.102:6809/1732708348","cluster_addr":"172.21.15.102:6813/1732708348","heartbeat_back_addr":"172.21.15.102:6820/1732708348","heartbeat_front_addr":"172.21.15.102:6817/1732708348","state":["exists","up"]},{"osd":2,"uuid":"496b0834-351e-4ec2-a714-86ed0c0ff4fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6810","nonce":1825475150},{"type":"v1","addr":"172.21.15.102:6812","nonce":1825475150}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6814","nonce":1825475150},{"type":"v1","addr":"172.21.15.102:6816","nonce":1825475150}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6822","nonce":1825475150},{"type":"v1","addr":"172.21.15.102:6823","nonce":1825475150}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6819","nonce":1825475150},{"type":"v1","addr":"172.21.15.102:6821","nonce":1825475150}]},"public_addr":"172.21.15.102:6812/1825475150","cluster_addr":"172.21.15.102:6816/1825475150","heartbeat_back_addr":"172.21.15.102:6823/1825475150","heartbeat_front_addr":"172.21.15.102:6821/1825475150","state":["exists","up"]},{"osd":3,"uuid":"3ba6cc41-e0a0-4273-86cb-90000c06a55a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6824","nonce":4149355528},{"type":"v1","addr":"172.21.15.102:6825","nonce":4149355528}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6826","nonce":4149355528},{"type":"v1","addr":"172.21.15.102:6827","nonce":4149355528}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6830","nonce":4149355528},{"type":"v1","addr":"172.21.15.102:6831","nonce":4149355528}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6828","nonce":4149355528},{"type":"v1","addr":"172.21.15.102:6829","nonce":4149355528}]},"public_addr":"172.21.15.102:6825/4149355528","cluster_addr":"172.21.15.102:6827/4149355528","heartbeat_back_addr":"172.21.15.102:6831/4149355528","heartbeat_front_addr":"172.21.15.102:6829/4149355528","state":["exists","up"]},{"osd":4,"uuid":"16e797d8-e6e7-4140-95c3-b85283c42a2a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6808","nonce":4028899241},{"type":"v1","addr":"172.21.15.154:6809","nonce":4028899241}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6810","nonce":4028899241},{"type":"v1","addr":"172.21.15.154:6811","nonce":4028899241}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6814","nonce":4028899241},{"type":"v1","addr":"172.21.15.154:6815","nonce":4028899241}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6812","nonce":4028899241},{"type":"v1","addr":"172.21.15.154:6813","nonce":4028899241}]},"public_addr":"172.21.15.154:6809/4028899241","cluster_addr":"172.21.15.154:6811/4028899241","heartbeat_back_addr":"172.21.15.154:6815/4028899241","heartbeat_front_addr":"172.21.15.154:6813/4028899241","state":["exists","up"]},{"osd":5,"uuid":"d6ab225c-1b55-450a-89a9-abe5c3f8d6af","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":3562396827},{"type":"v1","addr":"172.21.15.154:6801","nonce":3562396827}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":3562396827},{"type":"v1","addr":"172.21.15.154:6803","nonce":3562396827}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6806","nonce":3562396827},{"type":"v1","addr":"172.21.15.154:6807","nonce":3562396827}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6804","nonce":3562396827},{"type":"v1","addr":"172.21.15.154:6805","nonce":3562396827}]},"public_addr":"172.21.15.154:6801/3562396827","cluster_addr":"172.21.15.154:6803/3562396827","heartbeat_back_addr":"172.21.15.154:6807/3562396827","heartbeat_front_addr":"172.21.15.154:6805/3562396827","state":["exists","up"]},{"osd":6,"uuid":"96f905ac-491c-4662-8e2b-5bb8e929ab9d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6816","nonce":2933728751},{"type":"v1","addr":"172.21.15.154:6817","nonce":2933728751}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6818","nonce":2933728751},{"type":"v1","addr":"172.21.15.154:6819","nonce":2933728751}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6822","nonce":2933728751},{"type":"v1","addr":"172.21.15.154:6823","nonce":2933728751}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6820","nonce":2933728751},{"type":"v1","addr":"172.21.15.154:6821","nonce":2933728751}]},"public_addr":"172.21.15.154:6817/2933728751","cluster_addr":"172.21.15.154:6819/2933728751","heartbeat_back_addr":"172.21.15.154:6823/2933728751","heartbeat_front_addr":"172.21.15.154:6821/2933728751","state":["exists","up"]},{"osd":7,"uuid":"07012d3b-3ab4-40df-a471-93caed22e2dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6824","nonce":1753500785},{"type":"v1","addr":"172.21.15.154:6825","nonce":1753500785}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6826","nonce":1753500785},{"type":"v1","addr":"172.21.15.154:6827","nonce":1753500785}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6830","nonce":1753500785},{"type":"v1","addr":"172.21.15.154:6831","nonce":1753500785}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6828","nonce":1753500785},{"type":"v1","addr":"172.21.15.154:6829","nonce":1753500785}]},"public_addr":"172.21.15.154:6825/1753500785","cluster_addr":"172.21.15.154:6827/1753500785","heartbeat_back_addr":"172.21.15.154:6831/1753500785","heartbeat_front_addr":"172.21.15.154:6829/1753500785","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-13T11:28:40.978603+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-13T11:28:41.200985+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-13T11:28:41.222815+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-13T11:28:41.202162+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-13T11:28:40.925911+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-13T11:28:41.087725+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-13T11:28:41.072208+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-13T11:28:40.875257+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"5.0","mappings":[{"from":4,"to":5}]},{"pgid":"5.e","mappings":[{"from":4,"to":5}]},{"pgid":"5.15","mappings":[{"from":4,"to":5}]},{"pgid":"5.32","mappings":[{"from":4,"to":3}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-13T18:41:12.464 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:12.429+0000 7f3fc6b48640 1 -- 172.21.15.102:0/2430660107 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f3fa4066470 msgr2=0x7f3fa4068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T18:41:12.464 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:12.429+0000 7f3fc6b48640 1 --2- 172.21.15.102:0/2430660107 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f3fa4066470 0x7f3fa4068930 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7f3fbc009890 tx=0x7f3fbc008040 comp rx=0 tx=0).stop 2023-11-13T18:41:12.464 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:12.429+0000 7f3fc6b48640 1 -- 172.21.15.102:0/2430660107 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3fc006fb80 msgr2=0x7f3fc0146cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T18:41:12.465 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:12.429+0000 7f3fc6b48640 1 --2- 172.21.15.102:0/2430660107 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3fc006fb80 0x7f3fc0146cd0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f3fb00ad040 tx=0x7f3fb001ac40 comp rx=0 tx=0).stop 2023-11-13T18:41:12.465 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:12.433+0000 7f3fc6b48640 1 -- 172.21.15.102:0/2430660107 shutdown_connections 2023-11-13T18:41:12.465 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:12.433+0000 7f3fc6b48640 1 --2- 172.21.15.102:0/2430660107 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f3fa4066470 0x7f3fa4068930 unknown :-1 s=CLOSED pgs=734 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T18:41:12.466 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:12.433+0000 7f3fc6b48640 1 --2- 172.21.15.102:0/2430660107 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3fc0071850 0x7f3fc00cb730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T18:41:12.466 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:12.433+0000 7f3fc6b48640 1 --2- 172.21.15.102:0/2430660107 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3fc006fb80 0x7f3fc0146cd0 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T18:41:12.466 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:12.433+0000 7f3fc6b48640 1 --2- 172.21.15.102:0/2430660107 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3fc006cbf0 0x7f3fc014cb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T18:41:12.467 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:12.433+0000 7f3fc6b48640 1 -- 172.21.15.102:0/2430660107 >> 172.21.15.102:0/2430660107 conn(0x7f3fc00b0690 msgr2=0x7f3fc015d270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-13T18:41:12.467 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:12.433+0000 7f3fc6b48640 1 -- 172.21.15.102:0/2430660107 shutdown_connections 2023-11-13T18:41:12.467 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:12.433+0000 7f3fc6b48640 1 -- 172.21.15.102:0/2430660107 wait complete. 2023-11-13T18:41:12.479 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-13T11:28:44.981356+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-13T11:29:54.890079+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '35', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data', 'create_time': '2023-11-13T11:29:55.482816+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '36', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-13T18:41:12.480 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-13T18:41:12.722 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:12.713+0000 7fa67b09a640 1 Processor -- start 2023-11-13T18:41:12.723 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:12.713+0000 7fa67b09a640 1 -- start start 2023-11-13T18:41:12.726 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:12.717+0000 7fa67b09a640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7fa674070320 0x7fa674159f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T18:41:12.727 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:12.717+0000 7fa67b09a640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa6740b2a00 con 0x7fa6740adf10 2023-11-13T18:41:12.727 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:12.717+0000 7fa67b09a640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa6740b23b0 con 0x7fa6740ce940 2023-11-13T18:41:12.727 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:12.717+0000 7fa67b09a640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa6740b1ef0 con 0x7fa674070320 2023-11-13T18:41:12.728 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:12.717+0000 7fa678e36640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7fa6740ce940 0x7fa6740b2e90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.102:59894/0 (socket says 172.21.15.102:59894) 2023-11-13T18:41:12.728 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:12.717+0000 7fa678e36640 1 -- 172.21.15.102:0/714897920 learned_addr learned my addr 172.21.15.102:0/714897920 (peer_addr_for_me v1:172.21.15.102:0/0) 2023-11-13T18:41:12.728 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:12.717+0000 7fa679637640 1 --2- 172.21.15.102:0/714897920 >> v2:172.21.15.102:3300/0 conn(0x7fa674070320 0x7fa674159f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T18:41:12.732 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:12.721+0000 7fa6737fe640 1 -- 172.21.15.102:0/714897920 <== mon.1 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2327234450 0 0) 0x7fa6740b23b0 con 0x7fa6740ce940 2023-11-13T18:41:12.732 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:12.721+0000 7fa6737fe640 1 -- 172.21.15.102:0/714897920 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa65c003530 con 0x7fa6740ce940 2023-11-13T18:41:12.732 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:12.721+0000 7fa6737fe640 1 -- 172.21.15.102:0/714897920 <== mon.1 v1:172.21.15.154:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4006661280 0 0) 0x7fa65c003530 con 0x7fa6740ce940 2023-11-13T18:41:12.733 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:12.721+0000 7fa6737fe640 1 -- 172.21.15.102:0/714897920 >> v2:172.21.15.102:3300/0 conn(0x7fa674070320 msgr2=0x7fa674159f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-13T18:41:12.733 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:12.721+0000 7fa6737fe640 1 --2- 172.21.15.102:0/714897920 >> v2:172.21.15.102:3300/0 conn(0x7fa674070320 0x7fa674159f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T18:41:12.733 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:12.721+0000 7fa6737fe640 1 -- 172.21.15.102:0/714897920 >> v1:172.21.15.102:6789/0 conn(0x7fa6740adf10 legacy=0x7fa67406fc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-13T18:41:12.733 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:12.721+0000 7fa6737fe640 1 -- 172.21.15.102:0/714897920 --> v1:172.21.15.154:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6740b2690 con 0x7fa6740ce940 2023-11-13T18:41:12.734 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:12.721+0000 7fa6737fe640 1 -- 172.21.15.102:0/714897920 <== mon.1 v1:172.21.15.154:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 895381068 0 0) 0x7fa664001660 con 0x7fa6740ce940 2023-11-13T18:41:12.734 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:12.721+0000 7fa6737fe640 1 -- 172.21.15.102:0/714897920 >> v1:172.21.15.154:6789/0 conn(0x7fa6740ce940 legacy=0x7fa6740b2e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T18:41:12.735 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:12.721+0000 7fa6737fe640 1 --2- 172.21.15.102:0/714897920 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa65c003980 0x7fa65c003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T18:41:12.735 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:12.721+0000 7fa6737fe640 1 --2- 172.21.15.102:0/714897920 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa65c0047d0 0x7fa65c004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T18:41:12.735 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:12.721+0000 7fa6737fe640 1 --2- 172.21.15.102:0/714897920 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa65c005190 0x7fa65c00b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T18:41:12.736 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:12.721+0000 7fa6737fe640 1 -- 172.21.15.102:0/714897920 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6740b1ef0 con 0x7fa65c003980 2023-11-13T18:41:12.736 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:12.721+0000 7fa6737fe640 1 -- 172.21.15.102:0/714897920 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa65c00c0c0 con 0x7fa65c0047d0 2023-11-13T18:41:12.736 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:12.721+0000 7fa6737fe640 1 -- 172.21.15.102:0/714897920 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa65c00c280 con 0x7fa65c005190 2023-11-13T18:41:12.737 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:12.721+0000 7fa679637640 1 --2- 172.21.15.102:0/714897920 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa65c005190 0x7fa65c00b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T18:41:12.737 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:12.721+0000 7fa678e36640 1 --2- 172.21.15.102:0/714897920 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa65c003980 0x7fa65c003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T18:41:12.737 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:12.721+0000 7fa673fff640 1 --2- 172.21.15.102:0/714897920 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa65c0047d0 0x7fa65c004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T18:41:12.738 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:12.721+0000 7fa678e36640 1 -- 172.21.15.102:0/714897920 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa65c005190 msgr2=0x7fa65c00b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-13T18:41:12.738 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:12.721+0000 7fa678e36640 1 --2- 172.21.15.102:0/714897920 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa65c005190 0x7fa65c00b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T18:41:12.738 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:12.721+0000 7fa678e36640 1 -- 172.21.15.102:0/714897920 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa65c0047d0 msgr2=0x7fa65c004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-13T18:41:12.739 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:12.721+0000 7fa678e36640 1 --2- 172.21.15.102:0/714897920 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa65c0047d0 0x7fa65c004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T18:41:12.739 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:12.721+0000 7fa678e36640 1 -- 172.21.15.102:0/714897920 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa65c003530 con 0x7fa65c003980 2023-11-13T18:41:12.739 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:12.721+0000 7fa679637640 1 -- 172.21.15.102:0/714897920 reap_dead start 2023-11-13T18:41:12.743 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:12.725+0000 7fa678e36640 1 --2- 172.21.15.102:0/714897920 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa65c003980 0x7fa65c003dc0 secure :-1 s=READY pgs=1925 cs=0 l=1 rev1=1 crypto rx=0x7fa664013980 tx=0x7fa664025700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c5f6765e57d63d4 server_cookie=0 in_seq=0 out_seq=0 2023-11-13T18:41:12.744 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:12.725+0000 7fa6737fe640 1 -- 172.21.15.102:0/714897920 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6640ae710 con 0x7fa65c003980 2023-11-13T18:41:12.744 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:12.725+0000 7fa6737fe640 1 -- 172.21.15.102:0/714897920 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa66400f070 con 0x7fa65c003980 2023-11-13T18:41:12.744 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:12.725+0000 7fa6737fe640 1 -- 172.21.15.102:0/714897920 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6640aeab0 con 0x7fa65c003980 2023-11-13T18:41:12.745 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:12.725+0000 7fa67b09a640 1 -- 172.21.15.102:0/714897920 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa65c003980 msgr2=0x7fa65c003dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T18:41:12.745 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:12.725+0000 7fa67b09a640 1 --2- 172.21.15.102:0/714897920 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa65c003980 0x7fa65c003dc0 secure :-1 s=READY pgs=1925 cs=0 l=1 rev1=1 crypto rx=0x7fa664013980 tx=0x7fa664025700 comp rx=0 tx=0).stop 2023-11-13T18:41:12.745 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:12.725+0000 7fa67b09a640 1 -- 172.21.15.102:0/714897920 shutdown_connections 2023-11-13T18:41:12.746 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:12.725+0000 7fa67b09a640 1 --2- 172.21.15.102:0/714897920 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa65c003980 0x7fa65c003dc0 unknown :-1 s=CLOSED pgs=1925 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T18:41:12.746 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:12.729+0000 7fa67b09a640 1 -- 172.21.15.102:0/714897920 >> 172.21.15.102:0/714897920 conn(0x7fa67406a410 msgr2=0x7fa67406a820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-13T18:41:12.746 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:12.729+0000 7fa67b09a640 1 -- 172.21.15.102:0/714897920 shutdown_connections 2023-11-13T18:41:12.747 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:12.729+0000 7fa67b09a640 1 -- 172.21.15.102:0/714897920 wait complete. 2023-11-13T18:41:12.747 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:12.729+0000 7fa67b09a640 1 Processor -- start 2023-11-13T18:41:12.747 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:12.729+0000 7fa67b09a640 1 -- start start 2023-11-13T18:41:12.747 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:12.729+0000 7fa67b09a640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa65c003980 0x7fa6740b0900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T18:41:12.748 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:12.729+0000 7fa67b09a640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa67414a6a0 0x7fa67414ab20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T18:41:12.748 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:12.729+0000 7fa67b09a640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa6741482d0 0x7fa674148780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T18:41:12.748 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:12.729+0000 7fa67b09a640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa67414b060 con 0x7fa6741482d0 2023-11-13T18:41:12.749 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:12.729+0000 7fa67b09a640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa67414a030 con 0x7fa65c003980 2023-11-13T18:41:12.749 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:12.729+0000 7fa67b09a640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa674148cc0 con 0x7fa67414a6a0 2023-11-13T18:41:12.749 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:12.733+0000 7fa678e36640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa65c003980 0x7fa6740b0900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T18:41:12.750 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:12.733+0000 7fa678e36640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa65c003980 0x7fa6740b0900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.102:53056/0 (socket says 172.21.15.102:53056) 2023-11-13T18:41:12.750 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:12.733+0000 7fa678e36640 1 -- 172.21.15.102:0/1335962178 learned_addr learned my addr 172.21.15.102:0/1335962178 (peer_addr_for_me v2:172.21.15.102:0/0) 2023-11-13T18:41:12.750 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:12.733+0000 7fa678e36640 1 -- 172.21.15.102:0/1335962178 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa67414a6a0 msgr2=0x7fa67414ab20 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-11-13T18:41:12.751 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:12.733+0000 7fa678e36640 1 --2- 172.21.15.102:0/1335962178 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa67414a6a0 0x7fa67414ab20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T18:41:12.751 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:12.733+0000 7fa678e36640 1 -- 172.21.15.102:0/1335962178 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa6741482d0 msgr2=0x7fa674148780 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-11-13T18:41:12.751 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:12.733+0000 7fa678e36640 1 --2- 172.21.15.102:0/1335962178 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa6741482d0 0x7fa674148780 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T18:41:12.751 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:12.733+0000 7fa678e36640 1 -- 172.21.15.102:0/1335962178 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa674148f90 con 0x7fa65c003980 2023-11-13T18:41:12.752 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:12.733+0000 7fa678e36640 1 --2- 172.21.15.102:0/1335962178 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa65c003980 0x7fa6740b0900 secure :-1 s=READY pgs=890 cs=0 l=1 rev1=1 crypto rx=0x7fa664025530 tx=0x7fa65c005800 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-13T18:41:12.752 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:12.733+0000 7fa6717fa640 1 -- 172.21.15.102:0/1335962178 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6640ae710 con 0x7fa65c003980 2023-11-13T18:41:12.752 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:12.733+0000 7fa67b09a640 1 -- 172.21.15.102:0/1335962178 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa674149270 con 0x7fa65c003980 2023-11-13T18:41:12.753 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:12.733+0000 7fa6717fa640 1 -- 172.21.15.102:0/1335962178 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa6640ae870 con 0x7fa65c003980 2023-11-13T18:41:12.753 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:12.733+0000 7fa67b09a640 1 -- 172.21.15.102:0/1335962178 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa674149830 con 0x7fa65c003980 2023-11-13T18:41:12.753 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:12.733+0000 7fa6717fa640 1 -- 172.21.15.102:0/1335962178 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6640aebe0 con 0x7fa65c003980 2023-11-13T18:41:12.754 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:12.737+0000 7fa67b09a640 1 -- 172.21.15.102:0/1335962178 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa654005260 con 0x7fa65c003980 2023-11-13T18:41:12.755 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:12.737+0000 7fa6717fa640 1 -- 172.21.15.102:0/1335962178 <== mon.1 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fa6640b4070 con 0x7fa65c003980 2023-11-13T18:41:12.755 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:12.737+0000 7fa6717fa640 1 --2- 172.21.15.102:0/1335962178 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7fa6600664a0 0x7fa660068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T18:41:12.755 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:12.737+0000 7fa6717fa640 1 -- 172.21.15.102:0/1335962178 <== mon.1 v2:172.21.15.154:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 5825+0+0 (secure 0 0 0) 0x7fa664126910 con 0x7fa65c003980 2023-11-13T18:41:12.756 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:12.741+0000 7fa673fff640 1 --2- 172.21.15.102:0/1335962178 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7fa6600664a0 0x7fa660068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T18:41:12.756 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:12.741+0000 7fa673fff640 1 --2- 172.21.15.102:0/1335962178 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7fa6600664a0 0x7fa660068960 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 crypto rx=0x7fa674156190 tx=0x7fa668009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-13T18:41:12.886 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:12.877+0000 7fa6717fa640 1 -- 172.21.15.102:0/1335962178 <== mon.1 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fa6640f3bf0 con 0x7fa65c003980 2023-11-13T18:41:13.697 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:13.689+0000 7fa67b09a640 1 -- 172.21.15.102:0/1335962178 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fa654005a90 con 0x7fa65c003980 2023-11-13T18:41:13.764 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:13.757+0000 7fa6717fa640 1 -- 172.21.15.102:0/1335962178 <== mon.1 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v38) v1 ==== 93+0+10 (secure 0 0 0) 0x7fa6640f7210 con 0x7fa65c003980 2023-11-13T18:41:13.764 INFO:teuthology.orchestra.run.smithi102.stdout:pg_num: 1 2023-11-13T18:41:13.767 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:13.757+0000 7fa67b09a640 1 -- 172.21.15.102:0/1335962178 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7fa6600664a0 msgr2=0x7fa660068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T18:41:13.768 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:13.757+0000 7fa67b09a640 1 --2- 172.21.15.102:0/1335962178 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7fa6600664a0 0x7fa660068960 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 crypto rx=0x7fa674156190 tx=0x7fa668009040 comp rx=0 tx=0).stop 2023-11-13T18:41:13.768 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:13.757+0000 7fa67b09a640 1 -- 172.21.15.102:0/1335962178 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa65c003980 msgr2=0x7fa6740b0900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T18:41:13.769 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:13.757+0000 7fa67b09a640 1 --2- 172.21.15.102:0/1335962178 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa65c003980 0x7fa6740b0900 secure :-1 s=READY pgs=890 cs=0 l=1 rev1=1 crypto rx=0x7fa664025530 tx=0x7fa65c005800 comp rx=0 tx=0).stop 2023-11-13T18:41:13.770 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:13.761+0000 7fa67b09a640 1 -- 172.21.15.102:0/1335962178 shutdown_connections 2023-11-13T18:41:13.771 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:13.761+0000 7fa67b09a640 1 --2- 172.21.15.102:0/1335962178 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7fa6600664a0 0x7fa660068960 unknown :-1 s=CLOSED pgs=735 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T18:41:13.771 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:13.761+0000 7fa67b09a640 1 --2- 172.21.15.102:0/1335962178 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa6741482d0 0x7fa674148780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T18:41:13.771 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:13.761+0000 7fa67b09a640 1 --2- 172.21.15.102:0/1335962178 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa67414a6a0 0x7fa67414ab20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T18:41:13.771 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:13.761+0000 7fa67b09a640 1 --2- 172.21.15.102:0/1335962178 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa65c003980 0x7fa6740b0900 unknown :-1 s=CLOSED pgs=890 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T18:41:13.771 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:13.761+0000 7fa67b09a640 1 -- 172.21.15.102:0/1335962178 >> 172.21.15.102:0/1335962178 conn(0x7fa67406a410 msgr2=0x7fa67406d410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-13T18:41:13.772 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:13.761+0000 7fa67b09a640 1 -- 172.21.15.102:0/1335962178 shutdown_connections 2023-11-13T18:41:13.772 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:13.761+0000 7fa67b09a640 1 -- 172.21.15.102:0/1335962178 wait complete. 2023-11-13T18:41:13.843 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-13T18:41:14.411 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:14.405+0000 7f578d279640 1 Processor -- start 2023-11-13T18:41:14.413 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:14.405+0000 7f578d279640 1 -- start start 2023-11-13T18:41:14.418 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:14.409+0000 7f578d279640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f57880cac00 0x7f57880cb0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T18:41:14.419 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:14.409+0000 7f578d279640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f57880aded0 0x7f57880cb620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T18:41:14.419 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:14.409+0000 7f578d279640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f578806c0d0 con 0x7f5788159230 2023-11-13T18:41:14.419 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:14.409+0000 7f578d279640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f57880b3c00 con 0x7f57880aded0 2023-11-13T18:41:14.419 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:14.409+0000 7f578d279640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f57880cdce0 con 0x7f57880cac00 2023-11-13T18:41:14.420 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:14.409+0000 7f57867fc640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f57880cac00 0x7f57880cb0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T18:41:14.420 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:14.409+0000 7f57867fc640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f57880cac00 0x7f57880cb0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.102:55128/0 (socket says 172.21.15.102:55128) 2023-11-13T18:41:14.420 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:14.409+0000 7f57867fc640 1 -- 172.21.15.102:0/137579582 learned_addr learned my addr 172.21.15.102:0/137579582 (peer_addr_for_me v2:172.21.15.102:0/0) 2023-11-13T18:41:14.432 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:14.413+0000 7f57867fc640 1 -- 172.21.15.102:0/137579582 >> v2:172.21.15.102:3300/0 conn(0x7f57880aded0 msgr2=0x7f57880cb620 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-13T18:41:14.432 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:14.413+0000 7f57867fc640 1 --2- 172.21.15.102:0/137579582 >> v2:172.21.15.102:3300/0 conn(0x7f57880aded0 0x7f57880cb620 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T18:41:14.433 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:14.413+0000 7f57867fc640 1 -- 172.21.15.102:0/137579582 >> v1:172.21.15.102:6789/0 conn(0x7f5788159230 legacy=0x7f578806b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-13T18:41:14.433 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:14.413+0000 7f57867fc640 1 -- 172.21.15.102:0/137579582 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57880cdfc0 con 0x7f57880cac00 2023-11-13T18:41:14.433 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:14.413+0000 7f57867fc640 1 --2- 172.21.15.102:0/137579582 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f57880cac00 0x7f57880cb0e0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f5778009870 tx=0x7f577801d600 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a9a5a3d6ccbadab5 server_cookie=0 in_seq=0 out_seq=0 2023-11-13T18:41:14.433 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:14.413+0000 7f5785ffb640 1 -- 172.21.15.102:0/137579582 <== mon.2 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57780aa5f0 con 0x7f57880cac00 2023-11-13T18:41:14.433 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:14.417+0000 7f5785ffb640 1 -- 172.21.15.102:0/137579582 <== mon.2 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f57780aa750 con 0x7f57880cac00 2023-11-13T18:41:14.434 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:14.417+0000 7f5785ffb640 1 -- 172.21.15.102:0/137579582 <== mon.2 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57780aaae0 con 0x7f57880cac00 2023-11-13T18:41:14.434 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:14.417+0000 7f578d279640 1 -- 172.21.15.102:0/137579582 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f57880cac00 msgr2=0x7f57880cb0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T18:41:14.434 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:14.417+0000 7f578d279640 1 --2- 172.21.15.102:0/137579582 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f57880cac00 0x7f57880cb0e0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f5778009870 tx=0x7f577801d600 comp rx=0 tx=0).stop 2023-11-13T18:41:14.434 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:14.421+0000 7f578d279640 1 -- 172.21.15.102:0/137579582 shutdown_connections 2023-11-13T18:41:14.434 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:14.421+0000 7f578d279640 1 --2- 172.21.15.102:0/137579582 >> v2:172.21.15.102:3300/0 conn(0x7f57880aded0 0x7f57880cb620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T18:41:14.434 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:14.421+0000 7f578d279640 1 --2- 172.21.15.102:0/137579582 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f57880cac00 0x7f57880cb0e0 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T18:41:14.435 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:14.421+0000 7f578d279640 1 -- 172.21.15.102:0/137579582 >> 172.21.15.102:0/137579582 conn(0x7f578806a240 msgr2=0x7f578806a650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-13T18:41:14.435 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:14.421+0000 7f578d279640 1 -- 172.21.15.102:0/137579582 shutdown_connections 2023-11-13T18:41:14.435 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:14.421+0000 7f578d279640 1 -- 172.21.15.102:0/137579582 wait complete. 2023-11-13T18:41:14.435 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:14.421+0000 7f578d279640 1 Processor -- start 2023-11-13T18:41:14.435 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:14.425+0000 7f578d279640 1 -- start start 2023-11-13T18:41:14.436 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:14.425+0000 7f578d279640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f57880aded0 0x7f5788149650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T18:41:14.436 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:14.425+0000 7f578d279640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f57880cac00 0x7f57881fa040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T18:41:14.437 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:14.425+0000 7f578d279640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5788159230 0x7f57881fa580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T18:41:14.437 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:14.425+0000 7f578d279640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5788149b90 con 0x7f57880aded0 2023-11-13T18:41:14.437 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:14.425+0000 7f578d279640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57881fab90 con 0x7f5788159230 2023-11-13T18:41:14.437 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:14.425+0000 7f578d279640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f57881fae70 con 0x7f57880cac00 2023-11-13T18:41:14.437 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:14.425+0000 7f5786ffd640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f57880aded0 0x7f5788149650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T18:41:14.437 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:14.425+0000 7f5786ffd640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f57880aded0 0x7f5788149650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:48158/0 (socket says 172.21.15.102:48158) 2023-11-13T18:41:14.438 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:14.425+0000 7f5786ffd640 1 -- 172.21.15.102:0/1206239009 learned_addr learned my addr 172.21.15.102:0/1206239009 (peer_addr_for_me v2:172.21.15.102:0/0) 2023-11-13T18:41:14.438 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:14.425+0000 7f57867fc640 1 --2- 172.21.15.102:0/1206239009 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f57880cac00 0x7f57881fa040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T18:41:14.438 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:14.425+0000 7f5786ffd640 1 -- 172.21.15.102:0/1206239009 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f57880cac00 msgr2=0x7f57881fa040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T18:41:14.438 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:14.425+0000 7f5786ffd640 1 --2- 172.21.15.102:0/1206239009 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f57880cac00 0x7f57881fa040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T18:41:14.438 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:14.425+0000 7f5786ffd640 1 -- 172.21.15.102:0/1206239009 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5788159230 msgr2=0x7f57881fa580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T18:41:14.439 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:14.425+0000 7f57877fe640 1 --2- 172.21.15.102:0/1206239009 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5788159230 0x7f57881fa580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T18:41:14.439 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:14.425+0000 7f5786ffd640 1 --2- 172.21.15.102:0/1206239009 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5788159230 0x7f57881fa580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T18:41:14.439 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:14.425+0000 7f5786ffd640 1 -- 172.21.15.102:0/1206239009 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57780094d0 con 0x7f57880aded0 2023-11-13T18:41:14.439 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:14.425+0000 7f57867fc640 1 --2- 172.21.15.102:0/1206239009 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f57880cac00 0x7f57881fa040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-13T18:41:14.439 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:14.425+0000 7f57877fe640 1 --2- 172.21.15.102:0/1206239009 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5788159230 0x7f57881fa580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-13T18:41:14.440 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:14.429+0000 7f5786ffd640 1 --2- 172.21.15.102:0/1206239009 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f57880aded0 0x7f5788149650 secure :-1 s=READY pgs=1926 cs=0 l=1 rev1=1 crypto rx=0x7f577c00b3e0 tx=0x7f577c00b8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-13T18:41:14.440 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:14.429+0000 7f576f7fe640 1 -- 172.21.15.102:0/1206239009 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f577c022640 con 0x7f57880aded0 2023-11-13T18:41:14.440 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:14.429+0000 7f576f7fe640 1 -- 172.21.15.102:0/1206239009 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f577c0227c0 con 0x7f57880aded0 2023-11-13T18:41:14.441 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:14.429+0000 7f578d279640 1 -- 172.21.15.102:0/1206239009 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f57881664f0 con 0x7f57880aded0 2023-11-13T18:41:14.441 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:14.429+0000 7f578d279640 1 -- 172.21.15.102:0/1206239009 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f578814afc0 con 0x7f57880aded0 2023-11-13T18:41:14.441 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:14.429+0000 7f576f7fe640 1 -- 172.21.15.102:0/1206239009 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f577c022b70 con 0x7f57880aded0 2023-11-13T18:41:14.441 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:14.433+0000 7f578d279640 1 -- 172.21.15.102:0/1206239009 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5788166350 con 0x7f57880aded0 2023-11-13T18:41:14.450 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:14.441+0000 7f576f7fe640 1 -- 172.21.15.102:0/1206239009 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f577c022cd0 con 0x7f57880aded0 2023-11-13T18:41:14.453 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:14.445+0000 7f576f7fe640 1 --2- 172.21.15.102:0/1206239009 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f5774066540 0x7f5774068a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T18:41:14.454 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:14.445+0000 7f576f7fe640 1 -- 172.21.15.102:0/1206239009 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f577c094e20 con 0x7f57880aded0 2023-11-13T18:41:14.454 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:14.445+0000 7f57867fc640 1 --2- 172.21.15.102:0/1206239009 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f5774066540 0x7f5774068a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T18:41:14.455 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:14.445+0000 7f57867fc640 1 --2- 172.21.15.102:0/1206239009 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f5774066540 0x7f5774068a00 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7f57780af000 tx=0x7f5778008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-13T18:41:14.607 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:14.597+0000 7f576f7fe640 1 -- 172.21.15.102:0/1206239009 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f5788166350 con 0x7f57880aded0 2023-11-13T18:41:15.421 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:15.413+0000 7f578d279640 1 -- 172.21.15.102:0/1206239009 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f5788166350 con 0x7f57880aded0 2023-11-13T18:41:15.480 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:15.473+0000 7f576f7fe640 1 -- 172.21.15.102:0/1206239009 <== mon.0 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v38) v1 ==== 104+0+11 (secure 0 0 0) 0x7f577c026020 con 0x7f57880aded0 2023-11-13T18:41:15.480 INFO:teuthology.orchestra.run.smithi102.stdout:pg_num: 32 2023-11-13T18:41:15.485 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:15.477+0000 7f578d279640 1 -- 172.21.15.102:0/1206239009 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f5774066540 msgr2=0x7f5774068a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T18:41:15.485 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:15.477+0000 7f578d279640 1 --2- 172.21.15.102:0/1206239009 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f5774066540 0x7f5774068a00 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7f57780af000 tx=0x7f5778008040 comp rx=0 tx=0).stop 2023-11-13T18:41:15.485 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:15.477+0000 7f578d279640 1 -- 172.21.15.102:0/1206239009 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f57880aded0 msgr2=0x7f5788149650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T18:41:15.485 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:15.477+0000 7f578d279640 1 --2- 172.21.15.102:0/1206239009 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f57880aded0 0x7f5788149650 secure :-1 s=READY pgs=1926 cs=0 l=1 rev1=1 crypto rx=0x7f577c00b3e0 tx=0x7f577c00b8a0 comp rx=0 tx=0).stop 2023-11-13T18:41:15.486 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:15.477+0000 7f578d279640 1 -- 172.21.15.102:0/1206239009 shutdown_connections 2023-11-13T18:41:15.486 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:15.477+0000 7f578d279640 1 --2- 172.21.15.102:0/1206239009 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5788159230 0x7f57881fa580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T18:41:15.486 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:15.477+0000 7f578d279640 1 --2- 172.21.15.102:0/1206239009 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f57880cac00 0x7f57881fa040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T18:41:15.486 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:15.477+0000 7f578d279640 1 --2- 172.21.15.102:0/1206239009 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f5774066540 0x7f5774068a00 unknown :-1 s=CLOSED pgs=736 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T18:41:15.486 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:15.477+0000 7f578d279640 1 --2- 172.21.15.102:0/1206239009 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f57880aded0 0x7f5788149650 unknown :-1 s=CLOSED pgs=1926 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T18:41:15.487 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:15.477+0000 7f578d279640 1 -- 172.21.15.102:0/1206239009 >> 172.21.15.102:0/1206239009 conn(0x7f578806a240 msgr2=0x7f578806d240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-13T18:41:15.487 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:15.477+0000 7f578d279640 1 -- 172.21.15.102:0/1206239009 shutdown_connections 2023-11-13T18:41:15.487 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:15.477+0000 7f578d279640 1 -- 172.21.15.102:0/1206239009 wait complete. 2023-11-13T18:41:15.558 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-13T18:41:16.111 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:16.101+0000 7f8f93fff640 1 Processor -- start 2023-11-13T18:41:16.111 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:16.101+0000 7f8f93fff640 1 -- start start 2023-11-13T18:41:16.118 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:16.109+0000 7f8f93fff640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f8f94151a50 0x7f8f9415f100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T18:41:16.119 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:16.109+0000 7f8f92ffd640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f8f94151a50 0x7f8f9415f100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T18:41:16.119 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:16.109+0000 7f8f93fff640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8f9415ba10 con 0x7f8f9406a950 2023-11-13T18:41:16.119 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:16.109+0000 7f8f93fff640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8f9415f640 con 0x7f8f94151e30 2023-11-13T18:41:16.120 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:16.109+0000 7f8f93fff640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8f940cb4f0 con 0x7f8f94151a50 2023-11-13T18:41:16.120 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:16.109+0000 7f8f92ffd640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f8f94151a50 0x7f8f9415f100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.102:53080/0 (socket says 172.21.15.102:53080) 2023-11-13T18:41:16.120 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:16.109+0000 7f8f92ffd640 1 -- 172.21.15.102:0/2031664545 learned_addr learned my addr 172.21.15.102:0/2031664545 (peer_addr_for_me v2:172.21.15.102:0/0) 2023-11-13T18:41:16.121 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:16.113+0000 7f8f91ffb640 1 -- 172.21.15.102:0/2031664545 <== mon.1 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3420601492 0 0) 0x7f8f9415f640 con 0x7f8f94151e30 2023-11-13T18:41:16.121 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:16.113+0000 7f8f92ffd640 1 -- 172.21.15.102:0/2031664545 >> v1:172.21.15.154:6789/0 conn(0x7f8f94151e30 legacy=0x7f8f9406a240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T18:41:16.121 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:16.113+0000 7f8f92ffd640 1 -- 172.21.15.102:0/2031664545 >> v1:172.21.15.102:6789/0 conn(0x7f8f9406a950 legacy=0x7f8f940ad4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T18:41:16.122 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:16.113+0000 7f8f92ffd640 1 -- 172.21.15.102:0/2031664545 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f9415b100 con 0x7f8f94151a50 2023-11-13T18:41:16.134 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:16.125+0000 7f8f92ffd640 1 --2- 172.21.15.102:0/2031664545 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8f94151a50 0x7f8f9415f100 secure :-1 s=READY pgs=892 cs=0 l=1 rev1=1 crypto rx=0x7f8f84009870 tx=0x7f8f8401c490 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d8ef31789b786557 server_cookie=0 in_seq=0 out_seq=0 2023-11-13T18:41:16.135 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:16.125+0000 7f8f91ffb640 1 -- 172.21.15.102:0/2031664545 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f840ad660 con 0x7f8f94151a50 2023-11-13T18:41:16.135 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:16.125+0000 7f8f91ffb640 1 -- 172.21.15.102:0/2031664545 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f840ad7c0 con 0x7f8f94151a50 2023-11-13T18:41:16.136 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:16.125+0000 7f8f91ffb640 1 -- 172.21.15.102:0/2031664545 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f840adb50 con 0x7f8f94151a50 2023-11-13T18:41:16.137 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:16.129+0000 7f8f93fff640 1 -- 172.21.15.102:0/2031664545 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8f94151a50 msgr2=0x7f8f9415f100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T18:41:16.137 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:16.129+0000 7f8f93fff640 1 --2- 172.21.15.102:0/2031664545 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8f94151a50 0x7f8f9415f100 secure :-1 s=READY pgs=892 cs=0 l=1 rev1=1 crypto rx=0x7f8f84009870 tx=0x7f8f8401c490 comp rx=0 tx=0).stop 2023-11-13T18:41:16.138 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:16.129+0000 7f8f93fff640 1 -- 172.21.15.102:0/2031664545 shutdown_connections 2023-11-13T18:41:16.138 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:16.129+0000 7f8f93fff640 1 --2- 172.21.15.102:0/2031664545 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8f94151a50 0x7f8f9415f100 unknown :-1 s=CLOSED pgs=892 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T18:41:16.138 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:16.129+0000 7f8f93fff640 1 -- 172.21.15.102:0/2031664545 >> 172.21.15.102:0/2031664545 conn(0x7f8f940b04d0 msgr2=0x7f8f940b08e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-13T18:41:16.139 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:16.129+0000 7f8f93fff640 1 -- 172.21.15.102:0/2031664545 shutdown_connections 2023-11-13T18:41:16.139 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:16.129+0000 7f8f93fff640 1 -- 172.21.15.102:0/2031664545 wait complete. 2023-11-13T18:41:16.146 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:16.137+0000 7f8f93fff640 1 Processor -- start 2023-11-13T18:41:16.147 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:16.137+0000 7f8f93fff640 1 -- start start 2023-11-13T18:41:16.152 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:16.141+0000 7f8f93fff640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8f9406a950 0x7f8f94140320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T18:41:16.152 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:16.145+0000 7f8f93fff640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8f94151a50 0x7f8f941496b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T18:41:16.152 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:16.145+0000 7f8f93fff640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8f94149bf0 0x7f8f941fcf70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T18:41:16.153 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:16.145+0000 7f8f93fff640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f94149290 con 0x7f8f94149bf0 2023-11-13T18:41:16.153 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:16.145+0000 7f8f93fff640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f94140860 con 0x7f8f94151a50 2023-11-13T18:41:16.153 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:16.145+0000 7f8f93fff640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8f941fda30 con 0x7f8f9406a950 2023-11-13T18:41:16.154 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:16.145+0000 7f8f937fe640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8f94149bf0 0x7f8f941fcf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T18:41:16.154 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:16.145+0000 7f8f927fc640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8f94151a50 0x7f8f941496b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T18:41:16.154 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:16.145+0000 7f8f937fe640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8f94149bf0 0x7f8f941fcf70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:48166/0 (socket says 172.21.15.102:48166) 2023-11-13T18:41:16.155 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:16.145+0000 7f8f937fe640 1 -- 172.21.15.102:0/1252667272 learned_addr learned my addr 172.21.15.102:0/1252667272 (peer_addr_for_me v2:172.21.15.102:0/0) 2023-11-13T18:41:16.155 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:16.145+0000 7f8f92ffd640 1 --2- 172.21.15.102:0/1252667272 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8f9406a950 0x7f8f94140320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T18:41:16.155 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:16.145+0000 7f8f927fc640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8f94151a50 0x7f8f941496b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.102:53084/0 (socket says 172.21.15.102:53084) 2023-11-13T18:41:16.156 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:16.145+0000 7f8f92ffd640 1 -- 172.21.15.102:0/1252667272 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8f94151a50 msgr2=0x7f8f941496b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T18:41:16.156 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:16.145+0000 7f8f92ffd640 1 --2- 172.21.15.102:0/1252667272 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8f94151a50 0x7f8f941496b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T18:41:16.156 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:16.145+0000 7f8f92ffd640 1 -- 172.21.15.102:0/1252667272 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8f94149bf0 msgr2=0x7f8f941fcf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T18:41:16.157 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:16.145+0000 7f8f92ffd640 1 --2- 172.21.15.102:0/1252667272 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8f94149bf0 0x7f8f941fcf70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T18:41:16.157 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:16.145+0000 7f8f92ffd640 1 -- 172.21.15.102:0/1252667272 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f840094d0 con 0x7f8f9406a950 2023-11-13T18:41:16.157 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:16.145+0000 7f8f92ffd640 1 --2- 172.21.15.102:0/1252667272 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8f9406a950 0x7f8f94140320 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f8f840ac000 tx=0x7f8f84019230 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-13T18:41:16.157 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:16.145+0000 7f8f7bfff640 1 -- 172.21.15.102:0/1252667272 <== mon.2 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f840b7600 con 0x7f8f9406a950 2023-11-13T18:41:16.157 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:16.149+0000 7f8f7bfff640 1 -- 172.21.15.102:0/1252667272 <== mon.2 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f840b7780 con 0x7f8f9406a950 2023-11-13T18:41:16.158 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:16.149+0000 7f8f93fff640 1 -- 172.21.15.102:0/1252667272 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8f941fdd10 con 0x7f8f9406a950 2023-11-13T18:41:16.158 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:16.149+0000 7f8f93fff640 1 -- 172.21.15.102:0/1252667272 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8f9414b050 con 0x7f8f9406a950 2023-11-13T18:41:16.159 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:16.149+0000 7f8f7bfff640 1 -- 172.21.15.102:0/1252667272 <== mon.2 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f840b7b30 con 0x7f8f9406a950 2023-11-13T18:41:16.159 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:16.149+0000 7f8f93fff640 1 -- 172.21.15.102:0/1252667272 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8f94068520 con 0x7f8f9406a950 2023-11-13T18:41:16.159 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:16.149+0000 7f8f7bfff640 1 -- 172.21.15.102:0/1252667272 <== mon.2 v2:172.21.15.154:3301/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f8f840b7c90 con 0x7f8f9406a950 2023-11-13T18:41:16.162 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:16.153+0000 7f8f7bfff640 1 --2- 172.21.15.102:0/1252667272 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f8f800664c0 0x7f8f80068980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T18:41:16.163 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:16.153+0000 7f8f927fc640 1 --2- 172.21.15.102:0/1252667272 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f8f800664c0 0x7f8f80068980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T18:41:16.163 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:16.153+0000 7f8f7bfff640 1 -- 172.21.15.102:0/1252667272 <== mon.2 v2:172.21.15.154:3301/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f8f8411ebe0 con 0x7f8f9406a950 2023-11-13T18:41:16.166 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:16.157+0000 7f8f927fc640 1 --2- 172.21.15.102:0/1252667272 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f8f800664c0 0x7f8f80068980 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 crypto rx=0x7f8f88000f70 tx=0x7f8f88009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-13T18:41:16.172 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:16.165+0000 7f8f7bfff640 1 -- 172.21.15.102:0/1252667272 <== mon.2 v2:172.21.15.154:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f8f840ec220 con 0x7f8f9406a950 2023-11-13T18:41:16.949 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:16.941+0000 7f8f93fff640 1 -- 172.21.15.102:0/1252667272 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f8f9406b170 con 0x7f8f9406a950 2023-11-13T18:41:17.255 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:17.245+0000 7f8f7bfff640 1 -- 172.21.15.102:0/1252667272 <== mon.2 v2:172.21.15.154:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v38) v1 ==== 100+0+11 (secure 0 0 0) 0x7f8f840ef840 con 0x7f8f9406a950 2023-11-13T18:41:17.256 INFO:teuthology.orchestra.run.smithi102.stdout:pg_num: 64 2023-11-13T18:41:17.258 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:17.249+0000 7f8f93fff640 1 -- 172.21.15.102:0/1252667272 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f8f800664c0 msgr2=0x7f8f80068980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T18:41:17.258 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:17.249+0000 7f8f93fff640 1 --2- 172.21.15.102:0/1252667272 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f8f800664c0 0x7f8f80068980 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 crypto rx=0x7f8f88000f70 tx=0x7f8f88009040 comp rx=0 tx=0).stop 2023-11-13T18:41:17.259 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:17.249+0000 7f8f93fff640 1 -- 172.21.15.102:0/1252667272 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8f9406a950 msgr2=0x7f8f94140320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T18:41:17.259 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:17.249+0000 7f8f93fff640 1 --2- 172.21.15.102:0/1252667272 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8f9406a950 0x7f8f94140320 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f8f840ac000 tx=0x7f8f84019230 comp rx=0 tx=0).stop 2023-11-13T18:41:17.259 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:17.249+0000 7f8f93fff640 1 -- 172.21.15.102:0/1252667272 shutdown_connections 2023-11-13T18:41:17.259 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:17.249+0000 7f8f93fff640 1 --2- 172.21.15.102:0/1252667272 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f8f800664c0 0x7f8f80068980 unknown :-1 s=CLOSED pgs=737 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T18:41:17.260 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:17.249+0000 7f8f93fff640 1 --2- 172.21.15.102:0/1252667272 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8f94149bf0 0x7f8f941fcf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T18:41:17.260 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:17.249+0000 7f8f93fff640 1 --2- 172.21.15.102:0/1252667272 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8f94151a50 0x7f8f941496b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T18:41:17.260 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:17.249+0000 7f8f93fff640 1 --2- 172.21.15.102:0/1252667272 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8f9406a950 0x7f8f94140320 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T18:41:17.260 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:17.249+0000 7f8f93fff640 1 -- 172.21.15.102:0/1252667272 >> 172.21.15.102:0/1252667272 conn(0x7f8f940b04d0 msgr2=0x7f8f9406a240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-13T18:41:17.261 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:17.249+0000 7f8f93fff640 1 -- 172.21.15.102:0/1252667272 shutdown_connections 2023-11-13T18:41:17.261 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:17.249+0000 7f8f93fff640 1 -- 172.21.15.102:0/1252667272 wait complete. 2023-11-13T18:41:17.298 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-13T18:41:17.865 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:17.857+0000 7efe9759e640 1 Processor -- start 2023-11-13T18:41:17.865 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:17.857+0000 7efe9759e640 1 -- start start 2023-11-13T18:41:17.871 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:17.861+0000 7efe9759e640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7efe980b4e60 0x7efe980af7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T18:41:17.872 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:17.861+0000 7efe9759e640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efe980b1e10 con 0x7efe9815a2b0 2023-11-13T18:41:17.872 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:17.865+0000 7efe9759e640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efe980b1600 con 0x7efe9815ada0 2023-11-13T18:41:17.872 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:17.865+0000 7efe9759e640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efe98157c90 con 0x7efe980b4e60 2023-11-13T18:41:17.873 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:17.865+0000 7efe8dd9b640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7efe9815ada0 0x7efe9806a900 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.102:37702/0 (socket says 172.21.15.102:37702) 2023-11-13T18:41:17.873 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:17.865+0000 7efe8dd9b640 1 -- 172.21.15.102:0/3460362807 learned_addr learned my addr 172.21.15.102:0/3460362807 (peer_addr_for_me v1:172.21.15.102:0/0) 2023-11-13T18:41:17.877 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:17.869+0000 7efe96d9d640 1 --2- 172.21.15.102:0/3460362807 >> v2:172.21.15.102:3300/0 conn(0x7efe980b4e60 0x7efe980af7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T18:41:17.879 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:17.869+0000 7efe96d9d640 1 -- 172.21.15.102:0/3460362807 >> v1:172.21.15.154:6789/0 conn(0x7efe9815ada0 legacy=0x7efe9806a900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T18:41:17.879 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:17.869+0000 7efe96d9d640 1 -- 172.21.15.102:0/3460362807 >> v1:172.21.15.102:6789/0 conn(0x7efe9815a2b0 legacy=0x7efe9815a690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-13T18:41:17.879 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:17.869+0000 7efe96d9d640 1 -- 172.21.15.102:0/3460362807 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe980b5290 con 0x7efe980b4e60 2023-11-13T18:41:17.898 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:17.889+0000 7efe96d9d640 1 --2- 172.21.15.102:0/3460362807 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7efe980b4e60 0x7efe980af7f0 secure :-1 s=READY pgs=1928 cs=0 l=1 rev1=1 crypto rx=0x7efe90009d90 tx=0x7efe9001ea90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b9c3c469601b8ebc server_cookie=0 in_seq=0 out_seq=0 2023-11-13T18:41:17.902 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:17.889+0000 7efe95d9b640 1 -- 172.21.15.102:0/3460362807 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe900a7a60 con 0x7efe980b4e60 2023-11-13T18:41:17.902 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:17.893+0000 7efe95d9b640 1 -- 172.21.15.102:0/3460362807 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe900a7bc0 con 0x7efe980b4e60 2023-11-13T18:41:17.902 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:17.893+0000 7efe95d9b640 1 -- 172.21.15.102:0/3460362807 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe900a7a60 con 0x7efe980b4e60 2023-11-13T18:41:17.903 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:17.893+0000 7efe9759e640 1 -- 172.21.15.102:0/3460362807 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7efe980b4e60 msgr2=0x7efe980af7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T18:41:17.903 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:17.893+0000 7efe9759e640 1 --2- 172.21.15.102:0/3460362807 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7efe980b4e60 0x7efe980af7f0 secure :-1 s=READY pgs=1928 cs=0 l=1 rev1=1 crypto rx=0x7efe90009d90 tx=0x7efe9001ea90 comp rx=0 tx=0).stop 2023-11-13T18:41:17.903 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:17.893+0000 7efe9759e640 1 -- 172.21.15.102:0/3460362807 shutdown_connections 2023-11-13T18:41:17.903 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:17.893+0000 7efe9759e640 1 --2- 172.21.15.102:0/3460362807 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7efe980b4e60 0x7efe980af7f0 unknown :-1 s=CLOSED pgs=1928 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T18:41:17.904 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:17.893+0000 7efe9759e640 1 -- 172.21.15.102:0/3460362807 >> 172.21.15.102:0/3460362807 conn(0x7efe980b4020 msgr2=0x7efe980b46e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-13T18:41:17.906 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:17.897+0000 7efe9759e640 1 -- 172.21.15.102:0/3460362807 shutdown_connections 2023-11-13T18:41:17.907 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:17.897+0000 7efe9759e640 1 -- 172.21.15.102:0/3460362807 wait complete. 2023-11-13T18:41:17.913 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:17.905+0000 7efe9759e640 1 Processor -- start 2023-11-13T18:41:17.914 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:17.905+0000 7efe9759e640 1 -- start start 2023-11-13T18:41:17.918 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:17.909+0000 7efe9759e640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efe980b4e60 0x7efe980993d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T18:41:17.918 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:17.909+0000 7efe9759e640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7efe9815a2b0 0x7efe9809c050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T18:41:17.919 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:17.909+0000 7efe9759e640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7efe9815ada0 0x7efe980ad7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T18:41:17.919 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:17.909+0000 7efe9759e640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe9809a7c0 con 0x7efe9815ada0 2023-11-13T18:41:17.919 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:17.909+0000 7efe9759e640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe98099910 con 0x7efe980b4e60 2023-11-13T18:41:17.919 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:17.909+0000 7efe9759e640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efe98099bb0 con 0x7efe9815a2b0 2023-11-13T18:41:17.920 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:17.909+0000 7efe9659c640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efe980b4e60 0x7efe980993d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T18:41:17.921 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:17.909+0000 7efe96d9d640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7efe9815ada0 0x7efe980ad7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T18:41:17.921 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:17.909+0000 7efe96d9d640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7efe9815ada0 0x7efe980ad7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:34320/0 (socket says 172.21.15.102:34320) 2023-11-13T18:41:17.921 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:17.909+0000 7efe8dd9b640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7efe9815a2b0 0x7efe9809c050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T18:41:17.921 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:17.909+0000 7efe96d9d640 1 -- 172.21.15.102:0/1347934077 learned_addr learned my addr 172.21.15.102:0/1347934077 (peer_addr_for_me v2:172.21.15.102:0/0) 2023-11-13T18:41:17.921 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:17.909+0000 7efe96d9d640 1 -- 172.21.15.102:0/1347934077 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7efe9815a2b0 msgr2=0x7efe9809c050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T18:41:17.922 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:17.913+0000 7efe96d9d640 1 --2- 172.21.15.102:0/1347934077 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7efe9815a2b0 0x7efe9809c050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T18:41:17.922 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:17.913+0000 7efe96d9d640 1 -- 172.21.15.102:0/1347934077 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efe980b4e60 msgr2=0x7efe980993d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T18:41:17.922 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:17.913+0000 7efe96d9d640 1 --2- 172.21.15.102:0/1347934077 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efe980b4e60 0x7efe980993d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T18:41:17.922 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:17.913+0000 7efe96d9d640 1 -- 172.21.15.102:0/1347934077 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe90009a70 con 0x7efe9815ada0 2023-11-13T18:41:17.922 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:17.913+0000 7efe9659c640 1 --2- 172.21.15.102:0/1347934077 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efe980b4e60 0x7efe980993d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-13T18:41:17.923 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:17.913+0000 7efe96d9d640 1 --2- 172.21.15.102:0/1347934077 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7efe9815ada0 0x7efe980ad7a0 secure :-1 s=READY pgs=1929 cs=0 l=1 rev1=1 crypto rx=0x7efe9001c6c0 tx=0x7efe9001b830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-13T18:41:17.923 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:17.913+0000 7efe8f7fe640 1 -- 172.21.15.102:0/1347934077 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe900a7a60 con 0x7efe9815ada0 2023-11-13T18:41:17.924 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:17.913+0000 7efe8f7fe640 1 -- 172.21.15.102:0/1347934077 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe900afc80 con 0x7efe9815ada0 2023-11-13T18:41:17.924 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:17.913+0000 7efe8f7fe640 1 -- 172.21.15.102:0/1347934077 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe900b9440 con 0x7efe9815ada0 2023-11-13T18:41:17.924 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:17.913+0000 7efe9759e640 1 -- 172.21.15.102:0/1347934077 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efe98099e90 con 0x7efe9815ada0 2023-11-13T18:41:17.924 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:17.913+0000 7efe9759e640 1 -- 172.21.15.102:0/1347934077 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efe9809a450 con 0x7efe9815ada0 2023-11-13T18:41:17.925 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:17.917+0000 7efe9759e640 1 -- 172.21.15.102:0/1347934077 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efe98067680 con 0x7efe9815ada0 2023-11-13T18:41:17.936 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:17.925+0000 7efe8f7fe640 1 -- 172.21.15.102:0/1347934077 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7efe900b95a0 con 0x7efe9815ada0 2023-11-13T18:41:17.936 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:17.925+0000 7efe8f7fe640 1 --2- 172.21.15.102:0/1347934077 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7efe78066470 0x7efe78068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T18:41:17.937 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:17.925+0000 7efe8f7fe640 1 -- 172.21.15.102:0/1347934077 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 5825+0+0 (secure 0 0 0) 0x7efe9011faf0 con 0x7efe9815ada0 2023-11-13T18:41:17.937 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:17.929+0000 7efe9659c640 1 --2- 172.21.15.102:0/1347934077 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7efe78066470 0x7efe78068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T18:41:17.951 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:17.941+0000 7efe9659c640 1 --2- 172.21.15.102:0/1347934077 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7efe78066470 0x7efe78068930 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7efe80001760 tx=0x7efe80009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-13T18:41:17.953 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:17.945+0000 7efe8f7fe640 1 -- 172.21.15.102:0/1347934077 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7efe900ecfb0 con 0x7efe9815ada0 2023-11-13T18:41:18.985 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:18.977+0000 7efe9759e640 1 -- 172.21.15.102:0/1347934077 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7efe9809a970 con 0x7efe9815ada0 2023-11-13T18:41:18.987 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:18.981+0000 7efe8f7fe640 1 -- 172.21.15.102:0/1347934077 <== mon.0 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) v1 ==== 94+0+4922 (secure 0 0 0) 0x7efe9809a970 con 0x7efe9815ada0 2023-11-13T18:41:18.988 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T18:41:18.989 INFO:teuthology.orchestra.run.smithi102.stdout:{"epoch":16,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4826,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6834/3121803929","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6832","nonce":3121803929},{"type":"v1","addr":"172.21.15.154:6834","nonce":3121803929}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":4829,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6835/2990283260","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6833","nonce":2990283260},{"type":"v1","addr":"172.21.15.154:6835","nonce":2990283260}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":5271,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.102:6836/868460192","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6834","nonce":868460192},{"type":"v1","addr":"172.21.15.102:6836","nonce":868460192}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-13T11:29:56.498042+0000","modified":"2023-11-13T11:29:59.519487+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5274},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5274":{"gid":5274,"name":"a","rank":0,"incarnation":12,"state":"up:active","state_seq":3,"addr":"172.21.15.102:6837/3869977039","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6835","nonce":3869977039},{"type":"v1","addr":"172.21.15.102:6837","nonce":3869977039}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-11-13T18:41:18.989 INFO:teuthology.orchestra.run.smithi102.stderr:dumped fsmap epoch 16 2023-11-13T18:41:18.995 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:18.985+0000 7efe9759e640 1 -- 172.21.15.102:0/1347934077 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7efe78066470 msgr2=0x7efe78068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T18:41:18.995 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:18.985+0000 7efe9759e640 1 --2- 172.21.15.102:0/1347934077 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7efe78066470 0x7efe78068930 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7efe80001760 tx=0x7efe80009040 comp rx=0 tx=0).stop 2023-11-13T18:41:18.995 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:18.985+0000 7efe9759e640 1 -- 172.21.15.102:0/1347934077 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7efe9815ada0 msgr2=0x7efe980ad7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T18:41:18.996 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:18.985+0000 7efe9759e640 1 --2- 172.21.15.102:0/1347934077 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7efe9815ada0 0x7efe980ad7a0 secure :-1 s=READY pgs=1929 cs=0 l=1 rev1=1 crypto rx=0x7efe9001c6c0 tx=0x7efe9001b830 comp rx=0 tx=0).stop 2023-11-13T18:41:18.996 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:18.985+0000 7efe9759e640 1 -- 172.21.15.102:0/1347934077 shutdown_connections 2023-11-13T18:41:18.997 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:18.985+0000 7efe9759e640 1 --2- 172.21.15.102:0/1347934077 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7efe78066470 0x7efe78068930 unknown :-1 s=CLOSED pgs=738 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T18:41:18.997 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:18.985+0000 7efe9759e640 1 --2- 172.21.15.102:0/1347934077 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7efe9815ada0 0x7efe980ad7a0 unknown :-1 s=CLOSED pgs=1929 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T18:41:18.997 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:18.985+0000 7efe9759e640 1 --2- 172.21.15.102:0/1347934077 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7efe9815a2b0 0x7efe9809c050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T18:41:18.997 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:18.985+0000 7efe9759e640 1 --2- 172.21.15.102:0/1347934077 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efe980b4e60 0x7efe980993d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T18:41:18.998 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:18.985+0000 7efe9759e640 1 -- 172.21.15.102:0/1347934077 >> 172.21.15.102:0/1347934077 conn(0x7efe980b4020 msgr2=0x7efe9806c5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-13T18:41:18.998 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:18.989+0000 7efe9759e640 1 -- 172.21.15.102:0/1347934077 shutdown_connections 2023-11-13T18:41:18.998 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:18.989+0000 7efe9759e640 1 -- 172.21.15.102:0/1347934077 wait complete. 2023-11-13T18:41:19.074 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-13T18:41:19.716 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:19.705+0000 7f181bfff640 1 Processor -- start 2023-11-13T18:41:19.716 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:19.709+0000 7f181bfff640 1 -- start start 2023-11-13T18:41:19.721 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:19.713+0000 7f181bfff640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f181c0b2fc0 0x7f181c0cc3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T18:41:19.721 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:19.713+0000 7f181bfff640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f181c0ce2a0 0x7f181c0b33a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T18:41:19.722 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:19.713+0000 7f181bfff640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f181c070550 con 0x7f181c0b1990 2023-11-13T18:41:19.722 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:19.713+0000 7f181bfff640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f181c0b38e0 con 0x7f181c0b2fc0 2023-11-13T18:41:19.723 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:19.713+0000 7f181bfff640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f181c0cd710 con 0x7f181c0ce2a0 2023-11-13T18:41:19.724 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:19.713+0000 7f181a7fc640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f181c0ce2a0 0x7f181c0b33a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T18:41:19.724 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:19.713+0000 7f181a7fc640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f181c0ce2a0 0x7f181c0b33a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.102:56564/0 (socket says 172.21.15.102:56564) 2023-11-13T18:41:19.724 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:19.713+0000 7f181a7fc640 1 -- 172.21.15.102:0/2967506092 learned_addr learned my addr 172.21.15.102:0/2967506092 (peer_addr_for_me v2:172.21.15.102:0/0) 2023-11-13T18:41:19.724 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:19.713+0000 7f181a7fc640 1 -- 172.21.15.102:0/2967506092 >> v2:172.21.15.102:3300/0 conn(0x7f181c0b2fc0 msgr2=0x7f181c0cc3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-13T18:41:19.725 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:19.713+0000 7f181a7fc640 1 --2- 172.21.15.102:0/2967506092 >> v2:172.21.15.102:3300/0 conn(0x7f181c0b2fc0 0x7f181c0cc3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T18:41:19.725 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:19.717+0000 7f181a7fc640 1 -- 172.21.15.102:0/2967506092 >> v1:172.21.15.102:6789/0 conn(0x7f181c0b1990 legacy=0x7f181c0b1e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-13T18:41:19.725 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:19.717+0000 7f181a7fc640 1 -- 172.21.15.102:0/2967506092 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f181c06fc20 con 0x7f181c0ce2a0 2023-11-13T18:41:19.738 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:19.729+0000 7f181a7fc640 1 --2- 172.21.15.102:0/2967506092 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f181c0ce2a0 0x7f181c0b33a0 secure :-1 s=READY pgs=894 cs=0 l=1 rev1=1 crypto rx=0x7f181c06efd0 tx=0x7f1804020930 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9232742994093200 server_cookie=0 in_seq=0 out_seq=0 2023-11-13T18:41:19.738 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:19.729+0000 7f1819ffb640 1 -- 172.21.15.102:0/2967506092 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18040a9a00 con 0x7f181c0ce2a0 2023-11-13T18:41:19.739 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:19.729+0000 7f1819ffb640 1 -- 172.21.15.102:0/2967506092 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f18040a9b60 con 0x7f181c0ce2a0 2023-11-13T18:41:19.739 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:19.729+0000 7f1819ffb640 1 -- 172.21.15.102:0/2967506092 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18040b1440 con 0x7f181c0ce2a0 2023-11-13T18:41:19.741 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:19.733+0000 7f181bfff640 1 -- 172.21.15.102:0/2967506092 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f181c0ce2a0 msgr2=0x7f181c0b33a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T18:41:19.741 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:19.733+0000 7f181bfff640 1 --2- 172.21.15.102:0/2967506092 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f181c0ce2a0 0x7f181c0b33a0 secure :-1 s=READY pgs=894 cs=0 l=1 rev1=1 crypto rx=0x7f181c06efd0 tx=0x7f1804020930 comp rx=0 tx=0).stop 2023-11-13T18:41:19.741 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:19.733+0000 7f181bfff640 1 -- 172.21.15.102:0/2967506092 shutdown_connections 2023-11-13T18:41:19.742 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:19.733+0000 7f181bfff640 1 --2- 172.21.15.102:0/2967506092 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f181c0ce2a0 0x7f181c0b33a0 unknown :-1 s=CLOSED pgs=894 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T18:41:19.742 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:19.733+0000 7f181bfff640 1 --2- 172.21.15.102:0/2967506092 >> v2:172.21.15.102:3300/0 conn(0x7f181c0b2fc0 0x7f181c0cc3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T18:41:19.742 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:19.733+0000 7f181bfff640 1 -- 172.21.15.102:0/2967506092 >> 172.21.15.102:0/2967506092 conn(0x7f181c0b0690 msgr2=0x7f181c0b0aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-13T18:41:19.743 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:19.733+0000 7f181bfff640 1 -- 172.21.15.102:0/2967506092 shutdown_connections 2023-11-13T18:41:19.743 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:19.733+0000 7f181bfff640 1 -- 172.21.15.102:0/2967506092 wait complete. 2023-11-13T18:41:19.748 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:19.741+0000 7f181bfff640 1 Processor -- start 2023-11-13T18:41:19.749 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:19.741+0000 7f181bfff640 1 -- start start 2023-11-13T18:41:19.754 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:19.745+0000 7f181bfff640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f181c0b1990 0x7f181c153810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T18:41:19.754 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:19.745+0000 7f181bfff640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f181c0b2fc0 0x7f181c14aac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T18:41:19.755 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:19.745+0000 7f181bfff640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f181c0ce2a0 0x7f181c152ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T18:41:19.755 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:19.745+0000 7f181bfff640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f181c14a800 con 0x7f181c0b1990 2023-11-13T18:41:19.755 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:19.745+0000 7f181bfff640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f181c1fa130 con 0x7f181c0b2fc0 2023-11-13T18:41:19.756 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:19.745+0000 7f181bfff640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f181c155d90 con 0x7f181c0ce2a0 2023-11-13T18:41:19.756 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:19.745+0000 7f181b7fe640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f181c0ce2a0 0x7f181c152ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T18:41:19.757 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:19.745+0000 7f181b7fe640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f181c0ce2a0 0x7f181c152ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.102:51346/0 (socket says 172.21.15.102:51346) 2023-11-13T18:41:19.758 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:19.745+0000 7f181b7fe640 1 -- 172.21.15.102:0/965777884 learned_addr learned my addr 172.21.15.102:0/965777884 (peer_addr_for_me v2:172.21.15.102:0/0) 2023-11-13T18:41:19.758 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:19.745+0000 7f181affd640 1 --2- 172.21.15.102:0/965777884 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f181c0b1990 0x7f181c153810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T18:41:19.758 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:19.745+0000 7f181a7fc640 1 --2- 172.21.15.102:0/965777884 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f181c0b2fc0 0x7f181c14aac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T18:41:19.759 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:19.749+0000 7f181b7fe640 1 -- 172.21.15.102:0/965777884 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f181c0b2fc0 msgr2=0x7f181c14aac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T18:41:19.759 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:19.749+0000 7f181b7fe640 1 --2- 172.21.15.102:0/965777884 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f181c0b2fc0 0x7f181c14aac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T18:41:19.759 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:19.749+0000 7f181b7fe640 1 -- 172.21.15.102:0/965777884 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f181c0b1990 msgr2=0x7f181c153810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T18:41:19.759 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:19.749+0000 7f181b7fe640 1 --2- 172.21.15.102:0/965777884 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f181c0b1990 0x7f181c153810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T18:41:19.760 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:19.749+0000 7f181b7fe640 1 -- 172.21.15.102:0/965777884 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18040094d0 con 0x7f181c0ce2a0 2023-11-13T18:41:19.760 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:19.749+0000 7f181a7fc640 1 --2- 172.21.15.102:0/965777884 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f181c0b2fc0 0x7f181c14aac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-13T18:41:19.760 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:19.749+0000 7f181b7fe640 1 --2- 172.21.15.102:0/965777884 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f181c0ce2a0 0x7f181c152ed0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f180c00b440 tx=0x7f180c00b900 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-13T18:41:19.761 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:19.749+0000 7f18137fe640 1 -- 172.21.15.102:0/965777884 <== mon.2 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f180c011830 con 0x7f181c0ce2a0 2023-11-13T18:41:19.761 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:19.749+0000 7f18137fe640 1 -- 172.21.15.102:0/965777884 <== mon.2 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f180c0119b0 con 0x7f181c0ce2a0 2023-11-13T18:41:19.762 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:19.749+0000 7f18137fe640 1 -- 172.21.15.102:0/965777884 <== mon.2 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f180c011d60 con 0x7f181c0ce2a0 2023-11-13T18:41:19.762 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:19.749+0000 7f181bfff640 1 -- 172.21.15.102:0/965777884 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f181c153410 con 0x7f181c0ce2a0 2023-11-13T18:41:19.762 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:19.753+0000 7f181bfff640 1 -- 172.21.15.102:0/965777884 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f181c14b4a0 con 0x7f181c0ce2a0 2023-11-13T18:41:19.763 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:19.753+0000 7f18137fe640 1 -- 172.21.15.102:0/965777884 <== mon.2 v2:172.21.15.154:3301/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f180c0193b0 con 0x7f181c0ce2a0 2023-11-13T18:41:19.763 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:19.753+0000 7f181bfff640 1 -- 172.21.15.102:0/965777884 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f181c155f60 con 0x7f181c0ce2a0 2023-11-13T18:41:19.769 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:19.757+0000 7f18137fe640 1 --2- 172.21.15.102:0/965777884 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f17fc066540 0x7f17fc068a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T18:41:19.770 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:19.757+0000 7f18137fe640 1 -- 172.21.15.102:0/965777884 <== mon.2 v2:172.21.15.154:3301/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f180c083b60 con 0x7f181c0ce2a0 2023-11-13T18:41:19.773 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:19.765+0000 7f18137fe640 1 -- 172.21.15.102:0/965777884 <== mon.2 v2:172.21.15.154:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f180c050fd0 con 0x7f181c0ce2a0 2023-11-13T18:41:19.775 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:19.769+0000 7f181affd640 1 --2- 172.21.15.102:0/965777884 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f17fc066540 0x7f17fc068a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T18:41:19.779 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:19.769+0000 7f181affd640 1 --2- 172.21.15.102:0/965777884 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f17fc066540 0x7f17fc068a00 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x7f181c15bd90 tx=0x7f1814007310 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-13T18:41:20.593 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:20.585+0000 7f181bfff640 1 -- 172.21.15.102:0/965777884 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f181c068520 con 0x7f181c0ce2a0 2023-11-13T18:41:20.594 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:20.585+0000 7f18137fe640 1 -- 172.21.15.102:0/965777884 <== mon.2 v2:172.21.15.154:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v38) v1 ==== 74+0+16793 (secure 0 0 0) 0x7f180c015090 con 0x7f181c0ce2a0 2023-11-13T18:41:20.599 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T18:41:20.599 INFO:teuthology.orchestra.run.smithi102.stdout:{"epoch":38,"fsid":"97b3eb2b-7ccf-4aae-8d92-bff986c671ea","created":"2023-11-13T11:28:31.836724+0000","modified":"2023-11-13T11:30:39.704184+0000","last_up_change":"2023-11-13T11:28:44.876638+0000","last_in_change":"2023-11-13T11:28:35.312740+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-13T11:28:44.981356+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2023-11-13T11:29:54.890079+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"35","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2023-11-13T11:29:55.482816+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"36","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"bdefaa17-fcca-4c86-aa40-27dc33a789af","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6800","nonce":53303834},{"type":"v1","addr":"172.21.15.102:6801","nonce":53303834}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6802","nonce":53303834},{"type":"v1","addr":"172.21.15.102:6803","nonce":53303834}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6806","nonce":53303834},{"type":"v1","addr":"172.21.15.102:6807","nonce":53303834}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6804","nonce":53303834},{"type":"v1","addr":"172.21.15.102:6805","nonce":53303834}]},"public_addr":"172.21.15.102:6801/53303834","cluster_addr":"172.21.15.102:6803/53303834","heartbeat_back_addr":"172.21.15.102:6807/53303834","heartbeat_front_addr":"172.21.15.102:6805/53303834","state":["exists","up"]},{"osd":1,"uuid":"f0033196-dec9-4ae9-945e-6aeef6dbb47f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6808","nonce":1732708348},{"type":"v1","addr":"172.21.15.102:6809","nonce":1732708348}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6811","nonce":1732708348},{"type":"v1","addr":"172.21.15.102:6813","nonce":1732708348}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6818","nonce":1732708348},{"type":"v1","addr":"172.21.15.102:6820","nonce":1732708348}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6815","nonce":1732708348},{"type":"v1","addr":"172.21.15.102:6817","nonce":1732708348}]},"public_addr":"172.21.15.102:6809/1732708348","cluster_addr":"172.21.15.102:6813/1732708348","heartbeat_back_addr":"172.21.15.102:6820/1732708348","heartbeat_front_addr":"172.21.15.102:6817/1732708348","state":["exists","up"]},{"osd":2,"uuid":"496b0834-351e-4ec2-a714-86ed0c0ff4fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6810","nonce":1825475150},{"type":"v1","addr":"172.21.15.102:6812","nonce":1825475150}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6814","nonce":1825475150},{"type":"v1","addr":"172.21.15.102:6816","nonce":1825475150}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6822","nonce":1825475150},{"type":"v1","addr":"172.21.15.102:6823","nonce":1825475150}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6819","nonce":1825475150},{"type":"v1","addr":"172.21.15.102:6821","nonce":1825475150}]},"public_addr":"172.21.15.102:6812/1825475150","cluster_addr":"172.21.15.102:6816/1825475150","heartbeat_back_addr":"172.21.15.102:6823/1825475150","heartbeat_front_addr":"172.21.15.102:6821/1825475150","state":["exists","up"]},{"osd":3,"uuid":"3ba6cc41-e0a0-4273-86cb-90000c06a55a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6824","nonce":4149355528},{"type":"v1","addr":"172.21.15.102:6825","nonce":4149355528}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6826","nonce":4149355528},{"type":"v1","addr":"172.21.15.102:6827","nonce":4149355528}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6830","nonce":4149355528},{"type":"v1","addr":"172.21.15.102:6831","nonce":4149355528}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6828","nonce":4149355528},{"type":"v1","addr":"172.21.15.102:6829","nonce":4149355528}]},"public_addr":"172.21.15.102:6825/4149355528","cluster_addr":"172.21.15.102:6827/4149355528","heartbeat_back_addr":"172.21.15.102:6831/4149355528","heartbeat_front_addr":"172.21.15.102:6829/4149355528","state":["exists","up"]},{"osd":4,"uuid":"16e797d8-e6e7-4140-95c3-b85283c42a2a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6808","nonce":4028899241},{"type":"v1","addr":"172.21.15.154:6809","nonce":4028899241}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6810","nonce":4028899241},{"type":"v1","addr":"172.21.15.154:6811","nonce":4028899241}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6814","nonce":4028899241},{"type":"v1","addr":"172.21.15.154:6815","nonce":4028899241}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6812","nonce":4028899241},{"type":"v1","addr":"172.21.15.154:6813","nonce":4028899241}]},"public_addr":"172.21.15.154:6809/4028899241","cluster_addr":"172.21.15.154:6811/4028899241","heartbeat_back_addr":"172.21.15.154:6815/4028899241","heartbeat_front_addr":"172.21.15.154:6813/4028899241","state":["exists","up"]},{"osd":5,"uuid":"d6ab225c-1b55-450a-89a9-abe5c3f8d6af","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":3562396827},{"type":"v1","addr":"172.21.15.154:6801","nonce":3562396827}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":3562396827},{"type":"v1","addr":"172.21.15.154:6803","nonce":3562396827}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6806","nonce":3562396827},{"type":"v1","addr":"172.21.15.154:6807","nonce":3562396827}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6804","nonce":3562396827},{"type":"v1","addr":"172.21.15.154:6805","nonce":3562396827}]},"public_addr":"172.21.15.154:6801/3562396827","cluster_addr":"172.21.15.154:6803/3562396827","heartbeat_back_addr":"172.21.15.154:6807/3562396827","heartbeat_front_addr":"172.21.15.154:6805/3562396827","state":["exists","up"]},{"osd":6,"uuid":"96f905ac-491c-4662-8e2b-5bb8e929ab9d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6816","nonce":2933728751},{"type":"v1","addr":"172.21.15.154:6817","nonce":2933728751}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6818","nonce":2933728751},{"type":"v1","addr":"172.21.15.154:6819","nonce":2933728751}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6822","nonce":2933728751},{"type":"v1","addr":"172.21.15.154:6823","nonce":2933728751}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6820","nonce":2933728751},{"type":"v1","addr":"172.21.15.154:6821","nonce":2933728751}]},"public_addr":"172.21.15.154:6817/2933728751","cluster_addr":"172.21.15.154:6819/2933728751","heartbeat_back_addr":"172.21.15.154:6823/2933728751","heartbeat_front_addr":"172.21.15.154:6821/2933728751","state":["exists","up"]},{"osd":7,"uuid":"07012d3b-3ab4-40df-a471-93caed22e2dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6824","nonce":1753500785},{"type":"v1","addr":"172.21.15.154:6825","nonce":1753500785}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6826","nonce":1753500785},{"type":"v1","addr":"172.21.15.154:6827","nonce":1753500785}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6830","nonce":1753500785},{"type":"v1","addr":"172.21.15.154:6831","nonce":1753500785}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6828","nonce":1753500785},{"type":"v1","addr":"172.21.15.154:6829","nonce":1753500785}]},"public_addr":"172.21.15.154:6825/1753500785","cluster_addr":"172.21.15.154:6827/1753500785","heartbeat_back_addr":"172.21.15.154:6831/1753500785","heartbeat_front_addr":"172.21.15.154:6829/1753500785","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-13T11:28:40.978603+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-13T11:28:41.200985+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-13T11:28:41.222815+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-13T11:28:41.202162+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-13T11:28:40.925911+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-13T11:28:41.087725+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-13T11:28:41.072208+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-13T11:28:40.875257+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"5.0","mappings":[{"from":4,"to":5}]},{"pgid":"5.e","mappings":[{"from":4,"to":5}]},{"pgid":"5.15","mappings":[{"from":4,"to":5}]},{"pgid":"5.32","mappings":[{"from":4,"to":3}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-13T18:41:20.606 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:20.597+0000 7f181bfff640 1 -- 172.21.15.102:0/965777884 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f17fc066540 msgr2=0x7f17fc068a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T18:41:20.606 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:20.597+0000 7f181bfff640 1 --2- 172.21.15.102:0/965777884 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f17fc066540 0x7f17fc068a00 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x7f181c15bd90 tx=0x7f1814007310 comp rx=0 tx=0).stop 2023-11-13T18:41:20.607 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:20.597+0000 7f181bfff640 1 -- 172.21.15.102:0/965777884 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f181c0ce2a0 msgr2=0x7f181c152ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T18:41:20.607 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:20.597+0000 7f181bfff640 1 --2- 172.21.15.102:0/965777884 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f181c0ce2a0 0x7f181c152ed0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f180c00b440 tx=0x7f180c00b900 comp rx=0 tx=0).stop 2023-11-13T18:41:20.607 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:20.597+0000 7f181bfff640 1 -- 172.21.15.102:0/965777884 shutdown_connections 2023-11-13T18:41:20.607 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:20.597+0000 7f181bfff640 1 --2- 172.21.15.102:0/965777884 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f181c0ce2a0 0x7f181c152ed0 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T18:41:20.608 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:20.597+0000 7f181bfff640 1 --2- 172.21.15.102:0/965777884 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f181c0b2fc0 0x7f181c14aac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T18:41:20.608 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:20.597+0000 7f181bfff640 1 --2- 172.21.15.102:0/965777884 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f17fc066540 0x7f17fc068a00 unknown :-1 s=CLOSED pgs=739 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T18:41:20.608 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:20.597+0000 7f181bfff640 1 --2- 172.21.15.102:0/965777884 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f181c0b1990 0x7f181c153810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T18:41:20.609 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:20.597+0000 7f181bfff640 1 -- 172.21.15.102:0/965777884 >> 172.21.15.102:0/965777884 conn(0x7f181c0b0690 msgr2=0x7f181c157f50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-13T18:41:20.609 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:20.597+0000 7f181bfff640 1 -- 172.21.15.102:0/965777884 shutdown_connections 2023-11-13T18:41:20.609 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:20.597+0000 7f181bfff640 1 -- 172.21.15.102:0/965777884 wait complete. 2023-11-13T18:41:20.646 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-11-13T18:41:20.647 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-13T18:41:20.923 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:20.913+0000 7f4f1ef80640 1 Processor -- start 2023-11-13T18:41:20.924 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:20.917+0000 7f4f1ef80640 1 -- start start 2023-11-13T18:41:20.928 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:20.921+0000 7f4f1ef80640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4f1815d1a0 0x7f4f1806dfe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T18:41:20.930 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:20.921+0000 7f4f17fff640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f4f180cd9d0 0x7f4f180b1c50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.102:37712/0 (socket says 172.21.15.102:37712) 2023-11-13T18:41:20.930 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:20.921+0000 7f4f17fff640 1 -- 172.21.15.102:0/3657106998 learned_addr learned my addr 172.21.15.102:0/3657106998 (peer_addr_for_me v1:172.21.15.102:0/0) 2023-11-13T18:41:20.930 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:20.921+0000 7f4f1cd1c640 1 --2- 172.21.15.102:0/3657106998 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4f1815d1a0 0x7f4f1806dfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T18:41:20.931 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:20.921+0000 7f4f1ef80640 1 -- 172.21.15.102:0/3657106998 --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4f180ad2b0 con 0x7f4f180718a0 2023-11-13T18:41:20.931 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:20.921+0000 7f4f1ef80640 1 -- 172.21.15.102:0/3657106998 --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4f180ade30 con 0x7f4f180cd9d0 2023-11-13T18:41:20.931 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:20.921+0000 7f4f1ef80640 1 -- 172.21.15.102:0/3657106998 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f18071d30 con 0x7f4f1815d1a0 2023-11-13T18:41:20.932 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:20.921+0000 7f4f1cd1c640 1 -- 172.21.15.102:0/3657106998 >> v1:172.21.15.154:6789/0 conn(0x7f4f180cd9d0 legacy=0x7f4f180b1c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-13T18:41:20.932 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:20.921+0000 7f4f1cd1c640 1 -- 172.21.15.102:0/3657106998 >> v1:172.21.15.102:6789/0 conn(0x7f4f180718a0 legacy=0x7f4f180b2360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-13T18:41:20.933 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:20.921+0000 7f4f1cd1c640 1 -- 172.21.15.102:0/3657106998 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f180ad500 con 0x7f4f1815d1a0 2023-11-13T18:41:20.948 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:20.937+0000 7f4f1cd1c640 1 --2- 172.21.15.102:0/3657106998 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4f1815d1a0 0x7f4f1806dfe0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f4f0c0097f0 tx=0x7f4f0c01c410 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2591ce5178ba01e5 server_cookie=0 in_seq=0 out_seq=0 2023-11-13T18:41:20.951 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:20.941+0000 7f4f177fe640 1 -- 172.21.15.102:0/3657106998 <== mon.2 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f0c0ac630 con 0x7f4f1815d1a0 2023-11-13T18:41:20.951 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:20.941+0000 7f4f177fe640 1 -- 172.21.15.102:0/3657106998 <== mon.2 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f0c0ac790 con 0x7f4f1815d1a0 2023-11-13T18:41:20.951 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:20.941+0000 7f4f177fe640 1 -- 172.21.15.102:0/3657106998 <== mon.2 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f0c0acb20 con 0x7f4f1815d1a0 2023-11-13T18:41:20.952 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:20.945+0000 7f4f1ef80640 1 -- 172.21.15.102:0/3657106998 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4f1815d1a0 msgr2=0x7f4f1806dfe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T18:41:20.952 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:20.945+0000 7f4f1ef80640 1 --2- 172.21.15.102:0/3657106998 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4f1815d1a0 0x7f4f1806dfe0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f4f0c0097f0 tx=0x7f4f0c01c410 comp rx=0 tx=0).stop 2023-11-13T18:41:20.953 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:20.945+0000 7f4f1ef80640 1 -- 172.21.15.102:0/3657106998 shutdown_connections 2023-11-13T18:41:20.954 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:20.945+0000 7f4f1ef80640 1 --2- 172.21.15.102:0/3657106998 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4f1815d1a0 0x7f4f1806dfe0 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T18:41:20.954 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:20.945+0000 7f4f1ef80640 1 -- 172.21.15.102:0/3657106998 >> 172.21.15.102:0/3657106998 conn(0x7f4f180cb5c0 msgr2=0x7f4f180cb9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-13T18:41:20.954 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:20.945+0000 7f4f1ef80640 1 -- 172.21.15.102:0/3657106998 shutdown_connections 2023-11-13T18:41:20.955 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:20.945+0000 7f4f1ef80640 1 -- 172.21.15.102:0/3657106998 wait complete. 2023-11-13T18:41:20.955 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:20.945+0000 7f4f1ef80640 1 Processor -- start 2023-11-13T18:41:20.956 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:20.945+0000 7f4f1ef80640 1 -- start start 2023-11-13T18:41:20.959 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:20.949+0000 7f4f1ef80640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4f180718a0 0x7f4f18156a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T18:41:20.959 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:20.949+0000 7f4f1ef80640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4f180cd9d0 0x7f4f1814e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T18:41:20.959 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:20.949+0000 7f4f1cd1c640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4f180718a0 0x7f4f18156a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T18:41:20.960 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:20.949+0000 7f4f1ef80640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4f1815d1a0 0x7f4f1815d610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T18:41:20.960 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:20.949+0000 7f4f1ef80640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f1815fde0 con 0x7f4f1815d1a0 2023-11-13T18:41:20.960 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:20.949+0000 7f4f1ef80640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f18151dc0 con 0x7f4f180718a0 2023-11-13T18:41:20.960 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:20.949+0000 7f4f1ef80640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f1815ffc0 con 0x7f4f180cd9d0 2023-11-13T18:41:20.961 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:20.949+0000 7f4f1cd1c640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4f180718a0 0x7f4f18156a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.102:56586/0 (socket says 172.21.15.102:56586) 2023-11-13T18:41:20.961 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:20.949+0000 7f4f1cd1c640 1 -- 172.21.15.102:0/411073264 learned_addr learned my addr 172.21.15.102:0/411073264 (peer_addr_for_me v2:172.21.15.102:0/0) 2023-11-13T18:41:20.961 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:20.949+0000 7f4f17fff640 1 --2- 172.21.15.102:0/411073264 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4f180cd9d0 0x7f4f1814e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T18:41:20.961 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:20.949+0000 7f4f1cd1c640 1 -- 172.21.15.102:0/411073264 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4f180cd9d0 msgr2=0x7f4f1814e340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T18:41:20.962 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:20.949+0000 7f4f1cd1c640 1 --2- 172.21.15.102:0/411073264 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4f180cd9d0 0x7f4f1814e340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T18:41:20.962 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:20.949+0000 7f4f1cd1c640 1 -- 172.21.15.102:0/411073264 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4f1815d1a0 msgr2=0x7f4f1815d610 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-11-13T18:41:20.962 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:20.949+0000 7f4f1cd1c640 1 --2- 172.21.15.102:0/411073264 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4f1815d1a0 0x7f4f1815d610 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T18:41:20.963 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:20.949+0000 7f4f1cd1c640 1 -- 172.21.15.102:0/411073264 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f0c009420 con 0x7f4f180718a0 2023-11-13T18:41:20.963 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:20.949+0000 7f4f17fff640 1 --2- 172.21.15.102:0/411073264 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4f180cd9d0 0x7f4f1814e340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-13T18:41:20.964 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:20.953+0000 7f4f1cd1c640 1 --2- 172.21.15.102:0/411073264 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4f180718a0 0x7f4f18156a70 secure :-1 s=READY pgs=896 cs=0 l=1 rev1=1 crypto rx=0x7f4f0c0097f0 tx=0x7f4f0c0191b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-13T18:41:20.964 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:20.953+0000 7f4f157fa640 1 -- 172.21.15.102:0/411073264 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f0c0b5600 con 0x7f4f180718a0 2023-11-13T18:41:20.964 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:20.953+0000 7f4f157fa640 1 -- 172.21.15.102:0/411073264 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f0c0b57a0 con 0x7f4f180718a0 2023-11-13T18:41:20.965 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:20.953+0000 7f4f157fa640 1 -- 172.21.15.102:0/411073264 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f0c0b5b50 con 0x7f4f180718a0 2023-11-13T18:41:20.965 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:20.953+0000 7f4f1ef80640 1 -- 172.21.15.102:0/411073264 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4f181602a0 con 0x7f4f180718a0 2023-11-13T18:41:20.965 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:20.957+0000 7f4f1ef80640 1 -- 172.21.15.102:0/411073264 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4f181537e0 con 0x7f4f180718a0 2023-11-13T18:41:20.967 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:20.957+0000 7f4f1ef80640 1 -- 172.21.15.102:0/411073264 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4f18153a00 con 0x7f4f180718a0 2023-11-13T18:41:20.969 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:20.961+0000 7f4f157fa640 1 -- 172.21.15.102:0/411073264 <== mon.1 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f4f0c0b3040 con 0x7f4f180718a0 2023-11-13T18:41:20.972 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:20.965+0000 7f4f157fa640 1 --2- 172.21.15.102:0/411073264 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f4efc0664c0 0x7f4efc068980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T18:41:20.973 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:20.965+0000 7f4f157fa640 1 -- 172.21.15.102:0/411073264 <== mon.1 v2:172.21.15.154:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f4f0c11e840 con 0x7f4f180718a0 2023-11-13T18:41:20.973 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:20.965+0000 7f4f17fff640 1 --2- 172.21.15.102:0/411073264 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f4efc0664c0 0x7f4efc068980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T18:41:20.974 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:20.965+0000 7f4f17fff640 1 --2- 172.21.15.102:0/411073264 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f4efc0664c0 0x7f4efc068980 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x7f4f04007ca0 tx=0x7f4f04007bf0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-13T18:41:20.974 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:20.965+0000 7f4f157fa640 1 -- 172.21.15.102:0/411073264 <== mon.1 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f4f0c0ebd60 con 0x7f4f180718a0 2023-11-13T18:41:21.284 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:21.277+0000 7f4f1ef80640 1 -- 172.21.15.102:0/411073264 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f4f18068520 con 0x7f4f180718a0 2023-11-13T18:41:21.288 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T18:41:21.289 INFO:teuthology.orchestra.run.smithi102.stdout:{"epoch":16,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4826,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6834/3121803929","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6832","nonce":3121803929},{"type":"v1","addr":"172.21.15.154:6834","nonce":3121803929}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":4829,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6835/2990283260","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6833","nonce":2990283260},{"type":"v1","addr":"172.21.15.154:6835","nonce":2990283260}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":5271,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.102:6836/868460192","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6834","nonce":868460192},{"type":"v1","addr":"172.21.15.102:6836","nonce":868460192}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-13T11:29:56.498042+0000","modified":"2023-11-13T11:29:59.519487+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5274},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5274":{"gid":5274,"name":"a","rank":0,"incarnation":12,"state":"up:active","state_seq":3,"addr":"172.21.15.102:6837/3869977039","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6835","nonce":3869977039},{"type":"v1","addr":"172.21.15.102:6837","nonce":3869977039}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-11-13T18:41:21.289 INFO:teuthology.orchestra.run.smithi102.stderr:dumped fsmap epoch 16 2023-11-13T18:41:21.290 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:21.277+0000 7f4f157fa640 1 -- 172.21.15.102:0/411073264 <== mon.1 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) v1 ==== 94+0+4922 (secure 0 0 0) 0x7f4f0c0ef380 con 0x7f4f180718a0 2023-11-13T18:41:21.292 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:21.281+0000 7f4f1ef80640 1 -- 172.21.15.102:0/411073264 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f4efc0664c0 msgr2=0x7f4efc068980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T18:41:21.292 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:21.281+0000 7f4f1ef80640 1 --2- 172.21.15.102:0/411073264 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f4efc0664c0 0x7f4efc068980 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x7f4f04007ca0 tx=0x7f4f04007bf0 comp rx=0 tx=0).stop 2023-11-13T18:41:21.292 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:21.281+0000 7f4f1ef80640 1 -- 172.21.15.102:0/411073264 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4f180718a0 msgr2=0x7f4f18156a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T18:41:21.292 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:21.281+0000 7f4f1ef80640 1 --2- 172.21.15.102:0/411073264 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4f180718a0 0x7f4f18156a70 secure :-1 s=READY pgs=896 cs=0 l=1 rev1=1 crypto rx=0x7f4f0c0097f0 tx=0x7f4f0c0191b0 comp rx=0 tx=0).stop 2023-11-13T18:41:21.293 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:21.281+0000 7f4f1ef80640 1 -- 172.21.15.102:0/411073264 shutdown_connections 2023-11-13T18:41:21.293 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:21.281+0000 7f4f1ef80640 1 --2- 172.21.15.102:0/411073264 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f4efc0664c0 0x7f4efc068980 unknown :-1 s=CLOSED pgs=740 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T18:41:21.293 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:21.281+0000 7f4f1ef80640 1 --2- 172.21.15.102:0/411073264 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4f1815d1a0 0x7f4f1815d610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T18:41:21.294 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:21.281+0000 7f4f1ef80640 1 --2- 172.21.15.102:0/411073264 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4f180cd9d0 0x7f4f1814e340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T18:41:21.294 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:21.281+0000 7f4f1ef80640 1 --2- 172.21.15.102:0/411073264 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4f180718a0 0x7f4f18156a70 unknown :-1 s=CLOSED pgs=896 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T18:41:21.294 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:21.281+0000 7f4f1ef80640 1 -- 172.21.15.102:0/411073264 >> 172.21.15.102:0/411073264 conn(0x7f4f180cb5c0 msgr2=0x7f4f180aefe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-13T18:41:21.295 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:21.285+0000 7f4f1ef80640 1 -- 172.21.15.102:0/411073264 shutdown_connections 2023-11-13T18:41:21.295 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:21.285+0000 7f4f1ef80640 1 -- 172.21.15.102:0/411073264 wait complete. 2023-11-13T18:41:21.328 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-13T18:41:21.595 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:21.585+0000 7fe0df846640 1 Processor -- start 2023-11-13T18:41:21.596 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:21.589+0000 7fe0df846640 1 -- start start 2023-11-13T18:41:21.601 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:21.593+0000 7fe0df846640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe0d815d1a0 0x7fe0d806dfe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T18:41:21.602 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:21.593+0000 7fe0df846640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe0d80ad2b0 con 0x7fe0d80718a0 2023-11-13T18:41:21.602 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:21.593+0000 7fe0ddde3640 1 --1- >> v1:172.21.15.102:6789/0 conn(0x7fe0d80718a0 0x7fe0d80b2360 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.102:6789/0 says I am v1:172.21.15.102:59396/0 (socket says 172.21.15.102:59396) 2023-11-13T18:41:21.603 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:21.593+0000 7fe0ddde3640 1 -- 172.21.15.102:0/1893571762 learned_addr learned my addr 172.21.15.102:0/1893571762 (peer_addr_for_me v1:172.21.15.102:0/0) 2023-11-13T18:41:21.605 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:21.593+0000 7fe0dd5e2640 1 --2- 172.21.15.102:0/1893571762 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe0d815d1a0 0x7fe0d806dfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T18:41:21.605 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:21.593+0000 7fe0df846640 1 -- 172.21.15.102:0/1893571762 --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe0d80ade30 con 0x7fe0d80cd9d0 2023-11-13T18:41:21.605 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:21.593+0000 7fe0df846640 1 -- 172.21.15.102:0/1893571762 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe0d8071d30 con 0x7fe0d815d1a0 2023-11-13T18:41:21.606 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:21.593+0000 7fe0cffff640 1 -- 172.21.15.102:0/1893571762 <== mon.0 v1:172.21.15.102:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3701103346 0 0) 0x7fe0d80ad2b0 con 0x7fe0d80718a0 2023-11-13T18:41:21.606 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:21.593+0000 7fe0cffff640 1 -- 172.21.15.102:0/1893571762 --> v1:172.21.15.102:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe0c4003530 con 0x7fe0d80718a0 2023-11-13T18:41:21.606 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:21.597+0000 7fe0cffff640 1 -- 172.21.15.102:0/1893571762 <== mon.0 v1:172.21.15.102:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2676047127 0 0) 0x7fe0c4003530 con 0x7fe0d80718a0 2023-11-13T18:41:21.607 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:21.597+0000 7fe0cffff640 1 -- 172.21.15.102:0/1893571762 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe0d815d1a0 msgr2=0x7fe0d806dfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-13T18:41:21.607 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:21.597+0000 7fe0cffff640 1 --2- 172.21.15.102:0/1893571762 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe0d815d1a0 0x7fe0d806dfe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T18:41:21.607 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:21.597+0000 7fe0cffff640 1 -- 172.21.15.102:0/1893571762 >> v1:172.21.15.154:6789/0 conn(0x7fe0d80cd9d0 legacy=0x7fe0d80b1c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T18:41:21.607 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:21.597+0000 7fe0cffff640 1 -- 172.21.15.102:0/1893571762 --> v1:172.21.15.102:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0d80ad500 con 0x7fe0d80718a0 2023-11-13T18:41:21.608 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:21.597+0000 7fe0cffff640 1 -- 172.21.15.102:0/1893571762 <== mon.0 v1:172.21.15.102:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 895381068 0 0) 0x7fe0d0001a00 con 0x7fe0d80718a0 2023-11-13T18:41:21.608 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:21.597+0000 7fe0cffff640 1 -- 172.21.15.102:0/1893571762 >> v1:172.21.15.102:6789/0 conn(0x7fe0d80718a0 legacy=0x7fe0d80b2360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T18:41:21.608 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:21.597+0000 7fe0cffff640 1 --2- 172.21.15.102:0/1893571762 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe0c40039b0 0x7fe0c4003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T18:41:21.609 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:21.597+0000 7fe0cffff640 1 --2- 172.21.15.102:0/1893571762 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe0c40047d0 0x7fe0c4004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T18:41:21.609 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:21.597+0000 7fe0cffff640 1 --2- 172.21.15.102:0/1893571762 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe0c4005190 0x7fe0c400b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T18:41:21.610 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:21.597+0000 7fe0cffff640 1 -- 172.21.15.102:0/1893571762 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0c400c060 con 0x7fe0c40039b0 2023-11-13T18:41:21.610 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:21.597+0000 7fe0cffff640 1 -- 172.21.15.102:0/1893571762 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0c400c1d0 con 0x7fe0c4005190 2023-11-13T18:41:21.610 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:21.597+0000 7fe0cffff640 1 -- 172.21.15.102:0/1893571762 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe0c400c390 con 0x7fe0c40047d0 2023-11-13T18:41:21.611 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:21.597+0000 7fe0dd5e2640 1 --2- 172.21.15.102:0/1893571762 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe0d815d1a0 0x7fe0d806dfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-13T18:41:21.611 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:21.597+0000 7fe0dd5e2640 1 --2- 172.21.15.102:0/1893571762 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe0c40039b0 0x7fe0c4003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T18:41:21.611 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:21.597+0000 7fe0ddde3640 1 --2- 172.21.15.102:0/1893571762 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe0c4005190 0x7fe0c400b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T18:41:21.612 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:21.601+0000 7fe0ddde3640 1 -- 172.21.15.102:0/1893571762 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe0c40047d0 msgr2=0x7fe0c4004c50 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-13T18:41:21.612 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:21.601+0000 7fe0ddde3640 1 --2- 172.21.15.102:0/1893571762 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe0c40047d0 0x7fe0c4004c50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T18:41:21.612 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:21.601+0000 7fe0ddde3640 1 -- 172.21.15.102:0/1893571762 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe0c40039b0 msgr2=0x7fe0c4003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-13T18:41:21.612 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:21.601+0000 7fe0ddde3640 1 --2- 172.21.15.102:0/1893571762 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe0c40039b0 0x7fe0c4003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T18:41:21.613 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:21.601+0000 7fe0ddde3640 1 -- 172.21.15.102:0/1893571762 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0d80ad500 con 0x7fe0c4005190 2023-11-13T18:41:21.613 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:21.601+0000 7fe0dd5e2640 1 --2- 172.21.15.102:0/1893571762 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe0c40039b0 0x7fe0c4003d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-13T18:41:21.621 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:21.613+0000 7fe0ddde3640 1 --2- 172.21.15.102:0/1893571762 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe0c4005190 0x7fe0c400b990 secure :-1 s=READY pgs=898 cs=0 l=1 rev1=1 crypto rx=0x7fe0d0010cb0 tx=0x7fe0d002e010 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f6ae95daa529efe server_cookie=0 in_seq=0 out_seq=0 2023-11-13T18:41:21.621 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:21.613+0000 7fe0cffff640 1 -- 172.21.15.102:0/1893571762 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0d00b6e90 con 0x7fe0c4005190 2023-11-13T18:41:21.621 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:21.613+0000 7fe0cffff640 1 -- 172.21.15.102:0/1893571762 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe0d00be440 con 0x7fe0c4005190 2023-11-13T18:41:21.621 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:21.613+0000 7fe0cffff640 1 -- 172.21.15.102:0/1893571762 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0d00be7d0 con 0x7fe0c4005190 2023-11-13T18:41:21.623 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:21.613+0000 7fe0df846640 1 -- 172.21.15.102:0/1893571762 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe0c4005190 msgr2=0x7fe0c400b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T18:41:21.623 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:21.613+0000 7fe0df846640 1 --2- 172.21.15.102:0/1893571762 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe0c4005190 0x7fe0c400b990 secure :-1 s=READY pgs=898 cs=0 l=1 rev1=1 crypto rx=0x7fe0d0010cb0 tx=0x7fe0d002e010 comp rx=0 tx=0).stop 2023-11-13T18:41:21.623 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:21.613+0000 7fe0ddde3640 1 -- 172.21.15.102:0/1893571762 reap_dead start 2023-11-13T18:41:21.623 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:21.613+0000 7fe0df846640 1 -- 172.21.15.102:0/1893571762 shutdown_connections 2023-11-13T18:41:21.624 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:21.613+0000 7fe0df846640 1 -- 172.21.15.102:0/1893571762 >> 172.21.15.102:0/1893571762 conn(0x7fe0d80cb5c0 msgr2=0x7fe0d80cb9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-13T18:41:21.625 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:21.617+0000 7fe0df846640 1 -- 172.21.15.102:0/1893571762 shutdown_connections 2023-11-13T18:41:21.627 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:21.621+0000 7fe0df846640 1 -- 172.21.15.102:0/1893571762 wait complete. 2023-11-13T18:41:21.637 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:21.621+0000 7fe0df846640 1 Processor -- start 2023-11-13T18:41:21.638 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:21.621+0000 7fe0df846640 1 -- start start 2023-11-13T18:41:21.638 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:21.625+0000 7fe0df846640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe0c4005190 0x7fe0d8152db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T18:41:21.638 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:21.625+0000 7fe0df846640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe0d8151fd0 0x7fe0d8155be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T18:41:21.638 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:21.625+0000 7fe0df846640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe0d8159b10 0x7fe0d81512f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T18:41:21.639 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:21.625+0000 7fe0df846640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0d81532f0 con 0x7fe0d8159b10 2023-11-13T18:41:21.639 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:21.625+0000 7fe0df846640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0d8155750 con 0x7fe0d8151fd0 2023-11-13T18:41:21.639 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:21.625+0000 7fe0df846640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe0d8156120 con 0x7fe0c4005190 2023-11-13T18:41:21.640 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:21.625+0000 7fe0dcde1640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe0d8151fd0 0x7fe0d8155be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T18:41:21.640 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:21.625+0000 7fe0dcde1640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe0d8151fd0 0x7fe0d8155be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.102:56602/0 (socket says 172.21.15.102:56602) 2023-11-13T18:41:21.640 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:21.625+0000 7fe0dcde1640 1 -- 172.21.15.102:0/125865764 learned_addr learned my addr 172.21.15.102:0/125865764 (peer_addr_for_me v2:172.21.15.102:0/0) 2023-11-13T18:41:21.640 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:21.625+0000 7fe0dd5e2640 1 --2- 172.21.15.102:0/125865764 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe0c4005190 0x7fe0d8152db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T18:41:21.641 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:21.625+0000 7fe0dcde1640 1 -- 172.21.15.102:0/125865764 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe0c4005190 msgr2=0x7fe0d8152db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T18:41:21.641 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:21.625+0000 7fe0dcde1640 1 --2- 172.21.15.102:0/125865764 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe0c4005190 0x7fe0d8152db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T18:41:21.641 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:21.625+0000 7fe0dcde1640 1 -- 172.21.15.102:0/125865764 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe0d8159b10 msgr2=0x7fe0d81512f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T18:41:21.641 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:21.625+0000 7fe0dcde1640 1 --2- 172.21.15.102:0/125865764 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe0d8159b10 0x7fe0d81512f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T18:41:21.642 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:21.625+0000 7fe0dcde1640 1 -- 172.21.15.102:0/125865764 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0d8154b40 con 0x7fe0d8151fd0 2023-11-13T18:41:21.642 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:21.625+0000 7fe0dcde1640 1 --2- 172.21.15.102:0/125865764 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe0d8151fd0 0x7fe0d8155be0 secure :-1 s=READY pgs=899 cs=0 l=1 rev1=1 crypto rx=0x7fe0c800efc0 tx=0x7fe0c800c430 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-13T18:41:21.642 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:21.625+0000 7fe0cdffb640 1 -- 172.21.15.102:0/125865764 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0c800cd90 con 0x7fe0d8151fd0 2023-11-13T18:41:21.642 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:21.625+0000 7fe0df846640 1 -- 172.21.15.102:0/125865764 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe0d8154e20 con 0x7fe0d8151fd0 2023-11-13T18:41:21.643 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:21.625+0000 7fe0cdffb640 1 -- 172.21.15.102:0/125865764 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe0c8004020 con 0x7fe0d8151fd0 2023-11-13T18:41:21.643 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:21.625+0000 7fe0cdffb640 1 -- 172.21.15.102:0/125865764 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0c8004210 con 0x7fe0d8151fd0 2023-11-13T18:41:21.643 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:21.625+0000 7fe0df846640 1 -- 172.21.15.102:0/125865764 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe0d81553e0 con 0x7fe0d8151fd0 2023-11-13T18:41:21.644 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:21.629+0000 7fe0df846640 1 -- 172.21.15.102:0/125865764 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe0d81558e0 con 0x7fe0d8151fd0 2023-11-13T18:41:21.645 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:21.637+0000 7fe0cdffb640 1 -- 172.21.15.102:0/125865764 <== mon.1 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fe0c8004370 con 0x7fe0d8151fd0 2023-11-13T18:41:21.646 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:21.637+0000 7fe0cdffb640 1 --2- 172.21.15.102:0/125865764 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7fe0bc0664c0 0x7fe0bc068980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T18:41:21.646 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:21.637+0000 7fe0cdffb640 1 -- 172.21.15.102:0/125865764 <== mon.1 v2:172.21.15.154:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 5825+0+0 (secure 0 0 0) 0x7fe0c80a8380 con 0x7fe0d8151fd0 2023-11-13T18:41:21.647 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:21.637+0000 7fe0dd5e2640 1 --2- 172.21.15.102:0/125865764 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7fe0bc0664c0 0x7fe0bc068980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T18:41:21.649 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:21.641+0000 7fe0dd5e2640 1 --2- 172.21.15.102:0/125865764 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7fe0bc0664c0 0x7fe0bc068980 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x7fe0d4006fd0 tx=0x7fe0d4008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-13T18:41:21.653 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:21.645+0000 7fe0cdffb640 1 -- 172.21.15.102:0/125865764 <== mon.1 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fe0c8075860 con 0x7fe0d8151fd0 2023-11-13T18:41:22.662 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:22.653+0000 7fe0df846640 1 -- 172.21.15.102:0/125865764 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe0d8068520 con 0x7fe0d8151fd0 2023-11-13T18:41:22.663 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:22.653+0000 7fe0cdffb640 1 -- 172.21.15.102:0/125865764 <== mon.1 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) v1 ==== 94+0+4922 (secure 0 0 0) 0x7fe0c8078e80 con 0x7fe0d8151fd0 2023-11-13T18:41:22.663 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T18:41:22.664 INFO:teuthology.orchestra.run.smithi102.stdout:{"epoch":16,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4826,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6834/3121803929","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6832","nonce":3121803929},{"type":"v1","addr":"172.21.15.154:6834","nonce":3121803929}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":4829,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6835/2990283260","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6833","nonce":2990283260},{"type":"v1","addr":"172.21.15.154:6835","nonce":2990283260}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":5271,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.102:6836/868460192","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6834","nonce":868460192},{"type":"v1","addr":"172.21.15.102:6836","nonce":868460192}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-13T11:29:56.498042+0000","modified":"2023-11-13T11:29:59.519487+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5274},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5274":{"gid":5274,"name":"a","rank":0,"incarnation":12,"state":"up:active","state_seq":3,"addr":"172.21.15.102:6837/3869977039","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6835","nonce":3869977039},{"type":"v1","addr":"172.21.15.102:6837","nonce":3869977039}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-11-13T18:41:22.664 INFO:teuthology.orchestra.run.smithi102.stderr:dumped fsmap epoch 16 2023-11-13T18:41:22.666 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:22.657+0000 7fe0df846640 1 -- 172.21.15.102:0/125865764 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7fe0bc0664c0 msgr2=0x7fe0bc068980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T18:41:22.666 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:22.657+0000 7fe0df846640 1 --2- 172.21.15.102:0/125865764 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7fe0bc0664c0 0x7fe0bc068980 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x7fe0d4006fd0 tx=0x7fe0d4008040 comp rx=0 tx=0).stop 2023-11-13T18:41:22.666 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:22.657+0000 7fe0df846640 1 -- 172.21.15.102:0/125865764 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe0d8151fd0 msgr2=0x7fe0d8155be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T18:41:22.667 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:22.657+0000 7fe0df846640 1 --2- 172.21.15.102:0/125865764 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe0d8151fd0 0x7fe0d8155be0 secure :-1 s=READY pgs=899 cs=0 l=1 rev1=1 crypto rx=0x7fe0c800efc0 tx=0x7fe0c800c430 comp rx=0 tx=0).stop 2023-11-13T18:41:22.667 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:22.657+0000 7fe0df846640 1 -- 172.21.15.102:0/125865764 shutdown_connections 2023-11-13T18:41:22.667 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:22.657+0000 7fe0df846640 1 --2- 172.21.15.102:0/125865764 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7fe0bc0664c0 0x7fe0bc068980 unknown :-1 s=CLOSED pgs=741 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T18:41:22.667 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:22.657+0000 7fe0df846640 1 --2- 172.21.15.102:0/125865764 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe0d8159b10 0x7fe0d81512f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T18:41:22.668 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:22.657+0000 7fe0df846640 1 --2- 172.21.15.102:0/125865764 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe0d8151fd0 0x7fe0d8155be0 unknown :-1 s=CLOSED pgs=899 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T18:41:22.668 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:22.657+0000 7fe0df846640 1 --2- 172.21.15.102:0/125865764 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe0c4005190 0x7fe0d8152db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T18:41:22.668 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:22.657+0000 7fe0df846640 1 -- 172.21.15.102:0/125865764 >> 172.21.15.102:0/125865764 conn(0x7fe0d80cb5c0 msgr2=0x7fe0d815a960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-13T18:41:22.669 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:22.657+0000 7fe0df846640 1 -- 172.21.15.102:0/125865764 shutdown_connections 2023-11-13T18:41:22.669 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:22.657+0000 7fe0df846640 1 -- 172.21.15.102:0/125865764 wait complete. 2023-11-13T18:41:22.706 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-13T18:41:22.921 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:22.913+0000 7fd00f9f8640 1 Processor -- start 2023-11-13T18:41:22.921 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:22.913+0000 7fd00f9f8640 1 -- start start 2023-11-13T18:41:22.924 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:22.913+0000 7fd00f9f8640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7fd0080d0c40 0x7fd0080c69b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T18:41:22.924 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:22.913+0000 7fd00f9f8640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd0080d1440 con 0x7fd0080cf490 2023-11-13T18:41:22.924 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:22.913+0000 7fd00f9f8640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd0080cdb10 con 0x7fd0081606e0 2023-11-13T18:41:22.925 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:22.913+0000 7fd00f9f8640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd0080d1690 con 0x7fd0080d0c40 2023-11-13T18:41:22.925 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:22.913+0000 7fd00d794640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7fd0081606e0 0x7fd0080b3e20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.102:37740/0 (socket says 172.21.15.102:37740) 2023-11-13T18:41:22.926 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:22.917+0000 7fd00d794640 1 -- 172.21.15.102:0/1743171822 learned_addr learned my addr 172.21.15.102:0/1743171822 (peer_addr_for_me v1:172.21.15.102:0/0) 2023-11-13T18:41:22.926 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:22.917+0000 7fd00cf93640 1 --2- 172.21.15.102:0/1743171822 >> v2:172.21.15.102:3300/0 conn(0x7fd0080d0c40 0x7fd0080c69b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T18:41:22.926 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:22.917+0000 7fcffffff640 1 -- 172.21.15.102:0/1743171822 <== mon.1 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 855920640 0 0) 0x7fd0080cdb10 con 0x7fd0081606e0 2023-11-13T18:41:22.927 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:22.917+0000 7fcffffff640 1 -- 172.21.15.102:0/1743171822 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcff4003530 con 0x7fd0081606e0 2023-11-13T18:41:22.927 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:22.917+0000 7fd00cf93640 1 -- 172.21.15.102:0/1743171822 >> v1:172.21.15.154:6789/0 conn(0x7fd0081606e0 legacy=0x7fd0080b3e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T18:41:22.927 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:22.917+0000 7fd00cf93640 1 -- 172.21.15.102:0/1743171822 >> v1:172.21.15.102:6789/0 conn(0x7fd0080cf490 legacy=0x7fd0080cdfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-13T18:41:22.928 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:22.917+0000 7fd00cf93640 1 -- 172.21.15.102:0/1743171822 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0080d1970 con 0x7fd0080d0c40 2023-11-13T18:41:22.931 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:22.921+0000 7fd00cf93640 1 --2- 172.21.15.102:0/1743171822 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd0080d0c40 0x7fd0080c69b0 secure :-1 s=READY pgs=1933 cs=0 l=1 rev1=1 crypto rx=0x7fd000009d90 tx=0x7fd00001c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9860024baceff5d0 server_cookie=0 in_seq=0 out_seq=0 2023-11-13T18:41:22.933 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:22.925+0000 7fcffffff640 1 -- 172.21.15.102:0/1743171822 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0000a58b0 con 0x7fd0080d0c40 2023-11-13T18:41:22.933 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:22.925+0000 7fcffffff640 1 -- 172.21.15.102:0/1743171822 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd0000a5a10 con 0x7fd0080d0c40 2023-11-13T18:41:22.934 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:22.925+0000 7fcffffff640 1 -- 172.21.15.102:0/1743171822 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0000a5da0 con 0x7fd0080d0c40 2023-11-13T18:41:22.935 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:22.925+0000 7fd00f9f8640 1 -- 172.21.15.102:0/1743171822 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd0080d0c40 msgr2=0x7fd0080c69b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T18:41:22.935 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:22.925+0000 7fd00f9f8640 1 --2- 172.21.15.102:0/1743171822 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd0080d0c40 0x7fd0080c69b0 secure :-1 s=READY pgs=1933 cs=0 l=1 rev1=1 crypto rx=0x7fd000009d90 tx=0x7fd00001c880 comp rx=0 tx=0).stop 2023-11-13T18:41:22.936 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:22.929+0000 7fd00f9f8640 1 -- 172.21.15.102:0/1743171822 shutdown_connections 2023-11-13T18:41:22.936 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:22.929+0000 7fd00f9f8640 1 --2- 172.21.15.102:0/1743171822 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd0080d0c40 0x7fd0080c69b0 unknown :-1 s=CLOSED pgs=1933 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T18:41:22.937 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:22.929+0000 7fd00f9f8640 1 -- 172.21.15.102:0/1743171822 >> 172.21.15.102:0/1743171822 conn(0x7fd00809c130 msgr2=0x7fd0080d2e60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-13T18:41:22.943 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:22.929+0000 7fd00f9f8640 1 -- 172.21.15.102:0/1743171822 shutdown_connections 2023-11-13T18:41:22.943 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:22.933+0000 7fd00f9f8640 1 -- 172.21.15.102:0/1743171822 wait complete. 2023-11-13T18:41:22.955 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:22.945+0000 7fd00f9f8640 1 Processor -- start 2023-11-13T18:41:22.956 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:22.949+0000 7fd00f9f8640 1 -- start start 2023-11-13T18:41:22.961 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:22.953+0000 7fd00f9f8640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd0080cf490 0x7fd008143090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T18:41:22.962 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:22.953+0000 7fd00f9f8640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd0080d0c40 0x7fd00815a9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T18:41:22.962 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:22.953+0000 7fd00f9f8640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd0081606e0 0x7fd0080b5a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T18:41:22.962 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:22.953+0000 7fd00f9f8640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd00815b9d0 con 0x7fd0081606e0 2023-11-13T18:41:22.963 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:22.953+0000 7fd00f9f8640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0081fa740 con 0x7fd0080cf490 2023-11-13T18:41:22.963 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:22.953+0000 7fd00f9f8640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd0080cadc0 con 0x7fd0080d0c40 2023-11-13T18:41:22.965 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:22.953+0000 7fd00cf93640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd0080d0c40 0x7fd00815a9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T18:41:22.965 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:22.953+0000 7fd00cf93640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd0080d0c40 0x7fd00815a9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.102:51390/0 (socket says 172.21.15.102:51390) 2023-11-13T18:41:22.965 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:22.953+0000 7fd00cf93640 1 -- 172.21.15.102:0/1915457847 learned_addr learned my addr 172.21.15.102:0/1915457847 (peer_addr_for_me v2:172.21.15.102:0/0) 2023-11-13T18:41:22.965 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:22.953+0000 7fd00cf93640 1 -- 172.21.15.102:0/1915457847 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd0080cf490 msgr2=0x7fd008143090 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-11-13T18:41:22.966 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:22.953+0000 7fd00cf93640 1 --2- 172.21.15.102:0/1915457847 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd0080cf490 0x7fd008143090 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T18:41:22.966 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:22.953+0000 7fd00cf93640 1 -- 172.21.15.102:0/1915457847 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd0081606e0 msgr2=0x7fd0080b5a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T18:41:22.966 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:22.953+0000 7fd00cf93640 1 --2- 172.21.15.102:0/1915457847 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd0081606e0 0x7fd0080b5a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T18:41:22.966 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:22.953+0000 7fd00cf93640 1 -- 172.21.15.102:0/1915457847 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd000009a70 con 0x7fd0080d0c40 2023-11-13T18:41:22.967 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:22.953+0000 7fd00cf93640 1 --2- 172.21.15.102:0/1915457847 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd0080d0c40 0x7fd00815a9c0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7fd000009d90 tx=0x7fd000019620 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-13T18:41:22.967 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:22.957+0000 7fcffdffb640 1 -- 172.21.15.102:0/1915457847 <== mon.2 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0000a58b0 con 0x7fd0080d0c40 2023-11-13T18:41:22.967 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:22.957+0000 7fcffdffb640 1 -- 172.21.15.102:0/1915457847 <== mon.2 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd0000b9860 con 0x7fd0080d0c40 2023-11-13T18:41:22.967 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:22.957+0000 7fcffdffb640 1 -- 172.21.15.102:0/1915457847 <== mon.2 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0000b9bd0 con 0x7fd0080d0c40 2023-11-13T18:41:22.968 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:22.957+0000 7fd00f9f8640 1 -- 172.21.15.102:0/1915457847 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd00815b410 con 0x7fd0080d0c40 2023-11-13T18:41:22.968 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:22.957+0000 7fd00f9f8640 1 -- 172.21.15.102:0/1915457847 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd0080caa50 con 0x7fd0080d0c40 2023-11-13T18:41:22.969 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:22.961+0000 7fd00f9f8640 1 -- 172.21.15.102:0/1915457847 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd0080ca8b0 con 0x7fd0080d0c40 2023-11-13T18:41:22.979 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:22.969+0000 7fcffdffb640 1 -- 172.21.15.102:0/1915457847 <== mon.2 v2:172.21.15.154:3301/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fd0000b9d30 con 0x7fd0080d0c40 2023-11-13T18:41:22.981 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:22.973+0000 7fcffdffb640 1 --2- 172.21.15.102:0/1915457847 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7fcfec066470 0x7fcfec068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T18:41:22.982 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:22.973+0000 7fcffdffb640 1 -- 172.21.15.102:0/1915457847 <== mon.2 v2:172.21.15.154:3301/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 5825+0+0 (secure 0 0 0) 0x7fd00011f360 con 0x7fd0080d0c40 2023-11-13T18:41:22.982 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:22.973+0000 7fd00d794640 1 --2- 172.21.15.102:0/1915457847 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7fcfec066470 0x7fcfec068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T18:41:22.985 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:22.977+0000 7fd00d794640 1 --2- 172.21.15.102:0/1915457847 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7fcfec066470 0x7fcfec068930 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x7fcff8007fd0 tx=0x7fcff8007900 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-13T18:41:22.985 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:22.977+0000 7fcffdffb640 1 -- 172.21.15.102:0/1915457847 <== mon.2 v2:172.21.15.154:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fd0080ca8b0 con 0x7fd0080d0c40 2023-11-13T18:41:23.242 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:23.233+0000 7fd00f9f8640 1 -- 172.21.15.102:0/1915457847 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd0080ca8b0 con 0x7fd0080d0c40 2023-11-13T18:41:23.244 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:23.237+0000 7fcffdffb640 1 -- 172.21.15.102:0/1915457847 <== mon.2 v2:172.21.15.154:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v38) v1 ==== 74+0+16793 (secure 0 0 0) 0x7fd0080ca8b0 con 0x7fd0080d0c40 2023-11-13T18:41:23.247 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T18:41:23.248 INFO:teuthology.orchestra.run.smithi102.stdout:{"epoch":38,"fsid":"97b3eb2b-7ccf-4aae-8d92-bff986c671ea","created":"2023-11-13T11:28:31.836724+0000","modified":"2023-11-13T11:30:39.704184+0000","last_up_change":"2023-11-13T11:28:44.876638+0000","last_in_change":"2023-11-13T11:28:35.312740+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-13T11:28:44.981356+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2023-11-13T11:29:54.890079+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"35","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2023-11-13T11:29:55.482816+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"36","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"bdefaa17-fcca-4c86-aa40-27dc33a789af","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6800","nonce":53303834},{"type":"v1","addr":"172.21.15.102:6801","nonce":53303834}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6802","nonce":53303834},{"type":"v1","addr":"172.21.15.102:6803","nonce":53303834}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6806","nonce":53303834},{"type":"v1","addr":"172.21.15.102:6807","nonce":53303834}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6804","nonce":53303834},{"type":"v1","addr":"172.21.15.102:6805","nonce":53303834}]},"public_addr":"172.21.15.102:6801/53303834","cluster_addr":"172.21.15.102:6803/53303834","heartbeat_back_addr":"172.21.15.102:6807/53303834","heartbeat_front_addr":"172.21.15.102:6805/53303834","state":["exists","up"]},{"osd":1,"uuid":"f0033196-dec9-4ae9-945e-6aeef6dbb47f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6808","nonce":1732708348},{"type":"v1","addr":"172.21.15.102:6809","nonce":1732708348}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6811","nonce":1732708348},{"type":"v1","addr":"172.21.15.102:6813","nonce":1732708348}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6818","nonce":1732708348},{"type":"v1","addr":"172.21.15.102:6820","nonce":1732708348}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6815","nonce":1732708348},{"type":"v1","addr":"172.21.15.102:6817","nonce":1732708348}]},"public_addr":"172.21.15.102:6809/1732708348","cluster_addr":"172.21.15.102:6813/1732708348","heartbeat_back_addr":"172.21.15.102:6820/1732708348","heartbeat_front_addr":"172.21.15.102:6817/1732708348","state":["exists","up"]},{"osd":2,"uuid":"496b0834-351e-4ec2-a714-86ed0c0ff4fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6810","nonce":1825475150},{"type":"v1","addr":"172.21.15.102:6812","nonce":1825475150}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6814","nonce":1825475150},{"type":"v1","addr":"172.21.15.102:6816","nonce":1825475150}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6822","nonce":1825475150},{"type":"v1","addr":"172.21.15.102:6823","nonce":1825475150}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6819","nonce":1825475150},{"type":"v1","addr":"172.21.15.102:6821","nonce":1825475150}]},"public_addr":"172.21.15.102:6812/1825475150","cluster_addr":"172.21.15.102:6816/1825475150","heartbeat_back_addr":"172.21.15.102:6823/1825475150","heartbeat_front_addr":"172.21.15.102:6821/1825475150","state":["exists","up"]},{"osd":3,"uuid":"3ba6cc41-e0a0-4273-86cb-90000c06a55a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6824","nonce":4149355528},{"type":"v1","addr":"172.21.15.102:6825","nonce":4149355528}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6826","nonce":4149355528},{"type":"v1","addr":"172.21.15.102:6827","nonce":4149355528}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6830","nonce":4149355528},{"type":"v1","addr":"172.21.15.102:6831","nonce":4149355528}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6828","nonce":4149355528},{"type":"v1","addr":"172.21.15.102:6829","nonce":4149355528}]},"public_addr":"172.21.15.102:6825/4149355528","cluster_addr":"172.21.15.102:6827/4149355528","heartbeat_back_addr":"172.21.15.102:6831/4149355528","heartbeat_front_addr":"172.21.15.102:6829/4149355528","state":["exists","up"]},{"osd":4,"uuid":"16e797d8-e6e7-4140-95c3-b85283c42a2a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6808","nonce":4028899241},{"type":"v1","addr":"172.21.15.154:6809","nonce":4028899241}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6810","nonce":4028899241},{"type":"v1","addr":"172.21.15.154:6811","nonce":4028899241}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6814","nonce":4028899241},{"type":"v1","addr":"172.21.15.154:6815","nonce":4028899241}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6812","nonce":4028899241},{"type":"v1","addr":"172.21.15.154:6813","nonce":4028899241}]},"public_addr":"172.21.15.154:6809/4028899241","cluster_addr":"172.21.15.154:6811/4028899241","heartbeat_back_addr":"172.21.15.154:6815/4028899241","heartbeat_front_addr":"172.21.15.154:6813/4028899241","state":["exists","up"]},{"osd":5,"uuid":"d6ab225c-1b55-450a-89a9-abe5c3f8d6af","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":3562396827},{"type":"v1","addr":"172.21.15.154:6801","nonce":3562396827}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":3562396827},{"type":"v1","addr":"172.21.15.154:6803","nonce":3562396827}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6806","nonce":3562396827},{"type":"v1","addr":"172.21.15.154:6807","nonce":3562396827}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6804","nonce":3562396827},{"type":"v1","addr":"172.21.15.154:6805","nonce":3562396827}]},"public_addr":"172.21.15.154:6801/3562396827","cluster_addr":"172.21.15.154:6803/3562396827","heartbeat_back_addr":"172.21.15.154:6807/3562396827","heartbeat_front_addr":"172.21.15.154:6805/3562396827","state":["exists","up"]},{"osd":6,"uuid":"96f905ac-491c-4662-8e2b-5bb8e929ab9d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6816","nonce":2933728751},{"type":"v1","addr":"172.21.15.154:6817","nonce":2933728751}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6818","nonce":2933728751},{"type":"v1","addr":"172.21.15.154:6819","nonce":2933728751}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6822","nonce":2933728751},{"type":"v1","addr":"172.21.15.154:6823","nonce":2933728751}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6820","nonce":2933728751},{"type":"v1","addr":"172.21.15.154:6821","nonce":2933728751}]},"public_addr":"172.21.15.154:6817/2933728751","cluster_addr":"172.21.15.154:6819/2933728751","heartbeat_back_addr":"172.21.15.154:6823/2933728751","heartbeat_front_addr":"172.21.15.154:6821/2933728751","state":["exists","up"]},{"osd":7,"uuid":"07012d3b-3ab4-40df-a471-93caed22e2dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6824","nonce":1753500785},{"type":"v1","addr":"172.21.15.154:6825","nonce":1753500785}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6826","nonce":1753500785},{"type":"v1","addr":"172.21.15.154:6827","nonce":1753500785}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6830","nonce":1753500785},{"type":"v1","addr":"172.21.15.154:6831","nonce":1753500785}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6828","nonce":1753500785},{"type":"v1","addr":"172.21.15.154:6829","nonce":1753500785}]},"public_addr":"172.21.15.154:6825/1753500785","cluster_addr":"172.21.15.154:6827/1753500785","heartbeat_back_addr":"172.21.15.154:6831/1753500785","heartbeat_front_addr":"172.21.15.154:6829/1753500785","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-13T11:28:40.978603+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-13T11:28:41.200985+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-13T11:28:41.222815+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-13T11:28:41.202162+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-13T11:28:40.925911+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-13T11:28:41.087725+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-13T11:28:41.072208+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-13T11:28:40.875257+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"5.0","mappings":[{"from":4,"to":5}]},{"pgid":"5.e","mappings":[{"from":4,"to":5}]},{"pgid":"5.15","mappings":[{"from":4,"to":5}]},{"pgid":"5.32","mappings":[{"from":4,"to":3}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-13T18:41:23.252 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:23.241+0000 7fd00f9f8640 1 -- 172.21.15.102:0/1915457847 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7fcfec066470 msgr2=0x7fcfec068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T18:41:23.252 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:23.241+0000 7fd00f9f8640 1 --2- 172.21.15.102:0/1915457847 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7fcfec066470 0x7fcfec068930 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x7fcff8007fd0 tx=0x7fcff8007900 comp rx=0 tx=0).stop 2023-11-13T18:41:23.253 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:23.241+0000 7fd00f9f8640 1 -- 172.21.15.102:0/1915457847 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd0080d0c40 msgr2=0x7fd00815a9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T18:41:23.253 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:23.241+0000 7fd00f9f8640 1 --2- 172.21.15.102:0/1915457847 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd0080d0c40 0x7fd00815a9c0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7fd000009d90 tx=0x7fd000019620 comp rx=0 tx=0).stop 2023-11-13T18:41:23.254 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:23.245+0000 7fd00f9f8640 1 -- 172.21.15.102:0/1915457847 shutdown_connections 2023-11-13T18:41:23.254 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:23.245+0000 7fd00f9f8640 1 --2- 172.21.15.102:0/1915457847 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7fcfec066470 0x7fcfec068930 unknown :-1 s=CLOSED pgs=742 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T18:41:23.254 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:23.245+0000 7fd00f9f8640 1 --2- 172.21.15.102:0/1915457847 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd0081606e0 0x7fd0080b5a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T18:41:23.255 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:23.245+0000 7fd00f9f8640 1 --2- 172.21.15.102:0/1915457847 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd0080d0c40 0x7fd00815a9c0 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T18:41:23.255 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:23.245+0000 7fd00f9f8640 1 --2- 172.21.15.102:0/1915457847 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd0080cf490 0x7fd008143090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T18:41:23.255 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:23.245+0000 7fd00f9f8640 1 -- 172.21.15.102:0/1915457847 >> 172.21.15.102:0/1915457847 conn(0x7fd00809c130 msgr2=0x7fd00815dd70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-13T18:41:23.256 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:23.249+0000 7fd00f9f8640 1 -- 172.21.15.102:0/1915457847 shutdown_connections 2023-11-13T18:41:23.257 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:23.249+0000 7fd00f9f8640 1 -- 172.21.15.102:0/1915457847 wait complete. 2023-11-13T18:41:23.292 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-11-13T18:41:23.914 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:23.905+0000 7f388b59e640 1 Processor -- start 2023-11-13T18:41:23.917 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:23.905+0000 7f388b59e640 1 -- start start 2023-11-13T18:41:23.921 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:23.913+0000 7f388b59e640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f388c0b0cf0 0x7f388c0b4df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T18:41:23.922 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:23.913+0000 7f388b59e640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f388c165db0 con 0x7f388c1655e0 2023-11-13T18:41:23.922 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:23.913+0000 7f388b59e640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f388c0b11b0 con 0x7f388c165200 2023-11-13T18:41:23.922 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:23.913+0000 7f388b59e640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f388c0b1490 con 0x7f388c0b0cf0 2023-11-13T18:41:23.923 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:23.913+0000 7f388a59c640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f388c165200 0x7f388c160e00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.102:37742/0 (socket says 172.21.15.102:37742) 2023-11-13T18:41:23.923 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:23.913+0000 7f388a59c640 1 -- 172.21.15.102:0/2886757334 learned_addr learned my addr 172.21.15.102:0/2886757334 (peer_addr_for_me v1:172.21.15.102:0/0) 2023-11-13T18:41:23.924 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:23.917+0000 7f388959a640 1 -- 172.21.15.102:0/2886757334 <== mon.1 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3065350198 0 0) 0x7f388c0b11b0 con 0x7f388c165200 2023-11-13T18:41:23.924 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:23.917+0000 7f388959a640 1 -- 172.21.15.102:0/2886757334 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3874003530 con 0x7f388c165200 2023-11-13T18:41:23.925 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:23.917+0000 7f3889d9b640 1 --2- 172.21.15.102:0/2886757334 >> v2:172.21.15.154:3300/0 conn(0x7f388c0b0cf0 0x7f388c0b4df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T18:41:23.930 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:23.917+0000 7f3889d9b640 1 -- 172.21.15.102:0/2886757334 >> v1:172.21.15.154:6789/0 conn(0x7f388c165200 legacy=0x7f388c160e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T18:41:23.931 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:23.917+0000 7f3889d9b640 1 -- 172.21.15.102:0/2886757334 >> v1:172.21.15.102:6789/0 conn(0x7f388c1655e0 legacy=0x7f388c06a800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T18:41:23.931 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:23.917+0000 7f388959a640 1 -- 172.21.15.102:0/2886757334 <== mon.0 v1:172.21.15.102:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 730902311 0 0) 0x7f388c165db0 con 0x7f388c1655e0 2023-11-13T18:41:23.931 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:23.917+0000 7f3889d9b640 1 -- 172.21.15.102:0/2886757334 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f388c0b1770 con 0x7f388c0b0cf0 2023-11-13T18:41:23.944 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:23.933+0000 7f3889d9b640 1 --2- 172.21.15.102:0/2886757334 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f388c0b0cf0 0x7f388c0b4df0 secure :-1 s=READY pgs=902 cs=0 l=1 rev1=1 crypto rx=0x7f38800097c0 tx=0x7f388001c460 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4a9c53c1100d4beb server_cookie=0 in_seq=0 out_seq=0 2023-11-13T18:41:23.944 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:23.937+0000 7f388959a640 1 -- 172.21.15.102:0/2886757334 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38800ab600 con 0x7f388c0b0cf0 2023-11-13T18:41:23.945 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:23.937+0000 7f388959a640 1 -- 172.21.15.102:0/2886757334 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f38800a7050 con 0x7f388c0b0cf0 2023-11-13T18:41:23.945 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:23.937+0000 7f388959a640 1 -- 172.21.15.102:0/2886757334 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38800ab980 con 0x7f388c0b0cf0 2023-11-13T18:41:23.947 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:23.937+0000 7f388b59e640 1 -- 172.21.15.102:0/2886757334 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f388c0b0cf0 msgr2=0x7f388c0b4df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T18:41:23.948 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:23.937+0000 7f388b59e640 1 --2- 172.21.15.102:0/2886757334 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f388c0b0cf0 0x7f388c0b4df0 secure :-1 s=READY pgs=902 cs=0 l=1 rev1=1 crypto rx=0x7f38800097c0 tx=0x7f388001c460 comp rx=0 tx=0).stop 2023-11-13T18:41:23.949 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:23.941+0000 7f388b59e640 1 -- 172.21.15.102:0/2886757334 shutdown_connections 2023-11-13T18:41:23.949 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:23.941+0000 7f388b59e640 1 --2- 172.21.15.102:0/2886757334 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f388c0b0cf0 0x7f388c0b4df0 unknown :-1 s=CLOSED pgs=902 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T18:41:23.950 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:23.941+0000 7f388b59e640 1 -- 172.21.15.102:0/2886757334 >> 172.21.15.102:0/2886757334 conn(0x7f388c0b4020 msgr2=0x7f388c0b46e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-13T18:41:23.951 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:23.941+0000 7f388b59e640 1 -- 172.21.15.102:0/2886757334 shutdown_connections 2023-11-13T18:41:23.951 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:23.941+0000 7f388b59e640 1 -- 172.21.15.102:0/2886757334 wait complete. 2023-11-13T18:41:23.958 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:23.949+0000 7f388b59e640 1 Processor -- start 2023-11-13T18:41:23.958 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:23.949+0000 7f388b59e640 1 -- start start 2023-11-13T18:41:23.962 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:23.953+0000 7f388b59e640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f388c0b0cf0 0x7f388c159160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T18:41:23.963 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:23.953+0000 7f388b59e640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f388c165200 0x7f388c162ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T18:41:23.963 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:23.953+0000 7f388b59e640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f388c1655e0 0x7f388c15c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T18:41:23.964 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:23.953+0000 7f388b59e640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f388c161e00 con 0x7f388c165200 2023-11-13T18:41:23.964 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:23.953+0000 7f388b59e640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f388c1620e0 con 0x7f388c1655e0 2023-11-13T18:41:23.964 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:23.953+0000 7f388b59e640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f388c1623c0 con 0x7f388c0b0cf0 2023-11-13T18:41:23.965 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:23.953+0000 7f388a59c640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f388c0b0cf0 0x7f388c159160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T18:41:23.965 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:23.953+0000 7f388a59c640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f388c0b0cf0 0x7f388c159160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.102:51396/0 (socket says 172.21.15.102:51396) 2023-11-13T18:41:23.965 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:23.953+0000 7f388a59c640 1 -- 172.21.15.102:0/309853129 learned_addr learned my addr 172.21.15.102:0/309853129 (peer_addr_for_me v2:172.21.15.102:0/0) 2023-11-13T18:41:23.965 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:23.953+0000 7f388ad9d640 1 --2- 172.21.15.102:0/309853129 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f388c1655e0 0x7f388c15c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T18:41:23.966 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:23.953+0000 7f388a59c640 1 -- 172.21.15.102:0/309853129 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f388c1655e0 msgr2=0x7f388c15c610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T18:41:23.967 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:23.953+0000 7f388a59c640 1 --2- 172.21.15.102:0/309853129 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f388c1655e0 0x7f388c15c610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T18:41:23.967 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:23.953+0000 7f388a59c640 1 -- 172.21.15.102:0/309853129 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f388c165200 msgr2=0x7f388c162ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T18:41:23.967 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:23.953+0000 7f388a59c640 1 --2- 172.21.15.102:0/309853129 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f388c165200 0x7f388c162ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T18:41:23.968 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:23.953+0000 7f388a59c640 1 -- 172.21.15.102:0/309853129 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3880009420 con 0x7f388c0b0cf0 2023-11-13T18:41:23.968 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:23.961+0000 7f388a59c640 1 --2- 172.21.15.102:0/309853129 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f388c0b0cf0 0x7f388c159160 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f387c00c520 tx=0x7f387c00c9e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-13T18:41:23.976 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:23.965+0000 7f387affd640 1 -- 172.21.15.102:0/309853129 <== mon.2 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f387c0074e0 con 0x7f388c0b0cf0 2023-11-13T18:41:23.976 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:23.965+0000 7f387affd640 1 -- 172.21.15.102:0/309853129 <== mon.2 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f387c007640 con 0x7f388c0b0cf0 2023-11-13T18:41:23.976 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:23.965+0000 7f387affd640 1 -- 172.21.15.102:0/309853129 <== mon.2 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f387c0049f0 con 0x7f388c0b0cf0 2023-11-13T18:41:23.977 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:23.965+0000 7f388b59e640 1 -- 172.21.15.102:0/309853129 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f388c1626a0 con 0x7f388c0b0cf0 2023-11-13T18:41:23.977 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:23.965+0000 7f388b59e640 1 -- 172.21.15.102:0/309853129 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f388c1596a0 con 0x7f388c0b0cf0 2023-11-13T18:41:23.977 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:23.969+0000 7f388b59e640 1 -- 172.21.15.102:0/309853129 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f388c068520 con 0x7f388c0b0cf0 2023-11-13T18:41:23.984 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:23.977+0000 7f387affd640 1 -- 172.21.15.102:0/309853129 <== mon.2 v2:172.21.15.154:3301/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f387c004b50 con 0x7f388c0b0cf0 2023-11-13T18:41:23.989 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:23.981+0000 7f387affd640 1 --2- 172.21.15.102:0/309853129 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f386c066570 0x7f386c068a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T18:41:23.989 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:23.981+0000 7f3889d9b640 1 --2- 172.21.15.102:0/309853129 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f386c066570 0x7f386c068a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T18:41:23.989 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:23.981+0000 7f387affd640 1 -- 172.21.15.102:0/309853129 <== mon.2 v2:172.21.15.154:3301/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f387c083410 con 0x7f388c0b0cf0 2023-11-13T18:41:23.994 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:23.985+0000 7f387affd640 1 -- 172.21.15.102:0/309853129 <== mon.2 v2:172.21.15.154:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f387c050930 con 0x7f388c0b0cf0 2023-11-13T18:41:23.996 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:23.989+0000 7f3889d9b640 1 --2- 172.21.15.102:0/309853129 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f386c066570 0x7f386c068a30 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x7f38800ad000 tx=0x7f3880004740 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-13T18:41:25.017 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:25.009+0000 7f388b59e640 1 -- 172.21.15.102:0/309853129 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f388c073140 con 0x7f388c0b0cf0 2023-11-13T18:41:25.116 INFO:tasks.ceph.mon.a.smithi102.stderr:2023-11-13T18:41:25.105+0000 7fb06c1ec640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-11-13T18:41:25.301 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:25.293+0000 7f387affd640 1 -- 172.21.15.102:0/309853129 <== mon.2 v2:172.21.15.154:3301/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v17) v1 ==== 161+0+0 (secure 0 0 0) 0x7f387c018090 con 0x7f388c0b0cf0 2023-11-13T18:41:25.302 INFO:teuthology.orchestra.run.smithi102.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-11-13T18:41:25.310 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:25.301+0000 7f388b59e640 1 -- 172.21.15.102:0/309853129 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f386c066570 msgr2=0x7f386c068a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T18:41:25.311 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:25.301+0000 7f388b59e640 1 --2- 172.21.15.102:0/309853129 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f386c066570 0x7f386c068a30 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x7f38800ad000 tx=0x7f3880004740 comp rx=0 tx=0).stop 2023-11-13T18:41:25.311 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:25.301+0000 7f388b59e640 1 -- 172.21.15.102:0/309853129 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f388c0b0cf0 msgr2=0x7f388c159160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T18:41:25.311 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:25.301+0000 7f388b59e640 1 --2- 172.21.15.102:0/309853129 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f388c0b0cf0 0x7f388c159160 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f387c00c520 tx=0x7f387c00c9e0 comp rx=0 tx=0).stop 2023-11-13T18:41:25.312 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:25.305+0000 7f388b59e640 1 -- 172.21.15.102:0/309853129 shutdown_connections 2023-11-13T18:41:25.312 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:25.305+0000 7f388b59e640 1 --2- 172.21.15.102:0/309853129 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f388c1655e0 0x7f388c15c610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T18:41:25.313 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:25.305+0000 7f388b59e640 1 --2- 172.21.15.102:0/309853129 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f386c066570 0x7f386c068a30 unknown :-1 s=CLOSED pgs=743 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T18:41:25.313 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:25.305+0000 7f388b59e640 1 --2- 172.21.15.102:0/309853129 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f388c165200 0x7f388c162ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T18:41:25.313 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:25.305+0000 7f388b59e640 1 --2- 172.21.15.102:0/309853129 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f388c0b0cf0 0x7f388c159160 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T18:41:25.314 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:25.305+0000 7f388b59e640 1 -- 172.21.15.102:0/309853129 >> 172.21.15.102:0/309853129 conn(0x7f388c0b4020 msgr2=0x7f388c0ac1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-13T18:41:25.314 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:25.305+0000 7f388b59e640 1 -- 172.21.15.102:0/309853129 shutdown_connections 2023-11-13T18:41:25.315 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:25.305+0000 7f388b59e640 1 -- 172.21.15.102:0/309853129 wait complete. 2023-11-13T18:41:25.386 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-11-13T18:41:25.590 INFO:tasks.ceph.mds.a.smithi102.stdout:starting mds.a at 2023-11-13T18:41:25.777 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:25.769+0000 7f419c2fe640 1 Processor -- start 2023-11-13T18:41:25.777 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:25.769+0000 7f419c2fe640 1 -- start start 2023-11-13T18:41:25.778 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:25.769+0000 7f419c2fe640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f41940ade90 0x7f419416c3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T18:41:25.779 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:25.769+0000 7f419c2fe640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f41941619a0 con 0x7f41940cf2d0 2023-11-13T18:41:25.779 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:25.769+0000 7f419c2fe640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f419406bd20 con 0x7f41941615c0 2023-11-13T18:41:25.779 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:25.769+0000 7f419c2fe640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f419406cae0 con 0x7f41940ade90 2023-11-13T18:41:25.780 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:25.769+0000 7f419a89b640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f41940ade90 0x7f419416c3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T18:41:25.781 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:25.769+0000 7f4199899640 1 --1- >> v1:172.21.15.102:6789/0 conn(0x7f41940cf2d0 0x7f41940ad780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.102:6789/0 says I am v1:172.21.15.102:59440/0 (socket says 172.21.15.102:59440) 2023-11-13T18:41:25.781 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:25.769+0000 7f4199899640 1 -- 172.21.15.102:0/1936979778 learned_addr learned my addr 172.21.15.102:0/1936979778 (peer_addr_for_me v1:172.21.15.102:0/0) 2023-11-13T18:41:25.781 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:25.773+0000 7f419a89b640 1 -- 172.21.15.102:0/1936979778 >> v1:172.21.15.154:6789/0 conn(0x7f41941615c0 legacy=0x7f41940cebc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T18:41:25.782 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:25.773+0000 7f419a89b640 1 -- 172.21.15.102:0/1936979778 >> v1:172.21.15.102:6789/0 conn(0x7f41940cf2d0 legacy=0x7f41940ad780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T18:41:25.782 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:25.773+0000 7f419a89b640 1 -- 172.21.15.102:0/1936979778 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f419406c000 con 0x7f41940ade90 2023-11-13T18:41:25.783 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:25.773+0000 7f419a89b640 1 --2- 172.21.15.102:0/1936979778 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f41940ade90 0x7f419416c3a0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f418c009dc0 tx=0x7f418c01c970 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f678d9bf166148c server_cookie=0 in_seq=0 out_seq=0 2023-11-13T18:41:25.784 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:25.773+0000 7f4199098640 1 -- 172.21.15.102:0/1936979778 <== mon.2 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f418c0a5a30 con 0x7f41940ade90 2023-11-13T18:41:25.784 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:25.773+0000 7f4199098640 1 -- 172.21.15.102:0/1936979778 <== mon.2 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f418c0a5b90 con 0x7f41940ade90 2023-11-13T18:41:25.785 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:25.773+0000 7f4199098640 1 -- 172.21.15.102:0/1936979778 <== mon.2 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f418c0ad440 con 0x7f41940ade90 2023-11-13T18:41:25.785 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:25.777+0000 7f419c2fe640 1 -- 172.21.15.102:0/1936979778 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f41940ade90 msgr2=0x7f419416c3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T18:41:25.785 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:25.777+0000 7f419c2fe640 1 --2- 172.21.15.102:0/1936979778 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f41940ade90 0x7f419416c3a0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f418c009dc0 tx=0x7f418c01c970 comp rx=0 tx=0).stop 2023-11-13T18:41:25.787 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:25.777+0000 7f419c2fe640 1 -- 172.21.15.102:0/1936979778 shutdown_connections 2023-11-13T18:41:25.787 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:25.777+0000 7f419c2fe640 1 --2- 172.21.15.102:0/1936979778 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f41940ade90 0x7f419416c3a0 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T18:41:25.787 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:25.777+0000 7f419c2fe640 1 -- 172.21.15.102:0/1936979778 >> 172.21.15.102:0/1936979778 conn(0x7f419406a410 msgr2=0x7f419406a820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-13T18:41:25.788 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:25.777+0000 7f419c2fe640 1 -- 172.21.15.102:0/1936979778 shutdown_connections 2023-11-13T18:41:25.788 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:25.777+0000 7f419c2fe640 1 -- 172.21.15.102:0/1936979778 wait complete. 2023-11-13T18:41:25.788 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:25.777+0000 7f419c2fe640 1 Processor -- start 2023-11-13T18:41:25.788 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:25.777+0000 7f419c2fe640 1 -- start start 2023-11-13T18:41:25.791 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:25.781+0000 7f419c2fe640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f41940ade90 0x7f4194162a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T18:41:25.792 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:25.781+0000 7f419c2fe640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f41940cf2d0 0x7f4194164330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T18:41:25.792 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:25.781+0000 7f419c2fe640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f41941615c0 0x7f419414fa80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T18:41:25.792 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:25.781+0000 7f419c2fe640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4194161c60 con 0x7f41940cf2d0 2023-11-13T18:41:25.792 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:25.781+0000 7f419c2fe640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4194161f40 con 0x7f41941615c0 2023-11-13T18:41:25.793 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:25.781+0000 7f419c2fe640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4194162220 con 0x7f41940ade90 2023-11-13T18:41:25.793 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:25.781+0000 7f4199899640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f41940cf2d0 0x7f4194164330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T18:41:25.793 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:25.781+0000 7f4199899640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f41940cf2d0 0x7f4194164330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:34418/0 (socket says 172.21.15.102:34418) 2023-11-13T18:41:25.793 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:25.781+0000 7f4199899640 1 -- 172.21.15.102:0/3618296735 learned_addr learned my addr 172.21.15.102:0/3618296735 (peer_addr_for_me v2:172.21.15.102:0/0) 2023-11-13T18:41:25.794 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:25.781+0000 7f419a89b640 1 --2- 172.21.15.102:0/3618296735 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f41941615c0 0x7f419414fa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T18:41:25.794 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:25.781+0000 7f419a09a640 1 --2- 172.21.15.102:0/3618296735 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f41940ade90 0x7f4194162a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T18:41:25.794 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:25.781+0000 7f4199899640 1 -- 172.21.15.102:0/3618296735 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f41940ade90 msgr2=0x7f4194162a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T18:41:25.794 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:25.781+0000 7f4199899640 1 --2- 172.21.15.102:0/3618296735 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f41940ade90 0x7f4194162a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T18:41:25.795 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:25.781+0000 7f4199899640 1 -- 172.21.15.102:0/3618296735 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f41941615c0 msgr2=0x7f419414fa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T18:41:25.795 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:25.781+0000 7f4199899640 1 --2- 172.21.15.102:0/3618296735 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f41941615c0 0x7f419414fa80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T18:41:25.795 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:25.781+0000 7f4199899640 1 -- 172.21.15.102:0/3618296735 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f418c009a70 con 0x7f41940cf2d0 2023-11-13T18:41:25.795 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:25.781+0000 7f419a09a640 1 --2- 172.21.15.102:0/3618296735 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f41940ade90 0x7f4194162a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-13T18:41:25.796 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:25.781+0000 7f4199899640 1 --2- 172.21.15.102:0/3618296735 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f41940cf2d0 0x7f4194164330 secure :-1 s=READY pgs=1938 cs=0 l=1 rev1=1 crypto rx=0x7f418400c500 tx=0x7f418400c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-13T18:41:25.796 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:25.781+0000 7f418affd640 1 -- 172.21.15.102:0/3618296735 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4184005cf0 con 0x7f41940cf2d0 2023-11-13T18:41:25.796 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:25.781+0000 7f418affd640 1 -- 172.21.15.102:0/3618296735 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4184005e50 con 0x7f41940cf2d0 2023-11-13T18:41:25.797 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:25.781+0000 7f419c2fe640 1 -- 172.21.15.102:0/3618296735 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4194162500 con 0x7f41940cf2d0 2023-11-13T18:41:25.797 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:25.781+0000 7f418affd640 1 -- 172.21.15.102:0/3618296735 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41840072f0 con 0x7f41940cf2d0 2023-11-13T18:41:25.797 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:25.781+0000 7f419c2fe640 1 -- 172.21.15.102:0/3618296735 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4194162f60 con 0x7f41940cf2d0 2023-11-13T18:41:25.798 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:25.785+0000 7f419c2fe640 1 -- 172.21.15.102:0/3618296735 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4194162740 con 0x7f41940cf2d0 2023-11-13T18:41:25.804 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:25.797+0000 7f418affd640 1 -- 172.21.15.102:0/3618296735 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f4184007450 con 0x7f41940cf2d0 2023-11-13T18:41:25.807 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:25.797+0000 7f418affd640 1 --2- 172.21.15.102:0/3618296735 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f4178066470 0x7f4178068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T18:41:25.807 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:25.797+0000 7f418affd640 1 -- 172.21.15.102:0/3618296735 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 5911+0+0 (secure 0 0 0) 0x7f4184083720 con 0x7f41940cf2d0 2023-11-13T18:41:25.807 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:25.797+0000 7f419a09a640 1 --2- 172.21.15.102:0/3618296735 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f4178066470 0x7f4178068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T18:41:25.808 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:25.797+0000 7f418affd640 1 -- 172.21.15.102:0/3618296735 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f4184083ab0 con 0x7f41940cf2d0 2023-11-13T18:41:25.808 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:25.801+0000 7f419a09a640 1 --2- 172.21.15.102:0/3618296735 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f4178066470 0x7f4178068930 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 crypto rx=0x7f4194160f10 tx=0x7f4190009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-13T18:41:26.370 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:26.361+0000 7f419c2fe640 1 -- 172.21.15.102:0/3618296735 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f4194067640 con 0x7f41940cf2d0 2023-11-13T18:41:27.357 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:27.349+0000 7f418affd640 1 -- 172.21.15.102:0/3618296735 <== mon.0 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v19) v1 ==== 104+0+0 (secure 0 0 0) 0x7f4184050bf0 con 0x7f41940cf2d0 2023-11-13T18:41:27.362 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:27.353+0000 7f419c2fe640 1 -- 172.21.15.102:0/3618296735 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f4178066470 msgr2=0x7f4178068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T18:41:27.363 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:27.353+0000 7f419c2fe640 1 --2- 172.21.15.102:0/3618296735 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f4178066470 0x7f4178068930 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 crypto rx=0x7f4194160f10 tx=0x7f4190009040 comp rx=0 tx=0).stop 2023-11-13T18:41:27.363 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:27.353+0000 7f419c2fe640 1 -- 172.21.15.102:0/3618296735 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f41940cf2d0 msgr2=0x7f4194164330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T18:41:27.363 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:27.353+0000 7f419c2fe640 1 --2- 172.21.15.102:0/3618296735 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f41940cf2d0 0x7f4194164330 secure :-1 s=READY pgs=1938 cs=0 l=1 rev1=1 crypto rx=0x7f418400c500 tx=0x7f418400c9c0 comp rx=0 tx=0).stop 2023-11-13T18:41:27.363 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:27.353+0000 7f419c2fe640 1 -- 172.21.15.102:0/3618296735 shutdown_connections 2023-11-13T18:41:27.363 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:27.353+0000 7f419c2fe640 1 --2- 172.21.15.102:0/3618296735 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f41941615c0 0x7f419414fa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T18:41:27.364 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:27.353+0000 7f419c2fe640 1 --2- 172.21.15.102:0/3618296735 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f4178066470 0x7f4178068930 unknown :-1 s=CLOSED pgs=744 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T18:41:27.364 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:27.353+0000 7f419c2fe640 1 --2- 172.21.15.102:0/3618296735 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f41940cf2d0 0x7f4194164330 unknown :-1 s=CLOSED pgs=1938 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T18:41:27.364 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:27.353+0000 7f419c2fe640 1 --2- 172.21.15.102:0/3618296735 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f41940ade90 0x7f4194162a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T18:41:27.364 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:27.353+0000 7f419c2fe640 1 -- 172.21.15.102:0/3618296735 >> 172.21.15.102:0/3618296735 conn(0x7f419406a410 msgr2=0x7f41940b3620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-13T18:41:27.364 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:27.353+0000 7f419c2fe640 1 -- 172.21.15.102:0/3618296735 shutdown_connections 2023-11-13T18:41:27.365 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:27.353+0000 7f419c2fe640 1 -- 172.21.15.102:0/3618296735 wait complete. 2023-11-13T18:41:27.413 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-11-13T18:41:27.815 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:27.805+0000 7fada385a640 1 Processor -- start 2023-11-13T18:41:27.816 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:27.809+0000 7fada385a640 1 -- start start 2023-11-13T18:41:27.819 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:27.809+0000 7fada385a640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fad9c160970 0x7fad9c0d18b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T18:41:27.820 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:27.813+0000 7fada385a640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fad9c0d1df0 con 0x7fad9c0d0e10 2023-11-13T18:41:27.820 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:27.813+0000 7fada385a640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fad9c0b5c20 con 0x7fad9c0d11f0 2023-11-13T18:41:27.820 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:27.813+0000 7fada385a640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fad9c0b45c0 con 0x7fad9c160970 2023-11-13T18:41:27.820 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:27.813+0000 7fada15f6640 1 --1- >> v1:172.21.15.102:6789/0 conn(0x7fad9c0d0e10 0x7fad9c160260 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.102:6789/0 says I am v1:172.21.15.102:36670/0 (socket says 172.21.15.102:36670) 2023-11-13T18:41:27.821 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:27.813+0000 7fada15f6640 1 -- 172.21.15.102:0/1102318275 learned_addr learned my addr 172.21.15.102:0/1102318275 (peer_addr_for_me v1:172.21.15.102:0/0) 2023-11-13T18:41:27.821 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:27.813+0000 7fada0df5640 1 --2- 172.21.15.102:0/1102318275 >> v2:172.21.15.154:3300/0 conn(0x7fad9c160970 0x7fad9c0d18b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T18:41:27.822 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:27.813+0000 7fad93fff640 1 -- 172.21.15.102:0/1102318275 <== mon.1 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2947338641 0 0) 0x7fad9c0b5c20 con 0x7fad9c0d11f0 2023-11-13T18:41:27.822 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:27.813+0000 7fad93fff640 1 -- 172.21.15.102:0/1102318275 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fad88003530 con 0x7fad9c0d11f0 2023-11-13T18:41:27.822 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:27.813+0000 7fada0df5640 1 -- 172.21.15.102:0/1102318275 >> v1:172.21.15.154:6789/0 conn(0x7fad9c0d11f0 legacy=0x7fad9c0b60b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T18:41:27.822 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:27.813+0000 7fad93fff640 1 -- 172.21.15.102:0/1102318275 <== mon.0 v1:172.21.15.102:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1609989315 0 0) 0x7fad9c0d1df0 con 0x7fad9c0d0e10 2023-11-13T18:41:27.823 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:27.813+0000 7fada0df5640 1 -- 172.21.15.102:0/1102318275 >> v1:172.21.15.102:6789/0 conn(0x7fad9c0d0e10 legacy=0x7fad9c160260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T18:41:27.823 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:27.813+0000 7fada0df5640 1 -- 172.21.15.102:0/1102318275 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad9c0cff70 con 0x7fad9c160970 2023-11-13T18:41:27.830 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:27.821+0000 7fada0df5640 1 --2- 172.21.15.102:0/1102318275 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fad9c160970 0x7fad9c0d18b0 secure :-1 s=READY pgs=906 cs=0 l=1 rev1=1 crypto rx=0x7fad8c0097c0 tx=0x7fad8c01ec70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=85539d2ed39c8f3e server_cookie=0 in_seq=0 out_seq=0 2023-11-13T18:41:27.830 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:27.821+0000 7fad93fff640 1 -- 172.21.15.102:0/1102318275 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad8c0a8970 con 0x7fad9c160970 2023-11-13T18:41:27.831 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:27.821+0000 7fad93fff640 1 -- 172.21.15.102:0/1102318275 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad8c0a8ad0 con 0x7fad9c160970 2023-11-13T18:41:27.831 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:27.821+0000 7fad93fff640 1 -- 172.21.15.102:0/1102318275 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad8c0a8e60 con 0x7fad9c160970 2023-11-13T18:41:27.832 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:27.825+0000 7fada385a640 1 -- 172.21.15.102:0/1102318275 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fad9c160970 msgr2=0x7fad9c0d18b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T18:41:27.832 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:27.825+0000 7fada385a640 1 --2- 172.21.15.102:0/1102318275 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fad9c160970 0x7fad9c0d18b0 secure :-1 s=READY pgs=906 cs=0 l=1 rev1=1 crypto rx=0x7fad8c0097c0 tx=0x7fad8c01ec70 comp rx=0 tx=0).stop 2023-11-13T18:41:27.832 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:27.825+0000 7fada385a640 1 -- 172.21.15.102:0/1102318275 shutdown_connections 2023-11-13T18:41:27.833 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:27.825+0000 7fada385a640 1 --2- 172.21.15.102:0/1102318275 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fad9c160970 0x7fad9c0d18b0 unknown :-1 s=CLOSED pgs=906 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T18:41:27.833 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:27.825+0000 7fada385a640 1 -- 172.21.15.102:0/1102318275 >> 172.21.15.102:0/1102318275 conn(0x7fad9c0d2dd0 msgr2=0x7fad9c0d31e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-13T18:41:27.833 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:27.825+0000 7fada385a640 1 -- 172.21.15.102:0/1102318275 shutdown_connections 2023-11-13T18:41:27.833 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:27.825+0000 7fada385a640 1 -- 172.21.15.102:0/1102318275 wait complete. 2023-11-13T18:41:27.837 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:27.829+0000 7fada385a640 1 Processor -- start 2023-11-13T18:41:27.837 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:27.829+0000 7fada385a640 1 -- start start 2023-11-13T18:41:27.840 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:27.833+0000 7fada385a640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fad9c0d0e10 0x7fad9c1f64b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T18:41:27.840 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:27.833+0000 7fada385a640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fad9c0d11f0 0x7fad9c0afa20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T18:41:27.841 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:27.833+0000 7fada385a640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fad9c0aff60 0x7fad9c0cb480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T18:41:27.841 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:27.833+0000 7fada385a640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad9c0b2e20 con 0x7fad9c0aff60 2023-11-13T18:41:27.841 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:27.833+0000 7fada385a640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad9c09e010 con 0x7fad9c0d0e10 2023-11-13T18:41:27.841 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:27.833+0000 7fada385a640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad9c0b2580 con 0x7fad9c0d11f0 2023-11-13T18:41:27.842 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:27.833+0000 7fada1df7640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fad9c0aff60 0x7fad9c0cb480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T18:41:27.843 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:27.833+0000 7fada1df7640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fad9c0aff60 0x7fad9c0cb480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:54864/0 (socket says 172.21.15.102:54864) 2023-11-13T18:41:27.843 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:27.833+0000 7fada1df7640 1 -- 172.21.15.102:0/2310761722 learned_addr learned my addr 172.21.15.102:0/2310761722 (peer_addr_for_me v2:172.21.15.102:0/0) 2023-11-13T18:41:27.843 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:27.833+0000 7fada15f6640 1 --2- 172.21.15.102:0/2310761722 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fad9c0d0e10 0x7fad9c1f64b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T18:41:27.843 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:27.833+0000 7fada0df5640 1 --2- 172.21.15.102:0/2310761722 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fad9c0d11f0 0x7fad9c0afa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T18:41:27.843 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:27.833+0000 7fada1df7640 1 -- 172.21.15.102:0/2310761722 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fad9c0d11f0 msgr2=0x7fad9c0afa20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T18:41:27.844 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:27.833+0000 7fada1df7640 1 --2- 172.21.15.102:0/2310761722 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fad9c0d11f0 0x7fad9c0afa20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T18:41:27.844 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:27.833+0000 7fada1df7640 1 -- 172.21.15.102:0/2310761722 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fad9c0d0e10 msgr2=0x7fad9c1f64b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T18:41:27.844 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:27.833+0000 7fada1df7640 1 --2- 172.21.15.102:0/2310761722 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fad9c0d0e10 0x7fad9c1f64b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T18:41:27.844 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:27.833+0000 7fada1df7640 1 -- 172.21.15.102:0/2310761722 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad8c009420 con 0x7fad9c0aff60 2023-11-13T18:41:27.844 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:27.833+0000 7fada1df7640 1 --2- 172.21.15.102:0/2310761722 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fad9c0aff60 0x7fad9c0cb480 secure :-1 s=READY pgs=1940 cs=0 l=1 rev1=1 crypto rx=0x7fad9400c730 tx=0x7fad9400cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-13T18:41:27.845 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:27.833+0000 7fad91ffb640 1 -- 172.21.15.102:0/2310761722 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad94003b80 con 0x7fad9c0aff60 2023-11-13T18:41:27.845 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:27.833+0000 7fad91ffb640 1 -- 172.21.15.102:0/2310761722 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad94003ce0 con 0x7fad9c0aff60 2023-11-13T18:41:27.846 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:27.833+0000 7fad91ffb640 1 -- 172.21.15.102:0/2310761722 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad9400aa90 con 0x7fad9c0aff60 2023-11-13T18:41:27.846 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:27.833+0000 7fada385a640 1 -- 172.21.15.102:0/2310761722 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fad9c0b2860 con 0x7fad9c0aff60 2023-11-13T18:41:27.846 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:27.837+0000 7fada385a640 1 -- 172.21.15.102:0/2310761722 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fad9c1f69f0 con 0x7fad9c0aff60 2023-11-13T18:41:27.846 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:27.837+0000 7fada385a640 1 -- 172.21.15.102:0/2310761722 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fad9c09dde0 con 0x7fad9c0aff60 2023-11-13T18:41:27.848 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:27.841+0000 7fad91ffb640 1 -- 172.21.15.102:0/2310761722 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fad9400abf0 con 0x7fad9c0aff60 2023-11-13T18:41:27.850 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:27.841+0000 7fad91ffb640 1 --2- 172.21.15.102:0/2310761722 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7fad800664a0 0x7fad80068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T18:41:27.851 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:27.841+0000 7fad91ffb640 1 -- 172.21.15.102:0/2310761722 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 5911+0+0 (secure 0 0 0) 0x7fad94083c50 con 0x7fad9c0aff60 2023-11-13T18:41:27.851 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:27.841+0000 7fada15f6640 1 --2- 172.21.15.102:0/2310761722 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7fad800664a0 0x7fad80068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T18:41:27.852 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:27.845+0000 7fada15f6640 1 --2- 172.21.15.102:0/2310761722 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7fad800664a0 0x7fad80068960 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 crypto rx=0x7fad98001120 tx=0x7fad98001090 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-13T18:41:27.862 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:27.853+0000 7fad91ffb640 1 -- 172.21.15.102:0/2310761722 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fad9c09dde0 con 0x7fad9c0aff60 2023-11-13T18:41:28.351 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:28.341+0000 7fada385a640 1 -- 172.21.15.102:0/2310761722 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fad9c09dde0 con 0x7fad9c0aff60 2023-11-13T18:41:29.363 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:29.353+0000 7fad91ffb640 1 -- 172.21.15.102:0/2310761722 <== mon.0 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v40) v1 ==== 181+0+0 (secure 0 0 0) 0x7fad9c09dde0 con 0x7fad9c0aff60 2023-11-13T18:41:29.363 INFO:teuthology.orchestra.run.smithi102.stderr:pool 'cephfs_metadata' removed 2023-11-13T18:41:29.367 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:29.357+0000 7fada385a640 1 -- 172.21.15.102:0/2310761722 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7fad800664a0 msgr2=0x7fad80068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T18:41:29.368 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:29.357+0000 7fada385a640 1 --2- 172.21.15.102:0/2310761722 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7fad800664a0 0x7fad80068960 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 crypto rx=0x7fad98001120 tx=0x7fad98001090 comp rx=0 tx=0).stop 2023-11-13T18:41:29.368 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:29.357+0000 7fada385a640 1 -- 172.21.15.102:0/2310761722 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fad9c0aff60 msgr2=0x7fad9c0cb480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T18:41:29.368 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:29.357+0000 7fada385a640 1 --2- 172.21.15.102:0/2310761722 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fad9c0aff60 0x7fad9c0cb480 secure :-1 s=READY pgs=1940 cs=0 l=1 rev1=1 crypto rx=0x7fad9400c730 tx=0x7fad9400cbf0 comp rx=0 tx=0).stop 2023-11-13T18:41:29.368 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:29.361+0000 7fada385a640 1 -- 172.21.15.102:0/2310761722 shutdown_connections 2023-11-13T18:41:29.369 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:29.361+0000 7fada385a640 1 --2- 172.21.15.102:0/2310761722 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7fad800664a0 0x7fad80068960 unknown :-1 s=CLOSED pgs=747 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T18:41:29.369 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:29.361+0000 7fada385a640 1 --2- 172.21.15.102:0/2310761722 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fad9c0aff60 0x7fad9c0cb480 unknown :-1 s=CLOSED pgs=1940 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T18:41:29.369 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:29.361+0000 7fada385a640 1 --2- 172.21.15.102:0/2310761722 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fad9c0d11f0 0x7fad9c0afa20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T18:41:29.369 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:29.361+0000 7fada385a640 1 --2- 172.21.15.102:0/2310761722 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fad9c0d0e10 0x7fad9c1f64b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T18:41:29.369 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:29.361+0000 7fada385a640 1 -- 172.21.15.102:0/2310761722 >> 172.21.15.102:0/2310761722 conn(0x7fad9c0d2dd0 msgr2=0x7fad9c15ead0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-13T18:41:29.370 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:29.361+0000 7fada385a640 1 -- 172.21.15.102:0/2310761722 shutdown_connections 2023-11-13T18:41:29.370 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:29.361+0000 7fada385a640 1 -- 172.21.15.102:0/2310761722 wait complete. 2023-11-13T18:41:29.421 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-11-13T18:41:29.724 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:29.713+0000 7f030669a640 1 Processor -- start 2023-11-13T18:41:29.724 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:29.717+0000 7f030669a640 1 -- start start 2023-11-13T18:41:29.735 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:29.729+0000 7f030669a640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0300144310 0x7f030006bc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T18:41:29.738 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:29.729+0000 7f02fffff640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0300144310 0x7f030006bc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T18:41:29.738 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:29.729+0000 7f02fffff640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0300144310 0x7f030006bc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.102:36834/0 (socket says 172.21.15.102:36834) 2023-11-13T18:41:29.743 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:29.737+0000 7f02fffff640 1 -- 172.21.15.102:0/115267337 learned_addr learned my addr 172.21.15.102:0/115267337 (peer_addr_for_me v2:172.21.15.102:0/0) 2023-11-13T18:41:29.745 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:29.737+0000 7f030669a640 1 -- 172.21.15.102:0/115267337 --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f03000cd8e0 con 0x7f03001446f0 2023-11-13T18:41:29.745 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:29.737+0000 7f030669a640 1 -- 172.21.15.102:0/115267337 --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f03000b1a30 con 0x7f030015e810 2023-11-13T18:41:29.745 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:29.737+0000 7f030669a640 1 -- 172.21.15.102:0/115267337 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f030015f710 con 0x7f0300144310 2023-11-13T18:41:29.748 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:29.737+0000 7f02fffff640 1 -- 172.21.15.102:0/115267337 >> v1:172.21.15.154:6789/0 conn(0x7f030015e810 legacy=0x7f03000b21c0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-11-13T18:41:29.748 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:29.737+0000 7f02fffff640 1 -- 172.21.15.102:0/115267337 >> v1:172.21.15.102:6789/0 conn(0x7f03001446f0 legacy=0x7f03000b36e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T18:41:29.748 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:29.737+0000 7f02fffff640 1 -- 172.21.15.102:0/115267337 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03000cdb30 con 0x7f0300144310 2023-11-13T18:41:29.753 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:29.745+0000 7f02fffff640 1 --2- 172.21.15.102:0/115267337 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0300144310 0x7f030006bc60 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f02f40098a0 tx=0x7f02f401c4f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c688b59758741ec8 server_cookie=0 in_seq=0 out_seq=0 2023-11-13T18:41:29.754 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:29.745+0000 7f02feffd640 1 -- 172.21.15.102:0/115267337 <== mon.2 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02f40aa610 con 0x7f0300144310 2023-11-13T18:41:29.755 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:29.745+0000 7f02feffd640 1 -- 172.21.15.102:0/115267337 <== mon.2 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f02f40a6040 con 0x7f0300144310 2023-11-13T18:41:29.755 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:29.745+0000 7f02feffd640 1 -- 172.21.15.102:0/115267337 <== mon.2 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02f40aa990 con 0x7f0300144310 2023-11-13T18:41:29.755 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:29.745+0000 7f030669a640 1 -- 172.21.15.102:0/115267337 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0300144310 msgr2=0x7f030006bc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T18:41:29.755 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:29.745+0000 7f030669a640 1 --2- 172.21.15.102:0/115267337 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0300144310 0x7f030006bc60 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f02f40098a0 tx=0x7f02f401c4f0 comp rx=0 tx=0).stop 2023-11-13T18:41:29.757 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:29.745+0000 7f030669a640 1 -- 172.21.15.102:0/115267337 shutdown_connections 2023-11-13T18:41:29.757 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:29.745+0000 7f030669a640 1 --2- 172.21.15.102:0/115267337 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0300144310 0x7f030006bc60 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T18:41:29.757 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:29.745+0000 7f030669a640 1 -- 172.21.15.102:0/115267337 >> 172.21.15.102:0/115267337 conn(0x7f03000b0690 msgr2=0x7f03000b0aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-13T18:41:29.758 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:29.745+0000 7f030669a640 1 -- 172.21.15.102:0/115267337 shutdown_connections 2023-11-13T18:41:29.758 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:29.745+0000 7f030669a640 1 -- 172.21.15.102:0/115267337 wait complete. 2023-11-13T18:41:29.761 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:29.749+0000 7f030669a640 1 Processor -- start 2023-11-13T18:41:29.762 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:29.749+0000 7f030669a640 1 -- start start 2023-11-13T18:41:29.762 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:29.753+0000 7f030669a640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0300144310 0x7f03001fd8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T18:41:29.762 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:29.753+0000 7f030669a640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f03001446f0 0x7f03001fde00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T18:41:29.763 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:29.753+0000 7f030669a640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f030015e810 0x7f030015d2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T18:41:29.763 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:29.753+0000 7f030669a640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03001fb490 con 0x7f03001446f0 2023-11-13T18:41:29.763 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:29.753+0000 7f030669a640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03001fb6e0 con 0x7f030015e810 2023-11-13T18:41:29.764 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:29.753+0000 7f030669a640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f03001fb9c0 con 0x7f0300144310 2023-11-13T18:41:29.764 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:29.753+0000 7f0304c37640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f030015e810 0x7f030015d2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T18:41:29.764 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:29.753+0000 7f0304c37640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f030015e810 0x7f030015d2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.102:56268/0 (socket says 172.21.15.102:56268) 2023-11-13T18:41:29.765 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:29.753+0000 7f0304c37640 1 -- 172.21.15.102:0/793871326 learned_addr learned my addr 172.21.15.102:0/793871326 (peer_addr_for_me v2:172.21.15.102:0/0) 2023-11-13T18:41:29.765 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:29.757+0000 7f02fffff640 1 --2- 172.21.15.102:0/793871326 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0300144310 0x7f03001fd8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T18:41:29.767 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:29.757+0000 7f0304c37640 1 -- 172.21.15.102:0/793871326 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0300144310 msgr2=0x7f03001fd8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T18:41:29.768 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:29.761+0000 7f02ff7fe640 1 --2- 172.21.15.102:0/793871326 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f03001446f0 0x7f03001fde00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T18:41:29.770 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:29.761+0000 7f0304c37640 1 --2- 172.21.15.102:0/793871326 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0300144310 0x7f03001fd8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T18:41:29.770 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:29.761+0000 7f0304c37640 1 -- 172.21.15.102:0/793871326 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f03001446f0 msgr2=0x7f03001fde00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T18:41:29.770 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:29.761+0000 7f0304c37640 1 --2- 172.21.15.102:0/793871326 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f03001446f0 0x7f03001fde00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T18:41:29.771 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:29.761+0000 7f0304c37640 1 -- 172.21.15.102:0/793871326 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02f40094d0 con 0x7f030015e810 2023-11-13T18:41:29.771 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:29.761+0000 7f02ff7fe640 1 --2- 172.21.15.102:0/793871326 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f03001446f0 0x7f03001fde00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-13T18:41:29.771 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:29.761+0000 7f02fffff640 1 --2- 172.21.15.102:0/793871326 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0300144310 0x7f03001fd8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-13T18:41:29.773 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:29.765+0000 7f0304c37640 1 --2- 172.21.15.102:0/793871326 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f030015e810 0x7f030015d2b0 secure :-1 s=READY pgs=907 cs=0 l=1 rev1=1 crypto rx=0x7f02f800b990 tx=0x7f02f800be50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-13T18:41:29.774 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:29.765+0000 7f02fcff9640 1 -- 172.21.15.102:0/793871326 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02f800cba0 con 0x7f030015e810 2023-11-13T18:41:29.774 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:29.765+0000 7f030669a640 1 -- 172.21.15.102:0/793871326 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f03001fbca0 con 0x7f030015e810 2023-11-13T18:41:29.775 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:29.765+0000 7f030669a640 1 -- 172.21.15.102:0/793871326 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f030015d7f0 con 0x7f030015e810 2023-11-13T18:41:29.777 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:29.769+0000 7f02fcff9640 1 -- 172.21.15.102:0/793871326 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f02f800cd00 con 0x7f030015e810 2023-11-13T18:41:29.777 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:29.769+0000 7f02fcff9640 1 -- 172.21.15.102:0/793871326 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02f800cba0 con 0x7f030015e810 2023-11-13T18:41:29.778 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:29.769+0000 7f030669a640 1 -- 172.21.15.102:0/793871326 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0300067b50 con 0x7f030015e810 2023-11-13T18:41:29.782 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:29.769+0000 7f02fcff9640 1 -- 172.21.15.102:0/793871326 <== mon.1 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f02f801d3b0 con 0x7f030015e810 2023-11-13T18:41:29.784 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:29.773+0000 7f02fcff9640 1 --2- 172.21.15.102:0/793871326 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f02e40664d0 0x7f02e4068990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T18:41:29.788 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:29.781+0000 7f02fffff640 1 --2- 172.21.15.102:0/793871326 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f02e40664d0 0x7f02e4068990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T18:41:29.796 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:29.781+0000 7f02fcff9640 1 -- 172.21.15.102:0/793871326 <== mon.1 v2:172.21.15.154:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 5473+0+0 (secure 0 0 0) 0x7f02f8083910 con 0x7f030015e810 2023-11-13T18:41:29.797 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:29.789+0000 7f02fcff9640 1 -- 172.21.15.102:0/793871326 <== mon.1 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f02f8050f10 con 0x7f030015e810 2023-11-13T18:41:29.801 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:29.793+0000 7f02fffff640 1 --2- 172.21.15.102:0/793871326 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f02e40664d0 0x7f02e4068990 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 crypto rx=0x7f02f40ae000 tx=0x7f02f40b5040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-13T18:41:30.176 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:30.169+0000 7f030669a640 1 -- 172.21.15.102:0/793871326 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f03001fb820 con 0x7f030015e810 2023-11-13T18:41:30.422 INFO:teuthology.orchestra.run.smithi102.stderr:pool 'cephfs_data' removed 2023-11-13T18:41:30.423 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:30.409+0000 7f02fcff9640 1 -- 172.21.15.102:0/793871326 <== mon.1 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v41) v1 ==== 169+0+0 (secure 0 0 0) 0x7f03001fb820 con 0x7f030015e810 2023-11-13T18:41:30.429 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:30.421+0000 7f030669a640 1 -- 172.21.15.102:0/793871326 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f02e40664d0 msgr2=0x7f02e4068990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T18:41:30.430 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:30.421+0000 7f030669a640 1 --2- 172.21.15.102:0/793871326 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f02e40664d0 0x7f02e4068990 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 crypto rx=0x7f02f40ae000 tx=0x7f02f40b5040 comp rx=0 tx=0).stop 2023-11-13T18:41:30.430 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:30.421+0000 7f030669a640 1 -- 172.21.15.102:0/793871326 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f030015e810 msgr2=0x7f030015d2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T18:41:30.430 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:30.421+0000 7f030669a640 1 --2- 172.21.15.102:0/793871326 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f030015e810 0x7f030015d2b0 secure :-1 s=READY pgs=907 cs=0 l=1 rev1=1 crypto rx=0x7f02f800b990 tx=0x7f02f800be50 comp rx=0 tx=0).stop 2023-11-13T18:41:30.434 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:30.425+0000 7f030669a640 1 -- 172.21.15.102:0/793871326 shutdown_connections 2023-11-13T18:41:30.434 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:30.425+0000 7f030669a640 1 --2- 172.21.15.102:0/793871326 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f030015e810 0x7f030015d2b0 unknown :-1 s=CLOSED pgs=907 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T18:41:30.434 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:30.425+0000 7f030669a640 1 --2- 172.21.15.102:0/793871326 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f02e40664d0 0x7f02e4068990 unknown :-1 s=CLOSED pgs=748 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T18:41:30.435 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:30.425+0000 7f030669a640 1 --2- 172.21.15.102:0/793871326 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f03001446f0 0x7f03001fde00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T18:41:30.435 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:30.425+0000 7f030669a640 1 --2- 172.21.15.102:0/793871326 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0300144310 0x7f03001fd8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T18:41:30.436 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:30.425+0000 7f030669a640 1 -- 172.21.15.102:0/793871326 >> 172.21.15.102:0/793871326 conn(0x7f03000b0690 msgr2=0x7f03000716f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-13T18:41:30.442 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:30.433+0000 7f030669a640 1 -- 172.21.15.102:0/793871326 shutdown_connections 2023-11-13T18:41:30.444 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:30.437+0000 7f030669a640 1 -- 172.21.15.102:0/793871326 wait complete. 2023-11-13T18:41:30.656 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-11-13T18:41:31.384 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:31.373+0000 7f62730c8640 1 Processor -- start 2023-11-13T18:41:31.385 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:31.377+0000 7f62730c8640 1 -- start start 2023-11-13T18:41:31.400 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:31.385+0000 7f62720c6640 1 --1- >> v1:172.21.15.102:6789/0 conn(0x7f626c153a70 0x7f626c15da20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.102:6789/0 says I am v1:172.21.15.102:36690/0 (socket says 172.21.15.102:36690) 2023-11-13T18:41:31.401 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:31.385+0000 7f62720c6640 1 -- 172.21.15.102:0/1608640425 learned_addr learned my addr 172.21.15.102:0/1608640425 (peer_addr_for_me v1:172.21.15.102:0/0) 2023-11-13T18:41:31.401 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:31.385+0000 7f62730c8640 1 --2- 172.21.15.102:0/1608640425 >> v2:172.21.15.102:3300/0 conn(0x7f626c0b1b90 0x7f626c153e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T18:41:31.401 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:31.385+0000 7f62718c5640 1 --2- 172.21.15.102:0/1608640425 >> v2:172.21.15.102:3300/0 conn(0x7f626c0b1b90 0x7f626c153e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T18:41:31.401 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:31.389+0000 7f62730c8640 1 -- 172.21.15.102:0/1608640425 --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f626c071c00 con 0x7f626c153a70 2023-11-13T18:41:31.402 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:31.389+0000 7f62710c4640 1 -- 172.21.15.102:0/1608640425 <== mon.0 v1:172.21.15.102:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 877096523 0 0) 0x7f626c071c00 con 0x7f626c153a70 2023-11-13T18:41:31.402 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:31.389+0000 7f62730c8640 1 -- 172.21.15.102:0/1608640425 --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f626c161080 con 0x7f626c160900 2023-11-13T18:41:31.402 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:31.389+0000 7f62730c8640 1 -- 172.21.15.102:0/1608640425 --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f626c15d310 con 0x7f626c0b1b90 2023-11-13T18:41:31.403 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:31.389+0000 7f62710c4640 1 -- 172.21.15.102:0/1608640425 --> v1:172.21.15.102:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6258003530 con 0x7f626c153a70 2023-11-13T18:41:31.403 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:31.393+0000 7f62710c4640 1 -- 172.21.15.102:0/1608640425 <== mon.0 v1:172.21.15.102:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4091710896 0 0) 0x7f6258003530 con 0x7f626c153a70 2023-11-13T18:41:31.403 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:31.393+0000 7f62710c4640 1 -- 172.21.15.102:0/1608640425 >> v2:172.21.15.102:3300/0 conn(0x7f626c0b1b90 msgr2=0x7f626c153e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-13T18:41:31.403 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:31.393+0000 7f62710c4640 1 --2- 172.21.15.102:0/1608640425 >> v2:172.21.15.102:3300/0 conn(0x7f626c0b1b90 0x7f626c153e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T18:41:31.404 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:31.393+0000 7f62710c4640 1 -- 172.21.15.102:0/1608640425 >> v1:172.21.15.154:6789/0 conn(0x7f626c160900 legacy=0x7f626c06a240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-13T18:41:31.404 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:31.393+0000 7f62710c4640 1 -- 172.21.15.102:0/1608640425 --> v1:172.21.15.102:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f626c161360 con 0x7f626c153a70 2023-11-13T18:41:31.404 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:31.393+0000 7f62710c4640 1 -- 172.21.15.102:0/1608640425 <== mon.0 v1:172.21.15.102:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 895381068 0 0) 0x7f62680016a0 con 0x7f626c153a70 2023-11-13T18:41:31.405 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:31.393+0000 7f62710c4640 1 -- 172.21.15.102:0/1608640425 >> v1:172.21.15.102:6789/0 conn(0x7f626c153a70 legacy=0x7f626c15da20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T18:41:31.405 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:31.393+0000 7f62710c4640 1 --2- 172.21.15.102:0/1608640425 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6258003980 0x7f6258003d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T18:41:31.406 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:31.393+0000 7f62710c4640 1 --2- 172.21.15.102:0/1608640425 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f62580047d0 0x7f6258004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T18:41:31.406 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:31.393+0000 7f62710c4640 1 --2- 172.21.15.102:0/1608640425 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f62580052b0 0x7f625800b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T18:41:31.406 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:31.393+0000 7f62710c4640 1 -- 172.21.15.102:0/1608640425 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f625800c130 con 0x7f62580047d0 2023-11-13T18:41:31.407 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:31.393+0000 7f62710c4640 1 -- 172.21.15.102:0/1608640425 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f625800c2a0 con 0x7f6258003980 2023-11-13T18:41:31.407 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:31.393+0000 7f62710c4640 1 -- 172.21.15.102:0/1608640425 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f625800c460 con 0x7f62580052b0 2023-11-13T18:41:31.407 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:31.393+0000 7f62718c5640 1 --2- 172.21.15.102:0/1608640425 >> v2:172.21.15.102:3300/0 conn(0x7f626c0b1b90 0x7f626c153e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-13T18:41:31.408 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:31.393+0000 7f62720c6640 1 --2- 172.21.15.102:0/1608640425 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6258003980 0x7f6258003d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T18:41:31.408 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:31.397+0000 7f62718c5640 1 --2- 172.21.15.102:0/1608640425 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f62580047d0 0x7f6258004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T18:41:31.410 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:31.397+0000 7f62718c5640 1 -- 172.21.15.102:0/1608640425 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f62580052b0 msgr2=0x7f625800b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-13T18:41:31.410 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:31.397+0000 7f62718c5640 1 --2- 172.21.15.102:0/1608640425 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f62580052b0 0x7f625800b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T18:41:31.410 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:31.397+0000 7f62718c5640 1 -- 172.21.15.102:0/1608640425 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6258003980 msgr2=0x7f6258003d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-13T18:41:31.411 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:31.397+0000 7f62718c5640 1 --2- 172.21.15.102:0/1608640425 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6258003980 0x7f6258003d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T18:41:31.411 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:31.401+0000 7f62718c5640 1 -- 172.21.15.102:0/1608640425 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f626c161360 con 0x7f62580047d0 2023-11-13T18:41:31.411 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:31.401+0000 7f62720c6640 1 --2- 172.21.15.102:0/1608640425 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6258003980 0x7f6258003d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-13T18:41:31.412 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:31.401+0000 7f62728c7640 1 -- 172.21.15.102:0/1608640425 reap_dead start 2023-11-13T18:41:31.424 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:31.417+0000 7f62718c5640 1 --2- 172.21.15.102:0/1608640425 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f62580047d0 0x7f6258004c50 secure :-1 s=READY pgs=1943 cs=0 l=1 rev1=1 crypto rx=0x7f625c00fc50 tx=0x7f625c024d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d6bbc7302938d246 server_cookie=0 in_seq=0 out_seq=0 2023-11-13T18:41:31.444 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:31.433+0000 7f62710c4640 1 -- 172.21.15.102:0/1608640425 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f625c004220 con 0x7f62580047d0 2023-11-13T18:41:31.444 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:31.433+0000 7f62710c4640 1 -- 172.21.15.102:0/1608640425 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f625c0b1070 con 0x7f62580047d0 2023-11-13T18:41:31.445 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:31.433+0000 7f62710c4640 1 -- 172.21.15.102:0/1608640425 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f625c0ad820 con 0x7f62580047d0 2023-11-13T18:41:31.445 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:31.437+0000 7f62730c8640 1 -- 172.21.15.102:0/1608640425 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f62580047d0 msgr2=0x7f6258004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T18:41:31.446 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:31.437+0000 7f62730c8640 1 --2- 172.21.15.102:0/1608640425 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f62580047d0 0x7f6258004c50 secure :-1 s=READY pgs=1943 cs=0 l=1 rev1=1 crypto rx=0x7f625c00fc50 tx=0x7f625c024d30 comp rx=0 tx=0).stop 2023-11-13T18:41:31.447 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:31.437+0000 7f62730c8640 1 -- 172.21.15.102:0/1608640425 shutdown_connections 2023-11-13T18:41:31.448 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:31.437+0000 7f62730c8640 1 --2- 172.21.15.102:0/1608640425 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f62580047d0 0x7f6258004c50 unknown :-1 s=CLOSED pgs=1943 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T18:41:31.448 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:31.437+0000 7f62730c8640 1 -- 172.21.15.102:0/1608640425 >> 172.21.15.102:0/1608640425 conn(0x7f626c0b4450 msgr2=0x7f626c0b04d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-13T18:41:31.457 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:31.449+0000 7f62730c8640 1 -- 172.21.15.102:0/1608640425 shutdown_connections 2023-11-13T18:41:31.458 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:31.449+0000 7f62730c8640 1 -- 172.21.15.102:0/1608640425 wait complete. 2023-11-13T18:41:31.465 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:31.453+0000 7f62730c8640 1 Processor -- start 2023-11-13T18:41:31.465 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:31.453+0000 7f62730c8640 1 -- start start 2023-11-13T18:41:31.466 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:31.453+0000 7f62730c8640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f62580047d0 0x7f626c0c3740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T18:41:31.466 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:31.453+0000 7f62730c8640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f626c140700 0x7f626c15c4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T18:41:31.466 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:31.453+0000 7f62730c8640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f626c15ca30 0x7f626c142380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T18:41:31.466 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:31.453+0000 7f62730c8640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f626c0c3c80 con 0x7f626c15ca30 2023-11-13T18:41:31.467 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:31.453+0000 7f62730c8640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f626c140270 con 0x7f626c140700 2023-11-13T18:41:31.467 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:31.453+0000 7f62730c8640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f626c15ceb0 con 0x7f62580047d0 2023-11-13T18:41:31.467 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:31.457+0000 7f62728c7640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f626c15ca30 0x7f626c142380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T18:41:31.468 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:31.457+0000 7f62728c7640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f626c15ca30 0x7f626c142380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:54890/0 (socket says 172.21.15.102:54890) 2023-11-13T18:41:31.468 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:31.457+0000 7f62728c7640 1 -- 172.21.15.102:0/2398459086 learned_addr learned my addr 172.21.15.102:0/2398459086 (peer_addr_for_me v2:172.21.15.102:0/0) 2023-11-13T18:41:31.468 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:31.457+0000 7f62718c5640 1 --2- 172.21.15.102:0/2398459086 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f626c140700 0x7f626c15c4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T18:41:31.469 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:31.457+0000 7f62720c6640 1 --2- 172.21.15.102:0/2398459086 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f62580047d0 0x7f626c0c3740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T18:41:31.469 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:31.461+0000 7f62720c6640 1 -- 172.21.15.102:0/2398459086 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f626c140700 msgr2=0x7f626c15c4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T18:41:31.470 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:31.461+0000 7f62720c6640 1 --2- 172.21.15.102:0/2398459086 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f626c140700 0x7f626c15c4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T18:41:31.470 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:31.461+0000 7f62720c6640 1 -- 172.21.15.102:0/2398459086 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f626c15ca30 msgr2=0x7f626c142380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T18:41:31.470 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:31.461+0000 7f62720c6640 1 --2- 172.21.15.102:0/2398459086 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f626c15ca30 0x7f626c142380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T18:41:31.471 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:31.461+0000 7f62720c6640 1 -- 172.21.15.102:0/2398459086 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f626c0c3eb0 con 0x7f62580047d0 2023-11-13T18:41:31.473 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:31.465+0000 7f62720c6640 1 --2- 172.21.15.102:0/2398459086 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f62580047d0 0x7f626c0c3740 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f626800e910 tx=0x7f626800edd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-13T18:41:31.474 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:31.465+0000 7f6262ffd640 1 -- 172.21.15.102:0/2398459086 <== mon.2 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6268017070 con 0x7f62580047d0 2023-11-13T18:41:31.474 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:31.465+0000 7f6262ffd640 1 -- 172.21.15.102:0/2398459086 <== mon.2 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f626800c990 con 0x7f62580047d0 2023-11-13T18:41:31.475 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:31.465+0000 7f6262ffd640 1 -- 172.21.15.102:0/2398459086 <== mon.2 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f626800cb00 con 0x7f62580047d0 2023-11-13T18:41:31.475 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:31.469+0000 7f62730c8640 1 -- 172.21.15.102:0/2398459086 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f626c13f940 con 0x7f62580047d0 2023-11-13T18:41:31.476 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:31.469+0000 7f62730c8640 1 -- 172.21.15.102:0/2398459086 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f626c13ff00 con 0x7f62580047d0 2023-11-13T18:41:31.477 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:31.469+0000 7f62730c8640 1 -- 172.21.15.102:0/2398459086 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f626c068520 con 0x7f62580047d0 2023-11-13T18:41:31.489 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:31.477+0000 7f6262ffd640 1 -- 172.21.15.102:0/2398459086 <== mon.2 v2:172.21.15.154:3301/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f626800cc60 con 0x7f62580047d0 2023-11-13T18:41:31.489 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:31.481+0000 7f6262ffd640 1 --2- 172.21.15.102:0/2398459086 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f62500664c0 0x7f6250068980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T18:41:31.490 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:31.481+0000 7f6262ffd640 1 -- 172.21.15.102:0/2398459086 <== mon.2 v2:172.21.15.154:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f626805b6c0 con 0x7f62580047d0 2023-11-13T18:41:31.493 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:31.485+0000 7f62718c5640 1 --2- 172.21.15.102:0/2398459086 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f62500664c0 0x7f6250068980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T18:41:31.500 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:31.489+0000 7f62718c5640 1 --2- 172.21.15.102:0/2398459086 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f62500664c0 0x7f6250068980 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x7f625c0b7000 tx=0x7f625c008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-13T18:41:31.500 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:31.489+0000 7f6262ffd640 1 -- 172.21.15.102:0/2398459086 <== mon.2 v2:172.21.15.154:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f6268051f50 con 0x7f62580047d0 2023-11-13T18:41:31.869 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:31.857+0000 7f62730c8640 1 -- 172.21.15.102:0/2398459086 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f626c1511a0 con 0x7f62580047d0 2023-11-13T18:41:31.971 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:31.961+0000 7f6262ffd640 1 -- 172.21.15.102:0/2398459086 <== mon.2 v2:172.21.15.154:3301/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v11) v1 ==== 104+0+0 (secure 0 0 0) 0x7f62680520f0 con 0x7f62580047d0 2023-11-13T18:41:31.976 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:31.969+0000 7f62730c8640 1 -- 172.21.15.102:0/2398459086 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f62500664c0 msgr2=0x7f6250068980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T18:41:31.977 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:31.969+0000 7f62730c8640 1 --2- 172.21.15.102:0/2398459086 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f62500664c0 0x7f6250068980 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x7f625c0b7000 tx=0x7f625c008040 comp rx=0 tx=0).stop 2023-11-13T18:41:31.977 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:31.969+0000 7f62730c8640 1 -- 172.21.15.102:0/2398459086 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f62580047d0 msgr2=0x7f626c0c3740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T18:41:31.977 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:31.969+0000 7f62730c8640 1 --2- 172.21.15.102:0/2398459086 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f62580047d0 0x7f626c0c3740 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f626800e910 tx=0x7f626800edd0 comp rx=0 tx=0).stop 2023-11-13T18:41:31.978 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:31.969+0000 7f62730c8640 1 -- 172.21.15.102:0/2398459086 shutdown_connections 2023-11-13T18:41:31.978 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:31.969+0000 7f62730c8640 1 --2- 172.21.15.102:0/2398459086 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f62500664c0 0x7f6250068980 unknown :-1 s=CLOSED pgs=749 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T18:41:31.978 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:31.969+0000 7f62730c8640 1 --2- 172.21.15.102:0/2398459086 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f626c15ca30 0x7f626c142380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T18:41:31.978 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:31.969+0000 7f62730c8640 1 --2- 172.21.15.102:0/2398459086 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f626c140700 0x7f626c15c4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T18:41:31.979 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:31.969+0000 7f62730c8640 1 --2- 172.21.15.102:0/2398459086 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f62580047d0 0x7f626c0c3740 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T18:41:31.979 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:31.969+0000 7f62730c8640 1 -- 172.21.15.102:0/2398459086 >> 172.21.15.102:0/2398459086 conn(0x7f626c0b4450 msgr2=0x7f626c0ae440 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-13T18:41:31.983 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:31.973+0000 7f62730c8640 1 -- 172.21.15.102:0/2398459086 shutdown_connections 2023-11-13T18:41:31.984 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:31.973+0000 7f62730c8640 1 -- 172.21.15.102:0/2398459086 wait complete. 2023-11-13T18:41:32.107 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.tests_from_xfstests_dev.TestXFSTestsDev.test_generic' 2023-11-13T18:41:32.416 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T18:41:32.449 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T18:41:32.625 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:32.609+0000 7efe81e74640 1 Processor -- start 2023-11-13T18:41:32.626 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:32.609+0000 7efe81e74640 1 -- start start 2023-11-13T18:41:32.629 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:32.617+0000 7efe81e74640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7efe7c1647c0 0x7efe7c06cbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T18:41:32.629 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:32.617+0000 7efe81e74640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7efe7c070590 0x7efe7c06d130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T18:41:32.629 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:32.617+0000 7efe81e74640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7efe7c071990 0x7efe7c0b2450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T18:41:32.630 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:32.621+0000 7efe81e74640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efe7c070b00 con 0x7efe7c070590 2023-11-13T18:41:32.630 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:32.621+0000 7efe81e74640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efe7c1658b0 con 0x7efe7c071990 2023-11-13T18:41:32.630 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:32.621+0000 7efe7bfff640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7efe7c070590 0x7efe7c06d130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T18:41:32.630 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:32.621+0000 7efe7bfff640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7efe7c070590 0x7efe7c06d130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:54892/0 (socket says 172.21.15.102:54892) 2023-11-13T18:41:32.631 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:32.621+0000 7efe7bfff640 1 -- 172.21.15.102:0/1503064078 learned_addr learned my addr 172.21.15.102:0/1503064078 (peer_addr_for_me v2:172.21.15.102:0/0) 2023-11-13T18:41:32.631 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:32.621+0000 7efe81e74640 1 -- 172.21.15.102:0/1503064078 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efe7c165d40 con 0x7efe7c1647c0 2023-11-13T18:41:32.631 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:32.621+0000 7efe80e72640 1 --2- 172.21.15.102:0/1503064078 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7efe7c1647c0 0x7efe7c06cbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T18:41:32.632 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:32.621+0000 7efe81673640 1 --2- 172.21.15.102:0/1503064078 >> v2:172.21.15.154:3300/0 conn(0x7efe7c071990 0x7efe7c0b2450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T18:41:32.633 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:32.625+0000 7efe7bfff640 1 -- 172.21.15.102:0/1503064078 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7efe7c1647c0 msgr2=0x7efe7c06cbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-13T18:41:32.633 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:32.625+0000 7efe7bfff640 1 --2- 172.21.15.102:0/1503064078 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7efe7c1647c0 0x7efe7c06cbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T18:41:32.633 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:32.625+0000 7efe7bfff640 1 -- 172.21.15.102:0/1503064078 >> v2:172.21.15.154:3300/0 conn(0x7efe7c071990 msgr2=0x7efe7c0b2450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-13T18:41:32.634 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:32.625+0000 7efe7bfff640 1 --2- 172.21.15.102:0/1503064078 >> v2:172.21.15.154:3300/0 conn(0x7efe7c071990 0x7efe7c0b2450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T18:41:32.634 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:32.625+0000 7efe7bfff640 1 -- 172.21.15.102:0/1503064078 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe7c164ba0 con 0x7efe7c070590 2023-11-13T18:41:32.645 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:32.637+0000 7efe80e72640 1 --2- 172.21.15.102:0/1503064078 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7efe7c1647c0 0x7efe7c06cbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-13T18:41:32.662 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:32.641+0000 7efe7bfff640 1 --2- 172.21.15.102:0/1503064078 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7efe7c070590 0x7efe7c06d130 secure :-1 s=READY pgs=1944 cs=0 l=1 rev1=1 crypto rx=0x7efe7c072430 tx=0x7efe6801c1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2f1172f888e118e9 server_cookie=0 in_seq=0 out_seq=0 2023-11-13T18:41:32.662 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:32.641+0000 7efe7b7fe640 1 -- 172.21.15.102:0/1503064078 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe680ab600 con 0x7efe7c070590 2023-11-13T18:41:32.662 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:32.645+0000 7efe7b7fe640 1 -- 172.21.15.102:0/1503064078 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe680a7050 con 0x7efe7c070590 2023-11-13T18:41:32.662 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:32.645+0000 7efe7b7fe640 1 -- 172.21.15.102:0/1503064078 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe680ab980 con 0x7efe7c070590 2023-11-13T18:41:32.663 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:32.645+0000 7efe81e74640 1 -- 172.21.15.102:0/1503064078 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7efe7c070590 msgr2=0x7efe7c06d130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T18:41:32.663 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:32.645+0000 7efe81e74640 1 --2- 172.21.15.102:0/1503064078 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7efe7c070590 0x7efe7c06d130 secure :-1 s=READY pgs=1944 cs=0 l=1 rev1=1 crypto rx=0x7efe7c072430 tx=0x7efe6801c1a0 comp rx=0 tx=0).stop 2023-11-13T18:41:32.663 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:32.649+0000 7efe81e74640 1 -- 172.21.15.102:0/1503064078 shutdown_connections 2023-11-13T18:41:32.664 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:32.649+0000 7efe81e74640 1 --2- 172.21.15.102:0/1503064078 >> v2:172.21.15.154:3300/0 conn(0x7efe7c071990 0x7efe7c0b2450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T18:41:32.664 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:32.649+0000 7efe81e74640 1 --2- 172.21.15.102:0/1503064078 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7efe7c070590 0x7efe7c06d130 unknown :-1 s=CLOSED pgs=1944 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T18:41:32.664 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:32.649+0000 7efe81e74640 1 --2- 172.21.15.102:0/1503064078 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7efe7c1647c0 0x7efe7c06cbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T18:41:32.664 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:32.649+0000 7efe81e74640 1 -- 172.21.15.102:0/1503064078 >> 172.21.15.102:0/1503064078 conn(0x7efe7c0b0690 msgr2=0x7efe7c0b0aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-13T18:41:32.665 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:32.653+0000 7efe81e74640 1 -- 172.21.15.102:0/1503064078 shutdown_connections 2023-11-13T18:41:32.665 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:32.653+0000 7efe81e74640 1 -- 172.21.15.102:0/1503064078 wait complete. 2023-11-13T18:41:32.694 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:32.685+0000 7efe81e74640 1 Processor -- start 2023-11-13T18:41:32.704 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:32.685+0000 7efe81e74640 1 -- start start 2023-11-13T18:41:32.727 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:32.713+0000 7efe81e74640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7efe7c070590 0x7efe7c165f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T18:41:32.727 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:32.713+0000 7efe81e74640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efe7c071990 0x7efe7c143bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T18:41:32.728 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:32.713+0000 7efe81e74640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7efe7c1647c0 0x7efe7c163310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T18:41:32.728 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:32.713+0000 7efe81e74640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe7c155d70 con 0x7efe7c1647c0 2023-11-13T18:41:32.728 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:32.713+0000 7efe81e74640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe7c15acc0 con 0x7efe7c071990 2023-11-13T18:41:32.729 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:32.713+0000 7efe81e74640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efe7c15afa0 con 0x7efe7c070590 2023-11-13T18:41:32.729 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:32.713+0000 7efe80e72640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7efe7c070590 0x7efe7c165f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T18:41:32.729 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:32.717+0000 7efe81673640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7efe7c1647c0 0x7efe7c163310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T18:41:32.729 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:32.717+0000 7efe81673640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7efe7c1647c0 0x7efe7c163310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:54896/0 (socket says 172.21.15.102:54896) 2023-11-13T18:41:32.730 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:32.717+0000 7efe81673640 1 -- 172.21.15.102:0/2536962523 learned_addr learned my addr 172.21.15.102:0/2536962523 (peer_addr_for_me v2:172.21.15.102:0/0) 2023-11-13T18:41:32.730 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:32.717+0000 7efe81673640 1 -- 172.21.15.102:0/2536962523 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7efe7c070590 msgr2=0x7efe7c165f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T18:41:32.730 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:32.717+0000 7efe81673640 1 --2- 172.21.15.102:0/2536962523 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7efe7c070590 0x7efe7c165f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T18:41:32.731 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:32.717+0000 7efe81673640 1 -- 172.21.15.102:0/2536962523 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efe7c071990 msgr2=0x7efe7c143bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T18:41:32.731 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:32.717+0000 7efe81673640 1 --2- 172.21.15.102:0/2536962523 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efe7c071990 0x7efe7c143bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T18:41:32.731 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:32.717+0000 7efe81673640 1 -- 172.21.15.102:0/2536962523 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe680094d0 con 0x7efe7c1647c0 2023-11-13T18:41:32.732 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:32.721+0000 7efe81673640 1 --2- 172.21.15.102:0/2536962523 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7efe7c1647c0 0x7efe7c163310 secure :-1 s=READY pgs=1945 cs=0 l=1 rev1=1 crypto rx=0x7efe74007e90 tx=0x7efe7400e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-13T18:41:32.733 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:32.721+0000 7efe797fa640 1 -- 172.21.15.102:0/2536962523 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe74014420 con 0x7efe7c1647c0 2023-11-13T18:41:32.733 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:32.721+0000 7efe797fa640 1 -- 172.21.15.102:0/2536962523 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe740145a0 con 0x7efe7c1647c0 2023-11-13T18:41:32.733 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:32.721+0000 7efe797fa640 1 -- 172.21.15.102:0/2536962523 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe74014950 con 0x7efe7c1647c0 2023-11-13T18:41:32.745 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:32.725+0000 7efe81e74640 1 -- 172.21.15.102:0/2536962523 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efe7c155f80 con 0x7efe7c1647c0 2023-11-13T18:41:32.745 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:32.725+0000 7efe81e74640 1 -- 172.21.15.102:0/2536962523 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efe7c156540 con 0x7efe7c1647c0 2023-11-13T18:41:32.745 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:32.725+0000 7efe81e74640 1 -- 172.21.15.102:0/2536962523 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efe7c15b130 con 0x7efe7c1647c0 2023-11-13T18:41:32.784 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:32.777+0000 7efe797fa640 1 -- 172.21.15.102:0/2536962523 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7efe74014ab0 con 0x7efe7c1647c0 2023-11-13T18:41:32.792 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:32.785+0000 7efe797fa640 1 --2- 172.21.15.102:0/2536962523 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7efe600664c0 0x7efe60068980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T18:41:32.793 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:32.785+0000 7efe797fa640 1 -- 172.21.15.102:0/2536962523 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4943+0+0 (secure 0 0 0) 0x7efe74085340 con 0x7efe7c1647c0 2023-11-13T18:41:32.793 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:32.785+0000 7efe80e72640 1 --2- 172.21.15.102:0/2536962523 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7efe600664c0 0x7efe60068980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T18:41:32.795 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:32.785+0000 7efe80e72640 1 --2- 172.21.15.102:0/2536962523 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7efe600664c0 0x7efe60068980 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 crypto rx=0x7efe7c1596f0 tx=0x7efe70008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-13T18:41:32.877 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:32.869+0000 7efe797fa640 1 -- 172.21.15.102:0/2536962523 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7efe74052ba0 con 0x7efe7c1647c0 2023-11-13T18:41:33.486 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:33.477+0000 7efe81e74640 1 -- 172.21.15.102:0/2536962523 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.tests_from_xfstests_dev.TestXFSTestsDev.test_generic"]} v 0) v1 -- 0x7efe7c068520 con 0x7efe7c1647c0 2023-11-13T18:41:33.977 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:33.969+0000 7efe797fa640 1 -- 172.21.15.102:0/2536962523 <== mon.0 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.tests_from_xfstests_dev.TestXFSTestsDev.test_generic"]}]=0 v13051) v1 ==== 144+0+0 (secure 0 0 0) 0x7efe740561c0 con 0x7efe7c1647c0 2023-11-13T18:41:33.995 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:33.985+0000 7efe81e74640 1 -- 172.21.15.102:0/2536962523 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7efe600664c0 msgr2=0x7efe60068980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T18:41:33.996 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:33.985+0000 7efe81e74640 1 --2- 172.21.15.102:0/2536962523 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7efe600664c0 0x7efe60068980 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 crypto rx=0x7efe7c1596f0 tx=0x7efe70008040 comp rx=0 tx=0).stop 2023-11-13T18:41:33.996 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:33.985+0000 7efe81e74640 1 -- 172.21.15.102:0/2536962523 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7efe7c1647c0 msgr2=0x7efe7c163310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T18:41:33.996 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:33.985+0000 7efe81e74640 1 --2- 172.21.15.102:0/2536962523 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7efe7c1647c0 0x7efe7c163310 secure :-1 s=READY pgs=1945 cs=0 l=1 rev1=1 crypto rx=0x7efe74007e90 tx=0x7efe7400e4b0 comp rx=0 tx=0).stop 2023-11-13T18:41:33.998 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:33.989+0000 7efe81e74640 1 -- 172.21.15.102:0/2536962523 shutdown_connections 2023-11-13T18:41:33.998 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:33.989+0000 7efe81e74640 1 --2- 172.21.15.102:0/2536962523 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7efe600664c0 0x7efe60068980 unknown :-1 s=CLOSED pgs=750 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T18:41:33.998 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:33.989+0000 7efe81e74640 1 --2- 172.21.15.102:0/2536962523 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7efe7c1647c0 0x7efe7c163310 unknown :-1 s=CLOSED pgs=1945 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T18:41:33.998 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:33.989+0000 7efe81e74640 1 --2- 172.21.15.102:0/2536962523 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efe7c071990 0x7efe7c143bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T18:41:33.999 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:33.989+0000 7efe81e74640 1 --2- 172.21.15.102:0/2536962523 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7efe7c070590 0x7efe7c165f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T18:41:33.999 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:33.989+0000 7efe81e74640 1 -- 172.21.15.102:0/2536962523 >> 172.21.15.102:0/2536962523 conn(0x7efe7c0b0690 msgr2=0x7efe7c160040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-13T18:41:33.999 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:33.989+0000 7efe81e74640 1 -- 172.21.15.102:0/2536962523 shutdown_connections 2023-11-13T18:41:34.000 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:33.989+0000 7efe81e74640 1 -- 172.21.15.102:0/2536962523 wait complete. 2023-11-13T18:41:34.115 INFO:tasks.cephfs_test_runner:test_generic (tasks.cephfs.tests_from_xfstests_dev.TestXFSTestsDev) ... FAIL 2023-11-13T18:41:34.115 INFO:tasks.cephfs_test_runner: 2023-11-13T18:41:34.116 INFO:tasks.cephfs_test_runner:====================================================================== 2023-11-13T18:41:34.116 INFO:tasks.cephfs_test_runner:FAIL: test_generic (tasks.cephfs.tests_from_xfstests_dev.TestXFSTestsDev) 2023-11-13T18:41:34.116 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2023-11-13T18:41:34.116 INFO:tasks.cephfs_test_runner:Traceback (most recent call last): 2023-11-13T18:41:34.117 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_35f0debb3cc28955b7132ef4c509cd138a09d56b/qa/tasks/cephfs/tests_from_xfstests_dev.py", line 12, in test_generic 2023-11-13T18:41:34.117 INFO:tasks.cephfs_test_runner: self.run_generic_tests() 2023-11-13T18:41:34.117 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_35f0debb3cc28955b7132ef4c509cd138a09d56b/qa/tasks/cephfs/xfstests_dev.py", line 407, in run_generic_tests 2023-11-13T18:41:34.117 INFO:tasks.cephfs_test_runner: return self.run_testdir('generic') 2023-11-13T18:41:34.118 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_35f0debb3cc28955b7132ef4c509cd138a09d56b/qa/tasks/cephfs/xfstests_dev.py", line 399, in run_testdir 2023-11-13T18:41:34.118 INFO:tasks.cephfs_test_runner: self.assertEqual(self.total_tests_failed, 0) 2023-11-13T18:41:34.118 INFO:tasks.cephfs_test_runner:AssertionError: 16 != 0 2023-11-13T18:41:34.118 INFO:tasks.cephfs_test_runner: 2023-11-13T18:41:34.119 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2023-11-13T18:41:34.119 INFO:tasks.cephfs_test_runner:Ran 1 test in 25928.689s 2023-11-13T18:41:34.119 INFO:tasks.cephfs_test_runner: 2023-11-13T18:41:34.119 INFO:tasks.cephfs_test_runner:FAILED (failures=1) 2023-11-13T18:41:34.120 INFO:tasks.cephfs_test_runner: 2023-11-13T18:41:34.120 INFO:tasks.cephfs_test_runner:====================================================================== 2023-11-13T18:41:34.120 INFO:tasks.cephfs_test_runner:FAIL: test_generic (tasks.cephfs.tests_from_xfstests_dev.TestXFSTestsDev) 2023-11-13T18:41:34.120 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2023-11-13T18:41:34.121 INFO:tasks.cephfs_test_runner:Traceback (most recent call last): 2023-11-13T18:41:34.121 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_35f0debb3cc28955b7132ef4c509cd138a09d56b/qa/tasks/cephfs/tests_from_xfstests_dev.py", line 12, in test_generic 2023-11-13T18:41:34.121 INFO:tasks.cephfs_test_runner: self.run_generic_tests() 2023-11-13T18:41:34.121 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_35f0debb3cc28955b7132ef4c509cd138a09d56b/qa/tasks/cephfs/xfstests_dev.py", line 407, in run_generic_tests 2023-11-13T18:41:34.121 INFO:tasks.cephfs_test_runner: return self.run_testdir('generic') 2023-11-13T18:41:34.122 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_35f0debb3cc28955b7132ef4c509cd138a09d56b/qa/tasks/cephfs/xfstests_dev.py", line 399, in run_testdir 2023-11-13T18:41:34.122 INFO:tasks.cephfs_test_runner: self.assertEqual(self.total_tests_failed, 0) 2023-11-13T18:41:34.122 INFO:tasks.cephfs_test_runner:AssertionError: 16 != 0 2023-11-13T18:41:34.122 INFO:tasks.cephfs_test_runner: 2023-11-13T18:41:34.123 ERROR:teuthology.run_tasks:Saw exception from tasks. Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/run_tasks.py", line 109, in run_tasks manager.__enter__() File "/usr/lib/python3.8/contextlib.py", line 113, in __enter__ return next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph-c_35f0debb3cc28955b7132ef4c509cd138a09d56b/qa/tasks/cephfs_test_runner.py", line 211, in task raise RuntimeError("Test failure: {0}".format(", ".join(bad_tests))) RuntimeError: Test failure: test_generic (tasks.cephfs.tests_from_xfstests_dev.TestXFSTestsDev) 2023-11-13T18:41:34.194 ERROR:teuthology.util.sentry: Sentry event: https://sentry.ceph.com/organizations/ceph/?query=c848065eac2a4544a254695547c30336 Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/run_tasks.py", line 109, in run_tasks manager.__enter__() File "/usr/lib/python3.8/contextlib.py", line 113, in __enter__ return next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph-c_35f0debb3cc28955b7132ef4c509cd138a09d56b/qa/tasks/cephfs_test_runner.py", line 211, in task raise RuntimeError("Test failure: {0}".format(", ".join(bad_tests))) RuntimeError: Test failure: test_generic (tasks.cephfs.tests_from_xfstests_dev.TestXFSTestsDev) 2023-11-13T18:41:34.196 DEBUG:teuthology.run_tasks:Unwinding manager cephfs_test_runner 2023-11-13T18:41:34.206 DEBUG:teuthology.run_tasks:Unwinding manager ceph-fuse 2023-11-13T18:41:34.222 INFO:tasks.ceph_fuse:Unmounting ceph-fuse clients... 2023-11-13T18:41:34.222 DEBUG:teuthology.orchestra.run.smithi102:> set -ex 2023-11-13T18:41:34.223 DEBUG:teuthology.orchestra.run.smithi102:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-13T18:41:34.409 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354660k,nr_inodes=4088665,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275384k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=880 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275380k,nr_inodes=818845,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275384k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-11-13T18:41:34.410 DEBUG:teuthology.orchestra.run.smithi102:> set -ex 2023-11-13T18:41:34.410 DEBUG:teuthology.orchestra.run.smithi102:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-13T18:41:34.505 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354660k,nr_inodes=4088665,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275384k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=880 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275380k,nr_inodes=818845,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275384k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-11-13T18:41:34.506 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2023-11-13T18:41:34.506 DEBUG:teuthology.orchestra.run.smithi154:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-13T18:41:34.538 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354672k,nr_inodes=4088668,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275388k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=7632 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275384k,nr_inodes=818846,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275388k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-11-13T18:41:34.538 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2023-11-13T18:41:34.539 DEBUG:teuthology.orchestra.run.smithi154:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-13T18:41:34.627 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354672k,nr_inodes=4088668,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275388k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=7632 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275384k,nr_inodes=818846,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275388k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-11-13T18:41:34.628 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-13T18:41:34.628 DEBUG:teuthology.orchestra.run.smithi102:> ip netns list 2023-11-13T18:41:34.656 INFO:teuthology.orchestra.run.smithi102.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-11-13T18:41:34.656 INFO:teuthology.orchestra.run.smithi102.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-11-13T18:41:34.658 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-13T18:41:34.659 DEBUG:teuthology.orchestra.run.smithi102:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-13T18:41:34.770 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-13T18:41:34.771 DEBUG:teuthology.orchestra.run.smithi102:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-13T18:41:35.000 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-13T18:41:35.000 DEBUG:teuthology.orchestra.run.smithi102:> sudo ip link delete ceph-brx 2023-11-13T18:41:35.592 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-13T18:41:35.592 DEBUG:teuthology.orchestra.run.smithi154:> ip netns list 2023-11-13T18:41:35.629 INFO:teuthology.orchestra.run.smithi154.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-11-13T18:41:35.629 INFO:teuthology.orchestra.run.smithi154.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2023-11-13T18:41:35.629 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-13T18:41:35.630 DEBUG:teuthology.orchestra.run.smithi154:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.1 2023-11-13T18:41:35.753 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-13T18:41:35.753 DEBUG:teuthology.orchestra.run.smithi154:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.3 2023-11-13T18:41:35.822 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-13T18:41:35.822 DEBUG:teuthology.orchestra.run.smithi154:> sudo ip link delete ceph-brx 2023-11-13T18:41:36.102 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2023-11-13T18:41:36.111 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2023-11-13T18:41:36.111 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-13T18:41:37.692 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:37.680+0000 7f5f29fd1640 1 Processor -- start 2023-11-13T18:41:37.693 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:37.680+0000 7f5f29fd1640 1 -- start start 2023-11-13T18:41:37.698 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:37.688+0000 7f5f29fd1640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f5f240cc0e0 0x7f5f240b1b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T18:41:37.698 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:37.688+0000 7f5f29fd1640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f5f240cd9d0 0x7f5f240cde20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T18:41:37.699 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:37.688+0000 7f5f29fd1640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5f240ce360 con 0x7f5f2414ad70 2023-11-13T18:41:37.699 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:37.688+0000 7f5f29fd1640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5f2406d380 con 0x7f5f240cd9d0 2023-11-13T18:41:37.699 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:37.688+0000 7f5f29fd1640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5f2414b150 con 0x7f5f240cc0e0 2023-11-13T18:41:37.706 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:37.688+0000 7f5f237fe640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f5f2414ad70 0x7f5f2406beb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.102:48336/0 (socket says 172.21.15.102:48336) 2023-11-13T18:41:37.706 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:37.688+0000 7f5f237fe640 1 -- 172.21.15.102:0/98286458 learned_addr learned my addr 172.21.15.102:0/98286458 (peer_addr_for_me v1:172.21.15.102:0/0) 2023-11-13T18:41:37.707 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:37.688+0000 7f5f23fff640 1 --2- 172.21.15.102:0/98286458 >> v2:172.21.15.102:3300/0 conn(0x7f5f240cd9d0 0x7f5f240cde20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T18:41:37.707 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:37.692+0000 7f5f22ffd640 1 --2- 172.21.15.102:0/98286458 >> v2:172.21.15.154:3300/0 conn(0x7f5f240cc0e0 0x7f5f240b1b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T18:41:37.707 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:37.692+0000 7f5f22ffd640 1 -- 172.21.15.102:0/98286458 >> v2:172.21.15.102:3300/0 conn(0x7f5f240cd9d0 msgr2=0x7f5f240cde20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-13T18:41:37.708 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:37.700+0000 7f5f227fc640 1 -- 172.21.15.102:0/98286458 <== mon.1 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2426786654 0 0) 0x7f5f14001120 con 0x7f5f2414ad70 2023-11-13T18:41:37.716 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:37.704+0000 7f5f22ffd640 1 --2- 172.21.15.102:0/98286458 >> v2:172.21.15.102:3300/0 conn(0x7f5f240cd9d0 0x7f5f240cde20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T18:41:37.716 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:37.704+0000 7f5f22ffd640 1 -- 172.21.15.102:0/98286458 >> v1:172.21.15.154:6789/0 conn(0x7f5f2414ad70 legacy=0x7f5f2406beb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T18:41:37.716 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:37.704+0000 7f5f22ffd640 1 -- 172.21.15.102:0/98286458 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f2406c770 con 0x7f5f240cc0e0 2023-11-13T18:41:37.717 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:37.704+0000 7f5f23fff640 1 --2- 172.21.15.102:0/98286458 >> v2:172.21.15.102:3300/0 conn(0x7f5f240cd9d0 0x7f5f240cde20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-13T18:41:37.750 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:37.740+0000 7f5f22ffd640 1 --2- 172.21.15.102:0/98286458 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5f240cc0e0 0x7f5f240b1b70 secure :-1 s=READY pgs=909 cs=0 l=1 rev1=1 crypto rx=0x7f5f240cc890 tx=0x7f5f1c01c910 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3cd41cc9a00c7216 server_cookie=0 in_seq=0 out_seq=0 2023-11-13T18:41:37.764 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:37.752+0000 7f5f227fc640 1 -- 172.21.15.102:0/98286458 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f1c0a58c0 con 0x7f5f240cc0e0 2023-11-13T18:41:37.764 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:37.752+0000 7f5f227fc640 1 -- 172.21.15.102:0/98286458 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f1c0a5a20 con 0x7f5f240cc0e0 2023-11-13T18:41:37.764 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:37.752+0000 7f5f227fc640 1 -- 172.21.15.102:0/98286458 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f1c0a5db0 con 0x7f5f240cc0e0 2023-11-13T18:41:37.768 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:37.760+0000 7f5f29fd1640 1 -- 172.21.15.102:0/98286458 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5f240cc0e0 msgr2=0x7f5f240b1b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T18:41:37.768 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:37.760+0000 7f5f29fd1640 1 --2- 172.21.15.102:0/98286458 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5f240cc0e0 0x7f5f240b1b70 secure :-1 s=READY pgs=909 cs=0 l=1 rev1=1 crypto rx=0x7f5f240cc890 tx=0x7f5f1c01c910 comp rx=0 tx=0).stop 2023-11-13T18:41:37.788 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:37.780+0000 7f5f29fd1640 1 -- 172.21.15.102:0/98286458 shutdown_connections 2023-11-13T18:41:37.788 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:37.780+0000 7f5f29fd1640 1 --2- 172.21.15.102:0/98286458 >> v2:172.21.15.102:3300/0 conn(0x7f5f240cd9d0 0x7f5f240cde20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T18:41:37.789 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:37.780+0000 7f5f29fd1640 1 --2- 172.21.15.102:0/98286458 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5f240cc0e0 0x7f5f240b1b70 unknown :-1 s=CLOSED pgs=909 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T18:41:37.789 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:37.780+0000 7f5f29fd1640 1 -- 172.21.15.102:0/98286458 >> 172.21.15.102:0/98286458 conn(0x7f5f240cb5c0 msgr2=0x7f5f240cb9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-13T18:41:37.791 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:37.780+0000 7f5f29fd1640 1 -- 172.21.15.102:0/98286458 shutdown_connections 2023-11-13T18:41:37.808 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:37.796+0000 7f5f29fd1640 1 -- 172.21.15.102:0/98286458 wait complete. 2023-11-13T18:41:37.824 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:37.816+0000 7f5f29fd1640 1 Processor -- start 2023-11-13T18:41:37.828 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:37.816+0000 7f5f29fd1640 1 -- start start 2023-11-13T18:41:37.845 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:37.836+0000 7f5f29fd1640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5f240cc0e0 0x7f5f24165f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T18:41:37.846 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:37.836+0000 7f5f29fd1640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5f240cd9d0 0x7f5f24142f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T18:41:37.846 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:37.836+0000 7f5f29fd1640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5f2414ad70 0x7f5f241652e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T18:41:37.847 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:37.836+0000 7f5f29fd1640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f241451f0 con 0x7f5f2414ad70 2023-11-13T18:41:37.847 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:37.836+0000 7f5f29fd1640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f2414ea80 con 0x7f5f240cd9d0 2023-11-13T18:41:37.848 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:37.836+0000 7f5f29fd1640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f241664d0 con 0x7f5f240cc0e0 2023-11-13T18:41:37.849 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:37.836+0000 7f5f23fff640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5f2414ad70 0x7f5f241652e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T18:41:37.849 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:37.836+0000 7f5f23fff640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5f2414ad70 0x7f5f241652e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:55114/0 (socket says 172.21.15.102:55114) 2023-11-13T18:41:37.850 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:37.836+0000 7f5f23fff640 1 -- 172.21.15.102:0/4217766766 learned_addr learned my addr 172.21.15.102:0/4217766766 (peer_addr_for_me v2:172.21.15.102:0/0) 2023-11-13T18:41:37.850 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:37.840+0000 7f5f237fe640 1 --2- 172.21.15.102:0/4217766766 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5f240cc0e0 0x7f5f24165f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T18:41:37.851 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:37.840+0000 7f5f23fff640 1 -- 172.21.15.102:0/4217766766 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5f240cc0e0 msgr2=0x7f5f24165f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T18:41:37.851 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:37.840+0000 7f5f23fff640 1 --2- 172.21.15.102:0/4217766766 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5f240cc0e0 0x7f5f24165f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T18:41:37.852 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:37.840+0000 7f5f23fff640 1 -- 172.21.15.102:0/4217766766 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5f240cd9d0 msgr2=0x7f5f24142f10 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-11-13T18:41:37.853 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:37.840+0000 7f5f22ffd640 1 --2- 172.21.15.102:0/4217766766 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5f240cd9d0 0x7f5f24142f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T18:41:37.853 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:37.840+0000 7f5f23fff640 1 --2- 172.21.15.102:0/4217766766 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5f240cd9d0 0x7f5f24142f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T18:41:37.854 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:37.840+0000 7f5f23fff640 1 -- 172.21.15.102:0/4217766766 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f18009420 con 0x7f5f2414ad70 2023-11-13T18:41:37.854 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:37.840+0000 7f5f22ffd640 1 --2- 172.21.15.102:0/4217766766 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5f240cd9d0 0x7f5f24142f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-13T18:41:37.856 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:37.848+0000 7f5f23fff640 1 --2- 172.21.15.102:0/4217766766 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5f2414ad70 0x7f5f241652e0 secure :-1 s=READY pgs=1946 cs=0 l=1 rev1=1 crypto rx=0x7f5f1800e980 tx=0x7f5f1800ee40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-13T18:41:37.857 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:37.848+0000 7f5f0bfff640 1 -- 172.21.15.102:0/4217766766 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f18009720 con 0x7f5f2414ad70 2023-11-13T18:41:37.858 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:37.848+0000 7f5f0bfff640 1 -- 172.21.15.102:0/4217766766 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f1800ca00 con 0x7f5f2414ad70 2023-11-13T18:41:37.858 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:37.848+0000 7f5f0bfff640 1 -- 172.21.15.102:0/4217766766 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f18009720 con 0x7f5f2414ad70 2023-11-13T18:41:37.867 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:37.856+0000 7f5f29fd1640 1 -- 172.21.15.102:0/4217766766 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5f1c009a70 con 0x7f5f2414ad70 2023-11-13T18:41:37.868 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:37.856+0000 7f5f29fd1640 1 -- 172.21.15.102:0/4217766766 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5f240b2230 con 0x7f5f2414ad70 2023-11-13T18:41:37.868 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:37.856+0000 7f5f29fd1640 1 -- 172.21.15.102:0/4217766766 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5f24068520 con 0x7f5f2414ad70 2023-11-13T18:41:37.873 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:37.860+0000 7f5f0bfff640 1 -- 172.21.15.102:0/4217766766 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f5f1800cb70 con 0x7f5f2414ad70 2023-11-13T18:41:37.873 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:37.864+0000 7f5f0bfff640 1 --2- 172.21.15.102:0/4217766766 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f5f10066530 0x7f5f100689f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T18:41:37.875 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:37.864+0000 7f5f237fe640 1 --2- 172.21.15.102:0/4217766766 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f5f10066530 0x7f5f100689f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T18:41:37.876 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:37.864+0000 7f5f237fe640 1 --2- 172.21.15.102:0/4217766766 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f5f10066530 0x7f5f100689f0 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 crypto rx=0x7f5f14000f70 tx=0x7f5f14007c10 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-13T18:41:37.880 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:37.872+0000 7f5f0bfff640 1 -- 172.21.15.102:0/4217766766 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f5f1805b1c0 con 0x7f5f2414ad70 2023-11-13T18:41:37.938 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:37.928+0000 7f5f0bfff640 1 -- 172.21.15.102:0/4217766766 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f5f18051a50 con 0x7f5f2414ad70 2023-11-13T18:41:38.835 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:38.824+0000 7f5f29fd1640 1 -- 172.21.15.102:0/4217766766 --> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f5f240b20b0 con 0x7f5f10066530 2023-11-13T18:41:38.865 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:38.856+0000 7f5f0bfff640 1 -- 172.21.15.102:0/4217766766 <== mgr.4103 v2:172.21.15.102:6832/1009482693 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+49481 (secure 0 0 0) 0x7f5f14007da0 con 0x7f5f10066530 2023-11-13T18:41:38.870 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T18:41:38.871 INFO:teuthology.orchestra.run.smithi102.stderr:dumped all 2023-11-13T18:41:38.880 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:38.872+0000 7f5f29fd1640 1 -- 172.21.15.102:0/4217766766 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f5f10066530 msgr2=0x7f5f100689f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T18:41:38.881 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:38.872+0000 7f5f29fd1640 1 --2- 172.21.15.102:0/4217766766 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f5f10066530 0x7f5f100689f0 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 crypto rx=0x7f5f14000f70 tx=0x7f5f14007c10 comp rx=0 tx=0).stop 2023-11-13T18:41:38.881 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:38.872+0000 7f5f29fd1640 1 -- 172.21.15.102:0/4217766766 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5f2414ad70 msgr2=0x7f5f241652e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T18:41:38.881 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:38.872+0000 7f5f29fd1640 1 --2- 172.21.15.102:0/4217766766 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5f2414ad70 0x7f5f241652e0 secure :-1 s=READY pgs=1946 cs=0 l=1 rev1=1 crypto rx=0x7f5f1800e980 tx=0x7f5f1800ee40 comp rx=0 tx=0).stop 2023-11-13T18:41:38.884 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:38.876+0000 7f5f29fd1640 1 -- 172.21.15.102:0/4217766766 shutdown_connections 2023-11-13T18:41:38.888 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:38.876+0000 7f5f29fd1640 1 --2- 172.21.15.102:0/4217766766 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f5f10066530 0x7f5f100689f0 unknown :-1 s=CLOSED pgs=751 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T18:41:38.888 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:38.880+0000 7f5f29fd1640 1 --2- 172.21.15.102:0/4217766766 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5f2414ad70 0x7f5f241652e0 unknown :-1 s=CLOSED pgs=1946 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T18:41:38.888 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:38.880+0000 7f5f29fd1640 1 --2- 172.21.15.102:0/4217766766 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5f240cd9d0 0x7f5f24142f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T18:41:38.889 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:38.880+0000 7f5f29fd1640 1 --2- 172.21.15.102:0/4217766766 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5f240cc0e0 0x7f5f24165f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T18:41:38.889 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:38.880+0000 7f5f29fd1640 1 -- 172.21.15.102:0/4217766766 >> 172.21.15.102:0/4217766766 conn(0x7f5f240cb5c0 msgr2=0x7f5f2406ff40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-13T18:41:38.892 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:38.884+0000 7f5f29fd1640 1 -- 172.21.15.102:0/4217766766 shutdown_connections 2023-11-13T18:41:38.893 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:38.884+0000 7f5f29fd1640 1 -- 172.21.15.102:0/4217766766 wait complete. 2023-11-13T18:41:39.134 INFO:teuthology.orchestra.run.smithi102.stdout:{"pg_ready":true,"pg_map":{"version":13010,"stamp":"2023-11-13T18:41:37.972942+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":180,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":36777248,"kb_used_data":23938888,"kb_used_omap":3957,"kb_used_meta":12720138,"kb_avail":718197472,"statfs":{"total":773094113280,"available":735434211328,"internally_reserved":0,"allocated":24513421312,"data_stored":24459278328,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4052240,"internal_metadata":13025422064},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,1],"upper_bound":32},"perf_stat":{"commit_latency_ms":863,"apply_latency_ms":863,"commit_latency_ns":863000000,"apply_latency_ns":863000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-25792683264,"num_objects":-22371,"num_object_clones":0,"num_object_copies":-44742,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-22371,"num_whiteouts":0,"num_read":-2023324,"num_read_kb":-141734219,"num_write":-6589093,"num_write_kb":-163073304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.610083"},"pg_stats":[{"pgid":"1.0","version":"17'117","reported_seq":395,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-11-13T18:41:29.715310+0000","last_change":"2023-11-13T11:28:47.002866+0000","last_active":"2023-11-13T18:41:29.715310+0000","last_peered":"2023-11-13T18:41:29.715310+0000","last_clean":"2023-11-13T18:41:29.715310+0000","last_became_active":"2023-11-13T11:28:47.001494+0000","last_became_peered":"2023-11-13T11:28:47.001494+0000","last_unstale":"2023-11-13T18:41:29.715310+0000","last_undegraded":"2023-11-13T18:41:29.715310+0000","last_fullsized":"2023-11-13T18:41:29.715310+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-13T11:28:45.879416+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-13T11:28:45.879416+0000","last_clean_scrub_stamp":"2023-11-13T11:28:45.879416+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-14T14:38:55.166320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":15,"seq":64424514635,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5127268,"kb_used_data":3390556,"kb_used_omap":112,"kb_used_meta":1736591,"kb_avail":89244572,"statfs":{"total":96636764160,"available":91386441728,"internally_reserved":0,"allocated":3471929344,"data_stored":3464245951,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":115290,"internal_metadata":1778269606},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,1],"upper_bound":32},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Nov 13 18:40:24 2023","interfaces":[{"interface":"back","average":{"1min":1.3,"5min":1.3149999999999999,"15min":1.502},"min":{"1min":0.40100000000000002,"5min":0.35899999999999999,"15min":0.307},"max":{"1min":5.3769999999999998,"5min":7.2640000000000002,"15min":10.75},"last":3.2709999999999999},{"interface":"front","average":{"1min":1.6379999999999999,"5min":1.5780000000000001,"15min":1.5620000000000001},"min":{"1min":0.57699999999999996,"5min":0.36899999999999999,"15min":0.317},"max":{"1min":8.3000000000000007,"5min":8.3000000000000007,"15min":8.3000000000000007},"last":1.1819999999999999}]},{"osd":1,"last update":"Mon Nov 13 18:40:24 2023","interfaces":[{"interface":"back","average":{"1min":1.726,"5min":1.488,"15min":1.5429999999999999},"min":{"1min":0.46500000000000002,"5min":0.439,"15min":0.39100000000000001},"max":{"1min":5.6639999999999997,"5min":7.859,"15min":7.859},"last":0.58499999999999996},{"interface":"front","average":{"1min":1.232,"5min":1.486,"15min":1.6919999999999999},"min":{"1min":0.40999999999999998,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":2.423,"5min":7.399,"15min":10.238},"last":0.38500000000000001}]},{"osd":2,"last update":"Mon Nov 13 18:40:24 2023","interfaces":[{"interface":"back","average":{"1min":1.712,"5min":1.7529999999999999,"15min":1.7829999999999999},"min":{"1min":0.56000000000000005,"5min":0.54700000000000004,"15min":0.47499999999999998},"max":{"1min":4.3079999999999998,"5min":8.7929999999999993,"15min":13.769},"last":0.79400000000000004},{"interface":"front","average":{"1min":1.712,"5min":1.452,"15min":1.6919999999999999},"min":{"1min":0.57999999999999996,"5min":0.42699999999999999,"15min":0.42199999999999999},"max":{"1min":5.4080000000000004,"5min":9.7799999999999994,"15min":16.114999999999998},"last":0.76500000000000001}]},{"osd":3,"last update":"Mon Nov 13 18:40:24 2023","interfaces":[{"interface":"back","average":{"1min":1.998,"5min":1.722,"15min":1.7210000000000001},"min":{"1min":0.77200000000000002,"5min":0.436,"15min":0.38500000000000001},"max":{"1min":4.9320000000000004,"5min":7.5999999999999996,"15min":8.9459999999999997},"last":0.82599999999999996},{"interface":"front","average":{"1min":2.3879999999999999,"5min":1.738,"15min":1.8460000000000001},"min":{"1min":0.45900000000000002,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":7.25,"5min":8.5470000000000006,"15min":11.696},"last":0.53500000000000003}]},{"osd":4,"last update":"Mon Nov 13 18:40:24 2023","interfaces":[{"interface":"back","average":{"1min":0.96899999999999997,"5min":0.70699999999999996,"15min":0.60399999999999998},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.32400000000000001},"max":{"1min":5.4400000000000004,"5min":7.8949999999999996,"15min":7.8949999999999996},"last":0.43099999999999999},{"interface":"front","average":{"1min":0.60499999999999998,"5min":0.65900000000000003,"15min":0.62},"min":{"1min":0.38300000000000001,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":2.306,"5min":7.5179999999999998,"15min":7.5179999999999998},"last":0.46700000000000003}]},{"osd":5,"last update":"Mon Nov 13 18:40:24 2023","interfaces":[{"interface":"back","average":{"1min":0.91600000000000004,"5min":0.73899999999999999,"15min":0.68700000000000006},"min":{"1min":0.41299999999999998,"5min":0.36499999999999999,"15min":0.36399999999999999},"max":{"1min":4.415,"5min":7.4800000000000004,"15min":7.4800000000000004},"last":0.48799999999999999},{"interface":"front","average":{"1min":1.069,"5min":0.83799999999999997,"15min":0.69999999999999996},"min":{"1min":0.437,"5min":0.379,"15min":0.379},"max":{"1min":5.665,"5min":9.8230000000000004,"15min":9.8230000000000004},"last":0.65200000000000002}]},{"osd":7,"last update":"Mon Nov 13 18:40:24 2023","interfaces":[{"interface":"back","average":{"1min":0.92200000000000004,"5min":0.78400000000000003,"15min":0.73499999999999999},"min":{"1min":0.434,"5min":0.39800000000000002,"15min":0.372},"max":{"1min":4.0199999999999996,"5min":7.5609999999999999,"15min":7.5609999999999999},"last":0.63400000000000001},{"interface":"front","average":{"1min":1.288,"5min":0.874,"15min":0.77600000000000002},"min":{"1min":0.47999999999999998,"5min":0.40899999999999997,"15min":0.40699999999999997},"max":{"1min":7.9880000000000004,"5min":7.9880000000000004,"15min":7.9880000000000004},"last":0.56999999999999995}]}]},{"osd":5,"up_from":15,"seq":64424514636,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":3974684,"kb_used_data":2405520,"kb_used_omap":582,"kb_used_meta":1568569,"kb_avail":90397156,"statfs":{"total":96636764160,"available":92566687744,"internally_reserved":0,"allocated":2463252480,"data_stored":2457635591,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":596886,"internal_metadata":1606214762},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":53,"apply_latency_ms":53,"commit_latency_ns":53000000,"apply_latency_ns":53000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Nov 13 18:40:47 2023","interfaces":[{"interface":"back","average":{"1min":2.431,"5min":1.8600000000000001,"15min":1.734},"min":{"1min":0.35599999999999998,"5min":0.307,"15min":0.307},"max":{"1min":22.651,"5min":22.651,"15min":41.409999999999997},"last":5.1799999999999997},{"interface":"front","average":{"1min":2.9729999999999999,"5min":2.0630000000000002,"15min":2.0129999999999999},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":19.431999999999999,"5min":19.431999999999999,"15min":44.783000000000001},"last":1.5109999999999999}]},{"osd":1,"last update":"Mon Nov 13 18:40:47 2023","interfaces":[{"interface":"back","average":{"1min":2.2229999999999999,"5min":1.754,"15min":1.8620000000000001},"min":{"1min":0.433,"5min":0.39600000000000002,"15min":0.374},"max":{"1min":22.616,"5min":22.616,"15min":22.616},"last":2.8639999999999999},{"interface":"front","average":{"1min":2.7400000000000002,"5min":1.887,"15min":1.675},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.38300000000000001},"max":{"1min":22.231000000000002,"5min":22.231000000000002,"15min":22.231000000000002},"last":2.3740000000000001}]},{"osd":2,"last update":"Mon Nov 13 18:40:47 2023","interfaces":[{"interface":"back","average":{"1min":2.9319999999999999,"5min":1.9359999999999999,"15min":1.9650000000000001},"min":{"1min":0.50900000000000001,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":13.291,"5min":13.291,"15min":45.125},"last":2.96},{"interface":"front","average":{"1min":3.7959999999999998,"5min":1.861,"15min":1.98},"min":{"1min":0.70699999999999996,"5min":0.47199999999999998,"15min":0.45800000000000002},"max":{"1min":14.776,"5min":14.776,"15min":44.991},"last":4.5910000000000002}]},{"osd":3,"last update":"Mon Nov 13 18:40:47 2023","interfaces":[{"interface":"back","average":{"1min":4.1859999999999999,"5min":2.0739999999999998,"15min":2.0150000000000001},"min":{"1min":0.53300000000000003,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":55.082999999999998,"5min":55.082999999999998,"15min":55.082999999999998},"last":7.6159999999999997},{"interface":"front","average":{"1min":4.2539999999999996,"5min":2.1859999999999999,"15min":2.0739999999999998},"min":{"1min":0.60499999999999998,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":55.040999999999997,"5min":55.040999999999997,"15min":55.040999999999997},"last":7.4660000000000002}]},{"osd":4,"last update":"Mon Nov 13 18:40:47 2023","interfaces":[{"interface":"back","average":{"1min":1.0409999999999999,"5min":0.70199999999999996,"15min":0.58499999999999996},"min":{"1min":0.34399999999999997,"5min":0.308,"15min":0.28599999999999998},"max":{"1min":7.3869999999999996,"5min":7.3869999999999996,"15min":7.3869999999999996},"last":0.68000000000000005},{"interface":"front","average":{"1min":0.95999999999999996,"5min":0.78100000000000003,"15min":0.64900000000000002},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.33700000000000002},"max":{"1min":7.4329999999999998,"5min":7.4329999999999998,"15min":7.4329999999999998},"last":0.71599999999999997}]},{"osd":6,"last update":"Mon Nov 13 18:40:47 2023","interfaces":[{"interface":"back","average":{"1min":0.98599999999999999,"5min":0.76700000000000002,"15min":0.63},"min":{"1min":0.35499999999999998,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":8.2690000000000001,"5min":8.2690000000000001,"15min":8.2690000000000001},"last":0.65000000000000002},{"interface":"front","average":{"1min":2.383,"5min":0.97199999999999998,"15min":0.70599999999999996},"min":{"1min":0.40200000000000002,"5min":0.35399999999999998,"15min":0.33900000000000002},"max":{"1min":22.547999999999998,"5min":22.547999999999998,"15min":22.547999999999998},"last":0.59799999999999998}]},{"osd":7,"last update":"Mon Nov 13 18:40:47 2023","interfaces":[{"interface":"back","average":{"1min":1.1020000000000001,"5min":0.78000000000000003,"15min":0.65600000000000003},"min":{"1min":0.45600000000000002,"5min":0.37,"15min":0.37},"max":{"1min":10.66,"5min":10.66,"15min":10.66},"last":0.76500000000000001},{"interface":"front","average":{"1min":0.747,"5min":0.77200000000000002,"15min":0.67100000000000004},"min":{"1min":0.46300000000000002,"5min":0.38800000000000001,"15min":0.36399999999999999},"max":{"1min":1.8109999999999999,"5min":3.9809999999999999,"15min":3.9809999999999999},"last":0.70099999999999996}]}]},{"osd":4,"up_from":15,"seq":64424514635,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5311836,"kb_used_data":3777404,"kb_used_omap":965,"kb_used_meta":1444154,"kb_avail":89060004,"statfs":{"total":96636764160,"available":91197444096,"internally_reserved":0,"allocated":3868061696,"data_stored":3859848765,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":988456,"internal_metadata":1478814424},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":52,"apply_latency_ms":52,"commit_latency_ns":52000000,"apply_latency_ns":52000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Nov 13 18:40:42 2023","interfaces":[{"interface":"back","average":{"1min":2.0859999999999999,"5min":1.599,"15min":1.867},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.316},"max":{"1min":18.532,"5min":18.532,"15min":88.278000000000006},"last":9.3450000000000006},{"interface":"front","average":{"1min":1.923,"5min":1.3320000000000001,"15min":1.786},"min":{"1min":0.56999999999999995,"5min":0.36599999999999999,"15min":0.33900000000000002},"max":{"1min":5.2750000000000004,"5min":5.5170000000000003,"15min":88.555000000000007},"last":16.440999999999999}]},{"osd":1,"last update":"Mon Nov 13 18:40:42 2023","interfaces":[{"interface":"back","average":{"1min":2.6269999999999998,"5min":1.9079999999999999,"15min":2.1509999999999998},"min":{"1min":0.35499999999999998,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":20.643000000000001,"5min":20.643000000000001,"15min":85.168999999999997},"last":9.2100000000000009},{"interface":"front","average":{"1min":2.4569999999999999,"5min":1.726,"15min":1.9630000000000001},"min":{"1min":0.42399999999999999,"5min":0.376,"15min":0.376},"max":{"1min":24.550999999999998,"5min":24.550999999999998,"15min":85.587999999999994},"last":17.658999999999999}]},{"osd":2,"last update":"Mon Nov 13 18:40:42 2023","interfaces":[{"interface":"back","average":{"1min":1.631,"5min":1.6220000000000001,"15min":1.673},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.38600000000000001},"max":{"1min":6.0720000000000001,"5min":6.0720000000000001,"15min":14.832000000000001},"last":17.603000000000002},{"interface":"front","average":{"1min":3.073,"5min":1.8540000000000001,"15min":1.5640000000000001},"min":{"1min":0.45600000000000002,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":27.375,"5min":27.375,"15min":27.375},"last":6.4809999999999999}]},{"osd":3,"last update":"Mon Nov 13 18:40:42 2023","interfaces":[{"interface":"back","average":{"1min":1.571,"5min":1.8720000000000001,"15min":1.841},"min":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.48199999999999998},"max":{"1min":6.4619999999999997,"5min":6.4619999999999997,"15min":11.146000000000001},"last":3.9569999999999999},{"interface":"front","average":{"1min":1.992,"5min":1.968,"15min":1.8979999999999999},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.46300000000000002},"max":{"1min":11.362,"5min":11.362,"15min":11.362},"last":10.461}]},{"osd":5,"last update":"Mon Nov 13 18:40:42 2023","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":0.56000000000000005,"15min":0.53100000000000003},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.30199999999999999},"max":{"1min":1.9399999999999999,"5min":1.9399999999999999,"15min":2.1720000000000002},"last":2.105},{"interface":"front","average":{"1min":0.48399999999999999,"5min":0.56100000000000005,"15min":0.56399999999999995},"min":{"1min":0.39200000000000002,"5min":0.33900000000000002,"15min":0.309},"max":{"1min":0.72899999999999998,"5min":1.7909999999999999,"15min":2.2890000000000001},"last":3.9990000000000001}]},{"osd":6,"last update":"Mon Nov 13 18:40:42 2023","interfaces":[{"interface":"back","average":{"1min":0.76900000000000002,"5min":0.65800000000000003,"15min":0.61299999999999999},"min":{"1min":0.40200000000000002,"5min":0.314,"15min":0.314},"max":{"1min":5.9500000000000002,"5min":5.9500000000000002,"15min":5.9500000000000002},"last":10.372999999999999},{"interface":"front","average":{"1min":0.622,"5min":0.65300000000000002,"15min":0.63700000000000001},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":1.9930000000000001,"5min":3.4590000000000001,"15min":3.6850000000000001},"last":9.2949999999999999}]},{"osd":7,"last update":"Mon Nov 13 18:40:42 2023","interfaces":[{"interface":"back","average":{"1min":0.78700000000000003,"5min":0.69999999999999996,"15min":0.66700000000000004},"min":{"1min":0.42799999999999999,"5min":0.374,"15min":0.35899999999999999},"max":{"1min":5.3300000000000001,"5min":5.3300000000000001,"15min":5.3300000000000001},"last":3.8999999999999999},{"interface":"front","average":{"1min":0.94999999999999996,"5min":0.76800000000000002,"15min":0.71399999999999997},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":7.8789999999999996,"5min":7.8789999999999996,"15min":7.8789999999999996},"last":10.755000000000001}]}]},{"osd":3,"up_from":15,"seq":64424514579,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":4789676,"kb_used_data":3018652,"kb_used_omap":1085,"kb_used_meta":1769922,"kb_avail":89582164,"statfs":{"total":96636764160,"available":91732135936,"internally_reserved":0,"allocated":3091099648,"data_stored":3084722185,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1111813,"internal_metadata":1812400379},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":386,"apply_latency_ms":386,"commit_latency_ns":386000000,"apply_latency_ns":386000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Nov 13 18:40:54 2023","interfaces":[{"interface":"back","average":{"1min":3.7240000000000002,"5min":3.4089999999999998,"15min":3.306},"min":{"1min":0.54800000000000004,"5min":0.377,"15min":0.311},"max":{"1min":23.887,"5min":23.887,"15min":23.887},"last":11.821},{"interface":"front","average":{"1min":6.5469999999999997,"5min":3.54,"15min":3.4470000000000001},"min":{"1min":0.70299999999999996,"5min":0.52100000000000002,"15min":0.35799999999999998},"max":{"1min":48.045999999999999,"5min":48.045999999999999,"15min":48.045999999999999},"last":12.124000000000001}]},{"osd":1,"last update":"Mon Nov 13 18:40:54 2023","interfaces":[{"interface":"back","average":{"1min":3.036,"5min":3.1019999999999999,"15min":3.54},"min":{"1min":0.60699999999999998,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":11.631,"5min":23.428000000000001,"15min":100.48},"last":2.105},{"interface":"front","average":{"1min":3.6779999999999999,"5min":3.5710000000000002,"15min":3.4969999999999999},"min":{"1min":0.63700000000000001,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":13.286,"5min":21.818999999999999,"15min":21.818999999999999},"last":2.585}]},{"osd":2,"last update":"Mon Nov 13 18:40:54 2023","interfaces":[{"interface":"back","average":{"1min":6.6559999999999997,"5min":3.8809999999999998,"15min":4.0259999999999998},"min":{"1min":0.67600000000000005,"5min":0.53600000000000003,"15min":0.53200000000000003},"max":{"1min":21.638999999999999,"5min":22.738,"15min":100.589},"last":2.444},{"interface":"front","average":{"1min":3.3759999999999999,"5min":3.6099999999999999,"15min":3.617},"min":{"1min":0.74399999999999999,"5min":0.63900000000000001,"15min":0.439},"max":{"1min":8.3759999999999994,"5min":21.300999999999998,"15min":21.300999999999998},"last":2.633}]},{"osd":4,"last update":"Mon Nov 13 18:40:54 2023","interfaces":[{"interface":"back","average":{"1min":4.2240000000000002,"5min":2.7269999999999999,"15min":2.637},"min":{"1min":0.69999999999999996,"5min":0.55700000000000005,"15min":0.46200000000000002},"max":{"1min":26.68,"5min":26.68,"15min":26.68},"last":2.8330000000000002},{"interface":"front","average":{"1min":3.625,"5min":2.9060000000000001,"15min":2.5979999999999999},"min":{"1min":0.70899999999999996,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":17.091000000000001,"5min":23.655999999999999,"15min":23.655999999999999},"last":11.794}]},{"osd":5,"last update":"Mon Nov 13 18:40:54 2023","interfaces":[{"interface":"back","average":{"1min":3.8359999999999999,"5min":3.028,"15min":2.778},"min":{"1min":0.64700000000000002,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":21.454999999999998,"5min":23.75,"15min":23.75},"last":11.74},{"interface":"front","average":{"1min":2.5859999999999999,"5min":2.9470000000000001,"15min":2.7810000000000001},"min":{"1min":0.98499999999999999,"5min":0.66900000000000004,"15min":0.46700000000000003},"max":{"1min":7.9420000000000002,"5min":22.007000000000001,"15min":22.007000000000001},"last":11.867000000000001}]},{"osd":6,"last update":"Mon Nov 13 18:40:54 2023","interfaces":[{"interface":"back","average":{"1min":4.218,"5min":2.919,"15min":2.782},"min":{"1min":0.83899999999999997,"5min":0.626,"15min":0.52500000000000002},"max":{"1min":26.844999999999999,"5min":26.844999999999999,"15min":26.844999999999999},"last":26.965},{"interface":"front","average":{"1min":3.9020000000000001,"5min":3.1419999999999999,"15min":3.218},"min":{"1min":0.67800000000000005,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":21.555,"5min":23.841000000000001,"15min":100.315},"last":2.5619999999999998}]},{"osd":7,"last update":"Mon Nov 13 18:40:54 2023","interfaces":[{"interface":"back","average":{"1min":3.1739999999999999,"5min":3.2069999999999999,"15min":3.0059999999999998},"min":{"1min":1.0369999999999999,"5min":0.749,"15min":0.55500000000000005},"max":{"1min":12.794,"5min":22.087,"15min":22.087},"last":11.901},{"interface":"front","average":{"1min":4.9820000000000002,"5min":3.1230000000000002,"15min":2.9900000000000002},"min":{"1min":1.0209999999999999,"5min":0.621,"15min":0.55500000000000005},"max":{"1min":26.939,"5min":26.939,"15min":26.939},"last":12.836}]}]},{"osd":2,"up_from":15,"seq":64424514577,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5772700,"kb_used_data":4072336,"kb_used_omap":688,"kb_used_meta":1699663,"kb_avail":88599140,"statfs":{"total":96636764160,"available":90725519360,"internally_reserved":0,"allocated":4170072064,"data_stored":4160954051,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":705113,"internal_metadata":1740455335},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Nov 13 18:41:20 2023","interfaces":[{"interface":"back","average":{"1min":3.8010000000000002,"5min":3.2360000000000002,"15min":3.1880000000000002},"min":{"1min":0.50600000000000001,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":32.695999999999998,"5min":32.695999999999998,"15min":32.695999999999998},"last":0.83799999999999997},{"interface":"front","average":{"1min":4.8170000000000002,"5min":3.254,"15min":3.258},"min":{"1min":0.71999999999999997,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":31.927,"5min":31.927,"15min":31.927},"last":1.175}]},{"osd":1,"last update":"Mon Nov 13 18:41:20 2023","interfaces":[{"interface":"back","average":{"1min":2.5430000000000001,"5min":2.8119999999999998,"15min":3.2949999999999999},"min":{"1min":0.58199999999999996,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":7.6050000000000004,"5min":14.593,"15min":19.190999999999999},"last":1.0309999999999999},{"interface":"front","average":{"1min":2.984,"5min":3.613,"15min":3.6469999999999998},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":9.8849999999999998,"5min":22.782,"15min":22.782},"last":0.66000000000000003}]},{"osd":3,"last update":"Mon Nov 13 18:41:20 2023","interfaces":[{"interface":"back","average":{"1min":3.472,"5min":3.3849999999999998,"15min":3.3969999999999998},"min":{"1min":0.64600000000000002,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":23.966999999999999,"5min":27.233000000000001,"15min":27.233000000000001},"last":0.64300000000000002},{"interface":"front","average":{"1min":3.359,"5min":3.1059999999999999,"15min":3.516},"min":{"1min":0.68600000000000005,"5min":0.52300000000000002,"15min":0.40799999999999997},"max":{"1min":13.298,"5min":14.244999999999999,"15min":20.870000000000001},"last":1.147}]},{"osd":4,"last update":"Mon Nov 13 18:41:20 2023","interfaces":[{"interface":"back","average":{"1min":3.3199999999999998,"5min":2.4460000000000002,"15min":2.7589999999999999},"min":{"1min":0.61699999999999999,"5min":0.46600000000000003,"15min":0.45400000000000001},"max":{"1min":29.552,"5min":29.552,"15min":29.552},"last":1.2210000000000001},{"interface":"front","average":{"1min":3.5760000000000001,"5min":2.7240000000000002,"15min":2.7010000000000001},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":24.064,"5min":24.064,"15min":24.064},"last":1.091}]},{"osd":5,"last update":"Mon Nov 13 18:41:20 2023","interfaces":[{"interface":"back","average":{"1min":3.1150000000000002,"5min":3.0419999999999998,"15min":2.7799999999999998},"min":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.55900000000000005},"max":{"1min":23.722999999999999,"5min":30.375,"15min":30.375},"last":1.0680000000000001},{"interface":"front","average":{"1min":2.5739999999999998,"5min":2.3980000000000001,"15min":2.831},"min":{"1min":0.64600000000000002,"5min":0.51900000000000002,"15min":0.49399999999999999},"max":{"1min":12.026,"5min":14.148999999999999,"15min":14.148999999999999},"last":1.292}]},{"osd":6,"last update":"Mon Nov 13 18:41:20 2023","interfaces":[{"interface":"back","average":{"1min":3.573,"5min":2.8159999999999998,"15min":2.8399999999999999},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":21.073,"5min":21.073,"15min":21.073},"last":1.1200000000000001},{"interface":"front","average":{"1min":3.9820000000000002,"5min":3.2930000000000001,"15min":3.0310000000000001},"min":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":35.908999999999999,"5min":35.908999999999999,"15min":35.908999999999999},"last":0.93300000000000005}]},{"osd":7,"last update":"Mon Nov 13 18:41:20 2023","interfaces":[{"interface":"back","average":{"1min":3.6829999999999998,"5min":3.0299999999999998,"15min":2.988},"min":{"1min":0.66600000000000004,"5min":0.57899999999999996,"15min":0.55300000000000005},"max":{"1min":20.969000000000001,"5min":20.969000000000001,"15min":20.969000000000001},"last":0.99299999999999999},{"interface":"front","average":{"1min":3.5419999999999998,"5min":3.387,"15min":3.1339999999999999},"min":{"1min":0.80700000000000005,"5min":0.748,"15min":0.63400000000000001},"max":{"1min":23.847000000000001,"5min":26.902000000000001,"15min":26.902000000000001},"last":0.79300000000000004}]}]},{"osd":1,"up_from":15,"seq":64424514592,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":2883324,"kb_used_data":1344140,"kb_used_omap":147,"kb_used_meta":1514156,"kb_avail":91488516,"statfs":{"total":96636764160,"available":93684240384,"internally_reserved":0,"allocated":1376399360,"data_stored":1372987178,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":150803,"internal_metadata":1550496493},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":212,"apply_latency_ms":212,"commit_latency_ns":212000000,"apply_latency_ns":212000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Nov 13 18:41:25 2023","interfaces":[{"interface":"back","average":{"1min":2.569,"5min":2.7400000000000002,"15min":2.8730000000000002},"min":{"1min":0.67000000000000004,"5min":0.435,"15min":0.29299999999999998},"max":{"1min":8.0800000000000001,"5min":11.255000000000001,"15min":14.548999999999999},"last":5.3399999999999999},{"interface":"front","average":{"1min":2.2589999999999999,"5min":3.2450000000000001,"15min":3.3519999999999999},"min":{"1min":0.47399999999999998,"5min":0.45300000000000001,"15min":0.38300000000000001},"max":{"1min":4.2030000000000003,"5min":26.187999999999999,"15min":26.187999999999999},"last":2.2959999999999998}]},{"osd":2,"last update":"Mon Nov 13 18:41:25 2023","interfaces":[{"interface":"back","average":{"1min":2.9590000000000001,"5min":2.9460000000000002,"15min":2.964},"min":{"1min":0.55800000000000005,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":8.2059999999999995,"5min":11.381,"15min":12.708},"last":5.0270000000000001},{"interface":"front","average":{"1min":2.3610000000000002,"5min":3.3839999999999999,"15min":3.21},"min":{"1min":0.69499999999999995,"5min":0.54300000000000004,"15min":0.44},"max":{"1min":4.3109999999999999,"5min":27.844999999999999,"15min":27.844999999999999},"last":7.8780000000000001}]},{"osd":3,"last update":"Mon Nov 13 18:41:25 2023","interfaces":[{"interface":"back","average":{"1min":3.0779999999999998,"5min":3.7280000000000002,"15min":3.5699999999999998},"min":{"1min":0.872,"5min":0.66400000000000003,"15min":0.44400000000000001},"max":{"1min":8.5470000000000006,"5min":27.838999999999999,"15min":27.838999999999999},"last":8.0790000000000006},{"interface":"front","average":{"1min":2.286,"5min":2.948,"15min":3.1920000000000002},"min":{"1min":0.61799999999999999,"5min":0.50800000000000001,"15min":0.436},"max":{"1min":4.2190000000000003,"5min":12.034000000000001,"15min":15.619},"last":0.66400000000000003}]},{"osd":4,"last update":"Mon Nov 13 18:41:25 2023","interfaces":[{"interface":"back","average":{"1min":2.0259999999999998,"5min":2.782,"15min":2.617},"min":{"1min":0.71499999999999997,"5min":0.57999999999999996,"15min":0.46300000000000002},"max":{"1min":4.024,"5min":27.952000000000002,"15min":27.952000000000002},"last":5.0679999999999996},{"interface":"front","average":{"1min":2.9049999999999998,"5min":2.714,"15min":2.4449999999999998},"min":{"1min":0.65800000000000003,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":8.3170000000000002,"5min":27.678999999999998,"15min":27.678999999999998},"last":5.226}]},{"osd":5,"last update":"Mon Nov 13 18:41:25 2023","interfaces":[{"interface":"back","average":{"1min":3.044,"5min":3.073,"15min":2.6360000000000001},"min":{"1min":0.70299999999999996,"5min":0.54600000000000004,"15min":0.52500000000000002},"max":{"1min":8.5020000000000007,"5min":27.588999999999999,"15min":27.588999999999999},"last":0.99199999999999999},{"interface":"front","average":{"1min":2.4060000000000001,"5min":3.2229999999999999,"15min":2.7770000000000001},"min":{"1min":0.73499999999999999,"5min":0.69999999999999996,"15min":0.47299999999999998},"max":{"1min":4.282,"5min":26.579999999999998,"15min":26.579999999999998},"last":7.9219999999999997}]},{"osd":6,"last update":"Mon Nov 13 18:41:25 2023","interfaces":[{"interface":"back","average":{"1min":2.1749999999999998,"5min":3.157,"15min":2.8370000000000002},"min":{"1min":0.93700000000000006,"5min":0.54900000000000004,"15min":0.48299999999999998},"max":{"1min":4.5750000000000002,"5min":29.478999999999999,"15min":29.478999999999999},"last":3.9420000000000002},{"interface":"front","average":{"1min":3.0859999999999999,"5min":3.2229999999999999,"15min":2.8010000000000002},"min":{"1min":0.73999999999999999,"5min":0.57999999999999996,"15min":0.57999999999999996},"max":{"1min":8.4109999999999996,"5min":36.837000000000003,"15min":36.837000000000003},"last":4.4039999999999999}]},{"osd":7,"last update":"Mon Nov 13 18:41:25 2023","interfaces":[{"interface":"back","average":{"1min":2.5590000000000002,"5min":3.2959999999999998,"15min":2.8780000000000001},"min":{"1min":0.70199999999999996,"5min":0.626,"15min":0.54200000000000004},"max":{"1min":4.3879999999999999,"5min":26.622,"15min":26.622},"last":8.8360000000000003},{"interface":"front","average":{"1min":2.3879999999999999,"5min":3.1619999999999999,"15min":2.9420000000000002},"min":{"1min":0.93400000000000005,"5min":0.65900000000000003,"15min":0.54100000000000004},"max":{"1min":5.2649999999999997,"5min":25.965,"15min":25.965},"last":1.077}]}]},{"osd":0,"up_from":15,"seq":64424514585,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":4501200,"kb_used_data":3156548,"kb_used_omap":245,"kb_used_meta":1344394,"kb_avail":89870640,"statfs":{"total":96636764160,"available":92027535360,"internally_reserved":0,"allocated":3232305152,"data_stored":3225143385,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":251097,"internal_metadata":1376660263},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":158,"apply_latency_ms":158,"commit_latency_ns":158000000,"apply_latency_ns":158000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Nov 13 18:41:05 2023","interfaces":[{"interface":"back","average":{"1min":2.6619999999999999,"5min":2.569,"15min":3.3380000000000001},"min":{"1min":0.64500000000000002,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":6.29,"5min":8.3640000000000008,"15min":132.19800000000001},"last":1.2929999999999999},{"interface":"front","average":{"1min":2.6909999999999998,"5min":2.9169999999999998,"15min":3.4470000000000001},"min":{"1min":0.54500000000000004,"5min":0.46400000000000002,"15min":0.45900000000000002},"max":{"1min":11.978999999999999,"5min":13.000999999999999,"15min":125.517},"last":1.4350000000000001}]},{"osd":2,"last update":"Mon Nov 13 18:41:05 2023","interfaces":[{"interface":"back","average":{"1min":2.3439999999999999,"5min":2.8050000000000002,"15min":3.2269999999999999},"min":{"1min":0.65400000000000003,"5min":0.372,"15min":0.372},"max":{"1min":6.2320000000000002,"5min":8.8879999999999999,"15min":13.459},"last":0.65800000000000003},{"interface":"front","average":{"1min":4.1520000000000001,"5min":3.327,"15min":3.395},"min":{"1min":0.75900000000000001,"5min":0.66000000000000003,"15min":0.44800000000000001},"max":{"1min":16.423999999999999,"5min":16.423999999999999,"15min":16.423999999999999},"last":0.82799999999999996}]},{"osd":3,"last update":"Mon Nov 13 18:41:05 2023","interfaces":[{"interface":"back","average":{"1min":3.8980000000000001,"5min":3.1040000000000001,"15min":3.133},"min":{"1min":0.69399999999999995,"5min":0.69399999999999995,"15min":0.45900000000000002},"max":{"1min":15.502000000000001,"5min":15.502000000000001,"15min":15.502000000000001},"last":1.2290000000000001},{"interface":"front","average":{"1min":3.5019999999999998,"5min":3.3010000000000002,"15min":3.5459999999999998},"min":{"1min":0.70099999999999996,"5min":0.67900000000000005,"15min":0.441},"max":{"1min":15.955,"5min":15.955,"15min":20.747},"last":0.57899999999999996}]},{"osd":4,"last update":"Mon Nov 13 18:41:05 2023","interfaces":[{"interface":"back","average":{"1min":2.5750000000000002,"5min":2.2290000000000001,"15min":2.4689999999999999},"min":{"1min":0.77400000000000002,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":6.2539999999999996,"5min":9.3949999999999996,"15min":10.611000000000001},"last":0.91600000000000004},{"interface":"front","average":{"1min":2.4300000000000002,"5min":2.3260000000000001,"15min":2.6560000000000001},"min":{"1min":0.78800000000000003,"5min":0.51800000000000002,"15min":0.48899999999999999},"max":{"1min":5.9619999999999997,"5min":8.7780000000000005,"15min":12.353999999999999},"last":0.70599999999999996}]},{"osd":5,"last update":"Mon Nov 13 18:41:05 2023","interfaces":[{"interface":"back","average":{"1min":2.8170000000000002,"5min":2.3399999999999999,"15min":2.4849999999999999},"min":{"1min":0.66300000000000003,"5min":0.66300000000000003,"15min":0.501},"max":{"1min":12.470000000000001,"5min":12.470000000000001,"15min":12.470000000000001},"last":1.155},{"interface":"front","average":{"1min":2.6709999999999998,"5min":2.3740000000000001,"15min":2.6309999999999998},"min":{"1min":0.81599999999999995,"5min":0.63700000000000001,"15min":0.50600000000000001},"max":{"1min":6.3810000000000002,"5min":9.516,"15min":9.9640000000000004},"last":1.0649999999999999}]},{"osd":6,"last update":"Mon Nov 13 18:41:05 2023","interfaces":[{"interface":"back","average":{"1min":2.8660000000000001,"5min":2.532,"15min":2.8599999999999999},"min":{"1min":0.92400000000000004,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":13.348000000000001,"5min":13.348000000000001,"15min":13.348000000000001},"last":0.77500000000000002},{"interface":"front","average":{"1min":2.629,"5min":2.4319999999999999,"15min":2.6360000000000001},"min":{"1min":0.84599999999999997,"5min":0.60499999999999998,"15min":0.56799999999999995},"max":{"1min":12.191000000000001,"5min":12.191000000000001,"15min":12.191000000000001},"last":0.98699999999999999}]},{"osd":7,"last update":"Mon Nov 13 18:41:05 2023","interfaces":[{"interface":"back","average":{"1min":2.8999999999999999,"5min":2.5859999999999999,"15min":2.742},"min":{"1min":0.76000000000000001,"5min":0.64900000000000002,"15min":0.51400000000000001},"max":{"1min":12.289999999999999,"5min":12.289999999999999,"15min":12.289999999999999},"last":1.3420000000000001},{"interface":"front","average":{"1min":2.9089999999999998,"5min":2.5489999999999999,"15min":2.7629999999999999},"min":{"1min":1.0409999999999999,"5min":0.64400000000000002,"15min":0.57499999999999996},"max":{"1min":6.4749999999999996,"5min":9.6199999999999992,"15min":10.743},"last":1.3939999999999999}]}]},{"osd":7,"up_from":14,"seq":60129547340,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":4416560,"kb_used_data":2773732,"kb_used_omap":129,"kb_used_meta":1642686,"kb_avail":89955280,"statfs":{"total":96636764160,"available":92114206720,"internally_reserved":0,"allocated":2840301568,"data_stored":2833741222,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":132782,"internal_metadata":1682110802},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Nov 13 18:40:36 2023","interfaces":[{"interface":"back","average":{"1min":2.3490000000000002,"5min":1.831,"15min":1.7769999999999999},"min":{"1min":0.47899999999999998,"5min":0.34100000000000003,"15min":0.30599999999999999},"max":{"1min":11.522,"5min":11.522,"15min":11.522},"last":0.73499999999999999},{"interface":"front","average":{"1min":2.008,"5min":1.78,"15min":1.613},"min":{"1min":0.57099999999999995,"5min":0.39300000000000002,"15min":0.377},"max":{"1min":6.234,"5min":8.1430000000000007,"15min":9.266},"last":0.873}]},{"osd":1,"last update":"Mon Nov 13 18:40:36 2023","interfaces":[{"interface":"back","average":{"1min":2.359,"5min":1.9399999999999999,"15min":1.804},"min":{"1min":0.376,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":9.4909999999999997,"5min":9.4909999999999997,"15min":9.4909999999999997},"last":0.68100000000000005},{"interface":"front","average":{"1min":2.2970000000000002,"5min":2.04,"15min":1.8640000000000001},"min":{"1min":0.47699999999999998,"5min":0.39500000000000002,"15min":0.35599999999999998},"max":{"1min":8.1280000000000001,"5min":8.702,"15min":9.4939999999999998},"last":0.69799999999999995}]},{"osd":2,"last update":"Mon Nov 13 18:40:36 2023","interfaces":[{"interface":"back","average":{"1min":2.3439999999999999,"5min":1.9590000000000001,"15min":1.8480000000000001},"min":{"1min":0.57799999999999996,"5min":0.51000000000000001,"15min":0.38400000000000001},"max":{"1min":11.859999999999999,"5min":11.859999999999999,"15min":11.859999999999999},"last":0.76500000000000001},{"interface":"front","average":{"1min":2.125,"5min":1.905,"15min":1.825},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.45100000000000001},"max":{"1min":10.455,"5min":10.455,"15min":10.835000000000001},"last":0.90400000000000003}]},{"osd":3,"last update":"Mon Nov 13 18:40:36 2023","interfaces":[{"interface":"back","average":{"1min":2.0350000000000001,"5min":1.829,"15min":1.7909999999999999},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":13.727,"5min":13.727,"15min":13.727},"last":1.0980000000000001},{"interface":"front","average":{"1min":1.605,"5min":1.7749999999999999,"15min":1.9970000000000001},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.44500000000000001},"max":{"1min":7.5199999999999996,"5min":11.156000000000001,"15min":11.156000000000001},"last":0.80900000000000005}]},{"osd":4,"last update":"Mon Nov 13 18:40:36 2023","interfaces":[{"interface":"back","average":{"1min":0.63500000000000001,"5min":0.58299999999999996,"15min":0.56100000000000005},"min":{"1min":0.39700000000000002,"5min":0.33600000000000002,"15min":0.32700000000000001},"max":{"1min":1.869,"5min":4.4699999999999998,"15min":4.4699999999999998},"last":0.57099999999999995},{"interface":"front","average":{"1min":2.8740000000000001,"5min":1.1859999999999999,"15min":0.79000000000000004},"min":{"1min":0.378,"5min":0.34799999999999998,"15min":0.32100000000000001},"max":{"1min":38.662999999999997,"5min":38.662999999999997,"15min":38.662999999999997},"last":0.55800000000000005}]},{"osd":5,"last update":"Mon Nov 13 18:40:36 2023","interfaces":[{"interface":"back","average":{"1min":0.60799999999999998,"5min":0.63700000000000001,"15min":0.622},"min":{"1min":0.36099999999999999,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":2.234,"5min":6.5010000000000003,"15min":6.5010000000000003},"last":0.46100000000000002},{"interface":"front","average":{"1min":0.70099999999999996,"5min":0.70899999999999996,"15min":0.65100000000000002},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":1.74,"5min":7.8680000000000003,"15min":7.8680000000000003},"last":0.496}]},{"osd":6,"last update":"Mon Nov 13 18:40:36 2023","interfaces":[{"interface":"back","average":{"1min":0.78100000000000003,"5min":0.88400000000000001,"15min":0.73699999999999999},"min":{"1min":0.46100000000000002,"5min":0.43099999999999999,"15min":0.40200000000000002},"max":{"1min":2.0600000000000001,"5min":19.218,"15min":19.218},"last":0.54400000000000004},{"interface":"front","average":{"1min":1.4750000000000001,"5min":0.88100000000000001,"15min":0.748},"min":{"1min":0.38,"5min":0.38,"15min":0.37},"max":{"1min":13.677,"5min":13.677,"15min":13.677},"last":0.52000000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-13T18:41:39.138 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-13T18:41:40.132 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:40.124+0000 7fcb797aa640 1 Processor -- start 2023-11-13T18:41:40.134 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:40.124+0000 7fcb797aa640 1 -- start start 2023-11-13T18:41:40.142 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:40.132+0000 7fcb797aa640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fcb741606a0 0x7fcb740b2640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T18:41:40.144 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:40.136+0000 7fcb727fc640 1 --1- >> v1:172.21.15.102:6789/0 conn(0x7fcb740d3430 0x7fcb740ce670 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.102:6789/0 says I am v1:172.21.15.102:47490/0 (socket says 172.21.15.102:47490) 2023-11-13T18:41:40.145 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:40.136+0000 7fcb797aa640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7fcb740b2b80 0x7fcb740cf640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T18:41:40.145 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:40.136+0000 7fcb737fe640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7fcb740b2b80 0x7fcb740cf640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T18:41:40.146 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:40.136+0000 7fcb737fe640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7fcb740b2b80 0x7fcb740cf640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:55128/0 (socket says 172.21.15.102:55128) 2023-11-13T18:41:40.147 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:40.136+0000 7fcb797aa640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcb740cd8f0 con 0x7fcb740d3430 2023-11-13T18:41:40.147 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:40.136+0000 7fcb797aa640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcb740d3c80 con 0x7fcb740b2b80 2023-11-13T18:41:40.148 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:40.136+0000 7fcb797aa640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcb740d39a0 con 0x7fcb741606a0 2023-11-13T18:41:40.148 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:40.136+0000 7fcb727fc640 1 -- 172.21.15.102:0/3777619287 learned_addr learned my addr 172.21.15.102:0/3777619287 (peer_addr_for_me v1:172.21.15.102:0/0) 2023-11-13T18:41:40.148 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:40.136+0000 7fcb72ffd640 1 --2- 172.21.15.102:0/3777619287 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fcb741606a0 0x7fcb740b2640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T18:41:40.149 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:40.136+0000 7fcb71ffb640 1 -- 172.21.15.102:0/3777619287 <== mon.0 v1:172.21.15.102:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1718974965 0 0) 0x7fcb740cd8f0 con 0x7fcb740d3430 2023-11-13T18:41:40.149 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:40.136+0000 7fcb71ffb640 1 -- 172.21.15.102:0/3777619287 --> v1:172.21.15.102:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcb5c003530 con 0x7fcb740d3430 2023-11-13T18:41:40.152 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:40.140+0000 7fcb72ffd640 1 -- 172.21.15.102:0/3777619287 >> v2:172.21.15.102:3300/0 conn(0x7fcb740b2b80 msgr2=0x7fcb740cf640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-13T18:41:40.152 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:40.140+0000 7fcb72ffd640 1 --2- 172.21.15.102:0/3777619287 >> v2:172.21.15.102:3300/0 conn(0x7fcb740b2b80 0x7fcb740cf640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T18:41:40.152 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:40.140+0000 7fcb72ffd640 1 -- 172.21.15.102:0/3777619287 >> v1:172.21.15.102:6789/0 conn(0x7fcb740d3430 legacy=0x7fcb740ce670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T18:41:40.153 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:40.140+0000 7fcb72ffd640 1 -- 172.21.15.102:0/3777619287 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb740cdb90 con 0x7fcb741606a0 2023-11-13T18:41:40.184 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:40.168+0000 7fcb72ffd640 1 --2- 172.21.15.102:0/3777619287 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fcb741606a0 0x7fcb740b2640 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7fcb640097c0 tx=0x7fcb6401c470 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cdf7bacfce37d3e3 server_cookie=0 in_seq=0 out_seq=0 2023-11-13T18:41:40.185 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:40.168+0000 7fcb71ffb640 1 -- 172.21.15.102:0/3777619287 <== mon.2 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb640ab650 con 0x7fcb741606a0 2023-11-13T18:41:40.185 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:40.168+0000 7fcb71ffb640 1 -- 172.21.15.102:0/3777619287 <== mon.2 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb640ab7b0 con 0x7fcb741606a0 2023-11-13T18:41:40.185 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:40.168+0000 7fcb71ffb640 1 -- 172.21.15.102:0/3777619287 <== mon.2 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb640abb40 con 0x7fcb741606a0 2023-11-13T18:41:40.186 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:40.172+0000 7fcb797aa640 1 -- 172.21.15.102:0/3777619287 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fcb741606a0 msgr2=0x7fcb740b2640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T18:41:40.186 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:40.172+0000 7fcb797aa640 1 --2- 172.21.15.102:0/3777619287 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fcb741606a0 0x7fcb740b2640 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7fcb640097c0 tx=0x7fcb6401c470 comp rx=0 tx=0).stop 2023-11-13T18:41:40.187 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:40.176+0000 7fcb797aa640 1 -- 172.21.15.102:0/3777619287 shutdown_connections 2023-11-13T18:41:40.187 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:40.176+0000 7fcb797aa640 1 --2- 172.21.15.102:0/3777619287 >> v2:172.21.15.102:3300/0 conn(0x7fcb740b2b80 0x7fcb740cf640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T18:41:40.187 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:40.176+0000 7fcb797aa640 1 --2- 172.21.15.102:0/3777619287 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fcb741606a0 0x7fcb740b2640 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T18:41:40.188 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:40.176+0000 7fcb797aa640 1 -- 172.21.15.102:0/3777619287 >> 172.21.15.102:0/3777619287 conn(0x7fcb7409c020 msgr2=0x7fcb740d2d20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-13T18:41:40.188 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:40.176+0000 7fcb797aa640 1 -- 172.21.15.102:0/3777619287 shutdown_connections 2023-11-13T18:41:40.189 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:40.176+0000 7fcb797aa640 1 -- 172.21.15.102:0/3777619287 wait complete. 2023-11-13T18:41:40.200 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:40.192+0000 7fcb797aa640 1 Processor -- start 2023-11-13T18:41:40.201 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:40.192+0000 7fcb797aa640 1 -- start start 2023-11-13T18:41:40.209 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:40.200+0000 7fcb797aa640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcb740b2b80 0x7fcb740b72a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T18:41:40.211 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:40.200+0000 7fcb797aa640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fcb740d3430 0x7fcb7415f740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T18:41:40.211 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:40.200+0000 7fcb72ffd640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcb740b2b80 0x7fcb740b72a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T18:41:40.211 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:40.200+0000 7fcb72ffd640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcb740b2b80 0x7fcb740b72a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.102:33782/0 (socket says 172.21.15.102:33782) 2023-11-13T18:41:40.217 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:40.204+0000 7fcb727fc640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fcb740d3430 0x7fcb7415f740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T18:41:40.217 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:40.204+0000 7fcb727fc640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fcb740d3430 0x7fcb7415f740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:55140/0 (socket says 172.21.15.102:55140) 2023-11-13T18:41:40.218 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:40.208+0000 7fcb797aa640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fcb741606a0 0x7fcb741564b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T18:41:40.218 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:40.208+0000 7fcb797aa640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb74155220 con 0x7fcb740d3430 2023-11-13T18:41:40.218 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:40.208+0000 7fcb797aa640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb740ca1d0 con 0x7fcb740b2b80 2023-11-13T18:41:40.219 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:40.208+0000 7fcb797aa640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcb740ca4b0 con 0x7fcb741606a0 2023-11-13T18:41:40.220 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:40.208+0000 7fcb737fe640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fcb741606a0 0x7fcb741564b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T18:41:40.220 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:40.208+0000 7fcb737fe640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fcb741606a0 0x7fcb741564b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.102:47142/0 (socket says 172.21.15.102:47142) 2023-11-13T18:41:40.220 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:40.208+0000 7fcb737fe640 1 -- 172.21.15.102:0/942668273 learned_addr learned my addr 172.21.15.102:0/942668273 (peer_addr_for_me v2:172.21.15.102:0/0) 2023-11-13T18:41:40.221 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:40.208+0000 7fcb737fe640 1 -- 172.21.15.102:0/942668273 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcb740b2b80 msgr2=0x7fcb740b72a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T18:41:40.221 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:40.208+0000 7fcb737fe640 1 --2- 172.21.15.102:0/942668273 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcb740b2b80 0x7fcb740b72a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T18:41:40.222 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:40.208+0000 7fcb737fe640 1 -- 172.21.15.102:0/942668273 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fcb740d3430 msgr2=0x7fcb7415f740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T18:41:40.222 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:40.208+0000 7fcb737fe640 1 --2- 172.21.15.102:0/942668273 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fcb740d3430 0x7fcb7415f740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T18:41:40.222 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:40.208+0000 7fcb737fe640 1 -- 172.21.15.102:0/942668273 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb64009420 con 0x7fcb741606a0 2023-11-13T18:41:40.224 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:40.212+0000 7fcb737fe640 1 --2- 172.21.15.102:0/942668273 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fcb741606a0 0x7fcb741564b0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7fcb6c007e90 tx=0x7fcb6c00e4b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-13T18:41:40.224 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:40.216+0000 7fcb5b7fe640 1 -- 172.21.15.102:0/942668273 <== mon.2 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb6c014420 con 0x7fcb741606a0 2023-11-13T18:41:40.226 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:40.216+0000 7fcb5b7fe640 1 -- 172.21.15.102:0/942668273 <== mon.2 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb6c014580 con 0x7fcb741606a0 2023-11-13T18:41:40.226 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:40.216+0000 7fcb5b7fe640 1 -- 172.21.15.102:0/942668273 <== mon.2 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb6c014930 con 0x7fcb741606a0 2023-11-13T18:41:40.227 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:40.216+0000 7fcb797aa640 1 -- 172.21.15.102:0/942668273 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcb740ca790 con 0x7fcb741606a0 2023-11-13T18:41:40.227 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:40.216+0000 7fcb797aa640 1 -- 172.21.15.102:0/942668273 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcb740cad50 con 0x7fcb741606a0 2023-11-13T18:41:40.227 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:40.216+0000 7fcb72ffd640 1 --2- 172.21.15.102:0/942668273 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcb740b2b80 0x7fcb740b72a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-13T18:41:40.232 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:40.224+0000 7fcb797aa640 1 -- 172.21.15.102:0/942668273 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcb740cb060 con 0x7fcb741606a0 2023-11-13T18:41:40.234 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:40.224+0000 7fcb5b7fe640 1 -- 172.21.15.102:0/942668273 <== mon.2 v2:172.21.15.154:3301/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fcb6c014a90 con 0x7fcb741606a0 2023-11-13T18:41:40.239 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:40.228+0000 7fcb5b7fe640 1 --2- 172.21.15.102:0/942668273 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7fcb60066470 0x7fcb60068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T18:41:40.241 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:40.232+0000 7fcb5b7fe640 1 -- 172.21.15.102:0/942668273 <== mon.2 v2:172.21.15.154:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fcb6c084360 con 0x7fcb741606a0 2023-11-13T18:41:40.242 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:40.232+0000 7fcb72ffd640 1 --2- 172.21.15.102:0/942668273 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7fcb60066470 0x7fcb60068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T18:41:40.247 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:40.236+0000 7fcb72ffd640 1 --2- 172.21.15.102:0/942668273 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7fcb60066470 0x7fcb60068930 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x7fcb640af000 tx=0x7fcb640b6040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-13T18:41:40.258 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:40.244+0000 7fcb5b7fe640 1 -- 172.21.15.102:0/942668273 <== mon.2 v2:172.21.15.154:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fcb740cb060 con 0x7fcb741606a0 2023-11-13T18:41:41.448 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:41.440+0000 7fcb797aa640 1 -- 172.21.15.102:0/942668273 --> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fcb740b1dc0 con 0x7fcb60066470 2023-11-13T18:41:41.508 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:41.496+0000 7fcb5b7fe640 1 -- 172.21.15.102:0/942668273 <== mgr.4103 v2:172.21.15.102:6832/1009482693 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+49494 (secure 0 0 0) 0x7fcb640ab920 con 0x7fcb60066470 2023-11-13T18:41:41.511 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T18:41:41.512 INFO:teuthology.orchestra.run.smithi102.stderr:dumped all 2023-11-13T18:41:41.520 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:41.512+0000 7fcb797aa640 1 -- 172.21.15.102:0/942668273 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7fcb60066470 msgr2=0x7fcb60068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T18:41:41.521 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:41.512+0000 7fcb797aa640 1 --2- 172.21.15.102:0/942668273 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7fcb60066470 0x7fcb60068930 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x7fcb640af000 tx=0x7fcb640b6040 comp rx=0 tx=0).stop 2023-11-13T18:41:41.522 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:41.512+0000 7fcb797aa640 1 -- 172.21.15.102:0/942668273 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fcb741606a0 msgr2=0x7fcb741564b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T18:41:41.523 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:41.512+0000 7fcb797aa640 1 --2- 172.21.15.102:0/942668273 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fcb741606a0 0x7fcb741564b0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7fcb6c007e90 tx=0x7fcb6c00e4b0 comp rx=0 tx=0).stop 2023-11-13T18:41:41.523 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:41.512+0000 7fcb797aa640 1 -- 172.21.15.102:0/942668273 shutdown_connections 2023-11-13T18:41:41.524 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:41.512+0000 7fcb797aa640 1 --2- 172.21.15.102:0/942668273 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fcb741606a0 0x7fcb741564b0 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T18:41:41.524 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:41.512+0000 7fcb797aa640 1 --2- 172.21.15.102:0/942668273 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7fcb60066470 0x7fcb60068930 unknown :-1 s=CLOSED pgs=752 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T18:41:41.524 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:41.512+0000 7fcb797aa640 1 --2- 172.21.15.102:0/942668273 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fcb740d3430 0x7fcb7415f740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T18:41:41.525 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:41.512+0000 7fcb797aa640 1 --2- 172.21.15.102:0/942668273 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcb740b2b80 0x7fcb740b72a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T18:41:41.525 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:41.512+0000 7fcb797aa640 1 -- 172.21.15.102:0/942668273 >> 172.21.15.102:0/942668273 conn(0x7fcb7409c020 msgr2=0x7fcb740cf3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-13T18:41:41.525 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:41.512+0000 7fcb797aa640 1 -- 172.21.15.102:0/942668273 shutdown_connections 2023-11-13T18:41:41.526 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:41.512+0000 7fcb797aa640 1 -- 172.21.15.102:0/942668273 wait complete. 2023-11-13T18:41:41.602 INFO:teuthology.orchestra.run.smithi102.stdout:{"pg_ready":true,"pg_map":{"version":13011,"stamp":"2023-11-13T18:41:39.977132+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":170,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":35771576,"kb_used_data":22933212,"kb_used_omap":3957,"kb_used_meta":12720138,"kb_avail":719203144,"statfs":{"total":773094113280,"available":736464019456,"internally_reserved":0,"allocated":23483609088,"data_stored":23431413595,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4052240,"internal_metadata":13025422064},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1071,"apply_latency_ms":1071,"commit_latency_ns":1071000000,"apply_latency_ns":1071000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-25788798936,"num_objects":-22368,"num_object_clones":0,"num_object_copies":-44736,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-22368,"num_whiteouts":0,"num_read":-2023324,"num_read_kb":-141734219,"num_write":-6589096,"num_write_kb":-163073304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.014995"},"pg_stats":[{"pgid":"1.0","version":"17'117","reported_seq":395,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-11-13T18:41:29.715310+0000","last_change":"2023-11-13T11:28:47.002866+0000","last_active":"2023-11-13T18:41:29.715310+0000","last_peered":"2023-11-13T18:41:29.715310+0000","last_clean":"2023-11-13T18:41:29.715310+0000","last_became_active":"2023-11-13T11:28:47.001494+0000","last_became_peered":"2023-11-13T11:28:47.001494+0000","last_unstale":"2023-11-13T18:41:29.715310+0000","last_undegraded":"2023-11-13T18:41:29.715310+0000","last_fullsized":"2023-11-13T18:41:29.715310+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-13T11:28:45.879416+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-13T11:28:45.879416+0000","last_clean_scrub_stamp":"2023-11-13T11:28:45.879416+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-14T14:38:55.166320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":15,"seq":64424514636,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":4121596,"kb_used_data":2384880,"kb_used_omap":112,"kb_used_meta":1736591,"kb_avail":90250244,"statfs":{"total":96636764160,"available":92416249856,"internally_reserved":0,"allocated":2442117120,"data_stored":2436381218,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":115290,"internal_metadata":1778269606},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":208,"apply_latency_ms":208,"commit_latency_ns":208000000,"apply_latency_ns":208000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Nov 13 18:41:27 2023","interfaces":[{"interface":"back","average":{"1min":1.6399999999999999,"5min":1.431,"15min":1.4550000000000001},"min":{"1min":0.377,"5min":0.35899999999999999,"15min":0.307},"max":{"1min":4.843,"5min":7.2640000000000002,"15min":10.75},"last":4.8819999999999997},{"interface":"front","average":{"1min":1.8700000000000001,"5min":1.7070000000000001,"15min":1.5589999999999999},"min":{"1min":0.48899999999999999,"5min":0.36899999999999999,"15min":0.317},"max":{"1min":5.8250000000000002,"5min":8.3000000000000007,"15min":8.3000000000000007},"last":4.734}]},{"osd":1,"last update":"Mon Nov 13 18:41:27 2023","interfaces":[{"interface":"back","average":{"1min":1.4670000000000001,"5min":1.506,"15min":1.526},"min":{"1min":0.45300000000000001,"5min":0.439,"15min":0.39100000000000001},"max":{"1min":8.0519999999999996,"5min":8.0519999999999996,"15min":8.0519999999999996},"last":0.65200000000000002},{"interface":"front","average":{"1min":2.2109999999999999,"5min":1.5569999999999999,"15min":1.6739999999999999},"min":{"1min":0.38500000000000001,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":7.9489999999999998,"5min":7.9489999999999998,"15min":9.1679999999999993},"last":1.264}]},{"osd":2,"last update":"Mon Nov 13 18:41:27 2023","interfaces":[{"interface":"back","average":{"1min":1.526,"5min":1.6439999999999999,"15min":1.786},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":5.532,"5min":8.7929999999999993,"15min":13.769},"last":1.756},{"interface":"front","average":{"1min":1.7450000000000001,"5min":1.5189999999999999,"15min":1.6839999999999999},"min":{"1min":0.55200000000000005,"5min":0.42699999999999999,"15min":0.42199999999999999},"max":{"1min":6.3730000000000002,"5min":9.7799999999999994,"15min":16.114999999999998},"last":0.79200000000000004}]},{"osd":3,"last update":"Mon Nov 13 18:41:27 2023","interfaces":[{"interface":"back","average":{"1min":2.0880000000000001,"5min":1.899,"15min":1.7470000000000001},"min":{"1min":0.64200000000000002,"5min":0.438,"15min":0.38500000000000001},"max":{"1min":6.7960000000000003,"5min":7.5999999999999996,"15min":8.9459999999999997},"last":1.3029999999999999},{"interface":"front","average":{"1min":4.0709999999999997,"5min":2.1419999999999999,"15min":1.954},"min":{"1min":0.46600000000000003,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":47.872,"5min":47.872,"15min":47.872},"last":1.3979999999999999}]},{"osd":4,"last update":"Mon Nov 13 18:41:27 2023","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.73399999999999999,"15min":0.61299999999999999},"min":{"1min":0.40999999999999998,"5min":0.35099999999999998,"15min":0.32400000000000001},"max":{"1min":1.5309999999999999,"5min":7.8949999999999996,"15min":7.8949999999999996},"last":1.002},{"interface":"front","average":{"1min":0.66700000000000004,"5min":0.69099999999999995,"15min":0.61599999999999999},"min":{"1min":0.46700000000000003,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":1.851,"5min":7.5179999999999998,"15min":7.5179999999999998},"last":1.9470000000000001}]},{"osd":5,"last update":"Mon Nov 13 18:41:27 2023","interfaces":[{"interface":"back","average":{"1min":1.0900000000000001,"5min":0.85199999999999998,"15min":0.70899999999999996},"min":{"1min":0.45900000000000002,"5min":0.36499999999999999,"15min":0.36399999999999999},"max":{"1min":9.968,"5min":9.968,"15min":9.968},"last":0.96599999999999997},{"interface":"front","average":{"1min":1.389,"5min":0.998,"15min":0.752},"min":{"1min":0.48799999999999999,"5min":0.379,"15min":0.379},"max":{"1min":13.734999999999999,"5min":13.734999999999999,"15min":13.734999999999999},"last":1.202}]},{"osd":7,"last update":"Mon Nov 13 18:41:27 2023","interfaces":[{"interface":"back","average":{"1min":0.69799999999999995,"5min":0.81000000000000005,"15min":0.72999999999999998},"min":{"1min":0.51700000000000002,"5min":0.39800000000000002,"15min":0.378},"max":{"1min":1.891,"5min":7.5609999999999999,"15min":7.5609999999999999},"last":1.6599999999999999},{"interface":"front","average":{"1min":0.79700000000000004,"5min":0.91400000000000003,"15min":0.77400000000000002},"min":{"1min":0.52900000000000003,"5min":0.40899999999999997,"15min":0.40699999999999997},"max":{"1min":2.2869999999999999,"5min":7.9880000000000004,"15min":7.9880000000000004},"last":3.1869999999999998}]}]},{"osd":5,"up_from":15,"seq":64424514636,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":3974684,"kb_used_data":2405520,"kb_used_omap":582,"kb_used_meta":1568569,"kb_avail":90397156,"statfs":{"total":96636764160,"available":92566687744,"internally_reserved":0,"allocated":2463252480,"data_stored":2457635591,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":596886,"internal_metadata":1606214762},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":53,"apply_latency_ms":53,"commit_latency_ns":53000000,"apply_latency_ns":53000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Nov 13 18:40:47 2023","interfaces":[{"interface":"back","average":{"1min":2.431,"5min":1.8600000000000001,"15min":1.734},"min":{"1min":0.35599999999999998,"5min":0.307,"15min":0.307},"max":{"1min":22.651,"5min":22.651,"15min":41.409999999999997},"last":5.1799999999999997},{"interface":"front","average":{"1min":2.9729999999999999,"5min":2.0630000000000002,"15min":2.0129999999999999},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":19.431999999999999,"5min":19.431999999999999,"15min":44.783000000000001},"last":1.5109999999999999}]},{"osd":1,"last update":"Mon Nov 13 18:40:47 2023","interfaces":[{"interface":"back","average":{"1min":2.2229999999999999,"5min":1.754,"15min":1.8620000000000001},"min":{"1min":0.433,"5min":0.39600000000000002,"15min":0.374},"max":{"1min":22.616,"5min":22.616,"15min":22.616},"last":2.8639999999999999},{"interface":"front","average":{"1min":2.7400000000000002,"5min":1.887,"15min":1.675},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.38300000000000001},"max":{"1min":22.231000000000002,"5min":22.231000000000002,"15min":22.231000000000002},"last":2.3740000000000001}]},{"osd":2,"last update":"Mon Nov 13 18:40:47 2023","interfaces":[{"interface":"back","average":{"1min":2.9319999999999999,"5min":1.9359999999999999,"15min":1.9650000000000001},"min":{"1min":0.50900000000000001,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":13.291,"5min":13.291,"15min":45.125},"last":2.96},{"interface":"front","average":{"1min":3.7959999999999998,"5min":1.861,"15min":1.98},"min":{"1min":0.70699999999999996,"5min":0.47199999999999998,"15min":0.45800000000000002},"max":{"1min":14.776,"5min":14.776,"15min":44.991},"last":4.5910000000000002}]},{"osd":3,"last update":"Mon Nov 13 18:40:47 2023","interfaces":[{"interface":"back","average":{"1min":4.1859999999999999,"5min":2.0739999999999998,"15min":2.0150000000000001},"min":{"1min":0.53300000000000003,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":55.082999999999998,"5min":55.082999999999998,"15min":55.082999999999998},"last":7.6159999999999997},{"interface":"front","average":{"1min":4.2539999999999996,"5min":2.1859999999999999,"15min":2.0739999999999998},"min":{"1min":0.60499999999999998,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":55.040999999999997,"5min":55.040999999999997,"15min":55.040999999999997},"last":7.4660000000000002}]},{"osd":4,"last update":"Mon Nov 13 18:40:47 2023","interfaces":[{"interface":"back","average":{"1min":1.0409999999999999,"5min":0.70199999999999996,"15min":0.58499999999999996},"min":{"1min":0.34399999999999997,"5min":0.308,"15min":0.28599999999999998},"max":{"1min":7.3869999999999996,"5min":7.3869999999999996,"15min":7.3869999999999996},"last":0.68000000000000005},{"interface":"front","average":{"1min":0.95999999999999996,"5min":0.78100000000000003,"15min":0.64900000000000002},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.33700000000000002},"max":{"1min":7.4329999999999998,"5min":7.4329999999999998,"15min":7.4329999999999998},"last":0.71599999999999997}]},{"osd":6,"last update":"Mon Nov 13 18:40:47 2023","interfaces":[{"interface":"back","average":{"1min":0.98599999999999999,"5min":0.76700000000000002,"15min":0.63},"min":{"1min":0.35499999999999998,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":8.2690000000000001,"5min":8.2690000000000001,"15min":8.2690000000000001},"last":0.65000000000000002},{"interface":"front","average":{"1min":2.383,"5min":0.97199999999999998,"15min":0.70599999999999996},"min":{"1min":0.40200000000000002,"5min":0.35399999999999998,"15min":0.33900000000000002},"max":{"1min":22.547999999999998,"5min":22.547999999999998,"15min":22.547999999999998},"last":0.59799999999999998}]},{"osd":7,"last update":"Mon Nov 13 18:40:47 2023","interfaces":[{"interface":"back","average":{"1min":1.1020000000000001,"5min":0.78000000000000003,"15min":0.65600000000000003},"min":{"1min":0.45600000000000002,"5min":0.37,"15min":0.37},"max":{"1min":10.66,"5min":10.66,"15min":10.66},"last":0.76500000000000001},{"interface":"front","average":{"1min":0.747,"5min":0.77200000000000002,"15min":0.67100000000000004},"min":{"1min":0.46300000000000002,"5min":0.38800000000000001,"15min":0.36399999999999999},"max":{"1min":1.8109999999999999,"5min":3.9809999999999999,"15min":3.9809999999999999},"last":0.70099999999999996}]}]},{"osd":4,"up_from":15,"seq":64424514635,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5311836,"kb_used_data":3777404,"kb_used_omap":965,"kb_used_meta":1444154,"kb_avail":89060004,"statfs":{"total":96636764160,"available":91197444096,"internally_reserved":0,"allocated":3868061696,"data_stored":3859848765,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":988456,"internal_metadata":1478814424},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":52,"apply_latency_ms":52,"commit_latency_ns":52000000,"apply_latency_ns":52000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Nov 13 18:40:42 2023","interfaces":[{"interface":"back","average":{"1min":2.0859999999999999,"5min":1.599,"15min":1.867},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.316},"max":{"1min":18.532,"5min":18.532,"15min":88.278000000000006},"last":9.3450000000000006},{"interface":"front","average":{"1min":1.923,"5min":1.3320000000000001,"15min":1.786},"min":{"1min":0.56999999999999995,"5min":0.36599999999999999,"15min":0.33900000000000002},"max":{"1min":5.2750000000000004,"5min":5.5170000000000003,"15min":88.555000000000007},"last":16.440999999999999}]},{"osd":1,"last update":"Mon Nov 13 18:40:42 2023","interfaces":[{"interface":"back","average":{"1min":2.6269999999999998,"5min":1.9079999999999999,"15min":2.1509999999999998},"min":{"1min":0.35499999999999998,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":20.643000000000001,"5min":20.643000000000001,"15min":85.168999999999997},"last":9.2100000000000009},{"interface":"front","average":{"1min":2.4569999999999999,"5min":1.726,"15min":1.9630000000000001},"min":{"1min":0.42399999999999999,"5min":0.376,"15min":0.376},"max":{"1min":24.550999999999998,"5min":24.550999999999998,"15min":85.587999999999994},"last":17.658999999999999}]},{"osd":2,"last update":"Mon Nov 13 18:40:42 2023","interfaces":[{"interface":"back","average":{"1min":1.631,"5min":1.6220000000000001,"15min":1.673},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.38600000000000001},"max":{"1min":6.0720000000000001,"5min":6.0720000000000001,"15min":14.832000000000001},"last":17.603000000000002},{"interface":"front","average":{"1min":3.073,"5min":1.8540000000000001,"15min":1.5640000000000001},"min":{"1min":0.45600000000000002,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":27.375,"5min":27.375,"15min":27.375},"last":6.4809999999999999}]},{"osd":3,"last update":"Mon Nov 13 18:40:42 2023","interfaces":[{"interface":"back","average":{"1min":1.571,"5min":1.8720000000000001,"15min":1.841},"min":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.48199999999999998},"max":{"1min":6.4619999999999997,"5min":6.4619999999999997,"15min":11.146000000000001},"last":3.9569999999999999},{"interface":"front","average":{"1min":1.992,"5min":1.968,"15min":1.8979999999999999},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.46300000000000002},"max":{"1min":11.362,"5min":11.362,"15min":11.362},"last":10.461}]},{"osd":5,"last update":"Mon Nov 13 18:40:42 2023","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":0.56000000000000005,"15min":0.53100000000000003},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.30199999999999999},"max":{"1min":1.9399999999999999,"5min":1.9399999999999999,"15min":2.1720000000000002},"last":2.105},{"interface":"front","average":{"1min":0.48399999999999999,"5min":0.56100000000000005,"15min":0.56399999999999995},"min":{"1min":0.39200000000000002,"5min":0.33900000000000002,"15min":0.309},"max":{"1min":0.72899999999999998,"5min":1.7909999999999999,"15min":2.2890000000000001},"last":3.9990000000000001}]},{"osd":6,"last update":"Mon Nov 13 18:40:42 2023","interfaces":[{"interface":"back","average":{"1min":0.76900000000000002,"5min":0.65800000000000003,"15min":0.61299999999999999},"min":{"1min":0.40200000000000002,"5min":0.314,"15min":0.314},"max":{"1min":5.9500000000000002,"5min":5.9500000000000002,"15min":5.9500000000000002},"last":10.372999999999999},{"interface":"front","average":{"1min":0.622,"5min":0.65300000000000002,"15min":0.63700000000000001},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":1.9930000000000001,"5min":3.4590000000000001,"15min":3.6850000000000001},"last":9.2949999999999999}]},{"osd":7,"last update":"Mon Nov 13 18:40:42 2023","interfaces":[{"interface":"back","average":{"1min":0.78700000000000003,"5min":0.69999999999999996,"15min":0.66700000000000004},"min":{"1min":0.42799999999999999,"5min":0.374,"15min":0.35899999999999999},"max":{"1min":5.3300000000000001,"5min":5.3300000000000001,"15min":5.3300000000000001},"last":3.8999999999999999},{"interface":"front","average":{"1min":0.94999999999999996,"5min":0.76800000000000002,"15min":0.71399999999999997},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":7.8789999999999996,"5min":7.8789999999999996,"15min":7.8789999999999996},"last":10.755000000000001}]}]},{"osd":3,"up_from":15,"seq":64424514579,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":4789676,"kb_used_data":3018652,"kb_used_omap":1085,"kb_used_meta":1769922,"kb_avail":89582164,"statfs":{"total":96636764160,"available":91732135936,"internally_reserved":0,"allocated":3091099648,"data_stored":3084722185,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1111813,"internal_metadata":1812400379},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":386,"apply_latency_ms":386,"commit_latency_ns":386000000,"apply_latency_ns":386000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Nov 13 18:40:54 2023","interfaces":[{"interface":"back","average":{"1min":3.7240000000000002,"5min":3.4089999999999998,"15min":3.306},"min":{"1min":0.54800000000000004,"5min":0.377,"15min":0.311},"max":{"1min":23.887,"5min":23.887,"15min":23.887},"last":11.821},{"interface":"front","average":{"1min":6.5469999999999997,"5min":3.54,"15min":3.4470000000000001},"min":{"1min":0.70299999999999996,"5min":0.52100000000000002,"15min":0.35799999999999998},"max":{"1min":48.045999999999999,"5min":48.045999999999999,"15min":48.045999999999999},"last":12.124000000000001}]},{"osd":1,"last update":"Mon Nov 13 18:40:54 2023","interfaces":[{"interface":"back","average":{"1min":3.036,"5min":3.1019999999999999,"15min":3.54},"min":{"1min":0.60699999999999998,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":11.631,"5min":23.428000000000001,"15min":100.48},"last":2.105},{"interface":"front","average":{"1min":3.6779999999999999,"5min":3.5710000000000002,"15min":3.4969999999999999},"min":{"1min":0.63700000000000001,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":13.286,"5min":21.818999999999999,"15min":21.818999999999999},"last":2.585}]},{"osd":2,"last update":"Mon Nov 13 18:40:54 2023","interfaces":[{"interface":"back","average":{"1min":6.6559999999999997,"5min":3.8809999999999998,"15min":4.0259999999999998},"min":{"1min":0.67600000000000005,"5min":0.53600000000000003,"15min":0.53200000000000003},"max":{"1min":21.638999999999999,"5min":22.738,"15min":100.589},"last":2.444},{"interface":"front","average":{"1min":3.3759999999999999,"5min":3.6099999999999999,"15min":3.617},"min":{"1min":0.74399999999999999,"5min":0.63900000000000001,"15min":0.439},"max":{"1min":8.3759999999999994,"5min":21.300999999999998,"15min":21.300999999999998},"last":2.633}]},{"osd":4,"last update":"Mon Nov 13 18:40:54 2023","interfaces":[{"interface":"back","average":{"1min":4.2240000000000002,"5min":2.7269999999999999,"15min":2.637},"min":{"1min":0.69999999999999996,"5min":0.55700000000000005,"15min":0.46200000000000002},"max":{"1min":26.68,"5min":26.68,"15min":26.68},"last":2.8330000000000002},{"interface":"front","average":{"1min":3.625,"5min":2.9060000000000001,"15min":2.5979999999999999},"min":{"1min":0.70899999999999996,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":17.091000000000001,"5min":23.655999999999999,"15min":23.655999999999999},"last":11.794}]},{"osd":5,"last update":"Mon Nov 13 18:40:54 2023","interfaces":[{"interface":"back","average":{"1min":3.8359999999999999,"5min":3.028,"15min":2.778},"min":{"1min":0.64700000000000002,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":21.454999999999998,"5min":23.75,"15min":23.75},"last":11.74},{"interface":"front","average":{"1min":2.5859999999999999,"5min":2.9470000000000001,"15min":2.7810000000000001},"min":{"1min":0.98499999999999999,"5min":0.66900000000000004,"15min":0.46700000000000003},"max":{"1min":7.9420000000000002,"5min":22.007000000000001,"15min":22.007000000000001},"last":11.867000000000001}]},{"osd":6,"last update":"Mon Nov 13 18:40:54 2023","interfaces":[{"interface":"back","average":{"1min":4.218,"5min":2.919,"15min":2.782},"min":{"1min":0.83899999999999997,"5min":0.626,"15min":0.52500000000000002},"max":{"1min":26.844999999999999,"5min":26.844999999999999,"15min":26.844999999999999},"last":26.965},{"interface":"front","average":{"1min":3.9020000000000001,"5min":3.1419999999999999,"15min":3.218},"min":{"1min":0.67800000000000005,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":21.555,"5min":23.841000000000001,"15min":100.315},"last":2.5619999999999998}]},{"osd":7,"last update":"Mon Nov 13 18:40:54 2023","interfaces":[{"interface":"back","average":{"1min":3.1739999999999999,"5min":3.2069999999999999,"15min":3.0059999999999998},"min":{"1min":1.0369999999999999,"5min":0.749,"15min":0.55500000000000005},"max":{"1min":12.794,"5min":22.087,"15min":22.087},"last":11.901},{"interface":"front","average":{"1min":4.9820000000000002,"5min":3.1230000000000002,"15min":2.9900000000000002},"min":{"1min":1.0209999999999999,"5min":0.621,"15min":0.55500000000000005},"max":{"1min":26.939,"5min":26.939,"15min":26.939},"last":12.836}]}]},{"osd":2,"up_from":15,"seq":64424514577,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5772700,"kb_used_data":4072336,"kb_used_omap":688,"kb_used_meta":1699663,"kb_avail":88599140,"statfs":{"total":96636764160,"available":90725519360,"internally_reserved":0,"allocated":4170072064,"data_stored":4160954051,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":705113,"internal_metadata":1740455335},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Nov 13 18:41:20 2023","interfaces":[{"interface":"back","average":{"1min":3.8010000000000002,"5min":3.2360000000000002,"15min":3.1880000000000002},"min":{"1min":0.50600000000000001,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":32.695999999999998,"5min":32.695999999999998,"15min":32.695999999999998},"last":0.83799999999999997},{"interface":"front","average":{"1min":4.8170000000000002,"5min":3.254,"15min":3.258},"min":{"1min":0.71999999999999997,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":31.927,"5min":31.927,"15min":31.927},"last":1.175}]},{"osd":1,"last update":"Mon Nov 13 18:41:20 2023","interfaces":[{"interface":"back","average":{"1min":2.5430000000000001,"5min":2.8119999999999998,"15min":3.2949999999999999},"min":{"1min":0.58199999999999996,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":7.6050000000000004,"5min":14.593,"15min":19.190999999999999},"last":1.0309999999999999},{"interface":"front","average":{"1min":2.984,"5min":3.613,"15min":3.6469999999999998},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":9.8849999999999998,"5min":22.782,"15min":22.782},"last":0.66000000000000003}]},{"osd":3,"last update":"Mon Nov 13 18:41:20 2023","interfaces":[{"interface":"back","average":{"1min":3.472,"5min":3.3849999999999998,"15min":3.3969999999999998},"min":{"1min":0.64600000000000002,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":23.966999999999999,"5min":27.233000000000001,"15min":27.233000000000001},"last":0.64300000000000002},{"interface":"front","average":{"1min":3.359,"5min":3.1059999999999999,"15min":3.516},"min":{"1min":0.68600000000000005,"5min":0.52300000000000002,"15min":0.40799999999999997},"max":{"1min":13.298,"5min":14.244999999999999,"15min":20.870000000000001},"last":1.147}]},{"osd":4,"last update":"Mon Nov 13 18:41:20 2023","interfaces":[{"interface":"back","average":{"1min":3.3199999999999998,"5min":2.4460000000000002,"15min":2.7589999999999999},"min":{"1min":0.61699999999999999,"5min":0.46600000000000003,"15min":0.45400000000000001},"max":{"1min":29.552,"5min":29.552,"15min":29.552},"last":1.2210000000000001},{"interface":"front","average":{"1min":3.5760000000000001,"5min":2.7240000000000002,"15min":2.7010000000000001},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":24.064,"5min":24.064,"15min":24.064},"last":1.091}]},{"osd":5,"last update":"Mon Nov 13 18:41:20 2023","interfaces":[{"interface":"back","average":{"1min":3.1150000000000002,"5min":3.0419999999999998,"15min":2.7799999999999998},"min":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.55900000000000005},"max":{"1min":23.722999999999999,"5min":30.375,"15min":30.375},"last":1.0680000000000001},{"interface":"front","average":{"1min":2.5739999999999998,"5min":2.3980000000000001,"15min":2.831},"min":{"1min":0.64600000000000002,"5min":0.51900000000000002,"15min":0.49399999999999999},"max":{"1min":12.026,"5min":14.148999999999999,"15min":14.148999999999999},"last":1.292}]},{"osd":6,"last update":"Mon Nov 13 18:41:20 2023","interfaces":[{"interface":"back","average":{"1min":3.573,"5min":2.8159999999999998,"15min":2.8399999999999999},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":21.073,"5min":21.073,"15min":21.073},"last":1.1200000000000001},{"interface":"front","average":{"1min":3.9820000000000002,"5min":3.2930000000000001,"15min":3.0310000000000001},"min":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":35.908999999999999,"5min":35.908999999999999,"15min":35.908999999999999},"last":0.93300000000000005}]},{"osd":7,"last update":"Mon Nov 13 18:41:20 2023","interfaces":[{"interface":"back","average":{"1min":3.6829999999999998,"5min":3.0299999999999998,"15min":2.988},"min":{"1min":0.66600000000000004,"5min":0.57899999999999996,"15min":0.55300000000000005},"max":{"1min":20.969000000000001,"5min":20.969000000000001,"15min":20.969000000000001},"last":0.99299999999999999},{"interface":"front","average":{"1min":3.5419999999999998,"5min":3.387,"15min":3.1339999999999999},"min":{"1min":0.80700000000000005,"5min":0.748,"15min":0.63400000000000001},"max":{"1min":23.847000000000001,"5min":26.902000000000001,"15min":26.902000000000001},"last":0.79300000000000004}]}]},{"osd":1,"up_from":15,"seq":64424514592,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":2883324,"kb_used_data":1344140,"kb_used_omap":147,"kb_used_meta":1514156,"kb_avail":91488516,"statfs":{"total":96636764160,"available":93684240384,"internally_reserved":0,"allocated":1376399360,"data_stored":1372987178,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":150803,"internal_metadata":1550496493},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":212,"apply_latency_ms":212,"commit_latency_ns":212000000,"apply_latency_ns":212000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Nov 13 18:41:25 2023","interfaces":[{"interface":"back","average":{"1min":2.569,"5min":2.7400000000000002,"15min":2.8730000000000002},"min":{"1min":0.67000000000000004,"5min":0.435,"15min":0.29299999999999998},"max":{"1min":8.0800000000000001,"5min":11.255000000000001,"15min":14.548999999999999},"last":5.3399999999999999},{"interface":"front","average":{"1min":2.2589999999999999,"5min":3.2450000000000001,"15min":3.3519999999999999},"min":{"1min":0.47399999999999998,"5min":0.45300000000000001,"15min":0.38300000000000001},"max":{"1min":4.2030000000000003,"5min":26.187999999999999,"15min":26.187999999999999},"last":2.2959999999999998}]},{"osd":2,"last update":"Mon Nov 13 18:41:25 2023","interfaces":[{"interface":"back","average":{"1min":2.9590000000000001,"5min":2.9460000000000002,"15min":2.964},"min":{"1min":0.55800000000000005,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":8.2059999999999995,"5min":11.381,"15min":12.708},"last":5.0270000000000001},{"interface":"front","average":{"1min":2.3610000000000002,"5min":3.3839999999999999,"15min":3.21},"min":{"1min":0.69499999999999995,"5min":0.54300000000000004,"15min":0.44},"max":{"1min":4.3109999999999999,"5min":27.844999999999999,"15min":27.844999999999999},"last":7.8780000000000001}]},{"osd":3,"last update":"Mon Nov 13 18:41:25 2023","interfaces":[{"interface":"back","average":{"1min":3.0779999999999998,"5min":3.7280000000000002,"15min":3.5699999999999998},"min":{"1min":0.872,"5min":0.66400000000000003,"15min":0.44400000000000001},"max":{"1min":8.5470000000000006,"5min":27.838999999999999,"15min":27.838999999999999},"last":8.0790000000000006},{"interface":"front","average":{"1min":2.286,"5min":2.948,"15min":3.1920000000000002},"min":{"1min":0.61799999999999999,"5min":0.50800000000000001,"15min":0.436},"max":{"1min":4.2190000000000003,"5min":12.034000000000001,"15min":15.619},"last":0.66400000000000003}]},{"osd":4,"last update":"Mon Nov 13 18:41:25 2023","interfaces":[{"interface":"back","average":{"1min":2.0259999999999998,"5min":2.782,"15min":2.617},"min":{"1min":0.71499999999999997,"5min":0.57999999999999996,"15min":0.46300000000000002},"max":{"1min":4.024,"5min":27.952000000000002,"15min":27.952000000000002},"last":5.0679999999999996},{"interface":"front","average":{"1min":2.9049999999999998,"5min":2.714,"15min":2.4449999999999998},"min":{"1min":0.65800000000000003,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":8.3170000000000002,"5min":27.678999999999998,"15min":27.678999999999998},"last":5.226}]},{"osd":5,"last update":"Mon Nov 13 18:41:25 2023","interfaces":[{"interface":"back","average":{"1min":3.044,"5min":3.073,"15min":2.6360000000000001},"min":{"1min":0.70299999999999996,"5min":0.54600000000000004,"15min":0.52500000000000002},"max":{"1min":8.5020000000000007,"5min":27.588999999999999,"15min":27.588999999999999},"last":0.99199999999999999},{"interface":"front","average":{"1min":2.4060000000000001,"5min":3.2229999999999999,"15min":2.7770000000000001},"min":{"1min":0.73499999999999999,"5min":0.69999999999999996,"15min":0.47299999999999998},"max":{"1min":4.282,"5min":26.579999999999998,"15min":26.579999999999998},"last":7.9219999999999997}]},{"osd":6,"last update":"Mon Nov 13 18:41:25 2023","interfaces":[{"interface":"back","average":{"1min":2.1749999999999998,"5min":3.157,"15min":2.8370000000000002},"min":{"1min":0.93700000000000006,"5min":0.54900000000000004,"15min":0.48299999999999998},"max":{"1min":4.5750000000000002,"5min":29.478999999999999,"15min":29.478999999999999},"last":3.9420000000000002},{"interface":"front","average":{"1min":3.0859999999999999,"5min":3.2229999999999999,"15min":2.8010000000000002},"min":{"1min":0.73999999999999999,"5min":0.57999999999999996,"15min":0.57999999999999996},"max":{"1min":8.4109999999999996,"5min":36.837000000000003,"15min":36.837000000000003},"last":4.4039999999999999}]},{"osd":7,"last update":"Mon Nov 13 18:41:25 2023","interfaces":[{"interface":"back","average":{"1min":2.5590000000000002,"5min":3.2959999999999998,"15min":2.8780000000000001},"min":{"1min":0.70199999999999996,"5min":0.626,"15min":0.54200000000000004},"max":{"1min":4.3879999999999999,"5min":26.622,"15min":26.622},"last":8.8360000000000003},{"interface":"front","average":{"1min":2.3879999999999999,"5min":3.1619999999999999,"15min":2.9420000000000002},"min":{"1min":0.93400000000000005,"5min":0.65900000000000003,"15min":0.54100000000000004},"max":{"1min":5.2649999999999997,"5min":25.965,"15min":25.965},"last":1.077}]}]},{"osd":0,"up_from":15,"seq":64424514585,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":4501200,"kb_used_data":3156548,"kb_used_omap":245,"kb_used_meta":1344394,"kb_avail":89870640,"statfs":{"total":96636764160,"available":92027535360,"internally_reserved":0,"allocated":3232305152,"data_stored":3225143385,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":251097,"internal_metadata":1376660263},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":158,"apply_latency_ms":158,"commit_latency_ns":158000000,"apply_latency_ns":158000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Nov 13 18:41:05 2023","interfaces":[{"interface":"back","average":{"1min":2.6619999999999999,"5min":2.569,"15min":3.3380000000000001},"min":{"1min":0.64500000000000002,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":6.29,"5min":8.3640000000000008,"15min":132.19800000000001},"last":1.2929999999999999},{"interface":"front","average":{"1min":2.6909999999999998,"5min":2.9169999999999998,"15min":3.4470000000000001},"min":{"1min":0.54500000000000004,"5min":0.46400000000000002,"15min":0.45900000000000002},"max":{"1min":11.978999999999999,"5min":13.000999999999999,"15min":125.517},"last":1.4350000000000001}]},{"osd":2,"last update":"Mon Nov 13 18:41:05 2023","interfaces":[{"interface":"back","average":{"1min":2.3439999999999999,"5min":2.8050000000000002,"15min":3.2269999999999999},"min":{"1min":0.65400000000000003,"5min":0.372,"15min":0.372},"max":{"1min":6.2320000000000002,"5min":8.8879999999999999,"15min":13.459},"last":0.65800000000000003},{"interface":"front","average":{"1min":4.1520000000000001,"5min":3.327,"15min":3.395},"min":{"1min":0.75900000000000001,"5min":0.66000000000000003,"15min":0.44800000000000001},"max":{"1min":16.423999999999999,"5min":16.423999999999999,"15min":16.423999999999999},"last":0.82799999999999996}]},{"osd":3,"last update":"Mon Nov 13 18:41:05 2023","interfaces":[{"interface":"back","average":{"1min":3.8980000000000001,"5min":3.1040000000000001,"15min":3.133},"min":{"1min":0.69399999999999995,"5min":0.69399999999999995,"15min":0.45900000000000002},"max":{"1min":15.502000000000001,"5min":15.502000000000001,"15min":15.502000000000001},"last":1.2290000000000001},{"interface":"front","average":{"1min":3.5019999999999998,"5min":3.3010000000000002,"15min":3.5459999999999998},"min":{"1min":0.70099999999999996,"5min":0.67900000000000005,"15min":0.441},"max":{"1min":15.955,"5min":15.955,"15min":20.747},"last":0.57899999999999996}]},{"osd":4,"last update":"Mon Nov 13 18:41:05 2023","interfaces":[{"interface":"back","average":{"1min":2.5750000000000002,"5min":2.2290000000000001,"15min":2.4689999999999999},"min":{"1min":0.77400000000000002,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":6.2539999999999996,"5min":9.3949999999999996,"15min":10.611000000000001},"last":0.91600000000000004},{"interface":"front","average":{"1min":2.4300000000000002,"5min":2.3260000000000001,"15min":2.6560000000000001},"min":{"1min":0.78800000000000003,"5min":0.51800000000000002,"15min":0.48899999999999999},"max":{"1min":5.9619999999999997,"5min":8.7780000000000005,"15min":12.353999999999999},"last":0.70599999999999996}]},{"osd":5,"last update":"Mon Nov 13 18:41:05 2023","interfaces":[{"interface":"back","average":{"1min":2.8170000000000002,"5min":2.3399999999999999,"15min":2.4849999999999999},"min":{"1min":0.66300000000000003,"5min":0.66300000000000003,"15min":0.501},"max":{"1min":12.470000000000001,"5min":12.470000000000001,"15min":12.470000000000001},"last":1.155},{"interface":"front","average":{"1min":2.6709999999999998,"5min":2.3740000000000001,"15min":2.6309999999999998},"min":{"1min":0.81599999999999995,"5min":0.63700000000000001,"15min":0.50600000000000001},"max":{"1min":6.3810000000000002,"5min":9.516,"15min":9.9640000000000004},"last":1.0649999999999999}]},{"osd":6,"last update":"Mon Nov 13 18:41:05 2023","interfaces":[{"interface":"back","average":{"1min":2.8660000000000001,"5min":2.532,"15min":2.8599999999999999},"min":{"1min":0.92400000000000004,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":13.348000000000001,"5min":13.348000000000001,"15min":13.348000000000001},"last":0.77500000000000002},{"interface":"front","average":{"1min":2.629,"5min":2.4319999999999999,"15min":2.6360000000000001},"min":{"1min":0.84599999999999997,"5min":0.60499999999999998,"15min":0.56799999999999995},"max":{"1min":12.191000000000001,"5min":12.191000000000001,"15min":12.191000000000001},"last":0.98699999999999999}]},{"osd":7,"last update":"Mon Nov 13 18:41:05 2023","interfaces":[{"interface":"back","average":{"1min":2.8999999999999999,"5min":2.5859999999999999,"15min":2.742},"min":{"1min":0.76000000000000001,"5min":0.64900000000000002,"15min":0.51400000000000001},"max":{"1min":12.289999999999999,"5min":12.289999999999999,"15min":12.289999999999999},"last":1.3420000000000001},{"interface":"front","average":{"1min":2.9089999999999998,"5min":2.5489999999999999,"15min":2.7629999999999999},"min":{"1min":1.0409999999999999,"5min":0.64400000000000002,"15min":0.57499999999999996},"max":{"1min":6.4749999999999996,"5min":9.6199999999999992,"15min":10.743},"last":1.3939999999999999}]}]},{"osd":7,"up_from":14,"seq":60129547340,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":4416560,"kb_used_data":2773732,"kb_used_omap":129,"kb_used_meta":1642686,"kb_avail":89955280,"statfs":{"total":96636764160,"available":92114206720,"internally_reserved":0,"allocated":2840301568,"data_stored":2833741222,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":132782,"internal_metadata":1682110802},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Nov 13 18:40:36 2023","interfaces":[{"interface":"back","average":{"1min":2.3490000000000002,"5min":1.831,"15min":1.7769999999999999},"min":{"1min":0.47899999999999998,"5min":0.34100000000000003,"15min":0.30599999999999999},"max":{"1min":11.522,"5min":11.522,"15min":11.522},"last":0.73499999999999999},{"interface":"front","average":{"1min":2.008,"5min":1.78,"15min":1.613},"min":{"1min":0.57099999999999995,"5min":0.39300000000000002,"15min":0.377},"max":{"1min":6.234,"5min":8.1430000000000007,"15min":9.266},"last":0.873}]},{"osd":1,"last update":"Mon Nov 13 18:40:36 2023","interfaces":[{"interface":"back","average":{"1min":2.359,"5min":1.9399999999999999,"15min":1.804},"min":{"1min":0.376,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":9.4909999999999997,"5min":9.4909999999999997,"15min":9.4909999999999997},"last":0.68100000000000005},{"interface":"front","average":{"1min":2.2970000000000002,"5min":2.04,"15min":1.8640000000000001},"min":{"1min":0.47699999999999998,"5min":0.39500000000000002,"15min":0.35599999999999998},"max":{"1min":8.1280000000000001,"5min":8.702,"15min":9.4939999999999998},"last":0.69799999999999995}]},{"osd":2,"last update":"Mon Nov 13 18:40:36 2023","interfaces":[{"interface":"back","average":{"1min":2.3439999999999999,"5min":1.9590000000000001,"15min":1.8480000000000001},"min":{"1min":0.57799999999999996,"5min":0.51000000000000001,"15min":0.38400000000000001},"max":{"1min":11.859999999999999,"5min":11.859999999999999,"15min":11.859999999999999},"last":0.76500000000000001},{"interface":"front","average":{"1min":2.125,"5min":1.905,"15min":1.825},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.45100000000000001},"max":{"1min":10.455,"5min":10.455,"15min":10.835000000000001},"last":0.90400000000000003}]},{"osd":3,"last update":"Mon Nov 13 18:40:36 2023","interfaces":[{"interface":"back","average":{"1min":2.0350000000000001,"5min":1.829,"15min":1.7909999999999999},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":13.727,"5min":13.727,"15min":13.727},"last":1.0980000000000001},{"interface":"front","average":{"1min":1.605,"5min":1.7749999999999999,"15min":1.9970000000000001},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.44500000000000001},"max":{"1min":7.5199999999999996,"5min":11.156000000000001,"15min":11.156000000000001},"last":0.80900000000000005}]},{"osd":4,"last update":"Mon Nov 13 18:40:36 2023","interfaces":[{"interface":"back","average":{"1min":0.63500000000000001,"5min":0.58299999999999996,"15min":0.56100000000000005},"min":{"1min":0.39700000000000002,"5min":0.33600000000000002,"15min":0.32700000000000001},"max":{"1min":1.869,"5min":4.4699999999999998,"15min":4.4699999999999998},"last":0.57099999999999995},{"interface":"front","average":{"1min":2.8740000000000001,"5min":1.1859999999999999,"15min":0.79000000000000004},"min":{"1min":0.378,"5min":0.34799999999999998,"15min":0.32100000000000001},"max":{"1min":38.662999999999997,"5min":38.662999999999997,"15min":38.662999999999997},"last":0.55800000000000005}]},{"osd":5,"last update":"Mon Nov 13 18:40:36 2023","interfaces":[{"interface":"back","average":{"1min":0.60799999999999998,"5min":0.63700000000000001,"15min":0.622},"min":{"1min":0.36099999999999999,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":2.234,"5min":6.5010000000000003,"15min":6.5010000000000003},"last":0.46100000000000002},{"interface":"front","average":{"1min":0.70099999999999996,"5min":0.70899999999999996,"15min":0.65100000000000002},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":1.74,"5min":7.8680000000000003,"15min":7.8680000000000003},"last":0.496}]},{"osd":6,"last update":"Mon Nov 13 18:40:36 2023","interfaces":[{"interface":"back","average":{"1min":0.78100000000000003,"5min":0.88400000000000001,"15min":0.73699999999999999},"min":{"1min":0.46100000000000002,"5min":0.43099999999999999,"15min":0.40200000000000002},"max":{"1min":2.0600000000000001,"5min":19.218,"15min":19.218},"last":0.54400000000000004},{"interface":"front","average":{"1min":1.4750000000000001,"5min":0.88100000000000001,"15min":0.748},"min":{"1min":0.38,"5min":0.38,"15min":0.37},"max":{"1min":13.677,"5min":13.677,"15min":13.677},"last":0.52000000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-13T18:41:41.604 INFO:tasks.ceph.ceph_manager.ceph:clean! 2023-11-13T18:41:41.604 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-13T18:41:42.913 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:42.904+0000 7f881690f640 1 Processor -- start 2023-11-13T18:41:42.924 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:42.908+0000 7f881690f640 1 -- start start 2023-11-13T18:41:42.933 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:42.924+0000 7f881690f640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f88101591f0 0x7f88100b3510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T18:41:42.933 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:42.924+0000 7f881690f640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f88100ce0e0 0x7f88100b1b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T18:41:42.933 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:42.924+0000 7f881690f640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8810070940 con 0x7f881006fd10 2023-11-13T18:41:42.934 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:42.924+0000 7f881690f640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8810070560 con 0x7f88101591f0 2023-11-13T18:41:42.934 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:42.924+0000 7f881690f640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8810070b90 con 0x7f88100ce0e0 2023-11-13T18:41:42.935 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:42.924+0000 7f8814eac640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f88100ce0e0 0x7f88100b1b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T18:41:42.936 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:42.924+0000 7f8814eac640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f88100ce0e0 0x7f88100b1b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.102:33784/0 (socket says 172.21.15.102:33784) 2023-11-13T18:41:42.936 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:42.924+0000 7f8814eac640 1 -- 172.21.15.102:0/6342553 learned_addr learned my addr 172.21.15.102:0/6342553 (peer_addr_for_me v2:172.21.15.102:0/0) 2023-11-13T18:41:42.936 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:42.924+0000 7f8814eac640 1 -- 172.21.15.102:0/6342553 >> v2:172.21.15.102:3300/0 conn(0x7f88101591f0 msgr2=0x7f88100b3510 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-13T18:41:42.937 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:42.924+0000 7f8814eac640 1 --2- 172.21.15.102:0/6342553 >> v2:172.21.15.102:3300/0 conn(0x7f88101591f0 0x7f88100b3510 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T18:41:42.937 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:42.924+0000 7f8814eac640 1 -- 172.21.15.102:0/6342553 >> v1:172.21.15.154:6789/0 conn(0x7f881006fd10 legacy=0x7f88100cd9d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-13T18:41:42.938 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:42.924+0000 7f8814eac640 1 -- 172.21.15.102:0/6342553 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8810070e70 con 0x7f88100ce0e0 2023-11-13T18:41:42.980 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:42.972+0000 7f8814eac640 1 --2- 172.21.15.102:0/6342553 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f88100ce0e0 0x7f88100b1b70 secure :-1 s=READY pgs=910 cs=0 l=1 rev1=1 crypto rx=0x7f881006b7a0 tx=0x7f880001dec0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c54641ad79ee1f7f server_cookie=0 in_seq=0 out_seq=0 2023-11-13T18:41:42.984 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:42.972+0000 7f880effd640 1 -- 172.21.15.102:0/6342553 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88000a6c90 con 0x7f88100ce0e0 2023-11-13T18:41:42.984 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:42.972+0000 7f880effd640 1 -- 172.21.15.102:0/6342553 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f88000a6df0 con 0x7f88100ce0e0 2023-11-13T18:41:42.985 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:42.972+0000 7f880effd640 1 -- 172.21.15.102:0/6342553 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88000ae610 con 0x7f88100ce0e0 2023-11-13T18:41:42.985 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:42.972+0000 7f881690f640 1 -- 172.21.15.102:0/6342553 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f88100ce0e0 msgr2=0x7f88100b1b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T18:41:42.986 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:42.972+0000 7f881690f640 1 --2- 172.21.15.102:0/6342553 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f88100ce0e0 0x7f88100b1b70 secure :-1 s=READY pgs=910 cs=0 l=1 rev1=1 crypto rx=0x7f881006b7a0 tx=0x7f880001dec0 comp rx=0 tx=0).stop 2023-11-13T18:41:42.987 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:42.976+0000 7f881690f640 1 -- 172.21.15.102:0/6342553 shutdown_connections 2023-11-13T18:41:42.987 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:42.976+0000 7f881690f640 1 --2- 172.21.15.102:0/6342553 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f88100ce0e0 0x7f88100b1b70 unknown :-1 s=CLOSED pgs=910 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T18:41:42.988 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:42.976+0000 7f881690f640 1 --2- 172.21.15.102:0/6342553 >> v2:172.21.15.102:3300/0 conn(0x7f88101591f0 0x7f88100b3510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T18:41:42.988 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:42.976+0000 7f881690f640 1 -- 172.21.15.102:0/6342553 >> 172.21.15.102:0/6342553 conn(0x7f88100cb5c0 msgr2=0x7f88100cb9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-13T18:41:42.989 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:42.980+0000 7f881690f640 1 -- 172.21.15.102:0/6342553 shutdown_connections 2023-11-13T18:41:42.996 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:42.984+0000 7f881690f640 1 -- 172.21.15.102:0/6342553 wait complete. 2023-11-13T18:41:43.010 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:43.000+0000 7f881690f640 1 Processor -- start 2023-11-13T18:41:43.016 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:43.004+0000 7f881690f640 1 -- start start 2023-11-13T18:41:43.020 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:43.012+0000 7f881690f640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f881006fd10 0x7f881015c630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T18:41:43.021 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:43.012+0000 7f881690f640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f88100ce0e0 0x7f88100ccdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T18:41:43.022 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:43.012+0000 7f881690f640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f88101591f0 0x7f88100cd2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T18:41:43.022 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:43.012+0000 7f881690f640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f881015d790 con 0x7f88100ce0e0 2023-11-13T18:41:43.023 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:43.012+0000 7f881690f640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f881015cc10 con 0x7f88101591f0 2023-11-13T18:41:43.023 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:43.012+0000 7f881690f640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f881015cef0 con 0x7f881006fd10 2023-11-13T18:41:43.024 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:43.012+0000 7f8814eac640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f88101591f0 0x7f88100cd2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T18:41:43.024 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:43.012+0000 7f8814eac640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f88101591f0 0x7f88100cd2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.102:33800/0 (socket says 172.21.15.102:33800) 2023-11-13T18:41:43.024 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:43.012+0000 7f8814eac640 1 -- 172.21.15.102:0/578687030 learned_addr learned my addr 172.21.15.102:0/578687030 (peer_addr_for_me v2:172.21.15.102:0/0) 2023-11-13T18:41:43.025 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:43.012+0000 7f880f7fe640 1 --2- 172.21.15.102:0/578687030 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f88100ce0e0 0x7f88100ccdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T18:41:43.025 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:43.012+0000 7f8814eac640 1 -- 172.21.15.102:0/578687030 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f881006fd10 msgr2=0x7f881015c630 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-11-13T18:41:43.026 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:43.012+0000 7f8814eac640 1 --2- 172.21.15.102:0/578687030 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f881006fd10 0x7f881015c630 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T18:41:43.026 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:43.012+0000 7f8814eac640 1 -- 172.21.15.102:0/578687030 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f88100ce0e0 msgr2=0x7f88100ccdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T18:41:43.027 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:43.012+0000 7f8814eac640 1 --2- 172.21.15.102:0/578687030 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f88100ce0e0 0x7f88100ccdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T18:41:43.027 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:43.012+0000 7f8814eac640 1 -- 172.21.15.102:0/578687030 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8800009830 con 0x7f88101591f0 2023-11-13T18:41:43.032 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:43.024+0000 7f8814eac640 1 --2- 172.21.15.102:0/578687030 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f88101591f0 0x7f88100cd2f0 secure :-1 s=READY pgs=911 cs=0 l=1 rev1=1 crypto rx=0x7f880001baf0 tx=0x7f880001ac60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-13T18:41:43.033 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:43.024+0000 7f880cff9640 1 -- 172.21.15.102:0/578687030 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88000aec80 con 0x7f88101591f0 2023-11-13T18:41:43.033 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:43.024+0000 7f880cff9640 1 -- 172.21.15.102:0/578687030 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f88000aede0 con 0x7f88101591f0 2023-11-13T18:41:43.033 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:43.024+0000 7f880cff9640 1 -- 172.21.15.102:0/578687030 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88000b76a0 con 0x7f88101591f0 2023-11-13T18:41:43.034 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:43.024+0000 7f881690f640 1 -- 172.21.15.102:0/578687030 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f881015d1d0 con 0x7f88101591f0 2023-11-13T18:41:43.035 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:43.024+0000 7f881690f640 1 -- 172.21.15.102:0/578687030 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f881015a1e0 con 0x7f88101591f0 2023-11-13T18:41:43.040 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:43.032+0000 7f881690f640 1 -- 172.21.15.102:0/578687030 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f88101554c0 con 0x7f88101591f0 2023-11-13T18:41:43.048 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:43.032+0000 7f880cff9640 1 -- 172.21.15.102:0/578687030 <== mon.1 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f88000b7800 con 0x7f88101591f0 2023-11-13T18:41:43.048 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:43.036+0000 7f880cff9640 1 --2- 172.21.15.102:0/578687030 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f87f0066470 0x7f87f0068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T18:41:43.049 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:43.036+0000 7f880cff9640 1 -- 172.21.15.102:0/578687030 <== mon.1 v2:172.21.15.154:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f880011f550 con 0x7f88101591f0 2023-11-13T18:41:43.049 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:43.040+0000 7f880ffff640 1 --2- 172.21.15.102:0/578687030 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f87f0066470 0x7f87f0068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T18:41:43.065 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:43.056+0000 7f880ffff640 1 --2- 172.21.15.102:0/578687030 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f87f0066470 0x7f87f0068930 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 crypto rx=0x7f8808006fd0 tx=0x7f8808006b40 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-13T18:41:43.066 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:43.056+0000 7f880cff9640 1 -- 172.21.15.102:0/578687030 <== mon.1 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f88000eccd0 con 0x7f88101591f0 2023-11-13T18:41:44.552 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:44.540+0000 7f881690f640 1 -- 172.21.15.102:0/578687030 --> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f8810165f20 con 0x7f87f0066470 2023-11-13T18:41:44.561 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:44.552+0000 7f880cff9640 1 -- 172.21.15.102:0/578687030 <== mgr.4103 v2:172.21.15.102:6832/1009482693 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+49510 (secure 0 0 0) 0x7f8808012390 con 0x7f87f0066470 2023-11-13T18:41:44.565 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T18:41:44.565 INFO:teuthology.orchestra.run.smithi102.stderr:dumped all 2023-11-13T18:41:44.579 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:44.568+0000 7f881690f640 1 -- 172.21.15.102:0/578687030 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f87f0066470 msgr2=0x7f87f0068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T18:41:44.580 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:44.568+0000 7f881690f640 1 --2- 172.21.15.102:0/578687030 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f87f0066470 0x7f87f0068930 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 crypto rx=0x7f8808006fd0 tx=0x7f8808006b40 comp rx=0 tx=0).stop 2023-11-13T18:41:44.580 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:44.568+0000 7f881690f640 1 -- 172.21.15.102:0/578687030 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f88101591f0 msgr2=0x7f88100cd2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T18:41:44.580 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:44.568+0000 7f881690f640 1 --2- 172.21.15.102:0/578687030 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f88101591f0 0x7f88100cd2f0 secure :-1 s=READY pgs=911 cs=0 l=1 rev1=1 crypto rx=0x7f880001baf0 tx=0x7f880001ac60 comp rx=0 tx=0).stop 2023-11-13T18:41:44.581 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:44.572+0000 7f881690f640 1 -- 172.21.15.102:0/578687030 shutdown_connections 2023-11-13T18:41:44.581 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:44.572+0000 7f881690f640 1 --2- 172.21.15.102:0/578687030 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f88101591f0 0x7f88100cd2f0 unknown :-1 s=CLOSED pgs=911 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T18:41:44.581 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:44.572+0000 7f881690f640 1 --2- 172.21.15.102:0/578687030 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f87f0066470 0x7f87f0068930 unknown :-1 s=CLOSED pgs=753 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T18:41:44.582 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:44.572+0000 7f881690f640 1 --2- 172.21.15.102:0/578687030 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f88100ce0e0 0x7f88100ccdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T18:41:44.582 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:44.572+0000 7f881690f640 1 --2- 172.21.15.102:0/578687030 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f881006fd10 0x7f881015c630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T18:41:44.582 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:44.572+0000 7f881690f640 1 -- 172.21.15.102:0/578687030 >> 172.21.15.102:0/578687030 conn(0x7f88100cb5c0 msgr2=0x7f88100cad60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-13T18:41:44.583 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:44.572+0000 7f881690f640 1 -- 172.21.15.102:0/578687030 shutdown_connections 2023-11-13T18:41:44.584 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:44.572+0000 7f881690f640 1 -- 172.21.15.102:0/578687030 wait complete. 2023-11-13T18:41:44.726 INFO:teuthology.orchestra.run.smithi102.stdout:{"pg_ready":true,"pg_map":{"version":13013,"stamp":"2023-11-13T18:41:43.985075+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":84,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":19257160,"kb_used_data":6482976,"kb_used_omap":3957,"kb_used_meta":12760970,"kb_avail":735717560,"statfs":{"total":773094113280,"available":753374781440,"internally_reserved":0,"allocated":6638567424,"data_stored":6621873377,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4052240,"internal_metadata":13067234032},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2203,"apply_latency_ms":2203,"commit_latency_ns":2203000000,"apply_latency_ns":2203000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.022504"},"pg_stats":[{"pgid":"1.0","version":"17'117","reported_seq":395,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-11-13T18:41:29.715310+0000","last_change":"2023-11-13T11:28:47.002866+0000","last_active":"2023-11-13T18:41:29.715310+0000","last_peered":"2023-11-13T18:41:29.715310+0000","last_clean":"2023-11-13T18:41:29.715310+0000","last_became_active":"2023-11-13T11:28:47.001494+0000","last_became_peered":"2023-11-13T11:28:47.001494+0000","last_unstale":"2023-11-13T18:41:29.715310+0000","last_undegraded":"2023-11-13T18:41:29.715310+0000","last_fullsized":"2023-11-13T18:41:29.715310+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-13T11:28:45.879416+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-13T11:28:45.879416+0000","last_clean_scrub_stamp":"2023-11-13T11:28:45.879416+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-14T14:38:55.166320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":15,"seq":64424514636,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":4121596,"kb_used_data":2384880,"kb_used_omap":112,"kb_used_meta":1736591,"kb_avail":90250244,"statfs":{"total":96636764160,"available":92416249856,"internally_reserved":0,"allocated":2442117120,"data_stored":2436381218,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":115290,"internal_metadata":1778269606},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":208,"apply_latency_ms":208,"commit_latency_ns":208000000,"apply_latency_ns":208000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Nov 13 18:41:27 2023","interfaces":[{"interface":"back","average":{"1min":1.6399999999999999,"5min":1.431,"15min":1.4550000000000001},"min":{"1min":0.377,"5min":0.35899999999999999,"15min":0.307},"max":{"1min":4.843,"5min":7.2640000000000002,"15min":10.75},"last":4.8819999999999997},{"interface":"front","average":{"1min":1.8700000000000001,"5min":1.7070000000000001,"15min":1.5589999999999999},"min":{"1min":0.48899999999999999,"5min":0.36899999999999999,"15min":0.317},"max":{"1min":5.8250000000000002,"5min":8.3000000000000007,"15min":8.3000000000000007},"last":4.734}]},{"osd":1,"last update":"Mon Nov 13 18:41:27 2023","interfaces":[{"interface":"back","average":{"1min":1.4670000000000001,"5min":1.506,"15min":1.526},"min":{"1min":0.45300000000000001,"5min":0.439,"15min":0.39100000000000001},"max":{"1min":8.0519999999999996,"5min":8.0519999999999996,"15min":8.0519999999999996},"last":0.65200000000000002},{"interface":"front","average":{"1min":2.2109999999999999,"5min":1.5569999999999999,"15min":1.6739999999999999},"min":{"1min":0.38500000000000001,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":7.9489999999999998,"5min":7.9489999999999998,"15min":9.1679999999999993},"last":1.264}]},{"osd":2,"last update":"Mon Nov 13 18:41:27 2023","interfaces":[{"interface":"back","average":{"1min":1.526,"5min":1.6439999999999999,"15min":1.786},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":5.532,"5min":8.7929999999999993,"15min":13.769},"last":1.756},{"interface":"front","average":{"1min":1.7450000000000001,"5min":1.5189999999999999,"15min":1.6839999999999999},"min":{"1min":0.55200000000000005,"5min":0.42699999999999999,"15min":0.42199999999999999},"max":{"1min":6.3730000000000002,"5min":9.7799999999999994,"15min":16.114999999999998},"last":0.79200000000000004}]},{"osd":3,"last update":"Mon Nov 13 18:41:27 2023","interfaces":[{"interface":"back","average":{"1min":2.0880000000000001,"5min":1.899,"15min":1.7470000000000001},"min":{"1min":0.64200000000000002,"5min":0.438,"15min":0.38500000000000001},"max":{"1min":6.7960000000000003,"5min":7.5999999999999996,"15min":8.9459999999999997},"last":1.3029999999999999},{"interface":"front","average":{"1min":4.0709999999999997,"5min":2.1419999999999999,"15min":1.954},"min":{"1min":0.46600000000000003,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":47.872,"5min":47.872,"15min":47.872},"last":1.3979999999999999}]},{"osd":4,"last update":"Mon Nov 13 18:41:27 2023","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.73399999999999999,"15min":0.61299999999999999},"min":{"1min":0.40999999999999998,"5min":0.35099999999999998,"15min":0.32400000000000001},"max":{"1min":1.5309999999999999,"5min":7.8949999999999996,"15min":7.8949999999999996},"last":1.002},{"interface":"front","average":{"1min":0.66700000000000004,"5min":0.69099999999999995,"15min":0.61599999999999999},"min":{"1min":0.46700000000000003,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":1.851,"5min":7.5179999999999998,"15min":7.5179999999999998},"last":1.9470000000000001}]},{"osd":5,"last update":"Mon Nov 13 18:41:27 2023","interfaces":[{"interface":"back","average":{"1min":1.0900000000000001,"5min":0.85199999999999998,"15min":0.70899999999999996},"min":{"1min":0.45900000000000002,"5min":0.36499999999999999,"15min":0.36399999999999999},"max":{"1min":9.968,"5min":9.968,"15min":9.968},"last":0.96599999999999997},{"interface":"front","average":{"1min":1.389,"5min":0.998,"15min":0.752},"min":{"1min":0.48799999999999999,"5min":0.379,"15min":0.379},"max":{"1min":13.734999999999999,"5min":13.734999999999999,"15min":13.734999999999999},"last":1.202}]},{"osd":7,"last update":"Mon Nov 13 18:41:27 2023","interfaces":[{"interface":"back","average":{"1min":0.69799999999999995,"5min":0.81000000000000005,"15min":0.72999999999999998},"min":{"1min":0.51700000000000002,"5min":0.39800000000000002,"15min":0.378},"max":{"1min":1.891,"5min":7.5609999999999999,"15min":7.5609999999999999},"last":1.6599999999999999},{"interface":"front","average":{"1min":0.79700000000000004,"5min":0.91400000000000003,"15min":0.77400000000000002},"min":{"1min":0.52900000000000003,"5min":0.40899999999999997,"15min":0.40699999999999997},"max":{"1min":2.2869999999999999,"5min":7.9880000000000004,"15min":7.9880000000000004},"last":3.1869999999999998}]}]},{"osd":5,"up_from":15,"seq":64424514637,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1588244,"kb_used_data":1036,"kb_used_omap":582,"kb_used_meta":1586617,"kb_avail":92783596,"statfs":{"total":96636764160,"available":95010402304,"internally_reserved":0,"allocated":1060864,"data_stored":776285,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":596886,"internal_metadata":1624695914},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":229,"apply_latency_ms":229,"commit_latency_ns":229000000,"apply_latency_ns":229000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Nov 13 18:40:47 2023","interfaces":[{"interface":"back","average":{"1min":2.431,"5min":1.8600000000000001,"15min":1.734},"min":{"1min":0.35599999999999998,"5min":0.307,"15min":0.307},"max":{"1min":22.651,"5min":22.651,"15min":41.409999999999997},"last":2.2050000000000001},{"interface":"front","average":{"1min":2.9729999999999999,"5min":2.0630000000000002,"15min":2.0129999999999999},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":19.431999999999999,"5min":19.431999999999999,"15min":44.783000000000001},"last":1.5}]},{"osd":1,"last update":"Mon Nov 13 18:40:47 2023","interfaces":[{"interface":"back","average":{"1min":2.2229999999999999,"5min":1.754,"15min":1.8620000000000001},"min":{"1min":0.433,"5min":0.39600000000000002,"15min":0.374},"max":{"1min":22.616,"5min":22.616,"15min":22.616},"last":0.74399999999999999},{"interface":"front","average":{"1min":2.7400000000000002,"5min":1.887,"15min":1.675},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.38300000000000001},"max":{"1min":22.231000000000002,"5min":22.231000000000002,"15min":22.231000000000002},"last":1.248}]},{"osd":2,"last update":"Mon Nov 13 18:40:47 2023","interfaces":[{"interface":"back","average":{"1min":2.9319999999999999,"5min":1.9359999999999999,"15min":1.9650000000000001},"min":{"1min":0.50900000000000001,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":13.291,"5min":13.291,"15min":45.125},"last":0.78700000000000003},{"interface":"front","average":{"1min":3.7959999999999998,"5min":1.861,"15min":1.98},"min":{"1min":0.70699999999999996,"5min":0.47199999999999998,"15min":0.45800000000000002},"max":{"1min":14.776,"5min":14.776,"15min":44.991},"last":5.6500000000000004}]},{"osd":3,"last update":"Mon Nov 13 18:40:47 2023","interfaces":[{"interface":"back","average":{"1min":4.1859999999999999,"5min":2.0739999999999998,"15min":2.0150000000000001},"min":{"1min":0.53300000000000003,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":55.082999999999998,"5min":55.082999999999998,"15min":55.082999999999998},"last":1.081},{"interface":"front","average":{"1min":4.2539999999999996,"5min":2.1859999999999999,"15min":2.0739999999999998},"min":{"1min":0.60499999999999998,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":55.040999999999997,"5min":55.040999999999997,"15min":55.040999999999997},"last":1.0109999999999999}]},{"osd":4,"last update":"Mon Nov 13 18:40:47 2023","interfaces":[{"interface":"back","average":{"1min":1.0409999999999999,"5min":0.70199999999999996,"15min":0.58499999999999996},"min":{"1min":0.34399999999999997,"5min":0.308,"15min":0.28599999999999998},"max":{"1min":7.3869999999999996,"5min":7.3869999999999996,"15min":7.3869999999999996},"last":0.81999999999999995},{"interface":"front","average":{"1min":0.95999999999999996,"5min":0.78100000000000003,"15min":0.64900000000000002},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.33700000000000002},"max":{"1min":7.4329999999999998,"5min":7.4329999999999998,"15min":7.4329999999999998},"last":0.84199999999999997}]},{"osd":6,"last update":"Mon Nov 13 18:40:47 2023","interfaces":[{"interface":"back","average":{"1min":0.98599999999999999,"5min":0.76700000000000002,"15min":0.63},"min":{"1min":0.35499999999999998,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":8.2690000000000001,"5min":8.2690000000000001,"15min":8.2690000000000001},"last":0.72299999999999998},{"interface":"front","average":{"1min":2.383,"5min":0.97199999999999998,"15min":0.70599999999999996},"min":{"1min":0.40200000000000002,"5min":0.35399999999999998,"15min":0.33900000000000002},"max":{"1min":22.547999999999998,"5min":22.547999999999998,"15min":22.547999999999998},"last":0.70399999999999996}]},{"osd":7,"last update":"Mon Nov 13 18:40:47 2023","interfaces":[{"interface":"back","average":{"1min":1.1020000000000001,"5min":0.78000000000000003,"15min":0.65600000000000003},"min":{"1min":0.45600000000000002,"5min":0.37,"15min":0.37},"max":{"1min":10.66,"5min":10.66,"15min":10.66},"last":0.89400000000000002},{"interface":"front","average":{"1min":0.747,"5min":0.77200000000000002,"15min":0.67100000000000004},"min":{"1min":0.46300000000000002,"5min":0.38800000000000001,"15min":0.36399999999999999},"max":{"1min":1.8109999999999999,"5min":3.9809999999999999,"15min":3.9809999999999999},"last":0.96599999999999997}]}]},{"osd":4,"up_from":15,"seq":64424514636,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":1445588,"kb_used_data":460,"kb_used_omap":965,"kb_used_meta":1444154,"kb_avail":92926252,"statfs":{"total":96636764160,"available":95156482048,"internally_reserved":0,"allocated":471040,"data_stored":186886,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":988456,"internal_metadata":1478814424},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":346,"apply_latency_ms":346,"commit_latency_ns":346000000,"apply_latency_ns":346000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Nov 13 18:40:42 2023","interfaces":[{"interface":"back","average":{"1min":2.0859999999999999,"5min":1.599,"15min":1.867},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.316},"max":{"1min":18.532,"5min":18.532,"15min":88.278000000000006},"last":1.2230000000000001},{"interface":"front","average":{"1min":1.923,"5min":1.3320000000000001,"15min":1.786},"min":{"1min":0.56999999999999995,"5min":0.36599999999999999,"15min":0.33900000000000002},"max":{"1min":5.2750000000000004,"5min":5.5170000000000003,"15min":88.555000000000007},"last":9.4730000000000008}]},{"osd":1,"last update":"Mon Nov 13 18:40:42 2023","interfaces":[{"interface":"back","average":{"1min":2.6269999999999998,"5min":1.9079999999999999,"15min":2.1509999999999998},"min":{"1min":0.35499999999999998,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":20.643000000000001,"5min":20.643000000000001,"15min":85.168999999999997},"last":1.335},{"interface":"front","average":{"1min":2.4569999999999999,"5min":1.726,"15min":1.9630000000000001},"min":{"1min":0.42399999999999999,"5min":0.376,"15min":0.376},"max":{"1min":24.550999999999998,"5min":24.550999999999998,"15min":85.587999999999994},"last":0.78400000000000003}]},{"osd":2,"last update":"Mon Nov 13 18:40:42 2023","interfaces":[{"interface":"back","average":{"1min":1.631,"5min":1.6220000000000001,"15min":1.673},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.38600000000000001},"max":{"1min":6.0720000000000001,"5min":6.0720000000000001,"15min":14.832000000000001},"last":0.83199999999999996},{"interface":"front","average":{"1min":3.073,"5min":1.8540000000000001,"15min":1.5640000000000001},"min":{"1min":0.45600000000000002,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":27.375,"5min":27.375,"15min":27.375},"last":1.423}]},{"osd":3,"last update":"Mon Nov 13 18:40:42 2023","interfaces":[{"interface":"back","average":{"1min":1.571,"5min":1.8720000000000001,"15min":1.841},"min":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.48199999999999998},"max":{"1min":6.4619999999999997,"5min":6.4619999999999997,"15min":11.146000000000001},"last":9.8620000000000001},{"interface":"front","average":{"1min":1.992,"5min":1.968,"15min":1.8979999999999999},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.46300000000000002},"max":{"1min":11.362,"5min":11.362,"15min":11.362},"last":1.734}]},{"osd":5,"last update":"Mon Nov 13 18:40:42 2023","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":0.56000000000000005,"15min":0.53100000000000003},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.30199999999999999},"max":{"1min":1.9399999999999999,"5min":1.9399999999999999,"15min":2.1720000000000002},"last":1.587},{"interface":"front","average":{"1min":0.48399999999999999,"5min":0.56100000000000005,"15min":0.56399999999999995},"min":{"1min":0.39200000000000002,"5min":0.33900000000000002,"15min":0.309},"max":{"1min":0.72899999999999998,"5min":1.7909999999999999,"15min":2.2890000000000001},"last":9.9429999999999996}]},{"osd":6,"last update":"Mon Nov 13 18:40:42 2023","interfaces":[{"interface":"back","average":{"1min":0.76900000000000002,"5min":0.65800000000000003,"15min":0.61299999999999999},"min":{"1min":0.40200000000000002,"5min":0.314,"15min":0.314},"max":{"1min":5.9500000000000002,"5min":5.9500000000000002,"15min":5.9500000000000002},"last":0.74399999999999999},{"interface":"front","average":{"1min":0.622,"5min":0.65300000000000002,"15min":0.63700000000000001},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":1.9930000000000001,"5min":3.4590000000000001,"15min":3.6850000000000001},"last":1.1779999999999999}]},{"osd":7,"last update":"Mon Nov 13 18:40:42 2023","interfaces":[{"interface":"back","average":{"1min":0.78700000000000003,"5min":0.69999999999999996,"15min":0.66700000000000004},"min":{"1min":0.42799999999999999,"5min":0.374,"15min":0.35899999999999999},"max":{"1min":5.3300000000000001,"5min":5.3300000000000001,"15min":5.3300000000000001},"last":9.9039999999999999},{"interface":"front","average":{"1min":0.94999999999999996,"5min":0.76800000000000002,"15min":0.71399999999999997},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":7.8789999999999996,"5min":7.8789999999999996,"15min":7.8789999999999996},"last":0.69699999999999995}]}]},{"osd":3,"up_from":15,"seq":64424514580,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1805848,"kb_used_data":30672,"kb_used_omap":1085,"kb_used_meta":1774082,"kb_avail":92565992,"statfs":{"total":96636764160,"available":94787575808,"internally_reserved":0,"allocated":31408128,"data_stored":31049758,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1111813,"internal_metadata":1816660219},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":268,"apply_latency_ms":268,"commit_latency_ns":268000000,"apply_latency_ns":268000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Nov 13 18:40:54 2023","interfaces":[{"interface":"back","average":{"1min":3.7240000000000002,"5min":3.4089999999999998,"15min":3.306},"min":{"1min":0.54800000000000004,"5min":0.377,"15min":0.311},"max":{"1min":23.887,"5min":23.887,"15min":23.887},"last":1.077},{"interface":"front","average":{"1min":6.5469999999999997,"5min":3.54,"15min":3.4470000000000001},"min":{"1min":0.70299999999999996,"5min":0.52100000000000002,"15min":0.35799999999999998},"max":{"1min":48.045999999999999,"5min":48.045999999999999,"15min":48.045999999999999},"last":1.252}]},{"osd":1,"last update":"Mon Nov 13 18:40:54 2023","interfaces":[{"interface":"back","average":{"1min":3.036,"5min":3.1019999999999999,"15min":3.54},"min":{"1min":0.60699999999999998,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":11.631,"5min":23.428000000000001,"15min":100.48},"last":1.3600000000000001},{"interface":"front","average":{"1min":3.6779999999999999,"5min":3.5710000000000002,"15min":3.4969999999999999},"min":{"1min":0.63700000000000001,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":13.286,"5min":21.818999999999999,"15min":21.818999999999999},"last":2.2050000000000001}]},{"osd":2,"last update":"Mon Nov 13 18:40:54 2023","interfaces":[{"interface":"back","average":{"1min":6.6559999999999997,"5min":3.8809999999999998,"15min":4.0259999999999998},"min":{"1min":0.67600000000000005,"5min":0.53600000000000003,"15min":0.53200000000000003},"max":{"1min":21.638999999999999,"5min":22.738,"15min":100.589},"last":2.266},{"interface":"front","average":{"1min":3.3759999999999999,"5min":3.6099999999999999,"15min":3.617},"min":{"1min":0.74399999999999999,"5min":0.63900000000000001,"15min":0.439},"max":{"1min":8.3759999999999994,"5min":21.300999999999998,"15min":21.300999999999998},"last":2.3380000000000001}]},{"osd":4,"last update":"Mon Nov 13 18:40:54 2023","interfaces":[{"interface":"back","average":{"1min":4.2240000000000002,"5min":2.7269999999999999,"15min":2.637},"min":{"1min":0.69999999999999996,"5min":0.55700000000000005,"15min":0.46200000000000002},"max":{"1min":26.68,"5min":26.68,"15min":26.68},"last":1.742},{"interface":"front","average":{"1min":3.625,"5min":2.9060000000000001,"15min":2.5979999999999999},"min":{"1min":0.70899999999999996,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":17.091000000000001,"5min":23.655999999999999,"15min":23.655999999999999},"last":2.0350000000000001}]},{"osd":5,"last update":"Mon Nov 13 18:40:54 2023","interfaces":[{"interface":"back","average":{"1min":3.8359999999999999,"5min":3.028,"15min":2.778},"min":{"1min":0.64700000000000002,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":21.454999999999998,"5min":23.75,"15min":23.75},"last":2.1669999999999998},{"interface":"front","average":{"1min":2.5859999999999999,"5min":2.9470000000000001,"15min":2.7810000000000001},"min":{"1min":0.98499999999999999,"5min":0.66900000000000004,"15min":0.46700000000000003},"max":{"1min":7.9420000000000002,"5min":22.007000000000001,"15min":22.007000000000001},"last":2.2999999999999998}]},{"osd":6,"last update":"Mon Nov 13 18:40:54 2023","interfaces":[{"interface":"back","average":{"1min":4.218,"5min":2.919,"15min":2.782},"min":{"1min":0.83899999999999997,"5min":0.626,"15min":0.52500000000000002},"max":{"1min":26.844999999999999,"5min":26.844999999999999,"15min":26.844999999999999},"last":1.704},{"interface":"front","average":{"1min":3.9020000000000001,"5min":3.1419999999999999,"15min":3.218},"min":{"1min":0.67800000000000005,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":21.555,"5min":23.841000000000001,"15min":100.315},"last":1.9159999999999999}]},{"osd":7,"last update":"Mon Nov 13 18:40:54 2023","interfaces":[{"interface":"back","average":{"1min":3.1739999999999999,"5min":3.2069999999999999,"15min":3.0059999999999998},"min":{"1min":1.0369999999999999,"5min":0.749,"15min":0.55500000000000005},"max":{"1min":12.794,"5min":22.087,"15min":22.087},"last":2.2509999999999999},{"interface":"front","average":{"1min":4.9820000000000002,"5min":3.1230000000000002,"15min":2.9900000000000002},"min":{"1min":1.0209999999999999,"5min":0.621,"15min":0.55500000000000005},"max":{"1min":26.939,"5min":26.939,"15min":26.939},"last":2.3860000000000001}]}]},{"osd":2,"up_from":15,"seq":64424514578,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":2417808,"kb_used_data":717448,"kb_used_omap":688,"kb_used_meta":1699663,"kb_avail":91954032,"statfs":{"total":96636764160,"available":94160928768,"internally_reserved":0,"allocated":734666752,"data_stored":732795262,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":705113,"internal_metadata":1740455335},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":227,"apply_latency_ms":227,"commit_latency_ns":227000000,"apply_latency_ns":227000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Nov 13 18:41:20 2023","interfaces":[{"interface":"back","average":{"1min":3.8010000000000002,"5min":3.2360000000000002,"15min":3.1880000000000002},"min":{"1min":0.50600000000000001,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":32.695999999999998,"5min":32.695999999999998,"15min":32.695999999999998},"last":9.5899999999999999},{"interface":"front","average":{"1min":4.8170000000000002,"5min":3.254,"15min":3.258},"min":{"1min":0.71999999999999997,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":31.927,"5min":31.927,"15min":31.927},"last":0.98399999999999999}]},{"osd":1,"last update":"Mon Nov 13 18:41:20 2023","interfaces":[{"interface":"back","average":{"1min":2.5430000000000001,"5min":2.8119999999999998,"15min":3.2949999999999999},"min":{"1min":0.58199999999999996,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":7.6050000000000004,"5min":14.593,"15min":19.190999999999999},"last":1.806},{"interface":"front","average":{"1min":2.984,"5min":3.613,"15min":3.6469999999999998},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":9.8849999999999998,"5min":22.782,"15min":22.782},"last":0.71499999999999997}]},{"osd":3,"last update":"Mon Nov 13 18:41:20 2023","interfaces":[{"interface":"back","average":{"1min":3.472,"5min":3.3849999999999998,"15min":3.3969999999999998},"min":{"1min":0.64600000000000002,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":23.966999999999999,"5min":27.233000000000001,"15min":27.233000000000001},"last":1.577},{"interface":"front","average":{"1min":3.359,"5min":3.1059999999999999,"15min":3.516},"min":{"1min":0.68600000000000005,"5min":0.52300000000000002,"15min":0.40799999999999997},"max":{"1min":13.298,"5min":14.244999999999999,"15min":20.870000000000001},"last":1.681}]},{"osd":4,"last update":"Mon Nov 13 18:41:20 2023","interfaces":[{"interface":"back","average":{"1min":3.3199999999999998,"5min":2.4460000000000002,"15min":2.7589999999999999},"min":{"1min":0.61699999999999999,"5min":0.46600000000000003,"15min":0.45400000000000001},"max":{"1min":29.552,"5min":29.552,"15min":29.552},"last":9.6869999999999994},{"interface":"front","average":{"1min":3.5760000000000001,"5min":2.7240000000000002,"15min":2.7010000000000001},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":24.064,"5min":24.064,"15min":24.064},"last":7.6550000000000002}]},{"osd":5,"last update":"Mon Nov 13 18:41:20 2023","interfaces":[{"interface":"back","average":{"1min":3.1150000000000002,"5min":3.0419999999999998,"15min":2.7799999999999998},"min":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.55900000000000005},"max":{"1min":23.722999999999999,"5min":30.375,"15min":30.375},"last":1.728},{"interface":"front","average":{"1min":2.5739999999999998,"5min":2.3980000000000001,"15min":2.831},"min":{"1min":0.64600000000000002,"5min":0.51900000000000002,"15min":0.49399999999999999},"max":{"1min":12.026,"5min":14.148999999999999,"15min":14.148999999999999},"last":9.468}]},{"osd":6,"last update":"Mon Nov 13 18:41:20 2023","interfaces":[{"interface":"back","average":{"1min":3.573,"5min":2.8159999999999998,"15min":2.8399999999999999},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":21.073,"5min":21.073,"15min":21.073},"last":4.1580000000000004},{"interface":"front","average":{"1min":3.9820000000000002,"5min":3.2930000000000001,"15min":3.0310000000000001},"min":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":35.908999999999999,"5min":35.908999999999999,"15min":35.908999999999999},"last":4.2409999999999997}]},{"osd":7,"last update":"Mon Nov 13 18:41:20 2023","interfaces":[{"interface":"back","average":{"1min":3.6829999999999998,"5min":3.0299999999999998,"15min":2.988},"min":{"1min":0.66600000000000004,"5min":0.57899999999999996,"15min":0.55300000000000005},"max":{"1min":20.969000000000001,"5min":20.969000000000001,"15min":20.969000000000001},"last":4.1950000000000003},{"interface":"front","average":{"1min":3.5419999999999998,"5min":3.387,"15min":3.1339999999999999},"min":{"1min":0.80700000000000005,"5min":0.748,"15min":0.63400000000000001},"max":{"1min":23.847000000000001,"5min":26.902000000000001,"15min":26.902000000000001},"last":1.768}]}]},{"osd":1,"up_from":15,"seq":64424514593,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1622224,"kb_used_data":98728,"kb_used_omap":147,"kb_used_meta":1514156,"kb_avail":92749616,"statfs":{"total":96636764160,"available":94975606784,"internally_reserved":0,"allocated":101097472,"data_stored":100551400,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":150803,"internal_metadata":1550496493},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":549,"apply_latency_ms":549,"commit_latency_ns":549000000,"apply_latency_ns":549000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Nov 13 18:41:25 2023","interfaces":[{"interface":"back","average":{"1min":2.569,"5min":2.7400000000000002,"15min":2.8730000000000002},"min":{"1min":0.67000000000000004,"5min":0.435,"15min":0.29299999999999998},"max":{"1min":8.0800000000000001,"5min":11.255000000000001,"15min":14.548999999999999},"last":12.173999999999999},{"interface":"front","average":{"1min":2.2589999999999999,"5min":3.2450000000000001,"15min":3.3519999999999999},"min":{"1min":0.47399999999999998,"5min":0.45300000000000001,"15min":0.38300000000000001},"max":{"1min":4.2030000000000003,"5min":26.187999999999999,"15min":26.187999999999999},"last":1.4119999999999999}]},{"osd":2,"last update":"Mon Nov 13 18:41:25 2023","interfaces":[{"interface":"back","average":{"1min":2.9590000000000001,"5min":2.9460000000000002,"15min":2.964},"min":{"1min":0.55800000000000005,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":8.2059999999999995,"5min":11.381,"15min":12.708},"last":12.086},{"interface":"front","average":{"1min":2.3610000000000002,"5min":3.3839999999999999,"15min":3.21},"min":{"1min":0.69499999999999995,"5min":0.54300000000000004,"15min":0.44},"max":{"1min":4.3109999999999999,"5min":27.844999999999999,"15min":27.844999999999999},"last":1.5169999999999999}]},{"osd":3,"last update":"Mon Nov 13 18:41:25 2023","interfaces":[{"interface":"back","average":{"1min":3.0779999999999998,"5min":3.7280000000000002,"15min":3.5699999999999998},"min":{"1min":0.872,"5min":0.66400000000000003,"15min":0.44400000000000001},"max":{"1min":8.5470000000000006,"5min":27.838999999999999,"15min":27.838999999999999},"last":4.0949999999999998},{"interface":"front","average":{"1min":2.286,"5min":2.948,"15min":3.1920000000000002},"min":{"1min":0.61799999999999999,"5min":0.50800000000000001,"15min":0.436},"max":{"1min":4.2190000000000003,"5min":12.034000000000001,"15min":15.619},"last":6.5679999999999996}]},{"osd":4,"last update":"Mon Nov 13 18:41:25 2023","interfaces":[{"interface":"back","average":{"1min":2.0259999999999998,"5min":2.782,"15min":2.617},"min":{"1min":0.71499999999999997,"5min":0.57999999999999996,"15min":0.46300000000000002},"max":{"1min":4.024,"5min":27.952000000000002,"15min":27.952000000000002},"last":11.776},{"interface":"front","average":{"1min":2.9049999999999998,"5min":2.714,"15min":2.4449999999999998},"min":{"1min":0.65800000000000003,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":8.3170000000000002,"5min":27.678999999999998,"15min":27.678999999999998},"last":11.967000000000001}]},{"osd":5,"last update":"Mon Nov 13 18:41:25 2023","interfaces":[{"interface":"back","average":{"1min":3.044,"5min":3.073,"15min":2.6360000000000001},"min":{"1min":0.70299999999999996,"5min":0.54600000000000004,"15min":0.52500000000000002},"max":{"1min":8.5020000000000007,"5min":27.588999999999999,"15min":27.588999999999999},"last":12.015000000000001},{"interface":"front","average":{"1min":2.4060000000000001,"5min":3.2229999999999999,"15min":2.7770000000000001},"min":{"1min":0.73499999999999999,"5min":0.69999999999999996,"15min":0.47299999999999998},"max":{"1min":4.282,"5min":26.579999999999998,"15min":26.579999999999998},"last":1.3049999999999999}]},{"osd":6,"last update":"Mon Nov 13 18:41:25 2023","interfaces":[{"interface":"back","average":{"1min":2.1749999999999998,"5min":3.157,"15min":2.8370000000000002},"min":{"1min":0.93700000000000006,"5min":0.54900000000000004,"15min":0.48299999999999998},"max":{"1min":4.5750000000000002,"5min":29.478999999999999,"15min":29.478999999999999},"last":11.863},{"interface":"front","average":{"1min":3.0859999999999999,"5min":3.2229999999999999,"15min":2.8010000000000002},"min":{"1min":0.73999999999999999,"5min":0.57999999999999996,"15min":0.57999999999999996},"max":{"1min":8.4109999999999996,"5min":36.837000000000003,"15min":36.837000000000003},"last":12.051}]},{"osd":7,"last update":"Mon Nov 13 18:41:25 2023","interfaces":[{"interface":"back","average":{"1min":2.5590000000000002,"5min":3.2959999999999998,"15min":2.8780000000000001},"min":{"1min":0.70199999999999996,"5min":0.626,"15min":0.54200000000000004},"max":{"1min":4.3879999999999999,"5min":26.622,"15min":26.622},"last":1.1850000000000001},{"interface":"front","average":{"1min":2.3879999999999999,"5min":3.1619999999999999,"15min":2.9420000000000002},"min":{"1min":0.93400000000000005,"5min":0.65900000000000003,"15min":0.54100000000000004},"max":{"1min":5.2649999999999997,"5min":25.965,"15min":25.965},"last":11.816000000000001}]}]},{"osd":0,"up_from":15,"seq":64424514585,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":4501200,"kb_used_data":3156548,"kb_used_omap":245,"kb_used_meta":1344394,"kb_avail":89870640,"statfs":{"total":96636764160,"available":92027535360,"internally_reserved":0,"allocated":3232305152,"data_stored":3225143385,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":251097,"internal_metadata":1376660263},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":158,"apply_latency_ms":158,"commit_latency_ns":158000000,"apply_latency_ns":158000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Nov 13 18:41:05 2023","interfaces":[{"interface":"back","average":{"1min":2.6619999999999999,"5min":2.569,"15min":3.3380000000000001},"min":{"1min":0.64500000000000002,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":6.29,"5min":8.3640000000000008,"15min":132.19800000000001},"last":1.2929999999999999},{"interface":"front","average":{"1min":2.6909999999999998,"5min":2.9169999999999998,"15min":3.4470000000000001},"min":{"1min":0.54500000000000004,"5min":0.46400000000000002,"15min":0.45900000000000002},"max":{"1min":11.978999999999999,"5min":13.000999999999999,"15min":125.517},"last":1.4350000000000001}]},{"osd":2,"last update":"Mon Nov 13 18:41:05 2023","interfaces":[{"interface":"back","average":{"1min":2.3439999999999999,"5min":2.8050000000000002,"15min":3.2269999999999999},"min":{"1min":0.65400000000000003,"5min":0.372,"15min":0.372},"max":{"1min":6.2320000000000002,"5min":8.8879999999999999,"15min":13.459},"last":0.65800000000000003},{"interface":"front","average":{"1min":4.1520000000000001,"5min":3.327,"15min":3.395},"min":{"1min":0.75900000000000001,"5min":0.66000000000000003,"15min":0.44800000000000001},"max":{"1min":16.423999999999999,"5min":16.423999999999999,"15min":16.423999999999999},"last":0.82799999999999996}]},{"osd":3,"last update":"Mon Nov 13 18:41:05 2023","interfaces":[{"interface":"back","average":{"1min":3.8980000000000001,"5min":3.1040000000000001,"15min":3.133},"min":{"1min":0.69399999999999995,"5min":0.69399999999999995,"15min":0.45900000000000002},"max":{"1min":15.502000000000001,"5min":15.502000000000001,"15min":15.502000000000001},"last":1.2290000000000001},{"interface":"front","average":{"1min":3.5019999999999998,"5min":3.3010000000000002,"15min":3.5459999999999998},"min":{"1min":0.70099999999999996,"5min":0.67900000000000005,"15min":0.441},"max":{"1min":15.955,"5min":15.955,"15min":20.747},"last":0.57899999999999996}]},{"osd":4,"last update":"Mon Nov 13 18:41:05 2023","interfaces":[{"interface":"back","average":{"1min":2.5750000000000002,"5min":2.2290000000000001,"15min":2.4689999999999999},"min":{"1min":0.77400000000000002,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":6.2539999999999996,"5min":9.3949999999999996,"15min":10.611000000000001},"last":0.91600000000000004},{"interface":"front","average":{"1min":2.4300000000000002,"5min":2.3260000000000001,"15min":2.6560000000000001},"min":{"1min":0.78800000000000003,"5min":0.51800000000000002,"15min":0.48899999999999999},"max":{"1min":5.9619999999999997,"5min":8.7780000000000005,"15min":12.353999999999999},"last":0.70599999999999996}]},{"osd":5,"last update":"Mon Nov 13 18:41:05 2023","interfaces":[{"interface":"back","average":{"1min":2.8170000000000002,"5min":2.3399999999999999,"15min":2.4849999999999999},"min":{"1min":0.66300000000000003,"5min":0.66300000000000003,"15min":0.501},"max":{"1min":12.470000000000001,"5min":12.470000000000001,"15min":12.470000000000001},"last":1.155},{"interface":"front","average":{"1min":2.6709999999999998,"5min":2.3740000000000001,"15min":2.6309999999999998},"min":{"1min":0.81599999999999995,"5min":0.63700000000000001,"15min":0.50600000000000001},"max":{"1min":6.3810000000000002,"5min":9.516,"15min":9.9640000000000004},"last":1.0649999999999999}]},{"osd":6,"last update":"Mon Nov 13 18:41:05 2023","interfaces":[{"interface":"back","average":{"1min":2.8660000000000001,"5min":2.532,"15min":2.8599999999999999},"min":{"1min":0.92400000000000004,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":13.348000000000001,"5min":13.348000000000001,"15min":13.348000000000001},"last":0.77500000000000002},{"interface":"front","average":{"1min":2.629,"5min":2.4319999999999999,"15min":2.6360000000000001},"min":{"1min":0.84599999999999997,"5min":0.60499999999999998,"15min":0.56799999999999995},"max":{"1min":12.191000000000001,"5min":12.191000000000001,"15min":12.191000000000001},"last":0.98699999999999999}]},{"osd":7,"last update":"Mon Nov 13 18:41:05 2023","interfaces":[{"interface":"back","average":{"1min":2.8999999999999999,"5min":2.5859999999999999,"15min":2.742},"min":{"1min":0.76000000000000001,"5min":0.64900000000000002,"15min":0.51400000000000001},"max":{"1min":12.289999999999999,"5min":12.289999999999999,"15min":12.289999999999999},"last":1.3420000000000001},{"interface":"front","average":{"1min":2.9089999999999998,"5min":2.5489999999999999,"15min":2.7629999999999999},"min":{"1min":1.0409999999999999,"5min":0.64400000000000002,"15min":0.57499999999999996},"max":{"1min":6.4749999999999996,"5min":9.6199999999999992,"15min":10.743},"last":1.3939999999999999}]}]},{"osd":7,"up_from":14,"seq":60129547341,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1754652,"kb_used_data":93204,"kb_used_omap":129,"kb_used_meta":1661310,"kb_avail":92617188,"statfs":{"total":96636764160,"available":94840000512,"internally_reserved":0,"allocated":95440896,"data_stored":94989183,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":132782,"internal_metadata":1701181778},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":218,"apply_latency_ms":218,"commit_latency_ns":218000000,"apply_latency_ns":218000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Nov 13 18:41:38 2023","interfaces":[{"interface":"back","average":{"1min":2.0819999999999999,"5min":1.841,"15min":1.8100000000000001},"min":{"1min":0.39600000000000002,"5min":0.34100000000000003,"15min":0.30599999999999999},"max":{"1min":13.148999999999999,"5min":13.148999999999999,"15min":13.148999999999999},"last":13.148999999999999},{"interface":"front","average":{"1min":1.887,"5min":1.8999999999999999,"15min":1.6599999999999999},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":8.2729999999999997,"5min":8.2729999999999997,"15min":9.266},"last":8.2729999999999997}]},{"osd":1,"last update":"Mon Nov 13 18:41:38 2023","interfaces":[{"interface":"back","average":{"1min":1.581,"5min":2.0129999999999999,"15min":1.7589999999999999},"min":{"1min":0.51500000000000001,"5min":0.376,"15min":0.36399999999999999},"max":{"1min":7.7039999999999997,"5min":9.4909999999999997,"15min":9.4909999999999997},"last":3.6000000000000001},{"interface":"front","average":{"1min":1.843,"5min":2.036,"15min":1.8360000000000001},"min":{"1min":0.57199999999999995,"5min":0.47699999999999998,"15min":0.35599999999999998},"max":{"1min":6.9000000000000004,"5min":8.1280000000000001,"15min":9.4939999999999998},"last":3.6230000000000002}]},{"osd":2,"last update":"Mon Nov 13 18:41:38 2023","interfaces":[{"interface":"back","average":{"1min":3.8740000000000001,"5min":2.234,"15min":1.982},"min":{"1min":0.53800000000000003,"5min":0.51300000000000001,"15min":0.38400000000000001},"max":{"1min":27.635999999999999,"5min":27.635999999999999,"15min":27.635999999999999},"last":16.853000000000002},{"interface":"front","average":{"1min":2.1600000000000001,"5min":2.008,"15min":1.8859999999999999},"min":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45100000000000001},"max":{"1min":12.868,"5min":12.868,"15min":12.868},"last":12.868}]},{"osd":3,"last update":"Mon Nov 13 18:41:38 2023","interfaces":[{"interface":"back","average":{"1min":1.409,"5min":1.71,"15min":1.7769999999999999},"min":{"1min":0.54000000000000004,"5min":0.442,"15min":0.442},"max":{"1min":3.988,"5min":13.727,"15min":13.727},"last":0.71299999999999997},{"interface":"front","average":{"1min":1.9419999999999999,"5min":1.6839999999999999,"15min":2.0049999999999999},"min":{"1min":0.64500000000000002,"5min":0.45700000000000002,"15min":0.44500000000000001},"max":{"1min":6.944,"5min":7.5199999999999996,"15min":11.156000000000001},"last":0.95699999999999996}]},{"osd":4,"last update":"Mon Nov 13 18:41:38 2023","interfaces":[{"interface":"back","average":{"1min":1.1240000000000001,"5min":0.71699999999999997,"15min":0.60399999999999998},"min":{"1min":0.36599999999999999,"5min":0.34499999999999997,"15min":0.32700000000000001},"max":{"1min":8.0259999999999998,"5min":8.0259999999999998,"15min":8.0259999999999998},"last":3.6640000000000001},{"interface":"front","average":{"1min":0.98999999999999999,"5min":1.2869999999999999,"15min":0.82299999999999995},"min":{"1min":0.38500000000000001,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":4.7649999999999997,"5min":38.662999999999997,"15min":38.662999999999997},"last":0.66600000000000004}]},{"osd":5,"last update":"Mon Nov 13 18:41:38 2023","interfaces":[{"interface":"back","average":{"1min":1.516,"5min":0.83899999999999997,"15min":0.68500000000000005},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.32800000000000001},"max":{"1min":10.481,"5min":10.481,"15min":10.481},"last":1.3460000000000001},{"interface":"front","average":{"1min":1.1699999999999999,"5min":0.83199999999999996,"15min":0.68799999999999994},"min":{"1min":0.41199999999999998,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":8.1029999999999998,"5min":8.1029999999999998,"15min":8.1029999999999998},"last":3.706}]},{"osd":6,"last update":"Mon Nov 13 18:41:38 2023","interfaces":[{"interface":"back","average":{"1min":1.3859999999999999,"5min":1.0409999999999999,"15min":0.78600000000000003},"min":{"1min":0.45900000000000002,"5min":0.43099999999999999,"15min":0.40200000000000002},"max":{"1min":11.182,"5min":19.218,"15min":19.218},"last":3.7480000000000002},{"interface":"front","average":{"1min":1.4530000000000001,"5min":1.0489999999999999,"15min":0.80400000000000005},"min":{"1min":0.46999999999999997,"5min":0.38,"15min":0.373},"max":{"1min":11.202999999999999,"5min":13.677,"15min":13.677},"last":0.81399999999999995}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-13T18:41:44.728 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-13T18:41:45.608 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:45.600+0000 7fb5dd70f640 1 Processor -- start 2023-11-13T18:41:45.609 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:45.600+0000 7fb5dd70f640 1 -- start start 2023-11-13T18:41:45.610 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:45.600+0000 7fb5dd70f640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7fb5d815ef70 0x7fb5d80b18b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T18:41:45.610 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:45.600+0000 7fb5dd70f640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb5d80ade00 0x7fb5d8162300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T18:41:45.610 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:45.600+0000 7fb5dd70f640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb5d806e3c0 con 0x7fb5d806bb10 2023-11-13T18:41:45.611 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:45.600+0000 7fb5dd70f640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb5d80703a0 con 0x7fb5d815ef70 2023-11-13T18:41:45.611 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:45.600+0000 7fb5dd70f640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb5d8162840 con 0x7fb5d80ade00 2023-11-13T18:41:45.612 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:45.604+0000 7fb5d77fe640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb5d80ade00 0x7fb5d8162300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T18:41:45.612 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:45.604+0000 7fb5d77fe640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb5d80ade00 0x7fb5d8162300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.102:47148/0 (socket says 172.21.15.102:47148) 2023-11-13T18:41:45.613 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:45.604+0000 7fb5d77fe640 1 -- 172.21.15.102:0/1587064888 learned_addr learned my addr 172.21.15.102:0/1587064888 (peer_addr_for_me v2:172.21.15.102:0/0) 2023-11-13T18:41:45.613 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:45.604+0000 7fb5d6ffd640 1 --2- 172.21.15.102:0/1587064888 >> v2:172.21.15.102:3300/0 conn(0x7fb5d815ef70 0x7fb5d80b18b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T18:41:45.615 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:45.604+0000 7fb5d6ffd640 1 -- 172.21.15.102:0/1587064888 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb5d80ade00 msgr2=0x7fb5d8162300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-13T18:41:45.619 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:45.604+0000 7fb5d6ffd640 1 --2- 172.21.15.102:0/1587064888 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb5d80ade00 0x7fb5d8162300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T18:41:45.619 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:45.604+0000 7fb5d6ffd640 1 -- 172.21.15.102:0/1587064888 >> v1:172.21.15.102:6789/0 conn(0x7fb5d806bb10 legacy=0x7fb5d80ad6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-13T18:41:45.620 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:45.608+0000 7fb5d6ffd640 1 -- 172.21.15.102:0/1587064888 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5d806c020 con 0x7fb5d815ef70 2023-11-13T18:41:45.631 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:45.620+0000 7fb5d6ffd640 1 --2- 172.21.15.102:0/1587064888 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb5d815ef70 0x7fb5d80b18b0 secure :-1 s=READY pgs=1948 cs=0 l=1 rev1=1 crypto rx=0x7fb5c80097c0 tx=0x7fb5c801c460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=23f70801ce81bd1f server_cookie=0 in_seq=0 out_seq=0 2023-11-13T18:41:45.632 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:45.624+0000 7fb5d5ffb640 1 -- 172.21.15.102:0/1587064888 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5c80ab600 con 0x7fb5d815ef70 2023-11-13T18:41:45.636 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:45.624+0000 7fb5d5ffb640 1 -- 172.21.15.102:0/1587064888 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb5c80a7050 con 0x7fb5d815ef70 2023-11-13T18:41:45.636 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:45.624+0000 7fb5d5ffb640 1 -- 172.21.15.102:0/1587064888 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5c80ab600 con 0x7fb5d815ef70 2023-11-13T18:41:45.636 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:45.624+0000 7fb5dd70f640 1 -- 172.21.15.102:0/1587064888 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb5d815ef70 msgr2=0x7fb5d80b18b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T18:41:45.636 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:45.624+0000 7fb5dd70f640 1 --2- 172.21.15.102:0/1587064888 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb5d815ef70 0x7fb5d80b18b0 secure :-1 s=READY pgs=1948 cs=0 l=1 rev1=1 crypto rx=0x7fb5c80097c0 tx=0x7fb5c801c460 comp rx=0 tx=0).stop 2023-11-13T18:41:45.637 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:45.628+0000 7fb5dd70f640 1 -- 172.21.15.102:0/1587064888 shutdown_connections 2023-11-13T18:41:45.637 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:45.628+0000 7fb5dd70f640 1 --2- 172.21.15.102:0/1587064888 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb5d80ade00 0x7fb5d8162300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T18:41:45.638 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:45.628+0000 7fb5dd70f640 1 --2- 172.21.15.102:0/1587064888 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb5d815ef70 0x7fb5d80b18b0 unknown :-1 s=CLOSED pgs=1948 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T18:41:45.638 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:45.628+0000 7fb5dd70f640 1 -- 172.21.15.102:0/1587064888 >> 172.21.15.102:0/1587064888 conn(0x7fb5d80b05b0 msgr2=0x7fb5d80b09c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-13T18:41:45.638 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:45.628+0000 7fb5dd70f640 1 -- 172.21.15.102:0/1587064888 shutdown_connections 2023-11-13T18:41:45.639 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:45.628+0000 7fb5dd70f640 1 -- 172.21.15.102:0/1587064888 wait complete. 2023-11-13T18:41:45.644 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:45.636+0000 7fb5dd70f640 1 Processor -- start 2023-11-13T18:41:45.647 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:45.636+0000 7fb5dd70f640 1 -- start start 2023-11-13T18:41:45.649 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:45.640+0000 7fb5dd70f640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb5d806bb10 0x7fb5d80cd320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T18:41:45.650 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:45.640+0000 7fb5dd70f640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb5d80ade00 0x7fb5d80ca9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T18:41:45.651 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:45.640+0000 7fb5dd70f640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb5d8152cb0 0x7fb5d8155f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T18:41:45.651 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:45.640+0000 7fb5d6ffd640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb5d806bb10 0x7fb5d80cd320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T18:41:45.651 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:45.640+0000 7fb5d6ffd640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb5d806bb10 0x7fb5d80cd320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.102:33816/0 (socket says 172.21.15.102:33816) 2023-11-13T18:41:45.652 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:45.640+0000 7fb5d67fc640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb5d80ade00 0x7fb5d80ca9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T18:41:45.652 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:45.640+0000 7fb5d67fc640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb5d80ade00 0x7fb5d80ca9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.102:47154/0 (socket says 172.21.15.102:47154) 2023-11-13T18:41:45.655 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:45.644+0000 7fb5d77fe640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb5d8152cb0 0x7fb5d8155f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T18:41:45.656 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:45.644+0000 7fb5d77fe640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb5d8152cb0 0x7fb5d8155f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:55158/0 (socket says 172.21.15.102:55158) 2023-11-13T18:41:45.656 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:45.644+0000 7fb5d6ffd640 1 -- 172.21.15.102:0/3238474911 learned_addr learned my addr 172.21.15.102:0/3238474911 (peer_addr_for_me v2:172.21.15.102:0/0) 2023-11-13T18:41:45.656 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:45.644+0000 7fb5dd70f640 1 -- 172.21.15.102:0/3238474911 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5d80caef0 con 0x7fb5d8152cb0 2023-11-13T18:41:45.656 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:45.644+0000 7fb5dd70f640 1 -- 172.21.15.102:0/3238474911 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5d80cd9d0 con 0x7fb5d806bb10 2023-11-13T18:41:45.657 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:45.644+0000 7fb5dd70f640 1 -- 172.21.15.102:0/3238474911 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb5d80cdcb0 con 0x7fb5d80ade00 2023-11-13T18:41:45.657 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:45.644+0000 7fb5d6ffd640 1 -- 172.21.15.102:0/3238474911 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb5d80ade00 msgr2=0x7fb5d80ca9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T18:41:45.657 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:45.644+0000 7fb5d6ffd640 1 --2- 172.21.15.102:0/3238474911 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb5d80ade00 0x7fb5d80ca9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T18:41:45.657 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:45.644+0000 7fb5d6ffd640 1 -- 172.21.15.102:0/3238474911 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb5d8152cb0 msgr2=0x7fb5d8155f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T18:41:45.658 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:45.644+0000 7fb5d6ffd640 1 --2- 172.21.15.102:0/3238474911 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb5d8152cb0 0x7fb5d8155f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T18:41:45.658 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:45.644+0000 7fb5d6ffd640 1 -- 172.21.15.102:0/3238474911 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5c8009420 con 0x7fb5d806bb10 2023-11-13T18:41:45.658 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:45.644+0000 7fb5d6ffd640 1 --2- 172.21.15.102:0/3238474911 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb5d806bb10 0x7fb5d80cd320 secure :-1 s=READY pgs=912 cs=0 l=1 rev1=1 crypto rx=0x7fb5c801cd00 tx=0x7fb5c8019200 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-13T18:41:45.659 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:45.648+0000 7fb5cf7fe640 1 -- 172.21.15.102:0/3238474911 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5c80ab600 con 0x7fb5d806bb10 2023-11-13T18:41:45.659 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:45.648+0000 7fb5cf7fe640 1 -- 172.21.15.102:0/3238474911 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb5c8006e20 con 0x7fb5d806bb10 2023-11-13T18:41:45.660 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:45.648+0000 7fb5cf7fe640 1 -- 172.21.15.102:0/3238474911 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5c80b4850 con 0x7fb5d806bb10 2023-11-13T18:41:45.660 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:45.648+0000 7fb5dd70f640 1 -- 172.21.15.102:0/3238474911 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb5d80cdf90 con 0x7fb5d806bb10 2023-11-13T18:41:45.660 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:45.648+0000 7fb5dd70f640 1 -- 172.21.15.102:0/3238474911 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb5d80ce550 con 0x7fb5d806bb10 2023-11-13T18:41:45.661 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:45.652+0000 7fb5dd70f640 1 -- 172.21.15.102:0/3238474911 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb5d8068520 con 0x7fb5d806bb10 2023-11-13T18:41:45.668 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:45.660+0000 7fb5cf7fe640 1 -- 172.21.15.102:0/3238474911 <== mon.1 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fb5c80b2040 con 0x7fb5d806bb10 2023-11-13T18:41:45.674 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:45.664+0000 7fb5cf7fe640 1 --2- 172.21.15.102:0/3238474911 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7fb5c0066540 0x7fb5c0068a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T18:41:45.675 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:45.664+0000 7fb5cf7fe640 1 -- 172.21.15.102:0/3238474911 <== mon.1 v2:172.21.15.154:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fb5c811e3d0 con 0x7fb5d806bb10 2023-11-13T18:41:45.676 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:45.668+0000 7fb5cf7fe640 1 -- 172.21.15.102:0/3238474911 <== mon.1 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fb5c811e850 con 0x7fb5d806bb10 2023-11-13T18:41:45.679 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:45.668+0000 7fb5d67fc640 1 --2- 172.21.15.102:0/3238474911 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7fb5c0066540 0x7fb5c0068a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T18:41:45.684 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:45.676+0000 7fb5d67fc640 1 --2- 172.21.15.102:0/3238474911 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7fb5c0066540 0x7fb5c0068a00 secure :-1 s=READY pgs=754 cs=0 l=1 rev1=1 crypto rx=0x7fb5d80cf330 tx=0x7fb5c4009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-13T18:41:46.019 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:46.008+0000 7fb5dd70f640 1 -- 172.21.15.102:0/3238474911 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb5d806fc30 con 0x7fb5d806bb10 2023-11-13T18:41:46.021 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:46.012+0000 7fb5cf7fe640 1 -- 172.21.15.102:0/3238474911 <== mon.1 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v41) v1 ==== 74+0+13024 (secure 0 0 0) 0x7fb5c80b0090 con 0x7fb5d806bb10 2023-11-13T18:41:46.026 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T18:41:46.026 INFO:teuthology.orchestra.run.smithi102.stdout:{"epoch":41,"fsid":"97b3eb2b-7ccf-4aae-8d92-bff986c671ea","created":"2023-11-13T11:28:31.836724+0000","modified":"2023-11-13T18:41:30.362755+0000","last_up_change":"2023-11-13T11:28:44.876638+0000","last_in_change":"2023-11-13T11:28:35.312740+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-13T11:28:44.981356+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"bdefaa17-fcca-4c86-aa40-27dc33a789af","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6800","nonce":53303834},{"type":"v1","addr":"172.21.15.102:6801","nonce":53303834}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6802","nonce":53303834},{"type":"v1","addr":"172.21.15.102:6803","nonce":53303834}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6806","nonce":53303834},{"type":"v1","addr":"172.21.15.102:6807","nonce":53303834}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6804","nonce":53303834},{"type":"v1","addr":"172.21.15.102:6805","nonce":53303834}]},"public_addr":"172.21.15.102:6801/53303834","cluster_addr":"172.21.15.102:6803/53303834","heartbeat_back_addr":"172.21.15.102:6807/53303834","heartbeat_front_addr":"172.21.15.102:6805/53303834","state":["exists","up"]},{"osd":1,"uuid":"f0033196-dec9-4ae9-945e-6aeef6dbb47f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6808","nonce":1732708348},{"type":"v1","addr":"172.21.15.102:6809","nonce":1732708348}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6811","nonce":1732708348},{"type":"v1","addr":"172.21.15.102:6813","nonce":1732708348}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6818","nonce":1732708348},{"type":"v1","addr":"172.21.15.102:6820","nonce":1732708348}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6815","nonce":1732708348},{"type":"v1","addr":"172.21.15.102:6817","nonce":1732708348}]},"public_addr":"172.21.15.102:6809/1732708348","cluster_addr":"172.21.15.102:6813/1732708348","heartbeat_back_addr":"172.21.15.102:6820/1732708348","heartbeat_front_addr":"172.21.15.102:6817/1732708348","state":["exists","up"]},{"osd":2,"uuid":"496b0834-351e-4ec2-a714-86ed0c0ff4fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6810","nonce":1825475150},{"type":"v1","addr":"172.21.15.102:6812","nonce":1825475150}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6814","nonce":1825475150},{"type":"v1","addr":"172.21.15.102:6816","nonce":1825475150}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6822","nonce":1825475150},{"type":"v1","addr":"172.21.15.102:6823","nonce":1825475150}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6819","nonce":1825475150},{"type":"v1","addr":"172.21.15.102:6821","nonce":1825475150}]},"public_addr":"172.21.15.102:6812/1825475150","cluster_addr":"172.21.15.102:6816/1825475150","heartbeat_back_addr":"172.21.15.102:6823/1825475150","heartbeat_front_addr":"172.21.15.102:6821/1825475150","state":["exists","up"]},{"osd":3,"uuid":"3ba6cc41-e0a0-4273-86cb-90000c06a55a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6824","nonce":4149355528},{"type":"v1","addr":"172.21.15.102:6825","nonce":4149355528}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6826","nonce":4149355528},{"type":"v1","addr":"172.21.15.102:6827","nonce":4149355528}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6830","nonce":4149355528},{"type":"v1","addr":"172.21.15.102:6831","nonce":4149355528}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6828","nonce":4149355528},{"type":"v1","addr":"172.21.15.102:6829","nonce":4149355528}]},"public_addr":"172.21.15.102:6825/4149355528","cluster_addr":"172.21.15.102:6827/4149355528","heartbeat_back_addr":"172.21.15.102:6831/4149355528","heartbeat_front_addr":"172.21.15.102:6829/4149355528","state":["exists","up"]},{"osd":4,"uuid":"16e797d8-e6e7-4140-95c3-b85283c42a2a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6808","nonce":4028899241},{"type":"v1","addr":"172.21.15.154:6809","nonce":4028899241}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6810","nonce":4028899241},{"type":"v1","addr":"172.21.15.154:6811","nonce":4028899241}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6814","nonce":4028899241},{"type":"v1","addr":"172.21.15.154:6815","nonce":4028899241}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6812","nonce":4028899241},{"type":"v1","addr":"172.21.15.154:6813","nonce":4028899241}]},"public_addr":"172.21.15.154:6809/4028899241","cluster_addr":"172.21.15.154:6811/4028899241","heartbeat_back_addr":"172.21.15.154:6815/4028899241","heartbeat_front_addr":"172.21.15.154:6813/4028899241","state":["exists","up"]},{"osd":5,"uuid":"d6ab225c-1b55-450a-89a9-abe5c3f8d6af","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":3562396827},{"type":"v1","addr":"172.21.15.154:6801","nonce":3562396827}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":3562396827},{"type":"v1","addr":"172.21.15.154:6803","nonce":3562396827}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6806","nonce":3562396827},{"type":"v1","addr":"172.21.15.154:6807","nonce":3562396827}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6804","nonce":3562396827},{"type":"v1","addr":"172.21.15.154:6805","nonce":3562396827}]},"public_addr":"172.21.15.154:6801/3562396827","cluster_addr":"172.21.15.154:6803/3562396827","heartbeat_back_addr":"172.21.15.154:6807/3562396827","heartbeat_front_addr":"172.21.15.154:6805/3562396827","state":["exists","up"]},{"osd":6,"uuid":"96f905ac-491c-4662-8e2b-5bb8e929ab9d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6816","nonce":2933728751},{"type":"v1","addr":"172.21.15.154:6817","nonce":2933728751}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6818","nonce":2933728751},{"type":"v1","addr":"172.21.15.154:6819","nonce":2933728751}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6822","nonce":2933728751},{"type":"v1","addr":"172.21.15.154:6823","nonce":2933728751}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6820","nonce":2933728751},{"type":"v1","addr":"172.21.15.154:6821","nonce":2933728751}]},"public_addr":"172.21.15.154:6817/2933728751","cluster_addr":"172.21.15.154:6819/2933728751","heartbeat_back_addr":"172.21.15.154:6823/2933728751","heartbeat_front_addr":"172.21.15.154:6821/2933728751","state":["exists","up"]},{"osd":7,"uuid":"07012d3b-3ab4-40df-a471-93caed22e2dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6824","nonce":1753500785},{"type":"v1","addr":"172.21.15.154:6825","nonce":1753500785}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6826","nonce":1753500785},{"type":"v1","addr":"172.21.15.154:6827","nonce":1753500785}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6830","nonce":1753500785},{"type":"v1","addr":"172.21.15.154:6831","nonce":1753500785}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6828","nonce":1753500785},{"type":"v1","addr":"172.21.15.154:6829","nonce":1753500785}]},"public_addr":"172.21.15.154:6825/1753500785","cluster_addr":"172.21.15.154:6827/1753500785","heartbeat_back_addr":"172.21.15.154:6831/1753500785","heartbeat_front_addr":"172.21.15.154:6829/1753500785","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-13T11:28:40.978603+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-13T11:28:41.200985+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-13T11:28:41.222815+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-13T11:28:41.202162+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-13T11:28:40.925911+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-13T11:28:41.087725+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-13T11:28:41.072208+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-13T11:28:40.875257+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.102:6837/3869977039":"2023-11-14T18:41:25.015412+0000","172.21.15.102:6835/3869977039":"2023-11-14T18:41:25.015412+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-13T18:41:46.040 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:46.024+0000 7fb5dd70f640 1 -- 172.21.15.102:0/3238474911 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7fb5c0066540 msgr2=0x7fb5c0068a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T18:41:46.040 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:46.024+0000 7fb5dd70f640 1 --2- 172.21.15.102:0/3238474911 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7fb5c0066540 0x7fb5c0068a00 secure :-1 s=READY pgs=754 cs=0 l=1 rev1=1 crypto rx=0x7fb5d80cf330 tx=0x7fb5c4009040 comp rx=0 tx=0).stop 2023-11-13T18:41:46.040 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:46.024+0000 7fb5dd70f640 1 -- 172.21.15.102:0/3238474911 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb5d806bb10 msgr2=0x7fb5d80cd320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T18:41:46.041 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:46.024+0000 7fb5dd70f640 1 --2- 172.21.15.102:0/3238474911 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb5d806bb10 0x7fb5d80cd320 secure :-1 s=READY pgs=912 cs=0 l=1 rev1=1 crypto rx=0x7fb5c801cd00 tx=0x7fb5c8019200 comp rx=0 tx=0).stop 2023-11-13T18:41:46.041 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:46.024+0000 7fb5dd70f640 1 -- 172.21.15.102:0/3238474911 shutdown_connections 2023-11-13T18:41:46.041 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:46.024+0000 7fb5dd70f640 1 --2- 172.21.15.102:0/3238474911 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7fb5c0066540 0x7fb5c0068a00 secure :-1 s=CLOSED pgs=754 cs=0 l=1 rev1=1 crypto rx=0x7fb5d80cf330 tx=0x7fb5c4009040 comp rx=0 tx=0).stop 2023-11-13T18:41:46.041 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:46.024+0000 7fb5dd70f640 1 --2- 172.21.15.102:0/3238474911 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb5d8152cb0 0x7fb5d8155f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T18:41:46.042 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:46.024+0000 7fb5dd70f640 1 --2- 172.21.15.102:0/3238474911 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb5d80ade00 0x7fb5d80ca9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T18:41:46.042 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:46.024+0000 7fb5dd70f640 1 --2- 172.21.15.102:0/3238474911 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb5d806bb10 0x7fb5d80cd320 unknown :-1 s=CLOSED pgs=912 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T18:41:46.042 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:46.024+0000 7fb5dd70f640 1 -- 172.21.15.102:0/3238474911 >> 172.21.15.102:0/3238474911 conn(0x7fb5d80b05b0 msgr2=0x7fb5d80b2aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-13T18:41:46.042 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:46.028+0000 7fb5dd70f640 1 -- 172.21.15.102:0/3238474911 shutdown_connections 2023-11-13T18:41:46.043 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:46.028+0000 7fb5dd70f640 1 -- 172.21.15.102:0/3238474911 wait complete. 2023-11-13T18:41:47.092 INFO:tasks.ceph:Scrubbing osd.0 2023-11-13T18:41:47.093 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2023-11-13T18:41:47.358 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:47.348+0000 7fc614b7d640 1 Processor -- start 2023-11-13T18:41:47.359 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:47.348+0000 7fc614b7d640 1 -- start start 2023-11-13T18:41:47.366 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:47.356+0000 7fc614b7d640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc6100cf4e0 0x7fc61006a240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T18:41:47.366 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:47.356+0000 7fc614b7d640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fc61006a780 0x7fc6100b39f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T18:41:47.366 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:47.356+0000 7fc614b7d640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc61015b3f0 con 0x7fc6100cd410 2023-11-13T18:41:47.367 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:47.356+0000 7fc614b7d640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc61006abf0 con 0x7fc61006a780 2023-11-13T18:41:47.367 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:47.356+0000 7fc614b7d640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc61015b6d0 con 0x7fc6100cf4e0 2023-11-13T18:41:47.367 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:47.356+0000 7fc60effd640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc6100cf4e0 0x7fc61006a240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T18:41:47.367 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:47.356+0000 7fc60effd640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc6100cf4e0 0x7fc61006a240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.102:47170/0 (socket says 172.21.15.102:47170) 2023-11-13T18:41:47.368 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:47.356+0000 7fc60effd640 1 -- 172.21.15.102:0/473958016 learned_addr learned my addr 172.21.15.102:0/473958016 (peer_addr_for_me v2:172.21.15.102:0/0) 2023-11-13T18:41:47.368 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:47.356+0000 7fc60effd640 1 -- 172.21.15.102:0/473958016 >> v2:172.21.15.154:3300/0 conn(0x7fc61006a780 msgr2=0x7fc6100b39f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-13T18:41:47.369 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:47.356+0000 7fc60ffff640 1 --2- 172.21.15.102:0/473958016 >> v2:172.21.15.154:3300/0 conn(0x7fc61006a780 0x7fc6100b39f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T18:41:47.369 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:47.356+0000 7fc60effd640 1 --2- 172.21.15.102:0/473958016 >> v2:172.21.15.154:3300/0 conn(0x7fc61006a780 0x7fc6100b39f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T18:41:47.369 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:47.356+0000 7fc60effd640 1 -- 172.21.15.102:0/473958016 >> v1:172.21.15.154:6789/0 conn(0x7fc6100cd410 legacy=0x7fc6100cedd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T18:41:47.370 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:47.356+0000 7fc60e7fc640 1 -- 172.21.15.102:0/473958016 <== mon.1 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1960592839 0 0) 0x7fc61015b3f0 con 0x7fc6100cd410 2023-11-13T18:41:47.370 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:47.356+0000 7fc60effd640 1 -- 172.21.15.102:0/473958016 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc61015b9b0 con 0x7fc6100cf4e0 2023-11-13T18:41:47.370 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:47.356+0000 7fc60ffff640 1 --2- 172.21.15.102:0/473958016 >> v2:172.21.15.154:3300/0 conn(0x7fc61006a780 0x7fc6100b39f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-13T18:41:47.371 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:47.360+0000 7fc60effd640 1 --2- 172.21.15.102:0/473958016 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc6100cf4e0 0x7fc61006a240 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7fc604009870 tx=0x7fc60401c510 comp rx=0 tx=0).ready entity=mon.2 client_cookie=931ff771e2df3f69 server_cookie=0 in_seq=0 out_seq=0 2023-11-13T18:41:47.372 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:47.360+0000 7fc60e7fc640 1 -- 172.21.15.102:0/473958016 <== mon.2 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6040aa670 con 0x7fc6100cf4e0 2023-11-13T18:41:47.372 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:47.360+0000 7fc60e7fc640 1 -- 172.21.15.102:0/473958016 <== mon.2 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc6040aa7d0 con 0x7fc6100cf4e0 2023-11-13T18:41:47.372 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:47.360+0000 7fc60e7fc640 1 -- 172.21.15.102:0/473958016 <== mon.2 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6040aab60 con 0x7fc6100cf4e0 2023-11-13T18:41:47.372 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:47.360+0000 7fc614b7d640 1 -- 172.21.15.102:0/473958016 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc6100cf4e0 msgr2=0x7fc61006a240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T18:41:47.373 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:47.360+0000 7fc614b7d640 1 --2- 172.21.15.102:0/473958016 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc6100cf4e0 0x7fc61006a240 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7fc604009870 tx=0x7fc60401c510 comp rx=0 tx=0).stop 2023-11-13T18:41:47.373 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:47.360+0000 7fc614b7d640 1 -- 172.21.15.102:0/473958016 shutdown_connections 2023-11-13T18:41:47.373 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:47.360+0000 7fc614b7d640 1 --2- 172.21.15.102:0/473958016 >> v2:172.21.15.154:3300/0 conn(0x7fc61006a780 0x7fc6100b39f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T18:41:47.373 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:47.360+0000 7fc614b7d640 1 --2- 172.21.15.102:0/473958016 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc6100cf4e0 0x7fc61006a240 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T18:41:47.374 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:47.360+0000 7fc614b7d640 1 -- 172.21.15.102:0/473958016 >> 172.21.15.102:0/473958016 conn(0x7fc6100b1780 msgr2=0x7fc6100b1b90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-13T18:41:47.374 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:47.360+0000 7fc614b7d640 1 -- 172.21.15.102:0/473958016 shutdown_connections 2023-11-13T18:41:47.374 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:47.360+0000 7fc614b7d640 1 -- 172.21.15.102:0/473958016 wait complete. 2023-11-13T18:41:47.375 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:47.364+0000 7fc614b7d640 1 Processor -- start 2023-11-13T18:41:47.376 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:47.364+0000 7fc614b7d640 1 -- start start 2023-11-13T18:41:47.376 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:47.364+0000 7fc614b7d640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc61006a780 0x7fc6100aabd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T18:41:47.376 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:47.364+0000 7fc614b7d640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc6100cd410 0x7fc6100aca40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T18:41:47.376 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:47.364+0000 7fc614b7d640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc6100cf4e0 0x7fc610150210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T18:41:47.377 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:47.364+0000 7fc614b7d640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6100ab110 con 0x7fc6100cd410 2023-11-13T18:41:47.377 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:47.364+0000 7fc614b7d640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6100abbe0 con 0x7fc6100cf4e0 2023-11-13T18:41:47.377 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:47.364+0000 7fc614b7d640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc6100a85c0 con 0x7fc61006a780 2023-11-13T18:41:47.377 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:47.364+0000 7fc60ffff640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc6100cf4e0 0x7fc610150210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T18:41:47.378 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:47.368+0000 7fc60ffff640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc6100cf4e0 0x7fc610150210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.102:33820/0 (socket says 172.21.15.102:33820) 2023-11-13T18:41:47.378 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:47.368+0000 7fc60ffff640 1 -- 172.21.15.102:0/1831732214 learned_addr learned my addr 172.21.15.102:0/1831732214 (peer_addr_for_me v2:172.21.15.102:0/0) 2023-11-13T18:41:47.378 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:47.368+0000 7fc60effd640 1 --2- 172.21.15.102:0/1831732214 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc6100cd410 0x7fc6100aca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T18:41:47.379 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:47.368+0000 7fc60ffff640 1 -- 172.21.15.102:0/1831732214 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc61006a780 msgr2=0x7fc6100aabd0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-11-13T18:41:47.379 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:47.368+0000 7fc60ffff640 1 --2- 172.21.15.102:0/1831732214 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc61006a780 0x7fc6100aabd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T18:41:47.380 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:47.368+0000 7fc60ffff640 1 -- 172.21.15.102:0/1831732214 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc6100cd410 msgr2=0x7fc6100aca40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T18:41:47.380 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:47.368+0000 7fc60ffff640 1 --2- 172.21.15.102:0/1831732214 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc6100cd410 0x7fc6100aca40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T18:41:47.380 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:47.368+0000 7fc60ffff640 1 -- 172.21.15.102:0/1831732214 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6040094d0 con 0x7fc6100cf4e0 2023-11-13T18:41:47.381 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:47.368+0000 7fc60ffff640 1 --2- 172.21.15.102:0/1831732214 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc6100cf4e0 0x7fc610150210 secure :-1 s=READY pgs=914 cs=0 l=1 rev1=1 crypto rx=0x7fc60800cef0 tx=0x7fc60800a710 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-13T18:41:47.381 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:47.368+0000 7fc5f7fff640 1 -- 172.21.15.102:0/1831732214 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc60800d840 con 0x7fc6100cf4e0 2023-11-13T18:41:47.381 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:47.368+0000 7fc614b7d640 1 -- 172.21.15.102:0/1831732214 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc6100ab340 con 0x7fc6100cf4e0 2023-11-13T18:41:47.381 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:47.368+0000 7fc5f7fff640 1 -- 172.21.15.102:0/1831732214 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc60800d9c0 con 0x7fc6100cf4e0 2023-11-13T18:41:47.382 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:47.368+0000 7fc5f7fff640 1 -- 172.21.15.102:0/1831732214 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc60800dd70 con 0x7fc6100cf4e0 2023-11-13T18:41:47.382 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:47.368+0000 7fc614b7d640 1 -- 172.21.15.102:0/1831732214 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc6100ab900 con 0x7fc6100cf4e0 2023-11-13T18:41:47.382 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:47.368+0000 7fc5f7fff640 1 -- 172.21.15.102:0/1831732214 <== mon.1 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fc60801e3b0 con 0x7fc6100cf4e0 2023-11-13T18:41:47.382 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:47.372+0000 7fc614b7d640 1 -- 172.21.15.102:0/1831732214 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fc6100b4740 con 0x7fc6100cf4e0 2023-11-13T18:41:47.383 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:47.372+0000 7fc5f7fff640 1 --2- 172.21.15.102:0/1831732214 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7fc5fc0664d0 0x7fc5fc068990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T18:41:47.383 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:47.376+0000 7fc5f7fff640 1 -- 172.21.15.102:0/1831732214 <== mon.1 v2:172.21.15.154:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fc608084690 con 0x7fc6100cf4e0 2023-11-13T18:41:47.384 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:47.376+0000 7fc60f7fe640 1 --2- 172.21.15.102:0/1831732214 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7fc5fc0664d0 0x7fc5fc068990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T18:41:47.385 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:47.376+0000 7fc5f7fff640 1 --2- 172.21.15.102:0/1831732214 >> [v2:172.21.15.102:6800/53303834,v1:172.21.15.102:6801/53303834] conn(0x7fc5fc06c330 0x7fc5fc06e750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T18:41:47.385 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:47.376+0000 7fc5f7fff640 1 -- 172.21.15.102:0/1831732214 --> [v2:172.21.15.102:6800/53303834,v1:172.21.15.102:6801/53303834] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fc5fc06ee00 con 0x7fc5fc06c330 2023-11-13T18:41:47.385 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:47.376+0000 7fc5f7fff640 1 -- 172.21.15.102:0/1831732214 <== mon.1 v2:172.21.15.154:3300/0 6 ==== mon_get_version_reply(handle=1 version=41) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc60800dd70 con 0x7fc6100cf4e0 2023-11-13T18:41:47.385 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:47.376+0000 7fc60f7fe640 1 --2- 172.21.15.102:0/1831732214 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7fc5fc0664d0 0x7fc5fc068990 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 crypto rx=0x7fc600007fd0 tx=0x7fc6000078c0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-13T18:41:47.386 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:47.376+0000 7fc60effd640 1 --2- 172.21.15.102:0/1831732214 >> [v2:172.21.15.102:6800/53303834,v1:172.21.15.102:6801/53303834] conn(0x7fc5fc06c330 0x7fc5fc06e750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T18:41:47.386 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:47.376+0000 7fc60effd640 1 --2- 172.21.15.102:0/1831732214 >> [v2:172.21.15.102:6800/53303834,v1:172.21.15.102:6801/53303834] conn(0x7fc5fc06c330 0x7fc5fc06e750 crc :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-13T18:41:47.454 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:47.444+0000 7fc5f7fff640 1 -- 172.21.15.102:0/1831732214 <== osd.0 v2:172.21.15.102:6800/53303834 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26745 (crc 0 0 0) 0x7fc5fc06ee00 con 0x7fc5fc06c330 2023-11-13T18:41:47.526 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:47.516+0000 7fc614b7d640 1 -- 172.21.15.102:0/1831732214 --> [v2:172.21.15.102:6800/53303834,v1:172.21.15.102:6801/53303834] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fc6100b1510 con 0x7fc5fc06c330 2023-11-13T18:41:47.544 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:47.536+0000 7fc5f7fff640 1 -- 172.21.15.102:0/1831732214 <== osd.0 v2:172.21.15.102:6800/53303834 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7fc6100b1510 con 0x7fc5fc06c330 2023-11-13T18:41:47.546 INFO:teuthology.orchestra.run.smithi102.stdout:{ 2023-11-13T18:41:47.546 INFO:teuthology.orchestra.run.smithi102.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2023-11-13T18:41:47.547 INFO:teuthology.orchestra.run.smithi102.stdout:} 2023-11-13T18:41:47.547 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:47.536+0000 7fc614b7d640 1 -- 172.21.15.102:0/1831732214 >> [v2:172.21.15.102:6800/53303834,v1:172.21.15.102:6801/53303834] conn(0x7fc5fc06c330 msgr2=0x7fc5fc06e750 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T18:41:47.547 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:47.536+0000 7fc614b7d640 1 --2- 172.21.15.102:0/1831732214 >> [v2:172.21.15.102:6800/53303834,v1:172.21.15.102:6801/53303834] conn(0x7fc5fc06c330 0x7fc5fc06e750 crc :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T18:41:47.548 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:47.536+0000 7fc614b7d640 1 -- 172.21.15.102:0/1831732214 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7fc5fc0664d0 msgr2=0x7fc5fc068990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T18:41:47.548 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:47.536+0000 7fc614b7d640 1 --2- 172.21.15.102:0/1831732214 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7fc5fc0664d0 0x7fc5fc068990 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 crypto rx=0x7fc600007fd0 tx=0x7fc6000078c0 comp rx=0 tx=0).stop 2023-11-13T18:41:47.549 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:47.536+0000 7fc614b7d640 1 -- 172.21.15.102:0/1831732214 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc6100cf4e0 msgr2=0x7fc610150210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T18:41:47.549 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:47.536+0000 7fc614b7d640 1 --2- 172.21.15.102:0/1831732214 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc6100cf4e0 0x7fc610150210 secure :-1 s=READY pgs=914 cs=0 l=1 rev1=1 crypto rx=0x7fc60800cef0 tx=0x7fc60800a710 comp rx=0 tx=0).stop 2023-11-13T18:41:47.550 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:47.540+0000 7fc60ffff640 1 -- 172.21.15.102:0/1831732214 reap_dead start 2023-11-13T18:41:47.550 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:47.540+0000 7fc614b7d640 1 -- 172.21.15.102:0/1831732214 shutdown_connections 2023-11-13T18:41:47.550 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:47.540+0000 7fc614b7d640 1 -- 172.21.15.102:0/1831732214 >> 172.21.15.102:0/1831732214 conn(0x7fc6100b1780 msgr2=0x7fc6100b1b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-13T18:41:47.551 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:47.540+0000 7fc614b7d640 1 -- 172.21.15.102:0/1831732214 shutdown_connections 2023-11-13T18:41:47.551 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:47.540+0000 7fc614b7d640 1 -- 172.21.15.102:0/1831732214 wait complete. 2023-11-13T18:41:47.616 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2023-11-13T18:41:48.028 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:48.020+0000 7fb2d745a640 1 Processor -- start 2023-11-13T18:41:48.029 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:48.020+0000 7fb2d745a640 1 -- start start 2023-11-13T18:41:48.032 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:48.024+0000 7fb2d745a640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fb2d0140540 0x7fb2d015e3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T18:41:48.034 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:48.024+0000 7fb2d745a640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb2d015e910 con 0x7fb2d006caa0 2023-11-13T18:41:48.034 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:48.024+0000 7fb2d745a640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb2d0140920 con 0x7fb2d0071900 2023-11-13T18:41:48.035 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:48.024+0000 7fb2d745a640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb2d00ccc50 con 0x7fb2d0140540 2023-11-13T18:41:48.035 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:48.024+0000 7fb2d51f6640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fb2d0140540 0x7fb2d015e3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T18:41:48.035 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:48.024+0000 7fb2d49f5640 1 --1- >> v1:172.21.15.102:6789/0 conn(0x7fb2d006caa0 0x7fb2d00711f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.102:6789/0 says I am v1:172.21.15.102:40622/0 (socket says 172.21.15.102:40622) 2023-11-13T18:41:48.036 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:48.024+0000 7fb2d49f5640 1 -- 172.21.15.102:0/1042018638 learned_addr learned my addr 172.21.15.102:0/1042018638 (peer_addr_for_me v1:172.21.15.102:0/0) 2023-11-13T18:41:48.036 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:48.024+0000 7fb2d51f6640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fb2d0140540 0x7fb2d015e3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.102:47116/0 (socket says 172.21.15.102:47116) 2023-11-13T18:41:48.037 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:48.024+0000 7fb2d51f6640 1 -- 172.21.15.102:0/1042018638 >> v1:172.21.15.154:6789/0 conn(0x7fb2d0071900 legacy=0x7fb2d00b1c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-13T18:41:48.038 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:48.024+0000 7fb2d51f6640 1 -- 172.21.15.102:0/1042018638 >> v1:172.21.15.102:6789/0 conn(0x7fb2d006caa0 legacy=0x7fb2d00711f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T18:41:48.038 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:48.024+0000 7fb2d51f6640 1 -- 172.21.15.102:0/1042018638 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2d006cfc0 con 0x7fb2d0140540 2023-11-13T18:41:48.039 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:48.028+0000 7fb2d51f6640 1 --2- 172.21.15.102:0/1042018638 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb2d0140540 0x7fb2d015e3d0 secure :-1 s=READY pgs=916 cs=0 l=1 rev1=1 crypto rx=0x7fb2cc00bfa0 tx=0x7fb2cc01eb20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f75d7502d3e82bbd server_cookie=0 in_seq=0 out_seq=0 2023-11-13T18:41:48.039 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:48.028+0000 7fb2c7fff640 1 -- 172.21.15.102:0/1042018638 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2cc00b2d0 con 0x7fb2d0140540 2023-11-13T18:41:48.040 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:48.028+0000 7fb2c7fff640 1 -- 172.21.15.102:0/1042018638 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb2cc0a79f0 con 0x7fb2d0140540 2023-11-13T18:41:48.040 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:48.028+0000 7fb2c7fff640 1 -- 172.21.15.102:0/1042018638 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2cc0a7d80 con 0x7fb2d0140540 2023-11-13T18:41:48.041 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:48.028+0000 7fb2d745a640 1 -- 172.21.15.102:0/1042018638 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb2d0140540 msgr2=0x7fb2d015e3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T18:41:48.042 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:48.028+0000 7fb2d745a640 1 --2- 172.21.15.102:0/1042018638 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb2d0140540 0x7fb2d015e3d0 secure :-1 s=READY pgs=916 cs=0 l=1 rev1=1 crypto rx=0x7fb2cc00bfa0 tx=0x7fb2cc01eb20 comp rx=0 tx=0).stop 2023-11-13T18:41:48.042 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:48.028+0000 7fb2d745a640 1 -- 172.21.15.102:0/1042018638 shutdown_connections 2023-11-13T18:41:48.042 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:48.028+0000 7fb2d745a640 1 --2- 172.21.15.102:0/1042018638 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb2d0140540 0x7fb2d015e3d0 unknown :-1 s=CLOSED pgs=916 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T18:41:48.043 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:48.028+0000 7fb2d745a640 1 -- 172.21.15.102:0/1042018638 >> 172.21.15.102:0/1042018638 conn(0x7fb2d00b0870 msgr2=0x7fb2d00b0c80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-13T18:41:48.043 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:48.032+0000 7fb2d745a640 1 -- 172.21.15.102:0/1042018638 shutdown_connections 2023-11-13T18:41:48.044 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:48.032+0000 7fb2d745a640 1 -- 172.21.15.102:0/1042018638 wait complete. 2023-11-13T18:41:48.047 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:48.036+0000 7fb2d745a640 1 Processor -- start 2023-11-13T18:41:48.048 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:48.040+0000 7fb2d745a640 1 -- start start 2023-11-13T18:41:48.052 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:48.044+0000 7fb2d745a640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb2d006caa0 0x7fb2d013b9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T18:41:48.053 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:48.044+0000 7fb2d745a640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb2d0071900 0x7fb2d014ecc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T18:41:48.053 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:48.044+0000 7fb2d745a640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb2d0140540 0x7fb2d01549b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T18:41:48.053 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:48.044+0000 7fb2d745a640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2d014ff40 con 0x7fb2d0140540 2023-11-13T18:41:48.054 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:48.044+0000 7fb2d745a640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2d0150700 con 0x7fb2d006caa0 2023-11-13T18:41:48.054 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:48.044+0000 7fb2d745a640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb2d014f6a0 con 0x7fb2d0071900 2023-11-13T18:41:48.056 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:48.044+0000 7fb2d51f6640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb2d006caa0 0x7fb2d013b9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T18:41:48.056 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:48.044+0000 7fb2d51f6640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb2d006caa0 0x7fb2d013b9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.102:47120/0 (socket says 172.21.15.102:47120) 2023-11-13T18:41:48.056 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:48.044+0000 7fb2d51f6640 1 -- 172.21.15.102:0/2979764889 learned_addr learned my addr 172.21.15.102:0/2979764889 (peer_addr_for_me v2:172.21.15.102:0/0) 2023-11-13T18:41:48.057 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:48.044+0000 7fb2d49f5640 1 --2- 172.21.15.102:0/2979764889 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb2d0071900 0x7fb2d014ecc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T18:41:48.057 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:48.044+0000 7fb2d59f7640 1 --2- 172.21.15.102:0/2979764889 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb2d0140540 0x7fb2d01549b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T18:41:48.058 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:48.044+0000 7fb2d51f6640 1 -- 172.21.15.102:0/2979764889 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb2d0071900 msgr2=0x7fb2d014ecc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T18:41:48.058 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:48.044+0000 7fb2d51f6640 1 --2- 172.21.15.102:0/2979764889 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb2d0071900 0x7fb2d014ecc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T18:41:48.058 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:48.044+0000 7fb2d51f6640 1 -- 172.21.15.102:0/2979764889 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb2d0140540 msgr2=0x7fb2d01549b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T18:41:48.059 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:48.044+0000 7fb2d51f6640 1 --2- 172.21.15.102:0/2979764889 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb2d0140540 0x7fb2d01549b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T18:41:48.059 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:48.044+0000 7fb2d51f6640 1 -- 172.21.15.102:0/2979764889 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2cc00bc80 con 0x7fb2d006caa0 2023-11-13T18:41:48.059 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:48.044+0000 7fb2d51f6640 1 --2- 172.21.15.102:0/2979764889 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb2d006caa0 0x7fb2d013b9b0 secure :-1 s=READY pgs=917 cs=0 l=1 rev1=1 crypto rx=0x7fb2cc0b1040 tx=0x7fb2cc01b8c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-13T18:41:48.060 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:48.044+0000 7fb2c5ffb640 1 -- 172.21.15.102:0/2979764889 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2cc009950 con 0x7fb2d006caa0 2023-11-13T18:41:48.060 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:48.044+0000 7fb2c5ffb640 1 -- 172.21.15.102:0/2979764889 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb2cc009ad0 con 0x7fb2d006caa0 2023-11-13T18:41:48.060 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:48.044+0000 7fb2c5ffb640 1 -- 172.21.15.102:0/2979764889 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2cc009e80 con 0x7fb2d006caa0 2023-11-13T18:41:48.061 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:48.044+0000 7fb2d745a640 1 -- 172.21.15.102:0/2979764889 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb2d014f980 con 0x7fb2d006caa0 2023-11-13T18:41:48.062 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:48.048+0000 7fb2d745a640 1 -- 172.21.15.102:0/2979764889 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb2d013f700 con 0x7fb2d006caa0 2023-11-13T18:41:48.062 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:48.048+0000 7fb2c5ffb640 1 -- 172.21.15.102:0/2979764889 <== mon.1 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fb2cc0ba470 con 0x7fb2d006caa0 2023-11-13T18:41:48.063 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:48.048+0000 7fb2d745a640 1 -- 172.21.15.102:0/2979764889 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb2d013f890 con 0x7fb2d006caa0 2023-11-13T18:41:48.063 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:48.052+0000 7fb2c5ffb640 1 --2- 172.21.15.102:0/2979764889 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7fb2b40664c0 0x7fb2b4068980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T18:41:48.063 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:48.052+0000 7fb2c5ffb640 1 -- 172.21.15.102:0/2979764889 <== mon.1 v2:172.21.15.154:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fb2cc121540 con 0x7fb2d006caa0 2023-11-13T18:41:48.064 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:48.052+0000 7fb2d49f5640 1 --2- 172.21.15.102:0/2979764889 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7fb2b40664c0 0x7fb2b4068980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T18:41:48.065 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:48.052+0000 7fb2d49f5640 1 --2- 172.21.15.102:0/2979764889 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7fb2b40664c0 0x7fb2b4068980 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 crypto rx=0x7fb2d0150560 tx=0x7fb2c0009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-13T18:41:48.065 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:48.056+0000 7fb2c5ffb640 1 -- 172.21.15.102:0/2979764889 <== mon.1 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fb2cc0eed30 con 0x7fb2d006caa0 2023-11-13T18:41:48.495 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:48.484+0000 7fb2d745a640 1 -- 172.21.15.102:0/2979764889 --> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "0", "target": ["mon-mgr", ""]}) v1 -- 0x7fb2d006db40 con 0x7fb2b40664c0 2023-11-13T18:41:48.517 INFO:teuthology.orchestra.run.smithi102.stderr:instructed osd(s) 0 to deep-scrub 2023-11-13T18:41:48.519 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:48.508+0000 7fb2c5ffb640 1 -- 172.21.15.102:0/2979764889 <== mgr.4103 v2:172.21.15.102:6832/1009482693 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 0 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fb2c0001510 con 0x7fb2b40664c0 2023-11-13T18:41:48.521 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:48.512+0000 7fb2d745a640 1 -- 172.21.15.102:0/2979764889 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7fb2b40664c0 msgr2=0x7fb2b4068980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T18:41:48.521 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:48.512+0000 7fb2d745a640 1 --2- 172.21.15.102:0/2979764889 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7fb2b40664c0 0x7fb2b4068980 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 crypto rx=0x7fb2d0150560 tx=0x7fb2c0009040 comp rx=0 tx=0).stop 2023-11-13T18:41:48.521 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:48.512+0000 7fb2d745a640 1 -- 172.21.15.102:0/2979764889 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb2d006caa0 msgr2=0x7fb2d013b9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T18:41:48.522 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:48.512+0000 7fb2d745a640 1 --2- 172.21.15.102:0/2979764889 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb2d006caa0 0x7fb2d013b9b0 secure :-1 s=READY pgs=917 cs=0 l=1 rev1=1 crypto rx=0x7fb2cc0b1040 tx=0x7fb2cc01b8c0 comp rx=0 tx=0).stop 2023-11-13T18:41:48.524 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:48.516+0000 7fb2d745a640 1 -- 172.21.15.102:0/2979764889 shutdown_connections 2023-11-13T18:41:48.525 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:48.516+0000 7fb2d745a640 1 --2- 172.21.15.102:0/2979764889 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7fb2b40664c0 0x7fb2b4068980 unknown :-1 s=CLOSED pgs=756 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T18:41:48.525 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:48.516+0000 7fb2d745a640 1 --2- 172.21.15.102:0/2979764889 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb2d0140540 0x7fb2d01549b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T18:41:48.526 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:48.516+0000 7fb2d745a640 1 --2- 172.21.15.102:0/2979764889 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb2d0071900 0x7fb2d014ecc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T18:41:48.526 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:48.516+0000 7fb2d745a640 1 --2- 172.21.15.102:0/2979764889 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb2d006caa0 0x7fb2d013b9b0 unknown :-1 s=CLOSED pgs=917 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T18:41:48.527 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:48.516+0000 7fb2d745a640 1 -- 172.21.15.102:0/2979764889 >> 172.21.15.102:0/2979764889 conn(0x7fb2d00b0870 msgr2=0x7fb2d015f280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-13T18:41:48.527 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:48.516+0000 7fb2d745a640 1 -- 172.21.15.102:0/2979764889 shutdown_connections 2023-11-13T18:41:48.527 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:48.516+0000 7fb2d745a640 1 -- 172.21.15.102:0/2979764889 wait complete. 2023-11-13T18:41:48.558 INFO:tasks.ceph:Scrubbing osd.1 2023-11-13T18:41:48.559 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2023-11-13T18:41:49.044 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:49.032+0000 7f068759e640 1 Processor -- start 2023-11-13T18:41:49.045 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:49.036+0000 7f068759e640 1 -- start start 2023-11-13T18:41:49.046 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:49.036+0000 7f068759e640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f06880b36b0 0x7f068815d2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T18:41:49.047 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:49.036+0000 7f068759e640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f06880ce540 0x7f06880ce9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T18:41:49.047 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:49.036+0000 7f068759e640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f06880ad850 con 0x7f0688070590 2023-11-13T18:41:49.048 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:49.036+0000 7f068759e640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f06880cef00 con 0x7f06880b36b0 2023-11-13T18:41:49.048 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:49.036+0000 7f068759e640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f068815dc10 con 0x7f06880ce540 2023-11-13T18:41:49.048 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:49.036+0000 7f0685d9b640 1 --1- >> v1:172.21.15.102:6789/0 conn(0x7f0688070590 0x7f06880ad140 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.102:6789/0 says I am v1:172.21.15.102:40636/0 (socket says 172.21.15.102:40636) 2023-11-13T18:41:49.049 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:49.036+0000 7f0685d9b640 1 -- 172.21.15.102:0/686923344 learned_addr learned my addr 172.21.15.102:0/686923344 (peer_addr_for_me v1:172.21.15.102:0/0) 2023-11-13T18:41:49.049 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:49.036+0000 7f068659c640 1 --2- 172.21.15.102:0/686923344 >> v2:172.21.15.102:3300/0 conn(0x7f06880b36b0 0x7f068815d2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T18:41:49.050 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:49.036+0000 7f0686d9d640 1 --2- 172.21.15.102:0/686923344 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f06880ce540 0x7f06880ce9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T18:41:49.050 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:49.036+0000 7f068559a640 1 -- 172.21.15.102:0/686923344 <== mon.0 v1:172.21.15.102:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1965788462 0 0) 0x7f06880ad850 con 0x7f0688070590 2023-11-13T18:41:49.051 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:49.036+0000 7f068559a640 1 -- 172.21.15.102:0/686923344 --> v1:172.21.15.102:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0674003530 con 0x7f0688070590 2023-11-13T18:41:49.052 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:49.036+0000 7f068659c640 1 -- 172.21.15.102:0/686923344 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f06880ce540 msgr2=0x7f06880ce9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-13T18:41:49.052 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:49.036+0000 7f068559a640 1 -- 172.21.15.102:0/686923344 <== mon.0 v1:172.21.15.102:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3589585789 0 0) 0x7f0674003530 con 0x7f0688070590 2023-11-13T18:41:49.052 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:49.036+0000 7f068659c640 1 --2- 172.21.15.102:0/686923344 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f06880ce540 0x7f06880ce9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T18:41:49.053 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:49.040+0000 7f068659c640 1 -- 172.21.15.102:0/686923344 >> v1:172.21.15.102:6789/0 conn(0x7f0688070590 legacy=0x7f06880ad140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T18:41:49.053 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:49.040+0000 7f068659c640 1 -- 172.21.15.102:0/686923344 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f068815def0 con 0x7f06880b36b0 2023-11-13T18:41:49.062 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:49.052+0000 7f068659c640 1 --2- 172.21.15.102:0/686923344 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f06880b36b0 0x7f068815d2c0 secure :-1 s=READY pgs=1951 cs=0 l=1 rev1=1 crypto rx=0x7f06880cf040 tx=0x7f067801c370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=722e280ea011ac server_cookie=0 in_seq=0 out_seq=0 2023-11-13T18:41:49.063 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:49.052+0000 7f068559a640 1 -- 172.21.15.102:0/686923344 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0670001680 con 0x7f06880b36b0 2023-11-13T18:41:49.064 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:49.052+0000 7f068559a640 1 -- 172.21.15.102:0/686923344 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f06780a7050 con 0x7f06880b36b0 2023-11-13T18:41:49.064 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:49.052+0000 7f068559a640 1 -- 172.21.15.102:0/686923344 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06780ab620 con 0x7f06880b36b0 2023-11-13T18:41:49.065 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:49.056+0000 7f068759e640 1 -- 172.21.15.102:0/686923344 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f06880b36b0 msgr2=0x7f068815d2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T18:41:49.065 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:49.056+0000 7f068759e640 1 --2- 172.21.15.102:0/686923344 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f06880b36b0 0x7f068815d2c0 secure :-1 s=READY pgs=1951 cs=0 l=1 rev1=1 crypto rx=0x7f06880cf040 tx=0x7f067801c370 comp rx=0 tx=0).stop 2023-11-13T18:41:49.066 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:49.056+0000 7f068759e640 1 -- 172.21.15.102:0/686923344 shutdown_connections 2023-11-13T18:41:49.066 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:49.056+0000 7f068759e640 1 --2- 172.21.15.102:0/686923344 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f06880ce540 0x7f06880ce9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T18:41:49.067 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:49.056+0000 7f068759e640 1 --2- 172.21.15.102:0/686923344 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f06880b36b0 0x7f068815d2c0 unknown :-1 s=CLOSED pgs=1951 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T18:41:49.067 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:49.056+0000 7f068759e640 1 -- 172.21.15.102:0/686923344 >> 172.21.15.102:0/686923344 conn(0x7f068806a240 msgr2=0x7f068806a650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-13T18:41:49.068 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:49.056+0000 7f068759e640 1 -- 172.21.15.102:0/686923344 shutdown_connections 2023-11-13T18:41:49.068 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:49.056+0000 7f068759e640 1 -- 172.21.15.102:0/686923344 wait complete. 2023-11-13T18:41:49.071 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:49.056+0000 7f068759e640 1 Processor -- start 2023-11-13T18:41:49.072 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:49.056+0000 7f068759e640 1 -- start start 2023-11-13T18:41:49.072 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:49.060+0000 7f068759e640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0688070590 0x7f06881f8c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T18:41:49.072 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:49.060+0000 7f068759e640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f06880b36b0 0x7f06880cdb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T18:41:49.073 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:49.060+0000 7f068759e640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f06880ce540 0x7f06880abab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T18:41:49.073 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:49.060+0000 7f068759e640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06880a8490 con 0x7f0688070590 2023-11-13T18:41:49.073 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:49.060+0000 7f068759e640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06880a9d40 con 0x7f06880ce540 2023-11-13T18:41:49.074 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:49.060+0000 7f068759e640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f06880a86e0 con 0x7f06880b36b0 2023-11-13T18:41:49.074 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:49.060+0000 7f068659c640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0688070590 0x7f06881f8c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T18:41:49.075 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:49.060+0000 7f0685d9b640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f06880b36b0 0x7f06880cdb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T18:41:49.075 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:49.060+0000 7f0685d9b640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f06880b36b0 0x7f06880cdb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.102:54844/0 (socket says 172.21.15.102:54844) 2023-11-13T18:41:49.075 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:49.060+0000 7f0685d9b640 1 -- 172.21.15.102:0/2957455201 learned_addr learned my addr 172.21.15.102:0/2957455201 (peer_addr_for_me v2:172.21.15.102:0/0) 2023-11-13T18:41:49.076 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:49.060+0000 7f068659c640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0688070590 0x7f06881f8c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:50734/0 (socket says 172.21.15.102:50734) 2023-11-13T18:41:49.076 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:49.060+0000 7f0686d9d640 1 --2- 172.21.15.102:0/2957455201 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f06880ce540 0x7f06880abab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T18:41:49.077 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:49.060+0000 7f0685d9b640 1 -- 172.21.15.102:0/2957455201 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f06880ce540 msgr2=0x7f06880abab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T18:41:49.077 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:49.060+0000 7f0685d9b640 1 --2- 172.21.15.102:0/2957455201 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f06880ce540 0x7f06880abab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T18:41:49.077 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:49.060+0000 7f0685d9b640 1 -- 172.21.15.102:0/2957455201 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0688070590 msgr2=0x7f06881f8c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T18:41:49.078 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:49.060+0000 7f0685d9b640 1 --2- 172.21.15.102:0/2957455201 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0688070590 0x7f06881f8c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T18:41:49.078 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:49.060+0000 7f0685d9b640 1 -- 172.21.15.102:0/2957455201 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0678009420 con 0x7f06880b36b0 2023-11-13T18:41:49.078 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:49.060+0000 7f0685d9b640 1 --2- 172.21.15.102:0/2957455201 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f06880b36b0 0x7f06880cdb30 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f067000c750 tx=0x7f067000cc10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-13T18:41:49.079 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:49.060+0000 7f067effd640 1 -- 172.21.15.102:0/2957455201 <== mon.2 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0670005ae0 con 0x7f06880b36b0 2023-11-13T18:41:49.079 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:49.060+0000 7f067effd640 1 -- 172.21.15.102:0/2957455201 <== mon.2 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0670005c40 con 0x7f06880b36b0 2023-11-13T18:41:49.080 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:49.060+0000 7f068759e640 1 -- 172.21.15.102:0/2957455201 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f06880a89c0 con 0x7f06880b36b0 2023-11-13T18:41:49.080 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:49.060+0000 7f067effd640 1 -- 172.21.15.102:0/2957455201 <== mon.2 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0670007070 con 0x7f06880b36b0 2023-11-13T18:41:49.080 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:49.060+0000 7f068759e640 1 -- 172.21.15.102:0/2957455201 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f06880a8f80 con 0x7f06880b36b0 2023-11-13T18:41:49.082 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:49.064+0000 7f067effd640 1 -- 172.21.15.102:0/2957455201 <== mon.2 v2:172.21.15.154:3301/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f06700071d0 con 0x7f06880b36b0 2023-11-13T18:41:49.082 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:49.064+0000 7f068759e640 1 -- 172.21.15.102:0/2957455201 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f068815d800 con 0x7f06880b36b0 2023-11-13T18:41:49.083 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:49.064+0000 7f067effd640 1 --2- 172.21.15.102:0/2957455201 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f0668066470 0x7f0668068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T18:41:49.083 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:49.064+0000 7f067effd640 1 -- 172.21.15.102:0/2957455201 <== mon.2 v2:172.21.15.154:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f0670083360 con 0x7f06880b36b0 2023-11-13T18:41:49.083 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:49.064+0000 7f067effd640 1 --2- 172.21.15.102:0/2957455201 >> [v2:172.21.15.102:6808/1732708348,v1:172.21.15.102:6809/1732708348] conn(0x7f066806c2d0 0x7f066806e6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T18:41:49.084 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:49.064+0000 7f067effd640 1 -- 172.21.15.102:0/2957455201 --> [v2:172.21.15.102:6808/1732708348,v1:172.21.15.102:6809/1732708348] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f066806eda0 con 0x7f066806c2d0 2023-11-13T18:41:49.084 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:49.064+0000 7f067effd640 1 -- 172.21.15.102:0/2957455201 <== mon.2 v2:172.21.15.154:3301/0 6 ==== mon_get_version_reply(handle=1 version=41) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0670085940 con 0x7f06880b36b0 2023-11-13T18:41:49.084 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:49.064+0000 7f068659c640 1 --2- 172.21.15.102:0/2957455201 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f0668066470 0x7f0668068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T18:41:49.085 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:49.064+0000 7f0686d9d640 1 --2- 172.21.15.102:0/2957455201 >> [v2:172.21.15.102:6808/1732708348,v1:172.21.15.102:6809/1732708348] conn(0x7f066806c2d0 0x7f066806e6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T18:41:49.085 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:49.068+0000 7f0686d9d640 1 --2- 172.21.15.102:0/2957455201 >> [v2:172.21.15.102:6808/1732708348,v1:172.21.15.102:6809/1732708348] conn(0x7f066806c2d0 0x7f066806e6f0 crc :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-13T18:41:49.086 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:49.068+0000 7f068659c640 1 --2- 172.21.15.102:0/2957455201 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f0668066470 0x7f0668068930 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 crypto rx=0x7f06780ad000 tx=0x7f0678008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-13T18:41:49.128 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:49.120+0000 7f067effd640 1 -- 172.21.15.102:0/2957455201 <== osd.1 v2:172.21.15.102:6808/1732708348 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26745 (crc 0 0 0) 0x7f066806eda0 con 0x7f066806c2d0 2023-11-13T18:41:49.199 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:49.188+0000 7f068759e640 1 -- 172.21.15.102:0/2957455201 --> [v2:172.21.15.102:6808/1732708348,v1:172.21.15.102:6809/1732708348] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f0688068520 con 0x7f066806c2d0 2023-11-13T18:41:49.216 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:49.208+0000 7f067effd640 1 -- 172.21.15.102:0/2957455201 <== osd.1 v2:172.21.15.102:6808/1732708348 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f0688068520 con 0x7f066806c2d0 2023-11-13T18:41:49.216 INFO:teuthology.orchestra.run.smithi102.stdout:{ 2023-11-13T18:41:49.217 INFO:teuthology.orchestra.run.smithi102.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2023-11-13T18:41:49.217 INFO:teuthology.orchestra.run.smithi102.stdout:} 2023-11-13T18:41:49.218 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:49.208+0000 7f068759e640 1 -- 172.21.15.102:0/2957455201 >> [v2:172.21.15.102:6808/1732708348,v1:172.21.15.102:6809/1732708348] conn(0x7f066806c2d0 msgr2=0x7f066806e6f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T18:41:49.219 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:49.208+0000 7f068759e640 1 --2- 172.21.15.102:0/2957455201 >> [v2:172.21.15.102:6808/1732708348,v1:172.21.15.102:6809/1732708348] conn(0x7f066806c2d0 0x7f066806e6f0 crc :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T18:41:49.219 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:49.208+0000 7f068759e640 1 -- 172.21.15.102:0/2957455201 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f0668066470 msgr2=0x7f0668068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T18:41:49.219 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:49.208+0000 7f068759e640 1 --2- 172.21.15.102:0/2957455201 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f0668066470 0x7f0668068930 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 crypto rx=0x7f06780ad000 tx=0x7f0678008040 comp rx=0 tx=0).stop 2023-11-13T18:41:49.220 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:49.208+0000 7f068759e640 1 -- 172.21.15.102:0/2957455201 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f06880b36b0 msgr2=0x7f06880cdb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T18:41:49.220 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:49.208+0000 7f068759e640 1 --2- 172.21.15.102:0/2957455201 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f06880b36b0 0x7f06880cdb30 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f067000c750 tx=0x7f067000cc10 comp rx=0 tx=0).stop 2023-11-13T18:41:49.221 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:49.208+0000 7f0686d9d640 1 -- 172.21.15.102:0/2957455201 reap_dead start 2023-11-13T18:41:49.221 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:49.208+0000 7f068759e640 1 -- 172.21.15.102:0/2957455201 shutdown_connections 2023-11-13T18:41:49.221 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:49.208+0000 7f068759e640 1 -- 172.21.15.102:0/2957455201 >> 172.21.15.102:0/2957455201 conn(0x7f068806a240 msgr2=0x7f06880ae420 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-13T18:41:49.222 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:49.208+0000 7f068759e640 1 -- 172.21.15.102:0/2957455201 shutdown_connections 2023-11-13T18:41:49.222 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:49.208+0000 7f068759e640 1 -- 172.21.15.102:0/2957455201 wait complete. 2023-11-13T18:41:49.285 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2023-11-13T18:41:49.443 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:49.432+0000 7f806dc9c640 1 Processor -- start 2023-11-13T18:41:49.443 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:49.432+0000 7f806dc9c640 1 -- start start 2023-11-13T18:41:49.444 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:49.436+0000 7f806dc9c640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f80680d0c40 0x7f80680c69b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T18:41:49.445 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:49.436+0000 7f806dc9c640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f80680cf490 0x7f80680cf920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T18:41:49.445 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:49.436+0000 7f806dc9c640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f80680d1440 con 0x7f80681606e0 2023-11-13T18:41:49.445 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:49.436+0000 7f806dc9c640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f80680cfe60 con 0x7f80680d0c40 2023-11-13T18:41:49.446 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:49.436+0000 7f806dc9c640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f80680cdb10 con 0x7f80680cf490 2023-11-13T18:41:49.446 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:49.436+0000 7f8066ffd640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f80680d0c40 0x7f80680c69b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T18:41:49.447 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:49.436+0000 7f8066ffd640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f80680d0c40 0x7f80680c69b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:50744/0 (socket says 172.21.15.102:50744) 2023-11-13T18:41:49.447 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:49.436+0000 7f8066ffd640 1 -- 172.21.15.102:0/2339859696 learned_addr learned my addr 172.21.15.102:0/2339859696 (peer_addr_for_me v2:172.21.15.102:0/0) 2023-11-13T18:41:49.448 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:49.436+0000 7f8067fff640 1 --2- 172.21.15.102:0/2339859696 >> v2:172.21.15.154:3300/0 conn(0x7f80680cf490 0x7f80680cf920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T18:41:49.448 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:49.436+0000 7f8066ffd640 1 -- 172.21.15.102:0/2339859696 >> v2:172.21.15.154:3300/0 conn(0x7f80680cf490 msgr2=0x7f80680cf920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-13T18:41:49.448 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:49.436+0000 7f8066ffd640 1 --2- 172.21.15.102:0/2339859696 >> v2:172.21.15.154:3300/0 conn(0x7f80680cf490 0x7f80680cf920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T18:41:49.449 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:49.436+0000 7f8066ffd640 1 -- 172.21.15.102:0/2339859696 >> v1:172.21.15.102:6789/0 conn(0x7f80681606e0 legacy=0x7f80680b3e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-13T18:41:49.449 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:49.436+0000 7f8066ffd640 1 -- 172.21.15.102:0/2339859696 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80680d1690 con 0x7f80680d0c40 2023-11-13T18:41:49.451 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:49.440+0000 7f8066ffd640 1 --2- 172.21.15.102:0/2339859696 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f80680d0c40 0x7f80680c69b0 secure :-1 s=READY pgs=1953 cs=0 l=1 rev1=1 crypto rx=0x7f806808b230 tx=0x7f805001c400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6df40786a865b968 server_cookie=0 in_seq=0 out_seq=0 2023-11-13T18:41:49.451 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:49.440+0000 7f80667fc640 1 -- 172.21.15.102:0/2339859696 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80500ab620 con 0x7f80680d0c40 2023-11-13T18:41:49.452 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:49.440+0000 7f80667fc640 1 -- 172.21.15.102:0/2339859696 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f80500ab780 con 0x7f80680d0c40 2023-11-13T18:41:49.452 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:49.440+0000 7f80667fc640 1 -- 172.21.15.102:0/2339859696 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80500abb10 con 0x7f80680d0c40 2023-11-13T18:41:49.452 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:49.440+0000 7f806dc9c640 1 -- 172.21.15.102:0/2339859696 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f80680d0c40 msgr2=0x7f80680c69b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T18:41:49.453 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:49.440+0000 7f806dc9c640 1 --2- 172.21.15.102:0/2339859696 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f80680d0c40 0x7f80680c69b0 secure :-1 s=READY pgs=1953 cs=0 l=1 rev1=1 crypto rx=0x7f806808b230 tx=0x7f805001c400 comp rx=0 tx=0).stop 2023-11-13T18:41:49.453 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:49.440+0000 7f806dc9c640 1 -- 172.21.15.102:0/2339859696 shutdown_connections 2023-11-13T18:41:49.453 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:49.440+0000 7f806dc9c640 1 --2- 172.21.15.102:0/2339859696 >> v2:172.21.15.154:3300/0 conn(0x7f80680cf490 0x7f80680cf920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T18:41:49.454 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:49.440+0000 7f806dc9c640 1 --2- 172.21.15.102:0/2339859696 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f80680d0c40 0x7f80680c69b0 unknown :-1 s=CLOSED pgs=1953 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T18:41:49.454 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:49.440+0000 7f806dc9c640 1 -- 172.21.15.102:0/2339859696 >> 172.21.15.102:0/2339859696 conn(0x7f806809c130 msgr2=0x7f80680d2e60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-13T18:41:49.455 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:49.440+0000 7f806dc9c640 1 -- 172.21.15.102:0/2339859696 shutdown_connections 2023-11-13T18:41:49.455 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:49.440+0000 7f806dc9c640 1 -- 172.21.15.102:0/2339859696 wait complete. 2023-11-13T18:41:49.456 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:49.448+0000 7f806dc9c640 1 Processor -- start 2023-11-13T18:41:49.457 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:49.448+0000 7f806dc9c640 1 -- start start 2023-11-13T18:41:49.463 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:49.452+0000 7f806dc9c640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f80680cf490 0x7f80680cc070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T18:41:49.463 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:49.452+0000 7f806dc9c640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f80681606e0 0x7f806806c030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T18:41:49.464 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:49.452+0000 7f806dc9c640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f806806c570 0x7f80680b7cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T18:41:49.464 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:49.452+0000 7f80677fe640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f80680cf490 0x7f80680cc070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T18:41:49.464 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:49.452+0000 7f80677fe640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f80680cf490 0x7f80680cc070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.102:47142/0 (socket says 172.21.15.102:47142) 2023-11-13T18:41:49.465 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:49.452+0000 7f80677fe640 1 -- 172.21.15.102:0/3093723866 learned_addr learned my addr 172.21.15.102:0/3093723866 (peer_addr_for_me v2:172.21.15.102:0/0) 2023-11-13T18:41:49.465 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:49.452+0000 7f8066ffd640 1 --2- 172.21.15.102:0/3093723866 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f80681606e0 0x7f806806c030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T18:41:49.465 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:49.452+0000 7f806dc9c640 1 -- 172.21.15.102:0/3093723866 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80680b8920 con 0x7f806806c570 2023-11-13T18:41:49.466 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:49.452+0000 7f806dc9c640 1 -- 172.21.15.102:0/3093723866 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f806806ca20 con 0x7f80680cf490 2023-11-13T18:41:49.466 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:49.452+0000 7f806dc9c640 1 -- 172.21.15.102:0/3093723866 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f80680b7a30 con 0x7f80681606e0 2023-11-13T18:41:49.467 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:49.452+0000 7f8067fff640 1 --2- 172.21.15.102:0/3093723866 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f806806c570 0x7f80680b7cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T18:41:49.468 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:49.452+0000 7f8066ffd640 1 -- 172.21.15.102:0/3093723866 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f80680cf490 msgr2=0x7f80680cc070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T18:41:49.468 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:49.452+0000 7f8066ffd640 1 --2- 172.21.15.102:0/3093723866 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f80680cf490 0x7f80680cc070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T18:41:49.469 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:49.452+0000 7f8066ffd640 1 -- 172.21.15.102:0/3093723866 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f806806c570 msgr2=0x7f80680b7cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T18:41:49.469 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:49.452+0000 7f8066ffd640 1 --2- 172.21.15.102:0/3093723866 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f806806c570 0x7f80680b7cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T18:41:49.469 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:49.452+0000 7f8066ffd640 1 -- 172.21.15.102:0/3093723866 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80500094d0 con 0x7f80681606e0 2023-11-13T18:41:49.470 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:49.452+0000 7f8067fff640 1 --2- 172.21.15.102:0/3093723866 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f806806c570 0x7f80680b7cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-13T18:41:49.470 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:49.456+0000 7f8066ffd640 1 --2- 172.21.15.102:0/3093723866 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f80681606e0 0x7f806806c030 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f80500ac000 tx=0x7f805001ac40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-13T18:41:49.471 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:49.456+0000 7f805ffff640 1 -- 172.21.15.102:0/3093723866 <== mon.2 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80500abe00 con 0x7f80681606e0 2023-11-13T18:41:49.471 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:49.456+0000 7f805ffff640 1 -- 172.21.15.102:0/3093723866 <== mon.2 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8050004020 con 0x7f80681606e0 2023-11-13T18:41:49.471 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:49.456+0000 7f805ffff640 1 -- 172.21.15.102:0/3093723866 <== mon.2 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80500043b0 con 0x7f80681606e0 2023-11-13T18:41:49.472 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:49.456+0000 7f806dc9c640 1 -- 172.21.15.102:0/3093723866 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f80680b6c70 con 0x7f80681606e0 2023-11-13T18:41:49.472 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:49.456+0000 7f806dc9c640 1 -- 172.21.15.102:0/3093723866 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f80680b7230 con 0x7f80681606e0 2023-11-13T18:41:49.472 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:49.460+0000 7f806dc9c640 1 -- 172.21.15.102:0/3093723866 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8068068520 con 0x7f80681606e0 2023-11-13T18:41:49.474 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:49.460+0000 7f805ffff640 1 -- 172.21.15.102:0/3093723866 <== mon.2 v2:172.21.15.154:3301/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f8050003620 con 0x7f80681606e0 2023-11-13T18:41:49.474 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:49.464+0000 7f805ffff640 1 --2- 172.21.15.102:0/3093723866 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f8048066470 0x7f8048068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T18:41:49.474 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:49.464+0000 7f805ffff640 1 -- 172.21.15.102:0/3093723866 <== mon.2 v2:172.21.15.154:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f805011dea0 con 0x7f80681606e0 2023-11-13T18:41:49.475 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:49.464+0000 7f80677fe640 1 --2- 172.21.15.102:0/3093723866 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f8048066470 0x7f8048068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T18:41:49.475 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:49.464+0000 7f80677fe640 1 --2- 172.21.15.102:0/3093723866 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f8048066470 0x7f8048068930 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 crypto rx=0x7f80580099b0 tx=0x7f8058009110 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-13T18:41:49.479 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:49.468+0000 7f805ffff640 1 -- 172.21.15.102:0/3093723866 <== mon.2 v2:172.21.15.154:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f80500eb7a0 con 0x7f80681606e0 2023-11-13T18:41:49.726 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:49.716+0000 7f806dc9c640 1 -- 172.21.15.102:0/3093723866 --> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "1", "target": ["mon-mgr", ""]}) v1 -- 0x7f8068160cd0 con 0x7f8048066470 2023-11-13T18:41:49.727 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:49.716+0000 7f805ffff640 1 -- 172.21.15.102:0/3093723866 <== mgr.4103 v2:172.21.15.102:6832/1009482693 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 1 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f8058004020 con 0x7f8048066470 2023-11-13T18:41:49.727 INFO:teuthology.orchestra.run.smithi102.stderr:instructed osd(s) 1 to deep-scrub 2023-11-13T18:41:49.729 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:49.720+0000 7f806dc9c640 1 -- 172.21.15.102:0/3093723866 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f8048066470 msgr2=0x7f8048068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T18:41:49.730 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:49.720+0000 7f806dc9c640 1 --2- 172.21.15.102:0/3093723866 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f8048066470 0x7f8048068930 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 crypto rx=0x7f80580099b0 tx=0x7f8058009110 comp rx=0 tx=0).stop 2023-11-13T18:41:49.730 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:49.720+0000 7f806dc9c640 1 -- 172.21.15.102:0/3093723866 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f80681606e0 msgr2=0x7f806806c030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T18:41:49.731 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:49.720+0000 7f806dc9c640 1 --2- 172.21.15.102:0/3093723866 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f80681606e0 0x7f806806c030 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f80500ac000 tx=0x7f805001ac40 comp rx=0 tx=0).stop 2023-11-13T18:41:49.731 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:49.720+0000 7f806dc9c640 1 -- 172.21.15.102:0/3093723866 shutdown_connections 2023-11-13T18:41:49.731 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:49.720+0000 7f806dc9c640 1 --2- 172.21.15.102:0/3093723866 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f8048066470 0x7f8048068930 unknown :-1 s=CLOSED pgs=758 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T18:41:49.732 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:49.720+0000 7f806dc9c640 1 --2- 172.21.15.102:0/3093723866 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f806806c570 0x7f80680b7cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T18:41:49.732 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:49.720+0000 7f806dc9c640 1 --2- 172.21.15.102:0/3093723866 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f80681606e0 0x7f806806c030 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T18:41:49.733 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:49.720+0000 7f806dc9c640 1 --2- 172.21.15.102:0/3093723866 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f80680cf490 0x7f80680cc070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T18:41:49.733 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:49.720+0000 7f806dc9c640 1 -- 172.21.15.102:0/3093723866 >> 172.21.15.102:0/3093723866 conn(0x7f806809c130 msgr2=0x7f806815dce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-13T18:41:49.733 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:49.720+0000 7f806dc9c640 1 -- 172.21.15.102:0/3093723866 shutdown_connections 2023-11-13T18:41:49.734 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:49.720+0000 7f806dc9c640 1 -- 172.21.15.102:0/3093723866 wait complete. 2023-11-13T18:41:49.749 INFO:tasks.ceph:Scrubbing osd.2 2023-11-13T18:41:49.750 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2023-11-13T18:41:49.929 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:49.920+0000 7f976edb5640 1 Processor -- start 2023-11-13T18:41:49.930 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:49.920+0000 7f976edb5640 1 -- start start 2023-11-13T18:41:49.933 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:49.924+0000 7f976edb5640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f976815b290 0x7f97680cec80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T18:41:49.935 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:49.924+0000 7f976edb5640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f97680ce2b0 con 0x7f976815aeb0 2023-11-13T18:41:49.935 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:49.924+0000 7f976edb5640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f97680b33c0 con 0x7f97680cdaa0 2023-11-13T18:41:49.936 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:49.924+0000 7f976edb5640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f97680b30e0 con 0x7f976815b290 2023-11-13T18:41:49.936 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:49.924+0000 7f976ddb3640 1 --1- >> v1:172.21.15.102:6789/0 conn(0x7f976815aeb0 0x7f97680cd390 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.102:6789/0 says I am v1:172.21.15.102:40654/0 (socket says 172.21.15.102:40654) 2023-11-13T18:41:49.936 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:49.924+0000 7f976ddb3640 1 -- 172.21.15.102:0/1225331554 learned_addr learned my addr 172.21.15.102:0/1225331554 (peer_addr_for_me v1:172.21.15.102:0/0) 2023-11-13T18:41:49.937 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:49.924+0000 7f976e5b4640 1 --2- 172.21.15.102:0/1225331554 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f976815b290 0x7f97680cec80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T18:41:49.937 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:49.924+0000 7f976cdb1640 1 -- 172.21.15.102:0/1225331554 <== mon.1 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2596459845 0 0) 0x7f97680b33c0 con 0x7f97680cdaa0 2023-11-13T18:41:49.937 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:49.924+0000 7f976cdb1640 1 -- 172.21.15.102:0/1225331554 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9754003530 con 0x7f97680cdaa0 2023-11-13T18:41:49.938 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:49.924+0000 7f976cdb1640 1 -- 172.21.15.102:0/1225331554 <== mon.0 v1:172.21.15.102:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3937147865 0 0) 0x7f97680ce2b0 con 0x7f976815aeb0 2023-11-13T18:41:49.938 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:49.924+0000 7f976e5b4640 1 -- 172.21.15.102:0/1225331554 >> v1:172.21.15.154:6789/0 conn(0x7f97680cdaa0 legacy=0x7f97680ce570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T18:41:49.939 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:49.924+0000 7f976e5b4640 1 -- 172.21.15.102:0/1225331554 >> v1:172.21.15.102:6789/0 conn(0x7f976815aeb0 legacy=0x7f97680cd390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T18:41:49.939 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:49.924+0000 7f976e5b4640 1 -- 172.21.15.102:0/1225331554 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97680cc0f0 con 0x7f976815b290 2023-11-13T18:41:49.948 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:49.940+0000 7f976e5b4640 1 --2- 172.21.15.102:0/1225331554 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f976815b290 0x7f97680cec80 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f9760009dc0 tx=0x7f976001c8b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5024cd40ffacf098 server_cookie=0 in_seq=0 out_seq=0 2023-11-13T18:41:49.949 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:49.940+0000 7f976cdb1640 1 -- 172.21.15.102:0/1225331554 <== mon.2 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97600a5970 con 0x7f976815b290 2023-11-13T18:41:49.950 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:49.940+0000 7f976cdb1640 1 -- 172.21.15.102:0/1225331554 <== mon.2 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f97600a5ad0 con 0x7f976815b290 2023-11-13T18:41:49.950 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:49.940+0000 7f976cdb1640 1 -- 172.21.15.102:0/1225331554 <== mon.2 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97600a5e60 con 0x7f976815b290 2023-11-13T18:41:49.951 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:49.940+0000 7f976edb5640 1 -- 172.21.15.102:0/1225331554 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f976815b290 msgr2=0x7f97680cec80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T18:41:49.951 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:49.940+0000 7f976edb5640 1 --2- 172.21.15.102:0/1225331554 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f976815b290 0x7f97680cec80 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f9760009dc0 tx=0x7f976001c8b0 comp rx=0 tx=0).stop 2023-11-13T18:41:49.952 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:49.940+0000 7f976edb5640 1 -- 172.21.15.102:0/1225331554 shutdown_connections 2023-11-13T18:41:49.953 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:49.940+0000 7f976edb5640 1 --2- 172.21.15.102:0/1225331554 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f976815b290 0x7f97680cec80 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T18:41:49.953 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:49.940+0000 7f976edb5640 1 -- 172.21.15.102:0/1225331554 >> 172.21.15.102:0/1225331554 conn(0x7f97680b2550 msgr2=0x7f97680b2930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-13T18:41:49.954 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:49.940+0000 7f976edb5640 1 -- 172.21.15.102:0/1225331554 shutdown_connections 2023-11-13T18:41:49.954 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:49.940+0000 7f976edb5640 1 -- 172.21.15.102:0/1225331554 wait complete. 2023-11-13T18:41:49.954 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:49.944+0000 7f976edb5640 1 Processor -- start 2023-11-13T18:41:49.955 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:49.944+0000 7f976edb5640 1 -- start start 2023-11-13T18:41:49.957 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:49.944+0000 7f976edb5640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f97680cdaa0 0x7f97681554d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T18:41:49.957 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:49.944+0000 7f976edb5640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f976815aeb0 0x7f9768163a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T18:41:49.958 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:49.944+0000 7f976edb5640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f976815b290 0x7f9768156260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T18:41:49.958 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:49.944+0000 7f976edb5640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97680b4bc0 con 0x7f976815b290 2023-11-13T18:41:49.959 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:49.944+0000 7f976edb5640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9768155120 con 0x7f976815aeb0 2023-11-13T18:41:49.959 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:49.944+0000 7f976edb5640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9768152dd0 con 0x7f97680cdaa0 2023-11-13T18:41:49.959 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:49.944+0000 7f976d5b2640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f976815aeb0 0x7f9768163a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T18:41:49.960 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:49.944+0000 7f976e5b4640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f976815b290 0x7f9768156260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T18:41:49.960 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:49.944+0000 7f976d5b2640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f976815aeb0 0x7f9768163a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.102:47148/0 (socket says 172.21.15.102:47148) 2023-11-13T18:41:49.960 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:49.944+0000 7f976d5b2640 1 -- 172.21.15.102:0/1788943152 learned_addr learned my addr 172.21.15.102:0/1788943152 (peer_addr_for_me v2:172.21.15.102:0/0) 2023-11-13T18:41:49.961 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:49.944+0000 7f976ddb3640 1 --2- 172.21.15.102:0/1788943152 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f97680cdaa0 0x7f97681554d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T18:41:49.961 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:49.944+0000 7f976d5b2640 1 -- 172.21.15.102:0/1788943152 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f97680cdaa0 msgr2=0x7f97681554d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T18:41:49.962 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:49.944+0000 7f976d5b2640 1 --2- 172.21.15.102:0/1788943152 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f97680cdaa0 0x7f97681554d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T18:41:49.962 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:49.944+0000 7f976d5b2640 1 -- 172.21.15.102:0/1788943152 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f976815b290 msgr2=0x7f9768156260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T18:41:49.962 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:49.944+0000 7f976d5b2640 1 --2- 172.21.15.102:0/1788943152 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f976815b290 0x7f9768156260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T18:41:49.963 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:49.944+0000 7f976d5b2640 1 -- 172.21.15.102:0/1788943152 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9760009a70 con 0x7f976815aeb0 2023-11-13T18:41:49.963 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:49.944+0000 7f976d5b2640 1 --2- 172.21.15.102:0/1788943152 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f976815aeb0 0x7f9768163a70 secure :-1 s=READY pgs=919 cs=0 l=1 rev1=1 crypto rx=0x7f975800c430 tx=0x7f975800c8f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-13T18:41:49.963 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:49.948+0000 7f975e7fc640 1 -- 172.21.15.102:0/1788943152 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97580052d0 con 0x7f976815aeb0 2023-11-13T18:41:49.964 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:49.948+0000 7f975e7fc640 1 -- 172.21.15.102:0/1788943152 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9758005450 con 0x7f976815aeb0 2023-11-13T18:41:49.964 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:49.948+0000 7f975e7fc640 1 -- 172.21.15.102:0/1788943152 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9758003840 con 0x7f976815aeb0 2023-11-13T18:41:49.965 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:49.948+0000 7f976edb5640 1 -- 172.21.15.102:0/1788943152 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f97681540c0 con 0x7f976815aeb0 2023-11-13T18:41:49.965 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:49.948+0000 7f976edb5640 1 -- 172.21.15.102:0/1788943152 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9768163fb0 con 0x7f976815aeb0 2023-11-13T18:41:49.967 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:49.948+0000 7f976edb5640 1 -- 172.21.15.102:0/1788943152 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f97680b6710 con 0x7f976815aeb0 2023-11-13T18:41:49.967 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:49.948+0000 7f975e7fc640 1 -- 172.21.15.102:0/1788943152 <== mon.1 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f97580039a0 con 0x7f976815aeb0 2023-11-13T18:41:49.967 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:49.952+0000 7f975e7fc640 1 --2- 172.21.15.102:0/1788943152 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f974c066470 0x7f974c068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T18:41:49.968 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:49.952+0000 7f976ddb3640 1 --2- 172.21.15.102:0/1788943152 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f974c066470 0x7f974c068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T18:41:49.968 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:49.952+0000 7f975e7fc640 1 -- 172.21.15.102:0/1788943152 <== mon.1 v2:172.21.15.154:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f97580831a0 con 0x7f976815aeb0 2023-11-13T18:41:49.969 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:49.952+0000 7f975e7fc640 1 --2- 172.21.15.102:0/1788943152 >> [v2:172.21.15.102:6810/1825475150,v1:172.21.15.102:6812/1825475150] conn(0x7f974c06c2d0 0x7f974c06e6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T18:41:49.969 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:49.952+0000 7f975e7fc640 1 -- 172.21.15.102:0/1788943152 --> [v2:172.21.15.102:6810/1825475150,v1:172.21.15.102:6812/1825475150] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f974c06eda0 con 0x7f974c06c2d0 2023-11-13T18:41:49.969 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:49.952+0000 7f975e7fc640 1 -- 172.21.15.102:0/1788943152 <== mon.1 v2:172.21.15.154:3300/0 6 ==== mon_get_version_reply(handle=1 version=41) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9758085780 con 0x7f976815aeb0 2023-11-13T18:41:49.970 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:49.956+0000 7f976ddb3640 1 --2- 172.21.15.102:0/1788943152 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f974c066470 0x7f974c068930 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x7f9764000f70 tx=0x7f9764007d30 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-13T18:41:49.970 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:49.956+0000 7f976e5b4640 1 --2- 172.21.15.102:0/1788943152 >> [v2:172.21.15.102:6810/1825475150,v1:172.21.15.102:6812/1825475150] conn(0x7f974c06c2d0 0x7f974c06e6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T18:41:49.970 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:49.956+0000 7f976e5b4640 1 --2- 172.21.15.102:0/1788943152 >> [v2:172.21.15.102:6810/1825475150,v1:172.21.15.102:6812/1825475150] conn(0x7f974c06c2d0 0x7f974c06e6f0 crc :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-13T18:41:49.986 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:49.976+0000 7f975e7fc640 1 -- 172.21.15.102:0/1788943152 <== osd.2 v2:172.21.15.102:6810/1825475150 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26745 (crc 0 0 0) 0x7f974c06eda0 con 0x7f974c06c2d0 2023-11-13T18:41:50.025 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:50.016+0000 7f976edb5640 1 -- 172.21.15.102:0/1788943152 --> [v2:172.21.15.102:6810/1825475150,v1:172.21.15.102:6812/1825475150] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f97680b1a20 con 0x7f974c06c2d0 2023-11-13T18:41:50.033 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:50.024+0000 7f975e7fc640 1 -- 172.21.15.102:0/1788943152 <== osd.2 v2:172.21.15.102:6810/1825475150 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f97680b1a20 con 0x7f974c06c2d0 2023-11-13T18:41:50.033 INFO:teuthology.orchestra.run.smithi102.stdout:{ 2023-11-13T18:41:50.034 INFO:teuthology.orchestra.run.smithi102.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2023-11-13T18:41:50.034 INFO:teuthology.orchestra.run.smithi102.stdout:} 2023-11-13T18:41:50.036 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:50.024+0000 7f976edb5640 1 -- 172.21.15.102:0/1788943152 >> [v2:172.21.15.102:6810/1825475150,v1:172.21.15.102:6812/1825475150] conn(0x7f974c06c2d0 msgr2=0x7f974c06e6f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T18:41:50.036 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:50.024+0000 7f976edb5640 1 --2- 172.21.15.102:0/1788943152 >> [v2:172.21.15.102:6810/1825475150,v1:172.21.15.102:6812/1825475150] conn(0x7f974c06c2d0 0x7f974c06e6f0 crc :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T18:41:50.036 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:50.024+0000 7f976edb5640 1 -- 172.21.15.102:0/1788943152 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f974c066470 msgr2=0x7f974c068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T18:41:50.037 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:50.024+0000 7f976edb5640 1 --2- 172.21.15.102:0/1788943152 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f974c066470 0x7f974c068930 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x7f9764000f70 tx=0x7f9764007d30 comp rx=0 tx=0).stop 2023-11-13T18:41:50.037 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:50.024+0000 7f976edb5640 1 -- 172.21.15.102:0/1788943152 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f976815aeb0 msgr2=0x7f9768163a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T18:41:50.037 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:50.024+0000 7f976edb5640 1 --2- 172.21.15.102:0/1788943152 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f976815aeb0 0x7f9768163a70 secure :-1 s=READY pgs=919 cs=0 l=1 rev1=1 crypto rx=0x7f975800c430 tx=0x7f975800c8f0 comp rx=0 tx=0).stop 2023-11-13T18:41:50.038 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:50.024+0000 7f976e5b4640 1 -- 172.21.15.102:0/1788943152 reap_dead start 2023-11-13T18:41:50.038 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:50.024+0000 7f976edb5640 1 -- 172.21.15.102:0/1788943152 shutdown_connections 2023-11-13T18:41:50.039 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:50.024+0000 7f976edb5640 1 -- 172.21.15.102:0/1788943152 >> 172.21.15.102:0/1788943152 conn(0x7f97680b2550 msgr2=0x7f9768166450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-13T18:41:50.039 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:50.024+0000 7f976edb5640 1 -- 172.21.15.102:0/1788943152 shutdown_connections 2023-11-13T18:41:50.039 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:50.024+0000 7f976edb5640 1 -- 172.21.15.102:0/1788943152 wait complete. 2023-11-13T18:41:50.064 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2023-11-13T18:41:50.507 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:50.496+0000 7f9463765640 1 Processor -- start 2023-11-13T18:41:50.508 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:50.500+0000 7f9463765640 1 -- start start 2023-11-13T18:41:50.511 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:50.500+0000 7f9463765640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f945c1606e0 0x7f945c0c69b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T18:41:50.511 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:50.500+0000 7f9463765640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f945c0cf490 0x7f945c0cf920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T18:41:50.512 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:50.500+0000 7f9463765640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f945c0d1440 con 0x7f945c0d0c40 2023-11-13T18:41:50.512 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:50.500+0000 7f9463765640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f945c0cfe60 con 0x7f945c0cf490 2023-11-13T18:41:50.513 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:50.500+0000 7f9463765640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f945c0cdb10 con 0x7f945c1606e0 2023-11-13T18:41:50.514 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:50.504+0000 7f9461501640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f945c1606e0 0x7f945c0c69b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T18:41:50.514 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:50.504+0000 7f9460d00640 1 --1- >> v1:172.21.15.102:6789/0 conn(0x7f945c0d0c40 0x7f945c0b3e20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.102:6789/0 says I am v1:172.21.15.102:40666/0 (socket says 172.21.15.102:40666) 2023-11-13T18:41:50.515 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:50.504+0000 7f9460d00640 1 -- 172.21.15.102:0/1349933639 learned_addr learned my addr 172.21.15.102:0/1349933639 (peer_addr_for_me v1:172.21.15.102:0/0) 2023-11-13T18:41:50.515 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:50.504+0000 7f9461d02640 1 --2- 172.21.15.102:0/1349933639 >> v2:172.21.15.154:3300/0 conn(0x7f945c0cf490 0x7f945c0cf920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T18:41:50.515 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:50.504+0000 7f9461501640 1 -- 172.21.15.102:0/1349933639 >> v2:172.21.15.154:3300/0 conn(0x7f945c0cf490 msgr2=0x7f945c0cf920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-13T18:41:50.516 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:50.504+0000 7f9461501640 1 --2- 172.21.15.102:0/1349933639 >> v2:172.21.15.154:3300/0 conn(0x7f945c0cf490 0x7f945c0cf920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T18:41:50.516 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:50.504+0000 7f9461501640 1 -- 172.21.15.102:0/1349933639 >> v1:172.21.15.102:6789/0 conn(0x7f945c0d0c40 legacy=0x7f945c0b3e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T18:41:50.517 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:50.504+0000 7f9461501640 1 -- 172.21.15.102:0/1349933639 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f945c0d1690 con 0x7f945c1606e0 2023-11-13T18:41:50.520 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:50.512+0000 7f9461501640 1 --2- 172.21.15.102:0/1349933639 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f945c1606e0 0x7f945c0c69b0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f94580097c0 tx=0x7f945801c3c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1bb99f068008a978 server_cookie=0 in_seq=0 out_seq=0 2023-11-13T18:41:50.522 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:50.512+0000 7f9453fff640 1 -- 172.21.15.102:0/1349933639 <== mon.2 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94580ac640 con 0x7f945c1606e0 2023-11-13T18:41:50.522 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:50.512+0000 7f9453fff640 1 -- 172.21.15.102:0/1349933639 <== mon.2 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f94580ac7a0 con 0x7f945c1606e0 2023-11-13T18:41:50.522 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:50.512+0000 7f9453fff640 1 -- 172.21.15.102:0/1349933639 <== mon.2 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94580acb30 con 0x7f945c1606e0 2023-11-13T18:41:50.524 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:50.512+0000 7f9463765640 1 -- 172.21.15.102:0/1349933639 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f945c1606e0 msgr2=0x7f945c0c69b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T18:41:50.524 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:50.512+0000 7f9463765640 1 --2- 172.21.15.102:0/1349933639 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f945c1606e0 0x7f945c0c69b0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f94580097c0 tx=0x7f945801c3c0 comp rx=0 tx=0).stop 2023-11-13T18:41:50.525 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:50.512+0000 7f9463765640 1 -- 172.21.15.102:0/1349933639 shutdown_connections 2023-11-13T18:41:50.525 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:50.512+0000 7f9463765640 1 --2- 172.21.15.102:0/1349933639 >> v2:172.21.15.154:3300/0 conn(0x7f945c0cf490 0x7f945c0cf920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T18:41:50.526 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:50.512+0000 7f9463765640 1 --2- 172.21.15.102:0/1349933639 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f945c1606e0 0x7f945c0c69b0 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T18:41:50.526 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:50.512+0000 7f9463765640 1 -- 172.21.15.102:0/1349933639 >> 172.21.15.102:0/1349933639 conn(0x7f945c09c130 msgr2=0x7f945c0d2e60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-13T18:41:50.526 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:50.516+0000 7f9463765640 1 -- 172.21.15.102:0/1349933639 shutdown_connections 2023-11-13T18:41:50.527 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:50.516+0000 7f9463765640 1 -- 172.21.15.102:0/1349933639 wait complete. 2023-11-13T18:41:50.528 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:50.520+0000 7f9463765640 1 Processor -- start 2023-11-13T18:41:50.529 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:50.520+0000 7f9463765640 1 -- start start 2023-11-13T18:41:50.532 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:50.520+0000 7f9463765640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f945c0cf490 0x7f945c09ead0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T18:41:50.533 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:50.520+0000 7f9463765640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f945c0d0c40 0x7f945c152270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T18:41:50.533 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:50.520+0000 7f9463765640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f945c1606e0 0x7f945c0b0590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T18:41:50.533 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:50.520+0000 7f9463765640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f945c159a90 con 0x7f945c0d0c40 2023-11-13T18:41:50.534 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:50.520+0000 7f9463765640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f945c09f4b0 con 0x7f945c1606e0 2023-11-13T18:41:50.534 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:50.520+0000 7f9463765640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f945c09f790 con 0x7f945c0cf490 2023-11-13T18:41:50.534 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:50.524+0000 7f9461501640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f945c0cf490 0x7f945c09ead0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T18:41:50.535 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:50.524+0000 7f9461501640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f945c0cf490 0x7f945c09ead0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.102:54872/0 (socket says 172.21.15.102:54872) 2023-11-13T18:41:50.535 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:50.524+0000 7f9461501640 1 -- 172.21.15.102:0/1246590711 learned_addr learned my addr 172.21.15.102:0/1246590711 (peer_addr_for_me v2:172.21.15.102:0/0) 2023-11-13T18:41:50.536 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:50.524+0000 7f9460d00640 1 --2- 172.21.15.102:0/1246590711 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f945c0d0c40 0x7f945c152270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T18:41:50.536 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:50.524+0000 7f9461d02640 1 --2- 172.21.15.102:0/1246590711 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f945c1606e0 0x7f945c0b0590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T18:41:50.538 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:50.524+0000 7f9461501640 1 -- 172.21.15.102:0/1246590711 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f945c1606e0 msgr2=0x7f945c0b0590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T18:41:50.538 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:50.524+0000 7f9461501640 1 --2- 172.21.15.102:0/1246590711 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f945c1606e0 0x7f945c0b0590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T18:41:50.538 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:50.524+0000 7f9461501640 1 -- 172.21.15.102:0/1246590711 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f945c0d0c40 msgr2=0x7f945c152270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T18:41:50.539 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:50.524+0000 7f9461501640 1 --2- 172.21.15.102:0/1246590711 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f945c0d0c40 0x7f945c152270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T18:41:50.539 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:50.524+0000 7f9461501640 1 -- 172.21.15.102:0/1246590711 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9458009420 con 0x7f945c0cf490 2023-11-13T18:41:50.539 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:50.524+0000 7f9460d00640 1 --2- 172.21.15.102:0/1246590711 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f945c0d0c40 0x7f945c152270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-13T18:41:50.540 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:50.524+0000 7f9461501640 1 --2- 172.21.15.102:0/1246590711 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f945c0cf490 0x7f945c09ead0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f9458019ff0 tx=0x7f9458019160 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-13T18:41:50.540 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:50.524+0000 7f9451ffb640 1 -- 172.21.15.102:0/1246590711 <== mon.2 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94580b5610 con 0x7f945c0cf490 2023-11-13T18:41:50.541 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:50.524+0000 7f9451ffb640 1 -- 172.21.15.102:0/1246590711 <== mon.2 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f94580b5770 con 0x7f945c0cf490 2023-11-13T18:41:50.541 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:50.524+0000 7f9451ffb640 1 -- 172.21.15.102:0/1246590711 <== mon.2 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94580b5ae0 con 0x7f945c0cf490 2023-11-13T18:41:50.541 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:50.524+0000 7f9463765640 1 -- 172.21.15.102:0/1246590711 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f945c09fa70 con 0x7f945c0cf490 2023-11-13T18:41:50.542 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:50.524+0000 7f9463765640 1 -- 172.21.15.102:0/1246590711 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f945c0a0030 con 0x7f945c0cf490 2023-11-13T18:41:50.542 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:50.528+0000 7f9463765640 1 -- 172.21.15.102:0/1246590711 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f945c0b02b0 con 0x7f945c0cf490 2023-11-13T18:41:50.543 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:50.528+0000 7f9451ffb640 1 -- 172.21.15.102:0/1246590711 <== mon.2 v2:172.21.15.154:3301/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f94580b3040 con 0x7f945c0cf490 2023-11-13T18:41:50.544 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:50.532+0000 7f9451ffb640 1 --2- 172.21.15.102:0/1246590711 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f9440066470 0x7f9440068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T18:41:50.544 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:50.532+0000 7f9451ffb640 1 -- 172.21.15.102:0/1246590711 <== mon.2 v2:172.21.15.154:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f945811e1d0 con 0x7f945c0cf490 2023-11-13T18:41:50.544 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:50.532+0000 7f9460d00640 1 --2- 172.21.15.102:0/1246590711 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f9440066470 0x7f9440068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T18:41:50.545 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:50.532+0000 7f9460d00640 1 --2- 172.21.15.102:0/1246590711 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f9440066470 0x7f9440068930 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 crypto rx=0x7f945c073670 tx=0x7f944c007e90 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-13T18:41:50.545 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:50.536+0000 7f9451ffb640 1 -- 172.21.15.102:0/1246590711 <== mon.2 v2:172.21.15.154:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f945c0b02b0 con 0x7f945c0cf490 2023-11-13T18:41:50.699 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:50.688+0000 7f9463765640 1 -- 172.21.15.102:0/1246590711 --> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "2", "target": ["mon-mgr", ""]}) v1 -- 0x7f945c0b02b0 con 0x7f9440066470 2023-11-13T18:41:50.700 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:50.692+0000 7f9451ffb640 1 -- 172.21.15.102:0/1246590711 <== mgr.4103 v2:172.21.15.102:6832/1009482693 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 2 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f945c0b02b0 con 0x7f9440066470 2023-11-13T18:41:50.700 INFO:teuthology.orchestra.run.smithi102.stderr:instructed osd(s) 2 to deep-scrub 2023-11-13T18:41:50.703 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:50.692+0000 7f9463765640 1 -- 172.21.15.102:0/1246590711 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f9440066470 msgr2=0x7f9440068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T18:41:50.704 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:50.692+0000 7f9463765640 1 --2- 172.21.15.102:0/1246590711 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f9440066470 0x7f9440068930 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 crypto rx=0x7f945c073670 tx=0x7f944c007e90 comp rx=0 tx=0).stop 2023-11-13T18:41:50.704 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:50.692+0000 7f9463765640 1 -- 172.21.15.102:0/1246590711 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f945c0cf490 msgr2=0x7f945c09ead0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T18:41:50.704 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:50.692+0000 7f9463765640 1 --2- 172.21.15.102:0/1246590711 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f945c0cf490 0x7f945c09ead0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f9458019ff0 tx=0x7f9458019160 comp rx=0 tx=0).stop 2023-11-13T18:41:50.705 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:50.692+0000 7f9463765640 1 -- 172.21.15.102:0/1246590711 shutdown_connections 2023-11-13T18:41:50.705 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:50.692+0000 7f9463765640 1 --2- 172.21.15.102:0/1246590711 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f945c1606e0 0x7f945c0b0590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T18:41:50.706 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:50.692+0000 7f9463765640 1 --2- 172.21.15.102:0/1246590711 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f9440066470 0x7f9440068930 unknown :-1 s=CLOSED pgs=760 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T18:41:50.706 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:50.692+0000 7f9463765640 1 --2- 172.21.15.102:0/1246590711 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f945c0d0c40 0x7f945c152270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T18:41:50.706 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:50.692+0000 7f9463765640 1 --2- 172.21.15.102:0/1246590711 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f945c0cf490 0x7f945c09ead0 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T18:41:50.707 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:50.692+0000 7f9463765640 1 -- 172.21.15.102:0/1246590711 >> 172.21.15.102:0/1246590711 conn(0x7f945c09c130 msgr2=0x7f945c0b47a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-13T18:41:50.707 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:50.692+0000 7f9463765640 1 -- 172.21.15.102:0/1246590711 shutdown_connections 2023-11-13T18:41:50.707 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:50.692+0000 7f9463765640 1 -- 172.21.15.102:0/1246590711 wait complete. 2023-11-13T18:41:50.747 INFO:tasks.ceph:Scrubbing osd.3 2023-11-13T18:41:50.747 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2023-11-13T18:41:50.957 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:50.948+0000 7f2abf59e640 1 Processor -- start 2023-11-13T18:41:50.957 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:50.948+0000 7f2abf59e640 1 -- start start 2023-11-13T18:41:50.961 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:50.952+0000 7f2abf59e640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2ac0160570 0x7f2ac006b560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T18:41:50.961 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:50.952+0000 7f2abf59e640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f2ac00b1d20 0x7f2ac00cc580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T18:41:50.962 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:50.952+0000 7f2abf59e640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2ac006c1b0 con 0x7f2ac00b3040 2023-11-13T18:41:50.962 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:50.952+0000 7f2abf59e640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2ac006c400 con 0x7f2ac00b1d20 2023-11-13T18:41:50.963 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:50.952+0000 7f2abf59e640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ac00cbaa0 con 0x7f2ac0160570 2023-11-13T18:41:50.963 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:50.952+0000 7f2abed9d640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f2ac00b1d20 0x7f2ac00cc580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T18:41:50.963 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:50.952+0000 7f2abed9d640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f2ac00b1d20 0x7f2ac00cc580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:50778/0 (socket says 172.21.15.102:50778) 2023-11-13T18:41:50.964 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:50.952+0000 7f2abed9d640 1 -- 172.21.15.102:0/1710605286 learned_addr learned my addr 172.21.15.102:0/1710605286 (peer_addr_for_me v2:172.21.15.102:0/0) 2023-11-13T18:41:50.964 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:50.952+0000 7f2abe59c640 1 --2- 172.21.15.102:0/1710605286 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2ac0160570 0x7f2ac006b560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T18:41:50.964 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:50.952+0000 7f2abed9d640 1 -- 172.21.15.102:0/1710605286 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2ac0160570 msgr2=0x7f2ac006b560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-13T18:41:50.965 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:50.952+0000 7f2abed9d640 1 --2- 172.21.15.102:0/1710605286 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2ac0160570 0x7f2ac006b560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T18:41:50.965 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:50.952+0000 7f2abed9d640 1 -- 172.21.15.102:0/1710605286 >> v1:172.21.15.154:6789/0 conn(0x7f2ac00b3040 legacy=0x7f2ac006baa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-13T18:41:50.966 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:50.952+0000 7f2abed9d640 1 -- 172.21.15.102:0/1710605286 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ac00cbd80 con 0x7f2ac00b1d20 2023-11-13T18:41:50.966 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:50.956+0000 7f2abed9d640 1 --2- 172.21.15.102:0/1710605286 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2ac00b1d20 0x7f2ac00cc580 secure :-1 s=READY pgs=1956 cs=0 l=1 rev1=1 crypto rx=0x7f2ab8009e50 tx=0x7f2ab801c9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=75c2729d8add7b10 server_cookie=0 in_seq=0 out_seq=0 2023-11-13T18:41:50.970 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:50.960+0000 7f2abdd9b640 1 -- 172.21.15.102:0/1710605286 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ab80a5840 con 0x7f2ac00b1d20 2023-11-13T18:41:50.970 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:50.960+0000 7f2abdd9b640 1 -- 172.21.15.102:0/1710605286 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ab80a59a0 con 0x7f2ac00b1d20 2023-11-13T18:41:50.971 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:50.960+0000 7f2abdd9b640 1 -- 172.21.15.102:0/1710605286 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ab80a5d30 con 0x7f2ac00b1d20 2023-11-13T18:41:50.972 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:50.960+0000 7f2abf59e640 1 -- 172.21.15.102:0/1710605286 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2ac00b1d20 msgr2=0x7f2ac00cc580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T18:41:50.973 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:50.960+0000 7f2abf59e640 1 --2- 172.21.15.102:0/1710605286 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2ac00b1d20 0x7f2ac00cc580 secure :-1 s=READY pgs=1956 cs=0 l=1 rev1=1 crypto rx=0x7f2ab8009e50 tx=0x7f2ab801c9a0 comp rx=0 tx=0).stop 2023-11-13T18:41:50.973 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:50.960+0000 7f2abf59e640 1 -- 172.21.15.102:0/1710605286 shutdown_connections 2023-11-13T18:41:50.973 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:50.960+0000 7f2abf59e640 1 --2- 172.21.15.102:0/1710605286 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2ac00b1d20 0x7f2ac00cc580 unknown :-1 s=CLOSED pgs=1956 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T18:41:50.974 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:50.960+0000 7f2abf59e640 1 --2- 172.21.15.102:0/1710605286 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2ac0160570 0x7f2ac006b560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T18:41:50.974 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:50.960+0000 7f2abf59e640 1 -- 172.21.15.102:0/1710605286 >> 172.21.15.102:0/1710605286 conn(0x7f2ac00b2550 msgr2=0x7f2ac00b2930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-13T18:41:50.975 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:50.960+0000 7f2abf59e640 1 -- 172.21.15.102:0/1710605286 shutdown_connections 2023-11-13T18:41:50.975 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:50.960+0000 7f2abf59e640 1 -- 172.21.15.102:0/1710605286 wait complete. 2023-11-13T18:41:50.977 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:50.964+0000 7f2abf59e640 1 Processor -- start 2023-11-13T18:41:50.977 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:50.964+0000 7f2abf59e640 1 -- start start 2023-11-13T18:41:50.978 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:50.964+0000 7f2abf59e640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2ac00b1d20 0x7f2ac015c4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T18:41:50.978 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:50.964+0000 7f2abf59e640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2ac00b3040 0x7f2ac015ca00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T18:41:50.979 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:50.964+0000 7f2abf59e640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2ac0160570 0x7f2ac015cf40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T18:41:50.979 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:50.964+0000 7f2abf59e640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ac01591f0 con 0x7f2ac00b3040 2023-11-13T18:41:50.979 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:50.964+0000 7f2abf59e640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ac01594d0 con 0x7f2ac00b1d20 2023-11-13T18:41:50.980 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:50.964+0000 7f2abf59e640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ac015bcc0 con 0x7f2ac0160570 2023-11-13T18:41:50.980 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:50.964+0000 7f2abed9d640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2ac0160570 0x7f2ac015cf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T18:41:50.980 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:50.964+0000 7f2abed9d640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2ac0160570 0x7f2ac015cf40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.102:54888/0 (socket says 172.21.15.102:54888) 2023-11-13T18:41:50.981 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:50.964+0000 7f2abed9d640 1 -- 172.21.15.102:0/1595419360 learned_addr learned my addr 172.21.15.102:0/1595419360 (peer_addr_for_me v2:172.21.15.102:0/0) 2023-11-13T18:41:50.981 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:50.964+0000 7f2abe59c640 1 --2- 172.21.15.102:0/1595419360 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2ac00b1d20 0x7f2ac015c4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T18:41:50.982 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:50.964+0000 7f2ab7fff640 1 --2- 172.21.15.102:0/1595419360 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2ac00b3040 0x7f2ac015ca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T18:41:50.982 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:50.968+0000 7f2abed9d640 1 -- 172.21.15.102:0/1595419360 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2ac00b1d20 msgr2=0x7f2ac015c4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T18:41:50.982 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:50.968+0000 7f2abed9d640 1 --2- 172.21.15.102:0/1595419360 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2ac00b1d20 0x7f2ac015c4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T18:41:50.983 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:50.968+0000 7f2abed9d640 1 -- 172.21.15.102:0/1595419360 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2ac00b3040 msgr2=0x7f2ac015ca00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T18:41:50.983 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:50.968+0000 7f2abed9d640 1 --2- 172.21.15.102:0/1595419360 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2ac00b3040 0x7f2ac015ca00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T18:41:50.983 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:50.968+0000 7f2abed9d640 1 -- 172.21.15.102:0/1595419360 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ab8009b30 con 0x7f2ac0160570 2023-11-13T18:41:50.984 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:50.968+0000 7f2ab7fff640 1 --2- 172.21.15.102:0/1595419360 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2ac00b3040 0x7f2ac015ca00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-13T18:41:50.984 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:50.968+0000 7f2abed9d640 1 --2- 172.21.15.102:0/1595419360 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2ac0160570 0x7f2ac015cf40 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f2ab80af040 tx=0x7f2ab8019740 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-13T18:41:50.985 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:50.968+0000 7f2ab6ffd640 1 -- 172.21.15.102:0/1595419360 <== mon.2 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ab80b8670 con 0x7f2ac0160570 2023-11-13T18:41:50.986 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:50.968+0000 7f2ab6ffd640 1 -- 172.21.15.102:0/1595419360 <== mon.2 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ab80b87d0 con 0x7f2ac0160570 2023-11-13T18:41:50.986 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:50.968+0000 7f2ab6ffd640 1 -- 172.21.15.102:0/1595419360 <== mon.2 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ab80b8b80 con 0x7f2ac0160570 2023-11-13T18:41:50.987 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:50.968+0000 7f2abf59e640 1 -- 172.21.15.102:0/1595419360 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2ac015bfa0 con 0x7f2ac0160570 2023-11-13T18:41:50.987 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:50.968+0000 7f2abf59e640 1 -- 172.21.15.102:0/1595419360 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2ac01597b0 con 0x7f2ac0160570 2023-11-13T18:41:50.987 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:50.972+0000 7f2abf59e640 1 -- 172.21.15.102:0/1595419360 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f2ac0068520 con 0x7f2ac0160570 2023-11-13T18:41:50.988 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:50.976+0000 7f2ab6ffd640 1 -- 172.21.15.102:0/1595419360 <== mon.2 v2:172.21.15.154:3301/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f2ab80b8ce0 con 0x7f2ac0160570 2023-11-13T18:41:50.989 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:50.980+0000 7f2ab6ffd640 1 --2- 172.21.15.102:0/1595419360 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f2aa00664f0 0x7f2aa00689b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T18:41:50.989 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:50.980+0000 7f2ab6ffd640 1 -- 172.21.15.102:0/1595419360 <== mon.2 v2:172.21.15.154:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f2ab811f210 con 0x7f2ac0160570 2023-11-13T18:41:50.990 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:50.980+0000 7f2ab6ffd640 1 --2- 172.21.15.102:0/1595419360 >> [v2:172.21.15.102:6824/4149355528,v1:172.21.15.102:6825/4149355528] conn(0x7f2aa006c350 0x7f2aa006e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T18:41:50.990 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:50.980+0000 7f2ab6ffd640 1 -- 172.21.15.102:0/1595419360 --> [v2:172.21.15.102:6824/4149355528,v1:172.21.15.102:6825/4149355528] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f2aa006ee20 con 0x7f2aa006c350 2023-11-13T18:41:50.990 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:50.980+0000 7f2ab6ffd640 1 -- 172.21.15.102:0/1595419360 <== mon.2 v2:172.21.15.154:3301/0 6 ==== mon_get_version_reply(handle=1 version=41) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2ab81217f0 con 0x7f2ac0160570 2023-11-13T18:41:50.991 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:50.980+0000 7f2ab7fff640 1 --2- 172.21.15.102:0/1595419360 >> [v2:172.21.15.102:6824/4149355528,v1:172.21.15.102:6825/4149355528] conn(0x7f2aa006c350 0x7f2aa006e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T18:41:50.991 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:50.980+0000 7f2abe59c640 1 --2- 172.21.15.102:0/1595419360 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f2aa00664f0 0x7f2aa00689b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T18:41:50.992 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:50.980+0000 7f2ab7fff640 1 --2- 172.21.15.102:0/1595419360 >> [v2:172.21.15.102:6824/4149355528,v1:172.21.15.102:6825/4149355528] conn(0x7f2aa006c350 0x7f2aa006e770 crc :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-13T18:41:50.992 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:50.980+0000 7f2abe59c640 1 --2- 172.21.15.102:0/1595419360 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f2aa00664f0 0x7f2aa00689b0 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 crypto rx=0x7f2ab00079c0 tx=0x7f2ab0008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-13T18:41:51.014 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:51.004+0000 7f2ab6ffd640 1 -- 172.21.15.102:0/1595419360 <== osd.3 v2:172.21.15.102:6824/4149355528 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26745 (crc 0 0 0) 0x7f2aa006ee20 con 0x7f2aa006c350 2023-11-13T18:41:51.052 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:51.040+0000 7f2abf59e640 1 -- 172.21.15.102:0/1595419360 --> [v2:172.21.15.102:6824/4149355528,v1:172.21.15.102:6825/4149355528] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f2ac015c190 con 0x7f2aa006c350 2023-11-13T18:41:51.058 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:51.048+0000 7f2ab6ffd640 1 -- 172.21.15.102:0/1595419360 <== osd.3 v2:172.21.15.102:6824/4149355528 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f2ac015c190 con 0x7f2aa006c350 2023-11-13T18:41:51.058 INFO:teuthology.orchestra.run.smithi102.stdout:{ 2023-11-13T18:41:51.059 INFO:teuthology.orchestra.run.smithi102.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2023-11-13T18:41:51.059 INFO:teuthology.orchestra.run.smithi102.stdout:} 2023-11-13T18:41:51.061 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:51.048+0000 7f2abf59e640 1 -- 172.21.15.102:0/1595419360 >> [v2:172.21.15.102:6824/4149355528,v1:172.21.15.102:6825/4149355528] conn(0x7f2aa006c350 msgr2=0x7f2aa006e770 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T18:41:51.061 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:51.048+0000 7f2abf59e640 1 --2- 172.21.15.102:0/1595419360 >> [v2:172.21.15.102:6824/4149355528,v1:172.21.15.102:6825/4149355528] conn(0x7f2aa006c350 0x7f2aa006e770 crc :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T18:41:51.061 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:51.048+0000 7f2abf59e640 1 -- 172.21.15.102:0/1595419360 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f2aa00664f0 msgr2=0x7f2aa00689b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T18:41:51.062 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:51.048+0000 7f2abf59e640 1 --2- 172.21.15.102:0/1595419360 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f2aa00664f0 0x7f2aa00689b0 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 crypto rx=0x7f2ab00079c0 tx=0x7f2ab0008040 comp rx=0 tx=0).stop 2023-11-13T18:41:51.062 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:51.048+0000 7f2abf59e640 1 -- 172.21.15.102:0/1595419360 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2ac0160570 msgr2=0x7f2ac015cf40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T18:41:51.063 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:51.048+0000 7f2abf59e640 1 --2- 172.21.15.102:0/1595419360 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2ac0160570 0x7f2ac015cf40 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f2ab80af040 tx=0x7f2ab8019740 comp rx=0 tx=0).stop 2023-11-13T18:41:51.063 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:51.048+0000 7f2abed9d640 1 -- 172.21.15.102:0/1595419360 reap_dead start 2023-11-13T18:41:51.063 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:51.048+0000 7f2abf59e640 1 -- 172.21.15.102:0/1595419360 shutdown_connections 2023-11-13T18:41:51.064 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:51.048+0000 7f2abf59e640 1 -- 172.21.15.102:0/1595419360 >> 172.21.15.102:0/1595419360 conn(0x7f2ac00b2550 msgr2=0x7f2ac00b2930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-13T18:41:51.064 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:51.048+0000 7f2abf59e640 1 -- 172.21.15.102:0/1595419360 shutdown_connections 2023-11-13T18:41:51.065 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:51.048+0000 7f2abf59e640 1 -- 172.21.15.102:0/1595419360 wait complete. 2023-11-13T18:41:51.101 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2023-11-13T18:41:51.310 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:51.300+0000 7feffcf57640 1 Processor -- start 2023-11-13T18:41:51.310 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:51.300+0000 7feffcf57640 1 -- start start 2023-11-13T18:41:51.312 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:51.300+0000 7feffcf57640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7feff81606a0 0x7feff80b2640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T18:41:51.312 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:51.300+0000 7feffcf57640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7feff80b2b80 0x7feff80cf640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T18:41:51.313 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:51.300+0000 7feffcf57640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feff80cd8f0 con 0x7feff80d3430 2023-11-13T18:41:51.313 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:51.300+0000 7feffcf57640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feff80d3c80 con 0x7feff80b2b80 2023-11-13T18:41:51.314 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:51.300+0000 7feffcf57640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feff80d39a0 con 0x7feff81606a0 2023-11-13T18:41:51.314 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:51.304+0000 7feff6d9d640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7feff80b2b80 0x7feff80cf640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T18:41:51.314 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:51.304+0000 7feff6d9d640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7feff80b2b80 0x7feff80cf640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:50808/0 (socket says 172.21.15.102:50808) 2023-11-13T18:41:51.315 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:51.304+0000 7feff6d9d640 1 -- 172.21.15.102:0/1058921787 learned_addr learned my addr 172.21.15.102:0/1058921787 (peer_addr_for_me v2:172.21.15.102:0/0) 2023-11-13T18:41:51.315 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:51.304+0000 7feff659c640 1 --2- 172.21.15.102:0/1058921787 >> v2:172.21.15.154:3300/0 conn(0x7feff81606a0 0x7feff80b2640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T18:41:51.317 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:51.304+0000 7feff6d9d640 1 -- 172.21.15.102:0/1058921787 >> v2:172.21.15.154:3300/0 conn(0x7feff81606a0 msgr2=0x7feff80b2640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-13T18:41:51.317 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:51.304+0000 7feff6d9d640 1 --2- 172.21.15.102:0/1058921787 >> v2:172.21.15.154:3300/0 conn(0x7feff81606a0 0x7feff80b2640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T18:41:51.318 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:51.304+0000 7feff6d9d640 1 -- 172.21.15.102:0/1058921787 >> v1:172.21.15.102:6789/0 conn(0x7feff80d3430 legacy=0x7feff80ce670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T18:41:51.318 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:51.304+0000 7feff6d9d640 1 -- 172.21.15.102:0/1058921787 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feff80cdb90 con 0x7feff80b2b80 2023-11-13T18:41:51.318 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:51.308+0000 7feff6d9d640 1 --2- 172.21.15.102:0/1058921787 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7feff80b2b80 0x7feff80cf640 secure :-1 s=READY pgs=1958 cs=0 l=1 rev1=1 crypto rx=0x7feff0009e50 tx=0x7feff001c9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7f12844ab50e6945 server_cookie=0 in_seq=0 out_seq=0 2023-11-13T18:41:51.319 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:51.308+0000 7feff559a640 1 -- 172.21.15.102:0/1058921787 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feff00a5860 con 0x7feff80b2b80 2023-11-13T18:41:51.319 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:51.308+0000 7feff559a640 1 -- 172.21.15.102:0/1058921787 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feff00a59c0 con 0x7feff80b2b80 2023-11-13T18:41:51.319 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:51.308+0000 7feff559a640 1 -- 172.21.15.102:0/1058921787 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feff00a5d50 con 0x7feff80b2b80 2023-11-13T18:41:51.320 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:51.308+0000 7feffcf57640 1 -- 172.21.15.102:0/1058921787 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7feff80b2b80 msgr2=0x7feff80cf640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T18:41:51.320 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:51.308+0000 7feffcf57640 1 --2- 172.21.15.102:0/1058921787 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7feff80b2b80 0x7feff80cf640 secure :-1 s=READY pgs=1958 cs=0 l=1 rev1=1 crypto rx=0x7feff0009e50 tx=0x7feff001c9a0 comp rx=0 tx=0).stop 2023-11-13T18:41:51.323 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:51.308+0000 7feffcf57640 1 -- 172.21.15.102:0/1058921787 shutdown_connections 2023-11-13T18:41:51.323 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:51.308+0000 7feffcf57640 1 --2- 172.21.15.102:0/1058921787 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7feff80b2b80 0x7feff80cf640 unknown :-1 s=CLOSED pgs=1958 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T18:41:51.324 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:51.308+0000 7feffcf57640 1 --2- 172.21.15.102:0/1058921787 >> v2:172.21.15.154:3300/0 conn(0x7feff81606a0 0x7feff80b2640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T18:41:51.324 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:51.308+0000 7feffcf57640 1 -- 172.21.15.102:0/1058921787 >> 172.21.15.102:0/1058921787 conn(0x7feff809c020 msgr2=0x7feff80d2d20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-13T18:41:51.325 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:51.308+0000 7feffcf57640 1 -- 172.21.15.102:0/1058921787 shutdown_connections 2023-11-13T18:41:51.325 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:51.308+0000 7feffcf57640 1 -- 172.21.15.102:0/1058921787 wait complete. 2023-11-13T18:41:51.325 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:51.312+0000 7feffcf57640 1 Processor -- start 2023-11-13T18:41:51.326 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:51.312+0000 7feffcf57640 1 -- start start 2023-11-13T18:41:51.326 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:51.312+0000 7feffcf57640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7feff80b2b80 0x7feff8153be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T18:41:51.326 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:51.312+0000 7feffcf57640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7feff80d3430 0x7feff80b0230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T18:41:51.327 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:51.312+0000 7feffcf57640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7feff81606a0 0x7feff8153050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T18:41:51.327 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:51.312+0000 7feffcf57640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feff8154fb0 con 0x7feff80b2b80 2023-11-13T18:41:51.328 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:51.312+0000 7feffcf57640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feff8154430 con 0x7feff81606a0 2023-11-13T18:41:51.328 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:51.312+0000 7feffcf57640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feff8154710 con 0x7feff80d3430 2023-11-13T18:41:51.328 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:51.312+0000 7feff6d9d640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7feff81606a0 0x7feff8153050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T18:41:51.329 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:51.312+0000 7feff6d9d640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7feff81606a0 0x7feff8153050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.102:47194/0 (socket says 172.21.15.102:47194) 2023-11-13T18:41:51.329 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:51.312+0000 7feff6d9d640 1 -- 172.21.15.102:0/2673676095 learned_addr learned my addr 172.21.15.102:0/2673676095 (peer_addr_for_me v2:172.21.15.102:0/0) 2023-11-13T18:41:51.329 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:51.312+0000 7feff5d9b640 1 --2- 172.21.15.102:0/2673676095 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7feff80d3430 0x7feff80b0230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T18:41:51.330 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:51.312+0000 7feff659c640 1 --2- 172.21.15.102:0/2673676095 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7feff80b2b80 0x7feff8153be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T18:41:51.330 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:51.312+0000 7feff6d9d640 1 -- 172.21.15.102:0/2673676095 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7feff80d3430 msgr2=0x7feff80b0230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T18:41:51.331 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:51.312+0000 7feff6d9d640 1 --2- 172.21.15.102:0/2673676095 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7feff80d3430 0x7feff80b0230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T18:41:51.331 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:51.312+0000 7feff6d9d640 1 -- 172.21.15.102:0/2673676095 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7feff80b2b80 msgr2=0x7feff8153be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T18:41:51.331 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:51.312+0000 7feff6d9d640 1 --2- 172.21.15.102:0/2673676095 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7feff80b2b80 0x7feff8153be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T18:41:51.332 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:51.312+0000 7feff6d9d640 1 -- 172.21.15.102:0/2673676095 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feff0009b30 con 0x7feff81606a0 2023-11-13T18:41:51.332 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:51.312+0000 7feff6d9d640 1 --2- 172.21.15.102:0/2673676095 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7feff81606a0 0x7feff8153050 secure :-1 s=READY pgs=921 cs=0 l=1 rev1=1 crypto rx=0x7feff00195b0 tx=0x7feff0019740 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-13T18:41:51.332 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:51.312+0000 7fefe6ffd640 1 -- 172.21.15.102:0/2673676095 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feff00b8670 con 0x7feff81606a0 2023-11-13T18:41:51.333 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:51.312+0000 7fefe6ffd640 1 -- 172.21.15.102:0/2673676095 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feff00b87d0 con 0x7feff81606a0 2023-11-13T18:41:51.333 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:51.312+0000 7feffcf57640 1 -- 172.21.15.102:0/2673676095 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feff81549f0 con 0x7feff81606a0 2023-11-13T18:41:51.333 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:51.312+0000 7fefe6ffd640 1 -- 172.21.15.102:0/2673676095 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feff00b8b40 con 0x7feff81606a0 2023-11-13T18:41:51.334 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:51.312+0000 7feffcf57640 1 -- 172.21.15.102:0/2673676095 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feff8154120 con 0x7feff81606a0 2023-11-13T18:41:51.335 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:51.316+0000 7feffcf57640 1 -- 172.21.15.102:0/2673676095 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feff8068520 con 0x7feff81606a0 2023-11-13T18:41:51.335 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:51.316+0000 7fefe6ffd640 1 -- 172.21.15.102:0/2673676095 <== mon.1 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7feff00b8ca0 con 0x7feff81606a0 2023-11-13T18:41:51.336 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:51.316+0000 7fefe6ffd640 1 --2- 172.21.15.102:0/2673676095 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7fefd8066470 0x7fefd8068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T18:41:51.336 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:51.320+0000 7fefe6ffd640 1 -- 172.21.15.102:0/2673676095 <== mon.1 v2:172.21.15.154:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4943+0+0 (secure 0 0 0) 0x7feff011f1a0 con 0x7feff81606a0 2023-11-13T18:41:51.336 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:51.320+0000 7feff659c640 1 --2- 172.21.15.102:0/2673676095 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7fefd8066470 0x7fefd8068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T18:41:51.337 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:51.320+0000 7feff659c640 1 --2- 172.21.15.102:0/2673676095 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7fefd8066470 0x7fefd8068930 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 crypto rx=0x7fefe800b9d0 tx=0x7fefe8008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-13T18:41:51.350 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:51.340+0000 7fefe6ffd640 1 -- 172.21.15.102:0/2673676095 <== mon.1 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7feff00eca30 con 0x7feff81606a0 2023-11-13T18:41:51.814 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:51.804+0000 7feffcf57640 1 -- 172.21.15.102:0/2673676095 --> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "3", "target": ["mon-mgr", ""]}) v1 -- 0x7feff80cff90 con 0x7fefd8066470 2023-11-13T18:41:51.815 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:51.804+0000 7fefe6ffd640 1 -- 172.21.15.102:0/2673676095 <== mgr.4103 v2:172.21.15.102:6832/1009482693 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 3 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fefe800b670 con 0x7fefd8066470 2023-11-13T18:41:51.816 INFO:teuthology.orchestra.run.smithi102.stderr:instructed osd(s) 3 to deep-scrub 2023-11-13T18:41:51.819 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:51.808+0000 7feffcf57640 1 -- 172.21.15.102:0/2673676095 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7fefd8066470 msgr2=0x7fefd8068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T18:41:51.820 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:51.808+0000 7feffcf57640 1 --2- 172.21.15.102:0/2673676095 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7fefd8066470 0x7fefd8068930 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 crypto rx=0x7fefe800b9d0 tx=0x7fefe8008040 comp rx=0 tx=0).stop 2023-11-13T18:41:51.820 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:51.808+0000 7feffcf57640 1 -- 172.21.15.102:0/2673676095 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7feff81606a0 msgr2=0x7feff8153050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T18:41:51.820 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:51.808+0000 7feffcf57640 1 --2- 172.21.15.102:0/2673676095 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7feff81606a0 0x7feff8153050 secure :-1 s=READY pgs=921 cs=0 l=1 rev1=1 crypto rx=0x7feff00195b0 tx=0x7feff0019740 comp rx=0 tx=0).stop 2023-11-13T18:41:51.821 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:51.808+0000 7feffcf57640 1 -- 172.21.15.102:0/2673676095 shutdown_connections 2023-11-13T18:41:51.821 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:51.808+0000 7feffcf57640 1 --2- 172.21.15.102:0/2673676095 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7feff81606a0 0x7feff8153050 unknown :-1 s=CLOSED pgs=921 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T18:41:51.822 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:51.808+0000 7feffcf57640 1 --2- 172.21.15.102:0/2673676095 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7feff80d3430 0x7feff80b0230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T18:41:51.822 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:51.808+0000 7feffcf57640 1 --2- 172.21.15.102:0/2673676095 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7fefd8066470 0x7fefd8068930 unknown :-1 s=CLOSED pgs=762 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T18:41:51.822 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:51.808+0000 7feffcf57640 1 --2- 172.21.15.102:0/2673676095 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7feff80b2b80 0x7feff8153be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T18:41:51.823 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:51.808+0000 7feffcf57640 1 -- 172.21.15.102:0/2673676095 >> 172.21.15.102:0/2673676095 conn(0x7feff809c020 msgr2=0x7feff80b35d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-13T18:41:51.823 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:51.808+0000 7feffcf57640 1 -- 172.21.15.102:0/2673676095 shutdown_connections 2023-11-13T18:41:51.824 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:51.808+0000 7feffcf57640 1 -- 172.21.15.102:0/2673676095 wait complete. 2023-11-13T18:41:51.871 INFO:tasks.ceph:Scrubbing osd.4 2023-11-13T18:41:51.872 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 config set osd_debug_deep_scrub_sleep 0 2023-11-13T18:41:52.270 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:52.260+0000 7f55d44e3640 1 Processor -- start 2023-11-13T18:41:52.271 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:52.260+0000 7f55d44e3640 1 -- start start 2023-11-13T18:41:52.272 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:52.264+0000 7f55d44e3640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f55cc144310 0x7f55cc06bc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T18:41:52.273 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:52.264+0000 7f55d44e3640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f55cc15e810 0x7f55cc15eca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T18:41:52.273 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:52.264+0000 7f55d44e3640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f55cc0cd8e0 con 0x7f55cc1446f0 2023-11-13T18:41:52.273 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:52.264+0000 7f55d44e3640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f55cc15f710 con 0x7f55cc144310 2023-11-13T18:41:52.274 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:52.264+0000 7f55d44e3640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f55cc15f1e0 con 0x7f55cc15e810 2023-11-13T18:41:52.275 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:52.264+0000 7f55d227f640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f55cc144310 0x7f55cc06bc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T18:41:52.275 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:52.264+0000 7f55d1a7e640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f55cc1446f0 0x7f55cc0b36e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.102:48486/0 (socket says 172.21.15.102:48486) 2023-11-13T18:41:52.275 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:52.264+0000 7f55d1a7e640 1 -- 172.21.15.102:0/4216804665 learned_addr learned my addr 172.21.15.102:0/4216804665 (peer_addr_for_me v1:172.21.15.102:0/0) 2023-11-13T18:41:52.276 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:52.264+0000 7f55d2a80640 1 --2- 172.21.15.102:0/4216804665 >> v2:172.21.15.154:3300/0 conn(0x7f55cc15e810 0x7f55cc15eca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T18:41:52.276 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:52.264+0000 7f55d227f640 1 -- 172.21.15.102:0/4216804665 >> v2:172.21.15.154:3300/0 conn(0x7f55cc15e810 msgr2=0x7f55cc15eca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-13T18:41:52.277 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:52.264+0000 7f55d227f640 1 --2- 172.21.15.102:0/4216804665 >> v2:172.21.15.154:3300/0 conn(0x7f55cc15e810 0x7f55cc15eca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T18:41:52.277 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:52.264+0000 7f55d227f640 1 -- 172.21.15.102:0/4216804665 >> v1:172.21.15.154:6789/0 conn(0x7f55cc1446f0 legacy=0x7f55cc0b36e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T18:41:52.278 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:52.264+0000 7f55d227f640 1 -- 172.21.15.102:0/4216804665 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55cc0b1a30 con 0x7f55cc144310 2023-11-13T18:41:52.278 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:52.264+0000 7f55d127d640 1 -- 172.21.15.102:0/4216804665 <== mon.1 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3160248243 0 0) 0x7f55cc0cd8e0 con 0x7f55cc1446f0 2023-11-13T18:41:52.280 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:52.268+0000 7f55d227f640 1 --2- 172.21.15.102:0/4216804665 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f55cc144310 0x7f55cc06bc60 secure :-1 s=READY pgs=1959 cs=0 l=1 rev1=1 crypto rx=0x7f55cc0cbae0 tx=0x7f55bc01c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=efd4cf9139befb0e server_cookie=0 in_seq=0 out_seq=0 2023-11-13T18:41:52.281 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:52.268+0000 7f55d127d640 1 -- 172.21.15.102:0/4216804665 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55bc0a59a0 con 0x7f55cc144310 2023-11-13T18:41:52.281 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:52.268+0000 7f55d127d640 1 -- 172.21.15.102:0/4216804665 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f55bc0a5b00 con 0x7f55cc144310 2023-11-13T18:41:52.281 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:52.268+0000 7f55d127d640 1 -- 172.21.15.102:0/4216804665 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55bc0a5e90 con 0x7f55cc144310 2023-11-13T18:41:52.282 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:52.268+0000 7f55d44e3640 1 -- 172.21.15.102:0/4216804665 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f55cc144310 msgr2=0x7f55cc06bc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T18:41:52.282 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:52.268+0000 7f55d44e3640 1 --2- 172.21.15.102:0/4216804665 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f55cc144310 0x7f55cc06bc60 secure :-1 s=READY pgs=1959 cs=0 l=1 rev1=1 crypto rx=0x7f55cc0cbae0 tx=0x7f55bc01c8e0 comp rx=0 tx=0).stop 2023-11-13T18:41:52.283 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:52.268+0000 7f55d44e3640 1 -- 172.21.15.102:0/4216804665 shutdown_connections 2023-11-13T18:41:52.283 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:52.268+0000 7f55d44e3640 1 --2- 172.21.15.102:0/4216804665 >> v2:172.21.15.154:3300/0 conn(0x7f55cc15e810 0x7f55cc15eca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T18:41:52.283 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:52.268+0000 7f55d44e3640 1 --2- 172.21.15.102:0/4216804665 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f55cc144310 0x7f55cc06bc60 unknown :-1 s=CLOSED pgs=1959 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T18:41:52.284 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:52.268+0000 7f55d44e3640 1 -- 172.21.15.102:0/4216804665 >> 172.21.15.102:0/4216804665 conn(0x7f55cc0b0690 msgr2=0x7f55cc0b0aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-13T18:41:52.284 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:52.268+0000 7f55d44e3640 1 -- 172.21.15.102:0/4216804665 shutdown_connections 2023-11-13T18:41:52.284 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:52.268+0000 7f55d44e3640 1 -- 172.21.15.102:0/4216804665 wait complete. 2023-11-13T18:41:52.285 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:52.272+0000 7f55d44e3640 1 Processor -- start 2023-11-13T18:41:52.285 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:52.272+0000 7f55d44e3640 1 -- start start 2023-11-13T18:41:52.288 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:52.272+0000 7f55d44e3640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f55cc144310 0x7f55cc13f3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T18:41:52.288 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:52.272+0000 7f55d44e3640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f55cc1446f0 0x7f55cc15d8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T18:41:52.288 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:52.272+0000 7f55d44e3640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f55cc15e810 0x7f55cc1fa150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T18:41:52.289 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:52.272+0000 7f55d44e3640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55cc13e350 con 0x7f55cc144310 2023-11-13T18:41:52.289 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:52.272+0000 7f55d44e3640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55cc13e630 con 0x7f55cc1446f0 2023-11-13T18:41:52.289 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:52.272+0000 7f55d44e3640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f55cc13e910 con 0x7f55cc15e810 2023-11-13T18:41:52.290 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:52.272+0000 7f55d2a80640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f55cc15e810 0x7f55cc1fa150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T18:41:52.290 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:52.272+0000 7f55d227f640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f55cc144310 0x7f55cc13f3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T18:41:52.291 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:52.272+0000 7f55d1a7e640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f55cc1446f0 0x7f55cc15d8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T18:41:52.291 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:52.272+0000 7f55d2a80640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f55cc15e810 0x7f55cc1fa150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.102:54896/0 (socket says 172.21.15.102:54896) 2023-11-13T18:41:52.291 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:52.272+0000 7f55d2a80640 1 -- 172.21.15.102:0/3191164092 learned_addr learned my addr 172.21.15.102:0/3191164092 (peer_addr_for_me v2:172.21.15.102:0/0) 2023-11-13T18:41:52.292 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:52.272+0000 7f55d227f640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f55cc144310 0x7f55cc13f3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:50850/0 (socket says 172.21.15.102:50850) 2023-11-13T18:41:52.292 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:52.272+0000 7f55d2a80640 1 -- 172.21.15.102:0/3191164092 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f55cc1446f0 msgr2=0x7f55cc15d8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T18:41:52.292 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:52.272+0000 7f55d2a80640 1 --2- 172.21.15.102:0/3191164092 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f55cc1446f0 0x7f55cc15d8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T18:41:52.293 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:52.272+0000 7f55d2a80640 1 -- 172.21.15.102:0/3191164092 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f55cc144310 msgr2=0x7f55cc13f3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T18:41:52.293 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:52.272+0000 7f55d2a80640 1 --2- 172.21.15.102:0/3191164092 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f55cc144310 0x7f55cc13f3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T18:41:52.293 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:52.272+0000 7f55d2a80640 1 -- 172.21.15.102:0/3191164092 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55bc009a70 con 0x7f55cc15e810 2023-11-13T18:41:52.294 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:52.276+0000 7f55d1a7e640 1 --2- 172.21.15.102:0/3191164092 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f55cc1446f0 0x7f55cc15d8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-13T18:41:52.294 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:52.276+0000 7f55d2a80640 1 --2- 172.21.15.102:0/3191164092 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f55cc15e810 0x7f55cc1fa150 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f55c400e7f0 tx=0x7f55c400ecb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-13T18:41:52.294 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:52.276+0000 7f55caffd640 1 -- 172.21.15.102:0/3191164092 <== mon.2 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55c4009530 con 0x7f55cc15e810 2023-11-13T18:41:52.295 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:52.276+0000 7f55caffd640 1 -- 172.21.15.102:0/3191164092 <== mon.2 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f55c400eea0 con 0x7f55cc15e810 2023-11-13T18:41:52.295 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:52.276+0000 7f55d44e3640 1 -- 172.21.15.102:0/3191164092 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f55cc13ebf0 con 0x7f55cc15e810 2023-11-13T18:41:52.295 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:52.276+0000 7f55caffd640 1 -- 172.21.15.102:0/3191164092 <== mon.2 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55c400cb60 con 0x7f55cc15e810 2023-11-13T18:41:52.296 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:52.276+0000 7f55d44e3640 1 -- 172.21.15.102:0/3191164092 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f55cc13f930 con 0x7f55cc15e810 2023-11-13T18:41:52.296 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:52.276+0000 7f55d44e3640 1 -- 172.21.15.102:0/3191164092 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f55cc165a30 con 0x7f55cc15e810 2023-11-13T18:41:52.298 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:52.280+0000 7f55caffd640 1 -- 172.21.15.102:0/3191164092 <== mon.2 v2:172.21.15.154:3301/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f55c400ccc0 con 0x7f55cc15e810 2023-11-13T18:41:52.298 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:52.284+0000 7f55caffd640 1 --2- 172.21.15.102:0/3191164092 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f55b80664f0 0x7f55b80689b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T18:41:52.299 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:52.284+0000 7f55caffd640 1 -- 172.21.15.102:0/3191164092 <== mon.2 v2:172.21.15.154:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f55c4084620 con 0x7f55cc15e810 2023-11-13T18:41:52.299 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:52.284+0000 7f55d227f640 1 --2- 172.21.15.102:0/3191164092 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f55b80664f0 0x7f55b80689b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T18:41:52.299 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:52.284+0000 7f55caffd640 1 --2- 172.21.15.102:0/3191164092 >> [v2:172.21.15.154:6808/4028899241,v1:172.21.15.154:6809/4028899241] conn(0x7f55b806c350 0x7f55b806e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T18:41:52.300 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:52.284+0000 7f55caffd640 1 -- 172.21.15.102:0/3191164092 --> [v2:172.21.15.154:6808/4028899241,v1:172.21.15.154:6809/4028899241] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f55b806ee20 con 0x7f55b806c350 2023-11-13T18:41:52.300 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:52.284+0000 7f55caffd640 1 -- 172.21.15.102:0/3191164092 <== mon.2 v2:172.21.15.154:3301/0 6 ==== mon_get_version_reply(handle=1 version=41) v2 ==== 24+0+0 (secure 0 0 0) 0x7f55c4084990 con 0x7f55cc15e810 2023-11-13T18:41:52.300 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:52.284+0000 7f55d1a7e640 1 --2- 172.21.15.102:0/3191164092 >> [v2:172.21.15.154:6808/4028899241,v1:172.21.15.154:6809/4028899241] conn(0x7f55b806c350 0x7f55b806e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T18:41:52.301 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:52.284+0000 7f55d227f640 1 --2- 172.21.15.102:0/3191164092 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f55b80664f0 0x7f55b80689b0 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 crypto rx=0x7f55bc0af000 tx=0x7f55bc0a7070 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-13T18:41:52.301 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:52.284+0000 7f55d1a7e640 1 --2- 172.21.15.102:0/3191164092 >> [v2:172.21.15.154:6808/4028899241,v1:172.21.15.154:6809/4028899241] conn(0x7f55b806c350 0x7f55b806e770 crc :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-13T18:41:52.341 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:52.332+0000 7f55caffd640 1 -- 172.21.15.102:0/3191164092 <== osd.4 v2:172.21.15.154:6808/4028899241 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26745 (crc 0 0 0) 0x7f55b806ee20 con 0x7f55b806c350 2023-11-13T18:41:52.378 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:52.368+0000 7f55d44e3640 1 -- 172.21.15.102:0/3191164092 --> [v2:172.21.15.154:6808/4028899241,v1:172.21.15.154:6809/4028899241] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f55cc0ce0f0 con 0x7f55b806c350 2023-11-13T18:41:52.379 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:52.368+0000 7f55caffd640 1 -- 172.21.15.102:0/3191164092 <== osd.4 v2:172.21.15.154:6808/4028899241 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f55c00047f0 con 0x7f55b806c350 2023-11-13T18:41:52.380 INFO:teuthology.orchestra.run.smithi102.stdout:{ 2023-11-13T18:41:52.380 INFO:teuthology.orchestra.run.smithi102.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2023-11-13T18:41:52.381 INFO:teuthology.orchestra.run.smithi102.stdout:} 2023-11-13T18:41:52.382 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:52.372+0000 7f55d44e3640 1 -- 172.21.15.102:0/3191164092 >> [v2:172.21.15.154:6808/4028899241,v1:172.21.15.154:6809/4028899241] conn(0x7f55b806c350 msgr2=0x7f55b806e770 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T18:41:52.383 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:52.372+0000 7f55d44e3640 1 --2- 172.21.15.102:0/3191164092 >> [v2:172.21.15.154:6808/4028899241,v1:172.21.15.154:6809/4028899241] conn(0x7f55b806c350 0x7f55b806e770 crc :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T18:41:52.383 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:52.372+0000 7f55d44e3640 1 -- 172.21.15.102:0/3191164092 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f55b80664f0 msgr2=0x7f55b80689b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T18:41:52.383 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:52.372+0000 7f55d44e3640 1 --2- 172.21.15.102:0/3191164092 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f55b80664f0 0x7f55b80689b0 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 crypto rx=0x7f55bc0af000 tx=0x7f55bc0a7070 comp rx=0 tx=0).stop 2023-11-13T18:41:52.384 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:52.372+0000 7f55d44e3640 1 -- 172.21.15.102:0/3191164092 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f55cc15e810 msgr2=0x7f55cc1fa150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T18:41:52.384 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:52.372+0000 7f55d44e3640 1 --2- 172.21.15.102:0/3191164092 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f55cc15e810 0x7f55cc1fa150 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f55c400e7f0 tx=0x7f55c400ecb0 comp rx=0 tx=0).stop 2023-11-13T18:41:52.385 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:52.372+0000 7f55d2a80640 1 -- 172.21.15.102:0/3191164092 reap_dead start 2023-11-13T18:41:52.385 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:52.372+0000 7f55d44e3640 1 -- 172.21.15.102:0/3191164092 shutdown_connections 2023-11-13T18:41:52.385 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:52.372+0000 7f55d44e3640 1 -- 172.21.15.102:0/3191164092 >> 172.21.15.102:0/3191164092 conn(0x7f55cc0b0690 msgr2=0x7f55cc159d30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-13T18:41:52.386 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:52.372+0000 7f55d44e3640 1 -- 172.21.15.102:0/3191164092 shutdown_connections 2023-11-13T18:41:52.386 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:52.372+0000 7f55d44e3640 1 -- 172.21.15.102:0/3191164092 wait complete. 2023-11-13T18:41:52.427 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 4 2023-11-13T18:41:52.635 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:52.628+0000 7f9fb2817640 1 Processor -- start 2023-11-13T18:41:52.636 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:52.628+0000 7f9fb2817640 1 -- start start 2023-11-13T18:41:52.639 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:52.628+0000 7f9fb2817640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f9fac155360 0x7f9fac0ceee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T18:41:52.641 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:52.628+0000 7f9fb2817640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9fac0ae3b0 0x7f9fac0ae840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T18:41:52.641 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:52.636+0000 7f9fb1815640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f9fac155360 0x7f9fac0ceee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T18:41:52.642 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:52.636+0000 7f9fb2817640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9fac15c300 con 0x7f9fac15be50 2023-11-13T18:41:52.642 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:52.636+0000 7f9fb2817640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9fac0cf420 con 0x7f9fac155360 2023-11-13T18:41:52.642 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:52.636+0000 7f9fb2817640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9fac0aed80 con 0x7f9fac0ae3b0 2023-11-13T18:41:52.643 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:52.636+0000 7f9fb1815640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f9fac155360 0x7f9fac0ceee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:50852/0 (socket says 172.21.15.102:50852) 2023-11-13T18:41:52.643 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:52.636+0000 7f9fb1815640 1 -- 172.21.15.102:0/4115688109 learned_addr learned my addr 172.21.15.102:0/4115688109 (peer_addr_for_me v2:172.21.15.102:0/0) 2023-11-13T18:41:52.644 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:52.636+0000 7f9fb1815640 1 -- 172.21.15.102:0/4115688109 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9fac0ae3b0 msgr2=0x7f9fac0ae840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-13T18:41:52.644 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:52.636+0000 7f9fb2016640 1 --2- 172.21.15.102:0/4115688109 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9fac0ae3b0 0x7f9fac0ae840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T18:41:52.644 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:52.636+0000 7f9fb1815640 1 --2- 172.21.15.102:0/4115688109 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9fac0ae3b0 0x7f9fac0ae840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T18:41:52.645 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:52.636+0000 7f9fb1815640 1 -- 172.21.15.102:0/4115688109 >> v1:172.21.15.154:6789/0 conn(0x7f9fac15be50 legacy=0x7f9fac15c500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-13T18:41:52.645 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:52.636+0000 7f9fb1815640 1 -- 172.21.15.102:0/4115688109 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9fac0cf610 con 0x7f9fac155360 2023-11-13T18:41:52.645 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:52.636+0000 7f9fb2016640 1 --2- 172.21.15.102:0/4115688109 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9fac0ae3b0 0x7f9fac0ae840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-13T18:41:52.647 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:52.640+0000 7f9fb1815640 1 --2- 172.21.15.102:0/4115688109 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9fac155360 0x7f9fac0ceee0 secure :-1 s=READY pgs=1960 cs=0 l=1 rev1=1 crypto rx=0x7f9fa8009870 tx=0x7f9fa801c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=98195b947133ddfc server_cookie=0 in_seq=0 out_seq=0 2023-11-13T18:41:52.647 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:52.640+0000 7f9fb0813640 1 -- 172.21.15.102:0/4115688109 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fa80aa5f0 con 0x7f9fac155360 2023-11-13T18:41:52.648 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:52.640+0000 7f9fb0813640 1 -- 172.21.15.102:0/4115688109 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9fa80aa750 con 0x7f9fac155360 2023-11-13T18:41:52.648 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:52.640+0000 7f9fb0813640 1 -- 172.21.15.102:0/4115688109 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fa80aaae0 con 0x7f9fac155360 2023-11-13T18:41:52.648 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:52.640+0000 7f9fb2817640 1 -- 172.21.15.102:0/4115688109 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9fac155360 msgr2=0x7f9fac0ceee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T18:41:52.649 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:52.640+0000 7f9fb2817640 1 --2- 172.21.15.102:0/4115688109 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9fac155360 0x7f9fac0ceee0 secure :-1 s=READY pgs=1960 cs=0 l=1 rev1=1 crypto rx=0x7f9fa8009870 tx=0x7f9fa801c4d0 comp rx=0 tx=0).stop 2023-11-13T18:41:52.649 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:52.640+0000 7f9fb2817640 1 -- 172.21.15.102:0/4115688109 shutdown_connections 2023-11-13T18:41:52.650 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:52.640+0000 7f9fb2817640 1 --2- 172.21.15.102:0/4115688109 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9fac0ae3b0 0x7f9fac0ae840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T18:41:52.650 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:52.640+0000 7f9fb2817640 1 --2- 172.21.15.102:0/4115688109 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9fac155360 0x7f9fac0ceee0 unknown :-1 s=CLOSED pgs=1960 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T18:41:52.650 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:52.640+0000 7f9fb2817640 1 -- 172.21.15.102:0/4115688109 >> 172.21.15.102:0/4115688109 conn(0x7f9fac0b4020 msgr2=0x7f9fac0b46e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-13T18:41:52.651 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:52.640+0000 7f9fb2817640 1 -- 172.21.15.102:0/4115688109 shutdown_connections 2023-11-13T18:41:52.651 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:52.640+0000 7f9fb2817640 1 -- 172.21.15.102:0/4115688109 wait complete. 2023-11-13T18:41:52.652 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:52.644+0000 7f9fb2817640 1 Processor -- start 2023-11-13T18:41:52.652 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:52.644+0000 7f9fb2817640 1 -- start start 2023-11-13T18:41:52.655 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:52.644+0000 7f9fb2817640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9fac0ae3b0 0x7f9fac0ad070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T18:41:52.655 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:52.644+0000 7f9fb2817640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9fac155360 0x7f9fac1517e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T18:41:52.656 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:52.644+0000 7f9fb2817640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9fac15be50 0x7f9fac164c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T18:41:52.656 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:52.644+0000 7f9fb2817640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9fac164830 con 0x7f9fac15be50 2023-11-13T18:41:52.656 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:52.644+0000 7f9fb2817640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9fac0ad5b0 con 0x7f9fac155360 2023-11-13T18:41:52.657 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:52.644+0000 7f9fb2817640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9fac163bd0 con 0x7f9fac0ae3b0 2023-11-13T18:41:52.657 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:52.644+0000 7f9fb2016640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9fac15be50 0x7f9fac164c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T18:41:52.657 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:52.644+0000 7f9fb1815640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9fac0ae3b0 0x7f9fac0ad070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T18:41:52.658 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:52.644+0000 7f9fb1815640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9fac0ae3b0 0x7f9fac0ad070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.102:54902/0 (socket says 172.21.15.102:54902) 2023-11-13T18:41:52.658 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:52.644+0000 7f9fb1815640 1 -- 172.21.15.102:0/2193880428 learned_addr learned my addr 172.21.15.102:0/2193880428 (peer_addr_for_me v2:172.21.15.102:0/0) 2023-11-13T18:41:52.659 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:52.644+0000 7f9fb1014640 1 --2- 172.21.15.102:0/2193880428 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9fac155360 0x7f9fac1517e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T18:41:52.659 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:52.644+0000 7f9fb1815640 1 -- 172.21.15.102:0/2193880428 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9fac155360 msgr2=0x7f9fac1517e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T18:41:52.659 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:52.644+0000 7f9fb1815640 1 --2- 172.21.15.102:0/2193880428 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9fac155360 0x7f9fac1517e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T18:41:52.660 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:52.644+0000 7f9fb1815640 1 -- 172.21.15.102:0/2193880428 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9fac15be50 msgr2=0x7f9fac164c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T18:41:52.660 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:52.644+0000 7f9fb1815640 1 --2- 172.21.15.102:0/2193880428 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9fac15be50 0x7f9fac164c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T18:41:52.660 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:52.644+0000 7f9fb1815640 1 -- 172.21.15.102:0/2193880428 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9fa80094d0 con 0x7f9fac0ae3b0 2023-11-13T18:41:52.661 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:52.644+0000 7f9fb1815640 1 --2- 172.21.15.102:0/2193880428 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9fac0ae3b0 0x7f9fac0ad070 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f9fa80ac040 tx=0x7f9fa801ad10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-13T18:41:52.662 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:52.644+0000 7f9fa27fc640 1 -- 172.21.15.102:0/2193880428 <== mon.2 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fa80b1940 con 0x7f9fac0ae3b0 2023-11-13T18:41:52.663 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:52.652+0000 7f9fa27fc640 1 -- 172.21.15.102:0/2193880428 <== mon.2 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9fa80b1ae0 con 0x7f9fac0ae3b0 2023-11-13T18:41:52.663 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:52.652+0000 7f9fb2817640 1 -- 172.21.15.102:0/2193880428 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9fac163e90 con 0x7f9fac0ae3b0 2023-11-13T18:41:52.664 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:52.652+0000 7f9fa27fc640 1 -- 172.21.15.102:0/2193880428 <== mon.2 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fa80b1e90 con 0x7f9fac0ae3b0 2023-11-13T18:41:52.664 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:52.652+0000 7f9fb2817640 1 -- 172.21.15.102:0/2193880428 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9fac164450 con 0x7f9fac0ae3b0 2023-11-13T18:41:52.664 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:52.652+0000 7f9fb2817640 1 -- 172.21.15.102:0/2193880428 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9fac068520 con 0x7f9fac0ae3b0 2023-11-13T18:41:52.665 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:52.652+0000 7f9fa27fc640 1 -- 172.21.15.102:0/2193880428 <== mon.2 v2:172.21.15.154:3301/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f9fa80c6440 con 0x7f9fac0ae3b0 2023-11-13T18:41:52.665 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:52.656+0000 7f9fa27fc640 1 --2- 172.21.15.102:0/2193880428 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f9f90066470 0x7f9f90068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T18:41:52.665 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:52.656+0000 7f9fa27fc640 1 -- 172.21.15.102:0/2193880428 <== mon.2 v2:172.21.15.154:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f9fa80a7070 con 0x7f9fac0ae3b0 2023-11-13T18:41:52.666 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:52.656+0000 7f9fb1014640 1 --2- 172.21.15.102:0/2193880428 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f9f90066470 0x7f9f90068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T18:41:52.666 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:52.656+0000 7f9fa27fc640 1 -- 172.21.15.102:0/2193880428 <== mon.2 v2:172.21.15.154:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f9fa80ec200 con 0x7f9fac0ae3b0 2023-11-13T18:41:52.666 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:52.656+0000 7f9fb1014640 1 --2- 172.21.15.102:0/2193880428 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f9f90066470 0x7f9f90068930 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 crypto rx=0x7f9fac15ac10 tx=0x7f9f9c008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-13T18:41:52.817 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:52.812+0000 7f9fb2817640 1 -- 172.21.15.102:0/2193880428 --> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "4", "target": ["mon-mgr", ""]}) v1 -- 0x7f9fac155740 con 0x7f9f90066470 2023-11-13T18:41:52.818 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:52.812+0000 7f9fa27fc640 1 -- 172.21.15.102:0/2193880428 <== mgr.4103 v2:172.21.15.102:6832/1009482693 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 4 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f9f9c00bd80 con 0x7f9f90066470 2023-11-13T18:41:52.819 INFO:teuthology.orchestra.run.smithi102.stderr:instructed osd(s) 4 to deep-scrub 2023-11-13T18:41:52.820 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:52.816+0000 7f9fb2817640 1 -- 172.21.15.102:0/2193880428 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f9f90066470 msgr2=0x7f9f90068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T18:41:52.821 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:52.816+0000 7f9fb2817640 1 --2- 172.21.15.102:0/2193880428 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f9f90066470 0x7f9f90068930 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 crypto rx=0x7f9fac15ac10 tx=0x7f9f9c008040 comp rx=0 tx=0).stop 2023-11-13T18:41:52.821 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:52.816+0000 7f9fb2817640 1 -- 172.21.15.102:0/2193880428 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9fac0ae3b0 msgr2=0x7f9fac0ad070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T18:41:52.821 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:52.816+0000 7f9fb2817640 1 --2- 172.21.15.102:0/2193880428 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9fac0ae3b0 0x7f9fac0ad070 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f9fa80ac040 tx=0x7f9fa801ad10 comp rx=0 tx=0).stop 2023-11-13T18:41:52.822 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:52.816+0000 7f9fb2817640 1 -- 172.21.15.102:0/2193880428 shutdown_connections 2023-11-13T18:41:52.822 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:52.816+0000 7f9fb2817640 1 --2- 172.21.15.102:0/2193880428 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f9f90066470 0x7f9f90068930 unknown :-1 s=CLOSED pgs=764 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T18:41:52.823 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:52.816+0000 7f9fb2817640 1 --2- 172.21.15.102:0/2193880428 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9fac15be50 0x7f9fac164c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T18:41:52.823 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:52.816+0000 7f9fb2817640 1 --2- 172.21.15.102:0/2193880428 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9fac155360 0x7f9fac1517e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T18:41:52.824 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:52.816+0000 7f9fb2817640 1 --2- 172.21.15.102:0/2193880428 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9fac0ae3b0 0x7f9fac0ad070 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T18:41:52.824 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:52.816+0000 7f9fb2817640 1 -- 172.21.15.102:0/2193880428 >> 172.21.15.102:0/2193880428 conn(0x7f9fac0b4020 msgr2=0x7f9fac06dc10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-13T18:41:52.824 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:52.816+0000 7f9fb2817640 1 -- 172.21.15.102:0/2193880428 shutdown_connections 2023-11-13T18:41:52.825 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:52.816+0000 7f9fb2817640 1 -- 172.21.15.102:0/2193880428 wait complete. 2023-11-13T18:41:52.865 INFO:tasks.ceph:Scrubbing osd.5 2023-11-13T18:41:52.865 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 config set osd_debug_deep_scrub_sleep 0 2023-11-13T18:41:53.246 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:53.240+0000 7f076fc32640 1 Processor -- start 2023-11-13T18:41:53.247 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:53.240+0000 7f076fc32640 1 -- start start 2023-11-13T18:41:53.248 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:53.244+0000 7f076fc32640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f07681446f0 0x7f076806bc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T18:41:53.249 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:53.244+0000 7f076fc32640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f076815e810 0x7f076815ecc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T18:41:53.249 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:53.244+0000 7f076fc32640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f07680cd8e0 con 0x7f0768144310 2023-11-13T18:41:53.250 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:53.244+0000 7f076fc32640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f076815f710 con 0x7f07681446f0 2023-11-13T18:41:53.250 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:53.244+0000 7f076fc32640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f076815f200 con 0x7f076815e810 2023-11-13T18:41:53.250 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:53.244+0000 7f076d9ce640 1 --1- >> v1:172.21.15.102:6789/0 conn(0x7f0768144310 0x7f07680b36e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.102:6789/0 says I am v1:172.21.15.102:40676/0 (socket says 172.21.15.102:40676) 2023-11-13T18:41:53.251 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:53.244+0000 7f076d9ce640 1 -- 172.21.15.102:0/695958690 learned_addr learned my addr 172.21.15.102:0/695958690 (peer_addr_for_me v1:172.21.15.102:0/0) 2023-11-13T18:41:53.253 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:53.244+0000 7f076c9cc640 1 -- 172.21.15.102:0/695958690 <== mon.0 v1:172.21.15.102:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1321036764 0 0) 0x7f07680cd8e0 con 0x7f0768144310 2023-11-13T18:41:53.253 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:53.244+0000 7f076c9cc640 1 -- 172.21.15.102:0/695958690 --> v1:172.21.15.102:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0750003530 con 0x7f0768144310 2023-11-13T18:41:53.254 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:53.244+0000 7f076c9cc640 1 -- 172.21.15.102:0/695958690 <== mon.0 v1:172.21.15.102:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1431925518 0 0) 0x7f0750003530 con 0x7f0768144310 2023-11-13T18:41:53.254 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:53.244+0000 7f076c9cc640 1 -- 172.21.15.102:0/695958690 >> v2:172.21.15.154:3300/0 conn(0x7f076815e810 msgr2=0x7f076815ecc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-13T18:41:53.255 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:53.244+0000 7f076e1cf640 1 --2- 172.21.15.102:0/695958690 >> v2:172.21.15.154:3300/0 conn(0x7f076815e810 0x7f076815ecc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T18:41:53.255 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:53.244+0000 7f076d1cd640 1 --2- 172.21.15.102:0/695958690 >> v2:172.21.15.102:3300/0 conn(0x7f07681446f0 0x7f076806bc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T18:41:53.255 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:53.244+0000 7f076c9cc640 1 --2- 172.21.15.102:0/695958690 >> v2:172.21.15.154:3300/0 conn(0x7f076815e810 0x7f076815ecc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T18:41:53.256 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:53.244+0000 7f076c9cc640 1 -- 172.21.15.102:0/695958690 >> v2:172.21.15.102:3300/0 conn(0x7f07681446f0 msgr2=0x7f076806bc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-13T18:41:53.256 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:53.244+0000 7f076c9cc640 1 --2- 172.21.15.102:0/695958690 >> v2:172.21.15.102:3300/0 conn(0x7f07681446f0 0x7f076806bc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T18:41:53.256 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:53.244+0000 7f076c9cc640 1 -- 172.21.15.102:0/695958690 --> v1:172.21.15.102:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07680b1a30 con 0x7f0768144310 2023-11-13T18:41:53.257 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:53.244+0000 7f076c9cc640 1 -- 172.21.15.102:0/695958690 <== mon.0 v1:172.21.15.102:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 895381068 0 0) 0x7f0758001a00 con 0x7f0768144310 2023-11-13T18:41:53.257 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:53.244+0000 7f076c9cc640 1 -- 172.21.15.102:0/695958690 >> v1:172.21.15.102:6789/0 conn(0x7f0768144310 legacy=0x7f07680b36e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T18:41:53.258 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:53.244+0000 7f076c9cc640 1 --2- 172.21.15.102:0/695958690 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0750003980 0x7f0750003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T18:41:53.258 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:53.244+0000 7f076c9cc640 1 --2- 172.21.15.102:0/695958690 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f07500047d0 0x7f0750004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T18:41:53.258 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:53.244+0000 7f076c9cc640 1 --2- 172.21.15.102:0/695958690 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f07500052b0 0x7f075000b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T18:41:53.259 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:53.244+0000 7f076c9cc640 1 -- 172.21.15.102:0/695958690 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f076815f710 con 0x7f07500047d0 2023-11-13T18:41:53.259 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:53.244+0000 7f076c9cc640 1 -- 172.21.15.102:0/695958690 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f076815f200 con 0x7f07500052b0 2023-11-13T18:41:53.259 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:53.244+0000 7f076c9cc640 1 -- 172.21.15.102:0/695958690 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f075000c230 con 0x7f0750003980 2023-11-13T18:41:53.260 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:53.244+0000 7f076d1cd640 1 --2- 172.21.15.102:0/695958690 >> v2:172.21.15.102:3300/0 conn(0x7f07681446f0 0x7f076806bc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-13T18:41:53.260 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:53.244+0000 7f076d1cd640 1 --2- 172.21.15.102:0/695958690 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f07500047d0 0x7f0750004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T18:41:53.261 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:53.244+0000 7f076e1cf640 1 --2- 172.21.15.102:0/695958690 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f07500052b0 0x7f075000b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T18:41:53.261 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:53.248+0000 7f076d9ce640 1 --2- 172.21.15.102:0/695958690 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0750003980 0x7f0750003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T18:41:53.261 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:53.248+0000 7f076e1cf640 1 -- 172.21.15.102:0/695958690 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0750003980 msgr2=0x7f0750003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-13T18:41:53.262 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:53.248+0000 7f076e1cf640 1 --2- 172.21.15.102:0/695958690 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0750003980 0x7f0750003da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T18:41:53.262 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:53.248+0000 7f076e1cf640 1 -- 172.21.15.102:0/695958690 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f07500047d0 msgr2=0x7f0750004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-13T18:41:53.262 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:53.248+0000 7f076e1cf640 1 --2- 172.21.15.102:0/695958690 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f07500047d0 0x7f0750004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T18:41:53.263 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:53.248+0000 7f076e1cf640 1 -- 172.21.15.102:0/695958690 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0750003530 con 0x7f07500052b0 2023-11-13T18:41:53.264 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:53.248+0000 7f076e1cf640 1 -- 172.21.15.102:0/695958690 reap_dead start 2023-11-13T18:41:53.265 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:53.248+0000 7f076e1cf640 1 --2- 172.21.15.102:0/695958690 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f07500052b0 0x7f075000b990 secure :-1 s=READY pgs=924 cs=0 l=1 rev1=1 crypto rx=0x7f076000a990 tx=0x7f076001c5b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=93cbcac281ac86de server_cookie=0 in_seq=0 out_seq=0 2023-11-13T18:41:53.265 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:53.252+0000 7f076c9cc640 1 -- 172.21.15.102:0/695958690 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07600ae070 con 0x7f07500052b0 2023-11-13T18:41:53.265 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:53.252+0000 7f076c9cc640 1 -- 172.21.15.102:0/695958690 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f07600aa460 con 0x7f07500052b0 2023-11-13T18:41:53.266 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:53.252+0000 7f076c9cc640 1 -- 172.21.15.102:0/695958690 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07600aa7d0 con 0x7f07500052b0 2023-11-13T18:41:53.266 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:53.252+0000 7f076fc32640 1 -- 172.21.15.102:0/695958690 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f07500052b0 msgr2=0x7f075000b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T18:41:53.267 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:53.252+0000 7f076fc32640 1 --2- 172.21.15.102:0/695958690 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f07500052b0 0x7f075000b990 secure :-1 s=READY pgs=924 cs=0 l=1 rev1=1 crypto rx=0x7f076000a990 tx=0x7f076001c5b0 comp rx=0 tx=0).stop 2023-11-13T18:41:53.267 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:53.252+0000 7f076fc32640 1 -- 172.21.15.102:0/695958690 shutdown_connections 2023-11-13T18:41:53.267 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:53.252+0000 7f076fc32640 1 --2- 172.21.15.102:0/695958690 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f07500052b0 0x7f075000b990 unknown :-1 s=CLOSED pgs=924 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T18:41:53.268 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:53.252+0000 7f076fc32640 1 -- 172.21.15.102:0/695958690 >> 172.21.15.102:0/695958690 conn(0x7f07680b0690 msgr2=0x7f07680b0aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-13T18:41:53.268 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:53.252+0000 7f076fc32640 1 -- 172.21.15.102:0/695958690 shutdown_connections 2023-11-13T18:41:53.268 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:53.252+0000 7f076fc32640 1 -- 172.21.15.102:0/695958690 wait complete. 2023-11-13T18:41:53.269 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:53.260+0000 7f076fc32640 1 Processor -- start 2023-11-13T18:41:53.270 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:53.260+0000 7f076fc32640 1 -- start start 2023-11-13T18:41:53.271 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:53.264+0000 7f076fc32640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f07500052b0 0x7f07681f1ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T18:41:53.272 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:53.264+0000 7f076fc32640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f07681eeca0 0x7f076813e970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T18:41:53.272 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:53.264+0000 7f076fc32640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f07681ef120 0x7f076813eeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T18:41:53.272 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:53.264+0000 7f076fc32640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07681ebfa0 con 0x7f07500052b0 2023-11-13T18:41:53.273 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:53.264+0000 7f076fc32640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07681f1ff0 con 0x7f07681ef120 2023-11-13T18:41:53.273 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:53.264+0000 7f076fc32640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f07681f2250 con 0x7f07681eeca0 2023-11-13T18:41:53.275 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:53.268+0000 7f076d9ce640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f07500052b0 0x7f07681f1ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T18:41:53.275 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:53.268+0000 7f076d9ce640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f07500052b0 0x7f07681f1ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:50886/0 (socket says 172.21.15.102:50886) 2023-11-13T18:41:53.276 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:53.268+0000 7f076d9ce640 1 -- 172.21.15.102:0/3084383367 learned_addr learned my addr 172.21.15.102:0/3084383367 (peer_addr_for_me v2:172.21.15.102:0/0) 2023-11-13T18:41:53.276 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:53.268+0000 7f076d1cd640 1 --2- 172.21.15.102:0/3084383367 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f07681eeca0 0x7f076813e970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T18:41:53.276 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:53.268+0000 7f076e1cf640 1 --2- 172.21.15.102:0/3084383367 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f07681ef120 0x7f076813eeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T18:41:53.277 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:53.268+0000 7f076d9ce640 1 -- 172.21.15.102:0/3084383367 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f07681eeca0 msgr2=0x7f076813e970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T18:41:53.277 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:53.268+0000 7f076d9ce640 1 --2- 172.21.15.102:0/3084383367 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f07681eeca0 0x7f076813e970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T18:41:53.277 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:53.268+0000 7f076d9ce640 1 -- 172.21.15.102:0/3084383367 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f07681ef120 msgr2=0x7f076813eeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T18:41:53.278 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:53.268+0000 7f076d9ce640 1 --2- 172.21.15.102:0/3084383367 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f07681ef120 0x7f076813eeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T18:41:53.278 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:53.268+0000 7f076d9ce640 1 -- 172.21.15.102:0/3084383367 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07681f2530 con 0x7f07500052b0 2023-11-13T18:41:53.279 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:53.268+0000 7f076d9ce640 1 --2- 172.21.15.102:0/3084383367 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f07500052b0 0x7f07681f1ab0 secure :-1 s=READY pgs=1962 cs=0 l=1 rev1=1 crypto rx=0x7f0758005ec0 tx=0x7f0758007420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-13T18:41:53.279 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:53.268+0000 7f07667fc640 1 -- 172.21.15.102:0/3084383367 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0758016610 con 0x7f07500052b0 2023-11-13T18:41:53.279 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:53.268+0000 7f07667fc640 1 -- 172.21.15.102:0/3084383367 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0758016790 con 0x7f07500052b0 2023-11-13T18:41:53.280 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:53.268+0000 7f076fc32640 1 -- 172.21.15.102:0/3084383367 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f07681f2810 con 0x7f07500052b0 2023-11-13T18:41:53.280 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:53.268+0000 7f07667fc640 1 -- 172.21.15.102:0/3084383367 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0758016b40 con 0x7f07500052b0 2023-11-13T18:41:53.280 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:53.268+0000 7f076fc32640 1 -- 172.21.15.102:0/3084383367 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f07681ee470 con 0x7f07500052b0 2023-11-13T18:41:53.281 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:53.272+0000 7f076fc32640 1 -- 172.21.15.102:0/3084383367 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f07680ce0f0 con 0x7f07500052b0 2023-11-13T18:41:53.282 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:53.276+0000 7f07667fc640 1 -- 172.21.15.102:0/3084383367 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f0758016ca0 con 0x7f07500052b0 2023-11-13T18:41:53.284 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:53.280+0000 7f07667fc640 1 --2- 172.21.15.102:0/3084383367 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f07540664a0 0x7f0754068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T18:41:53.284 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:53.280+0000 7f07667fc640 1 -- 172.21.15.102:0/3084383367 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f07580877f0 con 0x7f07500052b0 2023-11-13T18:41:53.285 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:53.280+0000 7f076d1cd640 1 --2- 172.21.15.102:0/3084383367 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f07540664a0 0x7f0754068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T18:41:53.286 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:53.280+0000 7f07667fc640 1 --2- 172.21.15.102:0/3084383367 >> [v2:172.21.15.154:6800/3562396827,v1:172.21.15.154:6801/3562396827] conn(0x7f075406c300 0x7f075406e720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T18:41:53.286 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:53.280+0000 7f07667fc640 1 -- 172.21.15.102:0/3084383367 --> [v2:172.21.15.154:6800/3562396827,v1:172.21.15.154:6801/3562396827] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f075406edd0 con 0x7f075406c300 2023-11-13T18:41:53.287 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:53.280+0000 7f07667fc640 1 -- 172.21.15.102:0/3084383367 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_get_version_reply(handle=1 version=41) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0758089d50 con 0x7f07500052b0 2023-11-13T18:41:53.287 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:53.280+0000 7f076e1cf640 1 --2- 172.21.15.102:0/3084383367 >> [v2:172.21.15.154:6800/3562396827,v1:172.21.15.154:6801/3562396827] conn(0x7f075406c300 0x7f075406e720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T18:41:53.287 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:53.280+0000 7f076d1cd640 1 --2- 172.21.15.102:0/3084383367 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f07540664a0 0x7f0754068960 secure :-1 s=READY pgs=765 cs=0 l=1 rev1=1 crypto rx=0x7f076815e770 tx=0x7f075c008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-13T18:41:53.288 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:53.280+0000 7f076e1cf640 1 --2- 172.21.15.102:0/3084383367 >> [v2:172.21.15.154:6800/3562396827,v1:172.21.15.154:6801/3562396827] conn(0x7f075406c300 0x7f075406e720 crc :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-13T18:41:53.288 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:53.284+0000 7f07667fc640 1 -- 172.21.15.102:0/3084383367 <== osd.5 v2:172.21.15.154:6800/3562396827 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26745 (crc 0 0 0) 0x7f075406edd0 con 0x7f075406c300 2023-11-13T18:41:53.326 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:53.320+0000 7f076fc32640 1 -- 172.21.15.102:0/3084383367 --> [v2:172.21.15.154:6800/3562396827,v1:172.21.15.154:6801/3562396827] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f07680b1ca0 con 0x7f075406c300 2023-11-13T18:41:53.327 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:53.320+0000 7f07667fc640 1 -- 172.21.15.102:0/3084383367 <== osd.5 v2:172.21.15.154:6800/3562396827 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f07600aa750 con 0x7f075406c300 2023-11-13T18:41:53.328 INFO:teuthology.orchestra.run.smithi102.stdout:{ 2023-11-13T18:41:53.328 INFO:teuthology.orchestra.run.smithi102.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2023-11-13T18:41:53.329 INFO:teuthology.orchestra.run.smithi102.stdout:} 2023-11-13T18:41:53.330 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:53.324+0000 7f076fc32640 1 -- 172.21.15.102:0/3084383367 >> [v2:172.21.15.154:6800/3562396827,v1:172.21.15.154:6801/3562396827] conn(0x7f075406c300 msgr2=0x7f075406e720 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T18:41:53.330 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:53.324+0000 7f076fc32640 1 --2- 172.21.15.102:0/3084383367 >> [v2:172.21.15.154:6800/3562396827,v1:172.21.15.154:6801/3562396827] conn(0x7f075406c300 0x7f075406e720 crc :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T18:41:53.331 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:53.324+0000 7f076fc32640 1 -- 172.21.15.102:0/3084383367 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f07540664a0 msgr2=0x7f0754068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T18:41:53.331 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:53.324+0000 7f076fc32640 1 --2- 172.21.15.102:0/3084383367 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f07540664a0 0x7f0754068960 secure :-1 s=READY pgs=765 cs=0 l=1 rev1=1 crypto rx=0x7f076815e770 tx=0x7f075c008040 comp rx=0 tx=0).stop 2023-11-13T18:41:53.331 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:53.324+0000 7f076fc32640 1 -- 172.21.15.102:0/3084383367 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f07500052b0 msgr2=0x7f07681f1ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T18:41:53.332 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:53.324+0000 7f076fc32640 1 --2- 172.21.15.102:0/3084383367 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f07500052b0 0x7f07681f1ab0 secure :-1 s=READY pgs=1962 cs=0 l=1 rev1=1 crypto rx=0x7f0758005ec0 tx=0x7f0758007420 comp rx=0 tx=0).stop 2023-11-13T18:41:53.332 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:53.324+0000 7f076e1cf640 1 -- 172.21.15.102:0/3084383367 reap_dead start 2023-11-13T18:41:53.333 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:53.324+0000 7f076fc32640 1 -- 172.21.15.102:0/3084383367 shutdown_connections 2023-11-13T18:41:53.333 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:53.324+0000 7f076fc32640 1 -- 172.21.15.102:0/3084383367 >> 172.21.15.102:0/3084383367 conn(0x7f07680b0690 msgr2=0x7f076806bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-13T18:41:53.333 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:53.324+0000 7f076fc32640 1 -- 172.21.15.102:0/3084383367 shutdown_connections 2023-11-13T18:41:53.334 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:53.324+0000 7f076fc32640 1 -- 172.21.15.102:0/3084383367 wait complete. 2023-11-13T18:41:53.374 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 5 2023-11-13T18:41:53.582 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:53.576+0000 7efd5e976640 1 Processor -- start 2023-11-13T18:41:53.583 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:53.576+0000 7efd5e976640 1 -- start start 2023-11-13T18:41:53.587 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:53.580+0000 7efd5e976640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7efd5815d060 0x7efd580d08c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T18:41:53.587 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:53.580+0000 7efd5e976640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7efd580d3810 0x7efd580d10a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T18:41:53.587 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:53.580+0000 7efd5e976640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7efd580d15e0 0x7efd580cf700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T18:41:53.588 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:53.580+0000 7efd5e976640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efd580d1a70 con 0x7efd580d15e0 2023-11-13T18:41:53.588 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:53.580+0000 7efd5e976640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efd580cebe0 con 0x7efd5815d060 2023-11-13T18:41:53.588 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:53.580+0000 7efd5e976640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efd580b27f0 con 0x7efd580d3810 2023-11-13T18:41:53.589 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:53.580+0000 7efd5d974640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7efd5815d060 0x7efd580d08c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T18:41:53.589 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:53.580+0000 7efd5e175640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7efd580d15e0 0x7efd580cf700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T18:41:53.589 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:53.580+0000 7efd5e175640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7efd580d15e0 0x7efd580cf700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:50898/0 (socket says 172.21.15.102:50898) 2023-11-13T18:41:53.590 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:53.580+0000 7efd5e175640 1 -- 172.21.15.102:0/677182195 learned_addr learned my addr 172.21.15.102:0/677182195 (peer_addr_for_me v2:172.21.15.102:0/0) 2023-11-13T18:41:53.590 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:53.580+0000 7efd5d173640 1 --2- 172.21.15.102:0/677182195 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7efd580d3810 0x7efd580d10a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T18:41:53.591 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:53.580+0000 7efd5e175640 1 -- 172.21.15.102:0/677182195 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7efd580d3810 msgr2=0x7efd580d10a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-13T18:41:53.591 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:53.580+0000 7efd5e175640 1 --2- 172.21.15.102:0/677182195 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7efd580d3810 0x7efd580d10a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T18:41:53.592 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:53.580+0000 7efd5e175640 1 -- 172.21.15.102:0/677182195 >> v2:172.21.15.154:3300/0 conn(0x7efd5815d060 msgr2=0x7efd580d08c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-13T18:41:53.592 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:53.580+0000 7efd5e175640 1 --2- 172.21.15.102:0/677182195 >> v2:172.21.15.154:3300/0 conn(0x7efd5815d060 0x7efd580d08c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T18:41:53.592 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:53.580+0000 7efd5e175640 1 -- 172.21.15.102:0/677182195 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd580ce340 con 0x7efd580d15e0 2023-11-13T18:41:53.593 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:53.584+0000 7efd5e175640 1 --2- 172.21.15.102:0/677182195 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7efd580d15e0 0x7efd580cf700 secure :-1 s=READY pgs=1963 cs=0 l=1 rev1=1 crypto rx=0x7efd5808d200 tx=0x7efd5001c710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dcbcde02f43728c7 server_cookie=0 in_seq=0 out_seq=0 2023-11-13T18:41:53.593 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:53.584+0000 7efd5c972640 1 -- 172.21.15.102:0/677182195 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd500a5590 con 0x7efd580d15e0 2023-11-13T18:41:53.593 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:53.584+0000 7efd5c972640 1 -- 172.21.15.102:0/677182195 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd500a56f0 con 0x7efd580d15e0 2023-11-13T18:41:53.594 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:53.584+0000 7efd5c972640 1 -- 172.21.15.102:0/677182195 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd500a5a80 con 0x7efd580d15e0 2023-11-13T18:41:53.596 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:53.588+0000 7efd5e976640 1 -- 172.21.15.102:0/677182195 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7efd580d15e0 msgr2=0x7efd580cf700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T18:41:53.597 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:53.588+0000 7efd5e976640 1 --2- 172.21.15.102:0/677182195 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7efd580d15e0 0x7efd580cf700 secure :-1 s=READY pgs=1963 cs=0 l=1 rev1=1 crypto rx=0x7efd5808d200 tx=0x7efd5001c710 comp rx=0 tx=0).stop 2023-11-13T18:41:53.597 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:53.588+0000 7efd5e976640 1 -- 172.21.15.102:0/677182195 shutdown_connections 2023-11-13T18:41:53.597 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:53.588+0000 7efd5e976640 1 --2- 172.21.15.102:0/677182195 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7efd580d15e0 0x7efd580cf700 unknown :-1 s=CLOSED pgs=1963 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T18:41:53.598 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:53.588+0000 7efd5e976640 1 --2- 172.21.15.102:0/677182195 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7efd580d3810 0x7efd580d10a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T18:41:53.598 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:53.588+0000 7efd5e976640 1 --2- 172.21.15.102:0/677182195 >> v2:172.21.15.154:3300/0 conn(0x7efd5815d060 0x7efd580d08c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T18:41:53.598 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:53.588+0000 7efd5e976640 1 -- 172.21.15.102:0/677182195 >> 172.21.15.102:0/677182195 conn(0x7efd580d2cf0 msgr2=0x7efd580d3100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-13T18:41:53.599 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:53.588+0000 7efd5e976640 1 -- 172.21.15.102:0/677182195 shutdown_connections 2023-11-13T18:41:53.599 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:53.588+0000 7efd5e976640 1 -- 172.21.15.102:0/677182195 wait complete. 2023-11-13T18:41:53.599 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:53.588+0000 7efd5e976640 1 Processor -- start 2023-11-13T18:41:53.600 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:53.588+0000 7efd5e976640 1 -- start start 2023-11-13T18:41:53.600 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:53.588+0000 7efd5e976640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efd580d15e0 0x7efd58154290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T18:41:53.600 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:53.588+0000 7efd5e976640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7efd580d3810 0x7efd580c58f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T18:41:53.601 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:53.588+0000 7efd5e976640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7efd5815d060 0x7efd580c5e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T18:41:53.601 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:53.588+0000 7efd5e976640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd580c8730 con 0x7efd580d3810 2023-11-13T18:41:53.601 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:53.588+0000 7efd5e976640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd581547d0 con 0x7efd580d15e0 2023-11-13T18:41:53.601 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:53.588+0000 7efd5e976640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efd580c7b20 con 0x7efd5815d060 2023-11-13T18:41:53.602 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:53.592+0000 7efd5d974640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efd580d15e0 0x7efd58154290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T18:41:53.602 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:53.592+0000 7efd5e175640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7efd5815d060 0x7efd580c5e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T18:41:53.602 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:53.592+0000 7efd5e175640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7efd5815d060 0x7efd580c5e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.102:54936/0 (socket says 172.21.15.102:54936) 2023-11-13T18:41:53.603 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:53.592+0000 7efd5e175640 1 -- 172.21.15.102:0/2994492572 learned_addr learned my addr 172.21.15.102:0/2994492572 (peer_addr_for_me v2:172.21.15.102:0/0) 2023-11-13T18:41:53.603 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:53.592+0000 7efd5d173640 1 --2- 172.21.15.102:0/2994492572 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7efd580d3810 0x7efd580c58f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T18:41:53.603 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:53.592+0000 7efd5e175640 1 -- 172.21.15.102:0/2994492572 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efd580d15e0 msgr2=0x7efd58154290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T18:41:53.604 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:53.592+0000 7efd5e175640 1 --2- 172.21.15.102:0/2994492572 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efd580d15e0 0x7efd58154290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T18:41:53.604 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:53.592+0000 7efd5e175640 1 -- 172.21.15.102:0/2994492572 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7efd580d3810 msgr2=0x7efd580c58f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T18:41:53.604 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:53.592+0000 7efd5e175640 1 --2- 172.21.15.102:0/2994492572 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7efd580d3810 0x7efd580c58f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T18:41:53.605 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:53.592+0000 7efd5e175640 1 -- 172.21.15.102:0/2994492572 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd50009b30 con 0x7efd5815d060 2023-11-13T18:41:53.605 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:53.592+0000 7efd5d173640 1 --2- 172.21.15.102:0/2994492572 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7efd580d3810 0x7efd580c58f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-13T18:41:53.605 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:53.592+0000 7efd5e175640 1 --2- 172.21.15.102:0/2994492572 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7efd5815d060 0x7efd580c5e30 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7efd500af040 tx=0x7efd500194b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-13T18:41:53.607 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:53.592+0000 7efd4e7fc640 1 -- 172.21.15.102:0/2994492572 <== mon.2 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd500b8670 con 0x7efd5815d060 2023-11-13T18:41:53.607 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:53.592+0000 7efd5e976640 1 -- 172.21.15.102:0/2994492572 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efd580c7e00 con 0x7efd5815d060 2023-11-13T18:41:53.607 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:53.592+0000 7efd4e7fc640 1 -- 172.21.15.102:0/2994492572 <== mon.2 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd500b8810 con 0x7efd5815d060 2023-11-13T18:41:53.608 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:53.592+0000 7efd4e7fc640 1 -- 172.21.15.102:0/2994492572 <== mon.2 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd500b8bc0 con 0x7efd5815d060 2023-11-13T18:41:53.608 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:53.592+0000 7efd5e976640 1 -- 172.21.15.102:0/2994492572 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efd580c83c0 con 0x7efd5815d060 2023-11-13T18:41:53.608 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:53.592+0000 7efd5e976640 1 -- 172.21.15.102:0/2994492572 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efd580c88e0 con 0x7efd5815d060 2023-11-13T18:41:53.609 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:53.596+0000 7efd4e7fc640 1 -- 172.21.15.102:0/2994492572 <== mon.2 v2:172.21.15.154:3301/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7efd500b8d20 con 0x7efd5815d060 2023-11-13T18:41:53.609 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:53.596+0000 7efd4e7fc640 1 --2- 172.21.15.102:0/2994492572 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7efd3c066470 0x7efd3c068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T18:41:53.609 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:53.596+0000 7efd4e7fc640 1 -- 172.21.15.102:0/2994492572 <== mon.2 v2:172.21.15.154:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4943+0+0 (secure 0 0 0) 0x7efd5011ede0 con 0x7efd5815d060 2023-11-13T18:41:53.610 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:53.596+0000 7efd5d974640 1 --2- 172.21.15.102:0/2994492572 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7efd3c066470 0x7efd3c068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T18:41:53.610 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:53.596+0000 7efd5d974640 1 --2- 172.21.15.102:0/2994492572 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7efd3c066470 0x7efd3c068930 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 crypto rx=0x7efd54009ac0 tx=0x7efd54009190 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-13T18:41:53.610 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:53.600+0000 7efd4e7fc640 1 -- 172.21.15.102:0/2994492572 <== mon.2 v2:172.21.15.154:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7efd580c88e0 con 0x7efd5815d060 2023-11-13T18:41:53.760 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:53.756+0000 7efd5e976640 1 -- 172.21.15.102:0/2994492572 --> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "5", "target": ["mon-mgr", ""]}) v1 -- 0x7efd580b1ff0 con 0x7efd3c066470 2023-11-13T18:41:53.761 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:53.756+0000 7efd4e7fc640 1 -- 172.21.15.102:0/2994492572 <== mgr.4103 v2:172.21.15.102:6832/1009482693 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 5 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7efd580b1ff0 con 0x7efd3c066470 2023-11-13T18:41:53.762 INFO:teuthology.orchestra.run.smithi102.stderr:instructed osd(s) 5 to deep-scrub 2023-11-13T18:41:53.763 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:53.756+0000 7efd5e976640 1 -- 172.21.15.102:0/2994492572 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7efd3c066470 msgr2=0x7efd3c068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T18:41:53.763 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:53.756+0000 7efd5e976640 1 --2- 172.21.15.102:0/2994492572 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7efd3c066470 0x7efd3c068930 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 crypto rx=0x7efd54009ac0 tx=0x7efd54009190 comp rx=0 tx=0).stop 2023-11-13T18:41:53.764 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:53.756+0000 7efd5e976640 1 -- 172.21.15.102:0/2994492572 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7efd5815d060 msgr2=0x7efd580c5e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T18:41:53.764 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:53.756+0000 7efd5e976640 1 --2- 172.21.15.102:0/2994492572 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7efd5815d060 0x7efd580c5e30 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7efd500af040 tx=0x7efd500194b0 comp rx=0 tx=0).stop 2023-11-13T18:41:53.765 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:53.756+0000 7efd5e976640 1 -- 172.21.15.102:0/2994492572 shutdown_connections 2023-11-13T18:41:53.765 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:53.756+0000 7efd5e976640 1 --2- 172.21.15.102:0/2994492572 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7efd5815d060 0x7efd580c5e30 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T18:41:53.765 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:53.756+0000 7efd5e976640 1 --2- 172.21.15.102:0/2994492572 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7efd3c066470 0x7efd3c068930 unknown :-1 s=CLOSED pgs=766 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T18:41:53.766 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:53.756+0000 7efd5e976640 1 --2- 172.21.15.102:0/2994492572 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7efd580d3810 0x7efd580c58f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T18:41:53.766 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:53.756+0000 7efd5e976640 1 --2- 172.21.15.102:0/2994492572 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efd580d15e0 0x7efd58154290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T18:41:53.767 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:53.756+0000 7efd5e976640 1 -- 172.21.15.102:0/2994492572 >> 172.21.15.102:0/2994492572 conn(0x7efd580d2cf0 msgr2=0x7efd580d30d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-13T18:41:53.767 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:53.756+0000 7efd5e976640 1 -- 172.21.15.102:0/2994492572 shutdown_connections 2023-11-13T18:41:53.767 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:53.756+0000 7efd5e976640 1 -- 172.21.15.102:0/2994492572 wait complete. 2023-11-13T18:41:53.806 INFO:tasks.ceph:Scrubbing osd.6 2023-11-13T18:41:53.806 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 config set osd_debug_deep_scrub_sleep 0 2023-11-13T18:41:54.205 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:54.200+0000 7f844f5f8640 1 Processor -- start 2023-11-13T18:41:54.206 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:54.200+0000 7f844f5f8640 1 -- start start 2023-11-13T18:41:54.210 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:54.204+0000 7f844f5f8640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f844815d1c0 0x7f84480ce3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T18:41:54.210 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:54.204+0000 7f844f5f8640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f84480d0c10 0x7f84480d13a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T18:41:54.211 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:54.204+0000 7f844f5f8640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f84480ced10 con 0x7f84480d18e0 2023-11-13T18:41:54.211 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:54.204+0000 7f844f5f8640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f84480d1d70 con 0x7f84480d0c10 2023-11-13T18:41:54.211 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:54.204+0000 7f844f5f8640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f844815d5a0 con 0x7f844815d1c0 2023-11-13T18:41:54.212 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:54.204+0000 7f844d394640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f844815d1c0 0x7f84480ce3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T18:41:54.213 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:54.204+0000 7f844db95640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f84480d18e0 0x7f84480b3990 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.102:48502/0 (socket says 172.21.15.102:48502) 2023-11-13T18:41:54.213 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:54.204+0000 7f844db95640 1 -- 172.21.15.102:0/581279677 learned_addr learned my addr 172.21.15.102:0/581279677 (peer_addr_for_me v1:172.21.15.102:0/0) 2023-11-13T18:41:54.214 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:54.204+0000 7f844cb93640 1 --2- 172.21.15.102:0/581279677 >> v2:172.21.15.102:3300/0 conn(0x7f84480d0c10 0x7f84480d13a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T18:41:54.214 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:54.204+0000 7f844d394640 1 -- 172.21.15.102:0/581279677 >> v2:172.21.15.102:3300/0 conn(0x7f84480d0c10 msgr2=0x7f84480d13a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-13T18:41:54.214 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:54.204+0000 7f844d394640 1 --2- 172.21.15.102:0/581279677 >> v2:172.21.15.102:3300/0 conn(0x7f84480d0c10 0x7f84480d13a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T18:41:54.215 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:54.204+0000 7f844d394640 1 -- 172.21.15.102:0/581279677 >> v1:172.21.15.154:6789/0 conn(0x7f84480d18e0 legacy=0x7f84480b3990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T18:41:54.215 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:54.204+0000 7f843ffff640 1 -- 172.21.15.102:0/581279677 <== mon.1 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4266141478 0 0) 0x7f84480ced10 con 0x7f84480d18e0 2023-11-13T18:41:54.215 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:54.204+0000 7f844d394640 1 -- 172.21.15.102:0/581279677 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84480cea30 con 0x7f844815d1c0 2023-11-13T18:41:54.216 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:54.204+0000 7f844cb93640 1 --2- 172.21.15.102:0/581279677 >> v2:172.21.15.102:3300/0 conn(0x7f84480d0c10 0x7f84480d13a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-13T18:41:54.225 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:54.220+0000 7f844d394640 1 --2- 172.21.15.102:0/581279677 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f844815d1c0 0x7f84480ce3e0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f84440097c0 tx=0x7f844401c450 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6e1009ae05988f70 server_cookie=0 in_seq=0 out_seq=0 2023-11-13T18:41:54.226 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:54.220+0000 7f843ffff640 1 -- 172.21.15.102:0/581279677 <== mon.2 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84440ab650 con 0x7f844815d1c0 2023-11-13T18:41:54.226 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:54.220+0000 7f843ffff640 1 -- 172.21.15.102:0/581279677 <== mon.2 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f84440ab7b0 con 0x7f844815d1c0 2023-11-13T18:41:54.227 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:54.220+0000 7f843ffff640 1 -- 172.21.15.102:0/581279677 <== mon.2 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84440abb40 con 0x7f844815d1c0 2023-11-13T18:41:54.227 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:54.220+0000 7f844f5f8640 1 -- 172.21.15.102:0/581279677 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f844815d1c0 msgr2=0x7f84480ce3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T18:41:54.228 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:54.220+0000 7f844f5f8640 1 --2- 172.21.15.102:0/581279677 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f844815d1c0 0x7f84480ce3e0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f84440097c0 tx=0x7f844401c450 comp rx=0 tx=0).stop 2023-11-13T18:41:54.228 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:54.224+0000 7f844f5f8640 1 -- 172.21.15.102:0/581279677 shutdown_connections 2023-11-13T18:41:54.228 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:54.224+0000 7f844f5f8640 1 --2- 172.21.15.102:0/581279677 >> v2:172.21.15.102:3300/0 conn(0x7f84480d0c10 0x7f84480d13a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T18:41:54.229 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:54.224+0000 7f844f5f8640 1 --2- 172.21.15.102:0/581279677 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f844815d1c0 0x7f84480ce3e0 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T18:41:54.229 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:54.224+0000 7f844f5f8640 1 -- 172.21.15.102:0/581279677 >> 172.21.15.102:0/581279677 conn(0x7f84480d2dc0 msgr2=0x7f84480d31d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-13T18:41:54.230 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:54.224+0000 7f844f5f8640 1 -- 172.21.15.102:0/581279677 shutdown_connections 2023-11-13T18:41:54.230 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:54.224+0000 7f844f5f8640 1 -- 172.21.15.102:0/581279677 wait complete. 2023-11-13T18:41:54.233 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:54.228+0000 7f844f5f8640 1 Processor -- start 2023-11-13T18:41:54.234 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:54.228+0000 7f844f5f8640 1 -- start start 2023-11-13T18:41:54.237 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:54.232+0000 7f844f5f8640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f84480d0c10 0x7f844814b260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T18:41:54.237 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:54.232+0000 7f844f5f8640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f84480d18e0 0x7f84480cc180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T18:41:54.238 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:54.232+0000 7f844f5f8640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f844815d1c0 0x7f8448159000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T18:41:54.238 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:54.232+0000 7f844f5f8640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f844814fa50 con 0x7f84480d0c10 2023-11-13T18:41:54.239 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:54.232+0000 7f844f5f8640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f844814f120 con 0x7f84480d18e0 2023-11-13T18:41:54.239 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:54.232+0000 7f844f5f8640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f844814f400 con 0x7f844815d1c0 2023-11-13T18:41:54.239 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:54.232+0000 7f844cb93640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f84480d18e0 0x7f84480cc180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T18:41:54.240 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:54.232+0000 7f844cb93640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f84480d18e0 0x7f84480cc180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.102:47268/0 (socket says 172.21.15.102:47268) 2023-11-13T18:41:54.240 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:54.232+0000 7f844cb93640 1 -- 172.21.15.102:0/2295566879 learned_addr learned my addr 172.21.15.102:0/2295566879 (peer_addr_for_me v2:172.21.15.102:0/0) 2023-11-13T18:41:54.241 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:54.232+0000 7f844d394640 1 --2- 172.21.15.102:0/2295566879 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f84480d0c10 0x7f844814b260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T18:41:54.241 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:54.232+0000 7f844db95640 1 --2- 172.21.15.102:0/2295566879 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f844815d1c0 0x7f8448159000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T18:41:54.241 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:54.232+0000 7f844cb93640 1 -- 172.21.15.102:0/2295566879 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f844815d1c0 msgr2=0x7f8448159000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T18:41:54.242 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:54.232+0000 7f844cb93640 1 --2- 172.21.15.102:0/2295566879 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f844815d1c0 0x7f8448159000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T18:41:54.242 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:54.232+0000 7f844cb93640 1 -- 172.21.15.102:0/2295566879 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f84480d0c10 msgr2=0x7f844814b260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T18:41:54.242 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:54.232+0000 7f844cb93640 1 --2- 172.21.15.102:0/2295566879 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f84480d0c10 0x7f844814b260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T18:41:54.243 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:54.232+0000 7f844cb93640 1 -- 172.21.15.102:0/2295566879 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8444009420 con 0x7f84480d18e0 2023-11-13T18:41:54.244 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:54.232+0000 7f844cb93640 1 --2- 172.21.15.102:0/2295566879 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f84480d18e0 0x7f84480cc180 secure :-1 s=READY pgs=926 cs=0 l=1 rev1=1 crypto rx=0x7f843800e810 tx=0x7f843800ecd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-13T18:41:54.244 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:54.232+0000 7f843dffb640 1 -- 172.21.15.102:0/2295566879 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f843800c8d0 con 0x7f84480d18e0 2023-11-13T18:41:54.245 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:54.232+0000 7f843dffb640 1 -- 172.21.15.102:0/2295566879 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f843800ca30 con 0x7f84480d18e0 2023-11-13T18:41:54.245 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:54.232+0000 7f843dffb640 1 -- 172.21.15.102:0/2295566879 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f843800cdc0 con 0x7f84480d18e0 2023-11-13T18:41:54.245 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:54.232+0000 7f844f5f8640 1 -- 172.21.15.102:0/2295566879 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f844814f6e0 con 0x7f84480d18e0 2023-11-13T18:41:54.246 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:54.232+0000 7f844f5f8640 1 -- 172.21.15.102:0/2295566879 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f84480cb3e0 con 0x7f84480d18e0 2023-11-13T18:41:54.246 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:54.236+0000 7f844f5f8640 1 -- 172.21.15.102:0/2295566879 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f84480b3c70 con 0x7f84480d18e0 2023-11-13T18:41:54.247 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:54.236+0000 7f843dffb640 1 -- 172.21.15.102:0/2295566879 <== mon.1 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f8438013410 con 0x7f84480d18e0 2023-11-13T18:41:54.248 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:54.240+0000 7f843dffb640 1 --2- 172.21.15.102:0/2295566879 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f842c0664a0 0x7f842c068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T18:41:54.248 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:54.240+0000 7f843dffb640 1 -- 172.21.15.102:0/2295566879 <== mon.1 v2:172.21.15.154:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f8438083a30 con 0x7f84480d18e0 2023-11-13T18:41:54.248 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:54.240+0000 7f844d394640 1 --2- 172.21.15.102:0/2295566879 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f842c0664a0 0x7f842c068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T18:41:54.249 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:54.240+0000 7f843dffb640 1 --2- 172.21.15.102:0/2295566879 >> [v2:172.21.15.154:6816/2933728751,v1:172.21.15.154:6817/2933728751] conn(0x7f842c06c300 0x7f842c06e720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T18:41:54.249 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:54.240+0000 7f843dffb640 1 -- 172.21.15.102:0/2295566879 --> [v2:172.21.15.154:6816/2933728751,v1:172.21.15.154:6817/2933728751] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f842c06edd0 con 0x7f842c06c300 2023-11-13T18:41:54.249 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:54.240+0000 7f843dffb640 1 -- 172.21.15.102:0/2295566879 <== mon.1 v2:172.21.15.154:3300/0 6 ==== mon_get_version_reply(handle=1 version=41) v2 ==== 24+0+0 (secure 0 0 0) 0x7f84380882a0 con 0x7f84480d18e0 2023-11-13T18:41:54.250 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:54.240+0000 7f844db95640 1 --2- 172.21.15.102:0/2295566879 >> [v2:172.21.15.154:6816/2933728751,v1:172.21.15.154:6817/2933728751] conn(0x7f842c06c300 0x7f842c06e720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T18:41:54.250 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:54.244+0000 7f844db95640 1 --2- 172.21.15.102:0/2295566879 >> [v2:172.21.15.154:6816/2933728751,v1:172.21.15.154:6817/2933728751] conn(0x7f842c06c300 0x7f842c06e720 crc :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-13T18:41:54.251 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:54.244+0000 7f844d394640 1 --2- 172.21.15.102:0/2295566879 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f842c0664a0 0x7f842c068960 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 crypto rx=0x7f84440af000 tx=0x7f84440b6040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-13T18:41:54.251 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:54.244+0000 7f843dffb640 1 -- 172.21.15.102:0/2295566879 <== osd.6 v2:172.21.15.154:6816/2933728751 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26745 (crc 0 0 0) 0x7f842c06edd0 con 0x7f842c06c300 2023-11-13T18:41:54.263 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:54.256+0000 7f844f5f8640 1 -- 172.21.15.102:0/2295566879 --> [v2:172.21.15.154:6816/2933728751,v1:172.21.15.154:6817/2933728751] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f84480c7590 con 0x7f842c06c300 2023-11-13T18:41:54.263 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:54.256+0000 7f843dffb640 1 -- 172.21.15.102:0/2295566879 <== osd.6 v2:172.21.15.154:6816/2933728751 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f8440004b70 con 0x7f842c06c300 2023-11-13T18:41:54.264 INFO:teuthology.orchestra.run.smithi102.stdout:{ 2023-11-13T18:41:54.264 INFO:teuthology.orchestra.run.smithi102.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2023-11-13T18:41:54.265 INFO:teuthology.orchestra.run.smithi102.stdout:} 2023-11-13T18:41:54.266 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:54.260+0000 7f844f5f8640 1 -- 172.21.15.102:0/2295566879 >> [v2:172.21.15.154:6816/2933728751,v1:172.21.15.154:6817/2933728751] conn(0x7f842c06c300 msgr2=0x7f842c06e720 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T18:41:54.266 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:54.260+0000 7f844f5f8640 1 --2- 172.21.15.102:0/2295566879 >> [v2:172.21.15.154:6816/2933728751,v1:172.21.15.154:6817/2933728751] conn(0x7f842c06c300 0x7f842c06e720 crc :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T18:41:54.267 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:54.260+0000 7f844f5f8640 1 -- 172.21.15.102:0/2295566879 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f842c0664a0 msgr2=0x7f842c068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T18:41:54.267 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:54.260+0000 7f844f5f8640 1 --2- 172.21.15.102:0/2295566879 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f842c0664a0 0x7f842c068960 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 crypto rx=0x7f84440af000 tx=0x7f84440b6040 comp rx=0 tx=0).stop 2023-11-13T18:41:54.267 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:54.260+0000 7f844f5f8640 1 -- 172.21.15.102:0/2295566879 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f84480d18e0 msgr2=0x7f84480cc180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T18:41:54.268 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:54.260+0000 7f844f5f8640 1 --2- 172.21.15.102:0/2295566879 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f84480d18e0 0x7f84480cc180 secure :-1 s=READY pgs=926 cs=0 l=1 rev1=1 crypto rx=0x7f843800e810 tx=0x7f843800ecd0 comp rx=0 tx=0).stop 2023-11-13T18:41:54.268 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:54.260+0000 7f844db95640 1 -- 172.21.15.102:0/2295566879 reap_dead start 2023-11-13T18:41:54.268 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:54.260+0000 7f844f5f8640 1 -- 172.21.15.102:0/2295566879 shutdown_connections 2023-11-13T18:41:54.269 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:54.260+0000 7f844f5f8640 1 -- 172.21.15.102:0/2295566879 >> 172.21.15.102:0/2295566879 conn(0x7f84480d2dc0 msgr2=0x7f84481585b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-13T18:41:54.269 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:54.260+0000 7f844f5f8640 1 -- 172.21.15.102:0/2295566879 shutdown_connections 2023-11-13T18:41:54.269 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:54.260+0000 7f844f5f8640 1 -- 172.21.15.102:0/2295566879 wait complete. 2023-11-13T18:41:54.290 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 6 2023-11-13T18:41:54.488 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:54.484+0000 7f1ffcb1d640 1 Processor -- start 2023-11-13T18:41:54.489 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:54.484+0000 7f1ffcb1d640 1 -- start start 2023-11-13T18:41:54.490 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:54.484+0000 7f1ffcb1d640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f1ff80cf3e0 0x7f1ff8070e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T18:41:54.491 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:54.484+0000 7f1ffcb1d640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f1ff815aae0 0x7f1ff80ae550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T18:41:54.491 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:54.484+0000 7f1ffcb1d640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1ff815b120 con 0x7f1ff8071380 2023-11-13T18:41:54.492 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:54.484+0000 7f1ffcb1d640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1ff815af30 con 0x7f1ff815aae0 2023-11-13T18:41:54.492 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:54.484+0000 7f1ffcb1d640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1ff8071810 con 0x7f1ff80cf3e0 2023-11-13T18:41:54.492 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:54.484+0000 7f1ff659c640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f1ff80cf3e0 0x7f1ff8070e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T18:41:54.493 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:54.484+0000 7f1ff5d9b640 1 --1- >> v1:172.21.15.102:6789/0 conn(0x7f1ff8071380 0x7f1ff815a3d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.102:6789/0 says I am v1:172.21.15.102:40692/0 (socket says 172.21.15.102:40692) 2023-11-13T18:41:54.493 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:54.484+0000 7f1ff5d9b640 1 -- 172.21.15.102:0/892821759 learned_addr learned my addr 172.21.15.102:0/892821759 (peer_addr_for_me v1:172.21.15.102:0/0) 2023-11-13T18:41:54.494 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:54.484+0000 7f1ff6d9d640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f1ff815aae0 0x7f1ff80ae550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T18:41:54.495 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:54.484+0000 7f1ff659c640 1 -- 172.21.15.102:0/892821759 >> v2:172.21.15.102:3300/0 conn(0x7f1ff815aae0 msgr2=0x7f1ff80ae550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-13T18:41:54.495 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:54.484+0000 7f1ff659c640 1 --2- 172.21.15.102:0/892821759 >> v2:172.21.15.102:3300/0 conn(0x7f1ff815aae0 0x7f1ff80ae550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T18:41:54.495 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:54.484+0000 7f1ff659c640 1 -- 172.21.15.102:0/892821759 >> v1:172.21.15.102:6789/0 conn(0x7f1ff8071380 legacy=0x7f1ff815a3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T18:41:54.496 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:54.484+0000 7f1ff559a640 1 -- 172.21.15.102:0/892821759 <== mon.0 v1:172.21.15.102:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2980715231 0 0) 0x7f1ff815b120 con 0x7f1ff8071380 2023-11-13T18:41:54.496 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:54.484+0000 7f1ff659c640 1 -- 172.21.15.102:0/892821759 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ff815d830 con 0x7f1ff80cf3e0 2023-11-13T18:41:54.499 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:54.492+0000 7f1ff659c640 1 --2- 172.21.15.102:0/892821759 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1ff80cf3e0 0x7f1ff8070e40 secure :-1 s=READY pgs=927 cs=0 l=1 rev1=1 crypto rx=0x7f1fe80097c0 tx=0x7f1fe801c440 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f670d440793e2b11 server_cookie=0 in_seq=0 out_seq=0 2023-11-13T18:41:54.500 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:54.496+0000 7f1ff559a640 1 -- 172.21.15.102:0/892821759 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fe80ab640 con 0x7f1ff80cf3e0 2023-11-13T18:41:54.501 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:54.496+0000 7f1ff559a640 1 -- 172.21.15.102:0/892821759 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1fe80a7070 con 0x7f1ff80cf3e0 2023-11-13T18:41:54.501 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:54.496+0000 7f1ff559a640 1 -- 172.21.15.102:0/892821759 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fe80ab9c0 con 0x7f1ff80cf3e0 2023-11-13T18:41:54.502 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:54.496+0000 7f1ffcb1d640 1 -- 172.21.15.102:0/892821759 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1ff80cf3e0 msgr2=0x7f1ff8070e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T18:41:54.502 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:54.496+0000 7f1ffcb1d640 1 --2- 172.21.15.102:0/892821759 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1ff80cf3e0 0x7f1ff8070e40 secure :-1 s=READY pgs=927 cs=0 l=1 rev1=1 crypto rx=0x7f1fe80097c0 tx=0x7f1fe801c440 comp rx=0 tx=0).stop 2023-11-13T18:41:54.503 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:54.496+0000 7f1ffcb1d640 1 -- 172.21.15.102:0/892821759 shutdown_connections 2023-11-13T18:41:54.503 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:54.496+0000 7f1ffcb1d640 1 --2- 172.21.15.102:0/892821759 >> v2:172.21.15.102:3300/0 conn(0x7f1ff815aae0 0x7f1ff80ae550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T18:41:54.504 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:54.496+0000 7f1ffcb1d640 1 --2- 172.21.15.102:0/892821759 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1ff80cf3e0 0x7f1ff8070e40 unknown :-1 s=CLOSED pgs=927 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T18:41:54.504 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:54.496+0000 7f1ffcb1d640 1 -- 172.21.15.102:0/892821759 >> 172.21.15.102:0/892821759 conn(0x7f1ff806b350 msgr2=0x7f1ff806b760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-13T18:41:54.504 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:54.496+0000 7f1ffcb1d640 1 -- 172.21.15.102:0/892821759 shutdown_connections 2023-11-13T18:41:54.505 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:54.496+0000 7f1ffcb1d640 1 -- 172.21.15.102:0/892821759 wait complete. 2023-11-13T18:41:54.506 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:54.500+0000 7f1ffcb1d640 1 Processor -- start 2023-11-13T18:41:54.507 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:54.500+0000 7f1ffcb1d640 1 -- start start 2023-11-13T18:41:54.510 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:54.504+0000 7f1ffcb1d640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1ff8071380 0x7f1ff8153f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T18:41:54.511 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:54.504+0000 7f1ffcb1d640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1ff80cf3e0 0x7f1ff814dff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T18:41:54.511 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:54.504+0000 7f1ffcb1d640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1ff815aae0 0x7f1ff814e530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T18:41:54.511 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:54.504+0000 7f1ffcb1d640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ff8099a30 con 0x7f1ff815aae0 2023-11-13T18:41:54.512 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:54.504+0000 7f1ffcb1d640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ff8099d10 con 0x7f1ff80cf3e0 2023-11-13T18:41:54.512 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:54.504+0000 7f1ffcb1d640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ff8099ff0 con 0x7f1ff8071380 2023-11-13T18:41:54.512 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:54.504+0000 7f1ff5d9b640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1ff80cf3e0 0x7f1ff814dff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T18:41:54.513 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:54.504+0000 7f1ff659c640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1ff8071380 0x7f1ff8153f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T18:41:54.513 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:54.504+0000 7f1ff659c640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1ff8071380 0x7f1ff8153f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.102:54970/0 (socket says 172.21.15.102:54970) 2023-11-13T18:41:54.513 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:54.504+0000 7f1ff659c640 1 -- 172.21.15.102:0/534719995 learned_addr learned my addr 172.21.15.102:0/534719995 (peer_addr_for_me v2:172.21.15.102:0/0) 2023-11-13T18:41:54.514 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:54.504+0000 7f1ff6d9d640 1 --2- 172.21.15.102:0/534719995 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1ff815aae0 0x7f1ff814e530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T18:41:54.514 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:54.504+0000 7f1ff659c640 1 -- 172.21.15.102:0/534719995 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1ff80cf3e0 msgr2=0x7f1ff814dff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T18:41:54.515 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:54.504+0000 7f1ff659c640 1 --2- 172.21.15.102:0/534719995 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1ff80cf3e0 0x7f1ff814dff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T18:41:54.515 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:54.504+0000 7f1ff659c640 1 -- 172.21.15.102:0/534719995 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1ff815aae0 msgr2=0x7f1ff814e530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T18:41:54.515 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:54.504+0000 7f1ff659c640 1 --2- 172.21.15.102:0/534719995 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1ff815aae0 0x7f1ff814e530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T18:41:54.516 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:54.504+0000 7f1ff659c640 1 -- 172.21.15.102:0/534719995 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1fe8009420 con 0x7f1ff8071380 2023-11-13T18:41:54.516 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:54.504+0000 7f1ff659c640 1 --2- 172.21.15.102:0/534719995 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1ff8071380 0x7f1ff8153f10 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f1fe80ad040 tx=0x7f1fe801ac80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-13T18:41:54.517 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:54.504+0000 7f1fe6ffd640 1 -- 172.21.15.102:0/534719995 <== mon.2 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fe80bf410 con 0x7f1ff8071380 2023-11-13T18:41:54.518 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:54.504+0000 7f1fe6ffd640 1 -- 172.21.15.102:0/534719995 <== mon.2 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1fe80bf590 con 0x7f1ff8071380 2023-11-13T18:41:54.518 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:54.504+0000 7f1fe6ffd640 1 -- 172.21.15.102:0/534719995 <== mon.2 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fe80bf940 con 0x7f1ff8071380 2023-11-13T18:41:54.519 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:54.504+0000 7f1ffcb1d640 1 -- 172.21.15.102:0/534719995 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1ff809a2d0 con 0x7f1ff8071380 2023-11-13T18:41:54.519 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:54.504+0000 7f1ffcb1d640 1 -- 172.21.15.102:0/534719995 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1ff8150ae0 con 0x7f1ff8071380 2023-11-13T18:41:54.519 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:54.508+0000 7f1ffcb1d640 1 -- 172.21.15.102:0/534719995 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1ff8151090 con 0x7f1ff8071380 2023-11-13T18:41:54.520 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:54.512+0000 7f1fe6ffd640 1 -- 172.21.15.102:0/534719995 <== mon.2 v2:172.21.15.154:3301/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f1fe80b5400 con 0x7f1ff8071380 2023-11-13T18:41:54.520 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:54.512+0000 7f1fe6ffd640 1 --2- 172.21.15.102:0/534719995 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f1fd8066470 0x7f1fd8068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T18:41:54.520 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:54.512+0000 7f1fe6ffd640 1 -- 172.21.15.102:0/534719995 <== mon.2 v2:172.21.15.154:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f1fe811e210 con 0x7f1ff8071380 2023-11-13T18:41:54.521 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:54.512+0000 7f1ff5d9b640 1 --2- 172.21.15.102:0/534719995 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f1fd8066470 0x7f1fd8068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T18:41:54.521 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:54.512+0000 7f1ff5d9b640 1 --2- 172.21.15.102:0/534719995 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f1fd8066470 0x7f1fd8068930 secure :-1 s=READY pgs=768 cs=0 l=1 rev1=1 crypto rx=0x7f1ff814b300 tx=0x7f1fec007d60 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-13T18:41:54.522 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:54.516+0000 7f1fe6ffd640 1 -- 172.21.15.102:0/534719995 <== mon.2 v2:172.21.15.154:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f1fe80eba30 con 0x7f1ff8071380 2023-11-13T18:41:55.000 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:54.992+0000 7f1ffcb1d640 1 -- 172.21.15.102:0/534719995 --> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "6", "target": ["mon-mgr", ""]}) v1 -- 0x7f1ff815e5f0 con 0x7f1fd8066470 2023-11-13T18:41:55.001 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:54.996+0000 7f1fe6ffd640 1 -- 172.21.15.102:0/534719995 <== mgr.4103 v2:172.21.15.102:6832/1009482693 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 6 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f1fec014040 con 0x7f1fd8066470 2023-11-13T18:41:55.001 INFO:teuthology.orchestra.run.smithi102.stderr:instructed osd(s) 6 to deep-scrub 2023-11-13T18:41:55.003 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:54.996+0000 7f1ffcb1d640 1 -- 172.21.15.102:0/534719995 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f1fd8066470 msgr2=0x7f1fd8068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T18:41:55.004 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:54.996+0000 7f1ffcb1d640 1 --2- 172.21.15.102:0/534719995 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f1fd8066470 0x7f1fd8068930 secure :-1 s=READY pgs=768 cs=0 l=1 rev1=1 crypto rx=0x7f1ff814b300 tx=0x7f1fec007d60 comp rx=0 tx=0).stop 2023-11-13T18:41:55.004 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:54.996+0000 7f1ffcb1d640 1 -- 172.21.15.102:0/534719995 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1ff8071380 msgr2=0x7f1ff8153f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T18:41:55.004 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:54.996+0000 7f1ffcb1d640 1 --2- 172.21.15.102:0/534719995 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1ff8071380 0x7f1ff8153f10 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f1fe80ad040 tx=0x7f1fe801ac80 comp rx=0 tx=0).stop 2023-11-13T18:41:55.005 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:54.996+0000 7f1ffcb1d640 1 -- 172.21.15.102:0/534719995 shutdown_connections 2023-11-13T18:41:55.005 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:54.996+0000 7f1ffcb1d640 1 --2- 172.21.15.102:0/534719995 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f1fd8066470 0x7f1fd8068930 unknown :-1 s=CLOSED pgs=768 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T18:41:55.005 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:54.996+0000 7f1ffcb1d640 1 --2- 172.21.15.102:0/534719995 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1ff815aae0 0x7f1ff814e530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T18:41:55.006 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:54.996+0000 7f1ffcb1d640 1 --2- 172.21.15.102:0/534719995 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1ff80cf3e0 0x7f1ff814dff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T18:41:55.006 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:54.996+0000 7f1ffcb1d640 1 --2- 172.21.15.102:0/534719995 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1ff8071380 0x7f1ff8153f10 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T18:41:55.007 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:54.996+0000 7f1ffcb1d640 1 -- 172.21.15.102:0/534719995 >> 172.21.15.102:0/534719995 conn(0x7f1ff806b350 msgr2=0x7f1ff814b830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-13T18:41:55.007 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:54.996+0000 7f1ffcb1d640 1 -- 172.21.15.102:0/534719995 shutdown_connections 2023-11-13T18:41:55.007 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:54.996+0000 7f1ffcb1d640 1 -- 172.21.15.102:0/534719995 wait complete. 2023-11-13T18:41:55.031 INFO:tasks.ceph:Scrubbing osd.7 2023-11-13T18:41:55.031 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 config set osd_debug_deep_scrub_sleep 0 2023-11-13T18:41:55.447 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:55.440+0000 7fcb31d57640 1 Processor -- start 2023-11-13T18:41:55.448 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:55.440+0000 7fcb31d57640 1 -- start start 2023-11-13T18:41:55.451 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:55.444+0000 7fcb31d57640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7fcb2c159410 0x7fcb2c071950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T18:41:55.452 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:55.444+0000 7fcb31d57640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fcb2c06bc60 0x7fcb2c15cf20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T18:41:55.452 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:55.444+0000 7fcb31d57640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fcb2c06c0a0 0x7fcb2c15d460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T18:41:55.453 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:55.444+0000 7fcb31d57640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcb2c0cb4d0 con 0x7fcb2c159410 2023-11-13T18:41:55.453 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:55.444+0000 7fcb31d57640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcb2c070e20 con 0x7fcb2c06c0a0 2023-11-13T18:41:55.453 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:55.444+0000 7fcb31d57640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcb2c1597f0 con 0x7fcb2c06bc60 2023-11-13T18:41:55.455 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:55.448+0000 7fcb2bfff640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fcb2c06c0a0 0x7fcb2c15d460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T18:41:55.455 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:55.448+0000 7fcb2affd640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fcb2c06bc60 0x7fcb2c15cf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T18:41:55.455 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:55.448+0000 7fcb2b7fe640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7fcb2c159410 0x7fcb2c071950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T18:41:55.456 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:55.448+0000 7fcb2bfff640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fcb2c06c0a0 0x7fcb2c15d460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.102:47302/0 (socket says 172.21.15.102:47302) 2023-11-13T18:41:55.456 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:55.448+0000 7fcb2bfff640 1 -- 172.21.15.102:0/1485968746 learned_addr learned my addr 172.21.15.102:0/1485968746 (peer_addr_for_me v2:172.21.15.102:0/0) 2023-11-13T18:41:55.457 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:55.448+0000 7fcb2bfff640 1 -- 172.21.15.102:0/1485968746 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fcb2c06bc60 msgr2=0x7fcb2c15cf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-13T18:41:55.457 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:55.448+0000 7fcb2bfff640 1 --2- 172.21.15.102:0/1485968746 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fcb2c06bc60 0x7fcb2c15cf20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T18:41:55.457 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:55.448+0000 7fcb2bfff640 1 -- 172.21.15.102:0/1485968746 >> v2:172.21.15.102:3300/0 conn(0x7fcb2c159410 msgr2=0x7fcb2c071950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-13T18:41:55.458 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:55.448+0000 7fcb2bfff640 1 --2- 172.21.15.102:0/1485968746 >> v2:172.21.15.102:3300/0 conn(0x7fcb2c159410 0x7fcb2c071950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T18:41:55.458 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:55.448+0000 7fcb2bfff640 1 -- 172.21.15.102:0/1485968746 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb2c071e90 con 0x7fcb2c06c0a0 2023-11-13T18:41:55.460 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:55.452+0000 7fcb2bfff640 1 --2- 172.21.15.102:0/1485968746 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcb2c06c0a0 0x7fcb2c15d460 secure :-1 s=READY pgs=928 cs=0 l=1 rev1=1 crypto rx=0x7fcb2c15dfc0 tx=0x7fcb2401f1c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=719bf304247107ef server_cookie=0 in_seq=0 out_seq=0 2023-11-13T18:41:55.460 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:55.452+0000 7fcb2a7fc640 1 -- 172.21.15.102:0/1485968746 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb240af400 con 0x7fcb2c06c0a0 2023-11-13T18:41:55.461 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:55.452+0000 7fcb2a7fc640 1 -- 172.21.15.102:0/1485968746 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb240ab050 con 0x7fcb2c06c0a0 2023-11-13T18:41:55.461 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:55.452+0000 7fcb2a7fc640 1 -- 172.21.15.102:0/1485968746 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb240af780 con 0x7fcb2c06c0a0 2023-11-13T18:41:55.462 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:55.452+0000 7fcb31d57640 1 -- 172.21.15.102:0/1485968746 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcb2c06c0a0 msgr2=0x7fcb2c15d460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T18:41:55.462 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:55.452+0000 7fcb31d57640 1 --2- 172.21.15.102:0/1485968746 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcb2c06c0a0 0x7fcb2c15d460 secure :-1 s=READY pgs=928 cs=0 l=1 rev1=1 crypto rx=0x7fcb2c15dfc0 tx=0x7fcb2401f1c0 comp rx=0 tx=0).stop 2023-11-13T18:41:55.462 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:55.452+0000 7fcb31d57640 1 -- 172.21.15.102:0/1485968746 shutdown_connections 2023-11-13T18:41:55.463 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:55.452+0000 7fcb31d57640 1 --2- 172.21.15.102:0/1485968746 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcb2c06c0a0 0x7fcb2c15d460 unknown :-1 s=CLOSED pgs=928 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T18:41:55.463 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:55.452+0000 7fcb31d57640 1 --2- 172.21.15.102:0/1485968746 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fcb2c06bc60 0x7fcb2c15cf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T18:41:55.463 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:55.452+0000 7fcb31d57640 1 --2- 172.21.15.102:0/1485968746 >> v2:172.21.15.102:3300/0 conn(0x7fcb2c159410 0x7fcb2c071950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T18:41:55.464 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:55.452+0000 7fcb31d57640 1 -- 172.21.15.102:0/1485968746 >> 172.21.15.102:0/1485968746 conn(0x7fcb2c0b0690 msgr2=0x7fcb2c0b0aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-13T18:41:55.464 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:55.452+0000 7fcb31d57640 1 -- 172.21.15.102:0/1485968746 shutdown_connections 2023-11-13T18:41:55.464 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:55.452+0000 7fcb31d57640 1 -- 172.21.15.102:0/1485968746 wait complete. 2023-11-13T18:41:55.465 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:55.456+0000 7fcb31d57640 1 Processor -- start 2023-11-13T18:41:55.467 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:55.456+0000 7fcb31d57640 1 -- start start 2023-11-13T18:41:55.467 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:55.456+0000 7fcb31d57640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fcb2c06bc60 0x7fcb2c1456d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T18:41:55.468 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:55.456+0000 7fcb31d57640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcb2c06c0a0 0x7fcb2c14ff10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T18:41:55.468 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:55.456+0000 7fcb31d57640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fcb2c159410 0x7fcb2c06cb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T18:41:55.469 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:55.456+0000 7fcb31d57640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb2c1f6dd0 con 0x7fcb2c159410 2023-11-13T18:41:55.469 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:55.456+0000 7fcb31d57640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb2c145c10 con 0x7fcb2c06c0a0 2023-11-13T18:41:55.469 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:55.456+0000 7fcb31d57640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcb2c1f71f0 con 0x7fcb2c06bc60 2023-11-13T18:41:55.470 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:55.456+0000 7fcb2bfff640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fcb2c159410 0x7fcb2c06cb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T18:41:55.470 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:55.456+0000 7fcb2bfff640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fcb2c159410 0x7fcb2c06cb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:50936/0 (socket says 172.21.15.102:50936) 2023-11-13T18:41:55.470 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:55.456+0000 7fcb2bfff640 1 -- 172.21.15.102:0/1153255134 learned_addr learned my addr 172.21.15.102:0/1153255134 (peer_addr_for_me v2:172.21.15.102:0/0) 2023-11-13T18:41:55.471 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:55.456+0000 7fcb2b7fe640 1 --2- 172.21.15.102:0/1153255134 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fcb2c06bc60 0x7fcb2c1456d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T18:41:55.471 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:55.456+0000 7fcb2affd640 1 --2- 172.21.15.102:0/1153255134 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcb2c06c0a0 0x7fcb2c14ff10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T18:41:55.472 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:55.456+0000 7fcb2bfff640 1 -- 172.21.15.102:0/1153255134 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fcb2c06bc60 msgr2=0x7fcb2c1456d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T18:41:55.472 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:55.456+0000 7fcb2bfff640 1 --2- 172.21.15.102:0/1153255134 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fcb2c06bc60 0x7fcb2c1456d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T18:41:55.472 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:55.456+0000 7fcb2bfff640 1 -- 172.21.15.102:0/1153255134 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcb2c06c0a0 msgr2=0x7fcb2c14ff10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T18:41:55.473 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:55.456+0000 7fcb2bfff640 1 --2- 172.21.15.102:0/1153255134 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcb2c06c0a0 0x7fcb2c14ff10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T18:41:55.473 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:55.456+0000 7fcb2bfff640 1 -- 172.21.15.102:0/1153255134 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb24009b30 con 0x7fcb2c159410 2023-11-13T18:41:55.473 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:55.456+0000 7fcb2affd640 1 --2- 172.21.15.102:0/1153255134 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcb2c06c0a0 0x7fcb2c14ff10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-13T18:41:55.474 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:55.456+0000 7fcb2bfff640 1 --2- 172.21.15.102:0/1153255134 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fcb2c159410 0x7fcb2c06cb90 secure :-1 s=READY pgs=1965 cs=0 l=1 rev1=1 crypto rx=0x7fcb240b2040 tx=0x7fcb2401bf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-13T18:41:55.474 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:55.456+0000 7fcb13fff640 1 -- 172.21.15.102:0/1153255134 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb240afc60 con 0x7fcb2c159410 2023-11-13T18:41:55.474 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:55.456+0000 7fcb13fff640 1 -- 172.21.15.102:0/1153255134 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb240afde0 con 0x7fcb2c159410 2023-11-13T18:41:55.475 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:55.456+0000 7fcb13fff640 1 -- 172.21.15.102:0/1153255134 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb240ba680 con 0x7fcb2c159410 2023-11-13T18:41:55.475 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:55.460+0000 7fcb31d57640 1 -- 172.21.15.102:0/1153255134 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcb2c1f6430 con 0x7fcb2c159410 2023-11-13T18:41:55.475 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:55.460+0000 7fcb31d57640 1 -- 172.21.15.102:0/1153255134 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcb2c1f69f0 con 0x7fcb2c159410 2023-11-13T18:41:55.476 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:55.460+0000 7fcb31d57640 1 -- 172.21.15.102:0/1153255134 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fcb2c06c670 con 0x7fcb2c159410 2023-11-13T18:41:55.477 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:55.464+0000 7fcb13fff640 1 -- 172.21.15.102:0/1153255134 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fcb240b6040 con 0x7fcb2c159410 2023-11-13T18:41:55.478 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:55.464+0000 7fcb13fff640 1 --2- 172.21.15.102:0/1153255134 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7fcb18066470 0x7fcb18068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T18:41:55.478 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:55.464+0000 7fcb13fff640 1 -- 172.21.15.102:0/1153255134 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fcb24121c90 con 0x7fcb2c159410 2023-11-13T18:41:55.478 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:55.464+0000 7fcb13fff640 1 --2- 172.21.15.102:0/1153255134 >> [v2:172.21.15.154:6824/1753500785,v1:172.21.15.154:6825/1753500785] conn(0x7fcb1806c2d0 0x7fcb1806e6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T18:41:55.479 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:55.464+0000 7fcb13fff640 1 -- 172.21.15.102:0/1153255134 --> [v2:172.21.15.154:6824/1753500785,v1:172.21.15.154:6825/1753500785] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fcb1806eda0 con 0x7fcb1806c2d0 2023-11-13T18:41:55.479 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:55.464+0000 7fcb13fff640 1 -- 172.21.15.102:0/1153255134 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_get_version_reply(handle=1 version=41) v2 ==== 24+0+0 (secure 0 0 0) 0x7fcb24124270 con 0x7fcb2c159410 2023-11-13T18:41:55.479 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:55.464+0000 7fcb2b7fe640 1 --2- 172.21.15.102:0/1153255134 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7fcb18066470 0x7fcb18068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T18:41:55.480 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:55.464+0000 7fcb2affd640 1 --2- 172.21.15.102:0/1153255134 >> [v2:172.21.15.154:6824/1753500785,v1:172.21.15.154:6825/1753500785] conn(0x7fcb1806c2d0 0x7fcb1806e6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T18:41:55.480 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:55.464+0000 7fcb2b7fe640 1 --2- 172.21.15.102:0/1153255134 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7fcb18066470 0x7fcb18068930 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 crypto rx=0x7fcb1c009a50 tx=0x7fcb1c008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-13T18:41:55.481 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:55.468+0000 7fcb2affd640 1 --2- 172.21.15.102:0/1153255134 >> [v2:172.21.15.154:6824/1753500785,v1:172.21.15.154:6825/1753500785] conn(0x7fcb1806c2d0 0x7fcb1806e6f0 crc :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-13T18:41:55.481 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:55.468+0000 7fcb13fff640 1 -- 172.21.15.102:0/1153255134 <== osd.7 v2:172.21.15.154:6824/1753500785 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26745 (crc 0 0 0) 0x7fcb1806eda0 con 0x7fcb1806c2d0 2023-11-13T18:41:55.512 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:55.508+0000 7fcb31d57640 1 -- 172.21.15.102:0/1153255134 --> [v2:172.21.15.154:6824/1753500785,v1:172.21.15.154:6825/1753500785] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fcb2c071350 con 0x7fcb1806c2d0 2023-11-13T18:41:55.513 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:55.508+0000 7fcb13fff640 1 -- 172.21.15.102:0/1153255134 <== osd.7 v2:172.21.15.154:6824/1753500785 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7fcb20009b90 con 0x7fcb1806c2d0 2023-11-13T18:41:55.513 INFO:teuthology.orchestra.run.smithi102.stdout:{ 2023-11-13T18:41:55.514 INFO:teuthology.orchestra.run.smithi102.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2023-11-13T18:41:55.514 INFO:teuthology.orchestra.run.smithi102.stdout:} 2023-11-13T18:41:55.516 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:55.508+0000 7fcb31d57640 1 -- 172.21.15.102:0/1153255134 >> [v2:172.21.15.154:6824/1753500785,v1:172.21.15.154:6825/1753500785] conn(0x7fcb1806c2d0 msgr2=0x7fcb1806e6f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T18:41:55.516 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:55.508+0000 7fcb31d57640 1 --2- 172.21.15.102:0/1153255134 >> [v2:172.21.15.154:6824/1753500785,v1:172.21.15.154:6825/1753500785] conn(0x7fcb1806c2d0 0x7fcb1806e6f0 crc :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T18:41:55.516 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:55.508+0000 7fcb31d57640 1 -- 172.21.15.102:0/1153255134 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7fcb18066470 msgr2=0x7fcb18068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T18:41:55.517 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:55.508+0000 7fcb31d57640 1 --2- 172.21.15.102:0/1153255134 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7fcb18066470 0x7fcb18068930 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 crypto rx=0x7fcb1c009a50 tx=0x7fcb1c008040 comp rx=0 tx=0).stop 2023-11-13T18:41:55.517 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:55.508+0000 7fcb31d57640 1 -- 172.21.15.102:0/1153255134 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fcb2c159410 msgr2=0x7fcb2c06cb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T18:41:55.517 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:55.508+0000 7fcb31d57640 1 --2- 172.21.15.102:0/1153255134 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fcb2c159410 0x7fcb2c06cb90 secure :-1 s=READY pgs=1965 cs=0 l=1 rev1=1 crypto rx=0x7fcb240b2040 tx=0x7fcb2401bf60 comp rx=0 tx=0).stop 2023-11-13T18:41:55.518 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:55.508+0000 7fcb2bfff640 1 -- 172.21.15.102:0/1153255134 reap_dead start 2023-11-13T18:41:55.518 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:55.508+0000 7fcb31d57640 1 -- 172.21.15.102:0/1153255134 shutdown_connections 2023-11-13T18:41:55.519 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:55.508+0000 7fcb31d57640 1 -- 172.21.15.102:0/1153255134 >> 172.21.15.102:0/1153255134 conn(0x7fcb2c0b0690 msgr2=0x7fcb2c0cf120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-13T18:41:55.519 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:55.508+0000 7fcb31d57640 1 -- 172.21.15.102:0/1153255134 shutdown_connections 2023-11-13T18:41:55.519 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:55.508+0000 7fcb31d57640 1 -- 172.21.15.102:0/1153255134 wait complete. 2023-11-13T18:41:55.560 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 7 2023-11-13T18:41:55.968 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:55.960+0000 7f7cf5f1d640 1 Processor -- start 2023-11-13T18:41:55.968 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:55.964+0000 7f7cf5f1d640 1 -- start start 2023-11-13T18:41:55.971 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:55.964+0000 7f7cf5f1d640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f7cf015cd70 0x7f7cf006a240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T18:41:55.971 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:55.964+0000 7f7cf5f1d640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7cf00af120 0x7f7cf00ad230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T18:41:55.972 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:55.964+0000 7f7cf5f1d640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7cf0161940 con 0x7f7cf006a780 2023-11-13T18:41:55.972 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:55.964+0000 7f7cf5f1d640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7cf00af740 con 0x7f7cf015cd70 2023-11-13T18:41:55.973 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:55.964+0000 7f7cf5f1d640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7cf006ac10 con 0x7f7cf00af120 2023-11-13T18:41:55.974 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:55.968+0000 7f7cef7fe640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f7cf015cd70 0x7f7cf006a240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T18:41:55.974 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:55.968+0000 7f7ceeffd640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f7cf006a780 0x7f7cf00aea10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.102:48512/0 (socket says 172.21.15.102:48512) 2023-11-13T18:41:55.975 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:55.968+0000 7f7ceeffd640 1 -- 172.21.15.102:0/1080407141 learned_addr learned my addr 172.21.15.102:0/1080407141 (peer_addr_for_me v1:172.21.15.102:0/0) 2023-11-13T18:41:55.975 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:55.968+0000 7f7cef7fe640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f7cf015cd70 0x7f7cf006a240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:50940/0 (socket says 172.21.15.102:50940) 2023-11-13T18:41:55.975 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:55.968+0000 7f7ceffff640 1 --2- 172.21.15.102:0/1080407141 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7cf00af120 0x7f7cf00ad230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T18:41:55.976 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:55.968+0000 7f7cef7fe640 1 -- 172.21.15.102:0/1080407141 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7cf00af120 msgr2=0x7f7cf00ad230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-13T18:41:55.976 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:55.968+0000 7f7cef7fe640 1 --2- 172.21.15.102:0/1080407141 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7cf00af120 0x7f7cf00ad230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T18:41:55.977 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:55.968+0000 7f7cee7fc640 1 -- 172.21.15.102:0/1080407141 <== mon.1 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4184488092 0 0) 0x7f7cf0161940 con 0x7f7cf006a780 2023-11-13T18:41:55.977 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:55.968+0000 7f7cef7fe640 1 -- 172.21.15.102:0/1080407141 >> v1:172.21.15.154:6789/0 conn(0x7f7cf006a780 legacy=0x7f7cf00aea10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T18:41:55.977 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:55.968+0000 7f7cef7fe640 1 -- 172.21.15.102:0/1080407141 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7cf0160b80 con 0x7f7cf015cd70 2023-11-13T18:41:55.980 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:55.976+0000 7f7cef7fe640 1 --2- 172.21.15.102:0/1080407141 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7cf015cd70 0x7f7cf006a240 secure :-1 s=READY pgs=1966 cs=0 l=1 rev1=1 crypto rx=0x7f7ce00097c0 tx=0x7f7ce001c3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2de1e1c7d9d54e2d server_cookie=0 in_seq=0 out_seq=0 2023-11-13T18:41:55.981 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:55.976+0000 7f7cee7fc640 1 -- 172.21.15.102:0/1080407141 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ce00ab600 con 0x7f7cf015cd70 2023-11-13T18:41:55.982 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:55.976+0000 7f7cee7fc640 1 -- 172.21.15.102:0/1080407141 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ce00a7050 con 0x7f7cf015cd70 2023-11-13T18:41:55.982 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:55.976+0000 7f7cee7fc640 1 -- 172.21.15.102:0/1080407141 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ce00ab980 con 0x7f7cf015cd70 2023-11-13T18:41:55.983 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:55.976+0000 7f7cf5f1d640 1 -- 172.21.15.102:0/1080407141 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7cf015cd70 msgr2=0x7f7cf006a240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T18:41:55.984 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:55.976+0000 7f7cf5f1d640 1 --2- 172.21.15.102:0/1080407141 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7cf015cd70 0x7f7cf006a240 secure :-1 s=READY pgs=1966 cs=0 l=1 rev1=1 crypto rx=0x7f7ce00097c0 tx=0x7f7ce001c3c0 comp rx=0 tx=0).stop 2023-11-13T18:41:55.984 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:55.976+0000 7f7cf5f1d640 1 -- 172.21.15.102:0/1080407141 shutdown_connections 2023-11-13T18:41:55.984 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:55.976+0000 7f7cf5f1d640 1 --2- 172.21.15.102:0/1080407141 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7cf00af120 0x7f7cf00ad230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T18:41:55.985 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:55.976+0000 7f7cf5f1d640 1 --2- 172.21.15.102:0/1080407141 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7cf015cd70 0x7f7cf006a240 unknown :-1 s=CLOSED pgs=1966 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T18:41:55.985 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:55.976+0000 7f7cf5f1d640 1 -- 172.21.15.102:0/1080407141 >> 172.21.15.102:0/1080407141 conn(0x7f7cf006b350 msgr2=0x7f7cf006b760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-13T18:41:55.986 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:55.976+0000 7f7cf5f1d640 1 -- 172.21.15.102:0/1080407141 shutdown_connections 2023-11-13T18:41:55.986 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:55.976+0000 7f7cf5f1d640 1 -- 172.21.15.102:0/1080407141 wait complete. 2023-11-13T18:41:55.988 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:55.984+0000 7f7cf5f1d640 1 Processor -- start 2023-11-13T18:41:55.989 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:55.984+0000 7f7cf5f1d640 1 -- start start 2023-11-13T18:41:55.992 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:55.984+0000 7f7cf5f1d640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7cf006a780 0x7f7cf00b0dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T18:41:55.992 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:55.988+0000 7f7cf5f1d640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7cf00af120 0x7f7cf01405d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T18:41:55.993 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:55.988+0000 7f7cf5f1d640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7cf015cd70 0x7f7cf006e620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T18:41:55.993 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:55.988+0000 7f7cf5f1d640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7cf00b09a0 con 0x7f7cf006a780 2023-11-13T18:41:55.993 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:55.988+0000 7f7cf5f1d640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7cf00afd20 con 0x7f7cf015cd70 2023-11-13T18:41:55.994 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:55.988+0000 7f7cf5f1d640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7cf00b0000 con 0x7f7cf00af120 2023-11-13T18:41:55.994 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:55.988+0000 7f7ceeffd640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7cf00af120 0x7f7cf01405d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T18:41:55.995 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:55.988+0000 7f7cef7fe640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7cf006a780 0x7f7cf00b0dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T18:41:55.995 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:55.988+0000 7f7ceeffd640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7cf00af120 0x7f7cf01405d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.102:55010/0 (socket says 172.21.15.102:55010) 2023-11-13T18:41:55.995 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:55.988+0000 7f7cef7fe640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7cf006a780 0x7f7cf00b0dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:50944/0 (socket says 172.21.15.102:50944) 2023-11-13T18:41:55.996 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:55.988+0000 7f7ceeffd640 1 -- 172.21.15.102:0/2860896327 learned_addr learned my addr 172.21.15.102:0/2860896327 (peer_addr_for_me v2:172.21.15.102:0/0) 2023-11-13T18:41:55.997 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:55.988+0000 7f7ceffff640 1 --2- 172.21.15.102:0/2860896327 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7cf015cd70 0x7f7cf006e620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T18:41:55.997 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:55.988+0000 7f7ceeffd640 1 -- 172.21.15.102:0/2860896327 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7cf015cd70 msgr2=0x7f7cf006e620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T18:41:55.998 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:55.988+0000 7f7ceeffd640 1 --2- 172.21.15.102:0/2860896327 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7cf015cd70 0x7f7cf006e620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T18:41:55.998 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:55.988+0000 7f7ceeffd640 1 -- 172.21.15.102:0/2860896327 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7cf006a780 msgr2=0x7f7cf00b0dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T18:41:55.999 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:55.988+0000 7f7ceeffd640 1 --2- 172.21.15.102:0/2860896327 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7cf006a780 0x7f7cf00b0dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T18:41:55.999 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:55.988+0000 7f7ceeffd640 1 -- 172.21.15.102:0/2860896327 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ce0009420 con 0x7f7cf00af120 2023-11-13T18:41:55.999 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:55.988+0000 7f7ceeffd640 1 --2- 172.21.15.102:0/2860896327 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7cf00af120 0x7f7cf01405d0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f7ce40011f0 tx=0x7f7ce400c9b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-13T18:41:56.000 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:55.988+0000 7f7cd7fff640 1 -- 172.21.15.102:0/2860896327 <== mon.2 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ce40074e0 con 0x7f7cf00af120 2023-11-13T18:41:56.000 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:55.988+0000 7f7cd7fff640 1 -- 172.21.15.102:0/2860896327 <== mon.2 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ce4007640 con 0x7f7cf00af120 2023-11-13T18:41:56.000 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:55.988+0000 7f7cf5f1d640 1 -- 172.21.15.102:0/2860896327 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7cf015d2d0 con 0x7f7cf00af120 2023-11-13T18:41:56.001 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:55.988+0000 7f7cd7fff640 1 -- 172.21.15.102:0/2860896327 <== mon.2 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ce4004a10 con 0x7f7cf00af120 2023-11-13T18:41:56.001 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:55.988+0000 7f7cf5f1d640 1 -- 172.21.15.102:0/2860896327 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7cf00b05c0 con 0x7f7cf00af120 2023-11-13T18:41:56.001 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:55.992+0000 7f7cf5f1d640 1 -- 172.21.15.102:0/2860896327 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7cf0067680 con 0x7f7cf00af120 2023-11-13T18:41:56.002 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:55.996+0000 7f7cd7fff640 1 -- 172.21.15.102:0/2860896327 <== mon.2 v2:172.21.15.154:3301/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f7ce4004b70 con 0x7f7cf00af120 2023-11-13T18:41:56.003 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:55.996+0000 7f7cd7fff640 1 --2- 172.21.15.102:0/2860896327 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f7cdc066470 0x7f7cdc068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T18:41:56.003 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:55.996+0000 7f7cd7fff640 1 -- 172.21.15.102:0/2860896327 <== mon.2 v2:172.21.15.154:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f7ce4082c80 con 0x7f7cf00af120 2023-11-13T18:41:56.004 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:55.996+0000 7f7cef7fe640 1 --2- 172.21.15.102:0/2860896327 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f7cdc066470 0x7f7cdc068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T18:41:56.005 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:56.000+0000 7f7cef7fe640 1 --2- 172.21.15.102:0/2860896327 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f7cdc066470 0x7f7cdc068930 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 crypto rx=0x7f7ce00ad000 tx=0x7f7ce00a6000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-13T18:41:56.006 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:56.000+0000 7f7cd7fff640 1 -- 172.21.15.102:0/2860896327 <== mon.2 v2:172.21.15.154:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f7ce40504a0 con 0x7f7cf00af120 2023-11-13T18:41:56.159 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:56.152+0000 7f7cf5f1d640 1 -- 172.21.15.102:0/2860896327 --> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "7", "target": ["mon-mgr", ""]}) v1 -- 0x7f7cf015d150 con 0x7f7cdc066470 2023-11-13T18:41:56.160 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:56.156+0000 7f7cd7fff640 1 -- 172.21.15.102:0/2860896327 <== mgr.4103 v2:172.21.15.102:6832/1009482693 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 7 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f7ce00ab6c0 con 0x7f7cdc066470 2023-11-13T18:41:56.161 INFO:teuthology.orchestra.run.smithi102.stderr:instructed osd(s) 7 to deep-scrub 2023-11-13T18:41:56.163 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:56.156+0000 7f7cf5f1d640 1 -- 172.21.15.102:0/2860896327 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f7cdc066470 msgr2=0x7f7cdc068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T18:41:56.163 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:56.156+0000 7f7cf5f1d640 1 --2- 172.21.15.102:0/2860896327 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f7cdc066470 0x7f7cdc068930 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 crypto rx=0x7f7ce00ad000 tx=0x7f7ce00a6000 comp rx=0 tx=0).stop 2023-11-13T18:41:56.164 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:56.156+0000 7f7cf5f1d640 1 -- 172.21.15.102:0/2860896327 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7cf00af120 msgr2=0x7f7cf01405d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T18:41:56.164 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:56.156+0000 7f7cf5f1d640 1 --2- 172.21.15.102:0/2860896327 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7cf00af120 0x7f7cf01405d0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f7ce40011f0 tx=0x7f7ce400c9b0 comp rx=0 tx=0).stop 2023-11-13T18:41:56.165 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:56.156+0000 7f7cf5f1d640 1 -- 172.21.15.102:0/2860896327 shutdown_connections 2023-11-13T18:41:56.165 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:56.156+0000 7f7cf5f1d640 1 --2- 172.21.15.102:0/2860896327 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7cf015cd70 0x7f7cf006e620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T18:41:56.165 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:56.156+0000 7f7cf5f1d640 1 --2- 172.21.15.102:0/2860896327 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7cf00af120 0x7f7cf01405d0 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T18:41:56.166 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:56.156+0000 7f7cf5f1d640 1 --2- 172.21.15.102:0/2860896327 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f7cdc066470 0x7f7cdc068930 unknown :-1 s=CLOSED pgs=770 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T18:41:56.166 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:56.156+0000 7f7cf5f1d640 1 --2- 172.21.15.102:0/2860896327 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7cf006a780 0x7f7cf00b0dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T18:41:56.166 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:56.156+0000 7f7cf5f1d640 1 -- 172.21.15.102:0/2860896327 >> 172.21.15.102:0/2860896327 conn(0x7f7cf006b350 msgr2=0x7f7cf00b3130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-13T18:41:56.167 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:56.156+0000 7f7cf5f1d640 1 -- 172.21.15.102:0/2860896327 shutdown_connections 2023-11-13T18:41:56.167 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:56.156+0000 7f7cf5f1d640 1 -- 172.21.15.102:0/2860896327 wait complete. 2023-11-13T18:41:56.187 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-13T18:41:56.585 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:56.580+0000 7f5ae4e5a640 1 Processor -- start 2023-11-13T18:41:56.586 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:56.580+0000 7f5ae4e5a640 1 -- start start 2023-11-13T18:41:56.590 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:56.584+0000 7f5ae4e5a640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f5ae0157570 0x7f5ae015e090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T18:41:56.590 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:56.584+0000 7f5ae4e5a640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5ae00ad550 con 0x7f5ae00ae9f0 2023-11-13T18:41:56.590 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:56.584+0000 7f5ae4e5a640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5ae015e5d0 con 0x7f5ae006b250 2023-11-13T18:41:56.591 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:56.584+0000 7f5ae4e5a640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5ae0161a20 con 0x7f5ae0157570 2023-11-13T18:41:56.592 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:56.584+0000 7f5ade59c640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f5ae0157570 0x7f5ae015e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T18:41:56.593 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:56.584+0000 7f5ade59c640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f5ae0157570 0x7f5ae015e090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:50954/0 (socket says 172.21.15.102:50954) 2023-11-13T18:41:56.593 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:56.584+0000 7f5ade59c640 1 -- 172.21.15.102:0/3362066064 learned_addr learned my addr 172.21.15.102:0/3362066064 (peer_addr_for_me v2:172.21.15.102:0/0) 2023-11-13T18:41:56.593 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:56.584+0000 7f5ad7fff640 1 --1- 172.21.15.102:0/3362066064 >> v1:172.21.15.154:6789/0 conn(0x7f5ae006b250 0x7f5ae0160c00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.102:48518/0 (socket says 172.21.15.102:48518) 2023-11-13T18:41:56.594 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:56.584+0000 7f5ade59c640 1 -- 172.21.15.102:0/3362066064 >> v1:172.21.15.154:6789/0 conn(0x7f5ae006b250 legacy=0x7f5ae0160c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T18:41:56.594 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:56.584+0000 7f5ade59c640 1 -- 172.21.15.102:0/3362066064 >> v1:172.21.15.102:6789/0 conn(0x7f5ae00ae9f0 legacy=0x7f5ae0161310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T18:41:56.595 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:56.584+0000 7f5ade59c640 1 -- 172.21.15.102:0/3362066064 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ae00b3750 con 0x7f5ae0157570 2023-11-13T18:41:56.595 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:56.584+0000 7f5addd9b640 1 -- 172.21.15.102:0/3362066064 <== mon.1 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 169047529 0 0) 0x7f5ae015e5d0 con 0x7f5ae006b250 2023-11-13T18:41:56.599 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:56.592+0000 7f5ade59c640 1 --2- 172.21.15.102:0/3362066064 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5ae0157570 0x7f5ae015e090 secure :-1 s=READY pgs=1968 cs=0 l=1 rev1=1 crypto rx=0x7f5ad0009870 tx=0x7f5ad001c510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=84450bee11129004 server_cookie=0 in_seq=0 out_seq=0 2023-11-13T18:41:56.600 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:56.596+0000 7f5addd9b640 1 -- 172.21.15.102:0/3362066064 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ad00aa670 con 0x7f5ae0157570 2023-11-13T18:41:56.600 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:56.596+0000 7f5addd9b640 1 -- 172.21.15.102:0/3362066064 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ad00aa7d0 con 0x7f5ae0157570 2023-11-13T18:41:56.601 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:56.596+0000 7f5addd9b640 1 -- 172.21.15.102:0/3362066064 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ad00aab60 con 0x7f5ae0157570 2023-11-13T18:41:56.602 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:56.596+0000 7f5ae4e5a640 1 -- 172.21.15.102:0/3362066064 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5ae0157570 msgr2=0x7f5ae015e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T18:41:56.602 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:56.596+0000 7f5ae4e5a640 1 --2- 172.21.15.102:0/3362066064 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5ae0157570 0x7f5ae015e090 secure :-1 s=READY pgs=1968 cs=0 l=1 rev1=1 crypto rx=0x7f5ad0009870 tx=0x7f5ad001c510 comp rx=0 tx=0).stop 2023-11-13T18:41:56.603 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:56.596+0000 7f5ae4e5a640 1 -- 172.21.15.102:0/3362066064 shutdown_connections 2023-11-13T18:41:56.603 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:56.596+0000 7f5ae4e5a640 1 --2- 172.21.15.102:0/3362066064 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5ae0157570 0x7f5ae015e090 unknown :-1 s=CLOSED pgs=1968 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T18:41:56.604 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:56.596+0000 7f5ae4e5a640 1 -- 172.21.15.102:0/3362066064 >> 172.21.15.102:0/3362066064 conn(0x7f5ae0070590 msgr2=0x7f5ae00709a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-13T18:41:56.604 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:56.596+0000 7f5ae4e5a640 1 -- 172.21.15.102:0/3362066064 shutdown_connections 2023-11-13T18:41:56.604 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:56.596+0000 7f5ae4e5a640 1 -- 172.21.15.102:0/3362066064 wait complete. 2023-11-13T18:41:56.607 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:56.600+0000 7f5ae4e5a640 1 Processor -- start 2023-11-13T18:41:56.607 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:56.600+0000 7f5ae4e5a640 1 -- start start 2023-11-13T18:41:56.611 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:56.604+0000 7f5ae4e5a640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5ae006b250 0x7f5ae00cd4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T18:41:56.611 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:56.604+0000 7f5ae4e5a640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5ae00ae9f0 0x7f5ae0144890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T18:41:56.611 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:56.604+0000 7f5ae4e5a640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5ae0157570 0x7f5ae00b0740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T18:41:56.612 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:56.604+0000 7f5ae4e5a640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ae00cda20 con 0x7f5ae006b250 2023-11-13T18:41:56.612 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:56.604+0000 7f5ae4e5a640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ae00b02b0 con 0x7f5ae00ae9f0 2023-11-13T18:41:56.612 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:56.604+0000 7f5ae4e5a640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ae014b090 con 0x7f5ae0157570 2023-11-13T18:41:56.613 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:56.604+0000 7f5ade59c640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5ae006b250 0x7f5ae00cd4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T18:41:56.613 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:56.604+0000 7f5ade59c640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5ae006b250 0x7f5ae00cd4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:50970/0 (socket says 172.21.15.102:50970) 2023-11-13T18:41:56.613 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:56.604+0000 7f5ade59c640 1 -- 172.21.15.102:0/2663888932 learned_addr learned my addr 172.21.15.102:0/2663888932 (peer_addr_for_me v2:172.21.15.102:0/0) 2023-11-13T18:41:56.614 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:56.604+0000 7f5ad7fff640 1 --2- 172.21.15.102:0/2663888932 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5ae00ae9f0 0x7f5ae0144890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T18:41:56.614 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:56.604+0000 7f5aded9d640 1 --2- 172.21.15.102:0/2663888932 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5ae0157570 0x7f5ae00b0740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T18:41:56.616 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:56.604+0000 7f5ade59c640 1 -- 172.21.15.102:0/2663888932 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5ae0157570 msgr2=0x7f5ae00b0740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T18:41:56.616 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:56.604+0000 7f5ade59c640 1 --2- 172.21.15.102:0/2663888932 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5ae0157570 0x7f5ae00b0740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T18:41:56.616 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:56.604+0000 7f5ade59c640 1 -- 172.21.15.102:0/2663888932 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5ae00ae9f0 msgr2=0x7f5ae0144890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T18:41:56.617 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:56.604+0000 7f5ade59c640 1 --2- 172.21.15.102:0/2663888932 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5ae00ae9f0 0x7f5ae0144890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T18:41:56.617 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:56.604+0000 7f5ade59c640 1 -- 172.21.15.102:0/2663888932 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ad00094d0 con 0x7f5ae006b250 2023-11-13T18:41:56.618 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:56.604+0000 7f5aded9d640 1 --2- 172.21.15.102:0/2663888932 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5ae0157570 0x7f5ae00b0740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-13T18:41:56.618 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:56.608+0000 7f5ade59c640 1 --2- 172.21.15.102:0/2663888932 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5ae006b250 0x7f5ae00cd4e0 secure :-1 s=READY pgs=1969 cs=0 l=1 rev1=1 crypto rx=0x7f5ad00ac040 tx=0x7f5ad001ad50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-13T18:41:56.618 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:56.608+0000 7f5ad6ffd640 1 -- 172.21.15.102:0/2663888932 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ad00b3800 con 0x7f5ae006b250 2023-11-13T18:41:56.619 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:56.608+0000 7f5ae4e5a640 1 -- 172.21.15.102:0/2663888932 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5ae00aff80 con 0x7f5ae006b250 2023-11-13T18:41:56.619 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:56.608+0000 7f5ad6ffd640 1 -- 172.21.15.102:0/2663888932 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ad00b3960 con 0x7f5ae006b250 2023-11-13T18:41:56.619 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:56.608+0000 7f5ad6ffd640 1 -- 172.21.15.102:0/2663888932 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ad00b3d10 con 0x7f5ae006b250 2023-11-13T18:41:56.620 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:56.608+0000 7f5ae4e5a640 1 -- 172.21.15.102:0/2663888932 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5ae00cdf30 con 0x7f5ae006b250 2023-11-13T18:41:56.621 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:56.612+0000 7f5ae4e5a640 1 -- 172.21.15.102:0/2663888932 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5ae0071200 con 0x7f5ae006b250 2023-11-13T18:41:56.621 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:56.612+0000 7f5ad6ffd640 1 -- 172.21.15.102:0/2663888932 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f5ad00b2380 con 0x7f5ae006b250 2023-11-13T18:41:56.621 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:56.612+0000 7f5ad6ffd640 1 --2- 172.21.15.102:0/2663888932 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f5ac00664a0 0x7f5ac0068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T18:41:56.622 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:56.612+0000 7f5ad6ffd640 1 -- 172.21.15.102:0/2663888932 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f5ad011e650 con 0x7f5ae006b250 2023-11-13T18:41:56.622 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:56.612+0000 7f5ad7fff640 1 --2- 172.21.15.102:0/2663888932 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f5ac00664a0 0x7f5ac0068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T18:41:56.623 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:56.616+0000 7f5ad7fff640 1 --2- 172.21.15.102:0/2663888932 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f5ac00664a0 0x7f5ac0068960 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 crypto rx=0x7f5ae00cd020 tx=0x7f5ac8007240 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-13T18:41:56.632 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:56.628+0000 7f5ad6ffd640 1 -- 172.21.15.102:0/2663888932 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f5ad00ebd70 con 0x7f5ae006b250 2023-11-13T18:41:57.081 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:57.076+0000 7f5ae4e5a640 1 -- 172.21.15.102:0/2663888932 --> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f5ae006bad0 con 0x7f5ac00664a0 2023-11-13T18:41:57.087 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:57.080+0000 7f5ad6ffd640 1 -- 172.21.15.102:0/2663888932 <== mgr.4103 v2:172.21.15.102:6832/1009482693 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+49373 (secure 0 0 0) 0x7f5ac8001510 con 0x7f5ac00664a0 2023-11-13T18:41:57.088 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T18:41:57.089 INFO:teuthology.orchestra.run.smithi102.stderr:dumped all 2023-11-13T18:41:57.093 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:57.088+0000 7f5ae4e5a640 1 -- 172.21.15.102:0/2663888932 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f5ac00664a0 msgr2=0x7f5ac0068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T18:41:57.093 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:57.088+0000 7f5ae4e5a640 1 --2- 172.21.15.102:0/2663888932 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f5ac00664a0 0x7f5ac0068960 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 crypto rx=0x7f5ae00cd020 tx=0x7f5ac8007240 comp rx=0 tx=0).stop 2023-11-13T18:41:57.094 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:57.088+0000 7f5ae4e5a640 1 -- 172.21.15.102:0/2663888932 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5ae006b250 msgr2=0x7f5ae00cd4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T18:41:57.094 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:57.088+0000 7f5ae4e5a640 1 --2- 172.21.15.102:0/2663888932 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5ae006b250 0x7f5ae00cd4e0 secure :-1 s=READY pgs=1969 cs=0 l=1 rev1=1 crypto rx=0x7f5ad00ac040 tx=0x7f5ad001ad50 comp rx=0 tx=0).stop 2023-11-13T18:41:57.095 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:57.088+0000 7f5ae4e5a640 1 -- 172.21.15.102:0/2663888932 shutdown_connections 2023-11-13T18:41:57.095 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:57.088+0000 7f5ae4e5a640 1 --2- 172.21.15.102:0/2663888932 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5ae0157570 0x7f5ae00b0740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T18:41:57.095 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:57.088+0000 7f5ae4e5a640 1 --2- 172.21.15.102:0/2663888932 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5ae00ae9f0 0x7f5ae0144890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T18:41:57.096 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:57.088+0000 7f5ae4e5a640 1 --2- 172.21.15.102:0/2663888932 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f5ac00664a0 0x7f5ac0068960 unknown :-1 s=CLOSED pgs=771 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T18:41:57.096 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:57.088+0000 7f5ae4e5a640 1 --2- 172.21.15.102:0/2663888932 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5ae006b250 0x7f5ae00cd4e0 unknown :-1 s=CLOSED pgs=1969 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T18:41:57.096 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:57.088+0000 7f5ae4e5a640 1 -- 172.21.15.102:0/2663888932 >> 172.21.15.102:0/2663888932 conn(0x7f5ae0070590 msgr2=0x7f5ae00ad9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-13T18:41:57.097 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:57.088+0000 7f5ae4e5a640 1 -- 172.21.15.102:0/2663888932 shutdown_connections 2023-11-13T18:41:57.097 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:41:57.088+0000 7f5ae4e5a640 1 -- 172.21.15.102:0/2663888932 wait complete. 2023-11-13T18:41:57.143 INFO:teuthology.orchestra.run.smithi102.stdout:{"pg_ready":true,"pg_map":{"version":13019,"stamp":"2023-11-13T18:41:55.990350+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":12214944,"kb_used_data":4832,"kb_used_omap":4022,"kb_used_meta":12206025,"kb_avail":742759776,"statfs":{"total":773094113280,"available":760586010624,"internally_reserved":0,"allocated":4947968,"data_stored":2673886,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4119414,"internal_metadata":12498969738},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1739,"apply_latency_ms":1739,"commit_latency_ns":1739000000,"apply_latency_ns":1739000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005274"},"pg_stats":[{"pgid":"1.0","version":"41'119","reported_seq":401,"reported_epoch":41,"state":"active+clean+scrubbing+deep","last_fresh":"2023-11-13T18:41:54.655140+0000","last_change":"2023-11-13T18:41:51.680784+0000","last_active":"2023-11-13T18:41:54.655140+0000","last_peered":"2023-11-13T18:41:54.655140+0000","last_clean":"2023-11-13T18:41:54.655140+0000","last_became_active":"2023-11-13T11:28:47.001494+0000","last_became_peered":"2023-11-13T11:28:47.001494+0000","last_unstale":"2023-11-13T18:41:54.655140+0000","last_undegraded":"2023-11-13T18:41:54.655140+0000","last_fullsized":"2023-11-13T18:41:54.655140+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-13T11:28:45.879416+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-13T11:28:45.879416+0000","last_clean_scrub_stamp":"2023-11-13T11:28:45.879416+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 2s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":15,"seq":64424514639,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":1669460,"kb_used_data":460,"kb_used_omap":112,"kb_used_meta":1668879,"kb_avail":92702380,"statfs":{"total":96636764160,"available":94927237120,"internally_reserved":0,"allocated":471040,"data_stored":186886,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":115290,"internal_metadata":1708932518},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Nov 13 18:41:27 2023","interfaces":[{"interface":"back","average":{"1min":1.6399999999999999,"5min":1.431,"15min":1.4550000000000001},"min":{"1min":0.377,"5min":0.35899999999999999,"15min":0.307},"max":{"1min":4.843,"5min":7.2640000000000002,"15min":10.75},"last":0.38100000000000001},{"interface":"front","average":{"1min":1.8700000000000001,"5min":1.7070000000000001,"15min":1.5589999999999999},"min":{"1min":0.48899999999999999,"5min":0.36899999999999999,"15min":0.317},"max":{"1min":5.8250000000000002,"5min":8.3000000000000007,"15min":8.3000000000000007},"last":0.76900000000000002}]},{"osd":1,"last update":"Mon Nov 13 18:41:27 2023","interfaces":[{"interface":"back","average":{"1min":1.4670000000000001,"5min":1.506,"15min":1.526},"min":{"1min":0.45300000000000001,"5min":0.439,"15min":0.39100000000000001},"max":{"1min":8.0519999999999996,"5min":8.0519999999999996,"15min":8.0519999999999996},"last":0.434},{"interface":"front","average":{"1min":2.2109999999999999,"5min":1.5569999999999999,"15min":1.6739999999999999},"min":{"1min":0.38500000000000001,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":7.9489999999999998,"5min":7.9489999999999998,"15min":9.1679999999999993},"last":0.70699999999999996}]},{"osd":2,"last update":"Mon Nov 13 18:41:27 2023","interfaces":[{"interface":"back","average":{"1min":1.526,"5min":1.6439999999999999,"15min":1.786},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":5.532,"5min":8.7929999999999993,"15min":13.769},"last":0.67400000000000004},{"interface":"front","average":{"1min":1.7450000000000001,"5min":1.5189999999999999,"15min":1.6839999999999999},"min":{"1min":0.55200000000000005,"5min":0.42699999999999999,"15min":0.42199999999999999},"max":{"1min":6.3730000000000002,"5min":9.7799999999999994,"15min":16.114999999999998},"last":0.65100000000000002}]},{"osd":3,"last update":"Mon Nov 13 18:41:27 2023","interfaces":[{"interface":"back","average":{"1min":2.0880000000000001,"5min":1.899,"15min":1.7470000000000001},"min":{"1min":0.64200000000000002,"5min":0.438,"15min":0.38500000000000001},"max":{"1min":6.7960000000000003,"5min":7.5999999999999996,"15min":8.9459999999999997},"last":0.56100000000000005},{"interface":"front","average":{"1min":4.0709999999999997,"5min":2.1419999999999999,"15min":1.954},"min":{"1min":0.46600000000000003,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":47.872,"5min":47.872,"15min":47.872},"last":0.92600000000000005}]},{"osd":4,"last update":"Mon Nov 13 18:41:27 2023","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.73399999999999999,"15min":0.61299999999999999},"min":{"1min":0.40999999999999998,"5min":0.35099999999999998,"15min":0.32400000000000001},"max":{"1min":1.5309999999999999,"5min":7.8949999999999996,"15min":7.8949999999999996},"last":0.47599999999999998},{"interface":"front","average":{"1min":0.66700000000000004,"5min":0.69099999999999995,"15min":0.61599999999999999},"min":{"1min":0.46700000000000003,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":1.851,"5min":7.5179999999999998,"15min":7.5179999999999998},"last":0.58299999999999996}]},{"osd":5,"last update":"Mon Nov 13 18:41:27 2023","interfaces":[{"interface":"back","average":{"1min":1.0900000000000001,"5min":0.85199999999999998,"15min":0.70899999999999996},"min":{"1min":0.45900000000000002,"5min":0.36499999999999999,"15min":0.36399999999999999},"max":{"1min":9.968,"5min":9.968,"15min":9.968},"last":0.59999999999999998},{"interface":"front","average":{"1min":1.389,"5min":0.998,"15min":0.752},"min":{"1min":0.48799999999999999,"5min":0.379,"15min":0.379},"max":{"1min":13.734999999999999,"5min":13.734999999999999,"15min":13.734999999999999},"last":0.54300000000000004}]},{"osd":7,"last update":"Mon Nov 13 18:41:27 2023","interfaces":[{"interface":"back","average":{"1min":0.69799999999999995,"5min":0.81000000000000005,"15min":0.72999999999999998},"min":{"1min":0.51700000000000002,"5min":0.39800000000000002,"15min":0.378},"max":{"1min":1.891,"5min":7.5609999999999999,"15min":7.5609999999999999},"last":0.52600000000000002},{"interface":"front","average":{"1min":0.79700000000000004,"5min":0.91400000000000003,"15min":0.77400000000000002},"min":{"1min":0.52900000000000003,"5min":0.40899999999999997,"15min":0.40699999999999997},"max":{"1min":2.2869999999999999,"5min":7.9880000000000004,"15min":7.9880000000000004},"last":0.63900000000000001}]}]},{"osd":5,"up_from":15,"seq":64424514639,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1588244,"kb_used_data":1036,"kb_used_omap":582,"kb_used_meta":1586617,"kb_avail":92783596,"statfs":{"total":96636764160,"available":95010402304,"internally_reserved":0,"allocated":1060864,"data_stored":776285,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":596886,"internal_metadata":1624695914},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Nov 13 18:41:48 2023","interfaces":[{"interface":"back","average":{"1min":1.881,"5min":1.8959999999999999,"15min":1.766},"min":{"1min":0.40000000000000002,"5min":0.307,"15min":0.307},"max":{"1min":13.648,"5min":22.651,"15min":41.409999999999997},"last":0.68600000000000005},{"interface":"front","average":{"1min":1.536,"5min":1.865,"15min":2.0150000000000001},"min":{"1min":0.41399999999999998,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":9.3599999999999994,"5min":19.431999999999999,"15min":44.783000000000001},"last":0.70299999999999996}]},{"osd":1,"last update":"Mon Nov 13 18:41:48 2023","interfaces":[{"interface":"back","average":{"1min":2.2919999999999998,"5min":1.869,"15min":1.8480000000000001},"min":{"1min":0.67200000000000004,"5min":0.41199999999999998,"15min":0.374},"max":{"1min":9.7739999999999991,"5min":22.616,"15min":22.616},"last":0.81699999999999995},{"interface":"front","average":{"1min":1.8180000000000001,"5min":1.972,"15min":1.6879999999999999},"min":{"1min":0.71999999999999997,"5min":0.46600000000000003,"15min":0.38300000000000001},"max":{"1min":5.7199999999999998,"5min":22.231000000000002,"15min":22.231000000000002},"last":0.73999999999999999}]},{"osd":2,"last update":"Mon Nov 13 18:41:48 2023","interfaces":[{"interface":"back","average":{"1min":1.9650000000000001,"5min":1.9350000000000001,"15min":1.9670000000000001},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":12.375999999999999,"5min":13.291,"15min":45.125},"last":0.79200000000000004},{"interface":"front","average":{"1min":2.3109999999999999,"5min":2.0009999999999999,"15min":1.99},"min":{"1min":0.61099999999999999,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":12.436999999999999,"5min":14.776,"15min":44.991},"last":1.248}]},{"osd":3,"last update":"Mon Nov 13 18:41:48 2023","interfaces":[{"interface":"back","average":{"1min":1.633,"5min":2.0800000000000001,"15min":1.9810000000000001},"min":{"1min":0.71899999999999997,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":7.6159999999999997,"5min":55.082999999999998,"15min":55.082999999999998},"last":1.0680000000000001},{"interface":"front","average":{"1min":1.6579999999999999,"5min":2.1899999999999999,"15min":2.04},"min":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.42899999999999999},"max":{"1min":7.4660000000000002,"5min":55.040999999999997,"15min":55.040999999999997},"last":1.0349999999999999}]},{"osd":4,"last update":"Mon Nov 13 18:41:48 2023","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":0.71399999999999997,"15min":0.59099999999999997},"min":{"1min":0.32200000000000001,"5min":0.308,"15min":0.28599999999999998},"max":{"1min":1.341,"5min":7.3869999999999996,"15min":7.3869999999999996},"last":0.72699999999999998},{"interface":"front","average":{"1min":0.70199999999999996,"5min":0.79400000000000004,"15min":0.65600000000000003},"min":{"1min":0.47899999999999998,"5min":0.41199999999999998,"15min":0.33700000000000002},"max":{"1min":1.5189999999999999,"5min":7.4329999999999998,"15min":7.4329999999999998},"last":0.66500000000000004}]},{"osd":6,"last update":"Mon Nov 13 18:41:48 2023","interfaces":[{"interface":"back","average":{"1min":0.58099999999999996,"5min":0.77300000000000002,"15min":0.629},"min":{"1min":0.33700000000000002,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":1.0209999999999999,"5min":8.2690000000000001,"15min":8.2690000000000001},"last":0.56399999999999995},{"interface":"front","average":{"1min":0.626,"5min":0.98299999999999998,"15min":0.71199999999999997},"min":{"1min":0.35999999999999999,"5min":0.35399999999999998,"15min":0.33900000000000002},"max":{"1min":1.2010000000000001,"5min":22.547999999999998,"15min":22.547999999999998},"last":0.75900000000000001}]},{"osd":7,"last update":"Mon Nov 13 18:41:48 2023","interfaces":[{"interface":"back","average":{"1min":0.70799999999999996,"5min":0.79800000000000004,"15min":0.66400000000000003},"min":{"1min":0.41799999999999998,"5min":0.40799999999999997,"15min":0.37},"max":{"1min":1.3919999999999999,"5min":10.66,"15min":10.66},"last":0.58699999999999997},{"interface":"front","average":{"1min":0.65400000000000003,"5min":0.77600000000000002,"15min":0.67000000000000004},"min":{"1min":0.372,"5min":0.372,"15min":0.36399999999999999},"max":{"1min":1.5820000000000001,"5min":3.9809999999999999,"15min":3.9809999999999999},"last":0.628}]}]},{"osd":4,"up_from":15,"seq":64424514639,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":1463636,"kb_used_data":460,"kb_used_omap":965,"kb_used_meta":1462202,"kb_avail":92908204,"statfs":{"total":96636764160,"available":95138000896,"internally_reserved":0,"allocated":471040,"data_stored":186886,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":988456,"internal_metadata":1497295576},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Nov 13 18:41:44 2023","interfaces":[{"interface":"back","average":{"1min":3.1509999999999998,"5min":1.909,"15min":1.9650000000000001},"min":{"1min":0.44700000000000001,"5min":0.34499999999999997,"15min":0.316},"max":{"1min":15.737,"5min":18.532,"15min":88.278000000000006},"last":0.52500000000000002},{"interface":"front","average":{"1min":2.9380000000000002,"5min":1.6120000000000001,"15min":1.857},"min":{"1min":0.51700000000000002,"5min":0.372,"15min":0.33900000000000002},"max":{"1min":16.440999999999999,"5min":16.440999999999999,"15min":88.555000000000007},"last":0.48599999999999999}]},{"osd":1,"last update":"Mon Nov 13 18:41:44 2023","interfaces":[{"interface":"back","average":{"1min":1.9179999999999999,"5min":2.0299999999999998,"15min":2.113},"min":{"1min":0.46300000000000002,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":9.2100000000000009,"5min":20.643000000000001,"15min":85.168999999999997},"last":0.78800000000000003},{"interface":"front","average":{"1min":2.2610000000000001,"5min":1.8799999999999999,"15min":2.0150000000000001},"min":{"1min":0.51300000000000001,"5min":0.376,"15min":0.376},"max":{"1min":17.658999999999999,"5min":24.550999999999998,"15min":85.587999999999994},"last":0.64400000000000002}]},{"osd":2,"last update":"Mon Nov 13 18:41:44 2023","interfaces":[{"interface":"back","average":{"1min":3.2210000000000001,"5min":1.962,"15min":1.774},"min":{"1min":0.66900000000000004,"5min":0.42799999999999999,"15min":0.38600000000000001},"max":{"1min":17.603000000000002,"5min":17.603000000000002,"15min":17.603000000000002},"last":0.69499999999999995},{"interface":"front","average":{"1min":3.2589999999999999,"5min":2.1840000000000002,"15min":1.694},"min":{"1min":0.49199999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":40.225999999999999,"5min":40.225999999999999,"15min":40.225999999999999},"last":0.67200000000000004}]},{"osd":3,"last update":"Mon Nov 13 18:41:44 2023","interfaces":[{"interface":"back","average":{"1min":2.274,"5min":2.097,"15min":1.8939999999999999},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":9.8620000000000001,"5min":9.8620000000000001,"15min":11.146000000000001},"last":0.85299999999999998},{"interface":"front","average":{"1min":2.464,"5min":2.2130000000000001,"15min":1.9570000000000001},"min":{"1min":0.55400000000000005,"5min":0.53000000000000003,"15min":0.46300000000000002},"max":{"1min":12.220000000000001,"5min":12.220000000000001,"15min":12.220000000000001},"last":0.93799999999999994}]},{"osd":5,"last update":"Mon Nov 13 18:41:44 2023","interfaces":[{"interface":"back","average":{"1min":1.369,"5min":0.72899999999999998,"15min":0.58399999999999996},"min":{"1min":0.36899999999999999,"5min":0.34799999999999998,"15min":0.30199999999999999},"max":{"1min":11.022,"5min":11.022,"15min":11.022},"last":0.40000000000000002},{"interface":"front","average":{"1min":1.869,"5min":0.82499999999999996,"15min":0.65100000000000002},"min":{"1min":0.34999999999999998,"5min":0.34100000000000003,"15min":0.309},"max":{"1min":12.23,"5min":12.23,"15min":12.23},"last":0.372}]},{"osd":6,"last update":"Mon Nov 13 18:41:44 2023","interfaces":[{"interface":"back","average":{"1min":1.7629999999999999,"5min":0.89500000000000002,"15min":0.69199999999999995},"min":{"1min":0.38900000000000001,"5min":0.314,"15min":0.314},"max":{"1min":10.839,"5min":10.839,"15min":10.839},"last":0.504},{"interface":"front","average":{"1min":1.659,"5min":0.86199999999999999,"15min":0.70399999999999996},"min":{"1min":0.46999999999999997,"5min":0.37,"15min":0.37},"max":{"1min":9.2949999999999999,"5min":9.2949999999999999,"15min":9.2949999999999999},"last":0.46600000000000003}]},{"osd":7,"last update":"Mon Nov 13 18:41:44 2023","interfaces":[{"interface":"back","average":{"1min":1.9039999999999999,"5min":0.95699999999999996,"15min":0.748},"min":{"1min":0.42299999999999999,"5min":0.374,"15min":0.35899999999999999},"max":{"1min":9.9570000000000007,"5min":9.9570000000000007,"15min":9.9570000000000007},"last":0.42399999999999999},{"interface":"front","average":{"1min":1.387,"5min":0.90000000000000002,"15min":0.75900000000000001},"min":{"1min":0.46800000000000003,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":10.755000000000001,"5min":10.755000000000001,"15min":10.755000000000001},"last":0.56200000000000006}]}]},{"osd":3,"up_from":15,"seq":64424514582,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":1234324,"kb_used_data":460,"kb_used_omap":1151,"kb_used_meta":1232704,"kb_avail":93137516,"statfs":{"total":96636764160,"available":95372816384,"internally_reserved":0,"allocated":471040,"data_stored":186886,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1178987,"internal_metadata":1262289557},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Nov 13 18:40:54 2023","interfaces":[{"interface":"back","average":{"1min":3.7240000000000002,"5min":3.4089999999999998,"15min":3.306},"min":{"1min":0.54800000000000004,"5min":0.377,"15min":0.311},"max":{"1min":23.887,"5min":23.887,"15min":23.887},"last":1.054},{"interface":"front","average":{"1min":6.5469999999999997,"5min":3.54,"15min":3.4470000000000001},"min":{"1min":0.70299999999999996,"5min":0.52100000000000002,"15min":0.35799999999999998},"max":{"1min":48.045999999999999,"5min":48.045999999999999,"15min":48.045999999999999},"last":2.0600000000000001}]},{"osd":1,"last update":"Mon Nov 13 18:40:54 2023","interfaces":[{"interface":"back","average":{"1min":3.036,"5min":3.1019999999999999,"15min":3.54},"min":{"1min":0.60699999999999998,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":11.631,"5min":23.428000000000001,"15min":100.48},"last":2.117},{"interface":"front","average":{"1min":3.6779999999999999,"5min":3.5710000000000002,"15min":3.4969999999999999},"min":{"1min":0.63700000000000001,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":13.286,"5min":21.818999999999999,"15min":21.818999999999999},"last":1.256}]},{"osd":2,"last update":"Mon Nov 13 18:40:54 2023","interfaces":[{"interface":"back","average":{"1min":6.6559999999999997,"5min":3.8809999999999998,"15min":4.0259999999999998},"min":{"1min":0.67600000000000005,"5min":0.53600000000000003,"15min":0.53200000000000003},"max":{"1min":21.638999999999999,"5min":22.738,"15min":100.589},"last":1.478},{"interface":"front","average":{"1min":3.3759999999999999,"5min":3.6099999999999999,"15min":3.617},"min":{"1min":0.74399999999999999,"5min":0.63900000000000001,"15min":0.439},"max":{"1min":8.3759999999999994,"5min":21.300999999999998,"15min":21.300999999999998},"last":0.93300000000000005}]},{"osd":4,"last update":"Mon Nov 13 18:40:54 2023","interfaces":[{"interface":"back","average":{"1min":4.2240000000000002,"5min":2.7269999999999999,"15min":2.637},"min":{"1min":0.69999999999999996,"5min":0.55700000000000005,"15min":0.46200000000000002},"max":{"1min":26.68,"5min":26.68,"15min":26.68},"last":2.1720000000000002},{"interface":"front","average":{"1min":3.625,"5min":2.9060000000000001,"15min":2.5979999999999999},"min":{"1min":0.70899999999999996,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":17.091000000000001,"5min":23.655999999999999,"15min":23.655999999999999},"last":1.7629999999999999}]},{"osd":5,"last update":"Mon Nov 13 18:40:54 2023","interfaces":[{"interface":"back","average":{"1min":3.8359999999999999,"5min":3.028,"15min":2.778},"min":{"1min":0.64700000000000002,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":21.454999999999998,"5min":23.75,"15min":23.75},"last":1.972},{"interface":"front","average":{"1min":2.5859999999999999,"5min":2.9470000000000001,"15min":2.7810000000000001},"min":{"1min":0.98499999999999999,"5min":0.66900000000000004,"15min":0.46700000000000003},"max":{"1min":7.9420000000000002,"5min":22.007000000000001,"15min":22.007000000000001},"last":1.1619999999999999}]},{"osd":6,"last update":"Mon Nov 13 18:40:54 2023","interfaces":[{"interface":"back","average":{"1min":4.218,"5min":2.919,"15min":2.782},"min":{"1min":0.83899999999999997,"5min":0.626,"15min":0.52500000000000002},"max":{"1min":26.844999999999999,"5min":26.844999999999999,"15min":26.844999999999999},"last":1.913},{"interface":"front","average":{"1min":3.9020000000000001,"5min":3.1419999999999999,"15min":3.218},"min":{"1min":0.67800000000000005,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":21.555,"5min":23.841000000000001,"15min":100.315},"last":1.8819999999999999}]},{"osd":7,"last update":"Mon Nov 13 18:40:54 2023","interfaces":[{"interface":"back","average":{"1min":3.1739999999999999,"5min":3.2069999999999999,"15min":3.0059999999999998},"min":{"1min":1.0369999999999999,"5min":0.749,"15min":0.55500000000000005},"max":{"1min":12.794,"5min":22.087,"15min":22.087},"last":1.3480000000000001},{"interface":"front","average":{"1min":4.9820000000000002,"5min":3.1230000000000002,"15min":2.9900000000000002},"min":{"1min":1.0209999999999999,"5min":0.621,"15min":0.55500000000000005},"max":{"1min":26.939,"5min":26.939,"15min":26.939},"last":2.27}]}]},{"osd":2,"up_from":15,"seq":64424514580,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":1718868,"kb_used_data":460,"kb_used_omap":688,"kb_used_meta":1717711,"kb_avail":92652972,"statfs":{"total":96636764160,"available":94876643328,"internally_reserved":0,"allocated":471040,"data_stored":186886,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":705113,"internal_metadata":1758936487},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1738,"apply_latency_ms":1738,"commit_latency_ns":1738000000,"apply_latency_ns":1738000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Nov 13 18:41:20 2023","interfaces":[{"interface":"back","average":{"1min":3.8010000000000002,"5min":3.2360000000000002,"15min":3.1880000000000002},"min":{"1min":0.50600000000000001,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":32.695999999999998,"5min":32.695999999999998,"15min":32.695999999999998},"last":1.085},{"interface":"front","average":{"1min":4.8170000000000002,"5min":3.254,"15min":3.258},"min":{"1min":0.71999999999999997,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":31.927,"5min":31.927,"15min":31.927},"last":0.98799999999999999}]},{"osd":1,"last update":"Mon Nov 13 18:41:20 2023","interfaces":[{"interface":"back","average":{"1min":2.5430000000000001,"5min":2.8119999999999998,"15min":3.2949999999999999},"min":{"1min":0.58199999999999996,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":7.6050000000000004,"5min":14.593,"15min":19.190999999999999},"last":0.63},{"interface":"front","average":{"1min":2.984,"5min":3.613,"15min":3.6469999999999998},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":9.8849999999999998,"5min":22.782,"15min":22.782},"last":1.2}]},{"osd":3,"last update":"Mon Nov 13 18:41:20 2023","interfaces":[{"interface":"back","average":{"1min":3.472,"5min":3.3849999999999998,"15min":3.3969999999999998},"min":{"1min":0.64600000000000002,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":23.966999999999999,"5min":27.233000000000001,"15min":27.233000000000001},"last":1.0649999999999999},{"interface":"front","average":{"1min":3.359,"5min":3.1059999999999999,"15min":3.516},"min":{"1min":0.68600000000000005,"5min":0.52300000000000002,"15min":0.40799999999999997},"max":{"1min":13.298,"5min":14.244999999999999,"15min":20.870000000000001},"last":0.55100000000000005}]},{"osd":4,"last update":"Mon Nov 13 18:41:20 2023","interfaces":[{"interface":"back","average":{"1min":3.3199999999999998,"5min":2.4460000000000002,"15min":2.7589999999999999},"min":{"1min":0.61699999999999999,"5min":0.46600000000000003,"15min":0.45400000000000001},"max":{"1min":29.552,"5min":29.552,"15min":29.552},"last":0.67600000000000005},{"interface":"front","average":{"1min":3.5760000000000001,"5min":2.7240000000000002,"15min":2.7010000000000001},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":24.064,"5min":24.064,"15min":24.064},"last":1.1000000000000001}]},{"osd":5,"last update":"Mon Nov 13 18:41:20 2023","interfaces":[{"interface":"back","average":{"1min":3.1150000000000002,"5min":3.0419999999999998,"15min":2.7799999999999998},"min":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.55900000000000005},"max":{"1min":23.722999999999999,"5min":30.375,"15min":30.375},"last":0.96999999999999997},{"interface":"front","average":{"1min":2.5739999999999998,"5min":2.3980000000000001,"15min":2.831},"min":{"1min":0.64600000000000002,"5min":0.51900000000000002,"15min":0.49399999999999999},"max":{"1min":12.026,"5min":14.148999999999999,"15min":14.148999999999999},"last":0.74299999999999999}]},{"osd":6,"last update":"Mon Nov 13 18:41:20 2023","interfaces":[{"interface":"back","average":{"1min":3.573,"5min":2.8159999999999998,"15min":2.8399999999999999},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":21.073,"5min":21.073,"15min":21.073},"last":1.4219999999999999},{"interface":"front","average":{"1min":3.9820000000000002,"5min":3.2930000000000001,"15min":3.0310000000000001},"min":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":35.908999999999999,"5min":35.908999999999999,"15min":35.908999999999999},"last":0.93300000000000005}]},{"osd":7,"last update":"Mon Nov 13 18:41:20 2023","interfaces":[{"interface":"back","average":{"1min":3.6829999999999998,"5min":3.0299999999999998,"15min":2.988},"min":{"1min":0.66600000000000004,"5min":0.57899999999999996,"15min":0.55300000000000005},"max":{"1min":20.969000000000001,"5min":20.969000000000001,"15min":20.969000000000001},"last":1.3120000000000001},{"interface":"front","average":{"1min":3.5419999999999998,"5min":3.387,"15min":3.1339999999999999},"min":{"1min":0.80700000000000005,"5min":0.748,"15min":0.63400000000000001},"max":{"1min":23.847000000000001,"5min":26.902000000000001,"15min":26.902000000000001},"last":0.89500000000000002}]}]},{"osd":1,"up_from":15,"seq":64424514595,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1515352,"kb_used_data":1040,"kb_used_omap":147,"kb_used_meta":1514156,"kb_avail":92856488,"statfs":{"total":96636764160,"available":95085043712,"internally_reserved":0,"allocated":1064960,"data_stored":777254,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":150803,"internal_metadata":1550496493},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Nov 13 18:41:25 2023","interfaces":[{"interface":"back","average":{"1min":2.569,"5min":2.7400000000000002,"15min":2.8730000000000002},"min":{"1min":0.67000000000000004,"5min":0.435,"15min":0.29299999999999998},"max":{"1min":8.0800000000000001,"5min":11.255000000000001,"15min":14.548999999999999},"last":1.4510000000000001},{"interface":"front","average":{"1min":2.2589999999999999,"5min":3.2450000000000001,"15min":3.3519999999999999},"min":{"1min":0.47399999999999998,"5min":0.45300000000000001,"15min":0.38300000000000001},"max":{"1min":4.2030000000000003,"5min":26.187999999999999,"15min":26.187999999999999},"last":0.79200000000000004}]},{"osd":2,"last update":"Mon Nov 13 18:41:25 2023","interfaces":[{"interface":"back","average":{"1min":2.9590000000000001,"5min":2.9460000000000002,"15min":2.964},"min":{"1min":0.55800000000000005,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":8.2059999999999995,"5min":11.381,"15min":12.708},"last":0.97999999999999998},{"interface":"front","average":{"1min":2.3610000000000002,"5min":3.3839999999999999,"15min":3.21},"min":{"1min":0.69499999999999995,"5min":0.54300000000000004,"15min":0.44},"max":{"1min":4.3109999999999999,"5min":27.844999999999999,"15min":27.844999999999999},"last":0.92600000000000005}]},{"osd":3,"last update":"Mon Nov 13 18:41:25 2023","interfaces":[{"interface":"back","average":{"1min":3.0779999999999998,"5min":3.7280000000000002,"15min":3.5699999999999998},"min":{"1min":0.872,"5min":0.66400000000000003,"15min":0.44400000000000001},"max":{"1min":8.5470000000000006,"5min":27.838999999999999,"15min":27.838999999999999},"last":1.1419999999999999},{"interface":"front","average":{"1min":2.286,"5min":2.948,"15min":3.1920000000000002},"min":{"1min":0.61799999999999999,"5min":0.50800000000000001,"15min":0.436},"max":{"1min":4.2190000000000003,"5min":12.034000000000001,"15min":15.619},"last":1.1759999999999999}]},{"osd":4,"last update":"Mon Nov 13 18:41:25 2023","interfaces":[{"interface":"back","average":{"1min":2.0259999999999998,"5min":2.782,"15min":2.617},"min":{"1min":0.71499999999999997,"5min":0.57999999999999996,"15min":0.46300000000000002},"max":{"1min":4.024,"5min":27.952000000000002,"15min":27.952000000000002},"last":1.321},{"interface":"front","average":{"1min":2.9049999999999998,"5min":2.714,"15min":2.4449999999999998},"min":{"1min":0.65800000000000003,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":8.3170000000000002,"5min":27.678999999999998,"15min":27.678999999999998},"last":1.5549999999999999}]},{"osd":5,"last update":"Mon Nov 13 18:41:25 2023","interfaces":[{"interface":"back","average":{"1min":3.044,"5min":3.073,"15min":2.6360000000000001},"min":{"1min":0.70299999999999996,"5min":0.54600000000000004,"15min":0.52500000000000002},"max":{"1min":8.5020000000000007,"5min":27.588999999999999,"15min":27.588999999999999},"last":1.6200000000000001},{"interface":"front","average":{"1min":2.4060000000000001,"5min":3.2229999999999999,"15min":2.7770000000000001},"min":{"1min":0.73499999999999999,"5min":0.69999999999999996,"15min":0.47299999999999998},"max":{"1min":4.282,"5min":26.579999999999998,"15min":26.579999999999998},"last":1.2629999999999999}]},{"osd":6,"last update":"Mon Nov 13 18:41:25 2023","interfaces":[{"interface":"back","average":{"1min":2.1749999999999998,"5min":3.157,"15min":2.8370000000000002},"min":{"1min":0.93700000000000006,"5min":0.54900000000000004,"15min":0.48299999999999998},"max":{"1min":4.5750000000000002,"5min":29.478999999999999,"15min":29.478999999999999},"last":1.4179999999999999},{"interface":"front","average":{"1min":3.0859999999999999,"5min":3.2229999999999999,"15min":2.8010000000000002},"min":{"1min":0.73999999999999999,"5min":0.57999999999999996,"15min":0.57999999999999996},"max":{"1min":8.4109999999999996,"5min":36.837000000000003,"15min":36.837000000000003},"last":1.6819999999999999}]},{"osd":7,"last update":"Mon Nov 13 18:41:25 2023","interfaces":[{"interface":"back","average":{"1min":2.5590000000000002,"5min":3.2959999999999998,"15min":2.8780000000000001},"min":{"1min":0.70199999999999996,"5min":0.626,"15min":0.54200000000000004},"max":{"1min":4.3879999999999999,"5min":26.622,"15min":26.622},"last":1.395},{"interface":"front","average":{"1min":2.3879999999999999,"5min":3.1619999999999999,"15min":2.9420000000000002},"min":{"1min":0.93400000000000005,"5min":0.65900000000000003,"15min":0.54100000000000004},"max":{"1min":5.2649999999999997,"5min":25.965,"15min":25.965},"last":1.5089999999999999}]}]},{"osd":0,"up_from":15,"seq":64424514588,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":1363152,"kb_used_data":456,"kb_used_omap":245,"kb_used_meta":1362442,"kb_avail":93008688,"statfs":{"total":96636764160,"available":95240896512,"internally_reserved":0,"allocated":466944,"data_stored":185917,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":251097,"internal_metadata":1395141415},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Nov 13 18:41:05 2023","interfaces":[{"interface":"back","average":{"1min":2.6619999999999999,"5min":2.569,"15min":3.3380000000000001},"min":{"1min":0.64500000000000002,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":6.29,"5min":8.3640000000000008,"15min":132.19800000000001},"last":1.2549999999999999},{"interface":"front","average":{"1min":2.6909999999999998,"5min":2.9169999999999998,"15min":3.4470000000000001},"min":{"1min":0.54500000000000004,"5min":0.46400000000000002,"15min":0.45900000000000002},"max":{"1min":11.978999999999999,"5min":13.000999999999999,"15min":125.517},"last":0.85199999999999998}]},{"osd":2,"last update":"Mon Nov 13 18:41:05 2023","interfaces":[{"interface":"back","average":{"1min":2.3439999999999999,"5min":2.8050000000000002,"15min":3.2269999999999999},"min":{"1min":0.65400000000000003,"5min":0.372,"15min":0.372},"max":{"1min":6.2320000000000002,"5min":8.8879999999999999,"15min":13.459},"last":1.0389999999999999},{"interface":"front","average":{"1min":4.1520000000000001,"5min":3.327,"15min":3.395},"min":{"1min":0.75900000000000001,"5min":0.66000000000000003,"15min":0.44800000000000001},"max":{"1min":16.423999999999999,"5min":16.423999999999999,"15min":16.423999999999999},"last":0.68600000000000005}]},{"osd":3,"last update":"Mon Nov 13 18:41:05 2023","interfaces":[{"interface":"back","average":{"1min":3.8980000000000001,"5min":3.1040000000000001,"15min":3.133},"min":{"1min":0.69399999999999995,"5min":0.69399999999999995,"15min":0.45900000000000002},"max":{"1min":15.502000000000001,"5min":15.502000000000001,"15min":15.502000000000001},"last":0.63800000000000001},{"interface":"front","average":{"1min":3.5019999999999998,"5min":3.3010000000000002,"15min":3.5459999999999998},"min":{"1min":0.70099999999999996,"5min":0.67900000000000005,"15min":0.441},"max":{"1min":15.955,"5min":15.955,"15min":20.747},"last":1.2989999999999999}]},{"osd":4,"last update":"Mon Nov 13 18:41:05 2023","interfaces":[{"interface":"back","average":{"1min":2.5750000000000002,"5min":2.2290000000000001,"15min":2.4689999999999999},"min":{"1min":0.77400000000000002,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":6.2539999999999996,"5min":9.3949999999999996,"15min":10.611000000000001},"last":0.78000000000000003},{"interface":"front","average":{"1min":2.4300000000000002,"5min":2.3260000000000001,"15min":2.6560000000000001},"min":{"1min":0.78800000000000003,"5min":0.51800000000000002,"15min":0.48899999999999999},"max":{"1min":5.9619999999999997,"5min":8.7780000000000005,"15min":12.353999999999999},"last":1.5700000000000001}]},{"osd":5,"last update":"Mon Nov 13 18:41:05 2023","interfaces":[{"interface":"back","average":{"1min":2.8170000000000002,"5min":2.3399999999999999,"15min":2.4849999999999999},"min":{"1min":0.66300000000000003,"5min":0.66300000000000003,"15min":0.501},"max":{"1min":12.470000000000001,"5min":12.470000000000001,"15min":12.470000000000001},"last":0.97399999999999998},{"interface":"front","average":{"1min":2.6709999999999998,"5min":2.3740000000000001,"15min":2.6309999999999998},"min":{"1min":0.81599999999999995,"5min":0.63700000000000001,"15min":0.50600000000000001},"max":{"1min":6.3810000000000002,"5min":9.516,"15min":9.9640000000000004},"last":0.73399999999999999}]},{"osd":6,"last update":"Mon Nov 13 18:41:05 2023","interfaces":[{"interface":"back","average":{"1min":2.8660000000000001,"5min":2.532,"15min":2.8599999999999999},"min":{"1min":0.92400000000000004,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":13.348000000000001,"5min":13.348000000000001,"15min":13.348000000000001},"last":1.518},{"interface":"front","average":{"1min":2.629,"5min":2.4319999999999999,"15min":2.6360000000000001},"min":{"1min":0.84599999999999997,"5min":0.60499999999999998,"15min":0.56799999999999995},"max":{"1min":12.191000000000001,"5min":12.191000000000001,"15min":12.191000000000001},"last":1.109}]},{"osd":7,"last update":"Mon Nov 13 18:41:05 2023","interfaces":[{"interface":"back","average":{"1min":2.8999999999999999,"5min":2.5859999999999999,"15min":2.742},"min":{"1min":0.76000000000000001,"5min":0.64900000000000002,"15min":0.51400000000000001},"max":{"1min":12.289999999999999,"5min":12.289999999999999,"15min":12.289999999999999},"last":1.216},{"interface":"front","average":{"1min":2.9089999999999998,"5min":2.5489999999999999,"15min":2.7629999999999999},"min":{"1min":1.0409999999999999,"5min":0.64400000000000002,"15min":0.57499999999999996},"max":{"1min":6.4749999999999996,"5min":9.6199999999999992,"15min":10.743},"last":0.82299999999999995}]}]},{"osd":7,"up_from":14,"seq":60129547343,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":1661908,"kb_used_data":460,"kb_used_omap":129,"kb_used_meta":1661310,"kb_avail":92709932,"statfs":{"total":96636764160,"available":94934970368,"internally_reserved":0,"allocated":471040,"data_stored":186886,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":132782,"internal_metadata":1701181778},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Nov 13 18:41:38 2023","interfaces":[{"interface":"back","average":{"1min":2.0819999999999999,"5min":1.841,"15min":1.8100000000000001},"min":{"1min":0.39600000000000002,"5min":0.34100000000000003,"15min":0.30599999999999999},"max":{"1min":13.148999999999999,"5min":13.148999999999999,"15min":13.148999999999999},"last":0.51500000000000001},{"interface":"front","average":{"1min":1.887,"5min":1.8999999999999999,"15min":1.6599999999999999},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":8.2729999999999997,"5min":8.2729999999999997,"15min":9.266},"last":0.621}]},{"osd":1,"last update":"Mon Nov 13 18:41:38 2023","interfaces":[{"interface":"back","average":{"1min":1.581,"5min":2.0129999999999999,"15min":1.7589999999999999},"min":{"1min":0.51500000000000001,"5min":0.376,"15min":0.36399999999999999},"max":{"1min":7.7039999999999997,"5min":9.4909999999999997,"15min":9.4909999999999997},"last":0.58299999999999996},{"interface":"front","average":{"1min":1.843,"5min":2.036,"15min":1.8360000000000001},"min":{"1min":0.57199999999999995,"5min":0.47699999999999998,"15min":0.35599999999999998},"max":{"1min":6.9000000000000004,"5min":8.1280000000000001,"15min":9.4939999999999998},"last":0.60199999999999998}]},{"osd":2,"last update":"Mon Nov 13 18:41:38 2023","interfaces":[{"interface":"back","average":{"1min":3.8740000000000001,"5min":2.234,"15min":1.982},"min":{"1min":0.53800000000000003,"5min":0.51300000000000001,"15min":0.38400000000000001},"max":{"1min":27.635999999999999,"5min":27.635999999999999,"15min":27.635999999999999},"last":0.81200000000000006},{"interface":"front","average":{"1min":2.1600000000000001,"5min":2.008,"15min":1.8859999999999999},"min":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45100000000000001},"max":{"1min":12.868,"5min":12.868,"15min":12.868},"last":0.754}]},{"osd":3,"last update":"Mon Nov 13 18:41:38 2023","interfaces":[{"interface":"back","average":{"1min":1.409,"5min":1.71,"15min":1.7769999999999999},"min":{"1min":0.54000000000000004,"5min":0.442,"15min":0.442},"max":{"1min":3.988,"5min":13.727,"15min":13.727},"last":0.80000000000000004},{"interface":"front","average":{"1min":1.9419999999999999,"5min":1.6839999999999999,"15min":2.0049999999999999},"min":{"1min":0.64500000000000002,"5min":0.45700000000000002,"15min":0.44500000000000001},"max":{"1min":6.944,"5min":7.5199999999999996,"15min":11.156000000000001},"last":1.0449999999999999}]},{"osd":4,"last update":"Mon Nov 13 18:41:38 2023","interfaces":[{"interface":"back","average":{"1min":1.1240000000000001,"5min":0.71699999999999997,"15min":0.60399999999999998},"min":{"1min":0.36599999999999999,"5min":0.34499999999999997,"15min":0.32700000000000001},"max":{"1min":8.0259999999999998,"5min":8.0259999999999998,"15min":8.0259999999999998},"last":0.46500000000000002},{"interface":"front","average":{"1min":0.98999999999999999,"5min":1.2869999999999999,"15min":0.82299999999999995},"min":{"1min":0.38500000000000001,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":4.7649999999999997,"5min":38.662999999999997,"15min":38.662999999999997},"last":0.495}]},{"osd":5,"last update":"Mon Nov 13 18:41:38 2023","interfaces":[{"interface":"back","average":{"1min":1.516,"5min":0.83899999999999997,"15min":0.68500000000000005},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.32800000000000001},"max":{"1min":10.481,"5min":10.481,"15min":10.481},"last":0.55900000000000005},{"interface":"front","average":{"1min":1.1699999999999999,"5min":0.83199999999999996,"15min":0.68799999999999994},"min":{"1min":0.41199999999999998,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":8.1029999999999998,"5min":8.1029999999999998,"15min":8.1029999999999998},"last":0.53300000000000003}]},{"osd":6,"last update":"Mon Nov 13 18:41:38 2023","interfaces":[{"interface":"back","average":{"1min":1.3859999999999999,"5min":1.0409999999999999,"15min":0.78600000000000003},"min":{"1min":0.45900000000000002,"5min":0.43099999999999999,"15min":0.40200000000000002},"max":{"1min":11.182,"5min":19.218,"15min":19.218},"last":0.57099999999999995},{"interface":"front","average":{"1min":1.4530000000000001,"5min":1.0489999999999999,"15min":0.80400000000000005},"min":{"1min":0.46999999999999997,"5min":0.38,"15min":0.373},"max":{"1min":11.202999999999999,"5min":13.677,"15min":13.677},"last":0.435}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-13T18:41:57.151 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2023-11-13T11:28:45.879416+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=13, tm_hour=11, tm_min=28, tm_sec=45, tm_wday=0, tm_yday=317, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=13, tm_hour=18, tm_min=41, tm_sec=46, tm_wday=0, tm_yday=317, tm_isdst=0) 2023-11-13T18:41:57.151 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-11-13T18:42:02.722 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T18:42:02.731 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T18:42:17.152 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-13T18:42:17.560 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:42:17.556+0000 7fa853e68640 1 Processor -- start 2023-11-13T18:42:17.562 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:42:17.556+0000 7fa853e68640 1 -- start start 2023-11-13T18:42:17.564 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:42:17.560+0000 7fa853e68640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fa84c1606e0 0x7fa84c0c69b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T18:42:17.564 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:42:17.560+0000 7fa853e68640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa84c0d0c40 0x7fa84c0b3e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T18:42:17.565 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:42:17.560+0000 7fa853e68640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7fa84c0cf490 0x7fa84c0cf920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T18:42:17.565 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:42:17.560+0000 7fa853e68640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa84c0cfe60 con 0x7fa84c0cf490 2023-11-13T18:42:17.565 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:42:17.560+0000 7fa853e68640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa84c0d1440 con 0x7fa84c1606e0 2023-11-13T18:42:17.566 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:42:17.560+0000 7fa853e68640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa84c0cdb10 con 0x7fa84c0d0c40 2023-11-13T18:42:17.567 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:42:17.560+0000 7fa852405640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7fa84c0cf490 0x7fa84c0cf920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T18:42:17.567 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:42:17.560+0000 7fa852405640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7fa84c0cf490 0x7fa84c0cf920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:57164/0 (socket says 172.21.15.102:57164) 2023-11-13T18:42:17.567 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:42:17.560+0000 7fa852405640 1 -- 172.21.15.102:0/1226713371 learned_addr learned my addr 172.21.15.102:0/1226713371 (peer_addr_for_me v2:172.21.15.102:0/0) 2023-11-13T18:42:17.568 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:42:17.560+0000 7fa851403640 1 --2- 172.21.15.102:0/1226713371 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa84c0d0c40 0x7fa84c0b3e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T18:42:17.568 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:42:17.560+0000 7fa851c04640 1 --2- 172.21.15.102:0/1226713371 >> v2:172.21.15.154:3300/0 conn(0x7fa84c1606e0 0x7fa84c0c69b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T18:42:17.568 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:42:17.560+0000 7fa852405640 1 -- 172.21.15.102:0/1226713371 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa84c0d0c40 msgr2=0x7fa84c0b3e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-13T18:42:17.569 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:42:17.560+0000 7fa852405640 1 --2- 172.21.15.102:0/1226713371 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa84c0d0c40 0x7fa84c0b3e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T18:42:17.569 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:42:17.560+0000 7fa852405640 1 -- 172.21.15.102:0/1226713371 >> v2:172.21.15.154:3300/0 conn(0x7fa84c1606e0 msgr2=0x7fa84c0c69b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-13T18:42:17.569 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:42:17.560+0000 7fa852405640 1 --2- 172.21.15.102:0/1226713371 >> v2:172.21.15.154:3300/0 conn(0x7fa84c1606e0 0x7fa84c0c69b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T18:42:17.570 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:42:17.560+0000 7fa852405640 1 -- 172.21.15.102:0/1226713371 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa84c0d1690 con 0x7fa84c0cf490 2023-11-13T18:42:17.570 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:42:17.564+0000 7fa852405640 1 --2- 172.21.15.102:0/1226713371 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa84c0cf490 0x7fa84c0cf920 secure :-1 s=READY pgs=1970 cs=0 l=1 rev1=1 crypto rx=0x7fa84c08c0a0 tx=0x7fa84401c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8b176c5231359feb server_cookie=0 in_seq=0 out_seq=0 2023-11-13T18:42:17.571 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:42:17.564+0000 7fa850c02640 1 -- 172.21.15.102:0/1226713371 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8440a5750 con 0x7fa84c0cf490 2023-11-13T18:42:17.571 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:42:17.564+0000 7fa850c02640 1 -- 172.21.15.102:0/1226713371 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa8440a58b0 con 0x7fa84c0cf490 2023-11-13T18:42:17.572 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:42:17.564+0000 7fa850c02640 1 -- 172.21.15.102:0/1226713371 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8440a5c40 con 0x7fa84c0cf490 2023-11-13T18:42:17.573 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:42:17.564+0000 7fa853e68640 1 -- 172.21.15.102:0/1226713371 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa84c0cf490 msgr2=0x7fa84c0cf920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T18:42:17.573 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:42:17.564+0000 7fa853e68640 1 --2- 172.21.15.102:0/1226713371 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa84c0cf490 0x7fa84c0cf920 secure :-1 s=READY pgs=1970 cs=0 l=1 rev1=1 crypto rx=0x7fa84c08c0a0 tx=0x7fa84401c910 comp rx=0 tx=0).stop 2023-11-13T18:42:17.573 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:42:17.568+0000 7fa853e68640 1 -- 172.21.15.102:0/1226713371 shutdown_connections 2023-11-13T18:42:17.573 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:42:17.568+0000 7fa853e68640 1 --2- 172.21.15.102:0/1226713371 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa84c0cf490 0x7fa84c0cf920 unknown :-1 s=CLOSED pgs=1970 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T18:42:17.574 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:42:17.568+0000 7fa853e68640 1 --2- 172.21.15.102:0/1226713371 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa84c0d0c40 0x7fa84c0b3e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T18:42:17.574 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:42:17.568+0000 7fa853e68640 1 --2- 172.21.15.102:0/1226713371 >> v2:172.21.15.154:3300/0 conn(0x7fa84c1606e0 0x7fa84c0c69b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T18:42:17.574 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:42:17.568+0000 7fa853e68640 1 -- 172.21.15.102:0/1226713371 >> 172.21.15.102:0/1226713371 conn(0x7fa84c09c130 msgr2=0x7fa84c0d2e60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-13T18:42:17.575 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:42:17.568+0000 7fa853e68640 1 -- 172.21.15.102:0/1226713371 shutdown_connections 2023-11-13T18:42:17.575 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:42:17.568+0000 7fa853e68640 1 -- 172.21.15.102:0/1226713371 wait complete. 2023-11-13T18:42:17.576 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:42:17.572+0000 7fa853e68640 1 Processor -- start 2023-11-13T18:42:17.577 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:42:17.572+0000 7fa853e68640 1 -- start start 2023-11-13T18:42:17.580 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:42:17.576+0000 7fa853e68640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa84c0cf490 0x7fa84c14cc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T18:42:17.580 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:42:17.576+0000 7fa853e68640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa84c0d0c40 0x7fa84c1574a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T18:42:17.581 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:42:17.576+0000 7fa853e68640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa84c1606e0 0x7fa84c1579e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T18:42:17.581 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:42:17.576+0000 7fa853e68640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa84c151450 con 0x7fa84c0cf490 2023-11-13T18:42:17.581 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:42:17.576+0000 7fa853e68640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa84c150840 con 0x7fa84c0d0c40 2023-11-13T18:42:17.582 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:42:17.576+0000 7fa853e68640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa84c150b20 con 0x7fa84c1606e0 2023-11-13T18:42:17.583 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:42:17.576+0000 7fa851c04640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa84c0cf490 0x7fa84c14cc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T18:42:17.583 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:42:17.576+0000 7fa851403640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa84c0d0c40 0x7fa84c1574a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T18:42:17.584 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:42:17.576+0000 7fa851c04640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa84c0cf490 0x7fa84c14cc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:57170/0 (socket says 172.21.15.102:57170) 2023-11-13T18:42:17.584 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:42:17.576+0000 7fa852405640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa84c1606e0 0x7fa84c1579e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T18:42:17.584 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:42:17.576+0000 7fa851c04640 1 -- 172.21.15.102:0/814663192 learned_addr learned my addr 172.21.15.102:0/814663192 (peer_addr_for_me v2:172.21.15.102:0/0) 2023-11-13T18:42:17.585 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:42:17.576+0000 7fa852405640 1 -- 172.21.15.102:0/814663192 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa84c0d0c40 msgr2=0x7fa84c1574a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T18:42:17.585 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:42:17.576+0000 7fa852405640 1 --2- 172.21.15.102:0/814663192 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa84c0d0c40 0x7fa84c1574a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T18:42:17.585 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:42:17.576+0000 7fa852405640 1 -- 172.21.15.102:0/814663192 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa84c0cf490 msgr2=0x7fa84c14cc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T18:42:17.585 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:42:17.576+0000 7fa852405640 1 --2- 172.21.15.102:0/814663192 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa84c0cf490 0x7fa84c14cc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T18:42:17.586 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:42:17.576+0000 7fa852405640 1 -- 172.21.15.102:0/814663192 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa844009b30 con 0x7fa84c1606e0 2023-11-13T18:42:17.586 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:42:17.576+0000 7fa852405640 1 --2- 172.21.15.102:0/814663192 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa84c1606e0 0x7fa84c1579e0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7fa8440ab000 tx=0x7fa8440196b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-13T18:42:17.586 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:42:17.576+0000 7fa8427fc640 1 -- 172.21.15.102:0/814663192 <== mon.2 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8440b8670 con 0x7fa84c1606e0 2023-11-13T18:42:17.587 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:42:17.576+0000 7fa8427fc640 1 -- 172.21.15.102:0/814663192 <== mon.2 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa8440b87d0 con 0x7fa84c1606e0 2023-11-13T18:42:17.587 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:42:17.576+0000 7fa8427fc640 1 -- 172.21.15.102:0/814663192 <== mon.2 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8440b8b60 con 0x7fa84c1606e0 2023-11-13T18:42:17.587 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:42:17.576+0000 7fa853e68640 1 -- 172.21.15.102:0/814663192 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa84c150e00 con 0x7fa84c1606e0 2023-11-13T18:42:17.588 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:42:17.576+0000 7fa853e68640 1 -- 172.21.15.102:0/814663192 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa84c0b27c0 con 0x7fa84c1606e0 2023-11-13T18:42:17.589 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:42:17.580+0000 7fa8427fc640 1 -- 172.21.15.102:0/814663192 <== mon.2 v2:172.21.15.154:3301/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fa8440b8cc0 con 0x7fa84c1606e0 2023-11-13T18:42:17.589 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:42:17.580+0000 7fa853e68640 1 -- 172.21.15.102:0/814663192 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa84c068520 con 0x7fa84c1606e0 2023-11-13T18:42:17.589 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:42:17.580+0000 7fa8427fc640 1 --2- 172.21.15.102:0/814663192 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7fa830066470 0x7fa830068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T18:42:17.589 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:42:17.584+0000 7fa8427fc640 1 -- 172.21.15.102:0/814663192 <== mon.2 v2:172.21.15.154:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fa84411f130 con 0x7fa84c1606e0 2023-11-13T18:42:17.590 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:42:17.584+0000 7fa851c04640 1 --2- 172.21.15.102:0/814663192 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7fa830066470 0x7fa830068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T18:42:17.590 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:42:17.584+0000 7fa851c04640 1 --2- 172.21.15.102:0/814663192 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7fa830066470 0x7fa830068930 secure :-1 s=READY pgs=772 cs=0 l=1 rev1=1 crypto rx=0x7fa848007a70 tx=0x7fa848008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-13T18:42:17.591 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:42:17.584+0000 7fa8427fc640 1 -- 172.21.15.102:0/814663192 <== mon.2 v2:172.21.15.154:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fa8440ec9e0 con 0x7fa84c1606e0 2023-11-13T18:42:18.051 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:42:18.044+0000 7fa853e68640 1 -- 172.21.15.102:0/814663192 --> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fa84c0b1d90 con 0x7fa830066470 2023-11-13T18:42:18.056 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:42:18.052+0000 7fa8427fc640 1 -- 172.21.15.102:0/814663192 <== mgr.4103 v2:172.21.15.102:6832/1009482693 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+49259 (secure 0 0 0) 0x7fa84c0b1d90 con 0x7fa830066470 2023-11-13T18:42:18.057 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T18:42:18.058 INFO:teuthology.orchestra.run.smithi102.stderr:dumped all 2023-11-13T18:42:18.062 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:42:18.056+0000 7fa853e68640 1 -- 172.21.15.102:0/814663192 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7fa830066470 msgr2=0x7fa830068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T18:42:18.063 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:42:18.056+0000 7fa853e68640 1 --2- 172.21.15.102:0/814663192 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7fa830066470 0x7fa830068930 secure :-1 s=READY pgs=772 cs=0 l=1 rev1=1 crypto rx=0x7fa848007a70 tx=0x7fa848008040 comp rx=0 tx=0).stop 2023-11-13T18:42:18.063 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:42:18.056+0000 7fa853e68640 1 -- 172.21.15.102:0/814663192 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa84c1606e0 msgr2=0x7fa84c1579e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T18:42:18.063 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:42:18.056+0000 7fa853e68640 1 --2- 172.21.15.102:0/814663192 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa84c1606e0 0x7fa84c1579e0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7fa8440ab000 tx=0x7fa8440196b0 comp rx=0 tx=0).stop 2023-11-13T18:42:18.064 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:42:18.056+0000 7fa853e68640 1 -- 172.21.15.102:0/814663192 shutdown_connections 2023-11-13T18:42:18.064 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:42:18.056+0000 7fa853e68640 1 --2- 172.21.15.102:0/814663192 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa84c1606e0 0x7fa84c1579e0 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T18:42:18.065 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:42:18.056+0000 7fa853e68640 1 --2- 172.21.15.102:0/814663192 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa84c0d0c40 0x7fa84c1574a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T18:42:18.065 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:42:18.056+0000 7fa853e68640 1 --2- 172.21.15.102:0/814663192 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7fa830066470 0x7fa830068930 unknown :-1 s=CLOSED pgs=772 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T18:42:18.065 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:42:18.056+0000 7fa853e68640 1 --2- 172.21.15.102:0/814663192 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa84c0cf490 0x7fa84c14cc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T18:42:18.066 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:42:18.056+0000 7fa853e68640 1 -- 172.21.15.102:0/814663192 >> 172.21.15.102:0/814663192 conn(0x7fa84c09c130 msgr2=0x7fa84c06c4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-13T18:42:18.066 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:42:18.056+0000 7fa853e68640 1 -- 172.21.15.102:0/814663192 shutdown_connections 2023-11-13T18:42:18.067 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:42:18.056+0000 7fa853e68640 1 -- 172.21.15.102:0/814663192 wait complete. 2023-11-13T18:42:18.111 INFO:teuthology.orchestra.run.smithi102.stdout:{"pg_ready":true,"pg_map":{"version":13030,"stamp":"2023-11-13T18:42:17.996594+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":12214944,"kb_used_data":4832,"kb_used_omap":4022,"kb_used_meta":12206025,"kb_avail":742759776,"statfs":{"total":773094113280,"available":760586010624,"internally_reserved":0,"allocated":4947968,"data_stored":2673886,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4119414,"internal_metadata":12498969738},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003347"},"pg_stats":[{"pgid":"1.0","version":"41'119","reported_seq":407,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-11-13T18:41:54.659464+0000","last_change":"2023-11-13T18:41:54.659523+0000","last_active":"2023-11-13T18:41:54.659464+0000","last_peered":"2023-11-13T18:41:54.659464+0000","last_clean":"2023-11-13T18:41:54.659464+0000","last_became_active":"2023-11-13T11:28:47.001494+0000","last_became_peered":"2023-11-13T11:28:47.001494+0000","last_unstale":"2023-11-13T18:41:54.659464+0000","last_undegraded":"2023-11-13T18:41:54.659464+0000","last_fullsized":"2023-11-13T18:41:54.659464+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"41'119","last_scrub_stamp":"2023-11-13T18:41:54.659230+0000","last_deep_scrub":"41'119","last_deep_scrub_stamp":"2023-11-13T18:41:54.659230+0000","last_clean_scrub_stamp":"2023-11-13T18:41:54.659230+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":3,"scrub_schedule":"periodic scrub scheduled @ 2023-11-15T00:53:13.463263+0000","scrub_duration":2.96701419,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":15,"seq":64424514643,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":1669460,"kb_used_data":460,"kb_used_omap":112,"kb_used_meta":1668879,"kb_avail":92702380,"statfs":{"total":96636764160,"available":94927237120,"internally_reserved":0,"allocated":471040,"data_stored":186886,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":115290,"internal_metadata":1708932518},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Nov 13 18:41:27 2023","interfaces":[{"interface":"back","average":{"1min":1.6399999999999999,"5min":1.431,"15min":1.4550000000000001},"min":{"1min":0.377,"5min":0.35899999999999999,"15min":0.307},"max":{"1min":4.843,"5min":7.2640000000000002,"15min":10.75},"last":0.746},{"interface":"front","average":{"1min":1.8700000000000001,"5min":1.7070000000000001,"15min":1.5589999999999999},"min":{"1min":0.48899999999999999,"5min":0.36899999999999999,"15min":0.317},"max":{"1min":5.8250000000000002,"5min":8.3000000000000007,"15min":8.3000000000000007},"last":0.71699999999999997}]},{"osd":1,"last update":"Mon Nov 13 18:41:27 2023","interfaces":[{"interface":"back","average":{"1min":1.4670000000000001,"5min":1.506,"15min":1.526},"min":{"1min":0.45300000000000001,"5min":0.439,"15min":0.39100000000000001},"max":{"1min":8.0519999999999996,"5min":8.0519999999999996,"15min":8.0519999999999996},"last":0.84799999999999998},{"interface":"front","average":{"1min":2.2109999999999999,"5min":1.5569999999999999,"15min":1.6739999999999999},"min":{"1min":0.38500000000000001,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":7.9489999999999998,"5min":7.9489999999999998,"15min":9.1679999999999993},"last":0.91800000000000004}]},{"osd":2,"last update":"Mon Nov 13 18:41:27 2023","interfaces":[{"interface":"back","average":{"1min":1.526,"5min":1.6439999999999999,"15min":1.786},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":5.532,"5min":8.7929999999999993,"15min":13.769},"last":0.72899999999999998},{"interface":"front","average":{"1min":1.7450000000000001,"5min":1.5189999999999999,"15min":1.6839999999999999},"min":{"1min":0.55200000000000005,"5min":0.42699999999999999,"15min":0.42199999999999999},"max":{"1min":6.3730000000000002,"5min":9.7799999999999994,"15min":16.114999999999998},"last":1.0669999999999999}]},{"osd":3,"last update":"Mon Nov 13 18:41:27 2023","interfaces":[{"interface":"back","average":{"1min":2.0880000000000001,"5min":1.899,"15min":1.7470000000000001},"min":{"1min":0.64200000000000002,"5min":0.438,"15min":0.38500000000000001},"max":{"1min":6.7960000000000003,"5min":7.5999999999999996,"15min":8.9459999999999997},"last":0.82399999999999995},{"interface":"front","average":{"1min":4.0709999999999997,"5min":2.1419999999999999,"15min":1.954},"min":{"1min":0.46600000000000003,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":47.872,"5min":47.872,"15min":47.872},"last":0.69399999999999995}]},{"osd":4,"last update":"Mon Nov 13 18:41:27 2023","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.73399999999999999,"15min":0.61299999999999999},"min":{"1min":0.40999999999999998,"5min":0.35099999999999998,"15min":0.32400000000000001},"max":{"1min":1.5309999999999999,"5min":7.8949999999999996,"15min":7.8949999999999996},"last":0.88800000000000001},{"interface":"front","average":{"1min":0.66700000000000004,"5min":0.69099999999999995,"15min":0.61599999999999999},"min":{"1min":0.46700000000000003,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":1.851,"5min":7.5179999999999998,"15min":7.5179999999999998},"last":0.67800000000000005}]},{"osd":5,"last update":"Mon Nov 13 18:41:27 2023","interfaces":[{"interface":"back","average":{"1min":1.0900000000000001,"5min":0.85199999999999998,"15min":0.70899999999999996},"min":{"1min":0.45900000000000002,"5min":0.36499999999999999,"15min":0.36399999999999999},"max":{"1min":9.968,"5min":9.968,"15min":9.968},"last":0.57299999999999995},{"interface":"front","average":{"1min":1.389,"5min":0.998,"15min":0.752},"min":{"1min":0.48799999999999999,"5min":0.379,"15min":0.379},"max":{"1min":13.734999999999999,"5min":13.734999999999999,"15min":13.734999999999999},"last":0.93500000000000005}]},{"osd":7,"last update":"Mon Nov 13 18:41:27 2023","interfaces":[{"interface":"back","average":{"1min":0.69799999999999995,"5min":0.81000000000000005,"15min":0.72999999999999998},"min":{"1min":0.51700000000000002,"5min":0.39800000000000002,"15min":0.378},"max":{"1min":1.891,"5min":7.5609999999999999,"15min":7.5609999999999999},"last":0.61599999999999999},{"interface":"front","average":{"1min":0.79700000000000004,"5min":0.91400000000000003,"15min":0.77400000000000002},"min":{"1min":0.52900000000000003,"5min":0.40899999999999997,"15min":0.40699999999999997},"max":{"1min":2.2869999999999999,"5min":7.9880000000000004,"15min":7.9880000000000004},"last":0.64300000000000002}]}]},{"osd":5,"up_from":15,"seq":64424514644,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1588244,"kb_used_data":1036,"kb_used_omap":582,"kb_used_meta":1586617,"kb_avail":92783596,"statfs":{"total":96636764160,"available":95010402304,"internally_reserved":0,"allocated":1060864,"data_stored":776285,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":596886,"internal_metadata":1624695914},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Nov 13 18:41:48 2023","interfaces":[{"interface":"back","average":{"1min":1.881,"5min":1.8959999999999999,"15min":1.766},"min":{"1min":0.40000000000000002,"5min":0.307,"15min":0.307},"max":{"1min":13.648,"5min":22.651,"15min":41.409999999999997},"last":0.81499999999999995},{"interface":"front","average":{"1min":1.536,"5min":1.865,"15min":2.0150000000000001},"min":{"1min":0.41399999999999998,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":9.3599999999999994,"5min":19.431999999999999,"15min":44.783000000000001},"last":0.998}]},{"osd":1,"last update":"Mon Nov 13 18:41:48 2023","interfaces":[{"interface":"back","average":{"1min":2.2919999999999998,"5min":1.869,"15min":1.8480000000000001},"min":{"1min":0.67200000000000004,"5min":0.41199999999999998,"15min":0.374},"max":{"1min":9.7739999999999991,"5min":22.616,"15min":22.616},"last":0.86399999999999999},{"interface":"front","average":{"1min":1.8180000000000001,"5min":1.972,"15min":1.6879999999999999},"min":{"1min":0.71999999999999997,"5min":0.46600000000000003,"15min":0.38300000000000001},"max":{"1min":5.7199999999999998,"5min":22.231000000000002,"15min":22.231000000000002},"last":1.0329999999999999}]},{"osd":2,"last update":"Mon Nov 13 18:41:48 2023","interfaces":[{"interface":"back","average":{"1min":1.9650000000000001,"5min":1.9350000000000001,"15min":1.9670000000000001},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":12.375999999999999,"5min":13.291,"15min":45.125},"last":0.90200000000000002},{"interface":"front","average":{"1min":2.3109999999999999,"5min":2.0009999999999999,"15min":1.99},"min":{"1min":0.61099999999999999,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":12.436999999999999,"5min":14.776,"15min":44.991},"last":0.92000000000000004}]},{"osd":3,"last update":"Mon Nov 13 18:41:48 2023","interfaces":[{"interface":"back","average":{"1min":1.633,"5min":2.0800000000000001,"15min":1.9810000000000001},"min":{"1min":0.71899999999999997,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":7.6159999999999997,"5min":55.082999999999998,"15min":55.082999999999998},"last":1.119},{"interface":"front","average":{"1min":1.6579999999999999,"5min":2.1899999999999999,"15min":2.04},"min":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.42899999999999999},"max":{"1min":7.4660000000000002,"5min":55.040999999999997,"15min":55.040999999999997},"last":1.1000000000000001}]},{"osd":4,"last update":"Mon Nov 13 18:41:48 2023","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":0.71399999999999997,"15min":0.59099999999999997},"min":{"1min":0.32200000000000001,"5min":0.308,"15min":0.28599999999999998},"max":{"1min":1.341,"5min":7.3869999999999996,"15min":7.3869999999999996},"last":0.64700000000000002},{"interface":"front","average":{"1min":0.70199999999999996,"5min":0.79400000000000004,"15min":0.65600000000000003},"min":{"1min":0.47899999999999998,"5min":0.41199999999999998,"15min":0.33700000000000002},"max":{"1min":1.5189999999999999,"5min":7.4329999999999998,"15min":7.4329999999999998},"last":0.78400000000000003}]},{"osd":6,"last update":"Mon Nov 13 18:41:48 2023","interfaces":[{"interface":"back","average":{"1min":0.58099999999999996,"5min":0.77300000000000002,"15min":0.629},"min":{"1min":0.33700000000000002,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":1.0209999999999999,"5min":8.2690000000000001,"15min":8.2690000000000001},"last":0.62},{"interface":"front","average":{"1min":0.626,"5min":0.98299999999999998,"15min":0.71199999999999997},"min":{"1min":0.35999999999999999,"5min":0.35399999999999998,"15min":0.33900000000000002},"max":{"1min":1.2010000000000001,"5min":22.547999999999998,"15min":22.547999999999998},"last":0.71499999999999997}]},{"osd":7,"last update":"Mon Nov 13 18:41:48 2023","interfaces":[{"interface":"back","average":{"1min":0.70799999999999996,"5min":0.79800000000000004,"15min":0.66400000000000003},"min":{"1min":0.41799999999999998,"5min":0.40799999999999997,"15min":0.37},"max":{"1min":1.3919999999999999,"5min":10.66,"15min":10.66},"last":0.74399999999999999},{"interface":"front","average":{"1min":0.65400000000000003,"5min":0.77600000000000002,"15min":0.67000000000000004},"min":{"1min":0.372,"5min":0.372,"15min":0.36399999999999999},"max":{"1min":1.5820000000000001,"5min":3.9809999999999999,"15min":3.9809999999999999},"last":0.76400000000000001}]}]},{"osd":4,"up_from":15,"seq":64424514643,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":1463636,"kb_used_data":460,"kb_used_omap":965,"kb_used_meta":1462202,"kb_avail":92908204,"statfs":{"total":96636764160,"available":95138000896,"internally_reserved":0,"allocated":471040,"data_stored":186886,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":988456,"internal_metadata":1497295576},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Nov 13 18:41:44 2023","interfaces":[{"interface":"back","average":{"1min":3.1509999999999998,"5min":1.909,"15min":1.9650000000000001},"min":{"1min":0.44700000000000001,"5min":0.34499999999999997,"15min":0.316},"max":{"1min":15.737,"5min":18.532,"15min":88.278000000000006},"last":0.78800000000000003},{"interface":"front","average":{"1min":2.9380000000000002,"5min":1.6120000000000001,"15min":1.857},"min":{"1min":0.51700000000000002,"5min":0.372,"15min":0.33900000000000002},"max":{"1min":16.440999999999999,"5min":16.440999999999999,"15min":88.555000000000007},"last":0.90400000000000003}]},{"osd":1,"last update":"Mon Nov 13 18:41:44 2023","interfaces":[{"interface":"back","average":{"1min":1.9179999999999999,"5min":2.0299999999999998,"15min":2.113},"min":{"1min":0.46300000000000002,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":9.2100000000000009,"5min":20.643000000000001,"15min":85.168999999999997},"last":0.66400000000000003},{"interface":"front","average":{"1min":2.2610000000000001,"5min":1.8799999999999999,"15min":2.0150000000000001},"min":{"1min":0.51300000000000001,"5min":0.376,"15min":0.376},"max":{"1min":17.658999999999999,"5min":24.550999999999998,"15min":85.587999999999994},"last":0.93000000000000005}]},{"osd":2,"last update":"Mon Nov 13 18:41:44 2023","interfaces":[{"interface":"back","average":{"1min":3.2210000000000001,"5min":1.962,"15min":1.774},"min":{"1min":0.66900000000000004,"5min":0.42799999999999999,"15min":0.38600000000000001},"max":{"1min":17.603000000000002,"5min":17.603000000000002,"15min":17.603000000000002},"last":0.97899999999999998},{"interface":"front","average":{"1min":3.2589999999999999,"5min":2.1840000000000002,"15min":1.694},"min":{"1min":0.49199999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":40.225999999999999,"5min":40.225999999999999,"15min":40.225999999999999},"last":0.94499999999999995}]},{"osd":3,"last update":"Mon Nov 13 18:41:44 2023","interfaces":[{"interface":"back","average":{"1min":2.274,"5min":2.097,"15min":1.8939999999999999},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":9.8620000000000001,"5min":9.8620000000000001,"15min":11.146000000000001},"last":1.0569999999999999},{"interface":"front","average":{"1min":2.464,"5min":2.2130000000000001,"15min":1.9570000000000001},"min":{"1min":0.55400000000000005,"5min":0.53000000000000003,"15min":0.46300000000000002},"max":{"1min":12.220000000000001,"5min":12.220000000000001,"15min":12.220000000000001},"last":1.103}]},{"osd":5,"last update":"Mon Nov 13 18:41:44 2023","interfaces":[{"interface":"back","average":{"1min":1.369,"5min":0.72899999999999998,"15min":0.58399999999999996},"min":{"1min":0.36899999999999999,"5min":0.34799999999999998,"15min":0.30199999999999999},"max":{"1min":11.022,"5min":11.022,"15min":11.022},"last":0.72299999999999998},{"interface":"front","average":{"1min":1.869,"5min":0.82499999999999996,"15min":0.65100000000000002},"min":{"1min":0.34999999999999998,"5min":0.34100000000000003,"15min":0.309},"max":{"1min":12.23,"5min":12.23,"15min":12.23},"last":0.61699999999999999}]},{"osd":6,"last update":"Mon Nov 13 18:41:44 2023","interfaces":[{"interface":"back","average":{"1min":1.7629999999999999,"5min":0.89500000000000002,"15min":0.69199999999999995},"min":{"1min":0.38900000000000001,"5min":0.314,"15min":0.314},"max":{"1min":10.839,"5min":10.839,"15min":10.839},"last":0.748},{"interface":"front","average":{"1min":1.659,"5min":0.86199999999999999,"15min":0.70399999999999996},"min":{"1min":0.46999999999999997,"5min":0.37,"15min":0.37},"max":{"1min":9.2949999999999999,"5min":9.2949999999999999,"15min":9.2949999999999999},"last":0.83899999999999997}]},{"osd":7,"last update":"Mon Nov 13 18:41:44 2023","interfaces":[{"interface":"back","average":{"1min":1.9039999999999999,"5min":0.95699999999999996,"15min":0.748},"min":{"1min":0.42299999999999999,"5min":0.374,"15min":0.35899999999999999},"max":{"1min":9.9570000000000007,"5min":9.9570000000000007,"15min":9.9570000000000007},"last":0.69099999999999995},{"interface":"front","average":{"1min":1.387,"5min":0.90000000000000002,"15min":0.75900000000000001},"min":{"1min":0.46800000000000003,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":10.755000000000001,"5min":10.755000000000001,"15min":10.755000000000001},"last":0.879}]}]},{"osd":3,"up_from":15,"seq":64424514586,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":1234324,"kb_used_data":460,"kb_used_omap":1151,"kb_used_meta":1232704,"kb_avail":93137516,"statfs":{"total":96636764160,"available":95372816384,"internally_reserved":0,"allocated":471040,"data_stored":186886,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1178987,"internal_metadata":1262289557},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Nov 13 18:41:55 2023","interfaces":[{"interface":"back","average":{"1min":2.2360000000000002,"5min":3.4129999999999998,"15min":3.2850000000000001},"min":{"1min":0.60299999999999998,"5min":0.49099999999999999,"15min":0.311},"max":{"1min":11.821,"5min":23.887,"15min":23.887},"last":0.79600000000000004},{"interface":"front","average":{"1min":2.2789999999999999,"5min":3.544,"15min":3.411},"min":{"1min":0.72599999999999998,"5min":0.54200000000000004,"15min":0.35799999999999998},"max":{"1min":12.124000000000001,"5min":48.045999999999999,"15min":48.045999999999999},"last":0.997}]},{"osd":1,"last update":"Mon Nov 13 18:41:55 2023","interfaces":[{"interface":"back","average":{"1min":2.444,"5min":3.1309999999999998,"15min":3.23},"min":{"1min":0.68400000000000005,"5min":0.45900000000000002,"15min":0.45400000000000001},"max":{"1min":13.273999999999999,"5min":23.428000000000001,"15min":23.428000000000001},"last":1.129},{"interface":"front","average":{"1min":2.5649999999999999,"5min":3.512,"15min":3.4449999999999998},"min":{"1min":0.68300000000000005,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":7.5369999999999999,"5min":21.818999999999999,"15min":21.818999999999999},"last":1.0740000000000001}]},{"osd":2,"last update":"Mon Nov 13 18:41:55 2023","interfaces":[{"interface":"back","average":{"1min":2.7090000000000001,"5min":3.9670000000000001,"15min":3.7069999999999999},"min":{"1min":0.77900000000000003,"5min":0.60799999999999998,"15min":0.53200000000000003},"max":{"1min":13.233000000000001,"5min":22.738,"15min":22.738},"last":0.872},{"interface":"front","average":{"1min":2.5640000000000001,"5min":3.694,"15min":3.552},"min":{"1min":0.63,"5min":0.63,"15min":0.439},"max":{"1min":9.6739999999999995,"5min":21.300999999999998,"15min":21.300999999999998},"last":0.94699999999999995}]},{"osd":4,"last update":"Mon Nov 13 18:41:55 2023","interfaces":[{"interface":"back","average":{"1min":2.5870000000000002,"5min":2.8479999999999999,"15min":2.6640000000000001},"min":{"1min":0.58499999999999996,"5min":0.55700000000000005,"15min":0.46200000000000002},"max":{"1min":5.5750000000000002,"5min":26.68,"15min":26.68},"last":1.4830000000000001},{"interface":"front","average":{"1min":2.7109999999999999,"5min":3.0649999999999999,"15min":2.6349999999999998},"min":{"1min":0.79300000000000004,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":11.794,"5min":23.655999999999999,"15min":23.655999999999999},"last":1.2629999999999999}]},{"osd":5,"last update":"Mon Nov 13 18:41:55 2023","interfaces":[{"interface":"back","average":{"1min":2.7850000000000001,"5min":3.1619999999999999,"15min":2.7999999999999998},"min":{"1min":0.84399999999999997,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":11.74,"5min":23.75,"15min":23.75},"last":1.413},{"interface":"front","average":{"1min":2.3730000000000002,"5min":3.004,"15min":2.7999999999999998},"min":{"1min":0.66100000000000003,"5min":0.66100000000000003,"15min":0.46700000000000003},"max":{"1min":11.867000000000001,"5min":22.007000000000001,"15min":22.007000000000001},"last":1.371}]},{"osd":6,"last update":"Mon Nov 13 18:41:55 2023","interfaces":[{"interface":"back","average":{"1min":3.6400000000000001,"5min":3.1949999999999998,"15min":2.871},"min":{"1min":0.70699999999999996,"5min":0.626,"15min":0.52500000000000002},"max":{"1min":26.965,"5min":26.965,"15min":26.965},"last":1.5780000000000001},{"interface":"front","average":{"1min":2.2069999999999999,"5min":3.1579999999999999,"15min":2.8740000000000001},"min":{"1min":0.89900000000000002,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":5.2320000000000002,"5min":23.841000000000001,"15min":23.841000000000001},"last":1.3500000000000001}]},{"osd":7,"last update":"Mon Nov 13 18:41:55 2023","interfaces":[{"interface":"back","average":{"1min":2.4910000000000001,"5min":3.2589999999999999,"15min":2.996},"min":{"1min":0.71799999999999997,"5min":0.71799999999999997,"15min":0.55500000000000005},"max":{"1min":11.901,"5min":22.087,"15min":22.087},"last":1.2130000000000001},{"interface":"front","average":{"1min":2.8479999999999999,"5min":3.2250000000000001,"15min":3.024},"min":{"1min":0.80400000000000005,"5min":0.621,"15min":0.55500000000000005},"max":{"1min":12.836,"5min":26.939,"15min":26.939},"last":1.643}]}]},{"osd":2,"up_from":15,"seq":64424514584,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":1718868,"kb_used_data":460,"kb_used_omap":688,"kb_used_meta":1717711,"kb_avail":92652972,"statfs":{"total":96636764160,"available":94876643328,"internally_reserved":0,"allocated":471040,"data_stored":186886,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":705113,"internal_metadata":1758936487},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Nov 13 18:41:20 2023","interfaces":[{"interface":"back","average":{"1min":3.8010000000000002,"5min":3.2360000000000002,"15min":3.1880000000000002},"min":{"1min":0.50600000000000001,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":32.695999999999998,"5min":32.695999999999998,"15min":32.695999999999998},"last":1.1559999999999999},{"interface":"front","average":{"1min":4.8170000000000002,"5min":3.254,"15min":3.258},"min":{"1min":0.71999999999999997,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":31.927,"5min":31.927,"15min":31.927},"last":0.92300000000000004}]},{"osd":1,"last update":"Mon Nov 13 18:41:20 2023","interfaces":[{"interface":"back","average":{"1min":2.5430000000000001,"5min":2.8119999999999998,"15min":3.2949999999999999},"min":{"1min":0.58199999999999996,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":7.6050000000000004,"5min":14.593,"15min":19.190999999999999},"last":0.83299999999999996},{"interface":"front","average":{"1min":2.984,"5min":3.613,"15min":3.6469999999999998},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":9.8849999999999998,"5min":22.782,"15min":22.782},"last":0.81899999999999995}]},{"osd":3,"last update":"Mon Nov 13 18:41:20 2023","interfaces":[{"interface":"back","average":{"1min":3.472,"5min":3.3849999999999998,"15min":3.3969999999999998},"min":{"1min":0.64600000000000002,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":23.966999999999999,"5min":27.233000000000001,"15min":27.233000000000001},"last":0.79200000000000004},{"interface":"front","average":{"1min":3.359,"5min":3.1059999999999999,"15min":3.516},"min":{"1min":0.68600000000000005,"5min":0.52300000000000002,"15min":0.40799999999999997},"max":{"1min":13.298,"5min":14.244999999999999,"15min":20.870000000000001},"last":1.2749999999999999}]},{"osd":4,"last update":"Mon Nov 13 18:41:20 2023","interfaces":[{"interface":"back","average":{"1min":3.3199999999999998,"5min":2.4460000000000002,"15min":2.7589999999999999},"min":{"1min":0.61699999999999999,"5min":0.46600000000000003,"15min":0.45400000000000001},"max":{"1min":29.552,"5min":29.552,"15min":29.552},"last":1.4419999999999999},{"interface":"front","average":{"1min":3.5760000000000001,"5min":2.7240000000000002,"15min":2.7010000000000001},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":24.064,"5min":24.064,"15min":24.064},"last":1.0189999999999999}]},{"osd":5,"last update":"Mon Nov 13 18:41:20 2023","interfaces":[{"interface":"back","average":{"1min":3.1150000000000002,"5min":3.0419999999999998,"15min":2.7799999999999998},"min":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.55900000000000005},"max":{"1min":23.722999999999999,"5min":30.375,"15min":30.375},"last":1.224},{"interface":"front","average":{"1min":2.5739999999999998,"5min":2.3980000000000001,"15min":2.831},"min":{"1min":0.64600000000000002,"5min":0.51900000000000002,"15min":0.49399999999999999},"max":{"1min":12.026,"5min":14.148999999999999,"15min":14.148999999999999},"last":1.375}]},{"osd":6,"last update":"Mon Nov 13 18:41:20 2023","interfaces":[{"interface":"back","average":{"1min":3.573,"5min":2.8159999999999998,"15min":2.8399999999999999},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":21.073,"5min":21.073,"15min":21.073},"last":1.258},{"interface":"front","average":{"1min":3.9820000000000002,"5min":3.2930000000000001,"15min":3.0310000000000001},"min":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":35.908999999999999,"5min":35.908999999999999,"15min":35.908999999999999},"last":1.401}]},{"osd":7,"last update":"Mon Nov 13 18:41:20 2023","interfaces":[{"interface":"back","average":{"1min":3.6829999999999998,"5min":3.0299999999999998,"15min":2.988},"min":{"1min":0.66600000000000004,"5min":0.57899999999999996,"15min":0.55300000000000005},"max":{"1min":20.969000000000001,"5min":20.969000000000001,"15min":20.969000000000001},"last":1.302},{"interface":"front","average":{"1min":3.5419999999999998,"5min":3.387,"15min":3.1339999999999999},"min":{"1min":0.80700000000000005,"5min":0.748,"15min":0.63400000000000001},"max":{"1min":23.847000000000001,"5min":26.902000000000001,"15min":26.902000000000001},"last":1.327}]}]},{"osd":1,"up_from":15,"seq":64424514599,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1515352,"kb_used_data":1040,"kb_used_omap":147,"kb_used_meta":1514156,"kb_avail":92856488,"statfs":{"total":96636764160,"available":95085043712,"internally_reserved":0,"allocated":1064960,"data_stored":777254,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":150803,"internal_metadata":1550496493},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Nov 13 18:41:25 2023","interfaces":[{"interface":"back","average":{"1min":2.569,"5min":2.7400000000000002,"15min":2.8730000000000002},"min":{"1min":0.67000000000000004,"5min":0.435,"15min":0.29299999999999998},"max":{"1min":8.0800000000000001,"5min":11.255000000000001,"15min":14.548999999999999},"last":0.90900000000000003},{"interface":"front","average":{"1min":2.2589999999999999,"5min":3.2450000000000001,"15min":3.3519999999999999},"min":{"1min":0.47399999999999998,"5min":0.45300000000000001,"15min":0.38300000000000001},"max":{"1min":4.2030000000000003,"5min":26.187999999999999,"15min":26.187999999999999},"last":0.99299999999999999}]},{"osd":2,"last update":"Mon Nov 13 18:41:25 2023","interfaces":[{"interface":"back","average":{"1min":2.9590000000000001,"5min":2.9460000000000002,"15min":2.964},"min":{"1min":0.55800000000000005,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":8.2059999999999995,"5min":11.381,"15min":12.708},"last":1.4630000000000001},{"interface":"front","average":{"1min":2.3610000000000002,"5min":3.3839999999999999,"15min":3.21},"min":{"1min":0.69499999999999995,"5min":0.54300000000000004,"15min":0.44},"max":{"1min":4.3109999999999999,"5min":27.844999999999999,"15min":27.844999999999999},"last":1.0449999999999999}]},{"osd":3,"last update":"Mon Nov 13 18:41:25 2023","interfaces":[{"interface":"back","average":{"1min":3.0779999999999998,"5min":3.7280000000000002,"15min":3.5699999999999998},"min":{"1min":0.872,"5min":0.66400000000000003,"15min":0.44400000000000001},"max":{"1min":8.5470000000000006,"5min":27.838999999999999,"15min":27.838999999999999},"last":0.85899999999999999},{"interface":"front","average":{"1min":2.286,"5min":2.948,"15min":3.1920000000000002},"min":{"1min":0.61799999999999999,"5min":0.50800000000000001,"15min":0.436},"max":{"1min":4.2190000000000003,"5min":12.034000000000001,"15min":15.619},"last":1.4099999999999999}]},{"osd":4,"last update":"Mon Nov 13 18:41:25 2023","interfaces":[{"interface":"back","average":{"1min":2.0259999999999998,"5min":2.782,"15min":2.617},"min":{"1min":0.71499999999999997,"5min":0.57999999999999996,"15min":0.46300000000000002},"max":{"1min":4.024,"5min":27.952000000000002,"15min":27.952000000000002},"last":1.2529999999999999},{"interface":"front","average":{"1min":2.9049999999999998,"5min":2.714,"15min":2.4449999999999998},"min":{"1min":0.65800000000000003,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":8.3170000000000002,"5min":27.678999999999998,"15min":27.678999999999998},"last":1.0620000000000001}]},{"osd":5,"last update":"Mon Nov 13 18:41:25 2023","interfaces":[{"interface":"back","average":{"1min":3.044,"5min":3.073,"15min":2.6360000000000001},"min":{"1min":0.70299999999999996,"5min":0.54600000000000004,"15min":0.52500000000000002},"max":{"1min":8.5020000000000007,"5min":27.588999999999999,"15min":27.588999999999999},"last":1.1679999999999999},{"interface":"front","average":{"1min":2.4060000000000001,"5min":3.2229999999999999,"15min":2.7770000000000001},"min":{"1min":0.73499999999999999,"5min":0.69999999999999996,"15min":0.47299999999999998},"max":{"1min":4.282,"5min":26.579999999999998,"15min":26.579999999999998},"last":1.206}]},{"osd":6,"last update":"Mon Nov 13 18:41:25 2023","interfaces":[{"interface":"back","average":{"1min":2.1749999999999998,"5min":3.157,"15min":2.8370000000000002},"min":{"1min":0.93700000000000006,"5min":0.54900000000000004,"15min":0.48299999999999998},"max":{"1min":4.5750000000000002,"5min":29.478999999999999,"15min":29.478999999999999},"last":1.4970000000000001},{"interface":"front","average":{"1min":3.0859999999999999,"5min":3.2229999999999999,"15min":2.8010000000000002},"min":{"1min":0.73999999999999999,"5min":0.57999999999999996,"15min":0.57999999999999996},"max":{"1min":8.4109999999999996,"5min":36.837000000000003,"15min":36.837000000000003},"last":1.3440000000000001}]},{"osd":7,"last update":"Mon Nov 13 18:41:25 2023","interfaces":[{"interface":"back","average":{"1min":2.5590000000000002,"5min":3.2959999999999998,"15min":2.8780000000000001},"min":{"1min":0.70199999999999996,"5min":0.626,"15min":0.54200000000000004},"max":{"1min":4.3879999999999999,"5min":26.622,"15min":26.622},"last":1.3129999999999999},{"interface":"front","average":{"1min":2.3879999999999999,"5min":3.1619999999999999,"15min":2.9420000000000002},"min":{"1min":0.93400000000000005,"5min":0.65900000000000003,"15min":0.54100000000000004},"max":{"1min":5.2649999999999997,"5min":25.965,"15min":25.965},"last":1.5549999999999999}]}]},{"osd":0,"up_from":15,"seq":64424514592,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":1363152,"kb_used_data":456,"kb_used_omap":245,"kb_used_meta":1362442,"kb_avail":93008688,"statfs":{"total":96636764160,"available":95240896512,"internally_reserved":0,"allocated":466944,"data_stored":185917,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":251097,"internal_metadata":1395141415},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Nov 13 18:42:07 2023","interfaces":[{"interface":"back","average":{"1min":2.903,"5min":2.6059999999999999,"15min":3.343},"min":{"1min":0.65900000000000003,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":17.190999999999999,"5min":17.190999999999999,"15min":132.19800000000001},"last":0.93200000000000005},{"interface":"front","average":{"1min":3.516,"5min":3.0840000000000001,"15min":3.4790000000000001},"min":{"1min":0.58899999999999997,"5min":0.46400000000000002,"15min":0.45900000000000002},"max":{"1min":17.84,"5min":17.84,"15min":125.517},"last":0.99199999999999999}]},{"osd":2,"last update":"Mon Nov 13 18:42:07 2023","interfaces":[{"interface":"back","average":{"1min":2.7429999999999999,"5min":2.7559999999999998,"15min":3.2090000000000001},"min":{"1min":0.45500000000000002,"5min":0.372,"15min":0.372},"max":{"1min":11.640000000000001,"5min":11.640000000000001,"15min":13.459},"last":1.3620000000000001},{"interface":"front","average":{"1min":3.1219999999999999,"5min":3.3969999999999998,"15min":3.3620000000000001},"min":{"1min":0.66300000000000003,"5min":0.66000000000000003,"15min":0.44800000000000001},"max":{"1min":9.9849999999999994,"5min":16.423999999999999,"15min":16.423999999999999},"last":1.117}]},{"osd":3,"last update":"Mon Nov 13 18:42:07 2023","interfaces":[{"interface":"back","average":{"1min":1.6759999999999999,"5min":2.895,"15min":3.0840000000000001},"min":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.45900000000000002},"max":{"1min":4.1299999999999999,"5min":15.502000000000001,"15min":15.502000000000001},"last":1.3180000000000001},{"interface":"front","average":{"1min":2.2389999999999999,"5min":3.2149999999999999,"15min":3.4860000000000002},"min":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.441},"max":{"1min":6.141,"5min":15.955,"15min":20.747},"last":1.4830000000000001}]},{"osd":4,"last update":"Mon Nov 13 18:42:07 2023","interfaces":[{"interface":"back","average":{"1min":2.1469999999999998,"5min":2.274,"15min":2.4540000000000002},"min":{"1min":0.77000000000000002,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":10.847,"5min":10.847,"15min":10.847},"last":1.0640000000000001},{"interface":"front","average":{"1min":2.5070000000000001,"5min":2.3610000000000002,"15min":2.6520000000000001},"min":{"1min":0.70099999999999996,"5min":0.53000000000000003,"15min":0.48899999999999999},"max":{"1min":10.987,"5min":10.987,"15min":12.353999999999999},"last":1.26}]},{"osd":5,"last update":"Mon Nov 13 18:42:07 2023","interfaces":[{"interface":"back","average":{"1min":2.2290000000000001,"5min":2.3700000000000001,"15min":2.4540000000000002},"min":{"1min":0.65700000000000003,"5min":0.65700000000000003,"15min":0.501},"max":{"1min":6.5010000000000003,"5min":12.470000000000001,"15min":12.470000000000001},"last":1.591},{"interface":"front","average":{"1min":1.536,"5min":2.274,"15min":2.5590000000000002},"min":{"1min":0.73399999999999999,"5min":0.66500000000000004,"15min":0.50600000000000001},"max":{"1min":3.927,"5min":9.516,"15min":9.9640000000000004},"last":0.88400000000000001}]},{"osd":6,"last update":"Mon Nov 13 18:42:07 2023","interfaces":[{"interface":"back","average":{"1min":2.0099999999999998,"5min":2.4359999999999999,"15min":2.8090000000000002},"min":{"1min":0.73099999999999998,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":5.7830000000000004,"5min":13.348000000000001,"15min":13.348000000000001},"last":1.153},{"interface":"front","average":{"1min":2.5390000000000001,"5min":2.492,"15min":2.6190000000000002},"min":{"1min":0.78000000000000003,"5min":0.60499999999999998,"15min":0.56799999999999995},"max":{"1min":9.4589999999999996,"5min":12.191000000000001,"15min":12.191000000000001},"last":1.6539999999999999}]},{"osd":7,"last update":"Mon Nov 13 18:42:07 2023","interfaces":[{"interface":"back","average":{"1min":2.3180000000000001,"5min":2.5920000000000001,"15min":2.6989999999999998},"min":{"1min":0.92800000000000005,"5min":0.64900000000000002,"15min":0.51400000000000001},"max":{"1min":6.1319999999999997,"5min":12.289999999999999,"15min":12.289999999999999},"last":1.7170000000000001},{"interface":"front","average":{"1min":1.625,"5min":2.4289999999999998,"15min":2.6899999999999999},"min":{"1min":0.80400000000000005,"5min":0.64400000000000002,"15min":0.57499999999999996},"max":{"1min":4.5960000000000001,"5min":9.6199999999999992,"15min":10.743},"last":1.2130000000000001}]}]},{"osd":7,"up_from":14,"seq":60129547348,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":1661908,"kb_used_data":460,"kb_used_omap":129,"kb_used_meta":1661310,"kb_avail":92709932,"statfs":{"total":96636764160,"available":94934970368,"internally_reserved":0,"allocated":471040,"data_stored":186886,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":132782,"internal_metadata":1701181778},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Nov 13 18:41:38 2023","interfaces":[{"interface":"back","average":{"1min":2.0819999999999999,"5min":1.841,"15min":1.8100000000000001},"min":{"1min":0.39600000000000002,"5min":0.34100000000000003,"15min":0.30599999999999999},"max":{"1min":13.148999999999999,"5min":13.148999999999999,"15min":13.148999999999999},"last":0.76600000000000001},{"interface":"front","average":{"1min":1.887,"5min":1.8999999999999999,"15min":1.6599999999999999},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":8.2729999999999997,"5min":8.2729999999999997,"15min":9.266},"last":0.90300000000000002}]},{"osd":1,"last update":"Mon Nov 13 18:41:38 2023","interfaces":[{"interface":"back","average":{"1min":1.581,"5min":2.0129999999999999,"15min":1.7589999999999999},"min":{"1min":0.51500000000000001,"5min":0.376,"15min":0.36399999999999999},"max":{"1min":7.7039999999999997,"5min":9.4909999999999997,"15min":9.4909999999999997},"last":0.745},{"interface":"front","average":{"1min":1.843,"5min":2.036,"15min":1.8360000000000001},"min":{"1min":0.57199999999999995,"5min":0.47699999999999998,"15min":0.35599999999999998},"max":{"1min":6.9000000000000004,"5min":8.1280000000000001,"15min":9.4939999999999998},"last":0.70899999999999996}]},{"osd":2,"last update":"Mon Nov 13 18:41:38 2023","interfaces":[{"interface":"back","average":{"1min":3.8740000000000001,"5min":2.234,"15min":1.982},"min":{"1min":0.53800000000000003,"5min":0.51300000000000001,"15min":0.38400000000000001},"max":{"1min":27.635999999999999,"5min":27.635999999999999,"15min":27.635999999999999},"last":0.54400000000000004},{"interface":"front","average":{"1min":2.1600000000000001,"5min":2.008,"15min":1.8859999999999999},"min":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45100000000000001},"max":{"1min":12.868,"5min":12.868,"15min":12.868},"last":0.80800000000000005}]},{"osd":3,"last update":"Mon Nov 13 18:41:38 2023","interfaces":[{"interface":"back","average":{"1min":1.409,"5min":1.71,"15min":1.7769999999999999},"min":{"1min":0.54000000000000004,"5min":0.442,"15min":0.442},"max":{"1min":3.988,"5min":13.727,"15min":13.727},"last":0.97699999999999998},{"interface":"front","average":{"1min":1.9419999999999999,"5min":1.6839999999999999,"15min":2.0049999999999999},"min":{"1min":0.64500000000000002,"5min":0.45700000000000002,"15min":0.44500000000000001},"max":{"1min":6.944,"5min":7.5199999999999996,"15min":11.156000000000001},"last":0.79900000000000004}]},{"osd":4,"last update":"Mon Nov 13 18:41:38 2023","interfaces":[{"interface":"back","average":{"1min":1.1240000000000001,"5min":0.71699999999999997,"15min":0.60399999999999998},"min":{"1min":0.36599999999999999,"5min":0.34499999999999997,"15min":0.32700000000000001},"max":{"1min":8.0259999999999998,"5min":8.0259999999999998,"15min":8.0259999999999998},"last":0.66500000000000004},{"interface":"front","average":{"1min":0.98999999999999999,"5min":1.2869999999999999,"15min":0.82299999999999995},"min":{"1min":0.38500000000000001,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":4.7649999999999997,"5min":38.662999999999997,"15min":38.662999999999997},"last":0.60599999999999998}]},{"osd":5,"last update":"Mon Nov 13 18:41:38 2023","interfaces":[{"interface":"back","average":{"1min":1.516,"5min":0.83899999999999997,"15min":0.68500000000000005},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.32800000000000001},"max":{"1min":10.481,"5min":10.481,"15min":10.481},"last":0.64400000000000002},{"interface":"front","average":{"1min":1.1699999999999999,"5min":0.83199999999999996,"15min":0.68799999999999994},"min":{"1min":0.41199999999999998,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":8.1029999999999998,"5min":8.1029999999999998,"15min":8.1029999999999998},"last":0.72499999999999998}]},{"osd":6,"last update":"Mon Nov 13 18:41:38 2023","interfaces":[{"interface":"back","average":{"1min":1.3859999999999999,"5min":1.0409999999999999,"15min":0.78600000000000003},"min":{"1min":0.45900000000000002,"5min":0.43099999999999999,"15min":0.40200000000000002},"max":{"1min":11.182,"5min":19.218,"15min":19.218},"last":0.77700000000000002},{"interface":"front","average":{"1min":1.4530000000000001,"5min":1.0489999999999999,"15min":0.80400000000000005},"min":{"1min":0.46999999999999997,"5min":0.38,"15min":0.373},"max":{"1min":11.202999999999999,"5min":13.677,"15min":13.677},"last":0.68999999999999995}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-13T18:42:18.114 DEBUG:teuthology.orchestra.run.smithi102:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2023-11-13T18:42:18.515 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:42:18.508+0000 7ff64be09640 1 Processor -- start 2023-11-13T18:42:18.516 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:42:18.508+0000 7ff64be09640 1 -- start start 2023-11-13T18:42:18.519 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:42:18.512+0000 7ff64be09640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7ff64415d220 0x7ff6440d3910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T18:42:18.520 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:42:18.512+0000 7ff64be09640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff6440b3f60 0x7ff6440b2e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T18:42:18.520 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:42:18.512+0000 7ff64be09640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff6440b3840 con 0x7ff64415d600 2023-11-13T18:42:18.520 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:42:18.512+0000 7ff64be09640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff6440cecb0 con 0x7ff64415d220 2023-11-13T18:42:18.521 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:42:18.512+0000 7ff64be09640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff6440d0d00 con 0x7ff6440b3f60 2023-11-13T18:42:18.521 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:42:18.512+0000 7ff649ba5640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7ff64415d220 0x7ff6440d3910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T18:42:18.521 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:42:18.512+0000 7ff649ba5640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7ff64415d220 0x7ff6440d3910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.102:48570/0 (socket says 172.21.15.102:48570) 2023-11-13T18:42:18.522 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:42:18.512+0000 7ff64a3a6640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff6440b3f60 0x7ff6440b2e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T18:42:18.522 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:42:18.512+0000 7ff649ba5640 1 -- 172.21.15.102:0/924196670 learned_addr learned my addr 172.21.15.102:0/924196670 (peer_addr_for_me v2:172.21.15.102:0/0) 2023-11-13T18:42:18.523 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:42:18.516+0000 7ff649ba5640 1 -- 172.21.15.102:0/924196670 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff6440b3f60 msgr2=0x7ff6440b2e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-13T18:42:18.524 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:42:18.516+0000 7ff649ba5640 1 --2- 172.21.15.102:0/924196670 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff6440b3f60 0x7ff6440b2e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T18:42:18.524 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:42:18.516+0000 7ff649ba5640 1 -- 172.21.15.102:0/924196670 >> v1:172.21.15.154:6789/0 conn(0x7ff64415d600 legacy=0x7ff6440b2750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T18:42:18.524 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:42:18.516+0000 7ff649ba5640 1 -- 172.21.15.102:0/924196670 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6440d0fe0 con 0x7ff64415d220 2023-11-13T18:42:18.528 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:42:18.524+0000 7ff649ba5640 1 --2- 172.21.15.102:0/924196670 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff64415d220 0x7ff6440d3910 secure :-1 s=READY pgs=932 cs=0 l=1 rev1=1 crypto rx=0x7ff640009870 tx=0x7ff64001c3f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cfcf635b31cdaf0 server_cookie=0 in_seq=0 out_seq=0 2023-11-13T18:42:18.530 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:42:18.524+0000 7ff648ba3640 1 -- 172.21.15.102:0/924196670 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6400ac410 con 0x7ff64415d220 2023-11-13T18:42:18.530 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:42:18.524+0000 7ff648ba3640 1 -- 172.21.15.102:0/924196670 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff6400ac570 con 0x7ff64415d220 2023-11-13T18:42:18.531 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:42:18.524+0000 7ff648ba3640 1 -- 172.21.15.102:0/924196670 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6400ac900 con 0x7ff64415d220 2023-11-13T18:42:18.532 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:42:18.524+0000 7ff64be09640 1 -- 172.21.15.102:0/924196670 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff64415d220 msgr2=0x7ff6440d3910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T18:42:18.532 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:42:18.524+0000 7ff64be09640 1 --2- 172.21.15.102:0/924196670 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff64415d220 0x7ff6440d3910 secure :-1 s=READY pgs=932 cs=0 l=1 rev1=1 crypto rx=0x7ff640009870 tx=0x7ff64001c3f0 comp rx=0 tx=0).stop 2023-11-13T18:42:18.533 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:42:18.524+0000 7ff64be09640 1 -- 172.21.15.102:0/924196670 shutdown_connections 2023-11-13T18:42:18.533 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:42:18.524+0000 7ff64be09640 1 --2- 172.21.15.102:0/924196670 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff6440b3f60 0x7ff6440b2e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T18:42:18.533 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:42:18.524+0000 7ff64be09640 1 --2- 172.21.15.102:0/924196670 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff64415d220 0x7ff6440d3910 unknown :-1 s=CLOSED pgs=932 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T18:42:18.534 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:42:18.524+0000 7ff64be09640 1 -- 172.21.15.102:0/924196670 >> 172.21.15.102:0/924196670 conn(0x7ff6440d2df0 msgr2=0x7ff6440d3200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-13T18:42:18.534 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:42:18.528+0000 7ff64be09640 1 -- 172.21.15.102:0/924196670 shutdown_connections 2023-11-13T18:42:18.535 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:42:18.528+0000 7ff64be09640 1 -- 172.21.15.102:0/924196670 wait complete. 2023-11-13T18:42:18.536 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:42:18.532+0000 7ff64be09640 1 Processor -- start 2023-11-13T18:42:18.537 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:42:18.532+0000 7ff64be09640 1 -- start start 2023-11-13T18:42:18.539 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:42:18.532+0000 7ff64be09640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff6440b3f60 0x7ff6440b8910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T18:42:18.540 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:42:18.532+0000 7ff64be09640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff64415d220 0x7ff64415b090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T18:42:18.540 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:42:18.532+0000 7ff64be09640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff64415d600 0x7ff64415ff90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T18:42:18.540 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:42:18.532+0000 7ff64be09640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff64415e530 con 0x7ff64415d220 2023-11-13T18:42:18.541 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:42:18.532+0000 7ff64be09640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff64414bfe0 con 0x7ff64415d600 2023-11-13T18:42:18.541 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:42:18.532+0000 7ff64be09640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff64415b5d0 con 0x7ff6440b3f60 2023-11-13T18:42:18.543 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:42:18.536+0000 7ff6493a4640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff64415d220 0x7ff64415b090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T18:42:18.543 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:42:18.536+0000 7ff649ba5640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff6440b3f60 0x7ff6440b8910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T18:42:18.544 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:42:18.536+0000 7ff649ba5640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff6440b3f60 0x7ff6440b8910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.102:56428/0 (socket says 172.21.15.102:56428) 2023-11-13T18:42:18.544 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:42:18.536+0000 7ff6493a4640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff64415d220 0x7ff64415b090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:53828/0 (socket says 172.21.15.102:53828) 2023-11-13T18:42:18.544 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:42:18.536+0000 7ff64a3a6640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff64415d600 0x7ff64415ff90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T18:42:18.545 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:42:18.536+0000 7ff649ba5640 1 -- 172.21.15.102:0/2304883180 learned_addr learned my addr 172.21.15.102:0/2304883180 (peer_addr_for_me v2:172.21.15.102:0/0) 2023-11-13T18:42:18.545 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:42:18.536+0000 7ff649ba5640 1 -- 172.21.15.102:0/2304883180 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff64415d600 msgr2=0x7ff64415ff90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T18:42:18.546 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:42:18.536+0000 7ff649ba5640 1 --2- 172.21.15.102:0/2304883180 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff64415d600 0x7ff64415ff90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T18:42:18.546 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:42:18.536+0000 7ff649ba5640 1 -- 172.21.15.102:0/2304883180 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff64415d220 msgr2=0x7ff64415b090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T18:42:18.546 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:42:18.536+0000 7ff649ba5640 1 --2- 172.21.15.102:0/2304883180 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff64415d220 0x7ff64415b090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T18:42:18.547 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:42:18.536+0000 7ff649ba5640 1 -- 172.21.15.102:0/2304883180 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6400094d0 con 0x7ff6440b3f60 2023-11-13T18:42:18.547 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:42:18.536+0000 7ff64a3a6640 1 --2- 172.21.15.102:0/2304883180 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff64415d600 0x7ff64415ff90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-13T18:42:18.547 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:42:18.536+0000 7ff649ba5640 1 --2- 172.21.15.102:0/2304883180 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff6440b3f60 0x7ff6440b8910 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7ff6400af040 tx=0x7ff640019190 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-13T18:42:18.548 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:42:18.536+0000 7ff63a7fc640 1 -- 172.21.15.102:0/2304883180 <== mon.2 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6400ac410 con 0x7ff6440b3f60 2023-11-13T18:42:18.548 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:42:18.536+0000 7ff63a7fc640 1 -- 172.21.15.102:0/2304883180 <== mon.2 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff6400ace30 con 0x7ff6440b3f60 2023-11-13T18:42:18.548 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:42:18.536+0000 7ff64be09640 1 -- 172.21.15.102:0/2304883180 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff64415b8a0 con 0x7ff6440b3f60 2023-11-13T18:42:18.549 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:42:18.536+0000 7ff63a7fc640 1 -- 172.21.15.102:0/2304883180 <== mon.2 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6400b5870 con 0x7ff6440b3f60 2023-11-13T18:42:18.549 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:42:18.536+0000 7ff64be09640 1 -- 172.21.15.102:0/2304883180 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff64415be60 con 0x7ff6440b3f60 2023-11-13T18:42:18.550 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:42:18.540+0000 7ff64be09640 1 -- 172.21.15.102:0/2304883180 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff644068520 con 0x7ff6440b3f60 2023-11-13T18:42:18.551 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:42:18.540+0000 7ff63a7fc640 1 -- 172.21.15.102:0/2304883180 <== mon.2 v2:172.21.15.154:3301/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7ff6400b3070 con 0x7ff6440b3f60 2023-11-13T18:42:18.551 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:42:18.544+0000 7ff63a7fc640 1 --2- 172.21.15.102:0/2304883180 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7ff628066470 0x7ff628068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T18:42:18.552 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:42:18.544+0000 7ff63a7fc640 1 -- 172.21.15.102:0/2304883180 <== mon.2 v2:172.21.15.154:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4943+0+0 (secure 0 0 0) 0x7ff64011e090 con 0x7ff6440b3f60 2023-11-13T18:42:18.552 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:42:18.544+0000 7ff6493a4640 1 --2- 172.21.15.102:0/2304883180 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7ff628066470 0x7ff628068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T18:42:18.552 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:42:18.544+0000 7ff6493a4640 1 --2- 172.21.15.102:0/2304883180 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7ff628066470 0x7ff628068930 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 crypto rx=0x7ff64415e2b0 tx=0x7ff634009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-13T18:42:18.553 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:42:18.548+0000 7ff63a7fc640 1 -- 172.21.15.102:0/2304883180 <== mon.2 v2:172.21.15.154:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7ff6400eb770 con 0x7ff6440b3f60 2023-11-13T18:42:19.017 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:42:19.012+0000 7ff64be09640 1 -- 172.21.15.102:0/2304883180 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command([{prefix=config set, name=mon_health_to_clog}] v 0) v1 -- 0x7ff6440b1ce0 con 0x7ff6440b3f60 2023-11-13T18:42:19.026 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:42:19.020+0000 7ff63a7fc640 1 -- 172.21.15.102:0/2304883180 <== mon.2 v2:172.21.15.154:3301/0 7 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7ff6400eb770 con 0x7ff6440b3f60 2023-11-13T18:42:19.027 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:42:19.020+0000 7ff63a7fc640 1 -- 172.21.15.102:0/2304883180 <== mon.2 v2:172.21.15.154:3301/0 8 ==== mon_command_ack([{prefix=config set, name=mon_health_to_clog}]=0 v12)=0 v12) v1 ==== 123+0+0 (secure 0 0 0) 0x7ff6400b1020 con 0x7ff6440b3f60 2023-11-13T18:42:19.031 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:42:19.024+0000 7ff64be09640 1 -- 172.21.15.102:0/2304883180 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7ff628066470 msgr2=0x7ff628068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T18:42:19.031 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:42:19.024+0000 7ff64be09640 1 --2- 172.21.15.102:0/2304883180 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7ff628066470 0x7ff628068930 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 crypto rx=0x7ff64415e2b0 tx=0x7ff634009040 comp rx=0 tx=0).stop 2023-11-13T18:42:19.032 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:42:19.024+0000 7ff64be09640 1 -- 172.21.15.102:0/2304883180 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff6440b3f60 msgr2=0x7ff6440b8910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T18:42:19.032 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:42:19.024+0000 7ff64be09640 1 --2- 172.21.15.102:0/2304883180 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff6440b3f60 0x7ff6440b8910 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7ff6400af040 tx=0x7ff640019190 comp rx=0 tx=0).stop 2023-11-13T18:42:19.032 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:42:19.024+0000 7ff64be09640 1 -- 172.21.15.102:0/2304883180 shutdown_connections 2023-11-13T18:42:19.033 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:42:19.024+0000 7ff64be09640 1 --2- 172.21.15.102:0/2304883180 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff64415d600 0x7ff64415ff90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T18:42:19.033 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:42:19.024+0000 7ff64be09640 1 --2- 172.21.15.102:0/2304883180 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7ff628066470 0x7ff628068930 unknown :-1 s=CLOSED pgs=773 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T18:42:19.034 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:42:19.024+0000 7ff64be09640 1 --2- 172.21.15.102:0/2304883180 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff64415d220 0x7ff64415b090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T18:42:19.034 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:42:19.024+0000 7ff64be09640 1 --2- 172.21.15.102:0/2304883180 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff6440b3f60 0x7ff6440b8910 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T18:42:19.035 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:42:19.024+0000 7ff64be09640 1 -- 172.21.15.102:0/2304883180 >> 172.21.15.102:0/2304883180 conn(0x7ff6440d2df0 msgr2=0x7ff6440c93c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-13T18:42:19.035 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:42:19.024+0000 7ff64be09640 1 -- 172.21.15.102:0/2304883180 shutdown_connections 2023-11-13T18:42:19.035 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:42:19.024+0000 7ff64be09640 1 -- 172.21.15.102:0/2304883180 wait complete. 2023-11-13T18:42:19.058 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-11-13T18:42:19.060 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-13T18:42:19.464 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:42:19.460+0000 7f3d91cc8640 1 Processor -- start 2023-11-13T18:42:19.465 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:42:19.460+0000 7f3d91cc8640 1 -- start start 2023-11-13T18:42:19.469 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:42:19.460+0000 7f3d91cc8640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f3d8c15ce00 0x7f3d8c0cf340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T18:42:19.469 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:42:19.460+0000 7f3d91cc8640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f3d8c0d1980 0x7f3d8c0b2860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T18:42:19.470 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:42:19.460+0000 7f3d91cc8640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3d8c0cfcb0 con 0x7f3d8c0d0940 2023-11-13T18:42:19.470 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:42:19.464+0000 7f3d91cc8640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3d8c0cff90 con 0x7f3d8c15ce00 2023-11-13T18:42:19.471 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:42:19.464+0000 7f3d91cc8640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3d8c0d0270 con 0x7f3d8c0d1980 2023-11-13T18:42:19.473 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:42:19.464+0000 7f3d8bfff640 1 --1- >> v1:172.21.15.102:6789/0 conn(0x7f3d8c0d0940 0x7f3d8c0d1270 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.102:6789/0 says I am v1:172.21.15.102:60744/0 (socket says 172.21.15.102:60744) 2023-11-13T18:42:19.473 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:42:19.464+0000 7f3d8bfff640 1 -- 172.21.15.102:0/1540504759 learned_addr learned my addr 172.21.15.102:0/1540504759 (peer_addr_for_me v1:172.21.15.102:0/0) 2023-11-13T18:42:19.474 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:42:19.464+0000 7f3d914c7640 1 --2- 172.21.15.102:0/1540504759 >> v2:172.21.15.154:3300/0 conn(0x7f3d8c0d1980 0x7f3d8c0b2860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T18:42:19.474 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:42:19.464+0000 7f3d90cc6640 1 --2- 172.21.15.102:0/1540504759 >> v2:172.21.15.102:3300/0 conn(0x7f3d8c15ce00 0x7f3d8c0cf340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T18:42:19.475 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:42:19.464+0000 7f3d914c7640 1 -- 172.21.15.102:0/1540504759 >> v2:172.21.15.102:3300/0 conn(0x7f3d8c15ce00 msgr2=0x7f3d8c0cf340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-13T18:42:19.475 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:42:19.464+0000 7f3d914c7640 1 --2- 172.21.15.102:0/1540504759 >> v2:172.21.15.102:3300/0 conn(0x7f3d8c15ce00 0x7f3d8c0cf340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T18:42:19.475 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:42:19.464+0000 7f3d914c7640 1 -- 172.21.15.102:0/1540504759 >> v1:172.21.15.102:6789/0 conn(0x7f3d8c0d0940 legacy=0x7f3d8c0d1270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T18:42:19.476 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:42:19.464+0000 7f3d914c7640 1 -- 172.21.15.102:0/1540504759 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d8c0d0550 con 0x7f3d8c0d1980 2023-11-13T18:42:19.476 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:42:19.468+0000 7f3d914c7640 1 --2- 172.21.15.102:0/1540504759 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3d8c0d1980 0x7f3d8c0b2860 secure :-1 s=READY pgs=933 cs=0 l=1 rev1=1 crypto rx=0x7f3d8c0b8cc0 tx=0x7f3d8401d340 comp rx=0 tx=0).ready entity=mon.1 client_cookie=507d5f556c07a860 server_cookie=0 in_seq=0 out_seq=0 2023-11-13T18:42:19.477 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:42:19.468+0000 7f3d8b7fe640 1 -- 172.21.15.102:0/1540504759 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d840a59c0 con 0x7f3d8c0d1980 2023-11-13T18:42:19.477 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:42:19.468+0000 7f3d8b7fe640 1 -- 172.21.15.102:0/1540504759 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f3d840a5b20 con 0x7f3d8c0d1980 2023-11-13T18:42:19.478 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:42:19.468+0000 7f3d8b7fe640 1 -- 172.21.15.102:0/1540504759 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d840ad440 con 0x7f3d8c0d1980 2023-11-13T18:42:19.480 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:42:19.468+0000 7f3d91cc8640 1 -- 172.21.15.102:0/1540504759 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3d8c0d1980 msgr2=0x7f3d8c0b2860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T18:42:19.480 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:42:19.468+0000 7f3d91cc8640 1 --2- 172.21.15.102:0/1540504759 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3d8c0d1980 0x7f3d8c0b2860 secure :-1 s=READY pgs=933 cs=0 l=1 rev1=1 crypto rx=0x7f3d8c0b8cc0 tx=0x7f3d8401d340 comp rx=0 tx=0).stop 2023-11-13T18:42:19.481 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:42:19.468+0000 7f3d91cc8640 1 -- 172.21.15.102:0/1540504759 shutdown_connections 2023-11-13T18:42:19.481 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:42:19.468+0000 7f3d91cc8640 1 --2- 172.21.15.102:0/1540504759 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3d8c0d1980 0x7f3d8c0b2860 unknown :-1 s=CLOSED pgs=933 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T18:42:19.481 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:42:19.468+0000 7f3d91cc8640 1 --2- 172.21.15.102:0/1540504759 >> v2:172.21.15.102:3300/0 conn(0x7f3d8c15ce00 0x7f3d8c0cf340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T18:42:19.482 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:42:19.468+0000 7f3d91cc8640 1 -- 172.21.15.102:0/1540504759 >> 172.21.15.102:0/1540504759 conn(0x7f3d8c09bf60 msgr2=0x7f3d8c0d2c90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-13T18:42:19.482 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:42:19.468+0000 7f3d91cc8640 1 -- 172.21.15.102:0/1540504759 shutdown_connections 2023-11-13T18:42:19.483 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:42:19.468+0000 7f3d91cc8640 1 -- 172.21.15.102:0/1540504759 wait complete. 2023-11-13T18:42:19.483 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:42:19.472+0000 7f3d91cc8640 1 Processor -- start 2023-11-13T18:42:19.484 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:42:19.476+0000 7f3d91cc8640 1 -- start start 2023-11-13T18:42:19.488 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:42:19.476+0000 7f3d91cc8640 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3d8c0d0940 0x7f3d8c0b8340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T18:42:19.488 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:42:19.476+0000 7f3d91cc8640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3d8c0d1980 0x7f3d8c0c6130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T18:42:19.488 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:42:19.476+0000 7f3d91cc8640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3d8c15ce00 0x7f3d8c0cc1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T18:42:19.489 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:42:19.476+0000 7f3d91cc8640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d8c0cb140 con 0x7f3d8c15ce00 2023-11-13T18:42:19.489 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:42:19.476+0000 7f3d91cc8640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d8c0cb3e0 con 0x7f3d8c0d1980 2023-11-13T18:42:19.490 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:42:19.476+0000 7f3d91cc8640 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d8c0cb6c0 con 0x7f3d8c0d0940 2023-11-13T18:42:19.491 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:42:19.476+0000 7f3d8bfff640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3d8c0d1980 0x7f3d8c0c6130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T18:42:19.492 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:42:19.476+0000 7f3d8bfff640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3d8c0d1980 0x7f3d8c0c6130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.102:48590/0 (socket says 172.21.15.102:48590) 2023-11-13T18:42:19.493 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:42:19.476+0000 7f3d8bfff640 1 -- 172.21.15.102:0/2600868550 learned_addr learned my addr 172.21.15.102:0/2600868550 (peer_addr_for_me v2:172.21.15.102:0/0) 2023-11-13T18:42:19.494 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:42:19.476+0000 7f3d90cc6640 1 --2- 172.21.15.102:0/2600868550 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3d8c0d0940 0x7f3d8c0b8340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T18:42:19.495 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:42:19.476+0000 7f3d914c7640 1 --2- 172.21.15.102:0/2600868550 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3d8c15ce00 0x7f3d8c0cc1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T18:42:19.495 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:42:19.480+0000 7f3d8bfff640 1 -- 172.21.15.102:0/2600868550 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3d8c0d0940 msgr2=0x7f3d8c0b8340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T18:42:19.496 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:42:19.480+0000 7f3d8bfff640 1 --2- 172.21.15.102:0/2600868550 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3d8c0d0940 0x7f3d8c0b8340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T18:42:19.497 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:42:19.480+0000 7f3d8bfff640 1 -- 172.21.15.102:0/2600868550 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3d8c15ce00 msgr2=0x7f3d8c0cc1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T18:42:19.498 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:42:19.480+0000 7f3d8bfff640 1 --2- 172.21.15.102:0/2600868550 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3d8c15ce00 0x7f3d8c0cc1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T18:42:19.498 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:42:19.480+0000 7f3d8bfff640 1 -- 172.21.15.102:0/2600868550 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d84009a70 con 0x7f3d8c0d1980 2023-11-13T18:42:19.499 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:42:19.480+0000 7f3d8bfff640 1 --2- 172.21.15.102:0/2600868550 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3d8c0d1980 0x7f3d8c0c6130 secure :-1 s=READY pgs=934 cs=0 l=1 rev1=1 crypto rx=0x7f3d7800c500 tx=0x7f3d7800c9c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-13T18:42:19.500 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:42:19.480+0000 7f3d897fa640 1 -- 172.21.15.102:0/2600868550 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d78005cf0 con 0x7f3d8c0d1980 2023-11-13T18:42:19.500 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:42:19.480+0000 7f3d897fa640 1 -- 172.21.15.102:0/2600868550 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f3d78005e50 con 0x7f3d8c0d1980 2023-11-13T18:42:19.501 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:42:19.480+0000 7f3d897fa640 1 -- 172.21.15.102:0/2600868550 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d78007310 con 0x7f3d8c0d1980 2023-11-13T18:42:19.502 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:42:19.480+0000 7f3d91cc8640 1 -- 172.21.15.102:0/2600868550 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3d8c0cb9a0 con 0x7f3d8c0d1980 2023-11-13T18:42:19.502 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:42:19.480+0000 7f3d91cc8640 1 -- 172.21.15.102:0/2600868550 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3d8c0b8880 con 0x7f3d8c0d1980 2023-11-13T18:42:19.503 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:42:19.480+0000 7f3d897fa640 1 -- 172.21.15.102:0/2600868550 <== mon.1 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f3d78007470 con 0x7f3d8c0d1980 2023-11-13T18:42:19.503 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:42:19.484+0000 7f3d91cc8640 1 -- 172.21.15.102:0/2600868550 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3d8c067680 con 0x7f3d8c0d1980 2023-11-13T18:42:19.504 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:42:19.484+0000 7f3d897fa640 1 --2- 172.21.15.102:0/2600868550 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f3d70066470 0x7f3d70068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-13T18:42:19.505 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:42:19.484+0000 7f3d897fa640 1 -- 172.21.15.102:0/2600868550 <== mon.1 v2:172.21.15.154:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f3d780831a0 con 0x7f3d8c0d1980 2023-11-13T18:42:19.505 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:42:19.484+0000 7f3d90cc6640 1 --2- 172.21.15.102:0/2600868550 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f3d70066470 0x7f3d70068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-13T18:42:19.506 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:42:19.488+0000 7f3d90cc6640 1 --2- 172.21.15.102:0/2600868550 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f3d70066470 0x7f3d70068930 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 crypto rx=0x7f3d8c0a0cf0 tx=0x7f3d80008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-13T18:42:19.506 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:42:19.488+0000 7f3d897fa640 1 -- 172.21.15.102:0/2600868550 <== mon.1 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f3d78050930 con 0x7f3d8c0d1980 2023-11-13T18:42:20.072 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:42:20.068+0000 7f3d91cc8640 1 -- 172.21.15.102:0/2600868550 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f3d8c0cb520 con 0x7f3d8c0d1980 2023-11-13T18:42:20.073 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:42:20.068+0000 7f3d897fa640 1 -- 172.21.15.102:0/2600868550 <== mon.1 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 19 v19) v1 ==== 94+0+3705 (secure 0 0 0) 0x7f3d8c0cb520 con 0x7f3d8c0d1980 2023-11-13T18:42:20.073 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-11-13T18:42:20.074 INFO:teuthology.orchestra.run.smithi102.stdout:{"epoch":19,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4826,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6834/3121803929","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6832","nonce":3121803929},{"type":"v1","addr":"172.21.15.154:6834","nonce":3121803929}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":4829,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6835/2990283260","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6833","nonce":2990283260},{"type":"v1","addr":"172.21.15.154:6835","nonce":2990283260}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":5271,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.102:6836/868460192","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6834","nonce":868460192},{"type":"v1","addr":"172.21.15.102:6836","nonce":868460192}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":9655,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.102:6837/741780437","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6835","nonce":741780437},{"type":"v1","addr":"172.21.15.102:6837","nonce":741780437}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":18}],"filesystems":[]} 2023-11-13T18:42:20.075 INFO:teuthology.orchestra.run.smithi102.stderr:dumped fsmap epoch 19 2023-11-13T18:42:20.077 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:42:20.072+0000 7f3d91cc8640 1 -- 172.21.15.102:0/2600868550 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f3d70066470 msgr2=0x7f3d70068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T18:42:20.077 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:42:20.072+0000 7f3d91cc8640 1 --2- 172.21.15.102:0/2600868550 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f3d70066470 0x7f3d70068930 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 crypto rx=0x7f3d8c0a0cf0 tx=0x7f3d80008040 comp rx=0 tx=0).stop 2023-11-13T18:42:20.078 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:42:20.072+0000 7f3d91cc8640 1 -- 172.21.15.102:0/2600868550 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3d8c0d1980 msgr2=0x7f3d8c0c6130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-13T18:42:20.078 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:42:20.072+0000 7f3d91cc8640 1 --2- 172.21.15.102:0/2600868550 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3d8c0d1980 0x7f3d8c0c6130 secure :-1 s=READY pgs=934 cs=0 l=1 rev1=1 crypto rx=0x7f3d7800c500 tx=0x7f3d7800c9c0 comp rx=0 tx=0).stop 2023-11-13T18:42:20.079 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:42:20.072+0000 7f3d91cc8640 1 -- 172.21.15.102:0/2600868550 shutdown_connections 2023-11-13T18:42:20.080 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:42:20.072+0000 7f3d91cc8640 1 --2- 172.21.15.102:0/2600868550 >> [v2:172.21.15.102:6832/1009482693,v1:172.21.15.102:6833/1009482693] conn(0x7f3d70066470 0x7f3d70068930 unknown :-1 s=CLOSED pgs=774 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T18:42:20.080 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:42:20.072+0000 7f3d91cc8640 1 --2- 172.21.15.102:0/2600868550 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3d8c15ce00 0x7f3d8c0cc1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T18:42:20.081 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:42:20.072+0000 7f3d91cc8640 1 --2- 172.21.15.102:0/2600868550 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3d8c0d1980 0x7f3d8c0c6130 unknown :-1 s=CLOSED pgs=934 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T18:42:20.081 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:42:20.072+0000 7f3d91cc8640 1 --2- 172.21.15.102:0/2600868550 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3d8c0d0940 0x7f3d8c0b8340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-13T18:42:20.081 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:42:20.072+0000 7f3d91cc8640 1 -- 172.21.15.102:0/2600868550 >> 172.21.15.102:0/2600868550 conn(0x7f3d8c09bf60 msgr2=0x7f3d8c0afaa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-13T18:42:20.082 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:42:20.072+0000 7f3d91cc8640 1 -- 172.21.15.102:0/2600868550 shutdown_connections 2023-11-13T18:42:20.082 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-13T18:42:20.072+0000 7f3d91cc8640 1 -- 172.21.15.102:0/2600868550 wait complete. 2023-11-13T18:42:20.128 DEBUG:tasks.cephfs.filesystem:already dead... 2023-11-13T18:42:20.128 INFO:teuthology.misc:Shutting down mds daemons... 2023-11-13T18:42:20.130 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-11-13T18:42:20.130 INFO:teuthology.orchestra.run:waiting for 300 2023-11-13T18:42:20.181 INFO:tasks.ceph.mds.a:Stopped 2023-11-13T18:42:20.182 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-11-13T18:42:20.182 INFO:teuthology.orchestra.run:waiting for 300 2023-11-13T18:42:20.216 INFO:tasks.ceph.mds.c:Stopped 2023-11-13T18:42:20.217 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-11-13T18:42:20.218 INFO:teuthology.orchestra.run:waiting for 300 2023-11-13T18:42:20.233 INFO:tasks.ceph.mds.b:Stopped 2023-11-13T18:42:20.234 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-11-13T18:42:20.235 INFO:teuthology.orchestra.run:waiting for 300 2023-11-13T18:42:20.298 INFO:tasks.ceph.mds.d:Stopped 2023-11-13T18:42:20.298 INFO:teuthology.misc:Shutting down osd daemons... 2023-11-13T18:42:20.299 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2023-11-13T18:42:20.300 INFO:teuthology.orchestra.run:waiting for 300 2023-11-13T18:42:26.402 INFO:tasks.ceph.osd.0:Stopped 2023-11-13T18:42:26.404 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2023-11-13T18:42:26.404 INFO:teuthology.orchestra.run:waiting for 300 2023-11-13T18:42:26.487 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~0s 2023-11-13T18:42:32.507 INFO:tasks.ceph.osd.1:Stopped 2023-11-13T18:42:32.508 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2023-11-13T18:42:32.508 INFO:teuthology.orchestra.run:waiting for 300 2023-11-13T18:42:32.594 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~0s 2023-11-13T18:42:32.594 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 has been restored 2023-11-13T18:42:32.870 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T18:42:32.876 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T18:42:38.602 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~0s 2023-11-13T18:42:38.603 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 has been restored 2023-11-13T18:42:38.609 INFO:tasks.ceph.osd.2:Stopped 2023-11-13T18:42:38.610 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2023-11-13T18:42:38.611 INFO:teuthology.orchestra.run:waiting for 300 2023-11-13T18:42:44.512 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~0s 2023-11-13T18:42:44.513 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 has been restored 2023-11-13T18:42:44.713 INFO:tasks.ceph.osd.3:Stopped 2023-11-13T18:42:44.715 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2023-11-13T18:42:44.715 INFO:teuthology.orchestra.run:waiting for 300 2023-11-13T18:42:50.322 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~0s 2023-11-13T18:42:50.324 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 has been restored 2023-11-13T18:42:50.817 INFO:tasks.ceph.osd.4:Stopped 2023-11-13T18:42:50.818 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2023-11-13T18:42:50.819 INFO:teuthology.orchestra.run:waiting for 300 2023-11-13T18:42:56.031 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~0s 2023-11-13T18:42:56.032 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 has been restored 2023-11-13T18:42:56.921 INFO:tasks.ceph.osd.5:Stopped 2023-11-13T18:42:56.923 DEBUG:tasks.ceph.osd.6:waiting for process to exit 2023-11-13T18:42:56.923 INFO:teuthology.orchestra.run:waiting for 300 2023-11-13T18:43:01.638 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~0s 2023-11-13T18:43:01.639 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 has been restored 2023-11-13T18:43:02.966 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T18:43:02.972 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T18:43:03.026 INFO:tasks.ceph.osd.6:Stopped 2023-11-13T18:43:03.027 DEBUG:tasks.ceph.osd.7:waiting for process to exit 2023-11-13T18:43:03.027 INFO:teuthology.orchestra.run:waiting for 300 2023-11-13T18:43:07.143 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~0s 2023-11-13T18:43:07.143 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 has been restored 2023-11-13T18:43:09.130 INFO:tasks.ceph.osd.7:Stopped 2023-11-13T18:43:09.130 INFO:teuthology.misc:Shutting down mgr daemons... 2023-11-13T18:43:09.131 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2023-11-13T18:43:09.131 INFO:teuthology.orchestra.run:waiting for 300 2023-11-13T18:43:12.546 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.y is failed for ~0s 2023-11-13T18:43:12.547 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 has been restored 2023-11-13T18:43:15.233 INFO:tasks.ceph.mgr.y:Stopped 2023-11-13T18:43:15.234 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2023-11-13T18:43:15.235 INFO:teuthology.orchestra.run:waiting for 300 2023-11-13T18:43:17.851 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.x is failed for ~0s 2023-11-13T18:43:17.852 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.y has been restored 2023-11-13T18:43:21.338 INFO:tasks.ceph.mgr.x:Stopped 2023-11-13T18:43:21.339 INFO:teuthology.misc:Shutting down mon daemons... 2023-11-13T18:43:21.339 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2023-11-13T18:43:21.340 INFO:teuthology.orchestra.run:waiting for 300 2023-11-13T18:43:23.054 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~0s 2023-11-13T18:43:23.055 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.x has been restored 2023-11-13T18:43:27.442 INFO:tasks.ceph.mon.a:Stopped 2023-11-13T18:43:27.443 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2023-11-13T18:43:27.444 INFO:teuthology.orchestra.run:waiting for 300 2023-11-13T18:43:28.257 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a has been restored 2023-11-13T18:43:33.098 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T18:43:33.105 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T18:43:33.359 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~0s 2023-11-13T18:43:33.546 INFO:tasks.ceph.mon.b:Stopped 2023-11-13T18:43:33.547 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2023-11-13T18:43:33.547 INFO:teuthology.orchestra.run:waiting for 300 2023-11-13T18:43:38.360 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~0s 2023-11-13T18:43:38.361 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b has been restored 2023-11-13T18:43:39.649 INFO:tasks.ceph.mon.c:Stopped 2023-11-13T18:43:39.650 INFO:tasks.ceph:Checking cluster log for badness... 2023-11-13T18:43:39.651 DEBUG:teuthology.orchestra.run.smithi102:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v 'overall HEALTH_' | egrep -v '\(FS_DEGRADED\)' | egrep -v '\(MDS_FAILED\)' | egrep -v '\(MDS_DEGRADED\)' | egrep -v '\(FS_WITH_FAILED_MDS\)' | egrep -v '\(MDS_DAMAGE\)' | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(FS_INLINE_DATA_DEPRECATED\)' | egrep -v '\(POOL_APP_NOT_ENABLED\)' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | head -n 1 2023-11-13T18:43:39.812 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi102.front.sepia.ceph.com 2023-11-13T18:43:39.813 DEBUG:teuthology.orchestra.run.smithi102:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2023-11-13T18:43:40.251 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi102.front.sepia.ceph.com 2023-11-13T18:43:40.252 DEBUG:teuthology.orchestra.run.smithi102:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2023-11-13T18:43:40.586 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi102.front.sepia.ceph.com 2023-11-13T18:43:40.587 DEBUG:teuthology.orchestra.run.smithi102:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2023-11-13T18:43:41.042 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi102.front.sepia.ceph.com 2023-11-13T18:43:41.042 DEBUG:teuthology.orchestra.run.smithi102:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2023-11-13T18:43:41.388 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-4 on ubuntu@smithi154.front.sepia.ceph.com 2023-11-13T18:43:41.389 DEBUG:teuthology.orchestra.run.smithi154:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 2023-11-13T18:43:41.793 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@smithi154.front.sepia.ceph.com 2023-11-13T18:43:41.794 DEBUG:teuthology.orchestra.run.smithi154:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2023-11-13T18:43:42.191 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-6 on ubuntu@smithi154.front.sepia.ceph.com 2023-11-13T18:43:42.191 DEBUG:teuthology.orchestra.run.smithi154:> sync && sudo umount -f /var/lib/ceph/osd/ceph-6 2023-11-13T18:43:42.461 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-7 on ubuntu@smithi154.front.sepia.ceph.com 2023-11-13T18:43:42.462 DEBUG:teuthology.orchestra.run.smithi154:> sync && sudo umount -f /var/lib/ceph/osd/ceph-7 2023-11-13T18:43:42.858 INFO:tasks.ceph:Archiving mon data... 2023-11-13T18:43:42.860 DEBUG:teuthology.misc:Transferring archived files from smithi102:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/mchangir-2023-11-13_10:27:15-fs-wip-mchangir-testing-20231110.052303-testing-default-smithi/7456244/data/mon.a.tgz 2023-11-13T18:43:42.861 DEBUG:teuthology.orchestra.run.smithi102:> mktemp 2023-11-13T18:43:42.881 INFO:teuthology.orchestra.run.smithi102.stdout:/tmp/tmp.HHn4pp1O4f 2023-11-13T18:43:42.883 DEBUG:teuthology.orchestra.run.smithi102:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.HHn4pp1O4f 2023-11-13T18:43:43.318 DEBUG:teuthology.orchestra.run.smithi102:> sudo chmod 0666 /tmp/tmp.HHn4pp1O4f 2023-11-13T18:43:43.362 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c has been restored 2023-11-13T18:43:43.452 DEBUG:teuthology.orchestra.remote:smithi102:/tmp/tmp.HHn4pp1O4f is 550KB 2023-11-13T18:43:43.539 DEBUG:teuthology.orchestra.run.smithi102:> rm -fr /tmp/tmp.HHn4pp1O4f 2023-11-13T18:43:43.559 DEBUG:teuthology.misc:Transferring archived files from smithi154:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/mchangir-2023-11-13_10:27:15-fs-wip-mchangir-testing-20231110.052303-testing-default-smithi/7456244/data/mon.b.tgz 2023-11-13T18:43:43.560 DEBUG:teuthology.orchestra.run.smithi154:> mktemp 2023-11-13T18:43:43.570 INFO:teuthology.orchestra.run.smithi154.stdout:/tmp/tmp.8r7IRdgv5q 2023-11-13T18:43:43.571 DEBUG:teuthology.orchestra.run.smithi154:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.8r7IRdgv5q 2023-11-13T18:43:43.734 DEBUG:teuthology.orchestra.run.smithi154:> sudo chmod 0666 /tmp/tmp.8r7IRdgv5q 2023-11-13T18:43:43.886 DEBUG:teuthology.orchestra.remote:smithi154:/tmp/tmp.8r7IRdgv5q is 552KB 2023-11-13T18:43:43.984 DEBUG:teuthology.orchestra.run.smithi154:> rm -fr /tmp/tmp.8r7IRdgv5q 2023-11-13T18:43:43.995 DEBUG:teuthology.misc:Transferring archived files from smithi154:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/mchangir-2023-11-13_10:27:15-fs-wip-mchangir-testing-20231110.052303-testing-default-smithi/7456244/data/mon.c.tgz 2023-11-13T18:43:43.995 DEBUG:teuthology.orchestra.run.smithi154:> mktemp 2023-11-13T18:43:44.046 INFO:teuthology.orchestra.run.smithi154.stdout:/tmp/tmp.Z5z0tm4QP7 2023-11-13T18:43:44.047 DEBUG:teuthology.orchestra.run.smithi154:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.Z5z0tm4QP7 2023-11-13T18:43:44.194 DEBUG:teuthology.orchestra.run.smithi154:> sudo chmod 0666 /tmp/tmp.Z5z0tm4QP7 2023-11-13T18:43:44.271 DEBUG:teuthology.orchestra.remote:smithi154:/tmp/tmp.Z5z0tm4QP7 is 552KB 2023-11-13T18:43:44.345 DEBUG:teuthology.orchestra.run.smithi154:> rm -fr /tmp/tmp.Z5z0tm4QP7 2023-11-13T18:43:44.354 INFO:tasks.ceph:Cleaning ceph cluster... 2023-11-13T18:43:44.355 DEBUG:teuthology.orchestra.run.smithi102:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2023-11-13T18:43:44.360 DEBUG:teuthology.orchestra.run.smithi154:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2023-11-13T18:43:44.452 INFO:tasks.ceph:Checking for errors in any valgrind logs... 2023-11-13T18:43:44.453 DEBUG:teuthology.orchestra.run.smithi102:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2023-11-13T18:43:44.457 DEBUG:teuthology.orchestra.run.smithi154:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2023-11-13T18:43:44.508 INFO:teuthology.orchestra.run.smithi154.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2023-11-13T18:43:44.529 INFO:teuthology.orchestra.run.smithi102.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2023-11-13T18:43:44.547 INFO:tasks.ceph:Archiving crash dumps... 2023-11-13T18:43:44.549 DEBUG:teuthology.misc:Transferring archived files from smithi102:/var/lib/ceph/crash to /home/teuthworker/archive/mchangir-2023-11-13_10:27:15-fs-wip-mchangir-testing-20231110.052303-testing-default-smithi/7456244/remote/smithi102/crash 2023-11-13T18:43:44.551 DEBUG:teuthology.orchestra.run.smithi102:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2023-11-13T18:43:44.604 DEBUG:teuthology.misc:Transferring archived files from smithi154:/var/lib/ceph/crash to /home/teuthworker/archive/mchangir-2023-11-13_10:27:15-fs-wip-mchangir-testing-20231110.052303-testing-default-smithi/7456244/remote/smithi154/crash 2023-11-13T18:43:44.606 DEBUG:teuthology.orchestra.run.smithi154:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2023-11-13T18:43:44.626 INFO:tasks.ceph:Shutting down logrotate 2023-11-13T18:43:44.626 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T18:43:44.631 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-13T18:43:44.727 DEBUG:teuthology.orchestra.run.smithi102:> sudo rm /etc/logrotate.d/ceph-test.conf 2023-11-13T18:43:44.806 DEBUG:teuthology.orchestra.run.smithi154:> sudo rm /etc/logrotate.d/ceph-test.conf 2023-11-13T18:43:44.834 INFO:tasks.ceph:Compressing logs... 2023-11-13T18:43:44.834 DEBUG:teuthology.orchestra.run.smithi102:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2023-11-13T18:43:44.839 DEBUG:teuthology.orchestra.run.smithi154:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2023-11-13T18:43:44.903 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.216517.log 2023-11-13T18:43:44.906 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.458274.log 2023-11-13T18:43:44.909 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.216517.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.461964.log 2023-11-13T18:43:44.909 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47382.log 2023-11-13T18:43:44.912 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.458274.log: /var/log/ceph/ceph-client.admin.461964.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.208305.log 2023-11-13T18:43:44.914 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.47382.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.449007.log 2023-11-13T18:43:44.916 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.208305.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.203943.log 2023-11-13T18:43:44.919 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.449007.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.203051.log 2023-11-13T18:43:44.921 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.203943.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106923.log 2023-11-13T18:43:44.922 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.1.43485.log 2023-11-13T18:43:44.923 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38284.log 2023-11-13T18:43:44.924 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.488646.log 2023-11-13T18:43:44.925 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.1.43485.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.7.log 2023-11-13T18:43:44.926 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.38284.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.6.log 2023-11-13T18:43:44.926 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-osd.7.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.5.log 2023-11-13T18:43:44.928 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-osd.6.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38332.log 2023-11-13T18:43:44.929 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-osd.5.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38260.log 2023-11-13T18:43:44.929 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.38332.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.3.43591.log 2023-11-13T18:43:44.931 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.203051.log: /var/log/ceph/ceph-client.admin.106923.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.308020.log 2023-11-13T18:43:44.931 INFO:teuthology.orchestra.run.smithi102.stderr: 81.6% -- replaced with /var/log/ceph/ceph-client.admin.208305.log.gz 2023-11-13T18:43:44.932 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.488646.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46986.log 2023-11-13T18:43:44.932 INFO:teuthology.orchestra.run.smithi102.stderr: 78.1% -- replaced with /var/log/ceph/ceph-client.admin.203943.log.gz 2023-11-13T18:43:44.932 INFO:teuthology.orchestra.run.smithi102.stderr: 84.2% -- replaced with /var/log/ceph/ceph-client.admin.488646.log.gz 2023-11-13T18:43:44.933 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.308020.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.233015.log 2023-11-13T18:43:44.935 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.46986.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.340382.log 2023-11-13T18:43:44.936 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.233015.log: 78.0% -- replaced with /var/log/ceph/ceph-client.admin.203051.log.gz 2023-11-13T18:43:44.936 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.210757.log 2023-11-13T18:43:44.938 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38387.log 2023-11-13T18:43:44.939 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2023-11-13T18:43:44.939 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.log 2023-11-13T18:43:44.940 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38236.log 2023-11-13T18:43:44.940 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.c.log 2023-11-13T18:43:44.940 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2023-11-13T18:43:44.941 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.d.log 2023-11-13T18:43:44.941 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.38260.log: /var/log/ceph/ceph-client.3.43591.log: /var/log/ceph/ceph-client.admin.38387.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38363.log 2023-11-13T18:43:44.942 INFO:teuthology.orchestra.run.smithi154.stderr: 89.8% -- replaced with /var/log/ceph/ceph-client.1.43485.log.gz 2023-11-13T18:43:44.942 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-mgr.x.log: /var/log/ceph/ceph.log: /var/log/ceph/ceph-client.admin.38236.log: /var/log/ceph/ceph-mon.c.log: /var/log/ceph/ceph.audit.log: /var/log/ceph/ceph-mds.d.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.b.log 2023-11-13T18:43:44.942 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.38363.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.b.log 2023-11-13T18:43:44.943 INFO:teuthology.orchestra.run.smithi154.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.38284.log.gz 2023-11-13T18:43:44.943 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-mds.b.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38308.log 2023-11-13T18:43:44.946 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-mon.b.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.4.log 2023-11-13T18:43:44.947 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.38308.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38411.log 2023-11-13T18:43:44.947 INFO:teuthology.orchestra.run.smithi154.stderr: 90.6% -- replaced with /var/log/ceph/ceph-client.3.43591.log.gz 2023-11-13T18:43:44.947 INFO:teuthology.orchestra.run.smithi154.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.38308.log.gz 2023-11-13T18:43:44.948 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-osd.4.log: /var/log/ceph/ceph-client.admin.38411.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.38236.log.gz 2023-11-13T18:43:44.948 INFO:teuthology.orchestra.run.smithi154.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.38260.log.gz 2023-11-13T18:43:44.949 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.340382.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.188542.log 2023-11-13T18:43:44.950 INFO:teuthology.orchestra.run.smithi102.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.46986.log.gz 2023-11-13T18:43:44.950 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.210757.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.91999.log 2023-11-13T18:43:44.950 INFO:teuthology.orchestra.run.smithi102.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.47382.log.gz 2023-11-13T18:43:44.951 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.378732.log 2023-11-13T18:43:44.951 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.188542.log: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.340382.log.gz 2023-11-13T18:43:44.951 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.91999.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.299533.log 2023-11-13T18:43:44.952 INFO:teuthology.orchestra.run.smithi102.stderr: 84.2% -- replaced with /var/log/ceph/ceph-client.admin.449007.log.gz 2023-11-13T18:43:44.952 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.378732.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.498882.log 2023-11-13T18:43:44.952 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.299533.log: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.106923.log.gz 2023-11-13T18:43:44.953 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.370128.log 2023-11-13T18:43:44.954 INFO:teuthology.orchestra.run.smithi154.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.38332.log.gz 2023-11-13T18:43:44.955 INFO:teuthology.orchestra.run.smithi154.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.38363.log.gz 2023-11-13T18:43:44.955 INFO:teuthology.orchestra.run.smithi154.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.38387.log.gz 2023-11-13T18:43:44.955 INFO:teuthology.orchestra.run.smithi154.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.38411.log.gz 2023-11-13T18:43:44.957 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.498882.log: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.308020.log.gz 2023-11-13T18:43:44.957 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.302355.log 2023-11-13T18:43:44.957 INFO:teuthology.orchestra.run.smithi102.stderr:gzip/var/log/ceph/ceph-client.admin.370128.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.230573.log 2023-11-13T18:43:44.958 INFO:teuthology.orchestra.run.smithi102.stderr: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.498882.log.gz 2023-11-13T18:43:44.958 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.302355.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.489918.log 2023-11-13T18:43:44.958 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.230573.log: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.233015.log.gz 2023-11-13T18:43:44.959 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.449409.log 2023-11-13T18:43:44.960 INFO:teuthology.orchestra.run.smithi102.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.210757.log.gz 2023-11-13T18:43:44.961 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.489918.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.426525.log 2023-11-13T18:43:44.961 INFO:teuthology.orchestra.run.smithi102.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.370128.log.gz 2023-11-13T18:43:44.961 INFO:teuthology.orchestra.run.smithi102.stderr: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.489918.log.gz 2023-11-13T18:43:44.962 INFO:teuthology.orchestra.run.smithi102.stderr: 81.3% -- replaced with /var/log/ceph/ceph-client.admin.230573.log.gz 2023-11-13T18:43:44.962 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.449409.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.403990.log 2023-11-13T18:43:44.963 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.489524.log 2023-11-13T18:43:44.965 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.426525.log: /var/log/ceph/ceph-client.admin.403990.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.164257.log 2023-11-13T18:43:44.967 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.489524.log: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.458274.log.gz 2023-11-13T18:43:44.967 INFO:teuthology.orchestra.run.smithi102.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.489524.log.gz 2023-11-13T18:43:44.968 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.443516.log 2023-11-13T18:43:44.968 INFO:teuthology.orchestra.run.smithi102.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.426525.log.gz 2023-11-13T18:43:44.969 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.164257.log: gzip 81.4% -- replaced with /var/log/ceph/ceph-client.admin.449409.log.gz 2023-11-13T18:43:44.970 INFO:teuthology.orchestra.run.smithi102.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.458676.log 2023-11-13T18:43:44.972 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.443516.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.461523.log 2023-11-13T18:43:44.975 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.458676.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.85523.log 2023-11-13T18:43:44.976 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.211964.log 2023-11-13T18:43:44.979 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.461523.log: /var/log/ceph/ceph-client.admin.85523.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.398104.log 2023-11-13T18:43:44.980 INFO:teuthology.orchestra.run.smithi102.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.299533.log.gz 2023-11-13T18:43:44.980 INFO:teuthology.orchestra.run.smithi102.stderr: 85.6% -- replaced with /var/log/ceph/ceph-client.admin.378732.log.gz 2023-11-13T18:43:44.981 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.211964.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47017.log 2023-11-13T18:43:44.984 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.398104.log: 81.1% -- replaced with /var/log/ceph/ceph-client.admin.164257.log.gz 2023-11-13T18:43:44.984 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.511096.log 2023-11-13T18:43:44.985 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.47017.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.471318.log 2023-11-13T18:43:44.986 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.511096.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.511096.log.gz 2023-11-13T18:43:44.989 INFO:teuthology.orchestra.run.smithi102.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.47017.log.gz 2023-11-13T18:43:44.989 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113376.log 2023-11-13T18:43:44.989 INFO:teuthology.orchestra.run.smithi102.stderr: 84.4% -- replaced with /var/log/ceph/ceph-client.admin.188542.log.gz 2023-11-13T18:43:44.990 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.471318.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.378746.log 2023-11-13T18:43:44.993 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.113376.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.227296.log 2023-11-13T18:43:44.994 INFO:teuthology.orchestra.run.smithi154.stderr: 93.7% -- replaced with /var/log/ceph/ceph.audit.log.gz 2023-11-13T18:43:44.995 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.378746.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.324463.log 2023-11-13T18:43:44.998 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.227296.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.135241.log 2023-11-13T18:43:44.998 INFO:teuthology.orchestra.run.smithi102.stderr: 92.7% -- replaced with /var/log/ceph/ceph-client.admin.403990.log.gz 2023-11-13T18:43:45.001 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.324463.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.419385.log 2023-11-13T18:43:45.001 INFO:teuthology.orchestra.run.smithi102.stderr: 85.5% -- replaced with /var/log/ceph/ceph-client.admin.461523.log.gz 2023-11-13T18:43:45.003 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44652.log 2023-11-13T18:43:45.003 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.135241.log: 81.3% -- replaced with /var/log/ceph/ceph-client.admin.113376.log.gz 2023-11-13T18:43:45.005 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.419385.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.394448.log 2023-11-13T18:43:45.006 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.44652.log: 79.3% -- replaced with /var/log/ceph/ceph-client.admin.302355.log.gz 2023-11-13T18:43:45.007 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45904.log 2023-11-13T18:43:45.009 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.394448.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47278.log 2023-11-13T18:43:45.011 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.45904.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.170866.log 2023-11-13T18:43:45.012 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.161280.log 2023-11-13T18:43:45.014 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.47278.log: /var/log/ceph/ceph-client.admin.170866.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.45904.log.gz 2023-11-13T18:43:45.015 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.190168.log 2023-11-13T18:43:45.015 INFO:teuthology.orchestra.run.smithi102.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.170866.log.gz 2023-11-13T18:43:45.016 INFO:teuthology.orchestra.run.smithi102.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.47278.log.gz 2023-11-13T18:43:45.017 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43901.log 2023-11-13T18:43:45.020 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.161280.log: /var/log/ceph/ceph-client.admin.190168.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.509080.log 2023-11-13T18:43:45.022 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.244026.log 2023-11-13T18:43:45.023 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.43901.log: /var/log/ceph/ceph-client.admin.509080.log: 83.5% -- replaced with /var/log/ceph/ceph-client.admin.509080.log.gz 2023-11-13T18:43:45.023 INFO:teuthology.orchestra.run.smithi102.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.324463.log.gz 2023-11-13T18:43:45.023 INFO:teuthology.orchestra.run.smithi102.stderr: 81.3% -- replaced with /var/log/ceph/ceph-client.admin.394448.log.gz 2023-11-13T18:43:45.025 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.323246.log 2023-11-13T18:43:45.026 INFO:teuthology.orchestra.run.smithi102.stderr: 81.0% -- replaced with /var/log/ceph/ceph-client.admin.135241.log.gz 2023-11-13T18:43:45.028 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.244026.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92670.log 2023-11-13T18:43:45.031 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.323246.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.474995.log 2023-11-13T18:43:45.031 INFO:teuthology.orchestra.run.smithi102.stderr: 94.3% -- replaced with /var/log/ceph/ceph-client.admin.398104.log.gz 2023-11-13T18:43:45.032 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.92670.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.44652.log.gz 2023-11-13T18:43:45.033 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.198182.log 2023-11-13T18:43:45.037 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.474995.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.422349.log 2023-11-13T18:43:45.039 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47924.log 2023-11-13T18:43:45.041 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.198182.log: /var/log/ceph/ceph-client.admin.422349.log: 81.2% -- replaced with /var/log/ceph/ceph-client.admin.471318.log.gz 2023-11-13T18:43:45.041 INFO:teuthology.orchestra.run.smithi102.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.458676.log.gz 2023-11-13T18:43:45.042 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.322440.log 2023-11-13T18:43:45.043 INFO:teuthology.orchestra.run.smithi102.stderr: 81.5% -- replaced with /var/log/ceph/ceph-client.admin.422349.log.gz 2023-11-13T18:43:45.043 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.428186.log 2023-11-13T18:43:45.044 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.47924.log: /var/log/ceph/ceph-client.admin.322440.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.386697.log 2023-11-13T18:43:45.045 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.428186.log: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.198182.log.gz 2023-11-13T18:43:45.047 INFO:teuthology.orchestra.run.smithi102.stderr: 84.2% -- replaced with /var/log/ceph/ceph-client.admin.443516.log.gz 2023-11-13T18:43:45.048 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92661.log 2023-11-13T18:43:45.050 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.386697.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.421946.log 2023-11-13T18:43:45.050 INFO:teuthology.orchestra.run.smithi102.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.47924.log.gz 2023-11-13T18:43:45.052 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.92661.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.y.log 2023-11-13T18:43:45.053 INFO:teuthology.orchestra.run.smithi102.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.323246.log.gz 2023-11-13T18:43:45.054 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.421946.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.312677.log 2023-11-13T18:43:45.055 INFO:teuthology.orchestra.run.smithi102.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.322440.log.gz 2023-11-13T18:43:45.056 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-mgr.y.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139758.log 2023-11-13T18:43:45.058 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.312677.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.191831.log 2023-11-13T18:43:45.059 INFO:teuthology.orchestra.run.smithi102.stderr: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.386697.log.gz 2023-11-13T18:43:45.060 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.139758.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.407879.log 2023-11-13T18:43:45.063 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.191831.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.425191.log 2023-11-13T18:43:45.065 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.407879.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.397702.log 2023-11-13T18:43:45.068 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.425191.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45644.log 2023-11-13T18:43:45.068 INFO:teuthology.orchestra.run.smithi102.stderr: 78.1% -- replaced with /var/log/ceph/ceph-client.admin.428186.log.gz 2023-11-13T18:43:45.070 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.397702.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.196370.log 2023-11-13T18:43:45.072 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.45644.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.506085.log 2023-11-13T18:43:45.074 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.231789.log 2023-11-13T18:43:45.076 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.196370.log: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.397702.log.gz 2023-11-13T18:43:45.076 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.506085.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.477808.log 2023-11-13T18:43:45.079 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.231789.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.499301.log 2023-11-13T18:43:45.080 INFO:teuthology.orchestra.run.smithi102.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.43901.log.gz 2023-11-13T18:43:45.082 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.206650.log 2023-11-13T18:43:45.083 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.477808.log: /var/log/ceph/ceph-client.admin.499301.log: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.499301.log.gz 2023-11-13T18:43:45.084 INFO:teuthology.orchestra.run.smithi102.stderr: 86.2% -- replaced with /var/log/ceph/ceph-client.admin.421946.log.gz 2023-11-13T18:43:45.085 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.464997.log 2023-11-13T18:43:45.085 INFO:teuthology.orchestra.run.smithi102.stderr: 94.4% -- replaced with /var/log/ceph/ceph-client.admin.506085.log.gz 2023-11-13T18:43:45.086 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.206650.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.341768.log 2023-11-13T18:43:45.088 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.464997.log: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.477808.log.gz 2023-11-13T18:43:45.090 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.320357.log 2023-11-13T18:43:45.092 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.341768.log: 85.4% -- replaced with /var/log/ceph/ceph-client.admin.464997.log.gz 2023-11-13T18:43:45.093 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.185725.log 2023-11-13T18:43:45.094 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.320357.log: 77.9% -- replaced with /var/log/ceph/ceph-client.admin.231789.log.gz 2023-11-13T18:43:45.095 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.492567.log 2023-11-13T18:43:45.097 INFO:teuthology.orchestra.run.smithi102.stderr:gzip/var/log/ceph/ceph-client.admin.185725.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.43927.log 2023-11-13T18:43:45.097 INFO:teuthology.orchestra.run.smithi102.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.45644.log.gz 2023-11-13T18:43:45.098 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.492567.log: 80.7% -- replaced with /var/log/ceph/ceph-client.admin.492567.log.gz 2023-11-13T18:43:45.098 INFO:teuthology.orchestra.run.smithi102.stderr: 78.0% -- replaced with /var/log/ceph/ceph-client.admin.185725.log.gz 2023-11-13T18:43:45.100 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.254015.log 2023-11-13T18:43:45.103 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.43927.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.238300.log 2023-11-13T18:43:45.105 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.254015.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.435239.log 2023-11-13T18:43:45.105 INFO:teuthology.orchestra.run.smithi102.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.43927.log.gz 2023-11-13T18:43:45.108 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.238300.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.400883.log 2023-11-13T18:43:45.108 INFO:teuthology.orchestra.run.smithi102.stderr: 78.1% -- replaced with /var/log/ceph/ceph-client.admin.254015.log.gz 2023-11-13T18:43:45.109 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.435239.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104420.log 2023-11-13T18:43:45.111 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.400883.log: 83.5% -- replaced with /var/log/ceph/ceph-client.admin.238300.log.gz 2023-11-13T18:43:45.112 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.244428.log 2023-11-13T18:43:45.112 INFO:teuthology.orchestra.run.smithi102.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.320357.log.gz 2023-11-13T18:43:45.113 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.240408.log 2023-11-13T18:43:45.116 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.104420.log: /var/log/ceph/ceph-client.admin.244428.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44240.log 2023-11-13T18:43:45.118 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.240408.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.416397.log 2023-11-13T18:43:45.121 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.44240.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113385.log 2023-11-13T18:43:45.124 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.416397.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107733.log 2023-11-13T18:43:45.126 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.113385.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.403152.log 2023-11-13T18:43:45.127 INFO:teuthology.orchestra.run.smithi102.stderr: 77.5% -- replaced with /var/log/ceph/ceph-client.admin.206650.log.gz 2023-11-13T18:43:45.129 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.107733.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47590.log 2023-11-13T18:43:45.130 INFO:teuthology.orchestra.run.smithi102.stderr: 85.4% -- replaced with /var/log/ceph/ceph-client.admin.435239.log.gz 2023-11-13T18:43:45.132 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.403152.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.340848.log 2023-11-13T18:43:45.134 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.47590.log: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.416397.log.gz 2023-11-13T18:43:45.134 INFO:teuthology.orchestra.run.smithi102.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.113385.log.gz 2023-11-13T18:43:45.135 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.134432.log 2023-11-13T18:43:45.137 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.340848.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.230166.log 2023-11-13T18:43:45.140 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.134432.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.498072.log 2023-11-13T18:43:45.141 INFO:teuthology.orchestra.run.smithi102.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.107733.log.gz 2023-11-13T18:43:45.142 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.230166.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.329000.log 2023-11-13T18:43:45.144 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.498072.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.366993.log 2023-11-13T18:43:45.146 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.301139.log 2023-11-13T18:43:45.146 INFO:teuthology.orchestra.run.smithi102.stderr: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.498072.log.gz 2023-11-13T18:43:45.148 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.329000.log: /var/log/ceph/ceph-client.admin.366993.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.371325.log 2023-11-13T18:43:45.150 INFO:teuthology.orchestra.run.smithi102.stderr: 84.2% -- replaced with /var/log/ceph/ceph-client.admin.134432.log.gz 2023-11-13T18:43:45.151 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.301139.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.443112.log 2023-11-13T18:43:45.152 INFO:teuthology.orchestra.run.smithi102.stderr: 80.9% -- replaced with /var/log/ceph/ceph-client.admin.230166.log.gz 2023-11-13T18:43:45.154 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.200233.log 2023-11-13T18:43:45.154 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.371325.log: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.329000.log.gz 2023-11-13T18:43:45.157 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.443112.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.237868.log 2023-11-13T18:43:45.160 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.200233.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.345695.log 2023-11-13T18:43:45.161 INFO:teuthology.orchestra.run.smithi102.stderr: 78.3% -- replaced with /var/log/ceph/ceph-client.admin.301139.log.gz 2023-11-13T18:43:45.161 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.195977.log 2023-11-13T18:43:45.164 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.237868.log: /var/log/ceph/ceph-client.admin.345695.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.134441.log 2023-11-13T18:43:45.164 INFO:teuthology.orchestra.run.smithi102.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.44240.log.gz 2023-11-13T18:43:45.166 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.195977.log: 81.4% -- replaced with /var/log/ceph/ceph-client.admin.443112.log.gz 2023-11-13T18:43:45.166 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.235033.log 2023-11-13T18:43:45.168 INFO:teuthology.orchestra.run.smithi102.stderr: 81.6% -- replaced with /var/log/ceph/ceph-client.admin.196370.log.gz 2023-11-13T18:43:45.169 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46908.log 2023-11-13T18:43:45.171 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.134441.log: /var/log/ceph/ceph-client.admin.235033.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.299122.log 2023-11-13T18:43:45.174 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.46908.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45670.log 2023-11-13T18:43:45.177 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.299122.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.257430.log 2023-11-13T18:43:45.178 INFO:teuthology.orchestra.run.smithi102.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.195977.log.gz 2023-11-13T18:43:45.180 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.45670.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.207509.log 2023-11-13T18:43:45.183 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.257430.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98713.log 2023-11-13T18:43:45.184 INFO:teuthology.orchestra.run.smithi102.stderr: 80.8% -- replaced with /var/log/ceph/ceph-client.admin.371325.log.gz 2023-11-13T18:43:45.186 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.207509.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.445171.log 2023-11-13T18:43:45.187 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.506924.log 2023-11-13T18:43:45.188 INFO:teuthology.orchestra.run.smithi102.stderr: 90.2%/var/log/ceph/ceph-client.admin.98713.log: -- replaced with /var/log/ceph/ceph-client.admin.403152.log.gz 2023-11-13T18:43:45.190 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.445171.log: gzip -5 --verbose 88.5% -- -- replaced with /var/log/ceph/ceph-client.admin.47590.log.gz 2023-11-13T18:43:45.190 INFO:teuthology.orchestra.run.smithi102.stderr: /var/log/ceph/ceph-client.admin.459078.log 2023-11-13T18:43:45.192 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.506924.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.333776.log 2023-11-13T18:43:45.193 INFO:teuthology.orchestra.run.smithi102.stderr: 84.2% -- replaced with /var/log/ceph/ceph-client.admin.237868.log.gz 2023-11-13T18:43:45.194 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.511479.log 2023-11-13T18:43:45.195 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.459078.log: /var/log/ceph/ceph-client.admin.333776.log: 81.1% -- replaced with /var/log/ceph/ceph-client.admin.200233.log.gz 2023-11-13T18:43:45.197 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45227.log 2023-11-13T18:43:45.197 INFO:teuthology.orchestra.run.smithi102.stderr: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.459078.log.gz 2023-11-13T18:43:45.199 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.511479.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.211151.log 2023-11-13T18:43:45.200 INFO:teuthology.orchestra.run.smithi102.stderr: 80.9% -- replaced with /var/log/ceph/ceph-client.admin.345695.log.gz 2023-11-13T18:43:45.200 INFO:teuthology.orchestra.run.smithi102.stderr: 92.2% -- replaced with /var/log/ceph/ceph-client.admin.506924.log.gz 2023-11-13T18:43:45.200 INFO:teuthology.orchestra.run.smithi102.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.511479.log.gz 2023-11-13T18:43:45.201 INFO:teuthology.orchestra.run.smithi102.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.134441.log.gz 2023-11-13T18:43:45.202 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.45227.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.483041.log 2023-11-13T18:43:45.205 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.211151.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.390359.log 2023-11-13T18:43:45.205 INFO:teuthology.orchestra.run.smithi102.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.235033.log.gz 2023-11-13T18:43:45.207 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.483041.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.375054.log 2023-11-13T18:43:45.210 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.390359.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.224588.log 2023-11-13T18:43:45.211 INFO:teuthology.orchestra.run.smithi102.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.341768.log.gz 2023-11-13T18:43:45.213 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.375054.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.511330.log 2023-11-13T18:43:45.214 INFO:teuthology.orchestra.run.smithi102.stderr: 80.7% -- replaced with /var/log/ceph/ceph-client.admin.445171.log.gz 2023-11-13T18:43:45.215 INFO:teuthology.orchestra.run.smithi102.stderr: 78.7% 90.1% -- replaced with /var/log/ceph/ceph-client.admin.211151.log.gz -- replaced with /var/log/ceph/ceph-client.admin.207509.log.gz 2023-11-13T18:43:45.215 INFO:teuthology.orchestra.run.smithi102.stderr: 2023-11-13T18:43:45.216 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.224588.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.158447.log 2023-11-13T18:43:45.218 INFO:teuthology.orchestra.run.smithi102.stderr: 82.0% -- replaced with /var/log/ceph/ceph-client.admin.400883.log.gz 2023-11-13T18:43:45.220 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.511330.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.511330.log.gz 2023-11-13T18:43:45.220 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.305988.log 2023-11-13T18:43:45.222 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.158447.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.45670.log.gz 2023-11-13T18:43:45.223 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.190571.log 2023-11-13T18:43:45.226 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.305988.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.449829.log 2023-11-13T18:43:45.227 INFO:teuthology.orchestra.run.smithi102.stderr: 80.9% -- replaced with /var/log/ceph/ceph-client.admin.98713.log.gz 2023-11-13T18:43:45.228 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.190571.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.340839.log 2023-11-13T18:43:45.231 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.449829.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115101.log 2023-11-13T18:43:45.234 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.382995.log 2023-11-13T18:43:45.235 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.340839.log: 92.9% -- replaced with /var/log/ceph/ceph-client.admin.104420.log.gz 2023-11-13T18:43:45.235 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53246.log 2023-11-13T18:43:45.236 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.115101.log: /var/log/ceph/ceph-client.admin.382995.log: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.419385.log.gz 2023-11-13T18:43:45.238 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46934.log 2023-11-13T18:43:45.239 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.173031.log 2023-11-13T18:43:45.242 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.53246.log: /var/log/ceph/ceph-client.admin.46934.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2023-11-13T18:43:45.244 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.173031.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.197780.log 2023-11-13T18:43:45.248 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.420264.log 2023-11-13T18:43:45.250 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.197780.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.158438.log 2023-11-13T18:43:45.254 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.420264.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.385890.log 2023-11-13T18:43:45.255 INFO:teuthology.orchestra.run.smithi102.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.158447.log.gz 2023-11-13T18:43:45.256 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.158438.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116399.log 2023-11-13T18:43:45.257 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.385890.log: 86.0% -- replaced with /var/log/ceph/ceph-client.admin.161280.log.gz 2023-11-13T18:43:45.258 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.226266.log 2023-11-13T18:43:45.260 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- 90.0% /var/log/ceph/ceph-client.admin.396080.log 2023-11-13T18:43:45.260 INFO:teuthology.orchestra.run.smithi102.stderr: -- replaced with /var/log/ceph/ceph-client.admin.224588.log.gz 2023-11-13T18:43:45.262 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.116399.log: /var/log/ceph/ceph-client.admin.226266.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120126.log 2023-11-13T18:43:45.263 INFO:teuthology.orchestra.run.smithi102.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.240408.log.gz 2023-11-13T18:43:45.264 INFO:teuthology.orchestra.run.smithi102.stderr: 85.4% -- replaced with /var/log/ceph/ceph-client.admin.244428.log.gz 2023-11-13T18:43:45.264 INFO:teuthology.orchestra.run.smithi102.stderr: 80.7% -- replaced with /var/log/ceph/ceph-client.admin.244026.log.gz 2023-11-13T18:43:45.265 INFO:teuthology.orchestra.run.smithi102.stderr:gzip/var/log/ceph/ceph-client.admin.396080.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.218873.log 2023-11-13T18:43:45.268 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.120126.log: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.312677.log.gz 2023-11-13T18:43:45.268 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.389965.log 2023-11-13T18:43:45.271 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.218873.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.385453.log 2023-11-13T18:43:45.274 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.389965.log: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.378746.log.gz 2023-11-13T18:43:45.274 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.380390.log 2023-11-13T18:43:45.276 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.385453.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.483443.log 2023-11-13T18:43:45.279 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.380390.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.491254.log 2023-11-13T18:43:45.281 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.483443.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.310138.log 2023-11-13T18:43:45.284 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.491254.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44031.log 2023-11-13T18:43:45.285 INFO:teuthology.orchestra.run.smithi102.stderr: 81.4% -- replaced with /var/log/ceph/ceph-client.admin.340839.log.gz 2023-11-13T18:43:45.286 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.310138.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.402334.log 2023-11-13T18:43:45.287 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.44031.log: 81.6% -- replaced with /var/log/ceph/ceph-client.admin.390359.log.gz 2023-11-13T18:43:45.289 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.215239.log 2023-11-13T18:43:45.290 INFO:teuthology.orchestra.run.smithi102.stderr: 80.6% -- replaced with /var/log/ceph/ceph-client.admin.305988.log.gz 2023-11-13T18:43:45.290 INFO:teuthology.orchestra.run.smithi102.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.382995.log.gz 2023-11-13T18:43:45.292 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.402334.log: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.389965.log.gz 2023-11-13T18:43:45.293 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.243223.log 2023-11-13T18:43:45.296 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.215239.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.195566.log 2023-11-13T18:43:45.299 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.243223.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.483855.log 2023-11-13T18:43:45.300 INFO:teuthology.orchestra.run.smithi102.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.197780.log.gz 2023-11-13T18:43:45.301 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.195566.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.244831.log 2023-11-13T18:43:45.304 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.483855.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.328991.log 2023-11-13T18:43:45.305 INFO:teuthology.orchestra.run.smithi102.stderr: 81.3% -- replaced with /var/log/ceph/ceph-client.admin.396080.log.gz 2023-11-13T18:43:45.306 INFO:teuthology.orchestra.run.smithi102.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.449829.log.gz 2023-11-13T18:43:45.308 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.244831.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140246.log 2023-11-13T18:43:45.309 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45956.log/var/log/ceph/ceph-client.admin.328991.log: 2023-11-13T18:43:45.310 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.140246.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.53246.log.gz 2023-11-13T18:43:45.313 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.136596.log 2023-11-13T18:43:45.314 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.441846.log 2023-11-13T18:43:45.315 INFO:teuthology.orchestra.run.smithi102.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.375054.log.gz 2023-11-13T18:43:45.317 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.45956.log: /var/log/ceph/ceph-client.admin.136596.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.184528.log 2023-11-13T18:43:45.320 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.441846.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.190159.log 2023-11-13T18:43:45.323 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.184528.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.208314.log 2023-11-13T18:43:45.327 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.190159.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.195968.log 2023-11-13T18:43:45.328 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.208314.log: 79.4% -- replaced with /var/log/ceph/ceph-client.admin.158438.log.gz 2023-11-13T18:43:45.329 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.492576.log 2023-11-13T18:43:45.331 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.407476.log 2023-11-13T18:43:45.332 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.195968.log: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.184528.log.gz 2023-11-13T18:43:45.332 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.492576.log: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.492576.log.gz 2023-11-13T18:43:45.334 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.205680.log 2023-11-13T18:43:45.336 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.253168.log 2023-11-13T18:43:45.337 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.407476.log: /var/log/ceph/ceph-client.admin.205680.log: 81.3% -- replaced with /var/log/ceph/ceph-client.admin.226266.log.gz 2023-11-13T18:43:45.338 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.423173.log 2023-11-13T18:43:45.339 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.253168.log: 84.4% -- replaced with /var/log/ceph/ceph-client.admin.190159.log.gz 2023-11-13T18:43:45.340 INFO:teuthology.orchestra.run.smithi102.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.190168.log.gz 2023-11-13T18:43:45.341 INFO:teuthology.orchestra.run.smithi102.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.190571.log.gz 2023-11-13T18:43:45.341 INFO:teuthology.orchestra.run.smithi102.stderr: 80.7% -- replaced with /var/log/ceph/ceph-client.admin.191831.log.gz 2023-11-13T18:43:45.342 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.406659.log 2023-11-13T18:43:45.342 INFO:teuthology.orchestra.run.smithi102.stderr: 77.6% -- replaced with /var/log/ceph/ceph-client.admin.195566.log.gz 2023-11-13T18:43:45.343 INFO:teuthology.orchestra.run.smithi102.stderr: 81.3% -- replaced with /var/log/ceph/ceph-client.admin.205680.log.gz 2023-11-13T18:43:45.344 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.423173.log: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.407476.log.gz 2023-11-13T18:43:45.344 INFO:teuthology.orchestra.run.smithi102.stderr: 81.6% -- replaced with /var/log/ceph/ceph-client.admin.483443.log.gz 2023-11-13T18:43:45.345 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46751.log 2023-11-13T18:43:45.345 INFO:teuthology.orchestra.run.smithi102.stderr: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.483855.log.gz 2023-11-13T18:43:45.346 INFO:teuthology.orchestra.run.smithi102.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.208314.log.gz 2023-11-13T18:43:45.347 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.406659.log: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.44031.log.gz 2023-11-13T18:43:45.347 INFO:teuthology.orchestra.run.smithi102.stderr: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.227296.log.gz 2023-11-13T18:43:45.348 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.187745.log 2023-11-13T18:43:45.348 INFO:teuthology.orchestra.run.smithi102.stderr: 86.3% -- replaced with /var/log/ceph/ceph-client.admin.244831.log.gz 2023-11-13T18:43:45.349 INFO:teuthology.orchestra.run.smithi102.stderr: 78.8% -- replaced with /var/log/ceph/ceph-client.admin.299122.log.gz 2023-11-13T18:43:45.351 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.46751.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.177714.log 2023-11-13T18:43:45.351 INFO:teuthology.orchestra.run.smithi102.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.45956.log.gz 2023-11-13T18:43:45.352 INFO:teuthology.orchestra.run.smithi102.stderr: 81.5% -- replaced with /var/log/ceph/ceph-client.admin.406659.log.gz 2023-11-13T18:43:45.353 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.187745.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.330705.log 2023-11-13T18:43:45.354 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.177714.log: 78.5% -- replaced with /var/log/ceph/ceph-client.admin.333776.log.gz 2023-11-13T18:43:45.356 INFO:teuthology.orchestra.run.smithi102.stderr: 84.5% -- replaced with /var/log/ceph/ceph-client.admin.215239.log.gz 2023-11-13T18:43:45.357 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.201037.log 2023-11-13T18:43:45.357 INFO:teuthology.orchestra.run.smithi102.stderr: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.218873.log.gz 2023-11-13T18:43:45.358 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.330705.log: 79.4% -- replaced with /var/log/ceph/ceph-client.admin.195968.log.gz 2023-11-13T18:43:45.359 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.165118.log 2023-11-13T18:43:45.361 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.201037.log: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.441846.log.gz 2023-11-13T18:43:45.362 INFO:teuthology.orchestra.run.smithi102.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.423173.log.gz 2023-11-13T18:43:45.363 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.448604.log 2023-11-13T18:43:45.366 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.165118.log: 92.0% -- replaced with /var/log/ceph/ceph-client.admin.173031.log.gz 2023-11-13T18:43:45.367 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46060.log 2023-11-13T18:43:45.369 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.448604.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.300745.log 2023-11-13T18:43:45.370 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.46060.log: 92.7% -- replaced with /var/log/ceph/ceph-client.admin.385890.log.gz 2023-11-13T18:43:45.370 INFO:teuthology.orchestra.run.smithi102.stderr: 79.4% -- replaced with /var/log/ceph/ceph-client.admin.310138.log.gz 2023-11-13T18:43:45.372 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.449820.log 2023-11-13T18:43:45.373 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.300745.log: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.257430.log.gz 2023-11-13T18:43:45.375 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.490813.log 2023-11-13T18:43:45.379 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.449820.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.347632.log 2023-11-13T18:43:45.379 INFO:teuthology.orchestra.run.smithi102.stderr: 79.3% -- replaced with /var/log/ceph/ceph-client.admin.483041.log.gz 2023-11-13T18:43:45.381 INFO:teuthology.orchestra.run.smithi102.stderr: 81.3% -- replaced with /var/log/ceph/ceph-client.admin.449820.log.gz 2023-11-13T18:43:45.381 INFO:teuthology.orchestra.run.smithi102.stderr: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.448604.log.gz 2023-11-13T18:43:45.381 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.490813.log: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.243223.log.gz 2023-11-13T18:43:45.381 INFO:teuthology.orchestra.run.smithi102.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.46060.log.gz 2023-11-13T18:43:45.382 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.322037.log 2023-11-13T18:43:45.382 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.347632.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.196772.log 2023-11-13T18:43:45.384 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.322037.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.510784.log 2023-11-13T18:43:45.386 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.196772.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.310571.log 2023-11-13T18:43:45.386 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.510784.log: 81.4% -- replaced with /var/log/ceph/ceph-client.admin.510784.log.gz 2023-11-13T18:43:45.389 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.446883.log 2023-11-13T18:43:45.390 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.310571.log: 81.6% -- replaced with /var/log/ceph/ceph-client.admin.196772.log.gz 2023-11-13T18:43:45.391 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.164266.log 2023-11-13T18:43:45.393 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.446883.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.331171.log 2023-11-13T18:43:45.394 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.164266.log: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.253168.log.gz 2023-11-13T18:43:45.395 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.432878.log 2023-11-13T18:43:45.395 INFO:teuthology.orchestra.run.smithi102.stderr: 80.1% -- replaced with /var/log/ceph/ceph-client.admin.328991.log.gz 2023-11-13T18:43:45.396 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.331171.log: 82.5% -- replaced with /var/log/ceph/ceph-client.admin.201037.log.gz 2023-11-13T18:43:45.397 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.180726.log 2023-11-13T18:43:45.400 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.432878.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.377895.log 2023-11-13T18:43:45.400 INFO:teuthology.orchestra.run.smithi102.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.300745.log.gz 2023-11-13T18:43:45.402 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.180726.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.256215.log 2023-11-13T18:43:45.404 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.377895.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.497597.log 2023-11-13T18:43:45.406 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.256215.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.388758.log 2023-11-13T18:43:45.406 INFO:teuthology.orchestra.run.smithi102.stderr: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.45227.log.gz 2023-11-13T18:43:45.407 INFO:teuthology.orchestra.run.smithi154.stderr: 94.1% -- replaced with /var/log/ceph/ceph.log.gz 2023-11-13T18:43:45.407 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.497597.log: 78.1% -- replaced with /var/log/ceph/ceph-client.admin.497597.log.gz 2023-11-13T18:43:45.409 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44057.log 2023-11-13T18:43:45.410 INFO:teuthology.orchestra.run.smithi102.stderr: 93.6% -- replaced with /var/log/ceph/ceph-client.admin.177714.log.gz 2023-11-13T18:43:45.411 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.388758.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44645.log 2023-11-13T18:43:45.414 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.44057.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.372582.log 2023-11-13T18:43:45.415 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.44645.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.456967.log 2023-11-13T18:43:45.416 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.372582.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.365746.log 2023-11-13T18:43:45.417 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.456967.log: 93.2% -- replaced with /var/log/ceph/ceph-client.admin.211964.log.gz 2023-11-13T18:43:45.419 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.393652.log 2023-11-13T18:43:45.423 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.365746.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114642.log 2023-11-13T18:43:45.425 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.443121.log 2023-11-13T18:43:45.428 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.393652.log: /var/log/ceph/ceph-client.admin.114642.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.460681.log 2023-11-13T18:43:45.430 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.443121.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.385037.log 2023-11-13T18:43:45.430 INFO:teuthology.orchestra.run.smithi102.stderr: 80.9% -- replaced with /var/log/ceph/ceph-client.admin.432878.log.gz 2023-11-13T18:43:45.431 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.460681.log: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.330705.log.gz 2023-11-13T18:43:45.431 INFO:teuthology.orchestra.run.smithi102.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.322037.log.gz 2023-11-13T18:43:45.432 INFO:teuthology.orchestra.run.smithi102.stderr: 81.6% -- replaced with /var/log/ceph/ceph-client.admin.446883.log.gz 2023-11-13T18:43:45.432 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.182870.log 2023-11-13T18:43:45.435 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose --/var/log/ceph/ceph-client.admin.385037.log: /var/log/ceph/ceph-client.admin.245242.log 2023-11-13T18:43:45.435 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.182870.log: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.372582.log.gz 2023-11-13T18:43:45.436 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.421119.log 2023-11-13T18:43:45.439 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.245242.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43623.log 2023-11-13T18:43:45.440 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.421119.log: 92.1% -- replaced with /var/log/ceph/ceph-client.admin.140246.log.gz 2023-11-13T18:43:45.440 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.198986.log 2023-11-13T18:43:45.441 INFO:teuthology.orchestra.run.smithi102.stderr: 90.2%/var/log/ceph/ceph-client.admin.43623.log: -- replaced with /var/log/ceph/ceph-client.admin.377895.log.gz 2023-11-13T18:43:45.442 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.133210.log 2023-11-13T18:43:45.444 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.198986.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.302757.log 2023-11-13T18:43:45.446 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.133210.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.46908.log.gz 2023-11-13T18:43:45.447 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.89535.log 2023-11-13T18:43:45.447 INFO:teuthology.orchestra.run.smithi102.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.46934.log.gz 2023-11-13T18:43:45.448 INFO:teuthology.orchestra.run.smithi102.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.198986.log.gz 2023-11-13T18:43:45.450 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.302757.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.215674.log 2023-11-13T18:43:45.452 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.89535.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104853.log 2023-11-13T18:43:45.455 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.215674.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.382986.log 2023-11-13T18:43:45.456 INFO:teuthology.orchestra.run.smithi102.stderr: 78.0% -- replaced with /var/log/ceph/ceph-client.admin.114642.log.gz 2023-11-13T18:43:45.459 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.104853.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.220111.log 2023-11-13T18:43:45.459 INFO:teuthology.orchestra.run.smithi102.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.44057.log.gz 2023-11-13T18:43:45.460 INFO:teuthology.orchestra.run.smithi102.stderr: 80.6% -- replaced with /var/log/ceph/ceph-client.admin.182870.log.gz 2023-11-13T18:43:45.461 INFO:teuthology.orchestra.run.smithi102.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.44645.log.gz 2023-11-13T18:43:45.462 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.382986.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.405922.log 2023-11-13T18:43:45.463 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.220111.log: 78.4% 81.4% -- replaced with /var/log/ceph/ceph-client.admin.382986.log.gz 2023-11-13T18:43:45.464 INFO:teuthology.orchestra.run.smithi102.stderr: -- replaced with /var/log/ceph/ceph-client.admin.460681.log.gz 2023-11-13T18:43:45.464 INFO:teuthology.orchestra.run.smithi102.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.443121.log.gz 2023-11-13T18:43:45.465 INFO:teuthology.orchestra.run.smithi102.stderr: 80.9% -- replaced with /var/log/ceph/ceph-client.admin.302757.log.gz 2023-11-13T18:43:45.467 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.505225.log 2023-11-13T18:43:45.470 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.405922.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.163852.log 2023-11-13T18:43:45.470 INFO:teuthology.orchestra.run.smithi102.stderr: 93.6% -- replaced with /var/log/ceph/ceph-client.admin.164266.log.gz 2023-11-13T18:43:45.472 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.505225.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.347161.log 2023-11-13T18:43:45.472 INFO:teuthology.orchestra.run.smithi102.stderr: 81.1% -- replaced with /var/log/ceph/ceph-client.admin.505225.log.gz 2023-11-13T18:43:45.474 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.163852.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.209951.log 2023-11-13T18:43:45.474 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.347161.log: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.393652.log.gz 2023-11-13T18:43:45.475 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.204393.log 2023-11-13T18:43:45.477 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.209951.log: 92.5% -- replaced with /var/log/ceph/ceph-client.admin.331171.log.gz 2023-11-13T18:43:45.478 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.509089.log 2023-11-13T18:43:45.478 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.204393.log: 92.3% -- replaced with /var/log/ceph/ceph-client.admin.456967.log.gz 2023-11-13T18:43:45.479 INFO:teuthology.orchestra.run.smithi102.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.46751.log.gz 2023-11-13T18:43:45.481 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.206659.log 2023-11-13T18:43:45.481 INFO:teuthology.orchestra.run.smithi102.stderr: 93.6% -- replaced with /var/log/ceph/ceph-client.admin.245242.log.gz 2023-11-13T18:43:45.482 INFO:teuthology.orchestra.run.smithi102.stderr: 85.2% -- replaced with /var/log/ceph/ceph-client.admin.385037.log.gz 2023-11-13T18:43:45.483 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.235431.log 2023-11-13T18:43:45.485 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.509089.log: /var/log/ceph/ceph-client.admin.206659.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.241212.log 2023-11-13T18:43:45.486 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.235431.log: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.421119.log.gz 2023-11-13T18:43:45.487 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.414732.log 2023-11-13T18:43:45.488 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.241212.log: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.388758.log.gz 2023-11-13T18:43:45.488 INFO:teuthology.orchestra.run.smithi102.stderr: 93.6% -- replaced with /var/log/ceph/ceph-client.admin.180726.log.gz 2023-11-13T18:43:45.489 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92208.log 2023-11-13T18:43:45.491 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.414732.log: 85.3% -- replaced with /var/log/ceph/ceph-client.admin.133210.log.gz 2023-11-13T18:43:45.492 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.212410.log 2023-11-13T18:43:45.492 INFO:teuthology.orchestra.run.smithi102.stderr: 92.7% -- replaced with /var/log/ceph/ceph-client.admin.256215.log.gz 2023-11-13T18:43:45.495 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.92208.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.304384.log 2023-11-13T18:43:45.498 INFO:teuthology.orchestra.run.smithi102.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.241212.log.gz 2023-11-13T18:43:45.498 INFO:teuthology.orchestra.run.smithi102.stderr: 95.6% -- replaced with /var/log/ceph/ceph-client.admin.85523.log.gz 2023-11-13T18:43:45.499 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.311376.log 2023-11-13T18:43:45.499 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.304384.log: 92.7% -- replaced with /var/log/ceph/ceph-client.admin.509089.log.gz 2023-11-13T18:43:45.499 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.212410.log: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.116399.log.gz 2023-11-13T18:43:45.500 INFO:teuthology.orchestra.run.smithi102.stderr: 77.6% -- replaced with /var/log/ceph/ceph-client.admin.120126.log.gz 2023-11-13T18:43:45.500 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.394860.log 2023-11-13T18:43:45.501 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.311376.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.216105.log 2023-11-13T18:43:45.502 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.325258.log 2023-11-13T18:43:45.504 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.216105.log: /var/log/ceph/ceph-client.admin.394860.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.43623.log.gz 2023-11-13T18:43:45.505 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.498873.log 2023-11-13T18:43:45.506 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.216508.log 2023-11-13T18:43:45.507 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.325258.log: /var/log/ceph/ceph-client.admin.498873.log: 85.0% -- replaced with /var/log/ceph/ceph-client.admin.498873.log.gz 2023-11-13T18:43:45.508 INFO:teuthology.orchestra.run.smithi102.stderr: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.220111.log.gz 2023-11-13T18:43:45.509 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.193536.log 2023-11-13T18:43:45.511 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.216508.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.335440.log 2023-11-13T18:43:45.514 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.193536.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.233821.log 2023-11-13T18:43:45.516 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108538.log 2023-11-13T18:43:45.517 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.335440.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43590.log 2023-11-13T18:43:45.520 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.233821.log: /var/log/ceph/ceph-client.admin.108538.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.335431.log 2023-11-13T18:43:45.521 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.43590.log: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.347632.log.gz 2023-11-13T18:43:45.522 INFO:teuthology.orchestra.run.smithi102.stderr: 84.3% -- replaced with /var/log/ceph/ceph-client.admin.235431.log.gz 2023-11-13T18:43:45.523 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.192700.log 2023-11-13T18:43:45.523 INFO:teuthology.orchestra.run.smithi102.stderr: 79.4% -- replaced with /var/log/ceph/ceph-client.admin.394860.log.gz 2023-11-13T18:43:45.523 INFO:teuthology.orchestra.run.smithi102.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.365746.log.gz 2023-11-13T18:43:45.525 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.335431.log: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.304384.log.gz 2023-11-13T18:43:45.525 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.476590.log 2023-11-13T18:43:45.527 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.192700.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.311787.log 2023-11-13T18:43:45.528 INFO:teuthology.orchestra.run.smithi102.stderr: 80.9% -- replaced with /var/log/ceph/ceph-client.admin.414732.log.gz 2023-11-13T18:43:45.530 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.476590.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105295.log 2023-11-13T18:43:45.533 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.311787.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.422358.log 2023-11-13T18:43:45.536 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.105295.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.503533.log 2023-11-13T18:43:45.537 INFO:teuthology.orchestra.run.smithi102.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.420264.log.gz 2023-11-13T18:43:45.540 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.422358.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.442314.log 2023-11-13T18:43:45.542 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.503533.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102397.log 2023-11-13T18:43:45.544 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.442314.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.300333.log 2023-11-13T18:43:45.546 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.102397.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.160877.log 2023-11-13T18:43:45.546 INFO:teuthology.orchestra.run.smithi102.stderr: 81.3% -- replaced with /var/log/ceph/ceph-client.admin.325258.log.gz 2023-11-13T18:43:45.548 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.300333.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.323237.log 2023-11-13T18:43:45.549 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.160877.log: 92.1% -- replaced with /var/log/ceph/ceph-client.admin.503533.log.gz 2023-11-13T18:43:45.550 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.450287.log 2023-11-13T18:43:45.551 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.323237.log: 77.7% -- replaced with /var/log/ceph/ceph-client.admin.215674.log.gz 2023-11-13T18:43:45.552 INFO:teuthology.orchestra.run.smithi102.stderr: 81.2% -- replaced with /var/log/ceph/ceph-client.admin.216105.log.gz 2023-11-13T18:43:45.552 INFO:teuthology.orchestra.run.smithi102.stderr: 78.0% -- replaced with /var/log/ceph/ceph-client.admin.216508.log.gz 2023-11-13T18:43:45.553 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.512150.log 2023-11-13T18:43:45.554 INFO:teuthology.orchestra.run.smithi102.stderr: 79.1% -- replaced with /var/log/ceph/ceph-client.admin.300333.log.gz 2023-11-13T18:43:45.555 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.450287.log: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.108538.log.gz 2023-11-13T18:43:45.555 INFO:teuthology.orchestra.run.smithi102.stderr: 81.5% -- replaced with /var/log/ceph/ceph-client.admin.380390.log.gz 2023-11-13T18:43:45.557 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.470187.log 2023-11-13T18:43:45.557 INFO:teuthology.orchestra.run.smithi102.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.187745.log.gz 2023-11-13T18:43:45.559 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.512150.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.395682.log 2023-11-13T18:43:45.559 INFO:teuthology.orchestra.run.smithi102.stderr: 80.0% -- replaced with /var/log/ceph/ceph-client.admin.402334.log.gz 2023-11-13T18:43:45.560 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.470187.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.512150.log.gz 2023-11-13T18:43:45.561 INFO:teuthology.orchestra.run.smithi102.stderr: 77.6% -- replaced with /var/log/ceph/ceph-client.admin.212410.log.gz 2023-11-13T18:43:45.561 INFO:teuthology.orchestra.run.smithi102.stderr: 92.1% -- replaced with /var/log/ceph/ceph-client.admin.163852.log.gz 2023-11-13T18:43:45.561 INFO:teuthology.orchestra.run.smithi102.stderr: 81.4% -- replaced with /var/log/ceph/ceph-client.admin.323237.log.gz 2023-11-13T18:43:45.562 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.395682.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.438664.log 2023-11-13T18:43:45.565 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116803.log 2023-11-13T18:43:45.565 INFO:teuthology.orchestra.run.smithi102.stderr: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.165118.log.gz 2023-11-13T18:43:45.566 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.438664.log: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.422358.log.gz 2023-11-13T18:43:45.567 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.364454.log 2023-11-13T18:43:45.568 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.116803.log: 92.3% -- replaced with /var/log/ceph/ceph-client.admin.193536.log.gz 2023-11-13T18:43:45.570 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.202649.log 2023-11-13T18:43:45.570 INFO:teuthology.orchestra.run.smithi102.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.209951.log.gz 2023-11-13T18:43:45.573 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.364454.log: 81.5% -- replaced with /var/log/ceph/ceph-client.admin.310571.log.gz 2023-11-13T18:43:45.573 INFO:teuthology.orchestra.run.smithi102.stderr: 81.4% -- replaced with /var/log/ceph/ceph-client.admin.311376.log.gz 2023-11-13T18:43:45.574 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44657.log 2023-11-13T18:43:45.576 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.202649.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.420255.log 2023-11-13T18:43:45.579 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.44657.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.487397.log 2023-11-13T18:43:45.580 INFO:teuthology.orchestra.run.smithi102.stderr: 81.1% -- replaced with /var/log/ceph/ceph-client.admin.335431.log.gz 2023-11-13T18:43:45.581 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.420255.log: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.116803.log.gz 2023-11-13T18:43:45.582 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38086.log 2023-11-13T18:43:45.582 INFO:teuthology.orchestra.run.smithi102.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.233821.log.gz 2023-11-13T18:43:45.583 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.239595.log 2023-11-13T18:43:45.585 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.38086.log: /var/log/ceph/ceph-client.admin.487397.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44229.log 2023-11-13T18:43:45.586 INFO:teuthology.orchestra.run.smithi102.stderr: 85.1% -- replaced with /var/log/ceph/ceph-client.admin.487397.log.gz 2023-11-13T18:43:45.588 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.222922.log 2023-11-13T18:43:45.588 INFO:teuthology.orchestra.run.smithi102.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.442314.log.gz 2023-11-13T18:43:45.588 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.239595.log: /var/log/ceph/ceph-client.admin.44229.log: 80.9% -- replaced with /var/log/ceph/ceph-client.admin.202649.log.gz 2023-11-13T18:43:45.589 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.240810.log 2023-11-13T18:43:45.589 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.222922.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.43590.log.gz 2023-11-13T18:43:45.591 INFO:teuthology.orchestra.run.smithi102.stderr: 81.5% -- replaced with /var/log/ceph/ceph-client.admin.476590.log.gz 2023-11-13T18:43:45.591 INFO:teuthology.orchestra.run.smithi102.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.44229.log.gz 2023-11-13T18:43:45.592 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.403981.log 2023-11-13T18:43:45.593 INFO:teuthology.orchestra.run.smithi102.stderr: 93.6% -- replaced with /var/log/ceph/ceph-client.admin.335440.log.gz 2023-11-13T18:43:45.594 INFO:teuthology.orchestra.run.smithi102.stderr: 92.4% -- replaced with /var/log/ceph/ceph-client.admin.204393.log.gz 2023-11-13T18:43:45.595 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.332109.log 2023-11-13T18:43:45.596 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.240810.log: 80.9% -- replaced with /var/log/ceph/ceph-client.admin.450287.log.gz 2023-11-13T18:43:45.596 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.403981.log: 84.5% -- replaced with /var/log/ceph/ceph-client.admin.364454.log.gz 2023-11-13T18:43:45.597 INFO:teuthology.orchestra.run.smithi102.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.438664.log.gz 2023-11-13T18:43:45.597 INFO:teuthology.orchestra.run.smithi102.stderr: 80.6% -- replaced with /var/log/ceph/ceph-client.admin.239595.log.gz 2023-11-13T18:43:45.597 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.374607.log 2023-11-13T18:43:45.600 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.332109.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.229759.log 2023-11-13T18:43:45.602 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.374607.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.461124.log 2023-11-13T18:43:45.605 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.229759.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45852.log 2023-11-13T18:43:45.605 INFO:teuthology.orchestra.run.smithi102.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.395682.log.gz 2023-11-13T18:43:45.606 INFO:teuthology.orchestra.run.smithi102.stderr: 84.2% -- replaced with /var/log/ceph/ceph-client.admin.222922.log.gz 2023-11-13T18:43:45.608 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.482648.log 2023-11-13T18:43:45.609 INFO:teuthology.orchestra.run.smithi102.stderr: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.403981.log.gz 2023-11-13T18:43:45.609 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.461124.log: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.240810.log.gz 2023-11-13T18:43:45.609 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.45852.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.44657.log.gz 2023-11-13T18:43:45.610 INFO:teuthology.orchestra.run.smithi102.stderr: 81.1% -- replaced with /var/log/ceph/ceph-client.admin.374607.log.gz 2023-11-13T18:43:45.610 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.375447.log 2023-11-13T18:43:45.613 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.482648.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.487818.log 2023-11-13T18:43:45.614 INFO:teuthology.orchestra.run.smithi102.stderr: 92.4% -- replaced with /var/log/ceph/ceph-client.admin.38086.log.gz 2023-11-13T18:43:45.616 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.375447.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112562.log 2023-11-13T18:43:45.617 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.487818.log: 81.2% -- replaced with /var/log/ceph/ceph-client.admin.470187.log.gz 2023-11-13T18:43:45.619 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.193134.log 2023-11-13T18:43:45.619 INFO:teuthology.orchestra.run.smithi102.stderr: 92.4% -- replaced with /var/log/ceph/ceph-client.admin.487818.log.gz 2023-11-13T18:43:45.621 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.112562.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.224171.log 2023-11-13T18:43:45.622 INFO:teuthology.orchestra.run.smithi102.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.45852.log.gz 2023-11-13T18:43:45.624 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.193134.log: 90.1% 89.7% -- replaced with /var/log/ceph/ceph-client.admin.482648.log.gz 2023-11-13T18:43:45.625 INFO:teuthology.orchestra.run.smithi102.stderr: -- replaced with /var/log/ceph/ceph-client.admin.461124.log.gz 2023-11-13T18:43:45.626 INFO:teuthology.orchestra.run.smithi102.stderr: 81.3% -- replaced with /var/log/ceph/ceph-client.admin.375447.log.gz 2023-11-13T18:43:45.626 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.444320.log 2023-11-13T18:43:45.626 INFO:teuthology.orchestra.run.smithi102.stderr: 81.0% -- replaced with /var/log/ceph/ceph-client.admin.229759.log.gz 2023-11-13T18:43:45.627 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.224171.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.436077.log 2023-11-13T18:43:45.629 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.444320.log: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.332109.log.gz 2023-11-13T18:43:45.630 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.88711.log 2023-11-13T18:43:45.632 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.436077.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104005.log 2023-11-13T18:43:45.635 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.88711.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.510370.log 2023-11-13T18:43:45.639 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.104005.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.177284.log 2023-11-13T18:43:45.640 INFO:teuthology.orchestra.run.smithi102.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.193134.log.gz 2023-11-13T18:43:45.641 INFO:teuthology.orchestra.run.smithi102.stderr: 83.7% -- replaced with /var/log/ceph/ceph-client.admin.112562.log.gz 2023-11-13T18:43:45.641 INFO:teuthology.orchestra.run.smithi102.stderr: 81.0%/var/log/ceph/ceph-client.admin.510370.log: -- replaced with /var/log/ceph/ceph-client.admin.444320.log.gz 2023-11-13T18:43:45.642 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.504800.log 2023-11-13T18:43:45.643 INFO:teuthology.orchestra.run.smithi102.stderr: 81.4% -- replaced with /var/log/ceph/ceph-client.admin.510370.log.gz 2023-11-13T18:43:45.645 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.177284.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47872.log 2023-11-13T18:43:45.646 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.422765.log 2023-11-13T18:43:45.648 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.504800.log: /var/log/ceph/ceph-client.admin.47872.log: 78.7% -- replaced with /var/log/ceph/ceph-client.admin.504800.log.gz 2023-11-13T18:43:45.649 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.206144.log 2023-11-13T18:43:45.650 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.422765.log: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.436077.log.gz 2023-11-13T18:43:45.651 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.305587.log 2023-11-13T18:43:45.654 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.206144.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.158031.log 2023-11-13T18:43:45.656 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.305587.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.178144.log 2023-11-13T18:43:45.658 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.158031.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.219276.log 2023-11-13T18:43:45.660 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.178144.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.508636.log 2023-11-13T18:43:45.663 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.219276.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.227707.log 2023-11-13T18:43:45.666 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.189351.log 2023-11-13T18:43:45.667 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.508636.log: /var/log/ceph/ceph-client.admin.227707.log: 77.7% -- replaced with /var/log/ceph/ceph-client.admin.508636.log.gz 2023-11-13T18:43:45.668 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 84.2% --verbose -- replaced with /var/log/ceph/ceph-client.admin.158031.log.gz -- 2023-11-13T18:43:45.668 INFO:teuthology.orchestra.run.smithi102.stderr: /var/log/ceph/ceph-client.admin.330230.log 2023-11-13T18:43:45.671 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.189351.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.158852.log 2023-11-13T18:43:45.671 INFO:teuthology.orchestra.run.smithi102.stderr: 84.3% -- replaced with /var/log/ceph/ceph-client.admin.206144.log.gz 2023-11-13T18:43:45.672 INFO:teuthology.orchestra.run.smithi102.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.227707.log.gz 2023-11-13T18:43:45.673 INFO:teuthology.orchestra.run.smithi102.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.47872.log.gz 2023-11-13T18:43:45.673 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.330230.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.465006.log 2023-11-13T18:43:45.675 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.158852.log: 78.1% -- replaced with /var/log/ceph/ceph-client.admin.305587.log.gz 2023-11-13T18:43:45.675 INFO:teuthology.orchestra.run.smithi102.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.160877.log.gz 2023-11-13T18:43:45.676 INFO:teuthology.orchestra.run.smithi102.stderr: 90.4% -- replaced with /var/log/ceph/ceph-client.admin.422765.log.gz 2023-11-13T18:43:45.676 INFO:teuthology.orchestra.run.smithi102.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.219276.log.gz 2023-11-13T18:43:45.677 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.381414.log 2023-11-13T18:43:45.679 INFO:teuthology.orchestra.run.smithi102.stderr: 80.3% -- replaced with /var/log/ceph/ceph-client.admin.224171.log.gz 2023-11-13T18:43:45.679 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.337550.log 2023-11-13T18:43:45.681 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.381414.log: /var/log/ceph/ceph-client.admin.465006.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.317934.log 2023-11-13T18:43:45.682 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.337550.log: 93.6% -- replaced with /var/log/ceph/ceph-client.admin.177284.log.gz 2023-11-13T18:43:45.683 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.405913.log 2023-11-13T18:43:45.686 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.317934.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.319943.log 2023-11-13T18:43:45.688 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.405913.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.457642.log 2023-11-13T18:43:45.690 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.319943.log: 79.3% -- replaced with /var/log/ceph/ceph-client.admin.189351.log.gz 2023-11-13T18:43:45.691 INFO:teuthology.orchestra.run.smithi102.stderr: 80.9% -- replaced with /var/log/ceph/ceph-client.admin.330230.log.gz 2023-11-13T18:43:45.692 INFO:teuthology.orchestra.run.smithi102.stderr: 78.9% -- replaced with /var/log/ceph/ceph-client.admin.405913.log.gz 2023-11-13T18:43:45.692 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.366570.log 2023-11-13T18:43:45.693 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.511382.log 2023-11-13T18:43:45.694 INFO:teuthology.orchestra.run.smithi102.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.337550.log.gz 2023-11-13T18:43:45.695 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.457642.log: /var/log/ceph/ceph-client.admin.366570.log: 80.3% -- replaced with /var/log/ceph/ceph-client.admin.102397.log.gz 2023-11-13T18:43:45.696 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.333379.log 2023-11-13T18:43:45.697 INFO:teuthology.orchestra.run.smithi102.stderr: 80.6% -- replaced with /var/log/ceph/ceph-client.admin.105295.log.gz 2023-11-13T18:43:45.698 INFO:teuthology.orchestra.run.smithi102.stderr: 85.6% -- replaced with /var/log/ceph/ceph-client.admin.104005.log.gz 2023-11-13T18:43:45.699 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.511382.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.131552.log 2023-11-13T18:43:45.700 INFO:teuthology.orchestra.run.smithi102.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.317934.log.gz 2023-11-13T18:43:45.700 INFO:teuthology.orchestra.run.smithi102.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.511382.log.gz 2023-11-13T18:43:45.701 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98255.log 2023-11-13T18:43:45.702 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.333379.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.348537.log 2023-11-13T18:43:45.704 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.98255.log: /var/log/ceph/ceph-client.admin.131552.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.189765.log 2023-11-13T18:43:45.705 INFO:teuthology.orchestra.run.smithi102.stderr: 86.3% -- replaced with /var/log/ceph/ceph-client.admin.88711.log.gz 2023-11-13T18:43:45.706 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.348537.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45696.log 2023-11-13T18:43:45.709 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.380399.log 2023-11-13T18:43:45.709 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.189765.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.416388.log 2023-11-13T18:43:45.712 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.45696.log: /var/log/ceph/ceph-client.admin.380399.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.226275.log 2023-11-13T18:43:45.713 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44941.log 2023-11-13T18:43:45.717 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.226275.log: /var/log/ceph/ceph-client.admin.416388.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.368246.log 2023-11-13T18:43:45.717 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.253177.log 2023-11-13T18:43:45.720 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.368246.log: /var/log/ceph/ceph-client.admin.44941.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44449.log 2023-11-13T18:43:45.722 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.253177.log: 93.8% -- replaced with /var/log/ceph/ceph-client.admin.311787.log.gz 2023-11-13T18:43:45.723 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.431925.log 2023-11-13T18:43:45.725 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.301948.log 2023-11-13T18:43:45.726 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.44449.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47512.log 2023-11-13T18:43:45.729 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.301948.log: /var/log/ceph/ceph-client.admin.431925.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.431521.log 2023-11-13T18:43:45.730 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.47512.log: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.189765.log.gz 2023-11-13T18:43:45.731 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45722.log 2023-11-13T18:43:45.732 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.431521.log: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.380399.log.gz 2023-11-13T18:43:45.733 INFO:teuthology.orchestra.run.smithi102.stderr: 85.6% -- replaced with /var/log/ceph/ceph-client.admin.457642.log.gz 2023-11-13T18:43:45.733 INFO:teuthology.orchestra.run.smithi102.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.333379.log.gz 2023-11-13T18:43:45.734 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.337541.log 2023-11-13T18:43:45.737 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.45722.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.492980.log 2023-11-13T18:43:45.738 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.337541.log: 85.7% -- replaced with /var/log/ceph/ceph-client.admin.416388.log.gz 2023-11-13T18:43:45.738 INFO:teuthology.orchestra.run.smithi102.stderr: 85.4% -- replaced with /var/log/ceph/ceph-client.admin.348537.log.gz 2023-11-13T18:43:45.740 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.246101.log 2023-11-13T18:43:45.742 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.492980.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.476993.log 2023-11-13T18:43:45.743 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.246101.log: 81.2% -- replaced with /var/log/ceph/ceph-client.admin.492980.log.gz 2023-11-13T18:43:45.744 INFO:teuthology.orchestra.run.smithi102.stderr: 85.8% -- replaced with /var/log/ceph/ceph-client.admin.431521.log.gz 2023-11-13T18:43:45.745 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.165521.log 2023-11-13T18:43:45.746 INFO:teuthology.orchestra.run.smithi102.stderr: 81.0% -- replaced with /var/log/ceph/ceph-client.admin.431925.log.gz 2023-11-13T18:43:45.746 INFO:teuthology.orchestra.run.smithi102.stderr: 92.7% -- replaced with /var/log/ceph/ceph-client.admin.319943.log.gz 2023-11-13T18:43:45.747 INFO:teuthology.orchestra.run.smithi102.stderr: 84.2% -- replaced with /var/log/ceph/ceph-client.admin.301948.log.gz 2023-11-13T18:43:45.747 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.476993.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.308412.log 2023-11-13T18:43:45.750 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.165521.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44915.log 2023-11-13T18:43:45.751 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.303570.log 2023-11-13T18:43:45.752 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.44915.log: 84.2% -- replaced with /var/log/ceph/ceph-client.admin.246101.log.gz 2023-11-13T18:43:45.753 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.308412.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.442305.log 2023-11-13T18:43:45.755 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.303570.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.244035.log 2023-11-13T18:43:45.755 INFO:teuthology.orchestra.run.smithi154.stderr: 94.0% -- replaced with /var/log/ceph/ceph-mds.d.log.gz 2023-11-13T18:43:45.757 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.442305.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92217.log 2023-11-13T18:43:45.757 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.244035.log: 93.5% -- replaced with /var/log/ceph/ceph-client.admin.178144.log.gz 2023-11-13T18:43:45.757 INFO:teuthology.orchestra.run.smithi102.stderr: 81.0% -- replaced with /var/log/ceph/ceph-client.admin.165521.log.gz 2023-11-13T18:43:45.758 INFO:teuthology.orchestra.run.smithi102.stderr: 81.2% -- replaced with /var/log/ceph/ceph-client.admin.98255.log.gz 2023-11-13T18:43:45.759 INFO:teuthology.orchestra.run.smithi102.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.244035.log.gz 2023-11-13T18:43:45.759 INFO:teuthology.orchestra.run.smithi102.stderr: 81.5% -- replaced with /var/log/ceph/ceph-client.admin.337541.log.gz 2023-11-13T18:43:45.760 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.423164.log 2023-11-13T18:43:45.762 INFO:teuthology.orchestra.run.smithi102.stderr: 81.2% -- replaced with /var/log/ceph/ceph-client.admin.308412.log.gz 2023-11-13T18:43:45.763 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.92217.log: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.303570.log.gz 2023-11-13T18:43:45.765 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2023-11-13T18:43:45.767 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.391988.log 2023-11-13T18:43:45.768 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.423164.log: /var/log/ceph/ceph-osd.2.log: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.131552.log.gz 2023-11-13T18:43:45.769 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.374198.log 2023-11-13T18:43:45.769 INFO:teuthology.orchestra.run.smithi154.stderr: 94.6% -- replaced with /var/log/ceph/ceph-mds.b.log.gz 2023-11-13T18:43:45.770 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.391988.log: 85.3% -- replaced with /var/log/ceph/ceph-client.admin.442305.log.gz 2023-11-13T18:43:45.771 INFO:teuthology.orchestra.run.smithi102.stderr: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.381414.log.gz 2023-11-13T18:43:45.771 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.186136.log 2023-11-13T18:43:45.773 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.374198.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.45696.log.gz 2023-11-13T18:43:45.773 INFO:teuthology.orchestra.run.smithi102.stderr: 85.0% -- replaced with /var/log/ceph/ceph-client.admin.476993.log.gz 2023-11-13T18:43:45.774 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.230989.log 2023-11-13T18:43:45.775 INFO:teuthology.orchestra.run.smithi102.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.45722.log.gz 2023-11-13T18:43:45.775 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.186136.log: 85.5% -- replaced with /var/log/ceph/ceph-client.admin.374198.log.gz 2023-11-13T18:43:45.775 INFO:teuthology.orchestra.run.smithi102.stderr: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.423164.log.gz 2023-11-13T18:43:45.777 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.167661.log 2023-11-13T18:43:45.779 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45097.log 2023-11-13T18:43:45.782 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.230989.log: /var/log/ceph/ceph-client.admin.167661.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.301957.log 2023-11-13T18:43:45.785 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.329805.log 2023-11-13T18:43:45.786 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.45097.log: /var/log/ceph/ceph-client.admin.301957.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46829.log 2023-11-13T18:43:45.788 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.329805.log: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.186136.log.gz 2023-11-13T18:43:45.789 INFO:teuthology.orchestra.run.smithi102.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.158852.log.gz 2023-11-13T18:43:45.790 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103604.log 2023-11-13T18:43:45.790 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.456428.log 2023-11-13T18:43:45.793 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.46829.log: /var/log/ceph/ceph-client.admin.103604.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.237059.log 2023-11-13T18:43:45.794 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.163007.log 2023-11-13T18:43:45.797 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.456428.log: /var/log/ceph/ceph-client.admin.237059.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.178566.log 2023-11-13T18:43:45.799 INFO:teuthology.orchestra.run.smithi102.stderr: 83.3% -- replaced with /var/log/ceph/ceph-client.admin.103604.log.gz 2023-11-13T18:43:45.801 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.163007.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.317522.log 2023-11-13T18:43:45.802 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.178566.log: 90.4% -- replaced with /var/log/ceph/ceph-client.admin.301957.log.gz 2023-11-13T18:43:45.803 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.306802.log 2023-11-13T18:43:45.804 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.317522.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.45097.log.gz 2023-11-13T18:43:45.805 INFO:teuthology.orchestra.run.smithi102.stderr: 81.0% -- replaced with /var/log/ceph/ceph-client.admin.237059.log.gz 2023-11-13T18:43:45.806 INFO:teuthology.orchestra.run.smithi102.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.253177.log.gz 2023-11-13T18:43:45.807 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142369.log 2023-11-13T18:43:45.809 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.306802.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.503096.log 2023-11-13T18:43:45.809 INFO:teuthology.orchestra.run.smithi102.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.44915.log.gz 2023-11-13T18:43:45.810 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.142369.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.44941.log.gz 2023-11-13T18:43:45.811 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.493388.log 2023-11-13T18:43:45.811 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.503096.log: 81.4% -- replaced with /var/log/ceph/ceph-client.admin.503096.log.gz 2023-11-13T18:43:45.812 INFO:teuthology.orchestra.run.smithi102.stderr: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.420255.log.gz 2023-11-13T18:43:45.813 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.319130.log 2023-11-13T18:43:45.813 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.493388.log: 80.9% -- replaced with /var/log/ceph/ceph-client.admin.493388.log.gz 2023-11-13T18:43:45.815 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.448613.log 2023-11-13T18:43:45.816 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.319130.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.336730.log 2023-11-13T18:43:45.818 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.448613.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.186529.log 2023-11-13T18:43:45.820 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.336730.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.388356.log 2023-11-13T18:43:45.820 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.186529.log: 81.1% -- replaced with /var/log/ceph/ceph-client.admin.366570.log.gz 2023-11-13T18:43:45.821 INFO:teuthology.orchestra.run.smithi102.stderr: 84.1% -- replaced with /var/log/ceph/ceph-client.admin.178566.log.gz 2023-11-13T18:43:45.821 INFO:teuthology.orchestra.run.smithi102.stderr: 84.4% -- replaced with /var/log/ceph/ceph-client.admin.163007.log.gz 2023-11-13T18:43:45.823 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.176424.log 2023-11-13T18:43:45.824 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.388356.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.191400.log 2023-11-13T18:43:45.826 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.176424.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.240399.log 2023-11-13T18:43:45.828 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.191400.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.442719.log 2023-11-13T18:43:45.830 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.240399.log: 79.0% -- replaced with /var/log/ceph/ceph-client.admin.191400.log.gz 2023-11-13T18:43:45.830 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.322431.log 2023-11-13T18:43:45.830 INFO:teuthology.orchestra.run.smithi102.stderr: 81.4% -- replaced with /var/log/ceph/ceph-client.admin.391988.log.gz 2023-11-13T18:43:45.832 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.442719.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.339166.log 2023-11-13T18:43:45.833 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.322431.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139342.log 2023-11-13T18:43:45.834 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.339166.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.235847.log 2023-11-13T18:43:45.837 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.139342.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45930.log 2023-11-13T18:43:45.838 INFO:teuthology.orchestra.run.smithi102.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.44449.log.gz 2023-11-13T18:43:45.838 INFO:teuthology.orchestra.run.smithi102.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.230989.log.gz 2023-11-13T18:43:45.842 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.235847.log: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.448613.log.gz 2023-11-13T18:43:45.843 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.188138.log 2023-11-13T18:43:45.843 INFO:teuthology.orchestra.run.smithi102.stderr: 90.2%gzip -- replaced with /var/log/ceph/ceph-client.admin.339166.log.gz 2023-11-13T18:43:45.843 INFO:teuthology.orchestra.run.smithi102.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.209121.log 2023-11-13T18:43:45.844 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.45930.log: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.336730.log.gz 2023-11-13T18:43:45.844 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.188138.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.341293.log 2023-11-13T18:43:45.846 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.209121.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.338363.log 2023-11-13T18:43:45.847 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.341293.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.343444.log 2023-11-13T18:43:45.848 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.338363.log: 81.3% -- replaced with /var/log/ceph/ceph-client.admin.322431.log.gz 2023-11-13T18:43:45.849 INFO:teuthology.orchestra.run.smithi102.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.388356.log.gz 2023-11-13T18:43:45.849 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.441837.log 2023-11-13T18:43:45.851 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.343444.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.330696.log 2023-11-13T18:43:45.852 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.441837.log: 78.6% -- replaced with /var/log/ceph/ceph-client.admin.142369.log.gz 2023-11-13T18:43:45.853 INFO:teuthology.orchestra.run.smithi102.stderr: 85.3% -- replaced with /var/log/ceph/ceph-client.admin.441837.log.gz 2023-11-13T18:43:45.854 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44241.log 2023-11-13T18:43:45.856 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.381111.log 2023-11-13T18:43:45.857 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.330696.log: /var/log/ceph/ceph-client.admin.44241.log: 81.3% -- replaced with /var/log/ceph/ceph-client.admin.306802.log.gz 2023-11-13T18:43:45.858 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.306404.log 2023-11-13T18:43:45.859 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.381111.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141574.log 2023-11-13T18:43:45.861 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.306404.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38322.log 2023-11-13T18:43:45.863 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.141574.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.177705.log 2023-11-13T18:43:45.865 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.38322.log: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.209121.log.gz 2023-11-13T18:43:45.866 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.389160.log 2023-11-13T18:43:45.868 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.177705.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.395275.log 2023-11-13T18:43:45.870 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.389160.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.338765.log 2023-11-13T18:43:45.872 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.203489.log 2023-11-13T18:43:45.874 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.395275.log: /var/log/ceph/ceph-client.admin.338765.log: 81.5% -- replaced with /var/log/ceph/ceph-client.admin.317522.log.gz 2023-11-13T18:43:45.874 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.438252.log 2023-11-13T18:43:45.876 INFO:teuthology.orchestra.run.smithi102.stderr: 81.2% -- replaced with /var/log/ceph/ceph-client.admin.319130.log.gz 2023-11-13T18:43:45.877 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.203489.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.130678.log 2023-11-13T18:43:45.878 INFO:teuthology.orchestra.run.smithi102.stderr: 93.1% -- replaced with /var/log/ceph/ceph-client.admin.167661.log.gz 2023-11-13T18:43:45.878 INFO:teuthology.orchestra.run.smithi102.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.442719.log.gz 2023-11-13T18:43:45.880 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.445180.log 2023-11-13T18:43:45.881 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.438252.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.460690.log 2023-11-13T18:43:45.884 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.445180.log: /var/log/ceph/ceph-client.admin.130678.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.242409.log 2023-11-13T18:43:45.885 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.313070.log 2023-11-13T18:43:45.888 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.242409.log: /var/log/ceph/ceph-client.admin.460690.log: 85.3% -- replaced with /var/log/ceph/ceph-client.admin.203489.log.gz 2023-11-13T18:43:45.888 INFO:teuthology.orchestra.run.smithi102.stderr: 80.9% -- replaced with /var/log/ceph/ceph-client.admin.177705.log.gz 2023-11-13T18:43:45.889 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.454770.log 2023-11-13T18:43:45.890 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.304787.log 2023-11-13T18:43:45.890 INFO:teuthology.orchestra.run.smithi102.stderr: 81.5% -- replaced with /var/log/ceph/ceph-client.admin.240399.log.gz 2023-11-13T18:43:45.891 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.454770.log: 81.4% -- replaced with /var/log/ceph/ceph-client.admin.242409.log.gz 2023-11-13T18:43:45.891 INFO:teuthology.orchestra.run.smithi102.stderr: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.139342.log.gz 2023-11-13T18:43:45.893 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.313070.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.135691.log 2023-11-13T18:43:45.894 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.255811.log 2023-11-13T18:43:45.896 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.304787.log: /var/log/ceph/ceph-client.admin.135691.log: 78.5% -- replaced with /var/log/ceph/ceph-client.admin.313070.log.gz 2023-11-13T18:43:45.897 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.131951.log 2023-11-13T18:43:45.898 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.255811.log: 96.6% -- replaced with /var/log/ceph/ceph-client.admin.491254.log.gz 2023-11-13T18:43:45.899 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.393643.log 2023-11-13T18:43:45.900 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.131951.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.47512.log.gz 2023-11-13T18:43:45.901 INFO:teuthology.orchestra.run.smithi102.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.235847.log.gz 2023-11-13T18:43:45.902 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.480623.log 2023-11-13T18:43:45.906 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.393643.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.182008.log 2023-11-13T18:43:45.906 INFO:teuthology.orchestra.run.smithi102.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.45930.log.gz 2023-11-13T18:43:45.907 INFO:teuthology.orchestra.run.smithi102.stderr: 81.3% -- replaced with /var/log/ceph/ceph-client.admin.135691.log.gz 2023-11-13T18:43:45.908 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.480623.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.246916.log 2023-11-13T18:43:45.908 INFO:teuthology.orchestra.run.smithi102.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.44241.log.gz 2023-11-13T18:43:45.909 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.182008.log: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.445180.log.gz 81.2% 2023-11-13T18:43:45.909 INFO:teuthology.orchestra.run.smithi102.stderr: -- replaced with /var/log/ceph/ceph-client.admin.438252.log.gz 2023-11-13T18:43:45.909 INFO:teuthology.orchestra.run.smithi102.stderr: 85.4% -- replaced with /var/log/ceph/ceph-client.admin.330696.log.gz 2023-11-13T18:43:45.912 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.203952.log 2023-11-13T18:43:45.913 INFO:teuthology.orchestra.run.smithi102.stderr: 79.0% -- replaced with /var/log/ceph/ceph-client.admin.341293.log.gz 2023-11-13T18:43:45.914 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.246916.log: 81.0% -- replaced with /var/log/ceph/ceph-client.admin.343444.log.gz 2023-11-13T18:43:45.915 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.511427.log 2023-11-13T18:43:45.916 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.203952.log: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.395275.log.gz 2023-11-13T18:43:45.918 INFO:teuthology.orchestra.run.smithi102.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.255811.log.gz 2023-11-13T18:43:45.919 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.511707.log 2023-11-13T18:43:45.920 INFO:teuthology.orchestra.run.smithi102.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.389160.log.gz 2023-11-13T18:43:45.920 INFO:teuthology.orchestra.run.smithi102.stderr: 77.5%/var/log/ceph/ceph-client.admin.511427.log: -- replaced with /var/log/ceph/ceph-client.admin.393643.log.gz 2023-11-13T18:43:45.921 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.496788.log 2023-11-13T18:43:45.921 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.511707.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.511707.log.gz 2023-11-13T18:43:45.922 INFO:teuthology.orchestra.run.smithi102.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.511427.log.gz 2023-11-13T18:43:45.922 INFO:teuthology.orchestra.run.smithi102.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.304787.log.gz 2023-11-13T18:43:45.923 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45071.log 2023-11-13T18:43:45.925 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.496788.log: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.246916.log.gz 2023-11-13T18:43:45.926 INFO:teuthology.orchestra.run.smithi102.stderr: 81.6% -- replaced with /var/log/ceph/ceph-client.admin.496788.log.gz 2023-11-13T18:43:45.928 INFO:teuthology.orchestra.run.smithi102.stderr:gzip 81.4% -5 -- replaced with /var/log/ceph/ceph-client.admin.186529.log.gz 2023-11-13T18:43:45.928 INFO:teuthology.orchestra.run.smithi102.stderr: --verbose -- /var/log/ceph/ceph-client.admin.242016.log 2023-11-13T18:43:45.929 INFO:teuthology.orchestra.run.smithi102.stderr: 82.0% -- replaced with /var/log/ceph/ceph-client.admin.188138.log.gz 2023-11-13T18:43:45.931 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.45071.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.201448.log 2023-11-13T18:43:45.932 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.242016.log: 82.0% -- replaced with /var/log/ceph/ceph-client.admin.131951.log.gz 2023-11-13T18:43:45.935 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.482639.log 2023-11-13T18:43:45.936 INFO:teuthology.orchestra.run.smithi102.stderr: 93.6% -- replaced with /var/log/ceph/ceph-client.admin.176424.log.gz 2023-11-13T18:43:45.937 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.201448.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.336721.log 2023-11-13T18:43:45.937 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.482639.log: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.141574.log.gz 2023-11-13T18:43:45.939 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.257836.log 2023-11-13T18:43:45.942 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.336721.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.159254.log 2023-11-13T18:43:45.945 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.257836.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46301.log 2023-11-13T18:43:45.948 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.159254.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.387516.log 2023-11-13T18:43:45.950 INFO:teuthology.orchestra.run.smithi102.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.38322.log.gz 2023-11-13T18:43:45.951 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.46301.log: 78.5% -- replaced with /var/log/ceph/ceph-client.admin.182008.log.gz 2023-11-13T18:43:45.952 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.421512.log 2023-11-13T18:43:45.952 INFO:teuthology.orchestra.run.smithi102.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.159254.log.gz 2023-11-13T18:43:45.953 INFO:teuthology.orchestra.run.smithi102.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.242016.log.gz 2023-11-13T18:43:45.955 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.387516.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.316720.log 2023-11-13T18:43:45.957 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.421512.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.378301.log 2023-11-13T18:43:45.960 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.316720.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.201841.log 2023-11-13T18:43:45.964 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.378301.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.455215.log 2023-11-13T18:43:45.966 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.505651.log 2023-11-13T18:43:45.968 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.201841.log: /var/log/ceph/ceph-client.admin.455215.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.303159.log 2023-11-13T18:43:45.969 INFO:teuthology.orchestra.run.smithi102.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.46301.log.gz 2023-11-13T18:43:45.969 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.505651.log: 81.9% -- replaced with /var/log/ceph/ceph-client.admin.505651.log.gz 2023-11-13T18:43:45.970 INFO:teuthology.orchestra.run.smithi102.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.46829.log.gz 2023-11-13T18:43:45.972 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.197188.log 2023-11-13T18:43:45.975 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.303159.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119307.log 2023-11-13T18:43:45.977 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.197188.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.439536.log 2023-11-13T18:43:45.978 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.119307.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.45071.log.gz 2023-11-13T18:43:45.979 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2023-11-13T18:43:45.982 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.439536.log: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.306404.log.gz 2023-11-13T18:43:45.982 INFO:teuthology.orchestra.run.smithi102.stderr: 83.7% -- replaced with /var/log/ceph/ceph-client.admin.336721.log.gz 2023-11-13T18:43:45.983 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- 80.8% /var/log/ceph/ceph-client.admin.142378.log -- replaced with /var/log/ceph/ceph-client.admin.421512.log.gz 2023-11-13T18:43:45.983 INFO:teuthology.orchestra.run.smithi102.stderr: 2023-11-13T18:43:45.983 INFO:teuthology.orchestra.run.smithi102.stderr: 81.4% -- replaced with /var/log/ceph/ceph-client.admin.303159.log.gz 2023-11-13T18:43:45.984 INFO:teuthology.orchestra.run.smithi102.stderr: 81.2% -- replaced with /var/log/ceph/ceph-client.admin.197188.log.gz 2023-11-13T18:43:45.986 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-mon.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48146.log 2023-11-13T18:43:45.988 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.142378.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112158.log 2023-11-13T18:43:45.989 INFO:teuthology.orchestra.run.smithi102.stderr: 78.6% -- replaced with /var/log/ceph/ceph-client.admin.201841.log.gz 2023-11-13T18:43:45.989 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.48146.log: 78.4% -- replaced with /var/log/ceph/ceph-client.admin.482639.log.gz 2023-11-13T18:43:45.990 INFO:teuthology.orchestra.run.smithi102.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.201448.log.gz 2023-11-13T18:43:45.991 INFO:teuthology.orchestra.run.smithi102.stderr: 96.6% -- replaced with /var/log/ceph/ceph-client.admin.490813.log.gz 2023-11-13T18:43:45.992 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.306395.log 2023-11-13T18:43:45.994 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.112158.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.372166.log 2023-11-13T18:43:45.995 INFO:teuthology.orchestra.run.smithi102.stderr: 78.0% -- replaced with /var/log/ceph/ceph-client.admin.480623.log.gz 2023-11-13T18:43:45.998 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.306395.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.455616.log 2023-11-13T18:43:45.999 INFO:teuthology.orchestra.run.smithi102.stderr: 93.0% -- replaced with /var/log/ceph/ceph-client.admin.329805.log.gz 2023-11-13T18:43:46.000 INFO:teuthology.orchestra.run.smithi102.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.338363.log.gz 2023-11-13T18:43:46.001 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.372166.log: 81.1% -- replaced with /var/log/ceph/ceph-client.admin.316720.log.gz 2023-11-13T18:43:46.001 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.86103.log 2023-11-13T18:43:46.002 INFO:teuthology.orchestra.run.smithi102.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.338765.log.gz 2023-11-13T18:43:46.002 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.436478.log 2023-11-13T18:43:46.005 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.455616.log: /var/log/ceph/ceph-client.admin.86103.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115953.log 2023-11-13T18:43:46.007 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.436478.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.335038.log 2023-11-13T18:43:46.010 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.115953.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.461115.log 2023-11-13T18:43:46.012 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.364464.log 2023-11-13T18:43:46.014 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.335038.log: /var/log/ceph/ceph-client.admin.461115.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.254024.log 2023-11-13T18:43:46.015 INFO:teuthology.orchestra.run.smithi102.stderr: 93.5% -- replaced with /var/log/ceph/ceph-client.admin.347161.log.gz 2023-11-13T18:43:46.017 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.364464.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106111.log 2023-11-13T18:43:46.019 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.322843.log 2023-11-13T18:43:46.021 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.254024.log: /var/log/ceph/ceph-client.admin.106111.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.255408.log 2023-11-13T18:43:46.024 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.322843.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.234223.log 2023-11-13T18:43:46.025 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.218864.log 2023-11-13T18:43:46.028 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.234223.log: /var/log/ceph/ceph-client.admin.255408.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117609.log 2023-11-13T18:43:46.031 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.218864.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.214026.log 2023-11-13T18:43:46.034 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.117609.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.506499.log 2023-11-13T18:43:46.034 INFO:teuthology.orchestra.run.smithi102.stderr: 79.6% -- replaced with /var/log/ceph/ceph-client.admin.455215.log.gz 2023-11-13T18:43:46.035 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.214026.log: 85.6% -- replaced with /var/log/ceph/ceph-client.admin.455616.log.gz 2023-11-13T18:43:46.037 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46249.log 2023-11-13T18:43:46.037 INFO:teuthology.orchestra.run.smithi102.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.48146.log.gz 2023-11-13T18:43:46.039 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.506499.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.392811.log 2023-11-13T18:43:46.040 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.490366.log 2023-11-13T18:43:46.042 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.46249.log: /var/log/ceph/ceph-client.admin.392811.log: 80.8% -- replaced with /var/log/ceph/ceph-client.admin.112158.log.gz 2023-11-13T18:43:46.043 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.403143.log 2023-11-13T18:43:46.045 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.228101.log 2023-11-13T18:43:46.047 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.490366.log: /var/log/ceph/ceph-client.admin.403143.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.427783.log 2023-11-13T18:43:46.048 INFO:teuthology.orchestra.run.smithi102.stderr: 92.2% -- replaced with /var/log/ceph/ceph-client.admin.506499.log.gz 2023-11-13T18:43:46.050 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.225853.log 2023-11-13T18:43:46.051 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.228101.log: /var/log/ceph/ceph-client.admin.427783.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.313481.log 2023-11-13T18:43:46.053 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.225853.log: 85.1% -- replaced with /var/log/ceph/ceph-client.admin.130678.log.gz 2023-11-13T18:43:46.054 INFO:teuthology.orchestra.run.smithi102.stderr: 81.6% -- replaced with /var/log/ceph/ceph-client.admin.461115.log.gz 2023-11-13T18:43:46.054 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.318326.log 2023-11-13T18:43:46.055 INFO:teuthology.orchestra.run.smithi102.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.364464.log.gz 2023-11-13T18:43:46.057 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.313481.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.406251.log 2023-11-13T18:43:46.058 INFO:teuthology.orchestra.run.smithi102.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.335038.log.gz 2023-11-13T18:43:46.059 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.318326.log: 81.4% -- replaced with /var/log/ceph/ceph-client.admin.436478.log.gz 2023-11-13T18:43:46.060 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.337140.log 2023-11-13T18:43:46.060 INFO:teuthology.orchestra.run.smithi102.stderr: 85.9% -- replaced with /var/log/ceph/ceph-client.admin.403143.log.gz 2023-11-13T18:43:46.061 INFO:teuthology.orchestra.run.smithi102.stderr: 81.4% -- replaced with /var/log/ceph/ceph-client.admin.318326.log.gz 2023-11-13T18:43:46.062 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.406251.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.393211.log 2023-11-13T18:43:46.064 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.337140.log: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.106111.log.gz 2023-11-13T18:43:46.064 INFO:teuthology.orchestra.run.smithi102.stderr: 79.4% -- replaced with /var/log/ceph/ceph-client.admin.306395.log.gz 2023-11-13T18:43:46.065 INFO:teuthology.orchestra.run.smithi102.stderr: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.392811.log.gz 2023-11-13T18:43:46.065 INFO:teuthology.orchestra.run.smithi102.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.322843.log.gz 2023-11-13T18:43:46.066 INFO:teuthology.orchestra.run.smithi102.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.255408.log.gz 2023-11-13T18:43:46.066 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.447287.log 2023-11-13T18:43:46.067 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.393211.log: 85.2% -- replaced with /var/log/ceph/ceph-client.admin.427783.log.gz 2023-11-13T18:43:46.068 INFO:teuthology.orchestra.run.smithi102.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.372166.log.gz 2023-11-13T18:43:46.068 INFO:teuthology.orchestra.run.smithi102.stderr: 81.6% -- replaced with /var/log/ceph/ceph-client.admin.218864.log.gz 2023-11-13T18:43:46.068 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.211955.log 2023-11-13T18:43:46.070 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.447287.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.308011.log 2023-11-13T18:43:46.072 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.211955.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.228905.log 2023-11-13T18:43:46.072 INFO:teuthology.orchestra.run.smithi102.stderr: 81.5% -- replaced with /var/log/ceph/ceph-client.admin.214026.log.gz 2023-11-13T18:43:46.073 INFO:teuthology.orchestra.run.smithi102.stderr: 81.1% -- replaced with /var/log/ceph/ceph-client.admin.117609.log.gz 2023-11-13T18:43:46.075 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.308011.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.143756.log 2023-11-13T18:43:46.075 INFO:teuthology.orchestra.run.smithi102.stderr: 92.8% -- replaced with /var/log/ceph/ceph-client.admin.460690.log.gz 2023-11-13T18:43:46.076 INFO:teuthology.orchestra.run.smithi102.stderr: 94.3% -- replaced with /var/log/ceph/ceph-client.admin.192700.log.gz 2023-11-13T18:43:46.076 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.257827.log 2023-11-13T18:43:46.078 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.228905.log: /var/log/ceph/ceph-client.admin.143756.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.312275.log 2023-11-13T18:43:46.080 INFO:teuthology.orchestra.run.smithi102.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.234223.log.gz 2023-11-13T18:43:46.080 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.257827.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.430248.log 2023-11-13T18:43:46.082 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.312275.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.511356.log 2023-11-13T18:43:46.084 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.430248.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.202247.log 2023-11-13T18:43:46.086 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.511356.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.451505.log 2023-11-13T18:43:46.088 INFO:teuthology.orchestra.run.smithi102.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.511356.log.gz 2023-11-13T18:43:46.090 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.202247.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.388347.log 2023-11-13T18:43:46.092 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.451505.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.481429.log 2023-11-13T18:43:46.093 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.460279.log 2023-11-13T18:43:46.096 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.388347.log: /var/log/ceph/ceph-client.admin.481429.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.349963.log 2023-11-13T18:43:46.097 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.323640.log 2023-11-13T18:43:46.099 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.460279.log: /var/log/ceph/ceph-client.admin.349963.log: 84.3% -- replaced with /var/log/ceph/ceph-client.admin.202247.log.gz 2023-11-13T18:43:46.099 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.379982.log 2023-11-13T18:43:46.101 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.323640.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.241614.log 2023-11-13T18:43:46.103 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.379982.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118032.log 2023-11-13T18:43:46.105 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.241614.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47304.log 2023-11-13T18:43:46.108 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.118032.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44655.log 2023-11-13T18:43:46.108 INFO:teuthology.orchestra.run.smithi102.stderr: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.211955.log.gz 2023-11-13T18:43:46.109 INFO:teuthology.orchestra.run.smithi102.stderr: 84.3% -- replaced with /var/log/ceph/ceph-client.admin.257827.log.gz 2023-11-13T18:43:46.110 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.47304.log: 84.4% -- replaced with /var/log/ceph/ceph-client.admin.228101.log.gz 2023-11-13T18:43:46.111 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.418449.log 2023-11-13T18:43:46.112 INFO:teuthology.orchestra.run.smithi102.stderr: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.313481.log.gz 2023-11-13T18:43:46.113 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.365339.log 2023-11-13T18:43:46.116 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.44655.log: /var/log/ceph/ceph-client.admin.418449.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.407066.log 2023-11-13T18:43:46.118 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.329796.log 2023-11-13T18:43:46.119 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.365339.log: /var/log/ceph/ceph-client.admin.407066.log: 85.3% -- replaced with /var/log/ceph/ceph-client.admin.143756.log.gz 2023-11-13T18:43:46.119 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109334.log 2023-11-13T18:43:46.122 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.329796.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.377440.log 2023-11-13T18:43:46.122 INFO:teuthology.orchestra.run.smithi102.stderr: 84.1% -- replaced with /var/log/ceph/ceph-client.admin.379982.log.gz 2023-11-13T18:43:46.125 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.109334.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.426918.log 2023-11-13T18:43:46.126 INFO:teuthology.orchestra.run.smithi102.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.312275.log.gz 2023-11-13T18:43:46.129 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.377440.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.174301.log 2023-11-13T18:43:46.131 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.426918.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.337952.log 2023-11-13T18:43:46.131 INFO:teuthology.orchestra.run.smithi102.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.47304.log.gz 2023-11-13T18:43:46.134 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.174301.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.172102.log 2023-11-13T18:43:46.136 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.193960.log 2023-11-13T18:43:46.136 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.337952.log: /var/log/ceph/ceph-client.admin.172102.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.44655.log.gz 2023-11-13T18:43:46.138 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.392395.log 2023-11-13T18:43:46.139 INFO:teuthology.orchestra.run.smithi102.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.46249.log.gz 2023-11-13T18:43:46.140 INFO:teuthology.orchestra.run.smithi102.stderr: 83.4% -- replaced with /var/log/ceph/ceph-client.admin.109334.log.gz 2023-11-13T18:43:46.141 INFO:teuthology.orchestra.run.smithi102.stderr:gzip/var/log/ceph/ceph-client.admin.193960.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.47976.log 2023-11-13T18:43:46.142 INFO:teuthology.orchestra.run.smithi102.stderr: 80.8% -- replaced with /var/log/ceph/ceph-client.admin.406251.log.gz 2023-11-13T18:43:46.142 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.392395.log: 84.8% -- replaced with /var/log/ceph/ceph-client.admin.407066.log.gz 2023-11-13T18:43:46.143 INFO:teuthology.orchestra.run.smithi102.stderr: 81.4% -- replaced with /var/log/ceph/ceph-client.admin.447287.log.gz 2023-11-13T18:43:46.143 INFO:teuthology.orchestra.run.smithi102.stderr: 82.0% -- replaced with /var/log/ceph/ceph-client.admin.460279.log.gz 2023-11-13T18:43:46.145 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45610.log 2023-11-13T18:43:46.147 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.47976.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.401539.log 2023-11-13T18:43:46.150 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.45610.log: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.337140.log.gz 2023-11-13T18:43:46.151 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43953.log 2023-11-13T18:43:46.152 INFO:teuthology.orchestra.run.smithi102.stderr: 90.2%gzip -- replaced with /var/log/ceph/ceph-client.admin.365339.log.gz -5 --verbose 2023-11-13T18:43:46.153 INFO:teuthology.orchestra.run.smithi102.stderr: -- /var/log/ceph/ceph-client.admin.503959.log 2023-11-13T18:43:46.154 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.401539.log: /var/log/ceph/ceph-client.admin.43953.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.452310.log 2023-11-13T18:43:46.157 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.503959.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112977.log 2023-11-13T18:43:46.157 INFO:teuthology.orchestra.run.smithi102.stderr: 92.2% -- replaced with /var/log/ceph/ceph-client.admin.503959.log.gz 2023-11-13T18:43:46.158 INFO:teuthology.orchestra.run.smithi102.stderr: 81.3% -- replaced with /var/log/ceph/ceph-client.admin.323640.log.gz 2023-11-13T18:43:46.160 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.452310.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.406668.log 2023-11-13T18:43:46.162 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120135.log 2023-11-13T18:43:46.165 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.112977.log: /var/log/ceph/ceph-client.admin.406668.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.506490.log 2023-11-13T18:43:46.167 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.120135.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.332575.log 2023-11-13T18:43:46.168 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.506490.log: 86.2% -- replaced with /var/log/ceph/ceph-client.admin.506490.log.gz 2023-11-13T18:43:46.171 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99914.log 2023-11-13T18:43:46.172 INFO:teuthology.orchestra.run.smithi102.stderr: 81.4% -- replaced with /var/log/ceph/ceph-client.admin.349963.log.gz 2023-11-13T18:43:46.172 INFO:teuthology.orchestra.run.smithi102.stderr: 85.4% -- replaced with /var/log/ceph/ceph-client.admin.308011.log.gz 2023-11-13T18:43:46.173 INFO:teuthology.orchestra.run.smithi102.stderr: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.388347.log.gz 2023-11-13T18:43:46.173 INFO:teuthology.orchestra.run.smithi102.stderr: 82.0% -- replaced with /var/log/ceph/ceph-client.admin.392395.log.gz 2023-11-13T18:43:46.174 INFO:teuthology.orchestra.run.smithi102.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.92670.log.gz 2023-11-13T18:43:46.174 INFO:teuthology.orchestra.run.smithi102.stderr: 81.6% -- replaced with /var/log/ceph/ceph-client.admin.393211.log.gz 2023-11-13T18:43:46.174 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.332575.log: 85.7% -- replaced with /var/log/ceph/ceph-client.admin.426918.log.gz 2023-11-13T18:43:46.175 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.453929.log 2023-11-13T18:43:46.176 INFO:teuthology.orchestra.run.smithi102.stderr:gzip/var/log/ceph/ceph-client.admin.99914.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.44445.log 2023-11-13T18:43:46.179 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.453929.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.245666.log 2023-11-13T18:43:46.181 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.434689.log 2023-11-13T18:43:46.183 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.44445.log: /var/log/ceph/ceph-client.admin.245666.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141967.log 2023-11-13T18:43:46.185 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.434689.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45800.log 2023-11-13T18:43:46.187 INFO:teuthology.orchestra.run.smithi102.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.118032.log.gz 2023-11-13T18:43:46.188 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.141967.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104411.log 2023-11-13T18:43:46.189 INFO:teuthology.orchestra.run.smithi102.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.120135.log.gz 2023-11-13T18:43:46.191 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115549.log 2023-11-13T18:43:46.192 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.45800.log: /var/log/ceph/ceph-client.admin.104411.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116390.log 2023-11-13T18:43:46.194 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.115549.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.348098.log 2023-11-13T18:43:46.196 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.116390.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.320348.log 2023-11-13T18:43:46.198 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.491245.log 2023-11-13T18:43:46.200 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.348098.log: /var/log/ceph/ceph-client.admin.320348.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.511889.log 2023-11-13T18:43:46.200 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.491245.log: 79.3% -- replaced with /var/log/ceph/ceph-client.admin.491245.log.gz 2023-11-13T18:43:46.203 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44161.log 2023-11-13T18:43:46.204 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110954.log 2023-11-13T18:43:46.206 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.511889.log: /var/log/ceph/ceph-client.admin.44161.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.511889.log.gz 2023-11-13T18:43:46.207 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.386290.log 2023-11-13T18:43:46.210 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.110954.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93528.log 2023-11-13T18:43:46.213 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.386290.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.232192.log 2023-11-13T18:43:46.216 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.93528.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.167652.log 2023-11-13T18:43:46.217 INFO:teuthology.orchestra.run.smithi102.stderr: 80.6% -- replaced with /var/log/ceph/ceph-client.admin.418449.log.gz 2023-11-13T18:43:46.218 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.232192.log: 81.4% -- replaced with /var/log/ceph/ceph-client.admin.329796.log.gz 2023-11-13T18:43:46.219 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.458265.log 2023-11-13T18:43:46.221 INFO:teuthology.orchestra.run.smithi102.stderr: 83.2% -- replaced with /var/log/ceph/ceph-client.admin.86103.log.gz 2023-11-13T18:43:46.223 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.167652.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.204825.log 2023-11-13T18:43:46.225 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.458265.log: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.241614.log.gz 2023-11-13T18:43:46.225 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.234621.log 2023-11-13T18:43:46.226 INFO:teuthology.orchestra.run.smithi102.stderr: 81.6% -- replaced with /var/log/ceph/ceph-client.admin.193960.log.gz 2023-11-13T18:43:46.226 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.204825.log: 81.3% -- replaced with /var/log/ceph/ceph-client.admin.172102.log.gz 2023-11-13T18:43:46.229 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.415986.log 2023-11-13T18:43:46.229 INFO:teuthology.orchestra.run.smithi102.stderr: 81.6% -- replaced with /var/log/ceph/ceph-client.admin.228905.log.gz 2023-11-13T18:43:46.229 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.234621.log: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.401539.log.gz 2023-11-13T18:43:46.231 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.33233.log 2023-11-13T18:43:46.231 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.415986.log: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.451505.log.gz 2023-11-13T18:43:46.232 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.459884.log 2023-11-13T18:43:46.232 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph.tmp-client.admin.33233.log: 0.0% -- replaced with /var/log/ceph/ceph.tmp-client.admin.33233.log.gz 2023-11-13T18:43:46.235 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.168530.log 2023-11-13T18:43:46.236 INFO:teuthology.orchestra.run.smithi102.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.430248.log.gz 2023-11-13T18:43:46.239 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.459884.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118430.log 2023-11-13T18:43:46.241 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.168530.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46855.log 2023-11-13T18:43:46.244 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.118430.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.132368.log 2023-11-13T18:43:46.246 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.171268.log 2023-11-13T18:43:46.248 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.46855.log: /var/log/ceph/ceph-client.admin.132368.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.321167.log 2023-11-13T18:43:46.250 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.445980.log 2023-11-13T18:43:46.252 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.171268.log: /var/log/ceph/ceph-client.admin.321167.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.207911.log 2023-11-13T18:43:46.255 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.169527.log 2023-11-13T18:43:46.256 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.445980.log: /var/log/ceph/ceph-client.admin.207911.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109343.log 2023-11-13T18:43:46.257 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.169527.log: 81.0% -- replaced with /var/log/ceph/ceph-client.admin.481429.log.gz 2023-11-13T18:43:46.259 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.483452.log 2023-11-13T18:43:46.263 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.109343.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.166390.log 2023-11-13T18:43:46.265 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.483452.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.232599.log 2023-11-13T18:43:46.269 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.166390.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.473807.log 2023-11-13T18:43:46.271 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.346683.log 2023-11-13T18:43:46.273 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.473807.log: /var/log/ceph/ceph-client.admin.232599.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.419394.log 2023-11-13T18:43:46.274 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.346683.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.43953.log.gz 2023-11-13T18:43:46.275 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.320764.log 2023-11-13T18:43:46.276 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.419394.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.159245.log 2023-11-13T18:43:46.279 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.320764.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.511837.log 2023-11-13T18:43:46.282 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.159245.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.45610.log.gz 2023-11-13T18:43:46.282 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.309658.log 2023-11-13T18:43:46.285 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.511837.log: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.110954.log.gz 2023-11-13T18:43:46.286 INFO:teuthology.orchestra.run.smithi102.stderr: 85.1% -- replaced with /var/log/ceph/ceph-client.admin.104411.log.gz 2023-11-13T18:43:46.286 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.377431.log 2023-11-13T18:43:46.287 INFO:teuthology.orchestra.run.smithi102.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.511837.log.gz 2023-11-13T18:43:46.287 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44436.log 2023-11-13T18:43:46.288 INFO:teuthology.orchestra.run.smithi102.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.112977.log.gz 2023-11-13T18:43:46.289 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.377431.log: /var/log/ceph/ceph-client.admin.309658.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.511785.log 2023-11-13T18:43:46.291 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.44436.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48378.log 2023-11-13T18:43:46.292 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.511785.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.511785.log.gz 2023-11-13T18:43:46.293 INFO:teuthology.orchestra.run.smithi102.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.406668.log.gz 2023-11-13T18:43:46.293 INFO:teuthology.orchestra.run.smithi102.stderr: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.459884.log.gz 2023-11-13T18:43:46.294 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.366144.log 2023-11-13T18:43:46.296 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.48378.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.180296.log 2023-11-13T18:43:46.298 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.366144.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.86928.log 2023-11-13T18:43:46.302 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.180296.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.185323.log 2023-11-13T18:43:46.304 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.86928.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102810.log 2023-11-13T18:43:46.305 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.185323.log: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.452310.log.gz 2023-11-13T18:43:46.306 INFO:teuthology.orchestra.run.smithi102.stderr: 85.4% -- replaced with /var/log/ceph/ceph-client.admin.453929.log.gz 2023-11-13T18:43:46.307 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.398538.log 2023-11-13T18:43:46.310 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.371759.log 2023-11-13T18:43:46.310 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.102810.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.47976.log.gz 2023-11-13T18:43:46.311 INFO:teuthology.orchestra.run.smithi102.stderr: 90.3%/var/log/ceph/ceph-client.admin.398538.log: -- replaced with /var/log/ceph/ceph-client.admin.337952.log.gz 2023-11-13T18:43:46.311 INFO:teuthology.orchestra.run.smithi102.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.332575.log.gz 2023-11-13T18:43:46.312 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.324865.log 2023-11-13T18:43:46.314 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.371759.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46380.log 2023-11-13T18:43:46.317 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.324865.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.210345.log 2023-11-13T18:43:46.319 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.46380.log: 79.7% -- replaced with /var/log/ceph/ceph-client.admin.415986.log.gz 2023-11-13T18:43:46.320 INFO:teuthology.orchestra.run.smithi102.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.371759.log.gz 2023-11-13T18:43:46.320 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.169518.log 2023-11-13T18:43:46.323 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.210345.log: 83.1% -- replaced with /var/log/ceph/ceph-client.admin.434689.log.gz 2023-11-13T18:43:46.323 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.247749.log 2023-11-13T18:43:46.325 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.169518.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.178575.log 2023-11-13T18:43:46.326 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.247749.log: 84.3% -- replaced with /var/log/ceph/ceph-client.admin.320348.log.gz 2023-11-13T18:43:46.327 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.440062.log 2023-11-13T18:43:46.328 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.178575.log: 80.8% -- replaced with /var/log/ceph/ceph-client.admin.232192.log.gz 2023-11-13T18:43:46.329 INFO:teuthology.orchestra.run.smithi102.stderr: 79.4% -- replaced with /var/log/ceph/ceph-client.admin.245666.log.gz 2023-11-13T18:43:46.330 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.166381.log 2023-11-13T18:43:46.333 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.440062.log: 93.7% -- replaced with /var/log/ceph/ceph-client.admin.174301.log.gz 2023-11-13T18:43:46.334 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.501402.log 2023-11-13T18:43:46.337 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.166381.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.399744.log 2023-11-13T18:43:46.340 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.501402.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.332100.log 2023-11-13T18:43:46.342 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.399744.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116794.log 2023-11-13T18:43:46.344 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.332100.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105708.log 2023-11-13T18:43:46.345 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.170464.log 2023-11-13T18:43:46.346 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.105708.log: /var/log/ceph/ceph-client.admin.116794.log: 92.1% -- replaced with /var/log/ceph/ceph-client.admin.501402.log.gz 2023-11-13T18:43:46.348 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46190.log 2023-11-13T18:43:46.350 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.170464.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.342621.log 2023-11-13T18:43:46.351 INFO:teuthology.orchestra.run.smithi102.stderr: 78.9% -- replaced with /var/log/ceph/ceph-client.admin.473807.log.gz 2023-11-13T18:43:46.352 INFO:teuthology.orchestra.run.smithi102.stderr: 81.4% -- replaced with /var/log/ceph/ceph-client.admin.118430.log.gz 2023-11-13T18:43:46.352 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.46190.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.315525.log 2023-11-13T18:43:46.354 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.342621.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104014.log 2023-11-13T18:43:46.356 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.315525.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.512071.log 2023-11-13T18:43:46.358 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.104014.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.246110.log 2023-11-13T18:43:46.361 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.512071.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.214440.log 2023-11-13T18:43:46.361 INFO:teuthology.orchestra.run.smithi102.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.512071.log.gz 2023-11-13T18:43:46.362 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98722.log 2023-11-13T18:43:46.364 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.246110.log: /var/log/ceph/ceph-client.admin.214440.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.131140.log 2023-11-13T18:43:46.364 INFO:teuthology.orchestra.run.smithi102.stderr: 80.6% -- replaced with /var/log/ceph/ceph-client.admin.445980.log.gz 2023-11-13T18:43:46.366 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.98722.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.403559.log 2023-11-13T18:43:46.368 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.131140.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.236661.log 2023-11-13T18:43:46.370 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.403559.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.405189.log 2023-11-13T18:43:46.373 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.236661.log: 81.4% -- replaced with /var/log/ceph/ceph-client.admin.458265.log.gz 2023-11-13T18:43:46.373 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.198584.log 2023-11-13T18:43:46.374 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.405189.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.215683.log 2023-11-13T18:43:46.375 INFO:teuthology.orchestra.run.smithi102.stderr: 81.4% -- replaced with /var/log/ceph/ceph-client.admin.159245.log.gz 2023-11-13T18:43:46.377 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100730.log 2023-11-13T18:43:46.377 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.198584.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44629.log 2023-11-13T18:43:46.378 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.215683.log: /var/log/ceph/ceph-client.admin.100730.log: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.116390.log.gz 2023-11-13T18:43:46.380 INFO:teuthology.orchestra.run.smithi102.stderr: 81.5% -- replaced with /var/log/ceph/ceph-client.admin.185323.log.gz 2023-11-13T18:43:46.381 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.389554.log 2023-11-13T18:43:46.381 INFO:teuthology.orchestra.run.smithi102.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.115549.log.gz 2023-11-13T18:43:46.382 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.44629.log: 81.5% -- replaced with /var/log/ceph/ceph-client.admin.169518.log.gz 2023-11-13T18:43:46.383 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.451094.log 2023-11-13T18:43:46.385 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.389554.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.512100.log 2023-11-13T18:43:46.388 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.451094.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.451907.log 2023-11-13T18:43:46.389 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.512100.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46723.log 2023-11-13T18:43:46.391 INFO:teuthology.orchestra.run.smithi102.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.512100.log.gz 2023-11-13T18:43:46.391 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48118.log 2023-11-13T18:43:46.393 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.451907.log: /var/log/ceph/ceph-client.admin.46723.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.253596.log 2023-11-13T18:43:46.395 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.48118.log: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.483452.log.gz 2023-11-13T18:43:46.395 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.398931.log 2023-11-13T18:43:46.397 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.253596.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.166783.log 2023-11-13T18:43:46.398 INFO:teuthology.orchestra.run.smithi102.stderr: 81.4% -- replaced with /var/log/ceph/ceph-client.admin.166381.log.gz 2023-11-13T18:43:46.398 INFO:teuthology.orchestra.run.smithi102.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.166390.log.gz 2023-11-13T18:43:46.399 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.398931.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.301546.log 2023-11-13T18:43:46.401 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.166783.log: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.214440.log.gz 2023-11-13T18:43:46.403 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.301546.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.376539.log 2023-11-13T18:43:46.405 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.370522.log 2023-11-13T18:43:46.407 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.376539.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.44629.log.gz 2023-11-13T18:43:46.408 INFO:teuthology.orchestra.run.smithi102.stderr: 89.3% 88.1% -- replaced with /var/log/ceph/ceph-client.admin.48118.log.gz 2023-11-13T18:43:46.408 INFO:teuthology.orchestra.run.smithi102.stderr: -- replaced with /var/log/ceph/ceph-client.admin.44161.log.gz 2023-11-13T18:43:46.409 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.163843.log 2023-11-13T18:43:46.409 INFO:teuthology.orchestra.run.smithi102.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.44436.log.gz 2023-11-13T18:43:46.409 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.345704.log 2023-11-13T18:43:46.411 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.163843.log: /var/log/ceph/ceph-client.admin.370522.log: 80.8% -- replaced with /var/log/ceph/ceph-client.admin.141967.log.gz 2023-11-13T18:43:46.412 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.299131.log 2023-11-13T18:43:46.413 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.345704.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.379991.log 2023-11-13T18:43:46.416 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.299131.log: 78.0% -- replaced with /var/log/ceph/ceph-client.admin.100730.log.gz 2023-11-13T18:43:46.417 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.303168.log 2023-11-13T18:43:46.417 INFO:teuthology.orchestra.run.smithi102.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.102810.log.gz 2023-11-13T18:43:46.418 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.247310.log 2023-11-13T18:43:46.419 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.303168.log: /var/log/ceph/ceph-client.admin.379991.log: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.105708.log.gz 2023-11-13T18:43:46.420 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117201.log 2023-11-13T18:43:46.421 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.247310.log: 81.6% -- replaced with /var/log/ceph/ceph-client.admin.405189.log.gz 2023-11-13T18:43:46.422 INFO:teuthology.orchestra.run.smithi102.stderr: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.451094.log.gz 2023-11-13T18:43:46.422 INFO:teuthology.orchestra.run.smithi102.stderr: 80.7% -- replaced with /var/log/ceph/ceph-client.admin.342621.log.gz 2023-11-13T18:43:46.423 INFO:teuthology.orchestra.run.smithi102.stderr: 84.3% -- replaced with /var/log/ceph/ceph-client.admin.398931.log.gz 2023-11-13T18:43:46.423 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.310973.log 2023-11-13T18:43:46.424 INFO:teuthology.orchestra.run.smithi102.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.398538.log.gz 2023-11-13T18:43:46.426 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.117201.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.506076.log 2023-11-13T18:43:46.486 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.310973.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.387099.log 2023-11-13T18:43:46.486 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.423977.log 2023-11-13T18:43:46.486 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.506076.log: /var/log/ceph/ceph-client.admin.387099.log: 81.1% -- replaced with /var/log/ceph/ceph-client.admin.506076.log.gz 2023-11-13T18:43:46.486 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.203498.log 2023-11-13T18:43:46.487 INFO:teuthology.orchestra.run.smithi102.stderr: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.210345.log.gz 2023-11-13T18:43:46.487 INFO:teuthology.orchestra.run.smithi102.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.303168.log.gz 2023-11-13T18:43:46.487 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.423977.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.211561.log 2023-11-13T18:43:46.487 INFO:teuthology.orchestra.run.smithi102.stderr: 81.6% -- replaced with /var/log/ceph/ceph-client.admin.376539.log.gz 2023-11-13T18:43:46.488 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.168539.log 2023-11-13T18:43:46.488 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.203498.log: /var/log/ceph/ceph-client.admin.211561.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.85514.log 2023-11-13T18:43:46.488 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.132377.log 2023-11-13T18:43:46.489 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.168539.log: /var/log/ceph/ceph-client.admin.85514.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47356.log 2023-11-13T18:43:46.489 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47648.log 2023-11-13T18:43:46.489 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.132377.log: /var/log/ceph/ceph-client.admin.47356.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.381208.log 2023-11-13T18:43:46.489 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.47648.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.170857.log 2023-11-13T18:43:46.490 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5/var/log/ceph/ceph-client.admin.381208.log: --verbose -- /var/log/ceph/ceph-client.admin.46164.log 2023-11-13T18:43:46.490 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.170857.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46138.log 2023-11-13T18:43:46.490 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.389956.log 2023-11-13T18:43:46.490 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.46164.log: /var/log/ceph/ceph-client.admin.46138.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.440638.log 2023-11-13T18:43:46.491 INFO:teuthology.orchestra.run.smithi102.stderr: 82.1% -- replaced with /var/log/ceph/ceph-client.admin.247310.log.gz 2023-11-13T18:43:46.491 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.389956.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119298.log 2023-11-13T18:43:46.491 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.440638.log: 90.5% -- replaced with /var/log/ceph/ceph-client.admin.236661.log.gz 2023-11-13T18:43:46.491 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.133219.log 2023-11-13T18:43:46.492 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.418926.log 2023-11-13T18:43:46.492 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.119298.log: /var/log/ceph/ceph-client.admin.133219.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.450701.log 2023-11-13T18:43:46.492 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.418926.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.184930.log 2023-11-13T18:43:46.492 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.450701.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.428638.log 2023-11-13T18:43:46.493 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.184930.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.438655.log 2023-11-13T18:43:46.493 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118023.log 2023-11-13T18:43:46.493 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.428638.log: /var/log/ceph/ceph-client.admin.438655.log: 94.2% -- replaced with /var/log/ceph/ceph-client.admin.425191.log.gz 2023-11-13T18:43:46.493 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.500129.log 2023-11-13T18:43:46.494 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.118023.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93930.log 2023-11-13T18:43:46.494 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103203.log 2023-11-13T18:43:46.494 INFO:teuthology.orchestra.run.smithi102.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.48378.log.gz 2023-11-13T18:43:46.494 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.500129.log: /var/log/ceph/ceph-client.admin.93930.log: 78.9% -- replaced with /var/log/ceph/ceph-client.admin.500129.log.gz 2023-11-13T18:43:46.495 INFO:teuthology.orchestra.run.smithi102.stderr: 92.3%gzip -- replaced with /var/log/ceph/ceph-client.admin.99914.log.gz -5 2023-11-13T18:43:46.495 INFO:teuthology.orchestra.run.smithi102.stderr: --verbose -- /var/log/ceph/ceph-client.admin.476365.log 2023-11-13T18:43:46.495 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.103203.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45019.log 2023-11-13T18:43:46.495 INFO:teuthology.orchestra.run.smithi102.stderr: 81.3% -- replaced with /var/log/ceph/ceph-client.admin.117201.log.gz 2023-11-13T18:43:46.497 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.136151.log 2023-11-13T18:43:46.497 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.45019.log: /var/log/ceph/ceph-client.admin.476365.log: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.320764.log.gz 2023-11-13T18:43:46.497 INFO:teuthology.orchestra.run.smithi102.stderr: 92.1% -- replaced with /var/log/ceph/ceph-client.admin.204825.log.gz 2023-11-13T18:43:46.498 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47768.log 2023-11-13T18:43:46.498 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.136151.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.307610.log 2023-11-13T18:43:46.498 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.461955.log 2023-11-13T18:43:46.498 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.47768.log: /var/log/ceph/ceph-client.admin.307610.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.132784.log 2023-11-13T18:43:46.499 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.461955.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.183305.log 2023-11-13T18:43:46.499 INFO:teuthology.orchestra.run.smithi102.stderr: 78.8% -- replaced with /var/log/ceph/ceph-client.admin.170857.log.gz 2023-11-13T18:43:46.501 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.132784.log: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.399744.log.gz 2023-11-13T18:43:46.501 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.213217.log 2023-11-13T18:43:46.501 INFO:teuthology.orchestra.run.smithi102.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.211561.log.gz 2023-11-13T18:43:46.502 INFO:teuthology.orchestra.run.smithi102.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.170464.log.gz 2023-11-13T18:43:46.502 INFO:teuthology.orchestra.run.smithi102.stderr: 81.5% -- replaced with /var/log/ceph/ceph-client.admin.310973.log.gz 2023-11-13T18:43:46.504 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.183305.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.199388.log 2023-11-13T18:43:46.504 INFO:teuthology.orchestra.run.smithi102.stderr: 94.6% -- replaced with /var/log/ceph/ceph-client.admin.142378.log.gz 2023-11-13T18:43:46.505 INFO:teuthology.orchestra.run.smithi102.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.315525.log.gz 2023-11-13T18:43:46.506 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.213217.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.509532.log 2023-11-13T18:43:46.508 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.199388.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.46190.log.gz 2023-11-13T18:43:46.509 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.183711.log 2023-11-13T18:43:46.511 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.445989.log 2023-11-13T18:43:46.511 INFO:teuthology.orchestra.run.smithi102.stderr: 93.6% -- replaced with /var/log/ceph/ceph-client.admin.178575.log.gz 2023-11-13T18:43:46.513 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.509532.log: /var/log/ceph/ceph-client.admin.183711.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.332968.log 2023-11-13T18:43:46.515 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.445989.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.403550.log 2023-11-13T18:43:46.518 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.332968.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.243214.log 2023-11-13T18:43:46.521 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.403550.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.336311.log 2023-11-13T18:43:46.523 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.243214.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.492121.log 2023-11-13T18:43:46.526 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.336311.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.416802.log 2023-11-13T18:43:46.527 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.457858.log 2023-11-13T18:43:46.529 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.416802.log: /var/log/ceph/ceph-client.admin.492121.log: 92.7% -- replaced with /var/log/ceph/ceph-client.admin.509532.log.gz 2023-11-13T18:43:46.530 INFO:teuthology.orchestra.run.smithi102.stderr: 77.8% -- replaced with /var/log/ceph/ceph-client.admin.492121.log.gz 2023-11-13T18:43:46.530 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.337943.log 2023-11-13T18:43:46.532 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.457858.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.305596.log 2023-11-13T18:43:46.534 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.337943.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.189756.log 2023-11-13T18:43:46.536 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.305596.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.418458.log 2023-11-13T18:43:46.538 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.3.log 2023-11-13T18:43:46.540 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.418458.log: /var/log/ceph/ceph-client.admin.189756.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.310580.log 2023-11-13T18:43:46.542 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-osd.3.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.374616.log 2023-11-13T18:43:46.543 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.87866.log 2023-11-13T18:43:46.546 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.310580.log: /var/log/ceph/ceph-client.admin.374616.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.511759.log 2023-11-13T18:43:46.548 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.87866.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.509966.log 2023-11-13T18:43:46.550 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.511759.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47408.log 2023-11-13T18:43:46.551 INFO:teuthology.orchestra.run.smithi102.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.511759.log.gz 2023-11-13T18:43:46.551 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.165960.log 2023-11-13T18:43:46.554 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.509966.log: /var/log/ceph/ceph-client.admin.47408.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.224991.log 2023-11-13T18:43:46.555 INFO:teuthology.orchestra.run.smithi102.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.509966.log.gz 2023-11-13T18:43:46.557 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.165960.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.181586.log 2023-11-13T18:43:46.559 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.224991.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101563.log 2023-11-13T18:43:46.561 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.181586.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47225.log 2023-11-13T18:43:46.563 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.101563.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.500967.log 2023-11-13T18:43:46.565 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.47225.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48328.log 2023-11-13T18:43:46.567 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.500967.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.256206.log 2023-11-13T18:43:46.568 INFO:teuthology.orchestra.run.smithi102.stderr: 81.5% -- replaced with /var/log/ceph/ceph-client.admin.500967.log.gz 2023-11-13T18:43:46.568 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.300736.log 2023-11-13T18:43:46.570 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.48328.log: /var/log/ceph/ceph-client.admin.256206.log: 78.6% -- replaced with /var/log/ceph/ceph-client.admin.92661.log.gz 2023-11-13T18:43:46.571 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.179436.log 2023-11-13T18:43:46.571 INFO:teuthology.orchestra.run.smithi102.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.46380.log.gz 2023-11-13T18:43:46.572 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.133619.log 2023-11-13T18:43:46.572 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.300736.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.47408.log.gz 2023-11-13T18:43:46.575 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.179436.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.511200.log 2023-11-13T18:43:46.577 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose --/var/log/ceph/ceph-client.admin.133619.log: /var/log/ceph/ceph-client.admin.110150.log 2023-11-13T18:43:46.578 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94736.log 2023-11-13T18:43:46.580 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.511200.log: /var/log/ceph/ceph-client.admin.110150.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.511200.log.gz 2023-11-13T18:43:46.581 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.496797.log 2023-11-13T18:43:46.582 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.494213.log 2023-11-13T18:43:46.584 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.94736.log: /var/log/ceph/ceph-client.admin.496797.log: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.496797.log.gz 2023-11-13T18:43:46.585 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.502669.log 2023-11-13T18:43:46.586 INFO:teuthology.orchestra.run.smithi102.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.46138.log.gz 2023-11-13T18:43:46.587 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.431116.log 2023-11-13T18:43:46.588 INFO:teuthology.orchestra.run.smithi102.stderr: 84.5% -- replaced with /var/log/ceph/ceph-client.admin.103203.log.gz 2023-11-13T18:43:46.588 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.494213.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.194362.log 2023-11-13T18:43:46.590 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.502669.log: /var/log/ceph/ceph-client.admin.431116.log: 77.8% -- replaced with /var/log/ceph/ceph-client.admin.502669.log.gz 2023-11-13T18:43:46.592 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.170053.log 2023-11-13T18:43:46.592 INFO:teuthology.orchestra.run.smithi102.stderr: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.494213.log.gz 2023-11-13T18:43:46.593 INFO:teuthology.orchestra.run.smithi102.stderr: 84.7% 90.1% -- replaced with /var/log/ceph/ceph-client.admin.461955.log.gz -- replaced with /var/log/ceph/ceph-client.admin.451907.log.gz 2023-11-13T18:43:46.593 INFO:teuthology.orchestra.run.smithi102.stderr: 2023-11-13T18:43:46.594 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.188956.log 2023-11-13T18:43:46.595 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.194362.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.88306.log 2023-11-13T18:43:46.596 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.188956.log: /var/log/ceph/ceph-client.admin.170053.log: 92.5% -- replaced with /var/log/ceph/ceph-client.admin.254024.log.gz 2023-11-13T18:43:46.597 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114234.log 2023-11-13T18:43:46.599 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.88306.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.391170.log 2023-11-13T18:43:46.601 INFO:teuthology.orchestra.run.smithi102.stderr: 81.2% -- replaced with /var/log/ceph/ceph-client.admin.307610.log.gz 2023-11-13T18:43:46.602 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.114234.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.161690.log 2023-11-13T18:43:46.604 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.453128.log 2023-11-13T18:43:46.606 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.391170.log: /var/log/ceph/ceph-client.admin.161690.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.170455.log 2023-11-13T18:43:46.608 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.453128.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.305185.log 2023-11-13T18:43:46.610 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.170455.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.417610.log 2023-11-13T18:43:46.612 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.305185.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.185734.log 2023-11-13T18:43:46.614 INFO:teuthology.orchestra.run.smithi102.stderr: 81.2% -- replaced with /var/log/ceph/ceph-client.admin.305185.log.gz 2023-11-13T18:43:46.615 INFO:teuthology.orchestra.run.smithi102.stderr: 78.4% -- replaced with /var/log/ceph/ceph-client.admin.389956.log.gz 2023-11-13T18:43:46.615 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.162121.log 2023-11-13T18:43:46.616 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.417610.log: /var/log/ceph/ceph-client.admin.185734.log: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.305596.log.gz 2023-11-13T18:43:46.618 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43793.log 2023-11-13T18:43:46.620 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.162121.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.199379.log 2023-11-13T18:43:46.621 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.206153.log 2023-11-13T18:43:46.623 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.43793.log: /var/log/ceph/ceph-client.admin.199379.log: 96.7% -- replaced with /var/log/ceph/ceph-client.admin.490366.log.gz 2023-11-13T18:43:46.624 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.392404.log 2023-11-13T18:43:46.626 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.206153.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.484249.log 2023-11-13T18:43:46.628 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.205248.log 2023-11-13T18:43:46.630 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.392404.log: /var/log/ceph/ceph-client.admin.484249.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.160054.log 2023-11-13T18:43:46.632 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.205248.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.174722.log 2023-11-13T18:43:46.634 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.160054.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46593.log 2023-11-13T18:43:46.636 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.174722.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.186127.log 2023-11-13T18:43:46.638 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.46593.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.429444.log 2023-11-13T18:43:46.640 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.186127.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111349.log 2023-11-13T18:43:46.642 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.429444.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.245675.log 2023-11-13T18:43:46.644 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.111349.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.131149.log 2023-11-13T18:43:46.645 INFO:teuthology.orchestra.run.smithi102.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.93930.log.gz 2023-11-13T18:43:46.646 INFO:teuthology.orchestra.run.smithi102.stderr: 82.1% -- replaced with /var/log/ceph/ceph-client.admin.104853.log.gz 2023-11-13T18:43:46.646 INFO:teuthology.orchestra.run.smithi102.stderr: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.133619.log.gz 2023-11-13T18:43:46.646 INFO:teuthology.orchestra.run.smithi102.stderr: 81.2% -- replaced with /var/log/ceph/ceph-client.admin.119298.log.gz 2023-11-13T18:43:46.646 INFO:teuthology.orchestra.run.smithi102.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.119307.log.gz 2023-11-13T18:43:46.647 INFO:teuthology.orchestra.run.smithi102.stderr: 90.1%/var/log/ceph/ceph-client.admin.245675.log: -- replaced with /var/log/ceph/ceph-client.admin.93528.log.gz 2023-11-13T18:43:46.647 INFO:teuthology.orchestra.run.smithi102.stderr: 83.1% -- replaced with /var/log/ceph/ceph-client.admin.118023.log.gz 2023-11-13T18:43:46.648 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.452301.log 2023-11-13T18:43:46.650 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.131149.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.365737.log 2023-11-13T18:43:46.653 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.452301.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.315516.log 2023-11-13T18:43:46.655 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.365737.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.437785.log 2023-11-13T18:43:46.657 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.315516.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.484258.log 2023-11-13T18:43:46.659 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.437785.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.331634.log 2023-11-13T18:43:46.661 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.484258.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.236245.log 2023-11-13T18:43:46.664 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.331634.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.479413.log 2023-11-13T18:43:46.665 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.236245.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.494946.log 2023-11-13T18:43:46.668 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.479413.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46223.log 2023-11-13T18:43:46.670 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.494946.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.476356.log 2023-11-13T18:43:46.673 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.46223.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.498475.log 2023-11-13T18:43:46.674 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.332566.log 2023-11-13T18:43:46.675 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.476356.log: /var/log/ceph/ceph-client.admin.498475.log: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.498475.log.gz 2023-11-13T18:43:46.677 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.459875.log 2023-11-13T18:43:46.677 INFO:teuthology.orchestra.run.smithi102.stderr: 81.4% -- replaced with /var/log/ceph/ceph-client.admin.174722.log.gz 2023-11-13T18:43:46.678 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.332566.log: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.163843.log.gz 2023-11-13T18:43:46.679 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.247740.log 2023-11-13T18:43:46.679 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.459875.log: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.198584.log.gz 2023-11-13T18:43:46.680 INFO:teuthology.orchestra.run.smithi102.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.418926.log.gz 2023-11-13T18:43:46.681 INFO:teuthology.orchestra.run.smithi102.stderr: 80.8% -- replaced with /var/log/ceph/ceph-client.admin.183305.log.gz 2023-11-13T18:43:46.681 INFO:teuthology.orchestra.run.smithi102.stderr: 80.8% -- replaced with /var/log/ceph/ceph-client.admin.183711.log.gz 2023-11-13T18:43:46.682 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.406260.log 2023-11-13T18:43:46.682 INFO:teuthology.orchestra.run.smithi102.stderr: 81.2% -- replaced with /var/log/ceph/ceph-client.admin.194362.log.gz 2023-11-13T18:43:46.684 INFO:teuthology.orchestra.run.smithi102.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.416802.log.gz 2023-11-13T18:43:46.685 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.247740.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.89988.log 2023-11-13T18:43:46.686 INFO:teuthology.orchestra.run.smithi102.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.224991.log.gz 2023-11-13T18:43:46.687 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.237068.log 2023-11-13T18:43:46.690 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.406260.log: /var/log/ceph/ceph-client.admin.89988.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44187.log 2023-11-13T18:43:46.693 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.237068.log: 92.8% -- replaced with /var/log/ceph/ceph-client.admin.247749.log.gz 2023-11-13T18:43:46.693 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90452.log 2023-11-13T18:43:46.694 INFO:teuthology.orchestra.run.smithi102.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.45019.log.gz 2023-11-13T18:43:46.696 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99178.log 2023-11-13T18:43:46.696 INFO:teuthology.orchestra.run.smithi102.stderr: 81.9% -- replaced with /var/log/ceph/ceph-client.admin.377431.log.gz 2023-11-13T18:43:46.697 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.44187.log: gzip -5/var/log/ceph/ceph-client.admin.90452.log: --verbose -- /var/log/ceph/ceph-client.admin.425705.log 2023-11-13T18:43:46.700 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.99178.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.182439.log 2023-11-13T18:43:46.702 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44640.log 2023-11-13T18:43:46.703 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.425705.log: /var/log/ceph/ceph-client.admin.182439.log: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.440638.log.gz 2023-11-13T18:43:46.704 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.481035.log 2023-11-13T18:43:46.706 INFO:teuthology.orchestra.run.smithi102.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.46723.log.gz 2023-11-13T18:43:46.706 INFO:teuthology.orchestra.run.smithi102.stderr: 81.0% -- replaced with /var/log/ceph/ceph-client.admin.301546.log.gz 2023-11-13T18:43:46.707 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.44640.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.337131.log 2023-11-13T18:43:46.708 INFO:teuthology.orchestra.run.smithi102.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.47356.log.gz 2023-11-13T18:43:46.708 INFO:teuthology.orchestra.run.smithi102.stderr:gzip/var/log/ceph/ceph-client.admin.481035.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.459480.log 2023-11-13T18:43:46.711 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.337131.log: gzip 88.5% -5 -- replaced with /var/log/ceph/ceph-client.admin.44187.log.gz --verbose -- 2023-11-13T18:43:46.711 INFO:teuthology.orchestra.run.smithi102.stderr: /var/log/ceph/ceph-client.admin.509523.log 2023-11-13T18:43:46.712 INFO:teuthology.orchestra.run.smithi102.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.44640.log.gz 2023-11-13T18:43:46.712 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114651.log 2023-11-13T18:43:46.713 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.459480.log: /var/log/ceph/ceph-client.admin.509523.log: 80.5% -- replaced with /var/log/ceph/ceph-client.admin.509523.log.gz 2023-11-13T18:43:46.714 INFO:teuthology.orchestra.run.smithi102.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.45800.log.gz 2023-11-13T18:43:46.714 INFO:teuthology.orchestra.run.smithi102.stderr: 80.7% -- replaced with /var/log/ceph/ceph-client.admin.111349.log.gz 2023-11-13T18:43:46.715 INFO:teuthology.orchestra.run.smithi102.stderr:gzip 90.1% -5 -- replaced with /var/log/ceph/ceph-client.admin.324865.log.gz --verbose -- 2023-11-13T18:43:46.715 INFO:teuthology.orchestra.run.smithi102.stderr: /var/log/ceph/ceph-client.admin.112968.log 2023-11-13T18:43:46.716 INFO:teuthology.orchestra.run.smithi102.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.46223.log.gz 2023-11-13T18:43:46.716 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.452720.log 2023-11-13T18:43:46.718 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.112968.log: /var/log/ceph/ceph-client.admin.114651.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.202658.log 2023-11-13T18:43:46.721 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.452720.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48276.log 2023-11-13T18:43:46.723 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.202658.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.440053.log 2023-11-13T18:43:46.725 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.48276.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.309649.log 2023-11-13T18:43:46.728 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.440053.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.254481.log 2023-11-13T18:43:46.730 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.309649.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.242820.log 2023-11-13T18:43:46.732 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.304375.log 2023-11-13T18:43:46.733 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.254481.log: /var/log/ceph/ceph-client.admin.242820.log: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.406260.log.gz 2023-11-13T18:43:46.734 INFO:teuthology.orchestra.run.smithi102.stderr: 85.2% -- replaced with /var/log/ceph/ceph-client.admin.452301.log.gz 2023-11-13T18:43:46.735 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.437326.log 2023-11-13T18:43:46.736 INFO:teuthology.orchestra.run.smithi102.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.453128.log.gz 2023-11-13T18:43:46.737 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.313079.log 2023-11-13T18:43:46.739 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.304375.log: /var/log/ceph/ceph-client.admin.437326.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.175152.log 2023-11-13T18:43:46.740 INFO:teuthology.orchestra.run.smithi102.stderr: 86.2% -- replaced with /var/log/ceph/ceph-client.admin.332566.log.gz 2023-11-13T18:43:46.741 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.313079.log: 78.3% -- replaced with /var/log/ceph/ceph-client.admin.332968.log.gz 2023-11-13T18:43:46.742 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46489.log 2023-11-13T18:43:46.743 INFO:teuthology.orchestra.run.smithi102.stderr: 85.2% -- replaced with /var/log/ceph/ceph-client.admin.366144.log.gz 2023-11-13T18:43:46.745 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.175152.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112167.log 2023-11-13T18:43:46.746 INFO:teuthology.orchestra.run.smithi102.stderr: 80.7% -- replaced with /var/log/ceph/ceph-client.admin.389554.log.gz 2023-11-13T18:43:46.746 INFO:teuthology.orchestra.run.smithi102.stderr: 81.0% -- replaced with /var/log/ceph/ceph-client.admin.391170.log.gz 2023-11-13T18:43:46.748 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46567.log 2023-11-13T18:43:46.748 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.46489.log: 80.9% -- replaced with /var/log/ceph/ceph-client.admin.304375.log.gz 2023-11-13T18:43:46.749 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.334187.log 2023-11-13T18:43:46.749 INFO:teuthology.orchestra.run.smithi102.stderr: 90.2%/var/log/ceph/ceph-client.admin.46567.log: -- replaced with /var/log/ceph/ceph-client.admin.392404.log.gz 2023-11-13T18:43:46.750 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.112167.log: 91.9% -- replaced with /var/log/ceph/ceph-client.admin.403559.log.gz 2023-11-13T18:43:46.751 INFO:teuthology.orchestra.run.smithi102.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.428638.log.gz 2023-11-13T18:43:46.752 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.173022.log 2023-11-13T18:43:46.754 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.334187.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45282.log 2023-11-13T18:43:46.755 INFO:teuthology.orchestra.run.smithi102.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.104014.log.gz 2023-11-13T18:43:46.756 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.173022.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.497194.log 2023-11-13T18:43:46.758 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.45282.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.376146.log 2023-11-13T18:43:46.759 INFO:teuthology.orchestra.run.smithi102.stderr: 93.0% -- replaced with /var/log/ceph/ceph-client.admin.321167.log.gz 2023-11-13T18:43:46.759 INFO:teuthology.orchestra.run.smithi102.stderr: 80.8% -- replaced with /var/log/ceph/ceph-client.admin.236245.log.gz 2023-11-13T18:43:46.761 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.497194.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46112.log 2023-11-13T18:43:46.761 INFO:teuthology.orchestra.run.smithi102.stderr: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.247740.log.gz 2023-11-13T18:43:46.762 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.424783.log 2023-11-13T18:43:46.762 INFO:teuthology.orchestra.run.smithi102.stderr: 80.9% -- replaced with /var/log/ceph/ceph-client.admin.497194.log.gz 2023-11-13T18:43:46.763 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.46112.log: /var/log/ceph/ceph-client.admin.376146.log: 92.3% -- replaced with /var/log/ceph/ceph-client.admin.215683.log.gz 2023-11-13T18:43:46.764 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.377038.log 2023-11-13T18:43:46.765 INFO:teuthology.orchestra.run.smithi102.stderr: 81.0% -- replaced with /var/log/ceph/ceph-client.admin.132368.log.gz 2023-11-13T18:43:46.766 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.302766.log 2023-11-13T18:43:46.767 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.424783.log: 84.3% -- replaced with /var/log/ceph/ceph-client.admin.417610.log.gz 2023-11-13T18:43:46.768 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.420671.log 2023-11-13T18:43:46.769 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.302766.log: /var/log/ceph/ceph-client.admin.377038.log: 81.3% -- replaced with /var/log/ceph/ceph-client.admin.114234.log.gz 2023-11-13T18:43:46.770 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.195575.log 2023-11-13T18:43:46.772 INFO:teuthology.orchestra.run.smithi102.stderr: 93.6% -- replaced with /var/log/ceph/ceph-client.admin.179436.log.gz 2023-11-13T18:43:46.772 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.420671.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.496394.log 2023-11-13T18:43:46.774 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.195575.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.396888.log 2023-11-13T18:43:46.776 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.496394.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.368237.log 2023-11-13T18:43:46.778 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.396888.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.453119.log 2023-11-13T18:43:46.779 INFO:teuthology.orchestra.run.smithi102.stderr: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.496394.log.gz 2023-11-13T18:43:46.781 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.368237.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.316328.log 2023-11-13T18:43:46.783 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.453119.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47252.log 2023-11-13T18:43:46.785 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.511148.log 2023-11-13T18:43:46.787 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.316328.log: /var/log/ceph/ceph-client.admin.47252.log: 81.0% -- replaced with /var/log/ceph/ceph-client.admin.309649.log.gz 2023-11-13T18:43:46.787 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.135250.log 2023-11-13T18:43:46.788 INFO:teuthology.orchestra.run.smithi102.stderr: 91.9% -- replaced with /var/log/ceph/ceph-client.admin.253596.log.gz 2023-11-13T18:43:46.789 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.511148.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.227305.log 2023-11-13T18:43:46.791 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.303561.log 2023-11-13T18:43:46.791 INFO:teuthology.orchestra.run.smithi102.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.511148.log.gz 2023-11-13T18:43:46.792 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.135250.log: /var/log/ceph/ceph-client.admin.227305.log: 80.8% -- replaced with /var/log/ceph/ceph-client.admin.438655.log.gz 2023-11-13T18:43:46.793 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47095.log 2023-11-13T18:43:46.795 INFO:teuthology.orchestra.run.smithi102.stderr: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.484258.log.gz 2023-11-13T18:43:46.796 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.303561.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.181147.log 2023-11-13T18:43:46.797 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.47095.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44837.log 2023-11-13T18:43:46.800 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.181147.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.232201.log 2023-11-13T18:43:46.802 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.44837.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.435661.log 2023-11-13T18:43:46.804 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.232201.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.132775.log 2023-11-13T18:43:46.805 INFO:teuthology.orchestra.run.smithi102.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.46855.log.gz 2023-11-13T18:43:46.806 INFO:teuthology.orchestra.run.smithi102.stderr: 93.5% -- replaced with /var/log/ceph/ceph-client.admin.445989.log.gz/var/log/ceph/ceph-client.admin.435661.log: 2023-11-13T18:43:46.807 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.229366.log 2023-11-13T18:43:46.809 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.132775.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.171700.log 2023-11-13T18:43:46.810 INFO:teuthology.orchestra.run.smithi102.stderr: 84.4% -- replaced with /var/log/ceph/ceph-client.admin.205248.log.gz 2023-11-13T18:43:46.812 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.229366.log: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.316328.log.gz 2023-11-13T18:43:46.812 INFO:teuthology.orchestra.run.smithi102.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.227305.log.gz 2023-11-13T18:43:46.813 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.160063.log 2023-11-13T18:43:46.813 INFO:teuthology.orchestra.run.smithi102.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.313079.log.gz 2023-11-13T18:43:46.814 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.171700.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.417619.log 2023-11-13T18:43:46.817 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.160063.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.431107.log 2023-11-13T18:43:46.819 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.299939.log 2023-11-13T18:43:46.821 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.417619.log: /var/log/ceph/ceph-client.admin.431107.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.429435.log 2023-11-13T18:43:46.823 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.299939.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.448152.log 2023-11-13T18:43:46.826 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.429435.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.482236.log 2023-11-13T18:43:46.829 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.448152.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.246513.log 2023-11-13T18:43:46.832 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.482236.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.453528.log 2023-11-13T18:43:46.835 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.246513.log: 80.7% -- replaced with /var/log/ceph/ceph-client.admin.89988.log.gz 2023-11-13T18:43:46.836 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.325661.log 2023-11-13T18:43:46.837 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.453528.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.447689.log 2023-11-13T18:43:46.840 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.325661.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.433828.log 2023-11-13T18:43:46.842 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.447689.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.305997.log 2023-11-13T18:43:46.845 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.433828.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2023-11-13T18:43:46.848 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.305997.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119709.log 2023-11-13T18:43:46.850 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.480632.log 2023-11-13T18:43:46.852 INFO:teuthology.orchestra.run.smithi102.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.46489.log.gz 2023-11-13T18:43:46.852 INFO:teuthology.orchestra.run.smithi102.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.46593.log.gz 2023-11-13T18:43:46.853 INFO:teuthology.orchestra.run.smithi102.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.44837.log.gz 2023-11-13T18:43:46.853 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose --/var/log/ceph/ceph-client.admin.480632.log: /var/log/ceph/ceph-client.admin.499703.log 2023-11-13T18:43:46.854 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.119709.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.46112.log.gz 2023-11-13T18:43:46.854 INFO:teuthology.orchestra.run.smithi102.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.47648.log.gz 2023-11-13T18:43:46.856 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45826.log 2023-11-13T18:43:46.857 INFO:teuthology.orchestra.run.smithi102.stderr: 80.7% -- replaced with /var/log/ceph/ceph-client.admin.166783.log.gz 2023-11-13T18:43:46.857 INFO:teuthology.orchestra.run.smithi102.stderr: 78.7% -- replaced with /var/log/ceph/ceph-client.admin.167652.log.gz 2023-11-13T18:43:46.858 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.499703.log: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.379991.log.gz 2023-11-13T18:43:46.859 INFO:teuthology.orchestra.run.smithi102.stderr: 81.0% -- replaced with /var/log/ceph/ceph-client.admin.112968.log.gz 2023-11-13T18:43:46.859 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.255802.log 2023-11-13T18:43:46.861 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.45826.log: 80.5% -- replaced with /var/log/ceph/ceph-client.admin.300736.log.gz 2023-11-13T18:43:46.862 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.174292.log 2023-11-13T18:43:46.865 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.255802.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.162551.log 2023-11-13T18:43:46.865 INFO:teuthology.orchestra.run.smithi102.stderr: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.170053.log.gz 2023-11-13T18:43:46.866 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.168122.log 2023-11-13T18:43:46.867 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.162551.log: 82.0% -- replaced with /var/log/ceph/ceph-client.admin.448152.log.gz 2023-11-13T18:43:46.868 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.174292.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.480230.log 2023-11-13T18:43:46.870 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.168122.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.511629.log 2023-11-13T18:43:46.872 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.480230.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43819.log 2023-11-13T18:43:46.875 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.511629.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.254971.log 2023-11-13T18:43:46.876 INFO:teuthology.orchestra.run.smithi102.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.511629.log.gz 2023-11-13T18:43:46.878 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.43819.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.86505.log 2023-11-13T18:43:46.880 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.254971.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.195173.log 2023-11-13T18:43:46.881 INFO:teuthology.orchestra.run.smithi102.stderr: 80.8% -- replaced with /var/log/ceph/ceph-client.admin.484249.log.gz 2023-11-13T18:43:46.881 INFO:teuthology.orchestra.run.smithi102.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.48328.log.gz 2023-11-13T18:43:46.882 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.86505.log: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.452720.log.gz 2023-11-13T18:43:46.883 INFO:teuthology.orchestra.run.smithi102.stderr: 90.2%gzip -- replaced with /var/log/ceph/ceph-client.admin.437326.log.gz 2023-11-13T18:43:46.883 INFO:teuthology.orchestra.run.smithi102.stderr: -5 --verbose 78.3% -- replaced with /var/log/ceph/ceph-client.admin.337131.log.gz -- 2023-11-13T18:43:46.883 INFO:teuthology.orchestra.run.smithi102.stderr: /var/log/ceph/ceph-client.admin.449016.log 2023-11-13T18:43:46.885 INFO:teuthology.orchestra.run.smithi102.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.246110.log.gz 2023-11-13T18:43:46.885 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.195173.log: 81.5% -- replaced with /var/log/ceph/ceph-client.admin.255802.log.gz 2023-11-13T18:43:46.886 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.235440.log 2023-11-13T18:43:46.887 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.449016.log: 84.2% -- replaced with /var/log/ceph/ceph-client.admin.173022.log.gz 2023-11-13T18:43:46.888 INFO:teuthology.orchestra.run.smithi102.stderr: 81.4% -- replaced with /var/log/ceph/ceph-client.admin.303561.log.gz 2023-11-13T18:43:46.889 INFO:teuthology.orchestra.run.smithi102.stderr: 79.5% -- replaced with /var/log/ceph/ceph-client.admin.174292.log.gz 2023-11-13T18:43:46.889 INFO:teuthology.orchestra.run.smithi102.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.480632.log.gz 2023-11-13T18:43:46.890 INFO:teuthology.orchestra.run.smithi102.stderr: 92.0% -- replaced with /var/log/ceph/ceph-client.admin.431116.log.gz 2023-11-13T18:43:46.890 INFO:teuthology.orchestra.run.smithi102.stderr: 81.5% -- replaced with /var/log/ceph/ceph-client.admin.387099.log.gz 2023-11-13T18:43:46.891 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.313472.log 2023-11-13T18:43:46.891 INFO:teuthology.orchestra.run.smithi102.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.110150.log.gz 2023-11-13T18:43:46.892 INFO:teuthology.orchestra.run.smithi102.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.376146.log.gz 2023-11-13T18:43:46.892 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.235440.log: gzip -5 --verbose 90.5% -- replaced with /var/log/ceph/ceph-client.admin.237068.log.gz -- 2023-11-13T18:43:46.893 INFO:teuthology.orchestra.run.smithi102.stderr: /var/log/ceph/ceph-client.admin.450692.log 2023-11-13T18:43:46.895 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.313472.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.406043.log 2023-11-13T18:43:46.896 INFO:teuthology.orchestra.run.smithi102.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.450701.log.gz 2023-11-13T18:43:46.898 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.450692.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.432887.log 2023-11-13T18:43:46.900 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.495570.log 2023-11-13T18:43:46.902 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.406043.log: /var/log/ceph/ceph-client.admin.432887.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.477397.log 2023-11-13T18:43:46.902 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.495570.log: 93.0% -- replaced with /var/log/ceph/ceph-client.admin.132377.log.gz 2023-11-13T18:43:46.903 INFO:teuthology.orchestra.run.smithi102.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.495570.log.gz 2023-11-13T18:43:46.904 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.500976.log 2023-11-13T18:43:46.906 INFO:teuthology.orchestra.run.smithi102.stderr: 78.9% -- replaced with /var/log/ceph/ceph-client.admin.482236.log.gz 2023-11-13T18:43:46.907 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.383402.log 2023-11-13T18:43:46.910 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.477397.log: /var/log/ceph/ceph-client.admin.500976.log: 92.1% -- replaced with /var/log/ceph/ceph-client.admin.500976.log.gz 2023-11-13T18:43:46.910 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44442.log 2023-11-13T18:43:46.912 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47846.log 2023-11-13T18:43:46.914 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.383402.log: /var/log/ceph/ceph-client.admin.44442.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.477406.log 2023-11-13T18:43:46.916 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.47846.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45982.log 2023-11-13T18:43:46.916 INFO:teuthology.orchestra.run.smithi102.stderr: 81.6% -- replaced with /var/log/ceph/ceph-client.admin.175152.log.gz 2023-11-13T18:43:46.919 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.477406.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.308421.log 2023-11-13T18:43:46.921 INFO:teuthology.orchestra.run.smithi102.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.229366.log.gz 2023-11-13T18:43:46.921 INFO:teuthology.orchestra.run.smithi102.stderr: 81.4% -- replaced with /var/log/ceph/ceph-client.admin.476356.log.gz 2023-11-13T18:43:46.921 INFO:teuthology.orchestra.run.smithi102.stderr: 81.5% -- replaced with /var/log/ceph/ceph-client.admin.315516.log.gz 2023-11-13T18:43:46.922 INFO:teuthology.orchestra.run.smithi102.stderr: 81.5% -- replaced with /var/log/ceph/ceph-client.admin.313472.log.gz 2023-11-13T18:43:46.922 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.45982.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.326482.log 2023-11-13T18:43:46.924 INFO:teuthology.orchestra.run.smithi102.stderr:gzip/var/log/ceph/ceph-client.admin.308421.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.100326.log 2023-11-13T18:43:46.927 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.326482.log: 78.4% -- replaced with /var/log/ceph/ceph-client.admin.254481.log.gz 2023-11-13T18:43:46.928 INFO:teuthology.orchestra.run.smithi102.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.299939.log.gz 2023-11-13T18:43:46.928 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.507342.log 2023-11-13T18:43:46.930 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.100326.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.311778.log 2023-11-13T18:43:46.930 INFO:teuthology.orchestra.run.smithi102.stderr: 94.2% -- replaced with /var/log/ceph/ceph-client.admin.499703.log.gz 2023-11-13T18:43:46.931 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.507342.log: 85.9% -- replaced with /var/log/ceph/ceph-client.admin.507342.log.gz 2023-11-13T18:43:46.933 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.479422.log 2023-11-13T18:43:46.934 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.240801.log 2023-11-13T18:43:46.937 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.311778.log: /var/log/ceph/ceph-client.admin.479422.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.488243.log 2023-11-13T18:43:46.939 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.240801.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.220120.log 2023-11-13T18:43:46.941 INFO:teuthology.orchestra.run.smithi102.stderr:gzip/var/log/ceph/ceph-client.admin.488243.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.224579.log 2023-11-13T18:43:46.942 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.220120.log: 81.2% -- replaced with /var/log/ceph/ceph-client.admin.488243.log.gz 2023-11-13T18:43:46.942 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.240006.log 2023-11-13T18:43:46.946 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.224579.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44226.log 2023-11-13T18:43:46.948 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.240006.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.395673.log 2023-11-13T18:43:46.951 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.44226.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.181156.log 2023-11-13T18:43:46.954 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.395673.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.398940.log 2023-11-13T18:43:46.956 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.181156.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.215248.log 2023-11-13T18:43:46.959 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.398940.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.316729.log 2023-11-13T18:43:46.962 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.215248.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.429033.log 2023-11-13T18:43:46.964 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.316729.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.43793.log.gz 2023-11-13T18:43:46.965 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.346189.log 2023-11-13T18:43:46.967 INFO:teuthology.orchestra.run.smithi102.stderr: 93.5% -- replaced with /var/log/ceph/ceph-client.admin.439536.log.gz 2023-11-13T18:43:46.969 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.429033.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.256622.log 2023-11-13T18:43:46.970 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.427364.log 2023-11-13T18:43:46.972 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.346189.log: /var/log/ceph/ceph-client.admin.256622.log: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.457858.log.gz 2023-11-13T18:43:46.973 INFO:teuthology.orchestra.run.smithi102.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.424783.log.gz 2023-11-13T18:43:46.973 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.429846.log 2023-11-13T18:43:46.975 INFO:teuthology.orchestra.run.smithi102.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.45982.log.gz 2023-11-13T18:43:46.975 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.427364.log: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.86505.log.gz 2023-11-13T18:43:46.976 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142924.log 2023-11-13T18:43:46.976 INFO:teuthology.orchestra.run.smithi102.stderr: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.481035.log.gz 2023-11-13T18:43:46.978 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.424371.log 2023-11-13T18:43:46.980 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.429846.log: /var/log/ceph/ceph-client.admin.142924.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.169002.log 2023-11-13T18:43:46.982 INFO:teuthology.orchestra.run.smithi102.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.112167.log.gz 2023-11-13T18:43:46.983 INFO:teuthology.orchestra.run.smithi102.stderr: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.403550.log.gz 2023-11-13T18:43:46.983 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.424371.log: 81.6% -- replaced with /var/log/ceph/ceph-client.admin.440053.log.gz 2023-11-13T18:43:46.984 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.501393.log 2023-11-13T18:43:46.986 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.169002.log: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.449016.log.gz 2023-11-13T18:43:46.987 INFO:teuthology.orchestra.run.smithi102.stderr: 81.3%gzip -- replaced with /var/log/ceph/ceph-client.admin.450692.log.gz 2023-11-13T18:43:46.988 INFO:teuthology.orchestra.run.smithi102.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.209942.log 2023-11-13T18:43:46.988 INFO:teuthology.orchestra.run.smithi102.stderr: 84.3% -- replaced with /var/log/ceph/ceph-client.admin.332100.log.gz 2023-11-13T18:43:46.989 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.501393.log: 83.5% -- replaced with /var/log/ceph/ceph-client.admin.365737.log.gz 2023-11-13T18:43:46.990 INFO:teuthology.orchestra.run.smithi102.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.44442.log.gz 2023-11-13T18:43:46.990 INFO:teuthology.orchestra.run.smithi102.stderr: 79.9% -- replaced with /var/log/ceph/ceph-client.admin.501393.log.gz 2023-11-13T18:43:46.991 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98264.log 2023-11-13T18:43:46.992 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.209942.log: 81.1% -- replaced with /var/log/ceph/ceph-client.admin.427364.log.gz 2023-11-13T18:43:46.993 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.392802.log 2023-11-13T18:43:46.993 INFO:teuthology.orchestra.run.smithi102.stderr: 80.7% -- replaced with /var/log/ceph/ceph-client.admin.429033.log.gz 2023-11-13T18:43:46.995 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.193125.log 2023-11-13T18:43:46.995 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.98264.log: /var/log/ceph/ceph-client.admin.392802.log: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.429846.log.gz 2023-11-13T18:43:46.996 INFO:teuthology.orchestra.run.smithi102.stderr: 80.8% -- replaced with /var/log/ceph/ceph-client.admin.234621.log.gz 2023-11-13T18:43:46.997 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.370119.log 2023-11-13T18:43:46.998 INFO:teuthology.orchestra.run.smithi102.stderr: 90.4% -- replaced with /var/log/ceph/ceph-client.admin.235440.log.gz 2023-11-13T18:43:46.999 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.193125.log: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.479422.log.gz 2023-11-13T18:43:47.000 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.224180.log 2023-11-13T18:43:47.003 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.370119.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46406.log 2023-11-13T18:43:47.005 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.224180.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44223.log 2023-11-13T18:43:47.007 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.431934.log 2023-11-13T18:43:47.010 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.46406.log: /var/log/ceph/ceph-client.admin.44223.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47043.log 2023-11-13T18:43:47.011 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.431934.log: 85.6% -- replaced with /var/log/ceph/ceph-client.admin.92208.log.gz 2023-11-13T18:43:47.012 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.372157.log 2023-11-13T18:43:47.015 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.47043.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46803.log 2023-11-13T18:43:47.017 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.372157.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.345211.log 2023-11-13T18:43:47.019 INFO:teuthology.orchestra.run.smithi102.stderr: 92.2% -- replaced with /var/log/ceph/ceph-client.admin.494946.log.gz 2023-11-13T18:43:47.020 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.46803.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.237475.log 2023-11-13T18:43:47.022 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.200635.log 2023-11-13T18:43:47.023 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.345211.log: /var/log/ceph/ceph-client.admin.237475.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94324.log 2023-11-13T18:43:47.025 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.200635.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.134834.log 2023-11-13T18:43:47.027 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.379141.log 2023-11-13T18:43:47.029 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.94324.log: /var/log/ceph/ceph-client.admin.134834.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.314723.log 2023-11-13T18:43:47.032 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.379141.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.186941.log 2023-11-13T18:43:47.035 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.314723.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.396897.log 2023-11-13T18:43:47.036 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.220550.log 2023-11-13T18:43:47.038 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.396897.log: /var/log/ceph/ceph-client.admin.186941.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.222931.log 2023-11-13T18:43:47.040 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.220550.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.457651.log 2023-11-13T18:43:47.042 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.429042.log 2023-11-13T18:43:47.043 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.222931.log: /var/log/ceph/ceph-client.admin.457651.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.460288.log 2023-11-13T18:43:47.047 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.429042.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.324856.log 2023-11-13T18:43:47.048 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.460288.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.179866.log 2023-11-13T18:43:47.050 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.324856.log: 84.1% -- replaced with /var/log/ceph/ceph-client.admin.131140.log.gz 2023-11-13T18:43:47.051 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.418034.log 2023-11-13T18:43:47.052 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.394457.log 2023-11-13T18:43:47.055 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.179866.log: /var/log/ceph/ceph-client.admin.418034.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.397300.log 2023-11-13T18:43:47.057 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.205689.log 2023-11-13T18:43:47.058 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.394457.log: /var/log/ceph/ceph-client.admin.397300.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.391581.log 2023-11-13T18:43:47.060 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48172.log 2023-11-13T18:43:47.063 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.205689.log: /var/log/ceph/ceph-client.admin.391581.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.418043.log 2023-11-13T18:43:47.065 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.48172.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.454332.log 2023-11-13T18:43:47.068 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.418043.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.238791.log 2023-11-13T18:43:47.070 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.454332.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.232608.log 2023-11-13T18:43:47.072 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.238791.log: 81.3% -- replaced with /var/log/ceph/ceph-client.admin.189756.log.gz 2023-11-13T18:43:47.073 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.228914.log 2023-11-13T18:43:47.075 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.232608.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.186538.log 2023-11-13T18:43:47.075 INFO:teuthology.orchestra.run.smithi102.stderr: 80.3% -- replaced with /var/log/ceph/ceph-client.admin.368237.log.gz 2023-11-13T18:43:47.077 INFO:teuthology.orchestra.run.smithi102.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.299131.log.gz 2023-11-13T18:43:47.078 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.166792.log 2023-11-13T18:43:47.078 INFO:teuthology.orchestra.run.smithi102.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.160063.log.gz 2023-11-13T18:43:47.080 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.228914.log: /var/log/ceph/ceph-client.admin.186538.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.314714.log 2023-11-13T18:43:47.082 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106508.log 2023-11-13T18:43:47.083 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.166792.log: /var/log/ceph/ceph-client.admin.314714.log: 81.3% -- replaced with /var/log/ceph/ceph-client.admin.209942.log.gz 2023-11-13T18:43:47.084 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.364873.log 2023-11-13T18:43:47.086 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.106508.log: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.184930.log.gz 2023-11-13T18:43:47.086 INFO:teuthology.orchestra.run.smithi102.stderr: 81.5% -- replaced with /var/log/ceph/ceph-client.admin.200635.log.gz 2023-11-13T18:43:47.087 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113784.log 2023-11-13T18:43:47.088 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.364873.log: 81.0% -- replaced with /var/log/ceph/ceph-client.admin.326482.log.gz 2023-11-13T18:43:47.090 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.344736.log 2023-11-13T18:43:47.090 INFO:teuthology.orchestra.run.smithi102.stderr: 79.3% -- replaced with /var/log/ceph/ceph-client.admin.193125.log.gz 2023-11-13T18:43:47.092 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.113784.log: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.195173.log.gz 2023-11-13T18:43:47.094 INFO:teuthology.orchestra.run.smithi102.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.308421.log.gz 2023-11-13T18:43:47.094 INFO:teuthology.orchestra.run.smithi102.stderr: 78.5% -- replaced with /var/log/ceph/ceph-client.admin.477397.log.gz 2023-11-13T18:43:47.095 INFO:teuthology.orchestra.run.smithi102.stderr: 81.3% -- replaced with /var/log/ceph/ceph-client.admin.314714.log.gz 2023-11-13T18:43:47.095 INFO:teuthology.orchestra.run.smithi102.stderr: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.477406.log.gz 2023-11-13T18:43:47.095 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.449418.log 2023-11-13T18:43:47.097 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.344736.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.505234.log 2023-11-13T18:43:47.097 INFO:teuthology.orchestra.run.smithi102.stderr: 79.0% -- replaced with /var/log/ceph/ceph-client.admin.181147.log.gz 2023-11-13T18:43:47.098 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.449418.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.193969.log 2023-11-13T18:43:47.101 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.505234.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.451496.log 2023-11-13T18:43:47.102 INFO:teuthology.orchestra.run.smithi102.stderr: 92.0% -- replaced with /var/log/ceph/ceph-client.admin.505234.log.gz 2023-11-13T18:43:47.104 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.198575.log 2023-11-13T18:43:47.106 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.451496.log: /var/log/ceph/ceph-client.admin.193969.log: 91.9% -- replaced with /var/log/ceph/ceph-client.admin.132784.log.gz 2023-11-13T18:43:47.107 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.130687.log 2023-11-13T18:43:47.110 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.198575.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.391572.log 2023-11-13T18:43:47.113 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.130687.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46882.log 2023-11-13T18:43:47.116 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.391572.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.415182.log 2023-11-13T18:43:47.117 INFO:teuthology.orchestra.run.smithi102.stderr: 80.9% -- replaced with /var/log/ceph/ceph-client.admin.425705.log.gz 2023-11-13T18:43:47.119 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.46882.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.341302.log 2023-11-13T18:43:47.120 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.364864.log 2023-11-13T18:43:47.123 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.415182.log: /var/log/ceph/ceph-client.admin.341302.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.498466.log 2023-11-13T18:43:47.126 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.364864.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.217906.log 2023-11-13T18:43:47.129 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.498466.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.43819.log.gz 2023-11-13T18:43:47.130 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.418917.log 2023-11-13T18:43:47.130 INFO:teuthology.orchestra.run.smithi102.stderr: 81.1% -- replaced with /var/log/ceph/ceph-client.admin.498466.log.gz 2023-11-13T18:43:47.131 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.172599.log 2023-11-13T18:43:47.134 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.418917.log: /var/log/ceph/ceph-client.admin.217906.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.456017.log 2023-11-13T18:43:47.135 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.87857.log 2023-11-13T18:43:47.138 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.172599.log: /var/log/ceph/ceph-client.admin.456017.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142675.log 2023-11-13T18:43:47.140 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.87857.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.45826.log.gz 2023-11-13T18:43:47.141 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.379150.log 2023-11-13T18:43:47.142 INFO:teuthology.orchestra.run.smithi102.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.46164.log.gz 2023-11-13T18:43:47.143 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.142675.log: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.418458.log.gz 2023-11-13T18:43:47.144 INFO:teuthology.orchestra.run.smithi102.stderr: 83.8% -- replaced with /var/log/ceph/ceph-client.admin.106508.log.gz 2023-11-13T18:43:47.144 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.479826.log 2023-11-13T18:43:47.146 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.241203.log 2023-11-13T18:43:47.146 INFO:teuthology.orchestra.run.smithi102.stderr: 82.0% -- replaced with /var/log/ceph/ceph-client.admin.87857.log.gz 2023-11-13T18:43:47.147 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.379150.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.388749.log 2023-11-13T18:43:47.149 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.241203.log: /var/log/ceph/ceph-client.admin.479826.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.485890.log 2023-11-13T18:43:47.150 INFO:teuthology.orchestra.run.smithi102.stderr: 93.5% -- replaced with /var/log/ceph/ceph-client.admin.161690.log.gz 2023-11-13T18:43:47.151 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.388749.log: 93.6% -- replaced with /var/log/ceph/ceph-client.admin.162121.log.gz 2023-11-13T18:43:47.151 INFO:teuthology.orchestra.run.smithi102.stderr: 84.1% -- replaced with /var/log/ceph/ceph-client.admin.424371.log.gz 2023-11-13T18:43:47.152 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.229357.log 2023-11-13T18:43:47.154 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.485890.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.338354.log 2023-11-13T18:43:47.155 INFO:teuthology.orchestra.run.smithi102.stderr: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.480230.log.gz 2023-11-13T18:43:47.156 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.229357.log: 85.5% -- replaced with /var/log/ceph/ceph-client.admin.453528.log.gz 2023-11-13T18:43:47.157 INFO:teuthology.orchestra.run.smithi102.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.449418.log.gz 2023-11-13T18:43:47.158 INFO:teuthology.orchestra.run.smithi102.stderr: 81.4% -- replaced with /var/log/ceph/ceph-client.admin.331634.log.gz 2023-11-13T18:43:47.159 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.432400.log 2023-11-13T18:43:47.159 INFO:teuthology.orchestra.run.smithi102.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.460288.log.gz 2023-11-13T18:43:47.159 INFO:teuthology.orchestra.run.smithi102.stderr: 81.6% -- replaced with /var/log/ceph/ceph-client.admin.364864.log.gz 2023-11-13T18:43:47.160 INFO:teuthology.orchestra.run.smithi102.stderr: 82.0% -- replaced with /var/log/ceph/ceph-client.admin.396888.log.gz 2023-11-13T18:43:47.161 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.338354.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.317531.log 2023-11-13T18:43:47.162 INFO:teuthology.orchestra.run.smithi102.stderr: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.364873.log.gz 2023-11-13T18:43:47.163 INFO:teuthology.orchestra.run.smithi102.stderr: 93.6% -- replaced with /var/log/ceph/ceph-client.admin.165960.log.gz 2023-11-13T18:43:47.164 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.432400.log: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.396897.log.gz 2023-11-13T18:43:47.164 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.366579.log 2023-11-13T18:43:47.165 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.317531.log: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.429042.log.gz 2023-11-13T18:43:47.166 INFO:teuthology.orchestra.run.smithi102.stderr: 80.8% -- replaced with /var/log/ceph/ceph-client.admin.386290.log.gz 2023-11-13T18:43:47.166 INFO:teuthology.orchestra.run.smithi102.stderr: 79.4% -- replaced with /var/log/ceph/ceph-client.admin.232599.log.gz 2023-11-13T18:43:47.167 INFO:teuthology.orchestra.run.smithi102.stderr: 77.6% -- replaced with /var/log/ceph/ceph-client.admin.370119.log.gz 2023-11-13T18:43:47.168 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.381423.log 2023-11-13T18:43:47.168 INFO:teuthology.orchestra.run.smithi102.stderr: 77.7% -- replaced with /var/log/ceph/ceph-client.admin.388749.log.gz 2023-11-13T18:43:47.168 INFO:teuthology.orchestra.run.smithi102.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.232608.log.gz 2023-11-13T18:43:47.169 INFO:teuthology.orchestra.run.smithi102.stderr:gzip/var/log/ceph/ceph-client.admin.366579.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.48198.log 2023-11-13T18:43:47.171 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.381423.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47460.log 2023-11-13T18:43:47.173 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.48198.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.456958.log 2023-11-13T18:43:47.173 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.47460.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.44445.log.gz 2023-11-13T18:43:47.176 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.484652.log 2023-11-13T18:43:47.179 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.456958.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.300342.log 2023-11-13T18:43:47.182 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.484652.log: 81.4% -- replaced with /var/log/ceph/ceph-client.admin.344736.log.gz 2023-11-13T18:43:47.182 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100317.log 2023-11-13T18:43:47.185 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose/var/log/ceph/ceph-client.admin.300342.log: -- /var/log/ceph/ceph-client.admin.110945.log 2023-11-13T18:43:47.187 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.100317.log: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.242820.log.gz 2023-11-13T18:43:47.187 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43741.log 2023-11-13T18:43:47.190 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.110945.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43873.log 2023-11-13T18:43:47.192 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.43741.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.179857.log 2023-11-13T18:43:47.194 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.43873.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.204816.log 2023-11-13T18:43:47.197 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.179857.log: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.431934.log.gz 2023-11-13T18:43:47.197 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.198977.log 2023-11-13T18:43:47.199 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.204816.log: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.433828.log.gz 2023-11-13T18:43:47.200 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.444329.log 2023-11-13T18:43:47.203 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.198977.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.229768.log 2023-11-13T18:43:47.204 INFO:teuthology.orchestra.run.smithi102.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.46882.log.gz 2023-11-13T18:43:47.206 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.444329.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.241605.log 2023-11-13T18:43:47.209 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.229768.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.199840.log 2023-11-13T18:43:47.210 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.399333.log 2023-11-13T18:43:47.213 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.241605.log: /var/log/ceph/ceph-client.admin.199840.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.214035.log 2023-11-13T18:43:47.214 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.399333.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.398095.log 2023-11-13T18:43:47.217 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.214035.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.227698.log 2023-11-13T18:43:47.219 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.398095.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.453537.log 2023-11-13T18:43:47.222 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.227698.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.161681.log 2023-11-13T18:43:47.224 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.453537.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.511967.log 2023-11-13T18:43:47.225 INFO:teuthology.orchestra.run.smithi102.stderr: 80.6% -- replaced with /var/log/ceph/ceph-client.admin.179857.log.gz 2023-11-13T18:43:47.227 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.161681.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.209112.log 2023-11-13T18:43:47.228 INFO:teuthology.orchestra.run.smithi102.stderr: 85.4% -- replaced with /var/log/ceph/ceph-client.admin.204816.log.gz 2023-11-13T18:43:47.229 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.511967.log: gzip -5 84.2% --verbose -- replaced with /var/log/ceph/ceph-client.admin.229357.log.gz -- 2023-11-13T18:43:47.229 INFO:teuthology.orchestra.run.smithi102.stderr: /var/log/ceph/ceph-client.admin.384207.log 2023-11-13T18:43:47.230 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.209112.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.511967.log.gz 2023-11-13T18:43:47.232 INFO:teuthology.orchestra.run.smithi102.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.310580.log.gz 2023-11-13T18:43:47.232 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.494683.log 2023-11-13T18:43:47.233 INFO:teuthology.orchestra.run.smithi102.stderr: 81.0% -- replaced with /var/log/ceph/ceph-client.admin.168122.log.gz 2023-11-13T18:43:47.234 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.384207.log: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.300342.log.gz 2023-11-13T18:43:47.234 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46327.log 2023-11-13T18:43:47.236 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.494683.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.431530.log 2023-11-13T18:43:47.239 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.46327.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.176415.log 2023-11-13T18:43:47.241 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47564.log 2023-11-13T18:43:47.242 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.431530.log: 91.5% -- replaced with /var/log/ceph/ceph-client.admin.494683.log.gz 2023-11-13T18:43:47.244 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.176415.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.230980.log 2023-11-13T18:43:47.247 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.47564.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.213622.log 2023-11-13T18:43:47.249 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.230980.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.396490.log 2023-11-13T18:43:47.252 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.213622.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.479817.log 2023-11-13T18:43:47.255 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.396490.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.486717.log 2023-11-13T18:43:47.256 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.479817.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.334623.log 2023-11-13T18:43:47.260 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.486717.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93921.log 2023-11-13T18:43:47.262 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.334623.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.508645.log 2023-11-13T18:43:47.264 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.478202.log 2023-11-13T18:43:47.266 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.93921.log: /var/log/ceph/ceph-client.admin.508645.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.321622.log 2023-11-13T18:43:47.267 INFO:teuthology.orchestra.run.smithi102.stderr: 92.0% -- replaced with /var/log/ceph/ceph-client.admin.508645.log.gz 2023-11-13T18:43:47.267 INFO:teuthology.orchestra.run.smithi102.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.46327.log.gz 2023-11-13T18:43:47.268 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.478202.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.46567.log.gz 2023-11-13T18:43:47.269 INFO:teuthology.orchestra.run.smithi102.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.47095.log.gz 2023-11-13T18:43:47.269 INFO:teuthology.orchestra.run.smithi102.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.47460.log.gz 2023-11-13T18:43:47.270 INFO:teuthology.orchestra.run.smithi102.stderr: 84.2% -- replaced with /var/log/ceph/ceph-client.admin.113784.log.gz 2023-11-13T18:43:47.270 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.197771.log 2023-11-13T18:43:47.271 INFO:teuthology.orchestra.run.smithi102.stderr: 79.6% -- replaced with /var/log/ceph/ceph-client.admin.100317.log.gz 2023-11-13T18:43:47.272 INFO:teuthology.orchestra.run.smithi102.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.44223.log.gz 2023-11-13T18:43:47.273 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose/var/log/ceph/ceph-client.admin.321622.log: -- /var/log/ceph/ceph-client.admin.338756.log 2023-11-13T18:43:47.273 INFO:teuthology.orchestra.run.smithi102.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.47564.log.gz 2023-11-13T18:43:47.274 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.197771.log: 85.6% -- replaced with /var/log/ceph/ceph-client.admin.101563.log.gz 2023-11-13T18:43:47.276 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.502253.log 2023-11-13T18:43:47.277 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.233418.log 2023-11-13T18:43:47.280 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.338756.log: /var/log/ceph/ceph-client.admin.502253.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.88720.log 2023-11-13T18:43:47.280 INFO:teuthology.orchestra.run.smithi102.stderr: 92.2% -- replaced with /var/log/ceph/ceph-client.admin.502253.log.gz 2023-11-13T18:43:47.281 INFO:teuthology.orchestra.run.smithi102.stderr: 86.0% -- replaced with /var/log/ceph/ceph-client.admin.453119.log.gz 2023-11-13T18:43:47.282 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.233418.log: 85.4% -- replaced with /var/log/ceph/ceph-client.admin.454332.log.gz 2023-11-13T18:43:47.282 INFO:teuthology.orchestra.run.smithi102.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.444329.log.gz 2023-11-13T18:43:47.283 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.317130.log 2023-11-13T18:43:47.284 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.88720.log: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.453537.log.gz 2023-11-13T18:43:47.285 INFO:teuthology.orchestra.run.smithi102.stderr: 81.0% -- replaced with /var/log/ceph/ceph-client.admin.484652.log.gz 2023-11-13T18:43:47.286 INFO:teuthology.orchestra.run.smithi102.stderr: 84.2% -- replaced with /var/log/ceph/ceph-client.admin.338354.log.gz 2023-11-13T18:43:47.286 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.387941.log 2023-11-13T18:43:47.289 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.317130.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.495561.log 2023-11-13T18:43:47.290 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47486.log 2023-11-13T18:43:47.291 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.387941.log: /var/log/ceph/ceph-client.admin.495561.log: 84.9% -- replaced with /var/log/ceph/ceph-client.admin.495561.log.gz 2023-11-13T18:43:47.293 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.416793.log 2023-11-13T18:43:47.294 INFO:teuthology.orchestra.run.smithi102.stderr: 80.6% -- replaced with /var/log/ceph/ceph-client.admin.399333.log.gz 2023-11-13T18:43:47.295 INFO:teuthology.orchestra.run.smithi102.stderr: 77.4%gzip -- replaced with /var/log/ceph/ceph-client.admin.478202.log.gz 2023-11-13T18:43:47.295 INFO:teuthology.orchestra.run.smithi102.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.214835.log 2023-11-13T18:43:47.296 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.47486.log: /var/log/ceph/ceph-client.admin.416793.log: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.432400.log.gz 2023-11-13T18:43:47.296 INFO:teuthology.orchestra.run.smithi102.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.431530.log.gz 2023-11-13T18:43:47.298 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.225844.log 2023-11-13T18:43:47.299 INFO:teuthology.orchestra.run.smithi102.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.317130.log.gz 2023-11-13T18:43:47.300 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.214835.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.161289.log 2023-11-13T18:43:47.303 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.225844.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.370923.log 2023-11-13T18:43:47.305 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.401942.log 2023-11-13T18:43:47.308 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.161289.log: /var/log/ceph/ceph-client.admin.370923.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.483050.log 2023-11-13T18:43:47.309 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.401942.log: 81.2% -- replaced with /var/log/ceph/ceph-client.admin.416793.log.gz 2023-11-13T18:43:47.310 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.493792.log 2023-11-13T18:43:47.311 INFO:teuthology.orchestra.run.smithi102.stderr: 85.3% -- replaced with /var/log/ceph/ceph-client.admin.418034.log.gz 2023-11-13T18:43:47.312 INFO:teuthology.orchestra.run.smithi102.stderr: 84.0% -- replaced with /var/log/ceph/ceph-client.admin.209112.log.gz 2023-11-13T18:43:47.313 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.483050.log: 80.8% -- replaced with /var/log/ceph/ceph-client.admin.387941.log.gz 90.2% 2023-11-13T18:43:47.314 INFO:teuthology.orchestra.run.smithi102.stderr: -- replaced with /var/log/ceph/ceph-client.admin.305997.log.gz 2023-11-13T18:43:47.314 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46671.log 2023-11-13T18:43:47.314 INFO:teuthology.orchestra.run.smithi102.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.233418.log.gz 2023-11-13T18:43:47.316 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.493792.log: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.493792.log.gz 2023-11-13T18:43:47.316 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109737.log 2023-11-13T18:43:47.318 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.46671.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.495153.log 2023-11-13T18:43:47.319 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.109737.log: 81.1% -- replaced with /var/log/ceph/ceph-client.admin.142924.log.gz 2023-11-13T18:43:47.321 INFO:teuthology.orchestra.run.smithi102.stderr: 81.0% -- replaced with /var/log/ceph/ceph-client.admin.243214.log.gz 2023-11-13T18:43:47.322 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.189360.log 2023-11-13T18:43:47.323 INFO:teuthology.orchestra.run.smithi102.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.423977.log.gz 2023-11-13T18:43:47.324 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.495153.log: gzip -5 --verbose -- /var/log/ceph/ceph.log 2023-11-13T18:43:47.325 INFO:teuthology.orchestra.run.smithi102.stderr: 85.6% -- replaced with /var/log/ceph/ceph-client.admin.161681.log.gz 2023-11-13T18:43:47.325 INFO:teuthology.orchestra.run.smithi102.stderr: 83.7% -- replaced with /var/log/ceph/ceph-client.admin.495153.log.gz 2023-11-13T18:43:47.326 INFO:teuthology.orchestra.run.smithi102.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.207911.log.gz 2023-11-13T18:43:47.327 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.189360.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111358.log 2023-11-13T18:43:47.328 INFO:teuthology.orchestra.run.smithi102.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.186538.log.gz 2023-11-13T18:43:47.328 INFO:teuthology.orchestra.run.smithi102.stderr: 92.7% -- replaced with /var/log/ceph/ceph-client.admin.366579.log.gz 2023-11-13T18:43:47.329 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47434.log 2023-11-13T18:43:47.330 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph.log: /var/log/ceph/ceph-client.admin.111358.log: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.185734.log.gz 2023-11-13T18:43:47.330 INFO:teuthology.orchestra.run.smithi102.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.237475.log.gz 2023-11-13T18:43:47.331 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.134843.log 2023-11-13T18:43:47.333 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.47434.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101161.log 2023-11-13T18:43:47.336 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.134843.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.485467.log 2023-11-13T18:43:47.339 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.101161.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.171709.log 2023-11-13T18:43:47.340 INFO:teuthology.orchestra.run.smithi102.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.133219.log.gz 2023-11-13T18:43:47.342 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.485467.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.384630.log 2023-11-13T18:43:47.346 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.171709.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.307218.log 2023-11-13T18:43:47.347 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.448161.log 2023-11-13T18:43:47.348 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.384630.log: /var/log/ceph/ceph-client.admin.307218.log: 81.5% -- replaced with /var/log/ceph/ceph-client.admin.384207.log.gz 2023-11-13T18:43:47.349 INFO:teuthology.orchestra.run.smithi102.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.317531.log.gz 2023-11-13T18:43:47.350 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.447296.log 2023-11-13T18:43:47.352 INFO:teuthology.orchestra.run.smithi102.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.246513.log.gz 2023-11-13T18:43:47.354 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.448161.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.339961.log 2023-11-13T18:43:47.355 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.165530.log 2023-11-13T18:43:47.356 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.447296.log: /var/log/ceph/ceph-client.admin.339961.log: 80.8% -- replaced with /var/log/ceph/ceph-client.admin.214835.log.gz 2023-11-13T18:43:47.358 INFO:teuthology.orchestra.run.smithi102.stderr: 81.3% -- replaced with /var/log/ceph/ceph-client.admin.338756.log.gz 2023-11-13T18:43:47.358 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.389563.log 2023-11-13T18:43:47.359 INFO:teuthology.orchestra.run.smithi102.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.341302.log.gz 2023-11-13T18:43:47.361 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.165530.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.466266.log 2023-11-13T18:43:47.362 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46541.log 2023-11-13T18:43:47.365 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.389563.log: /var/log/ceph/ceph-client.admin.466266.log: 92.1% -- replaced with /var/log/ceph/ceph-client.admin.379150.log.gz 2023-11-13T18:43:47.366 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.439122.log 2023-11-13T18:43:47.366 INFO:teuthology.orchestra.run.smithi102.stderr: 93.0% -- replaced with /var/log/ceph/ceph-client.admin.394457.log.gz 2023-11-13T18:43:47.367 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.187343.log 2023-11-13T18:43:47.368 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.46541.log: /var/log/ceph/ceph-client.admin.439122.log: 78.1% -- replaced with /var/log/ceph/ceph-client.admin.321622.log.gz 2023-11-13T18:43:47.369 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.220541.log 2023-11-13T18:43:47.371 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.187343.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115944.log 2023-11-13T18:43:47.373 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.220541.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.201046.log 2023-11-13T18:43:47.376 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44429.log 2023-11-13T18:43:47.377 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.115944.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.257024.log 2023-11-13T18:43:47.378 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.44429.log: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.161289.log.gz 2023-11-13T18:43:47.380 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.201046.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.317121.log 2023-11-13T18:43:47.382 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.257024.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.511122.log 2023-11-13T18:43:47.384 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.317121.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.486304.log 2023-11-13T18:43:47.386 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.511122.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.456026.log 2023-11-13T18:43:47.387 INFO:teuthology.orchestra.run.smithi102.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.511122.log.gz 2023-11-13T18:43:47.388 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.511304.log 2023-11-13T18:43:47.390 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.486304.log: /var/log/ceph/ceph-client.admin.456026.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.254490.log 2023-11-13T18:43:47.391 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.511304.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.511304.log.gz 2023-11-13T18:43:47.392 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.332977.log 2023-11-13T18:43:47.394 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.254490.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.314309.log 2023-11-13T18:43:47.397 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.332977.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.190978.log 2023-11-13T18:43:47.399 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.400151.log 2023-11-13T18:43:47.400 INFO:teuthology.orchestra.run.smithi102.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.189360.log.gz 2023-11-13T18:43:47.400 INFO:teuthology.orchestra.run.smithi102.stderr: 90.1%/var/log/ceph/ceph-client.admin.314309.log: -- replaced with /var/log/ceph/ceph-client.admin.401942.log.gz 2023-11-13T18:43:47.401 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.190978.log: 82.0% -- replaced with /var/log/ceph/ceph-client.admin.217906.log.gz 2023-11-13T18:43:47.402 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.317925.log 2023-11-13T18:43:47.403 INFO:teuthology.orchestra.run.smithi102.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.224180.log.gz 2023-11-13T18:43:47.404 INFO:teuthology.orchestra.run.smithi102.stderr: 79.5% -- replaced with /var/log/ceph/ceph-client.admin.225844.log.gz 2023-11-13T18:43:47.404 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.400151.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.384216.log 2023-11-13T18:43:47.407 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.317925.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.46541.log.gz 2023-11-13T18:43:47.407 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.252770.log 2023-11-13T18:43:47.410 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.384216.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102406.log 2023-11-13T18:43:47.410 INFO:teuthology.orchestra.run.smithi102.stderr: 93.5% -- replaced with /var/log/ceph/ceph-client.admin.181586.log.gz 2023-11-13T18:43:47.411 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.324059.log 2023-11-13T18:43:47.413 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.102406.log: /var/log/ceph/ceph-client.admin.252770.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.401530.log 2023-11-13T18:43:47.415 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.324059.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.329403.log 2023-11-13T18:43:47.418 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.401530.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.407870.log 2023-11-13T18:43:47.418 INFO:teuthology.orchestra.run.smithi102.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.47043.log.gz 2023-11-13T18:43:47.419 INFO:teuthology.orchestra.run.smithi102.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.47434.log.gz 2023-11-13T18:43:47.419 INFO:teuthology.orchestra.run.smithi102.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.47225.log.gz 2023-11-13T18:43:47.420 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.325267.log 2023-11-13T18:43:47.420 INFO:teuthology.orchestra.run.smithi102.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.44429.log.gz 2023-11-13T18:43:47.421 INFO:teuthology.orchestra.run.smithi102.stderr: 88.9% -- replaced with /var/log/ceph/ceph.log.gz 2023-11-13T18:43:47.422 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.407870.log: /var/log/ceph/ceph-client.admin.329403.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.372993.log 2023-11-13T18:43:47.424 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.325267.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.208709.log 2023-11-13T18:43:47.426 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.372993.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48224.log 2023-11-13T18:43:47.428 INFO:teuthology.orchestra.run.smithi102.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.111358.log.gz 2023-11-13T18:43:47.429 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.159652.log 2023-11-13T18:43:47.431 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.208709.log: /var/log/ceph/ceph-client.admin.48224.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142933.log 2023-11-13T18:43:47.433 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.159652.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.324454.log 2023-11-13T18:43:47.435 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.142933.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.304778.log 2023-11-13T18:43:47.438 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.440629.log 2023-11-13T18:43:47.440 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.324454.log: /var/log/ceph/ceph-client.admin.304778.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47173.log 2023-11-13T18:43:47.442 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.440629.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.253587.log 2023-11-13T18:43:47.445 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.47173.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.424380.log 2023-11-13T18:43:47.446 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.234630.log 2023-11-13T18:43:47.448 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.253587.log: /var/log/ceph/ceph-client.admin.424380.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48250.log 2023-11-13T18:43:47.450 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.234630.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.307619.log 2023-11-13T18:43:47.452 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.48250.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.441040.log 2023-11-13T18:43:47.453 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.307619.log: 84.2% -- replaced with /var/log/ceph/ceph-client.admin.459875.log.gz 2023-11-13T18:43:47.455 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.242418.log 2023-11-13T18:43:47.456 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.441040.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.172590.log 2023-11-13T18:43:47.457 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.242418.log: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.447296.log.gz 2023-11-13T18:43:47.460 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.423968.log 2023-11-13T18:43:47.461 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.172590.log: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.479826.log.gz 2023-11-13T18:43:47.463 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103212.log 2023-11-13T18:43:47.466 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.423968.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.371750.log 2023-11-13T18:43:47.466 INFO:teuthology.orchestra.run.smithi102.stderr: 85.2% -- replaced with /var/log/ceph/ceph-client.admin.339961.log.gz 2023-11-13T18:43:47.467 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.103212.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.331643.log 2023-11-13T18:43:47.468 INFO:teuthology.orchestra.run.smithi102.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.332977.log.gz 2023-11-13T18:43:47.469 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.371750.log: 90.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104862.log 2023-11-13T18:43:47.470 INFO:teuthology.orchestra.run.smithi102.stderr: -- replaced with /var/log/ceph/ceph-client.admin.397300.log.gz 2023-11-13T18:43:47.470 INFO:teuthology.orchestra.run.smithi102.stderr: 77.7% -- replaced with /var/log/ceph/ceph-client.admin.171700.log.gz 2023-11-13T18:43:47.471 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.331643.log: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.432887.log.gz 2023-11-13T18:43:47.472 INFO:teuthology.orchestra.run.smithi102.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.171709.log.gz 2023-11-13T18:43:47.473 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.402343.log 2023-11-13T18:43:47.475 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.104862.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.491683.log 2023-11-13T18:43:47.477 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.402343.log: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.307218.log.gz 2023-11-13T18:43:47.477 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46619.log 2023-11-13T18:43:47.481 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.491683.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.446417.log 2023-11-13T18:43:47.481 INFO:teuthology.orchestra.run.smithi102.stderr: 84.2% -- replaced with /var/log/ceph/ceph-client.admin.491683.log.gz 2023-11-13T18:43:47.481 INFO:teuthology.orchestra.run.smithi102.stderr: 81.3% -- replaced with /var/log/ceph/ceph-client.admin.172590.log.gz 2023-11-13T18:43:47.481 INFO:teuthology.orchestra.run.smithi102.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.307619.log.gz 2023-11-13T18:43:47.482 INFO:teuthology.orchestra.run.smithi102.stderr: 81.4% -- replaced with /var/log/ceph/ceph-client.admin.370522.log.gz 2023-11-13T18:43:47.483 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.46619.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.187334.log 2023-11-13T18:43:47.485 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.446417.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47069.log 2023-11-13T18:43:47.487 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.187334.log: 85.3% -- replaced with /var/log/ceph/ceph-client.admin.423968.log.gz 2023-11-13T18:43:47.488 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46008.log 2023-11-13T18:43:47.489 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.503524.log 2023-11-13T18:43:47.491 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.46008.log: /var/log/ceph/ceph-client.admin.47069.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.454341.log 2023-11-13T18:43:47.493 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.503524.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.205257.log 2023-11-13T18:43:47.494 INFO:teuthology.orchestra.run.smithi102.stderr: 81.3% -- replaced with /var/log/ceph/ceph-client.admin.503524.log.gz 2023-11-13T18:43:47.496 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.454341.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.377029.log 2023-11-13T18:43:47.498 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.205257.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.184126.log 2023-11-13T18:43:47.500 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.377029.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.444731.log 2023-11-13T18:43:47.502 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.184126.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.175591.log 2023-11-13T18:43:47.505 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.444731.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43845.log 2023-11-13T18:43:47.506 INFO:teuthology.orchestra.run.smithi102.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.384216.log.gz 2023-11-13T18:43:47.507 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.175591.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.507775.log 2023-11-13T18:43:47.507 INFO:teuthology.orchestra.run.smithi102.stderr: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.317925.log.gz 2023-11-13T18:43:47.509 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.43845.log: 85.3% -- replaced with /var/log/ceph/ceph-client.admin.371750.log.gz 2023-11-13T18:43:47.510 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44656.log 2023-11-13T18:43:47.510 INFO:teuthology.orchestra.run.smithi102.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.214035.log.gz 2023-11-13T18:43:47.511 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.507775.log: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.175591.log.gz 2023-11-13T18:43:47.511 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.203060.log 2023-11-13T18:43:47.514 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.225393.log 2023-11-13T18:43:47.515 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.44656.log: 80.8% -- replaced with /var/log/ceph/ceph-client.admin.220541.log.gz 2023-11-13T18:43:47.516 INFO:teuthology.orchestra.run.smithi102.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.142933.log.gz 2023-11-13T18:43:47.516 INFO:teuthology.orchestra.run.smithi102.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.417619.log.gz 2023-11-13T18:43:47.516 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.203060.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.455224.log 2023-11-13T18:43:47.519 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.225393.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.313874.log 2023-11-13T18:43:47.520 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.455224.log: 92.2% -- replaced with /var/log/ceph/ceph-client.admin.507775.log.gz 2023-11-13T18:43:47.521 INFO:teuthology.orchestra.run.smithi102.stderr: 81.2% -- replaced with /var/log/ceph/ceph-client.admin.401530.log.gz 2023-11-13T18:43:47.522 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106914.log 2023-11-13T18:43:47.524 INFO:teuthology.orchestra.run.smithi102.stderr: 81.2% -- replaced with /var/log/ceph/ceph-client.admin.109737.log.gz 2023-11-13T18:43:47.524 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48032.log 2023-11-13T18:43:47.527 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.313874.log: /var/log/ceph/ceph-client.admin.106914.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.439527.log 2023-11-13T18:43:47.527 INFO:teuthology.orchestra.run.smithi102.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.134843.log.gz 2023-11-13T18:43:47.529 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.48032.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.325670.log 2023-11-13T18:43:47.530 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.439527.log: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.102406.log.gz 2023-11-13T18:43:47.531 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93063.log 2023-11-13T18:43:47.534 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.325670.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.404788.log 2023-11-13T18:43:47.535 INFO:teuthology.orchestra.run.smithi102.stderr: 85.7% -- replaced with /var/log/ceph/ceph-client.admin.197771.log.gz 2023-11-13T18:43:47.536 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.93063.log: 81.4% -- replaced with /var/log/ceph/ceph-client.admin.198575.log.gz 2023-11-13T18:43:47.538 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.216114.log 2023-11-13T18:43:47.538 INFO:teuthology.orchestra.run.smithi102.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.234630.log.gz 2023-11-13T18:43:47.540 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.404788.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107321.log 2023-11-13T18:43:47.542 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.216114.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.457867.log 2023-11-13T18:43:47.545 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.107321.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.346180.log 2023-11-13T18:43:47.548 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.457867.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.511811.log 2023-11-13T18:43:47.551 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.346180.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100739.log 2023-11-13T18:43:47.553 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.511811.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.399735.log 2023-11-13T18:43:47.554 INFO:teuthology.orchestra.run.smithi102.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.511811.log.gz 2023-11-13T18:43:47.556 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.100739.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.407075.log 2023-11-13T18:43:47.557 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose --/var/log/ceph/ceph-client.admin.399735.log: /var/log/ceph/ceph-client.admin.344310.log 2023-11-13T18:43:47.561 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.407075.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.243617.log 2023-11-13T18:43:47.562 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.45408.log 2023-11-13T18:43:47.565 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.344310.log: /var/log/ceph/ceph-client.admin.243617.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.419853.log 2023-11-13T18:43:47.566 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.502244.log 2023-11-13T18:43:47.568 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.0.45408.log: /var/log/ceph/ceph-client.admin.419853.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.488252.log 2023-11-13T18:43:47.568 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.502244.log: 85.1% -- replaced with /var/log/ceph/ceph-client.admin.502244.log.gz 2023-11-13T18:43:47.570 INFO:teuthology.orchestra.run.smithi102.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.329403.log.gz 2023-11-13T18:43:47.570 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108932.log 2023-11-13T18:43:47.572 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.488252.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.47486.log.gz 2023-11-13T18:43:47.573 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.86514.log 2023-11-13T18:43:47.574 INFO:teuthology.orchestra.run.smithi102.stderr: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.488252.log.gz 2023-11-13T18:43:47.575 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.108932.log: 79.4% -- replaced with /var/log/ceph/ceph-client.admin.439122.log.gz 2023-11-13T18:43:47.575 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45878.log 2023-11-13T18:43:47.578 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.86514.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46432.log 2023-11-13T18:43:47.580 INFO:teuthology.orchestra.run.smithi102.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.46619.log.gz 2023-11-13T18:43:47.581 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.45878.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.43741.log.gz 2023-11-13T18:43:47.581 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.182017.log 2023-11-13T18:43:47.582 INFO:teuthology.orchestra.run.smithi102.stderr: 93.4% -- replaced with /var/log/ceph/ceph-client.admin.190978.log.gz 2023-11-13T18:43:47.582 INFO:teuthology.orchestra.run.smithi102.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.43845.log.gz 2023-11-13T18:43:47.583 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.476599.log 2023-11-13T18:43:47.584 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.182017.log: /var/log/ceph/ceph-client.admin.46432.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.45878.log.gz 2023-11-13T18:43:47.586 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.164687.log 2023-11-13T18:43:47.588 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.476599.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.185332.log 2023-11-13T18:43:47.590 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.164687.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.89997.log 2023-11-13T18:43:47.592 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.185332.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.401933.log 2023-11-13T18:43:47.594 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.89997.log: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.455224.log.gz 2023-11-13T18:43:47.594 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112571.log 2023-11-13T18:43:47.596 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.401933.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.334614.log 2023-11-13T18:43:47.598 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.112571.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.173436.log 2023-11-13T18:43:47.599 INFO:teuthology.orchestra.run.smithi102.stderr: 90.1% 85.4% -- replaced with /var/log/ceph/ceph-client.admin.103212.log.gz -- replaced with /var/log/ceph/ceph-client.admin.108932.log.gz 2023-11-13T18:43:47.599 INFO:teuthology.orchestra.run.smithi102.stderr: 2023-11-13T18:43:47.600 INFO:teuthology.orchestra.run.smithi102.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.44656.log.gz 2023-11-13T18:43:47.600 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.334614.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.377886.log 2023-11-13T18:43:47.602 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.173436.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120542.log 2023-11-13T18:43:47.604 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.377886.log: 91.4% -- replaced with /var/log/ceph/ceph-client.admin.457651.log.gz 2023-11-13T18:43:47.605 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45149.log 2023-11-13T18:43:47.605 INFO:teuthology.orchestra.run.smithi102.stderr: 82.0% -- replaced with /var/log/ceph/ceph-client.admin.85514.log.gz 2023-11-13T18:43:47.606 INFO:teuthology.orchestra.run.smithi102.stderr: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.404788.log.gz 2023-11-13T18:43:47.607 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.322834.log 2023-11-13T18:43:47.607 INFO:teuthology.orchestra.run.smithi102.stderr: 77.7% -- replaced with /var/log/ceph/ceph-client.admin.439527.log.gz 2023-11-13T18:43:47.608 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.120542.log: /var/log/ceph/ceph-client.admin.45149.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.209548.log 2023-11-13T18:43:47.610 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.322834.log: 81.2% -- replaced with /var/log/ceph/ceph-client.admin.334614.log.gz 2023-11-13T18:43:47.611 INFO:teuthology.orchestra.run.smithi102.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.331643.log.gz 2023-11-13T18:43:47.611 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.393220.log 2023-11-13T18:43:47.612 INFO:teuthology.orchestra.run.smithi102.stderr: 77.7% -- replaced with /var/log/ceph/ceph-client.admin.398095.log.gz 2023-11-13T18:43:47.613 INFO:teuthology.orchestra.run.smithi102.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.334623.log.gz 2023-11-13T18:43:47.614 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.207902.log 2023-11-13T18:43:47.616 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.209548.log: /var/log/ceph/ceph-client.admin.393220.log: 80.7% -- replaced with /var/log/ceph/ceph-client.admin.399735.log.gz 2023-11-13T18:43:47.616 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46354.log 2023-11-13T18:43:47.618 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.207902.log: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.402343.log.gz 2023-11-13T18:43:47.619 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45449.log 2023-11-13T18:43:47.620 INFO:teuthology.orchestra.run.smithi102.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.302766.log.gz 2023-11-13T18:43:47.620 INFO:teuthology.orchestra.run.smithi102.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.48224.log.gz 2023-11-13T18:43:47.621 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.46354.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.48250.log.gz 2023-11-13T18:43:47.622 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.312668.log 2023-11-13T18:43:47.624 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47794.log 2023-11-13T18:43:47.625 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.45449.log: /var/log/ceph/ceph-client.admin.312668.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45045.log 2023-11-13T18:43:47.627 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.47794.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.492130.log 2023-11-13T18:43:47.630 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.45045.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.473817.log 2023-11-13T18:43:47.630 INFO:teuthology.orchestra.run.smithi102.stderr: 81.4%/var/log/ceph/ceph-client.admin.492130.log: -- replaced with /var/log/ceph/ceph-client.admin.377886.log.gz 2023-11-13T18:43:47.632 INFO:teuthology.orchestra.run.smithi102.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.492130.log.gz 2023-11-13T18:43:47.633 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.207500.log 2023-11-13T18:43:47.637 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.473817.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.167226.log 2023-11-13T18:43:47.640 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.207500.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.180717.log 2023-11-13T18:43:47.641 INFO:teuthology.orchestra.run.smithi102.stderr: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.325670.log.gz 2023-11-13T18:43:47.642 INFO:teuthology.orchestra.run.smithi154.stderr: 95.5% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2023-11-13T18:43:47.643 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.167226.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.390762.log 2023-11-13T18:43:47.643 INFO:teuthology.orchestra.run.smithi102.stderr: 78.7% -- replaced with /var/log/ceph/ceph-client.admin.322834.log.gz 2023-11-13T18:43:47.645 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.180717.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46697.log 2023-11-13T18:43:47.648 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.390762.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.417195.log 2023-11-13T18:43:47.651 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.46697.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117210.log 2023-11-13T18:43:47.654 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.417195.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.86112.log 2023-11-13T18:43:47.656 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.117210.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115092.log 2023-11-13T18:43:47.658 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.511551.log 2023-11-13T18:43:47.660 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.86112.log: /var/log/ceph/ceph-client.admin.115092.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47330.log 2023-11-13T18:43:47.663 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.511551.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.207097.log 2023-11-13T18:43:47.664 INFO:teuthology.orchestra.run.smithi102.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.511551.log.gz 2023-11-13T18:43:47.664 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.246907.log 2023-11-13T18:43:47.666 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.207097.log: /var/log/ceph/ceph-client.admin.47330.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.472601.log 2023-11-13T18:43:47.668 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.246907.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.512045.log 2023-11-13T18:43:47.670 INFO:teuthology.orchestra.run.smithi102.stderr: 81.6% -- replaced with /var/log/ceph/ceph-client.admin.180717.log.gz 2023-11-13T18:43:47.670 INFO:teuthology.orchestra.run.smithi102.stderr: 81.4% -- replaced with /var/log/ceph/ceph-client.admin.164687.log.gz 2023-11-13T18:43:47.671 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.174731.log 2023-11-13T18:43:47.671 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.472601.log: 81.0% -- replaced with /var/log/ceph/ceph-client.admin.207097.log.gz 2023-11-13T18:43:47.672 INFO:teuthology.orchestra.run.smithi102.stderr: 80.8% -- replaced with /var/log/ceph/ceph-client.admin.313874.log.gz 2023-11-13T18:43:47.673 INFO:teuthology.orchestra.run.smithi102.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.314723.log.gz 2023-11-13T18:43:47.673 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.512045.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.387950.log 2023-11-13T18:43:47.674 INFO:teuthology.orchestra.run.smithi102.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.512045.log.gz 2023-11-13T18:43:47.675 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.174731.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.471327.log 2023-11-13T18:43:47.677 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.387950.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.478613.log 2023-11-13T18:43:47.679 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.471327.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.239193.log 2023-11-13T18:43:47.681 INFO:teuthology.orchestra.run.smithi102.stderr: 84.8% -- replaced with /var/log/ceph/ceph-client.admin.207902.log.gz 2023-11-13T18:43:47.682 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141163.log 2023-11-13T18:43:47.684 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.478613.log: /var/log/ceph/ceph-client.admin.239193.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142684.log 2023-11-13T18:43:47.684 INFO:teuthology.orchestra.run.smithi102.stderr: 86.2% -- replaced with /var/log/ceph/ceph-client.admin.407870.log.gz 2023-11-13T18:43:47.685 INFO:teuthology.orchestra.run.smithi102.stderr: 81.1% -- replaced with /var/log/ceph/ceph-client.admin.456017.log.gz 2023-11-13T18:43:47.686 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.141163.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.434296.log 2023-11-13T18:43:47.687 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.400892.log 2023-11-13T18:43:47.688 INFO:teuthology.orchestra.run.smithi102.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.456026.log.gz 2023-11-13T18:43:47.689 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.434296.log: /var/log/ceph/ceph-client.admin.142684.log: 80.5% -- replaced with /var/log/ceph/ceph-client.admin.227698.log.gz 2023-11-13T18:43:47.690 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.487406.log 2023-11-13T18:43:47.690 INFO:teuthology.orchestra.run.smithi102.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.209548.log.gz 2023-11-13T18:43:47.693 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.400892.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.379580.log 2023-11-13T18:43:47.693 INFO:teuthology.orchestra.run.smithi102.stderr: 81.2% -- replaced with /var/log/ceph/ceph-client.admin.208709.log.gz 2023-11-13T18:43:47.694 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.487406.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.483846.log 2023-11-13T18:43:47.695 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.379580.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.46354.log.gz 2023-11-13T18:43:47.696 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.321158.log 2023-11-13T18:43:47.697 INFO:teuthology.orchestra.run.smithi102.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.46432.log.gz 2023-11-13T18:43:47.697 INFO:teuthology.orchestra.run.smithi102.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.316729.log.gz 2023-11-13T18:43:47.697 INFO:teuthology.orchestra.run.smithi102.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.487406.log.gz 2023-11-13T18:43:47.698 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.483846.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.381159.log 2023-11-13T18:43:47.700 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.321158.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.421521.log 2023-11-13T18:43:47.703 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.381159.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.237877.log 2023-11-13T18:43:47.704 INFO:teuthology.orchestra.run.smithi102.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.47794.log.gz 2023-11-13T18:43:47.705 INFO:teuthology.orchestra.run.smithi102.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.45449.log.gz 2023-11-13T18:43:47.706 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.397693.log 2023-11-13T18:43:47.707 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.421521.log: /var/log/ceph/ceph-client.admin.237877.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.173427.log 2023-11-13T18:43:47.710 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.397693.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140680.log 2023-11-13T18:43:47.711 INFO:teuthology.orchestra.run.smithi102.stderr: 80.7% -- replaced with /var/log/ceph/ceph-client.admin.447689.log.gz 2023-11-13T18:43:47.711 INFO:teuthology.orchestra.run.smithi102.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.478613.log.gz 2023-11-13T18:43:47.713 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.173427.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.424774.log 2023-11-13T18:43:47.716 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.140680.log: 92.7% -- replaced with /var/log/ceph/ceph-client.admin.100326.log.gz 2023-11-13T18:43:47.716 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.485881.log 2023-11-13T18:43:47.716 INFO:teuthology.orchestra.run.smithi102.stderr: 77.6% -- replaced with /var/log/ceph/ceph-client.admin.397693.log.gz 2023-11-13T18:43:47.717 INFO:teuthology.orchestra.run.smithi102.stderr: 86.1% -- replaced with /var/log/ceph/ceph-client.admin.431107.log.gz 2023-11-13T18:43:47.720 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.424774.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.371334.log 2023-11-13T18:43:47.720 INFO:teuthology.orchestra.run.smithi102.stderr: 80.8% -- replaced with /var/log/ceph/ceph-client.admin.321158.log.gz 2023-11-13T18:43:47.723 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.485881.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.443525.log 2023-11-13T18:43:47.726 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.371334.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.335878.log 2023-11-13T18:43:47.728 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.443525.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.503107.log 2023-11-13T18:43:47.730 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.494204.log 2023-11-13T18:43:47.733 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.335878.log: /var/log/ceph/ceph-client.admin.503107.log: gzip 92.2% -- replaced with /var/log/ceph/ceph-client.admin.503107.log.gz 2023-11-13T18:43:47.733 INFO:teuthology.orchestra.run.smithi102.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.467613.log 2023-11-13T18:43:47.733 INFO:teuthology.orchestra.run.smithi102.stderr: 81.2% -- replaced with /var/log/ceph/ceph-client.admin.417195.log.gz 2023-11-13T18:43:47.734 INFO:teuthology.orchestra.run.smithi102.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.387950.log.gz 2023-11-13T18:43:47.736 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.494204.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.234214.log 2023-11-13T18:43:47.736 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.467613.log: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.389563.log.gz 2023-11-13T18:43:47.737 INFO:teuthology.orchestra.run.smithi102.stderr: 84.6% -- replaced with /var/log/ceph/ceph-client.admin.494204.log.gz 2023-11-13T18:43:47.738 INFO:teuthology.orchestra.run.smithi102.stderr: 80.9% -- replaced with /var/log/ceph/ceph-client.admin.93063.log.gz 2023-11-13T18:43:47.738 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.334178.log 2023-11-13T18:43:47.741 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.234214.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.445583.log 2023-11-13T18:43:47.744 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.334178.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.242007.log 2023-11-13T18:43:47.745 INFO:teuthology.orchestra.run.smithi102.stderr: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.472601.log.gz 2023-11-13T18:43:47.747 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.445583.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46515.log 2023-11-13T18:43:47.749 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.242007.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44005.log 2023-11-13T18:43:47.751 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.481438.log 2023-11-13T18:43:47.754 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.46515.log: /var/log/ceph/ceph-client.admin.44005.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45748.log 2023-11-13T18:43:47.756 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.481438.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38204.log 2023-11-13T18:43:47.759 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.45748.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.369081.log 2023-11-13T18:43:47.761 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.38204.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.405198.log 2023-11-13T18:43:47.763 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.369081.log: 80.8% -- replaced with /var/log/ceph/ceph-client.admin.377029.log.gz 2023-11-13T18:43:47.763 INFO:teuthology.orchestra.run.smithi102.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.377038.log.gz 2023-11-13T18:43:47.764 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.192261.log 2023-11-13T18:43:47.767 INFO:teuthology.orchestra.run.smithi102.stderr: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.207500.log.gz 2023-11-13T18:43:47.767 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.405198.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.443918.log 2023-11-13T18:43:47.769 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101170.log 2023-11-13T18:43:47.772 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.192261.log: /var/log/ceph/ceph-client.admin.443918.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139351.log 2023-11-13T18:43:47.773 INFO:teuthology.orchestra.run.smithi102.stderr: 92.0% -- replaced with /var/log/ceph/ceph-client.admin.220120.log.gz 2023-11-13T18:43:47.774 INFO:teuthology.orchestra.run.smithi102.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.486304.log.gz 2023-11-13T18:43:47.775 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.101170.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.381053.log 2023-11-13T18:43:47.778 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.139351.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.45149.log.gz 2023-11-13T18:43:47.778 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.404387.log 2023-11-13T18:43:47.780 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.381053.log: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.434296.log.gz 2023-11-13T18:43:47.782 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.303977.log 2023-11-13T18:43:47.782 INFO:teuthology.orchestra.run.smithi102.stderr: 93.6% -- replaced with /var/log/ceph/ceph-client.admin.165530.log.gz 2023-11-13T18:43:47.784 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.208718.log 2023-11-13T18:43:47.786 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.404387.log: /var/log/ceph/ceph-client.admin.303977.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.511252.log 2023-11-13T18:43:47.788 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.209539.log 2023-11-13T18:43:47.788 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.208718.log: /var/log/ceph/ceph-client.admin.511252.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.511252.log.gz 2023-11-13T18:43:47.790 INFO:teuthology.orchestra.run.smithi102.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.131149.log.gz 2023-11-13T18:43:47.790 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.191840.log 2023-11-13T18:43:47.791 INFO:teuthology.orchestra.run.smithi102.stderr: 81.5% -- replaced with /var/log/ceph/ceph-client.admin.141163.log.gz 2023-11-13T18:43:47.791 INFO:teuthology.orchestra.run.smithi102.stderr: 81.2% -- replaced with /var/log/ceph/ceph-client.admin.317121.log.gz 2023-11-13T18:43:47.794 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.209539.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.89526.log 2023-11-13T18:43:47.795 INFO:teuthology.orchestra.run.smithi102.stderr: 94.3% -- replaced with /var/log/ceph/ceph-client.admin.173436.log.gz 2023-11-13T18:43:47.796 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.191840.log: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.257024.log.gz 2023-11-13T18:43:47.797 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.433819.log 2023-11-13T18:43:47.798 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose --/var/log/ceph/ceph-client.admin.89526.log: /var/log/ceph/ceph-client.admin.436487.log 2023-11-13T18:43:47.802 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.433819.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.400142.log 2023-11-13T18:43:47.803 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.343453.log 2023-11-13T18:43:47.806 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.400142.log: /var/log/ceph/ceph-client.admin.436487.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.386706.log 2023-11-13T18:43:47.808 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.343453.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.390368.log 2023-11-13T18:43:47.811 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.386706.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120533.log 2023-11-13T18:43:47.814 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.390368.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141976.log 2023-11-13T18:43:47.816 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.120533.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.453938.log 2023-11-13T18:43:47.819 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.141976.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.500531.log 2023-11-13T18:43:47.821 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.453938.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.509957.log 2023-11-13T18:43:47.823 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.428629.log 2023-11-13T18:43:47.824 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.500531.log: /var/log/ceph/ceph-client.admin.509957.log: 82.3% -- replaced with /var/log/ceph/ceph-client.admin.509957.log.gz 2023-11-13T18:43:47.825 INFO:teuthology.orchestra.run.smithi102.stderr: 80.8% -- replaced with /var/log/ceph/ceph-client.admin.500531.log.gz 2023-11-13T18:43:47.826 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.482245.log 2023-11-13T18:43:47.826 INFO:teuthology.orchestra.run.smithi102.stderr: 86.0% -- replaced with /var/log/ceph/ceph-client.admin.424774.log.gz 2023-11-13T18:43:47.826 INFO:teuthology.orchestra.run.smithi102.stderr: 85.3% -- replaced with /var/log/ceph/ceph-client.admin.456958.log.gz 2023-11-13T18:43:47.829 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.428629.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46275.log 2023-11-13T18:43:47.831 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.482245.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.314318.log 2023-11-13T18:43:47.834 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.46275.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.380792.log 2023-11-13T18:43:47.836 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.314318.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.441434.log 2023-11-13T18:43:47.839 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.380792.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.45748.log.gz 2023-11-13T18:43:47.840 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- 88.7% /var/log/ceph/ceph-client.admin.108126.log -- replaced with /var/log/ceph/ceph-client.admin.46515.log.gz 2023-11-13T18:43:47.840 INFO:teuthology.orchestra.run.smithi102.stderr: 2023-11-13T18:43:47.843 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.441434.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101994.log 2023-11-13T18:43:47.845 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.108126.log: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.199840.log.gz 2023-11-13T18:43:47.845 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47820.log 2023-11-13T18:43:47.847 INFO:teuthology.orchestra.run.smithi102.stderr: 77.7% -- replaced with /var/log/ceph/ceph-client.admin.108126.log.gz 2023-11-13T18:43:47.848 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.101994.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.239997.log 2023-11-13T18:43:47.848 INFO:teuthology.orchestra.run.smithi102.stderr: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.404387.log.gz 2023-11-13T18:43:47.849 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.47820.log: 80.8% -- replaced with /var/log/ceph/ceph-client.admin.89526.log.gz 2023-11-13T18:43:47.849 INFO:teuthology.orchestra.run.smithi102.stderr: 81.6% -- replaced with /var/log/ceph/ceph-client.admin.443918.log.gz 2023-11-13T18:43:47.850 INFO:teuthology.orchestra.run.smithi102.stderr: 80.7% -- replaced with /var/log/ceph/ceph-client.admin.451496.log.gz 2023-11-13T18:43:47.850 INFO:teuthology.orchestra.run.smithi102.stderr: 81.0% -- replaced with /var/log/ceph/ceph-client.admin.467613.log.gz 2023-11-13T18:43:47.851 INFO:teuthology.orchestra.run.smithi102.stderr: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.334178.log.gz 2023-11-13T18:43:47.851 INFO:teuthology.orchestra.run.smithi102.stderr: 78.4% -- replaced with /var/log/ceph/ceph-client.admin.485881.log.gz 2023-11-13T18:43:47.851 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.373795.log 2023-11-13T18:43:47.852 INFO:teuthology.orchestra.run.smithi102.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.445583.log.gz 2023-11-13T18:43:47.852 INFO:teuthology.orchestra.run.smithi102.stderr: 81.1% -- replaced with /var/log/ceph/ceph-client.admin.428629.log.gz 2023-11-13T18:43:47.853 INFO:teuthology.orchestra.run.smithi102.stderr: 83.7% -- replaced with /var/log/ceph/ceph-client.admin.433819.log.gz 2023-11-13T18:43:47.853 INFO:teuthology.orchestra.run.smithi102.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.46275.log.gz 2023-11-13T18:43:47.853 INFO:teuthology.orchestra.run.smithi102.stderr: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.485890.log.gz 2023-11-13T18:43:47.854 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.239997.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.175582.log 2023-11-13T18:43:47.854 INFO:teuthology.orchestra.run.smithi102.stderr: 78.9% -- replaced with /var/log/ceph/ceph-client.admin.440629.log.gz 2023-11-13T18:43:47.855 INFO:teuthology.orchestra.run.smithi102.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.391581.log.gz 2023-11-13T18:43:47.855 INFO:teuthology.orchestra.run.smithi102.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.303977.log.gz 2023-11-13T18:43:47.856 INFO:teuthology.orchestra.run.smithi102.stderr: 90.4% -- replaced with /var/log/ceph/ceph-client.admin.436487.log.gz 2023-11-13T18:43:47.857 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.373795.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.372591.log 2023-11-13T18:43:47.857 INFO:teuthology.orchestra.run.smithi102.stderr: 77.4% -- replaced with /var/log/ceph/ceph-client.admin.381053.log.gz 2023-11-13T18:43:47.857 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.175582.log: 90.3% 90.1% -- replaced with /var/log/ceph/ceph-client.admin.386706.log.gz 2023-11-13T18:43:47.858 INFO:teuthology.orchestra.run.smithi102.stderr: -- replaced with /var/log/ceph/ceph-client.admin.459480.log.gz 2023-11-13T18:43:47.860 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.498063.log 2023-11-13T18:43:47.862 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.372591.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48092.log 2023-11-13T18:43:47.864 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.385881.log 2023-11-13T18:43:47.865 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.498063.log: /var/log/ceph/ceph-client.admin.48092.log: 83.4% -- replaced with /var/log/ceph/ceph-client.admin.498063.log.gz 2023-11-13T18:43:47.866 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.419862.log 2023-11-13T18:43:47.869 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.323649.log 2023-11-13T18:43:47.869 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.385881.log: 85.3% -- replaced with /var/log/ceph/ceph-client.admin.390762.log.gz 2023-11-13T18:43:47.872 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.419862.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.228512.log 2023-11-13T18:43:47.875 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.323649.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.396089.log 2023-11-13T18:43:47.877 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.228512.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45123.log 2023-11-13T18:43:47.878 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.396089.log: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.372993.log.gz 2023-11-13T18:43:47.879 INFO:teuthology.orchestra.run.smithi102.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.324059.log.gz 2023-11-13T18:43:47.879 INFO:teuthology.orchestra.run.smithi102.stderr:gzip 79.0% -- replaced with /var/log/ceph/ceph-client.admin.325661.log.gz 2023-11-13T18:43:47.880 INFO:teuthology.orchestra.run.smithi102.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.343917.log 2023-11-13T18:43:47.880 INFO:teuthology.orchestra.run.smithi102.stderr: 81.3% -- replaced with /var/log/ceph/ceph-client.admin.120533.log.gz 2023-11-13T18:43:47.881 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114243.log 2023-11-13T18:43:47.884 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.45123.log: /var/log/ceph/ceph-client.admin.343917.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.179005.log 2023-11-13T18:43:47.885 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.366984.log 2023-11-13T18:43:47.887 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.114243.log: /var/log/ceph/ceph-client.admin.179005.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.236652.log 2023-11-13T18:43:47.889 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.366984.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.86919.log 2023-11-13T18:43:47.891 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.236652.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107330.log 2023-11-13T18:43:47.893 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.86919.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.504809.log 2023-11-13T18:43:47.896 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.107330.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.38204.log.gz 2023-11-13T18:43:47.896 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140237.log 2023-11-13T18:43:47.898 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.504809.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.170062.log 2023-11-13T18:43:47.899 INFO:teuthology.orchestra.run.smithi102.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.139351.log.gz 2023-11-13T18:43:47.900 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.140237.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.344319.log 2023-11-13T18:43:47.902 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.170062.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.433351.log 2023-11-13T18:43:47.905 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.344319.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.228110.log 2023-11-13T18:43:47.905 INFO:teuthology.orchestra.run.smithi102.stderr: 92.2% -- replaced with /var/log/ceph/ceph-client.admin.504809.log.gz 2023-11-13T18:43:47.907 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.433351.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.204384.log 2023-11-13T18:43:47.910 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.228110.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.381199.log 2023-11-13T18:43:47.913 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.204384.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.461532.log 2023-11-13T18:43:47.916 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.381199.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44967.log 2023-11-13T18:43:47.918 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.461532.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44135.log 2023-11-13T18:43:47.920 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.44967.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.305194.log 2023-11-13T18:43:47.922 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.44135.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.217915.log 2023-11-13T18:43:47.924 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.305194.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.184117.log 2023-11-13T18:43:47.928 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.217915.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.512124.log 2023-11-13T18:43:47.928 INFO:teuthology.orchestra.run.smithi102.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.216114.log.gz 2023-11-13T18:43:47.929 INFO:teuthology.orchestra.run.smithi102.stderr: 80.6% -- replaced with /var/log/ceph/ceph-client.admin.224579.log.gz 2023-11-13T18:43:47.930 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.184117.log: 84.2% -- replaced with /var/log/ceph/ceph-client.admin.175582.log.gz 2023-11-13T18:43:47.930 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.315115.log 2023-11-13T18:43:47.931 INFO:teuthology.orchestra.run.smithi102.stderr: 85.1% -- replaced with /var/log/ceph/ceph-client.admin.184117.log.gz 2023-11-13T18:43:47.932 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.396481.log 2023-11-13T18:43:47.932 INFO:teuthology.orchestra.run.smithi102.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.184126.log.gz 2023-11-13T18:43:47.934 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.315115.log: /var/log/ceph/ceph-client.admin.512124.log: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.314318.log.gz 2023-11-13T18:43:47.934 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.511577.log 2023-11-13T18:43:47.935 INFO:teuthology.orchestra.run.smithi102.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.512124.log.gz 2023-11-13T18:43:47.936 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.478604.log 2023-11-13T18:43:47.937 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.511577.log: /var/log/ceph/ceph-client.admin.396481.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.511577.log.gz 2023-11-13T18:43:47.938 INFO:teuthology.orchestra.run.smithi102.stderr: 78.5% -- replaced with /var/log/ceph/ceph-client.admin.379580.log.gz 2023-11-13T18:43:47.938 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.501828.log 2023-11-13T18:43:47.939 INFO:teuthology.orchestra.run.smithi102.stderr: 80.0% -- replaced with /var/log/ceph/ceph-client.admin.380792.log.gz 2023-11-13T18:43:47.940 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.478604.log: 84.2% -- replaced with /var/log/ceph/ceph-client.admin.182439.log.gz 2023-11-13T18:43:47.941 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.222505.log 2023-11-13T18:43:47.942 INFO:teuthology.orchestra.run.smithi102.stderr: 82.0% -- replaced with /var/log/ceph/ceph-client.admin.209539.log.gz 2023-11-13T18:43:47.943 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.501828.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.167217.log 2023-11-13T18:43:47.943 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.222505.log: 80.4% -- replaced with /var/log/ceph/ceph-client.admin.142675.log.gz 2023-11-13T18:43:47.946 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.299524.log 2023-11-13T18:43:47.948 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.248185.log 2023-11-13T18:43:47.949 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.167217.log: /var/log/ceph/ceph-client.admin.299524.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.394045.log 2023-11-13T18:43:47.949 INFO:teuthology.orchestra.run.smithi102.stderr: 83.3% -- replaced with /var/log/ceph/ceph-client.admin.140237.log.gz 2023-11-13T18:43:47.950 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.248185.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.48092.log.gz 2023-11-13T18:43:47.950 INFO:teuthology.orchestra.run.smithi102.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.47069.log.gz 2023-11-13T18:43:47.952 INFO:teuthology.orchestra.run.smithi102.stderr: 92.2% -- replaced with /var/log/ceph/ceph-client.admin.501828.log.gz 2023-11-13T18:43:47.952 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47950.log 2023-11-13T18:43:47.952 INFO:teuthology.orchestra.run.smithi102.stderr: 84.2% -- replaced with /var/log/ceph/ceph-client.admin.239997.log.gz 2023-11-13T18:43:47.953 INFO:teuthology.orchestra.run.smithi102.stderr: 81.4% -- replaced with /var/log/ceph/ceph-client.admin.241203.log.gz 2023-11-13T18:43:47.955 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.394045.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.510793.log 2023-11-13T18:43:47.958 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.47950.log: 78.6% -- replaced with /var/log/ceph/ceph-client.admin.366984.log.gz 2023-11-13T18:43:47.958 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.507766.log 2023-11-13T18:43:47.961 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.510793.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.302364.log 2023-11-13T18:43:47.962 INFO:teuthology.orchestra.run.smithi102.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.510793.log.gz 2023-11-13T18:43:47.963 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.507766.log: 83.7% -- replaced with /var/log/ceph/ceph-client.admin.507766.log.gz 2023-11-13T18:43:47.964 INFO:teuthology.orchestra.run.smithi102.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.47820.log.gz 2023-11-13T18:43:47.964 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.436068.log 2023-11-13T18:43:47.967 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.302364.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.239202.log 2023-11-13T18:43:47.970 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.436068.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.200242.log 2023-11-13T18:43:47.970 INFO:teuthology.orchestra.run.smithi102.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.107330.log.gz 2023-11-13T18:43:47.971 INFO:teuthology.orchestra.run.smithi102.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.112571.log.gz 2023-11-13T18:43:47.971 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.349972.log 2023-11-13T18:43:47.973 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.239202.log: /var/log/ceph/ceph-client.admin.200242.log: 81.3% -- replaced with /var/log/ceph/ceph-client.admin.134834.log.gz 2023-11-13T18:43:47.974 INFO:teuthology.orchestra.run.smithi102.stderr: 84.5% -- replaced with /var/log/ceph/ceph-client.admin.486717.log.gz 2023-11-13T18:43:47.974 INFO:teuthology.orchestra.run.smithi102.stderr: 84.5% -- replaced with /var/log/ceph/ceph-client.admin.479413.log.gz 2023-11-13T18:43:47.975 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.376137.log 2023-11-13T18:43:47.975 INFO:teuthology.orchestra.run.smithi102.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.396490.log.gz 2023-11-13T18:43:47.976 INFO:teuthology.orchestra.run.smithi102.stderr: 85.5% -- replaced with /var/log/ceph/ceph-client.admin.396481.log.gz 84.3% 2023-11-13T18:43:47.976 INFO:teuthology.orchestra.run.smithi102.stderr: -- replaced with /var/log/ceph/ceph-client.admin.436068.log.gz 2023-11-13T18:43:47.977 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.210748.log 2023-11-13T18:43:47.979 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.349972.log: /var/log/ceph/ceph-client.admin.376137.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.348089.log 2023-11-13T18:43:47.982 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.210748.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.315918.log 2023-11-13T18:43:47.984 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.348089.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.451898.log 2023-11-13T18:43:47.987 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.315918.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44448.log 2023-11-13T18:43:47.988 INFO:teuthology.orchestra.run.smithi102.stderr: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.228512.log.gz 2023-11-13T18:43:47.989 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.451898.log: 90.5% -- replaced with /var/log/ceph/ceph-client.admin.302364.log.gz 2023-11-13T18:43:47.990 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.495970.log 2023-11-13T18:43:47.993 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.44448.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53220.log 2023-11-13T18:43:47.996 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.495970.log: 81.2% -- replaced with /var/log/ceph/ceph-client.admin.495970.log.gz 2023-11-13T18:43:47.996 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.319934.log 2023-11-13T18:43:47.997 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.53220.log: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.372591.log.gz 2023-11-13T18:43:48.000 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.435248.log 2023-11-13T18:43:48.001 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.372984.log 2023-11-13T18:43:48.004 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.319934.log: /var/log/ceph/ceph-client.admin.435248.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.202256.log 2023-11-13T18:43:48.006 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.372984.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.512019.log 2023-11-13T18:43:48.010 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.202256.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.175161.log 2023-11-13T18:43:48.011 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.219671.log 2023-11-13T18:43:48.012 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.512019.log: /var/log/ceph/ceph-client.admin.175161.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.512019.log.gz 2023-11-13T18:43:48.014 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.312266.log 2023-11-13T18:43:48.016 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.199831.log 2023-11-13T18:43:48.018 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.219671.log: /var/log/ceph/ceph-client.admin.312266.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.425714.log 2023-11-13T18:43:48.020 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.199831.log: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.200242.log.gz 2023-11-13T18:43:48.022 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.367432.log 2023-11-13T18:43:48.025 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.425714.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.210354.log 2023-11-13T18:43:48.028 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.367432.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.437794.log 2023-11-13T18:43:48.029 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5/var/log/ceph/ceph-client.admin.210354.log: --verbose -- /var/log/ceph/ceph-client.admin.342168.log 2023-11-13T18:43:48.033 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.437794.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.477799.log 2023-11-13T18:43:48.034 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose --/var/log/ceph/ceph-client.admin.342168.log: /var/log/ceph/ceph-client.admin.487809.log 2023-11-13T18:43:48.035 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.477799.log: 85.3% -- replaced with /var/log/ceph/ceph-client.admin.373795.log.gz 2023-11-13T18:43:48.036 INFO:teuthology.orchestra.run.smithi102.stderr: 91.5% -- replaced with /var/log/ceph/ceph-client.admin.344319.log.gz 2023-11-13T18:43:48.037 INFO:teuthology.orchestra.run.smithi102.stderr: 81.3% -- replaced with /var/log/ceph/ceph-client.admin.376137.log.gz 2023-11-13T18:43:48.037 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47538.log 2023-11-13T18:43:48.038 INFO:teuthology.orchestra.run.smithi102.stderr: 85.3% -- replaced with /var/log/ceph/ceph-client.admin.392802.log.gz 2023-11-13T18:43:48.039 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.487809.log: 81.1% -- replaced with /var/log/ceph/ceph-client.admin.394045.log.gz 2023-11-13T18:43:48.040 INFO:teuthology.orchestra.run.smithi102.stderr: 84.1% -- replaced with /var/log/ceph/ceph-client.admin.487809.log.gz 2023-11-13T18:43:48.040 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.329394.log 2023-11-13T18:43:48.042 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.47538.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.47950.log.gz 2023-11-13T18:43:48.043 INFO:teuthology.orchestra.run.smithi102.stderr: 81.1% -- replaced with /var/log/ceph/ceph-client.admin.238791.log.gz 2023-11-13T18:43:48.043 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.485054.log 2023-11-13T18:43:48.044 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.329394.log: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.202256.log.gz 2023-11-13T18:43:48.046 INFO:teuthology.orchestra.run.smithi102.stderr: 90.2%gzip -- replaced with /var/log/ceph/ceph-client.admin.239202.log.gz 2023-11-13T18:43:48.046 INFO:teuthology.orchestra.run.smithi102.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.342177.log 2023-11-13T18:43:48.046 INFO:teuthology.orchestra.run.smithi102.stderr: 77.6% -- replaced with /var/log/ceph/ceph-client.admin.311778.log.gz 2023-11-13T18:43:48.047 INFO:teuthology.orchestra.run.smithi102.stderr: 80.9% -- replaced with /var/log/ceph/ceph-client.admin.312266.log.gz 2023-11-13T18:43:48.048 INFO:teuthology.orchestra.run.smithi102.stderr: 84.2% -- replaced with /var/log/ceph/ceph-client.admin.315115.log.gz 2023-11-13T18:43:48.049 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.485054.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.477002.log 2023-11-13T18:43:48.050 INFO:teuthology.orchestra.run.smithi102.stderr: 78.0% -- replaced with /var/log/ceph/ceph-client.admin.315918.log.gz 2023-11-13T18:43:48.050 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.342177.log: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.343917.log.gz 2023-11-13T18:43:48.051 INFO:teuthology.orchestra.run.smithi102.stderr: 81.0% -- replaced with /var/log/ceph/ceph-client.admin.167217.log.gz 2023-11-13T18:43:48.051 INFO:teuthology.orchestra.run.smithi102.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.406043.log.gz 2023-11-13T18:43:48.052 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.190969.log 2023-11-13T18:43:48.054 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.477002.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.344745.log 2023-11-13T18:43:48.057 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.190969.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2023-11-13T18:43:48.060 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.344745.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.177275.log 2023-11-13T18:43:48.063 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94727.log 2023-11-13T18:43:48.067 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.177275.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.421110.log 2023-11-13T18:43:48.068 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.94727.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.342630.log 2023-11-13T18:43:48.071 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.421110.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.c.log 2023-11-13T18:43:48.074 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.342630.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.379589.log 2023-11-13T18:43:48.077 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-mds.c.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.500540.log 2023-11-13T18:43:48.078 INFO:teuthology.orchestra.run.smithi102.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.47538.log.gz 2023-11-13T18:43:48.078 INFO:teuthology.orchestra.run.smithi102.stderr:gzip/var/log/ceph/ceph-client.admin.379589.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.188551.log 2023-11-13T18:43:48.081 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.500540.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.493801.log 2023-11-13T18:43:48.083 INFO:teuthology.orchestra.run.smithi102.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.46008.log.gz 2023-11-13T18:43:48.083 INFO:teuthology.orchestra.run.smithi102.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.43873.log.gz 2023-11-13T18:43:48.083 INFO:teuthology.orchestra.run.smithi102.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.47846.log.gz 2023-11-13T18:43:48.085 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.188551.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.452711.log 2023-11-13T18:43:48.088 INFO:teuthology.orchestra.run.smithi102.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.48276.log.gz 2023-11-13T18:43:48.089 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.493801.log: 85.9% -- replaced with /var/log/ceph/ceph-client.admin.451898.log.gz 2023-11-13T18:43:48.089 INFO:teuthology.orchestra.run.smithi102.stderr: 90.6%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.319541.log 2023-11-13T18:43:48.090 INFO:teuthology.orchestra.run.smithi102.stderr: -- replaced with /var/log/ceph/ceph-client.admin.86514.log.gz 2023-11-13T18:43:48.092 INFO:teuthology.orchestra.run.smithi102.stderr: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.493801.log.gz 2023-11-13T18:43:48.093 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.452711.log: 80.5% -- replaced with /var/log/ceph/ceph-client.admin.329394.log.gz 2023-11-13T18:43:48.093 INFO:teuthology.orchestra.run.smithi102.stderr: 85.6% -- replaced with /var/log/ceph/ceph-client.admin.485054.log.gz 2023-11-13T18:43:48.093 INFO:teuthology.orchestra.run.smithi102.stderr: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.477002.log.gz 2023-11-13T18:43:48.094 INFO:teuthology.orchestra.run.smithi102.stderr:gzip 90.2% -5 -- replaced with /var/log/ceph/ceph-client.admin.441040.log.gz --verbose 2023-11-13T18:43:48.094 INFO:teuthology.orchestra.run.smithi102.stderr: -- /var/log/ceph/ceph-client.admin.468914.log 2023-11-13T18:43:48.095 INFO:teuthology.orchestra.run.smithi102.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.210354.log.gz 2023-11-13T18:43:48.097 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.319541.log: gzip 90.2% -5 -- replaced with /var/log/ceph/ceph-client.admin.323649.log.gz --verbose 2023-11-13T18:43:48.097 INFO:teuthology.orchestra.run.smithi102.stderr: -- /var/log/ceph/ceph-client.admin.495162.log 2023-11-13T18:43:48.100 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.468914.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.162542.log 2023-11-13T18:43:48.103 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.495162.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.45123.log.gz 2023-11-13T18:43:48.103 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.218470.log 2023-11-13T18:43:48.104 INFO:teuthology.orchestra.run.smithi102.stderr: 79.4% -- replaced with /var/log/ceph/ceph-client.admin.199831.log.gz 2023-11-13T18:43:48.105 INFO:teuthology.orchestra.run.smithi102.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.45282.log.gz 2023-11-13T18:43:48.105 INFO:teuthology.orchestra.run.smithi102.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.495162.log.gz 2023-11-13T18:43:48.106 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.162542.log: 96.2% -- replaced with /var/log/ceph/ceph-client.admin.500540.log.gz 2023-11-13T18:43:48.107 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.343908.log 2023-11-13T18:43:48.108 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.218470.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.456419.log 2023-11-13T18:43:48.109 INFO:teuthology.orchestra.run.smithi102.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.53220.log.gz 2023-11-13T18:43:48.110 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.343908.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.87416.log 2023-11-13T18:43:48.113 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.456419.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.252761.log 2023-11-13T18:43:48.114 INFO:teuthology.orchestra.run.smithi102.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.435248.log.gz 2023-11-13T18:43:48.117 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.87416.log: 93.5% -- replaced with /var/log/ceph/ceph-client.admin.461532.log.gz 2023-11-13T18:43:48.117 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.466257.log 2023-11-13T18:43:48.118 INFO:teuthology.orchestra.run.smithi102.stderr: 81.9% -- replaced with /var/log/ceph/ceph-client.admin.246907.log.gz 2023-11-13T18:43:48.120 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.252761.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.451103.log 2023-11-13T18:43:48.123 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.466257.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.a.log 2023-11-13T18:43:48.126 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.451103.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43767.log 2023-11-13T18:43:48.126 INFO:teuthology.orchestra.run.smithi102.stderr: 94.4% -- replaced with /var/log/ceph/ceph-client.admin.166792.log.gz 2023-11-13T18:43:48.129 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-mds.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.233409.log 2023-11-13T18:43:48.131 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.43767.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.230582.log 2023-11-13T18:43:48.132 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.233409.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.368678.log 2023-11-13T18:43:48.135 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.230582.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43688.log 2023-11-13T18:43:48.138 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.368678.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43979.log 2023-11-13T18:43:48.138 INFO:teuthology.orchestra.run.smithi102.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.201046.log.gz 2023-11-13T18:43:48.140 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.43688.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.497606.log 2023-11-13T18:43:48.143 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.43979.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.223777.log 2023-11-13T18:43:48.144 INFO:teuthology.orchestra.run.smithi102.stderr: 81.2% -- replaced with /var/log/ceph/ceph-client.admin.230980.log.gz 2023-11-13T18:43:48.146 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.497606.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.479009.log 2023-11-13T18:43:48.147 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.223777.log: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.222505.log.gz 2023-11-13T18:43:48.149 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.407467.log 2023-11-13T18:43:48.151 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.237466.log 2023-11-13T18:43:48.153 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.407467.log: /var/log/ceph/ceph-client.admin.479009.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.236254.log 2023-11-13T18:43:48.155 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.237466.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.343041.log 2023-11-13T18:43:48.156 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.236254.log: 92.3% -- replaced with /var/log/ceph/ceph-client.admin.497606.log.gz 2023-11-13T18:43:48.156 INFO:teuthology.orchestra.run.smithi102.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.223777.log.gz 2023-11-13T18:43:48.156 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.390771.log 2023-11-13T18:43:48.159 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.343041.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103613.log 2023-11-13T18:43:48.163 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.390771.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99169.log 2023-11-13T18:43:48.165 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.103613.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.192270.log 2023-11-13T18:43:48.168 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.99169.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.511733.log 2023-11-13T18:43:48.170 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.192270.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.486295.log 2023-11-13T18:43:48.174 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.511733.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.158843.log 2023-11-13T18:43:48.174 INFO:teuthology.orchestra.run.smithi102.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.511733.log.gz 2023-11-13T18:43:48.175 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.339559.log 2023-11-13T18:43:48.178 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.486295.log: /var/log/ceph/ceph-client.admin.158843.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.447698.log 2023-11-13T18:43:48.180 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.339559.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.399342.log 2023-11-13T18:43:48.182 INFO:teuthology.orchestra.run.smithi102.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.379589.log.gz 2023-11-13T18:43:48.183 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.447698.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47121.log 2023-11-13T18:43:48.186 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.399342.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.178996.log 2023-11-13T18:43:48.188 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.47121.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.511453.log 2023-11-13T18:43:48.191 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.178996.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.340373.log 2023-11-13T18:43:48.192 INFO:teuthology.orchestra.run.smithi102.stderr: 79.1% -- replaced with /var/log/ceph/ceph-client.admin.213217.log.gz 2023-11-13T18:43:48.193 INFO:teuthology.orchestra.run.smithi102.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.193969.log.gz 2023-11-13T18:43:48.193 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.511453.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.415584.log 2023-11-13T18:43:48.194 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.340373.log: 80.2% -- replaced with /var/log/ceph/ceph-client.admin.299524.log.gz 2023-11-13T18:43:48.194 INFO:teuthology.orchestra.run.smithi102.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.511453.log.gz 2023-11-13T18:43:48.196 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141172.log 2023-11-13T18:43:48.196 INFO:teuthology.orchestra.run.smithi102.stderr: 81.5% -- replaced with /var/log/ceph/ceph-client.admin.242007.log.gz 2023-11-13T18:43:48.197 INFO:teuthology.orchestra.run.smithi102.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.242418.log.gz 2023-11-13T18:43:48.199 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.415584.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.368669.log 2023-11-13T18:43:48.199 INFO:teuthology.orchestra.run.smithi102.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.425714.log.gz 2023-11-13T18:43:48.201 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.141172.log: 81.6% -- replaced with /var/log/ceph/ceph-client.admin.407467.log.gz 2023-11-13T18:43:48.202 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.428195.log 2023-11-13T18:43:48.202 INFO:teuthology.orchestra.run.smithi102.stderr: 81.5% -- replaced with /var/log/ceph/ceph-client.admin.483846.log.gz 2023-11-13T18:43:48.205 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.368669.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.468905.log 2023-11-13T18:43:48.205 INFO:teuthology.orchestra.run.smithi102.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.44005.log.gz 2023-11-13T18:43:48.206 INFO:teuthology.orchestra.run.smithi102.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.47330.log.gz 2023-11-13T18:43:48.206 INFO:teuthology.orchestra.run.smithi102.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.43979.log.gz 2023-11-13T18:43:48.207 INFO:teuthology.orchestra.run.smithi102.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.188551.log.gz 2023-11-13T18:43:48.209 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.428195.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.233006.log 2023-11-13T18:43:48.211 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.468905.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.485065.log 2023-11-13T18:43:48.212 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.233006.log: 79.8% -- replaced with /var/log/ceph/ceph-client.admin.446417.log.gz 2023-11-13T18:43:48.213 INFO:teuthology.orchestra.run.smithi102.stderr: 80.8% -- replaced with /var/log/ceph/ceph-client.admin.452711.log.gz 2023-11-13T18:43:48.214 INFO:teuthology.orchestra.run.smithi102.stderr: 85.4% -- replaced with /var/log/ceph/ceph-client.admin.479009.log.gz 2023-11-13T18:43:48.214 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.163016.log 2023-11-13T18:43:48.216 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.491692.log 2023-11-13T18:43:48.216 INFO:teuthology.orchestra.run.smithi102.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.451103.log.gz 2023-11-13T18:43:48.218 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.163016.log: /var/log/ceph/ceph-client.admin.485065.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.494674.log 2023-11-13T18:43:48.220 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.491692.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.200644.log 2023-11-13T18:43:48.221 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.511863.log 2023-11-13T18:43:48.223 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.494674.log: /var/log/ceph/ceph-client.admin.200644.log: 85.7% -- replaced with /var/log/ceph/ceph-client.admin.494674.log.gz 2023-11-13T18:43:48.225 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.341759.log 2023-11-13T18:43:48.226 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.222496.log 2023-11-13T18:43:48.227 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.341759.log: 85.2% -- replaced with /var/log/ceph/ceph-client.admin.343908.log.gz 2023-11-13T18:43:48.229 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.511863.log: 78.6% -- replaced with /var/log/ceph/ceph-client.admin.115092.log.gz 2023-11-13T18:43:48.229 INFO:teuthology.orchestra.run.smithi102.stderr: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.234214.log.gz 2023-11-13T18:43:48.229 INFO:teuthology.orchestra.run.smithi102.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.319541.log.gz 2023-11-13T18:43:48.229 INFO:teuthology.orchestra.run.smithi102.stderr: 82.0% -- replaced with /var/log/ceph/ceph-client.admin.415584.log.gz 2023-11-13T18:43:48.230 INFO:teuthology.orchestra.run.smithi102.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.511863.log.gz 2023-11-13T18:43:48.230 INFO:teuthology.orchestra.run.smithi102.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.256622.log.gz 2023-11-13T18:43:48.231 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.511174.log 2023-11-13T18:43:48.234 INFO:teuthology.orchestra.run.smithi102.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.390771.log.gz 2023-11-13T18:43:48.234 INFO:teuthology.orchestra.run.smithi102.stderr: 80.9% -- replaced with /var/log/ceph/ceph-client.admin.486295.log.gz 2023-11-13T18:43:48.234 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.511174.log: 85.2% -- replaced with /var/log/ceph/ceph-client.admin.340373.log.gz 2023-11-13T18:43:48.235 INFO:teuthology.orchestra.run.smithi102.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.371334.log.gz 2023-11-13T18:43:48.235 INFO:teuthology.orchestra.run.smithi102.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.511174.log.gz/var/log/ceph/ceph-client.admin.222496.log: 2023-11-13T18:43:48.235 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.324050.log 2023-11-13T18:43:48.236 INFO:teuthology.orchestra.run.smithi102.stderr: 78.2% -- replaced with /var/log/ceph/ceph-client.admin.468905.log.gz 2023-11-13T18:43:48.236 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.421955.log 2023-11-13T18:43:48.237 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.324050.log: 84.5% -- replaced with /var/log/ceph/ceph-client.admin.198977.log.gz 2023-11-13T18:43:48.238 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.184519.log 2023-11-13T18:43:48.238 INFO:teuthology.orchestra.run.smithi102.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.232201.log.gz 2023-11-13T18:43:48.240 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.421955.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.373393.log 2023-11-13T18:43:48.241 INFO:teuthology.orchestra.run.smithi102.stderr: 90.4% -- replaced with /var/log/ceph/ceph-client.admin.236254.log.gz 2023-11-13T18:43:48.242 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.184519.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.430705.log 2023-11-13T18:43:48.245 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.373393.log: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.419394.log.gz 2023-11-13T18:43:48.245 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.391997.log 2023-11-13T18:43:48.247 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.430705.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.484661.log 2023-11-13T18:43:48.249 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.391997.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.134029.log 2023-11-13T18:43:48.251 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.484661.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.429837.log 2023-11-13T18:43:48.254 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.134029.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.405628.log 2023-11-13T18:43:48.256 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.429837.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.442710.log 2023-11-13T18:43:48.258 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.405628.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115540.log 2023-11-13T18:43:48.261 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.442710.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.183314.log 2023-11-13T18:43:48.263 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.115540.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.172111.log 2023-11-13T18:43:48.265 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.183314.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.231396.log 2023-11-13T18:43:48.266 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.176854.log 2023-11-13T18:43:48.269 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.172111.log: /var/log/ceph/ceph-client.admin.231396.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45175.log 2023-11-13T18:43:48.270 INFO:teuthology.orchestra.run.smithi102.stderr: 93.8% -- replaced with /var/log/ceph/ceph-client.admin.346683.log.gz 2023-11-13T18:43:48.270 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.459069.log 2023-11-13T18:43:48.273 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.45175.log: /var/log/ceph/ceph-client.admin.176854.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.480221.log 2023-11-13T18:43:48.276 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.459069.log: 93.7% -- replaced with /var/log/ceph/ceph-client.admin.180296.log.gz 2023-11-13T18:43:48.277 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.310147.log 2023-11-13T18:43:48.279 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.480221.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.310982.log 2023-11-13T18:43:48.281 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.310147.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47147.log 2023-11-13T18:43:48.283 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.310982.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.504375.log 2023-11-13T18:43:48.285 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.47147.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.467622.log 2023-11-13T18:43:48.287 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.504375.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.333785.log 2023-11-13T18:43:48.289 INFO:teuthology.orchestra.run.smithi102.stderr: 81.2% -- replaced with /var/log/ceph/ceph-client.admin.504375.log.gz 2023-11-13T18:43:48.289 INFO:teuthology.orchestra.run.smithi102.stderr: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.178996.log.gz 2023-11-13T18:43:48.290 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46777.log 2023-11-13T18:43:48.291 INFO:teuthology.orchestra.run.smithi102.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.240006.log.gz 2023-11-13T18:43:48.291 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.333785.log: /var/log/ceph/ceph-client.admin.467622.log: 82.1% -- replaced with /var/log/ceph/ceph-client.admin.222496.log.gz 2023-11-13T18:43:48.291 INFO:teuthology.orchestra.run.smithi102.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.141172.log.gz 2023-11-13T18:43:48.292 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45201.log 2023-11-13T18:43:48.295 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.46777.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.511941.log 2023-11-13T18:43:48.297 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.45201.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.427373.log 2023-11-13T18:43:48.298 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.511941.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.511941.log.gz 2023-11-13T18:43:48.300 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.481026.log 2023-11-13T18:43:48.302 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.427373.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.299930.log 2023-11-13T18:43:48.306 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.481026.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.322028.log 2023-11-13T18:43:48.308 INFO:teuthology.orchestra.run.smithi102.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.45175.log.gz 2023-11-13T18:43:48.309 INFO:teuthology.orchestra.run.smithi102.stderr: 93.6% -- replaced with /var/log/ceph/ceph-client.admin.182017.log.gz 2023-11-13T18:43:48.311 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.299930.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.398529.log 2023-11-13T18:43:48.311 INFO:teuthology.orchestra.run.smithi102.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.45201.log.gz 2023-11-13T18:43:48.311 INFO:teuthology.orchestra.run.smithi102.stderr: 81.6% -- replaced with /var/log/ceph/ceph-client.admin.101994.log.gz 2023-11-13T18:43:48.312 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.322028.log: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.333785.log.gz 2023-11-13T18:43:48.313 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.311385.log 2023-11-13T18:43:48.313 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.398529.log: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.484661.log.gz 2023-11-13T18:43:48.314 INFO:teuthology.orchestra.run.smithi102.stderr: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.341759.log.gz 2023-11-13T18:43:48.315 INFO:teuthology.orchestra.run.smithi102.stderr: 81.3% -- replaced with /var/log/ceph/ceph-client.admin.337943.log.gz 2023-11-13T18:43:48.315 INFO:teuthology.orchestra.run.smithi102.stderr: 83.3% -- replaced with /var/log/ceph/ceph-client.admin.346180.log.gz 2023-11-13T18:43:48.316 INFO:teuthology.orchestra.run.smithi102.stderr: 84.2% -- replaced with /var/log/ceph/ceph-client.admin.322028.log.gz 2023-11-13T18:43:48.318 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108941.log 2023-11-13T18:43:48.318 INFO:teuthology.orchestra.run.smithi102.stderr: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.430705.log.gz 2023-11-13T18:43:48.319 INFO:teuthology.orchestra.run.smithi102.stderr: 86.1% -- replaced with /var/log/ceph/ceph-client.admin.441434.log.gz 2023-11-13T18:43:48.319 INFO:teuthology.orchestra.run.smithi102.stderr: 81.4% -- replaced with /var/log/ceph/ceph-client.admin.385881.log.gz 2023-11-13T18:43:48.320 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.311385.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.159661.log 2023-11-13T18:43:48.323 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.108941.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.420662.log 2023-11-13T18:43:48.326 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.159661.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.182448.log 2023-11-13T18:43:48.328 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.490357.log 2023-11-13T18:43:48.329 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.420662.log: /var/log/ceph/ceph-client.admin.182448.log: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.229768.log.gz 2023-11-13T18:43:48.330 INFO:teuthology.orchestra.run.smithi102.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.231396.log.gz 2023-11-13T18:43:48.331 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.315927.log 2023-11-13T18:43:48.334 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.490357.log: 80.1% -- replaced with /var/log/ceph/ceph-client.admin.490357.log.gz 2023-11-13T18:43:48.334 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.391179.log 2023-11-13T18:43:48.336 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119700.log 2023-11-13T18:43:48.337 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.391179.log: /var/log/ceph/ceph-client.admin.315927.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106102.log 2023-11-13T18:43:48.340 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.119700.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47742.log 2023-11-13T18:43:48.340 INFO:teuthology.orchestra.run.smithi102.stderr: 93.7% -- replaced with /var/log/ceph/ceph-client.admin.168539.log.gz 2023-11-13T18:43:48.342 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.106102.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.319532.log 2023-11-13T18:43:48.345 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.47742.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.366153.log 2023-11-13T18:43:48.348 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.319532.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.136587.log 2023-11-13T18:43:48.349 INFO:teuthology.orchestra.run.smithi102.stderr: 94.9% -- replaced with /var/log/ceph/ceph-client.admin.142684.log.gz 2023-11-13T18:43:48.351 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.366153.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.499694.log 2023-11-13T18:43:48.353 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.136587.log: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.236652.log.gz 2023-11-13T18:43:48.354 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.333370.log 2023-11-13T18:43:48.356 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose/var/log/ceph/ceph-client.admin.499694.log: -- /var/log/ceph/ceph-client.admin.404396.log 2023-11-13T18:43:48.358 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.333370.log: 83.5% -- replaced with /var/log/ceph/ceph-client.admin.499694.log.gz 2023-11-13T18:43:48.359 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93072.log 2023-11-13T18:43:48.362 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.404396.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.143326.log 2023-11-13T18:43:48.365 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.93072.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.511655.log 2023-11-13T18:43:48.368 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.143326.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.474986.log 2023-11-13T18:43:48.370 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.511655.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.135700.log 2023-11-13T18:43:48.371 INFO:teuthology.orchestra.run.smithi102.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.511655.log.gz 2023-11-13T18:43:48.372 INFO:teuthology.orchestra.run.smithi102.stderr: 86.0% -- replaced with /var/log/ceph/ceph-client.admin.115944.log.gz 2023-11-13T18:43:48.374 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.474986.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.383800.log 2023-11-13T18:43:48.376 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.48433.log 2023-11-13T18:43:48.377 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.383800.log: /var/log/ceph/ceph-client.admin.135700.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.326491.log 2023-11-13T18:43:48.379 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.0.48433.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.345202.log 2023-11-13T18:43:48.382 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.326491.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.308835.log 2023-11-13T18:43:48.384 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.143765.log 2023-11-13T18:43:48.388 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.345202.log: /var/log/ceph/ceph-client.admin.308835.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.511226.log 2023-11-13T18:43:48.389 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.450296.log 2023-11-13T18:43:48.390 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.143765.log: /var/log/ceph/ceph-client.admin.511226.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.511226.log.gz 2023-11-13T18:43:48.392 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.223360.log 2023-11-13T18:43:48.395 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.450296.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46960.log 2023-11-13T18:43:48.397 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.415995.log 2023-11-13T18:43:48.398 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.223360.log: /var/log/ceph/ceph-client.admin.46960.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.383809.log 2023-11-13T18:43:48.400 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.415995.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108135.log 2023-11-13T18:43:48.403 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.383809.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.330239.log 2023-11-13T18:43:48.403 INFO:teuthology.orchestra.run.smithi102.stderr: 80.9% -- replaced with /var/log/ceph/ceph-client.admin.93921.log.gz 2023-11-13T18:43:48.405 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.108135.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.511278.log 2023-11-13T18:43:48.407 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.378292.log 2023-11-13T18:43:48.408 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.511278.log: /var/log/ceph/ceph-client.admin.330239.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.511278.log.gz 2023-11-13T18:43:48.411 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.176845.log 2023-11-13T18:43:48.413 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.378292.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.433360.log 2023-11-13T18:43:48.417 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.176845.log: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.311385.log.gz 2023-11-13T18:43:48.417 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44236.log 2023-11-13T18:43:48.420 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.433360.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44993.log 2023-11-13T18:43:48.422 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.44236.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.309242.log 2023-11-13T18:43:48.425 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.44993.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.375045.log 2023-11-13T18:43:48.428 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.309242.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.381062.log 2023-11-13T18:43:48.430 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.180287.log 2023-11-13T18:43:48.433 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.375045.log: /var/log/ceph/ceph-client.admin.381062.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.369548.log 2023-11-13T18:43:48.434 INFO:teuthology.orchestra.run.smithi102.stderr: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.481438.log.gz 2023-11-13T18:43:48.437 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.180287.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.91990.log 2023-11-13T18:43:48.440 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.369548.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.308826.log 2023-11-13T18:43:48.440 INFO:teuthology.orchestra.run.smithi102.stderr: 85.3% -- replaced with /var/log/ceph/ceph-client.admin.384630.log.gz 2023-11-13T18:43:48.441 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.143335.log 2023-11-13T18:43:48.444 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.308826.log: /var/log/ceph/ceph-client.admin.91990.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.385046.log 2023-11-13T18:43:48.444 INFO:teuthology.orchestra.run.smithi102.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.421955.log.gz 2023-11-13T18:43:48.444 INFO:teuthology.orchestra.run.smithi102.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.424380.log.gz 2023-11-13T18:43:48.445 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.381101.log 2023-11-13T18:43:48.446 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.143335.log: /var/log/ceph/ceph-client.admin.385046.log: 81.3% -- replaced with /var/log/ceph/ceph-client.admin.324050.log.gz 2023-11-13T18:43:48.448 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.160461.log 2023-11-13T18:43:48.449 INFO:teuthology.orchestra.run.smithi102.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.427373.log.gz 2023-11-13T18:43:48.450 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.381101.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.89123.log 2023-11-13T18:43:48.453 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.160461.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.133628.log 2023-11-13T18:43:48.453 INFO:teuthology.orchestra.run.smithi102.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.46406.log.gz 2023-11-13T18:43:48.453 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.485458.log 2023-11-13T18:43:48.456 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.89123.log: /var/log/ceph/ceph-client.admin.133628.log: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.398529.log.gz 2023-11-13T18:43:48.457 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.511603.log 2023-11-13T18:43:48.457 INFO:teuthology.orchestra.run.smithi102.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.44967.log.gz 2023-11-13T18:43:48.458 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.485458.log: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.391997.log.gz 2023-11-13T18:43:48.458 INFO:teuthology.orchestra.run.smithi102.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.48032.log.gz 2023-11-13T18:43:48.459 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111763.log 2023-11-13T18:43:48.459 INFO:teuthology.orchestra.run.smithi102.stderr: 94.3% -- replaced with /var/log/ceph/ceph-client.admin.368246.log.gz 2023-11-13T18:43:48.460 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.511603.log: 81.3% -- replaced with /var/log/ceph/ceph-client.admin.89123.log.gz 2023-11-13T18:43:48.460 INFO:teuthology.orchestra.run.smithi102.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.511603.log.gz 2023-11-13T18:43:48.460 INFO:teuthology.orchestra.run.smithi102.stderr: 79.9% -- replaced with /var/log/ceph/ceph-client.admin.106102.log.gz 2023-11-13T18:43:48.462 INFO:teuthology.orchestra.run.smithi102.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.108135.log.gz 2023-11-13T18:43:48.463 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.446426.log 2023-11-13T18:43:48.463 INFO:teuthology.orchestra.run.smithi102.stderr: 79.6% -- replaced with /var/log/ceph/ceph-client.admin.485458.log.gz 2023-11-13T18:43:48.464 INFO:teuthology.orchestra.run.smithi102.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.101170.log.gz 2023-11-13T18:43:48.465 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.111763.log: 81.0% -- replaced with /var/log/ceph/ceph-client.admin.319532.log.gz 2023-11-13T18:43:48.465 INFO:teuthology.orchestra.run.smithi102.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.44236.log.gz 2023-11-13T18:43:48.466 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.213631.log 2023-11-13T18:43:48.468 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.446426.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.511915.log 2023-11-13T18:43:48.468 INFO:teuthology.orchestra.run.smithi102.stderr: 78.9% -- replaced with /var/log/ceph/ceph-client.admin.136587.log.gz 2023-11-13T18:43:48.470 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.213631.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102801.log 2023-11-13T18:43:48.471 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.511915.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.511915.log.gz 2023-11-13T18:43:48.473 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.387507.log 2023-11-13T18:43:48.473 INFO:teuthology.orchestra.run.smithi102.stderr: 78.1% -- replaced with /var/log/ceph/ceph-client.admin.381101.log.gz 2023-11-13T18:43:48.474 INFO:teuthology.orchestra.run.smithi102.stderr: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.344745.log.gz 2023-11-13T18:43:48.476 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.102801.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44889.log 2023-11-13T18:43:48.478 INFO:teuthology.orchestra.run.smithi102.stderr: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.391572.log.gz 2023-11-13T18:43:48.478 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.441443.log 2023-11-13T18:43:48.478 INFO:teuthology.orchestra.run.smithi102.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.170062.log.gz 2023-11-13T18:43:48.479 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.387507.log: /var/log/ceph/ceph-client.admin.44889.log: 78.4% -- replaced with /var/log/ceph/ceph-client.admin.375045.log.gz 2023-11-13T18:43:48.480 INFO:teuthology.orchestra.run.smithi102.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.450296.log.gz 2023-11-13T18:43:48.481 INFO:teuthology.orchestra.run.smithi102.stderr: 84.1% -- replaced with /var/log/ceph/ceph-client.admin.383800.log.gz 2023-11-13T18:43:48.481 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.502678.log 2023-11-13T18:43:48.483 INFO:teuthology.orchestra.run.smithi102.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.383809.log.gz 2023-11-13T18:43:48.484 INFO:teuthology.orchestra.run.smithi102.stderr: 90.2%gzip -- replaced with /var/log/ceph/ceph-client.admin.385046.log.gz 2023-11-13T18:43:48.484 INFO:teuthology.orchestra.run.smithi102.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.402736.log 2023-11-13T18:43:48.485 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.441443.log: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.133628.log.gz 2023-11-13T18:43:48.485 INFO:teuthology.orchestra.run.smithi102.stderr: 77.7% -- replaced with /var/log/ceph/ceph-client.admin.415182.log.gz 2023-11-13T18:43:48.487 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.502678.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113793.log 2023-11-13T18:43:48.487 INFO:teuthology.orchestra.run.smithi102.stderr: 80.8% -- replaced with /var/log/ceph/ceph-client.admin.253587.log.gz 2023-11-13T18:43:48.489 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.402736.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.173870.log 2023-11-13T18:43:48.490 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.113793.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.511993.log 2023-11-13T18:43:48.493 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.173870.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.504384.log 2023-11-13T18:43:48.495 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.335869.log 2023-11-13T18:43:48.496 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.511993.log: /var/log/ceph/ceph-client.admin.504384.log: 92.1% -- replaced with /var/log/ceph/ceph-client.admin.502678.log.gz 2023-11-13T18:43:48.497 INFO:teuthology.orchestra.run.smithi102.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.511993.log.gz 2023-11-13T18:43:48.499 INFO:teuthology.orchestra.run.smithi102.stderr: 92.2% -- replaced with /var/log/ceph/ceph-client.admin.504384.log.gz 2023-11-13T18:43:48.500 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.306811.log 2023-11-13T18:43:48.501 INFO:teuthology.orchestra.run.smithi102.stderr: 93.4% -- replaced with /var/log/ceph/ceph-client.admin.405198.log.gz 2023-11-13T18:43:48.503 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.335869.log: 93.6% -- replaced with /var/log/ceph/ceph-client.admin.179866.log.gz 2023-11-13T18:43:48.504 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.212822.log 2023-11-13T18:43:48.505 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.306811.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.455625.log 2023-11-13T18:43:48.508 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.212822.log: 80.4% -- replaced with /var/log/ceph/ceph-client.admin.219671.log.gz 2023-11-13T18:43:48.508 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.422756.log 2023-11-13T18:43:48.509 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.212813.log 2023-11-13T18:43:48.511 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.455625.log: /var/log/ceph/ceph-client.admin.422756.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.245233.log 2023-11-13T18:43:48.512 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.212813.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.219680.log 2023-11-13T18:43:48.513 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.245233.log: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.117210.log.gz 2023-11-13T18:43:48.515 INFO:teuthology.orchestra.run.smithi102.stderr: 81.4% -- replaced with /var/log/ceph/ceph-client.admin.243617.log.gz 2023-11-13T18:43:48.515 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.511681.log 2023-11-13T18:43:48.515 INFO:teuthology.orchestra.run.smithi102.stderr: 79.3% -- replaced with /var/log/ceph/ceph-client.admin.180287.log.gz 2023-11-13T18:43:48.516 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.219680.log: 86.0% -- replaced with /var/log/ceph/ceph-client.admin.314309.log.gz 2023-11-13T18:43:48.517 INFO:teuthology.orchestra.run.smithi102.stderr: 80.0% -- replaced with /var/log/ceph/ceph-client.admin.367432.log.gz 2023-11-13T18:43:48.518 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.369072.log 2023-11-13T18:43:48.521 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.511681.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.479018.log 2023-11-13T18:43:48.522 INFO:teuthology.orchestra.run.smithi102.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.511681.log.gz 2023-11-13T18:43:48.523 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.369072.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.225384.log 2023-11-13T18:43:48.525 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.479018.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.160470.log 2023-11-13T18:43:48.528 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.225384.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93519.log 2023-11-13T18:43:48.530 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.160470.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.231387.log 2023-11-13T18:43:48.532 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.445574.log 2023-11-13T18:43:48.534 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.93519.log: /var/log/ceph/ceph-client.admin.231387.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.438261.log 2023-11-13T18:43:48.536 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.217460.log 2023-11-13T18:43:48.539 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.445574.log: /var/log/ceph/ceph-client.admin.438261.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.171259.log 2023-11-13T18:43:48.541 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.217460.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.247319.log 2023-11-13T18:43:48.542 INFO:teuthology.orchestra.run.smithi102.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.44889.log.gz 2023-11-13T18:43:48.544 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.171259.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.131543.log 2023-11-13T18:43:48.548 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.247319.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.427792.log 2023-11-13T18:43:48.550 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.367843.log 2023-11-13T18:43:48.550 INFO:teuthology.orchestra.run.smithi102.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.111763.log.gz 2023-11-13T18:43:48.553 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.427792.log: /var/log/ceph/ceph-client.admin.131543.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.181577.log 2023-11-13T18:43:48.556 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.367843.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47199.log 2023-11-13T18:43:48.558 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.181577.log: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.445574.log.gz 2023-11-13T18:43:48.559 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.494937.log 2023-11-13T18:43:48.562 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.47199.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118439.log 2023-11-13T18:43:48.565 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.494937.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.339568.log 2023-11-13T18:43:48.565 INFO:teuthology.orchestra.run.smithi102.stderr: 81.0% -- replaced with /var/log/ceph/ceph-client.admin.308826.log.gz 2023-11-13T18:43:48.568 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.118439.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.415593.log 2023-11-13T18:43:48.568 INFO:teuthology.orchestra.run.smithi102.stderr: 86.0% -- replaced with /var/log/ceph/ceph-client.admin.335869.log.gz 2023-11-13T18:43:48.569 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.339568.log: 84.3% -- replaced with /var/log/ceph/ceph-client.admin.395673.log.gz 2023-11-13T18:43:48.571 INFO:teuthology.orchestra.run.smithi102.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.396089.log.gz 2023-11-13T18:43:48.571 INFO:teuthology.orchestra.run.smithi102.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.441443.log.gz 2023-11-13T18:43:48.571 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.441031.log 2023-11-13T18:43:48.571 INFO:teuthology.orchestra.run.smithi102.stderr: 81.4% -- replaced with /var/log/ceph/ceph-client.admin.435661.log.gz 2023-11-13T18:43:48.572 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.179427.log 2023-11-13T18:43:48.574 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.415593.log: /var/log/ceph/ceph-client.admin.441031.log: 92.7% -- replaced with /var/log/ceph/ceph-client.admin.143335.log.gz 2023-11-13T18:43:48.574 INFO:teuthology.orchestra.run.smithi102.stderr: 80.8% -- replaced with /var/log/ceph/ceph-client.admin.369072.log.gz 2023-11-13T18:43:48.575 INFO:teuthology.orchestra.run.smithi102.stderr: 81.2% -- replaced with /var/log/ceph/ceph-client.admin.368669.log.gz 2023-11-13T18:43:48.575 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.219267.log 2023-11-13T18:43:48.576 INFO:teuthology.orchestra.run.smithi102.stderr: 79.7% -- replaced with /var/log/ceph/ceph-client.admin.422756.log.gz 2023-11-13T18:43:48.576 INFO:teuthology.orchestra.run.smithi102.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.306811.log.gz 2023-11-13T18:43:48.577 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.179427.log: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.383402.log.gz 2023-11-13T18:43:48.578 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.490804.log 2023-11-13T18:43:48.580 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.219267.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.183720.log 2023-11-13T18:43:48.581 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.490804.log: 84.4% -- replaced with /var/log/ceph/ceph-client.admin.490804.log.gz 2023-11-13T18:43:48.583 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.165127.log 2023-11-13T18:43:48.585 INFO:teuthology.orchestra.run.smithi102.stderr: 81.3% -- replaced with /var/log/ceph/ceph-client.admin.387507.log.gz 2023-11-13T18:43:48.585 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118832.log 2023-11-13T18:43:48.587 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.165127.log: /var/log/ceph/ceph-client.admin.183720.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.193527.log 2023-11-13T18:43:48.589 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.118832.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.402745.log 2023-11-13T18:43:48.589 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.193527.log: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.86112.log.gz 2023-11-13T18:43:48.590 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44109.log 2023-11-13T18:43:48.593 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.402745.log: 81.0% -- replaced with /var/log/ceph/ceph-client.admin.402736.log.gz 2023-11-13T18:43:48.593 INFO:teuthology.orchestra.run.smithi102.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.437794.log.gz 2023-11-13T18:43:48.594 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.478211.log 2023-11-13T18:43:48.595 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.44109.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.162112.log 2023-11-13T18:43:48.596 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.478211.log: 80.9% -- replaced with /var/log/ceph/ceph-client.admin.118832.log.gz 2023-11-13T18:43:48.598 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.231798.log 2023-11-13T18:43:48.598 INFO:teuthology.orchestra.run.smithi102.stderr: 81.6% -- replaced with /var/log/ceph/ceph-client.admin.131543.log.gz 2023-11-13T18:43:48.599 INFO:teuthology.orchestra.run.smithi102.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.118439.log.gz 2023-11-13T18:43:48.601 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.162112.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.503950.log 2023-11-13T18:43:48.603 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.231798.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.235838.log 2023-11-13T18:43:48.606 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46458.log 2023-11-13T18:43:48.607 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.503950.log: 81.4% -- replaced with /var/log/ceph/ceph-client.admin.503950.log.gz 2023-11-13T18:43:48.608 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.194763.log 2023-11-13T18:43:48.610 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.235838.log: /var/log/ceph/ceph-client.admin.46458.log: 93.1% -- replaced with /var/log/ceph/ceph-client.admin.183314.log.gz 2023-11-13T18:43:48.611 INFO:teuthology.orchestra.run.smithi102.stderr: 78.5% -- replaced with /var/log/ceph/ceph-client.admin.239193.log.gz 2023-11-13T18:43:48.611 INFO:teuthology.orchestra.run.smithi102.stderr: 82.0% -- replaced with /var/log/ceph/ceph-client.admin.171259.log.gz 2023-11-13T18:43:48.611 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99905.log 2023-11-13T18:43:48.614 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.194763.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.226864.log 2023-11-13T18:43:48.617 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.99905.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46645.log 2023-11-13T18:43:48.617 INFO:teuthology.orchestra.run.smithi102.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.188956.log.gz 2023-11-13T18:43:48.620 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.226864.log: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.179427.log.gz 2023-11-13T18:43:48.620 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.316319.log 2023-11-13T18:43:48.620 INFO:teuthology.orchestra.run.smithi102.stderr: 79.4% -- replaced with /var/log/ceph/ceph-client.admin.162112.log.gz 2023-11-13T18:43:48.622 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.489122.log 2023-11-13T18:43:48.625 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.46645.log: /var/log/ceph/ceph-client.admin.316319.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.315124.log 2023-11-13T18:43:48.627 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.489122.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.367834.log 2023-11-13T18:43:48.630 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.315124.log: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.489122.log.gz 2023-11-13T18:43:48.630 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.242811.log 2023-11-13T18:43:48.633 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.367834.log: 80.7% -- replaced with /var/log/ceph/ceph-client.admin.176415.log.gz 2023-11-13T18:43:48.633 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110543.log 2023-11-13T18:43:48.636 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.242811.log: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.213631.log.gz 2023-11-13T18:43:48.636 INFO:teuthology.orchestra.run.smithi102.stderr: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.187334.log.gz 2023-11-13T18:43:48.636 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.499292.log 2023-11-13T18:43:48.638 INFO:teuthology.orchestra.run.smithi102.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.187343.log.gz 2023-11-13T18:43:48.639 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.434698.log 2023-11-13T18:43:48.639 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.110543.log: /var/log/ceph/ceph-client.admin.499292.log: 81.5% -- replaced with /var/log/ceph/ceph-client.admin.499292.log.gz 2023-11-13T18:43:48.640 INFO:teuthology.orchestra.run.smithi102.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.165127.log.gz 2023-11-13T18:43:48.642 INFO:teuthology.orchestra.run.smithi102.stderr: 84.1% -- replaced with /var/log/ceph/ceph-client.admin.419853.log.gz 2023-11-13T18:43:48.642 INFO:teuthology.orchestra.run.smithi102.stderr: 85.2% -- replaced with /var/log/ceph/ceph-client.admin.420662.log.gz 2023-11-13T18:43:48.642 INFO:teuthology.orchestra.run.smithi102.stderr: 78.1% -- replaced with /var/log/ceph/ceph-client.admin.181577.log.gz 2023-11-13T18:43:48.643 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.385444.log 2023-11-13T18:43:48.643 INFO:teuthology.orchestra.run.smithi102.stderr: 81.3% -- replaced with /var/log/ceph/ceph-client.admin.474986.log.gz 2023-11-13T18:43:48.645 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.434698.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.321631.log 2023-11-13T18:43:48.645 INFO:teuthology.orchestra.run.smithi102.stderr: 80.7% -- replaced with /var/log/ceph/ceph-client.admin.241605.log.gz 2023-11-13T18:43:48.647 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.385444.log: 86.0% -- replaced with /var/log/ceph/ceph-client.admin.379141.log.gz 2023-11-13T18:43:48.647 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.508200.log 2023-11-13T18:43:48.649 INFO:teuthology.orchestra.run.smithi102.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.46645.log.gz 2023-11-13T18:43:48.649 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.321631.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.43688.log.gz 2023-11-13T18:43:48.650 INFO:teuthology.orchestra.run.smithi102.stderr: 77.7% -- replaced with /var/log/ceph/ceph-client.admin.194763.log.gz 2023-11-13T18:43:48.650 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.495979.log 2023-11-13T18:43:48.652 INFO:teuthology.orchestra.run.smithi102.stderr: 80.6% -- replaced with /var/log/ceph/ceph-client.admin.99905.log.gz 2023-11-13T18:43:48.652 INFO:teuthology.orchestra.run.smithi102.stderr: 88.5% 79.5% -- replaced with /var/log/ceph/ceph-client.admin.44109.log.gz 2023-11-13T18:43:48.653 INFO:teuthology.orchestra.run.smithi102.stderr: -- replaced with /var/log/ceph/ceph-client.admin.110543.log.gz 2023-11-13T18:43:48.653 INFO:teuthology.orchestra.run.smithi102.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.402745.log.gz 2023-11-13T18:43:48.654 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.426516.log 2023-11-13T18:43:48.657 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.508200.log: /var/log/ceph/ceph-client.admin.495979.log: 81.9% -- replaced with /var/log/ceph/ceph-client.admin.437785.log.gz 2023-11-13T18:43:48.657 INFO:teuthology.orchestra.run.smithi102.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.339568.log.gz 2023-11-13T18:43:48.658 INFO:teuthology.orchestra.run.smithi102.stderr: 92.4% -- replaced with /var/log/ceph/ceph-client.admin.495979.log.gz 2023-11-13T18:43:48.660 INFO:teuthology.orchestra.run.smithi102.stderr: 90.2% 78.4% -- replaced with /var/log/ceph/ceph-client.admin.385444.log.gz 2023-11-13T18:43:48.660 INFO:teuthology.orchestra.run.smithi102.stderr: 78.0% -- replaced with /var/log/ceph/ceph-client.admin.177275.log.gz 2023-11-13T18:43:48.661 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111754.log 2023-11-13T18:43:48.661 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.426516.log: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.415593.log.gz 2023-11-13T18:43:48.661 INFO:teuthology.orchestra.run.smithi102.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.231798.log.gz 2023-11-13T18:43:48.661 INFO:teuthology.orchestra.run.smithi102.stderr: 80.8% -- replaced with /var/log/ceph/ceph-client.admin.344310.log.gz 2023-11-13T18:43:48.662 INFO:teuthology.orchestra.run.smithi102.stderr: -- replaced with /var/log/ceph/ceph-client.admin.321631.log.gz 2023-11-13T18:43:48.662 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.367441.log 2023-11-13T18:43:48.663 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.111754.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.303968.log 2023-11-13T18:43:48.664 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.472610.log 2023-11-13T18:43:48.664 INFO:teuthology.orchestra.run.smithi102.stderr: 92.1% -- replaced with /var/log/ceph/ceph-client.admin.508200.log.gz 2023-11-13T18:43:48.667 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.367441.log: /var/log/ceph/ceph-client.admin.303968.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.196781.log 2023-11-13T18:43:48.669 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.472610.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.430714.log 2023-11-13T18:43:48.671 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.196781.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.136160.log 2023-11-13T18:43:48.673 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.430714.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48004.log 2023-11-13T18:43:48.675 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.136160.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.175994.log 2023-11-13T18:43:48.677 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.48004.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.89132.log 2023-11-13T18:43:48.679 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.175994.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.313883.log 2023-11-13T18:43:48.681 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118841.log 2023-11-13T18:43:48.683 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.313883.log: /var/log/ceph/ceph-client.admin.89132.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.224982.log 2023-11-13T18:43:48.684 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.370932.log 2023-11-13T18:43:48.687 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.118841.log: /var/log/ceph/ceph-client.admin.224982.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44239.log 2023-11-13T18:43:48.689 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.370932.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.218461.log 2023-11-13T18:43:48.691 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.44239.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.500138.log 2023-11-13T18:43:48.692 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.404797.log 2023-11-13T18:43:48.694 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.500138.log: /var/log/ceph/ceph-client.admin.218461.log: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.500138.log.gz 2023-11-13T18:43:48.694 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.178135.log 2023-11-13T18:43:48.697 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.404797.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.188147.log 2023-11-13T18:43:48.699 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.178135.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.331162.log 2023-11-13T18:43:48.701 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.188147.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.380801.log 2023-11-13T18:43:48.703 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.331162.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.239604.log 2023-11-13T18:43:48.705 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.380801.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.395266.log 2023-11-13T18:43:48.707 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109746.log 2023-11-13T18:43:48.710 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.239604.log: /var/log/ceph/ceph-client.admin.395266.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117618.log 2023-11-13T18:43:48.712 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43521.log 2023-11-13T18:43:48.714 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.109746.log: /var/log/ceph/ceph-client.admin.117618.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.339157.log 2023-11-13T18:43:48.716 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.43521.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44649.log 2023-11-13T18:43:48.719 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.339157.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.496385.log 2023-11-13T18:43:48.721 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.44649.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.370531.log 2023-11-13T18:43:48.723 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.496385.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.426123.log 2023-11-13T18:43:48.723 INFO:teuthology.orchestra.run.smithi102.stderr: 78.4% -- replaced with /var/log/ceph/ceph-client.admin.496385.log.gz 2023-11-13T18:43:48.724 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.389151.log 2023-11-13T18:43:48.727 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.426123.log: /var/log/ceph/ceph-client.admin.370531.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.384639.log 2023-11-13T18:43:48.729 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.389151.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.348546.log 2023-11-13T18:43:48.731 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.384639.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.406034.log 2023-11-13T18:43:48.733 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.348546.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.347152.log 2023-11-13T18:43:48.735 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.406034.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.405637.log 2023-11-13T18:43:48.737 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.347152.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141565.log 2023-11-13T18:43:48.739 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.405637.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94333.log 2023-11-13T18:43:48.741 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.141565.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.214844.log 2023-11-13T18:43:48.743 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.94333.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.506915.log 2023-11-13T18:43:48.746 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.214844.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.301148.log 2023-11-13T18:43:48.749 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.506915.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.211160.log 2023-11-13T18:43:48.749 INFO:teuthology.orchestra.run.smithi102.stderr: 81.6% -- replaced with /var/log/ceph/ceph-client.admin.506915.log.gz 2023-11-13T18:43:48.749 INFO:teuthology.orchestra.run.smithi102.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.239604.log.gz 2023-11-13T18:43:48.750 INFO:teuthology.orchestra.run.smithi102.stderr: 84.2% -- replaced with /var/log/ceph/ceph-client.admin.186127.log.gz 2023-11-13T18:43:48.751 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.301148.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.373402.log 2023-11-13T18:43:48.751 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.211160.log: 78.6% -- replaced with /var/log/ceph/ceph-client.admin.204384.log.gz 2023-11-13T18:43:48.753 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.197197.log 2023-11-13T18:43:48.755 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.373402.log: 85.3% -- replaced with /var/log/ceph/ceph-client.admin.224982.log.gz 2023-11-13T18:43:48.755 INFO:teuthology.orchestra.run.smithi102.stderr: 85.6% -- replaced with /var/log/ceph/ceph-client.admin.367834.log.gz 2023-11-13T18:43:48.756 INFO:teuthology.orchestra.run.smithi102.stderr: 81.0% -- replaced with /var/log/ceph/ceph-client.admin.226864.log.gz 2023-11-13T18:43:48.756 INFO:teuthology.orchestra.run.smithi102.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.367441.log.gz 2023-11-13T18:43:48.757 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.501819.log 2023-11-13T18:43:48.759 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.197197.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.436881.log 2023-11-13T18:43:48.759 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.501819.log: 81.2% -- replaced with /var/log/ceph/ceph-client.admin.501819.log.gz 2023-11-13T18:43:48.761 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.508191.log 2023-11-13T18:43:48.762 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.436881.log: 81.0% -- replaced with /var/log/ceph/ceph-client.admin.233409.log.gz 2023-11-13T18:43:48.763 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.505660.log 2023-11-13T18:43:48.764 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.508191.log: 78.4% -- replaced with /var/log/ceph/ceph-client.admin.508191.log.gz 2023-11-13T18:43:48.765 INFO:teuthology.orchestra.run.smithi102.stderr: 81.4% -- replaced with /var/log/ceph/ceph-client.admin.219267.log.gz 2023-11-13T18:43:48.766 INFO:teuthology.orchestra.run.smithi102.stderr: 81.5% -- replaced with /var/log/ceph/ceph-client.admin.235838.log.gz 2023-11-13T18:43:48.766 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.386299.log 2023-11-13T18:43:48.767 INFO:teuthology.orchestra.run.smithi102.stderr: 80.9% -- replaced with /var/log/ceph/ceph-client.admin.237466.log.gz 2023-11-13T18:43:48.768 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.481842.log 2023-11-13T18:43:48.769 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.505660.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.439131.log 2023-11-13T18:43:48.771 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.386299.log: /var/log/ceph/ceph-client.admin.481842.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.46697.log.gz 2023-11-13T18:43:48.772 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.414741.log 2023-11-13T18:43:48.773 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.432391.log 2023-11-13T18:43:48.776 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.439131.log: /var/log/ceph/ceph-client.admin.414741.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.423566.log 2023-11-13T18:43:48.777 INFO:teuthology.orchestra.run.smithi102.stderr: 92.2% -- replaced with /var/log/ceph/ceph-client.admin.505660.log.gz 2023-11-13T18:43:48.778 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.432391.log: 81.1% -- replaced with /var/log/ceph/ceph-client.admin.426516.log.gz 2023-11-13T18:43:48.779 INFO:teuthology.orchestra.run.smithi102.stderr: 93.6% -- replaced with /var/log/ceph/ceph-client.admin.454770.log.gz 2023-11-13T18:43:48.779 INFO:teuthology.orchestra.run.smithi102.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.426123.log.gz 2023-11-13T18:43:48.780 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.160868.log 2023-11-13T18:43:48.782 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.423566.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.168993.log 2023-11-13T18:43:48.785 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.160868.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.131960.log 2023-11-13T18:43:48.786 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.168993.log: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.455625.log.gz 2023-11-13T18:43:48.786 INFO:teuthology.orchestra.run.smithi102.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.47121.log.gz 2023-11-13T18:43:48.787 INFO:teuthology.orchestra.run.smithi102.stderr: 78.8% -- replaced with /var/log/ceph/ceph-client.admin.494937.log.gz 2023-11-13T18:43:48.787 INFO:teuthology.orchestra.run.smithi102.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.44649.log.gz 2023-11-13T18:43:48.789 INFO:teuthology.orchestra.run.smithi102.stderr: 93.6% -- replaced with /var/log/ceph/ceph-client.admin.192270.log.gz 2023-11-13T18:43:48.789 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.470196.log 2023-11-13T18:43:48.791 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.131960.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.44448.log.gz 2023-11-13T18:43:48.791 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.188947.log 2023-11-13T18:43:48.793 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.470196.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.48198.log.gz 2023-11-13T18:43:48.793 INFO:teuthology.orchestra.run.smithi102.stderr: 81.3% -- replaced with /var/log/ceph/ceph-client.admin.134029.log.gz 2023-11-13T18:43:48.794 INFO:teuthology.orchestra.run.smithi102.stderr: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.443525.log.gz 2023-11-13T18:43:48.795 INFO:teuthology.orchestra.run.smithi102.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.481842.log.gz 2023-11-13T18:43:48.795 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.226873.log 2023-11-13T18:43:48.798 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose/var/log/ceph/ceph-client.admin.188947.log: -- /var/log/ceph/ceph-client.admin.454761.log 2023-11-13T18:43:48.801 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.226873.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.254962.log 2023-11-13T18:43:48.803 INFO:teuthology.orchestra.run.smithi102.stderr: 81.6% -- replaced with /var/log/ceph/ceph-client.admin.331162.log.gz 2023-11-13T18:43:48.803 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.454761.log: 78.8% -- replaced with /var/log/ceph/ceph-client.admin.432391.log.gz 2023-11-13T18:43:48.804 INFO:teuthology.orchestra.run.smithi102.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.398940.log.gz 2023-11-13T18:43:48.805 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.187736.log 2023-11-13T18:43:48.806 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.254962.log: 78.6% -- replaced with /var/log/ceph/ceph-client.admin.436881.log.gz 2023-11-13T18:43:48.808 INFO:teuthology.orchestra.run.smithi102.stderr: 81.3% -- replaced with /var/log/ceph/ceph-client.admin.303968.log.gz 2023-11-13T18:43:48.808 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48066.log 2023-11-13T18:43:48.809 INFO:teuthology.orchestra.run.smithi102.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.439131.log.gz 2023-11-13T18:43:48.809 INFO:teuthology.orchestra.run.smithi102.stderr: 96.6% -- replaced with /var/log/ceph/ceph-client.admin.491692.log.gz 2023-11-13T18:43:48.811 INFO:teuthology.orchestra.run.smithi102.stderr: 81.4% -- replaced with /var/log/ceph/ceph-client.admin.429837.log.gz 2023-11-13T18:43:48.812 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.187736.log: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.370932.log.gz 2023-11-13T18:43:48.812 INFO:teuthology.orchestra.run.smithi102.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.386299.log.gz 2023-11-13T18:43:48.813 INFO:teuthology.orchestra.run.smithi102.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.373402.log.gz 2023-11-13T18:43:48.813 INFO:teuthology.orchestra.run.smithi102.stderr: 81.2% -- replaced with /var/log/ceph/ceph-client.admin.423566.log.gz 2023-11-13T18:43:48.813 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.511505.log 2023-11-13T18:43:48.814 INFO:teuthology.orchestra.run.smithi102.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.384639.log.gz 2023-11-13T18:43:48.815 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.434287.log 2023-11-13T18:43:48.815 INFO:teuthology.orchestra.run.smithi102.stderr: 92.4% -- replaced with /var/log/ceph/ceph-client.admin.135250.log.gz 2023-11-13T18:43:48.817 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.48066.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.47768.log.gz 2023-11-13T18:43:48.817 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.511505.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.244437.log 2023-11-13T18:43:48.818 INFO:teuthology.orchestra.run.smithi102.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.511505.log.gz 2023-11-13T18:43:48.819 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.434287.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.212419.log 2023-11-13T18:43:48.821 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.244437.log: 94.3% -- replaced with /var/log/ceph/ceph-client.admin.335878.log.gz 2023-11-13T18:43:48.822 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.87407.log 2023-11-13T18:43:48.824 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.383393.log 2023-11-13T18:43:48.825 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.212419.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.223369.log 2023-11-13T18:43:48.827 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.383393.log: /var/log/ceph/ceph-client.admin.87407.log: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.370531.log.gz 2023-11-13T18:43:48.828 INFO:teuthology.orchestra.run.smithi102.stderr: 79.3% -- replaced with /var/log/ceph/ceph-client.admin.442710.log.gz 2023-11-13T18:43:48.828 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.492989.log 2023-11-13T18:43:48.830 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.223369.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.243626.log 2023-11-13T18:43:48.831 INFO:teuthology.orchestra.run.smithi102.stderr: 93.2% -- replaced with /var/log/ceph/ceph-client.admin.420671.log.gz 2023-11-13T18:43:48.833 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.492989.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.489113.log 2023-11-13T18:43:48.835 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.243626.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47616.log 2023-11-13T18:43:48.835 INFO:teuthology.orchestra.run.smithi102.stderr: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.492989.log.gz 2023-11-13T18:43:48.837 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.489113.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107724.log 2023-11-13T18:43:48.838 INFO:teuthology.orchestra.run.smithi102.stderr: 84.6% -- replaced with /var/log/ceph/ceph-client.admin.489113.log.gz 2023-11-13T18:43:48.839 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.47616.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.335029.log 2023-11-13T18:43:48.842 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.107724.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.257421.log 2023-11-13T18:43:48.845 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.335029.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90443.log 2023-11-13T18:43:48.849 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.257421.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46034.log 2023-11-13T18:43:48.850 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.235024.log 2023-11-13T18:43:48.852 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.90443.log: /var/log/ceph/ceph-client.admin.46034.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.256613.log 2023-11-13T18:43:48.854 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102003.log 2023-11-13T18:43:48.856 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.235024.log: /var/log/ceph/ceph-client.admin.256613.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.175985.log 2023-11-13T18:43:48.859 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.102003.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.346674.log 2023-11-13T18:43:48.862 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.175985.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46086.log 2023-11-13T18:43:48.863 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.346674.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108529.log 2023-11-13T18:43:48.866 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.46086.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44435.log 2023-11-13T18:43:48.868 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.108529.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44441.log 2023-11-13T18:43:48.869 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose --/var/log/ceph/ceph-client.admin.44435.log: /var/log/ceph/ceph-client.admin.255399.log 2023-11-13T18:43:48.872 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.44441.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.343050.log 2023-11-13T18:43:48.875 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.255399.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47898.log 2023-11-13T18:43:48.878 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.343050.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.318728.log 2023-11-13T18:43:48.880 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.186932.log 2023-11-13T18:43:48.881 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.47898.log: /var/log/ceph/ceph-client.admin.318728.log: 90.4% -- replaced with /var/log/ceph/ceph-client.admin.301148.log.gz 2023-11-13T18:43:48.881 INFO:teuthology.orchestra.run.smithi102.stderr: 79.4% -- replaced with /var/log/ceph/ceph-client.admin.254962.log.gz 2023-11-13T18:43:48.883 INFO:teuthology.orchestra.run.smithi102.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.244437.log.gz 2023-11-13T18:43:48.884 INFO:teuthology.orchestra.run.smithi102.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.211160.log.gz 2023-11-13T18:43:48.884 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105699.log 2023-11-13T18:43:48.885 INFO:teuthology.orchestra.run.smithi102.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.208718.log.gz 2023-11-13T18:43:48.885 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.88297.log 2023-11-13T18:43:48.887 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.186932.log: /var/log/ceph/ceph-client.admin.105699.log: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.223369.log.gz 2023-11-13T18:43:48.887 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.244840.log 2023-11-13T18:43:48.888 INFO:teuthology.orchestra.run.smithi102.stderr: 79.5% -- replaced with /var/log/ceph/ceph-client.admin.158843.log.gz 2023-11-13T18:43:48.889 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.88297.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.507351.log 2023-11-13T18:43:48.890 INFO:teuthology.orchestra.run.smithi102.stderr: 80.9% -- replaced with /var/log/ceph/ceph-client.admin.160868.log.gz 2023-11-13T18:43:48.891 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.244840.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.213226.log 2023-11-13T18:43:48.894 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.507351.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.459471.log 2023-11-13T18:43:48.894 INFO:teuthology.orchestra.run.smithi102.stderr: 81.3% -- replaced with /var/log/ceph/ceph-client.admin.168993.log.gz 2023-11-13T18:43:48.895 INFO:teuthology.orchestra.run.smithi102.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.108941.log.gz 2023-11-13T18:43:48.896 INFO:teuthology.orchestra.run.smithi102.stderr: 93.0% -- replaced with /var/log/ceph/ceph-client.admin.136160.log.gz 2023-11-13T18:43:48.897 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.213226.log: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.485467.log.gz 2023-11-13T18:43:48.897 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101572.log 2023-11-13T18:43:48.899 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.459471.log: 79.5% -- replaced with /var/log/ceph/ceph-client.admin.406034.log.gz 2023-11-13T18:43:48.899 INFO:teuthology.orchestra.run.smithi102.stderr: 81.3% -- replaced with /var/log/ceph/ceph-client.admin.401933.log.gz 2023-11-13T18:43:48.900 INFO:teuthology.orchestra.run.smithi102.stderr: 78.9% -- replaced with /var/log/ceph/ceph-client.admin.333370.log.gz 2023-11-13T18:43:48.902 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.217451.log 2023-11-13T18:43:48.902 INFO:teuthology.orchestra.run.smithi102.stderr: 80.9% -- replaced with /var/log/ceph/ceph-client.admin.336311.log.gz 2023-11-13T18:43:48.903 INFO:teuthology.orchestra.run.smithi102.stderr: 81.3% -- replaced with /var/log/ceph/ceph-client.admin.342168.log.gz 2023-11-13T18:43:48.904 INFO:teuthology.orchestra.run.smithi102.stderr: 92.3% -- replaced with /var/log/ceph/ceph-client.admin.507351.log.gz 2023-11-13T18:43:48.904 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.430239.log 2023-11-13T18:43:48.906 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.101572.log: /var/log/ceph/ceph-client.admin.217451.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.195164.log 2023-11-13T18:43:48.908 INFO:teuthology.orchestra.run.smithi102.stderr:gzip/var/log/ceph/ceph-client.admin.430239.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.182879.log 2023-11-13T18:43:48.910 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.195164.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.369557.log 2023-11-13T18:43:48.912 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.489927.log 2023-11-13T18:43:48.913 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.182879.log: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.330239.log.gz 2023-11-13T18:43:48.915 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.369557.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.201439.log 2023-11-13T18:43:48.916 INFO:teuthology.orchestra.run.smithi102.stderr: 79.0% -- replaced with /var/log/ceph/ceph-client.admin.173427.log.gz 2023-11-13T18:43:48.916 INFO:teuthology.orchestra.run.smithi102.stderr: 78.3% -- replaced with /var/log/ceph/ceph-client.admin.217451.log.gz 2023-11-13T18:43:48.918 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.489927.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.248176.log 2023-11-13T18:43:48.919 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.246504.log 2023-11-13T18:43:48.922 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.248176.log: /var/log/ceph/ceph-client.admin.201439.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.211552.log 2023-11-13T18:43:48.923 INFO:teuthology.orchestra.run.smithi102.stderr: 81.6% -- replaced with /var/log/ceph/ceph-client.admin.255399.log.gz 2023-11-13T18:43:48.923 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.134038.log 2023-11-13T18:43:48.925 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.211552.log: /var/log/ceph/ceph-client.admin.246504.log: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.489927.log.gz 2023-11-13T18:43:48.925 INFO:teuthology.orchestra.run.smithi102.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.308835.log.gz 2023-11-13T18:43:48.926 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.458667.log 2023-11-13T18:43:48.929 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.134038.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110141.log 2023-11-13T18:43:48.929 INFO:teuthology.orchestra.run.smithi102.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.200644.log.gz 2023-11-13T18:43:48.931 INFO:teuthology.orchestra.run.smithi102.stderr: 84.2% -- replaced with /var/log/ceph/ceph-client.admin.210748.log.gz 2023-11-13T18:43:48.932 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.458667.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.158040.log 2023-11-13T18:43:48.934 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.110141.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.223768.log 2023-11-13T18:43:48.937 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.158040.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.319139.log 2023-11-13T18:43:48.941 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.223768.log: 80.9% -- replaced with /var/log/ceph/ceph-client.admin.318728.log.gz 2023-11-13T18:43:48.941 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.426114.log 2023-11-13T18:43:48.944 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.320755.log 2023-11-13T18:43:48.945 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.426114.log: /var/log/ceph/ceph-client.admin.319139.log: 93.6% -- replaced with /var/log/ceph/ceph-client.admin.176854.log.gz 2023-11-13T18:43:48.947 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105304.log 2023-11-13T18:43:48.949 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.320755.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.375456.log 2023-11-13T18:43:48.950 INFO:teuthology.orchestra.run.smithi102.stderr: 81.9% -- replaced with /var/log/ceph/ceph-client.admin.240801.log.gz 2023-11-13T18:43:48.951 INFO:teuthology.orchestra.run.smithi102.stderr: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.213226.log.gz 2023-11-13T18:43:48.953 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.105304.log: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.211552.log.gz 2023-11-13T18:43:48.953 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.318335.log 2023-11-13T18:43:48.953 INFO:teuthology.orchestra.run.smithi102.stderr: 84.4% -- replaced with /var/log/ceph/ceph-client.admin.186932.log.gz 2023-11-13T18:43:48.954 INFO:teuthology.orchestra.run.smithi102.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.391179.log.gz 2023-11-13T18:43:48.956 INFO:teuthology.orchestra.run.smithi102.stderr: 92.0% -- replaced with /var/log/ceph/ceph-client.admin.393220.log.gz 2023-11-13T18:43:48.956 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.375456.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.510379.log 2023-11-13T18:43:48.957 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.394869.log 2023-11-13T18:43:48.957 INFO:teuthology.orchestra.run.smithi102.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.244840.log.gz 2023-11-13T18:43:48.959 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.318335.log: /var/log/ceph/ceph-client.admin.510379.log: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.510379.log.gz 2023-11-13T18:43:48.960 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.394054.log 2023-11-13T18:43:48.962 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.394869.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.347623.log 2023-11-13T18:43:48.964 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.394054.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.425182.log 2023-11-13T18:43:48.966 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.347623.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.457388.log 2023-11-13T18:43:48.968 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.437317.log 2023-11-13T18:43:48.970 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.425182.log: /var/log/ceph/ceph-client.admin.457388.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.194371.log 2023-11-13T18:43:48.972 INFO:teuthology.orchestra.run.smithi102.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.47147.log.gz 2023-11-13T18:43:48.973 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.437317.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.196379.log 2023-11-13T18:43:48.973 INFO:teuthology.orchestra.run.smithi102.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.47173.log.gz 2023-11-13T18:43:48.975 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.194371.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.48066.log.gz 2023-11-13T18:43:48.976 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.192691.log 2023-11-13T18:43:48.977 INFO:teuthology.orchestra.run.smithi102.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.48172.log.gz 2023-11-13T18:43:48.978 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.196379.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.415191.log 2023-11-13T18:43:48.979 INFO:teuthology.orchestra.run.smithi102.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.47742.log.gz 2023-11-13T18:43:48.980 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.192691.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.168131.log 2023-11-13T18:43:48.982 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.415191.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.309233.log 2023-11-13T18:43:48.985 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.168131.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.326076.log 2023-11-13T18:43:48.986 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.309233.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.238309.log 2023-11-13T18:43:48.989 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.326076.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.493397.log 2023-11-13T18:43:48.991 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.238309.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110552.log 2023-11-13T18:43:48.993 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.493397.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.336320.log 2023-11-13T18:43:48.994 INFO:teuthology.orchestra.run.smithi102.stderr: 80.6% -- replaced with /var/log/ceph/ceph-client.admin.88297.log.gz 2023-11-13T18:43:48.995 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.110552.log: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.493397.log.gz 2023-11-13T18:43:48.996 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.201850.log 2023-11-13T18:43:48.998 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.336320.log: 81.5% -- replaced with /var/log/ceph/ceph-client.admin.107724.log.gz 2023-11-13T18:43:48.998 INFO:teuthology.orchestra.run.smithi102.stderr: 81.4% -- replaced with /var/log/ceph/ceph-client.admin.99169.log.gz 2023-11-13T18:43:48.999 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- 90.0% -- replaced with /var/log/ceph/ceph-client.admin.110552.log.gz 2023-11-13T18:43:48.999 INFO:teuthology.orchestra.run.smithi102.stderr: /var/log/ceph/ceph-client.admin.191409.log 2023-11-13T18:43:49.000 INFO:teuthology.orchestra.run.smithi102.stderr: 81.5% -- replaced with /var/log/ceph/ceph-client.admin.136151.log.gz 2023-11-13T18:43:49.000 INFO:teuthology.orchestra.run.smithi102.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.105304.log.gz 2023-11-13T18:43:49.001 INFO:teuthology.orchestra.run.smithi102.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.134038.log.gz 2023-11-13T18:43:49.003 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.201850.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.387108.log 2023-11-13T18:43:49.005 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.228503.log 2023-11-13T18:43:49.006 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.191409.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.257015.log 2023-11-13T18:43:49.008 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.387108.log: /var/log/ceph/ceph-client.admin.228503.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.489515.log 2023-11-13T18:43:49.010 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.257015.log: 79.1% -- replaced with /var/log/ceph/ceph-client.admin.477799.log.gz 2023-11-13T18:43:49.011 INFO:teuthology.orchestra.run.smithi102.stderr: 85.3% -- replaced with /var/log/ceph/ceph-client.admin.347623.log.gz 2023-11-13T18:43:49.012 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.443927.log 2023-11-13T18:43:49.014 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.489515.log: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.336320.log.gz 2023-11-13T18:43:49.014 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.173861.log 2023-11-13T18:43:49.015 INFO:teuthology.orchestra.run.smithi102.stderr: 78.0% -- replaced with /var/log/ceph/ceph-client.admin.489515.log.gz 2023-11-13T18:43:49.016 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.443927.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.488655.log 2023-11-13T18:43:49.018 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.173861.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.301555.log 2023-11-13T18:43:49.019 INFO:teuthology.orchestra.run.smithi102.stderr: 78.4% -- replaced with /var/log/ceph/ceph-client.admin.93519.log.gz 2023-11-13T18:43:49.019 INFO:teuthology.orchestra.run.smithi102.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.94333.log.gz 2023-11-13T18:43:49.020 INFO:teuthology.orchestra.run.smithi102.stderr: 83.5% -- replaced with /var/log/ceph/ceph-client.admin.94727.log.gz 2023-11-13T18:43:49.021 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.488655.log: 81.2% -- replaced with /var/log/ceph/ceph-client.admin.437317.log.gz 2023-11-13T18:43:49.022 INFO:teuthology.orchestra.run.smithi102.stderr: 84.1% -- replaced with /var/log/ceph/ceph-client.admin.319934.log.gz 2023-11-13T18:43:49.022 INFO:teuthology.orchestra.run.smithi102.stderr: 81.3% -- replaced with /var/log/ceph/ceph-client.admin.173861.log.gz 2023-11-13T18:43:49.022 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139749.log 2023-11-13T18:43:49.023 INFO:teuthology.orchestra.run.smithi102.stderr: 81.2% -- replaced with /var/log/ceph/ceph-client.admin.370923.log.gz 2023-11-13T18:43:49.024 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.301555.log: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.212822.log.gz 2023-11-13T18:43:49.025 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106517.log 2023-11-13T18:43:49.027 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.497203.log 2023-11-13T18:43:49.028 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.139749.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140671.log 2023-11-13T18:43:49.029 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.106517.log: /var/log/ceph/ceph-client.admin.497203.log: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.497203.log.gz 2023-11-13T18:43:49.031 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.436890.log 2023-11-13T18:43:49.031 INFO:teuthology.orchestra.run.smithi102.stderr: 92.9% -- replaced with /var/log/ceph/ceph-client.admin.488655.log.gz 2023-11-13T18:43:49.033 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.140671.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.435670.log 2023-11-13T18:43:49.035 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.436890.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.417204.log 2023-11-13T18:43:49.038 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.446893.log 2023-11-13T18:43:49.040 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.435670.log: /var/log/ceph/ceph-client.admin.417204.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.233812.log 2023-11-13T18:43:49.041 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.165951.log 2023-11-13T18:43:49.043 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.446893.log: /var/log/ceph/ceph-client.admin.233812.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.374207.log 2023-11-13T18:43:49.045 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.165951.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.486726.log 2023-11-13T18:43:49.048 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.374207.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.376548.log 2023-11-13T18:43:49.050 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.486726.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.164696.log 2023-11-13T18:43:49.052 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.376548.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.457397.log 2023-11-13T18:43:49.054 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.207106.log 2023-11-13T18:43:49.056 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.164696.log: /var/log/ceph/ceph-client.admin.457397.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.194772.log 2023-11-13T18:43:49.058 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.207106.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.326085.log 2023-11-13T18:43:49.061 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.194772.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.230175.log 2023-11-13T18:43:49.063 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.326085.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.381150.log 2023-11-13T18:43:49.065 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.230175.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.190562.log 2023-11-13T18:43:49.067 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.381150.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44863.log 2023-11-13T18:43:49.069 INFO:teuthology.orchestra.run.smithi102.stderr: 77.8% 81.4% -- replaced with /var/log/ceph/ceph-client.admin.190969.log.gz -- replaced with /var/log/ceph/ceph-client.admin.192691.log.gz 2023-11-13T18:43:49.070 INFO:teuthology.orchestra.run.smithi102.stderr: 2023-11-13T18:43:49.070 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.190562.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.339970.log 2023-11-13T18:43:49.071 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.423575.log 2023-11-13T18:43:49.072 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.44863.log: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.228110.log.gz 2023-11-13T18:43:49.074 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.339970.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.214431.log 2023-11-13T18:43:49.075 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43714.log 2023-11-13T18:43:49.078 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.423575.log: /var/log/ceph/ceph-client.admin.214431.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.365330.log 2023-11-13T18:43:49.080 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.43714.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.2.45540.log 2023-11-13T18:43:49.081 INFO:teuthology.orchestra.run.smithi102.stderr: 90.7% -- replaced with /var/log/ceph/ceph-client.admin.394869.log.gz 2023-11-13T18:43:49.083 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.365330.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45774.log 2023-11-13T18:43:49.085 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.307209.log 2023-11-13T18:43:49.087 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.2.45540.log: /var/log/ceph/ceph-client.admin.45774.log: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.252770.log.gz 2023-11-13T18:43:49.088 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.198173.log 2023-11-13T18:43:49.088 INFO:teuthology.orchestra.run.smithi102.stderr: 80.7% -- replaced with /var/log/ceph/ceph-client.admin.94324.log.gz 2023-11-13T18:43:49.089 INFO:teuthology.orchestra.run.smithi102.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.433360.log.gz 2023-11-13T18:43:49.090 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.307209.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.397291.log 2023-11-13T18:43:49.092 INFO:teuthology.orchestra.run.smithi102.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.47898.log.gz 2023-11-13T18:43:49.092 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose/var/log/ceph/ceph-client.admin.198173.log: -- /var/log/ceph/ceph-client.admin.373804.log 2023-11-13T18:43:49.093 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.397291.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.44863.log.gz 2023-11-13T18:43:49.094 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48302.log 2023-11-13T18:43:49.095 INFO:teuthology.orchestra.run.smithi102.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.476599.log.gz 2023-11-13T18:43:49.096 INFO:teuthology.orchestra.run.smithi102.stderr: 90.4% -- replaced with /var/log/ceph/ceph-client.0.45408.log.gz 2023-11-13T18:43:49.097 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.373804.log: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.106517.log.gz 2023-11-13T18:43:49.097 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.444722.log 2023-11-13T18:43:49.101 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.48302.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44233.log 2023-11-13T18:43:49.103 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.444722.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.46777.log.gz 2023-11-13T18:43:49.104 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.481833.log 2023-11-13T18:43:49.105 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44083.log 2023-11-13T18:43:49.107 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.44233.log: /var/log/ceph/ceph-client.admin.481833.log: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.438261.log.gz 2023-11-13T18:43:49.107 INFO:teuthology.orchestra.run.smithi102.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.446426.log.gz 2023-11-13T18:43:49.108 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47716.log 2023-11-13T18:43:49.109 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.44083.log: 81.5% -- replaced with /var/log/ceph/ceph-client.admin.397291.log.gz 2023-11-13T18:43:49.110 INFO:teuthology.orchestra.run.smithi102.stderr: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.365330.log.gz 2023-11-13T18:43:49.111 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.238800.log 2023-11-13T18:43:49.112 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.318737.log 2023-11-13T18:43:49.113 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.238800.log: /var/log/ceph/ceph-client.admin.47716.log: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.435670.log.gz 2023-11-13T18:43:49.113 INFO:teuthology.orchestra.run.smithi102.stderr: 80.9% -- replaced with /var/log/ceph/ceph-client.admin.459471.log.gz 2023-11-13T18:43:49.114 INFO:teuthology.orchestra.run.smithi102.stderr: 82.0% -- replaced with /var/log/ceph/ceph-client.admin.458667.log.gz 2023-11-13T18:43:49.115 INFO:teuthology.orchestra.run.smithi102.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.407075.log.gz 2023-11-13T18:43:49.115 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45584.log 2023-11-13T18:43:49.117 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.318737.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.184921.log 2023-11-13T18:43:49.119 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.45584.log: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.196379.log.gz 2023-11-13T18:43:49.120 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.426927.log 2023-11-13T18:43:49.120 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.184921.log: 78.5% -- replaced with /var/log/ceph/ceph-client.admin.324856.log.gz 2023-11-13T18:43:49.122 INFO:teuthology.orchestra.run.smithi102.stderr: 77.7% -- replaced with /var/log/ceph/ceph-client.admin.444722.log.gz 2023-11-13T18:43:49.124 INFO:teuthology.orchestra.run.smithi102.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.326085.log.gz 2023-11-13T18:43:49.126 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.426927.log: 93.7% -- replaced with /var/log/ceph/ceph-client.admin.381208.log.gz 2023-11-13T18:43:49.131 INFO:teuthology.orchestra.run.smithi102.stderr: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.198173.log.gz 2023-11-13T18:43:49.132 INFO:teuthology.orchestra.run.smithi102.stderr: 77.6% -- replaced with /var/log/ceph/ceph-client.admin.139749.log.gz 2023-11-13T18:43:49.133 INFO:teuthology.orchestra.run.smithi102.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.218470.log.gz 2023-11-13T18:43:49.137 INFO:teuthology.orchestra.run.smithi102.stderr: 80.8% -- replaced with /var/log/ceph/ceph-client.admin.102801.log.gz 2023-11-13T18:43:49.138 INFO:teuthology.orchestra.run.smithi102.stderr: 81.5% -- replaced with /var/log/ceph/ceph-client.admin.105699.log.gz 2023-11-13T18:43:49.146 INFO:teuthology.orchestra.run.smithi102.stderr: 80.9% -- replaced with /var/log/ceph/ceph-client.admin.304778.log.gz 2023-11-13T18:43:49.148 INFO:teuthology.orchestra.run.smithi102.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.453938.log.gz 2023-11-13T18:43:49.149 INFO:teuthology.orchestra.run.smithi102.stderr: 81.0% -- replaced with /var/log/ceph/ceph-client.admin.184921.log.gz 2023-11-13T18:43:49.150 INFO:teuthology.orchestra.run.smithi102.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.238800.log.gz 2023-11-13T18:43:49.150 INFO:teuthology.orchestra.run.smithi102.stderr: 81.5% -- replaced with /var/log/ceph/ceph-client.admin.456419.log.gz 2023-11-13T18:43:49.151 INFO:teuthology.orchestra.run.smithi102.stderr: 77.7% -- replaced with /var/log/ceph/ceph-client.admin.190562.log.gz 2023-11-13T18:43:49.152 INFO:teuthology.orchestra.run.smithi102.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.315124.log.gz 2023-11-13T18:43:49.185 INFO:teuthology.orchestra.run.smithi102.stderr: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.223768.log.gz 2023-11-13T18:43:49.188 INFO:teuthology.orchestra.run.smithi102.stderr: 85.3% -- replaced with /var/log/ceph/ceph-client.admin.160054.log.gz 2023-11-13T18:43:49.189 INFO:teuthology.orchestra.run.smithi102.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.158040.log.gz 2023-11-13T18:43:49.189 INFO:teuthology.orchestra.run.smithi102.stderr: 80.9% -- replaced with /var/log/ceph/ceph-client.admin.165951.log.gz 2023-11-13T18:43:49.191 INFO:teuthology.orchestra.run.smithi102.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.47199.log.gz 2023-11-13T18:43:49.194 INFO:teuthology.orchestra.run.smithi102.stderr: 85.5% -- replaced with /var/log/ceph/ceph-client.admin.299930.log.gz 2023-11-13T18:43:49.196 INFO:teuthology.orchestra.run.smithi102.stderr: 83.7% -- replaced with /var/log/ceph/ceph-client.admin.106914.log.gz 2023-11-13T18:43:49.196 INFO:teuthology.orchestra.run.smithi102.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.47716.log.gz 2023-11-13T18:43:49.199 INFO:teuthology.orchestra.run.smithi102.stderr: 78.5% -- replaced with /var/log/ceph/ceph-client.admin.405628.log.gz 2023-11-13T18:43:49.205 INFO:teuthology.orchestra.run.smithi102.stderr: 85.9% -- replaced with /var/log/ceph/ceph-client.admin.481833.log.gz 2023-11-13T18:43:49.217 INFO:teuthology.orchestra.run.smithi102.stderr: 81.3% -- replaced with /var/log/ceph/ceph-client.admin.421110.log.gz 2023-11-13T18:43:49.217 INFO:teuthology.orchestra.run.smithi102.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.399342.log.gz 2023-11-13T18:43:49.223 INFO:teuthology.orchestra.run.smithi102.stderr: 90.5% -- replaced with /var/log/ceph/ceph-client.admin.301555.log.gz 2023-11-13T18:43:49.224 INFO:teuthology.orchestra.run.smithi102.stderr: 93.4% -- replaced with /var/log/ceph/ceph-client.admin.164696.log.gz 2023-11-13T18:43:49.225 INFO:teuthology.orchestra.run.smithi102.stderr: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.318737.log.gz 2023-11-13T18:43:49.228 INFO:teuthology.orchestra.run.smithi102.stderr: 92.1% -- replaced with /var/log/ceph/ceph-client.admin.339970.log.gz 2023-11-13T18:43:49.233 INFO:teuthology.orchestra.run.smithi102.stderr: 79.3% -- replaced with /var/log/ceph/ceph-client.admin.199379.log.gz 2023-11-13T18:43:49.233 INFO:teuthology.orchestra.run.smithi102.stderr: 77.9% -- replaced with /var/log/ceph/ceph-client.admin.466257.log.gz 2023-11-13T18:43:49.234 INFO:teuthology.orchestra.run.smithi102.stderr: 81.4% -- replaced with /var/log/ceph/ceph-client.admin.218461.log.gz 2023-11-13T18:43:49.240 INFO:teuthology.orchestra.run.smithi102.stderr: 92.0% -- replaced with /var/log/ceph/ceph-client.admin.247319.log.gz 2023-11-13T18:43:49.241 INFO:teuthology.orchestra.run.smithi102.stderr: 93.9% -- replaced with /var/log/ceph/ceph-client.admin.345211.log.gz 2023-11-13T18:43:49.242 INFO:teuthology.orchestra.run.smithi102.stderr: 80.8% -- replaced with /var/log/ceph/ceph-client.admin.418917.log.gz 2023-11-13T18:43:49.243 INFO:teuthology.orchestra.run.smithi102.stderr: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.418043.log.gz 2023-11-13T18:43:49.247 INFO:teuthology.orchestra.run.smithi102.stderr: 85.4% -- replaced with /var/log/ceph/ceph-client.admin.160461.log.gz 2023-11-13T18:43:49.250 INFO:teuthology.orchestra.run.smithi102.stderr: 81.3% -- replaced with /var/log/ceph/ceph-client.admin.193527.log.gz 2023-11-13T18:43:49.251 INFO:teuthology.orchestra.run.smithi102.stderr: 81.2% -- replaced with /var/log/ceph/ceph-client.admin.143326.log.gz 2023-11-13T18:43:49.252 INFO:teuthology.orchestra.run.smithi102.stderr: 78.3% -- replaced with /var/log/ceph/ceph-client.admin.316319.log.gz 2023-11-13T18:43:49.252 INFO:teuthology.orchestra.run.smithi102.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.202658.log.gz 2023-11-13T18:43:49.261 INFO:teuthology.orchestra.run.smithi102.stderr: 93.7% -- replaced with /var/log/ceph/ceph-client.admin.191840.log.gz 2023-11-13T18:43:49.268 INFO:teuthology.orchestra.run.smithi102.stderr: 77.6% -- replaced with /var/log/ceph/ceph-client.admin.454761.log.gz 2023-11-13T18:43:49.281 INFO:teuthology.orchestra.run.smithi102.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.44233.log.gz 2023-11-13T18:43:49.306 INFO:teuthology.orchestra.run.smithi102.stderr: 81.1% -- replaced with /var/log/ceph/ceph-client.admin.426114.log.gz 2023-11-13T18:43:49.306 INFO:teuthology.orchestra.run.smithi102.stderr: 85.2% -- replaced with /var/log/ceph/ceph-client.admin.457388.log.gz 2023-11-13T18:43:49.309 INFO:teuthology.orchestra.run.smithi102.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.457867.log.gz 2023-11-13T18:43:49.310 INFO:teuthology.orchestra.run.smithi102.stderr: 78.2% -- replaced with /var/log/ceph/ceph-client.admin.90443.log.gz 2023-11-13T18:43:49.317 INFO:teuthology.orchestra.run.smithi102.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.479018.log.gz 2023-11-13T18:43:49.331 INFO:teuthology.orchestra.run.smithi102.stderr: 93.6% -- replaced with /var/log/ceph/ceph-client.admin.182448.log.gz 2023-11-13T18:43:49.336 INFO:teuthology.orchestra.run.smithi102.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.46960.log.gz 2023-11-13T18:43:49.338 INFO:teuthology.orchestra.run.smithi102.stderr: 91.8% -- replaced with /var/log/ceph/ceph-client.admin.254490.log.gz 2023-11-13T18:43:49.342 INFO:teuthology.orchestra.run.smithi102.stderr: 81.1% -- replaced with /var/log/ceph/ceph-client.admin.478604.log.gz 2023-11-13T18:43:49.342 INFO:teuthology.orchestra.run.smithi102.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.103613.log.gz 2023-11-13T18:43:49.362 INFO:teuthology.orchestra.run.smithi102.stderr: 85.3% -- replaced with /var/log/ceph/ceph-client.admin.434287.log.gz 2023-11-13T18:43:49.369 INFO:teuthology.orchestra.run.smithi102.stderr: 78.2% -- replaced with /var/log/ceph/ceph-client.admin.372157.log.gz 2023-11-13T18:43:49.393 INFO:teuthology.orchestra.run.smithi102.stderr: 93.6% -- replaced with /var/log/ceph/ceph-client.admin.174731.log.gz 2023-11-13T18:43:49.396 INFO:teuthology.orchestra.run.smithi102.stderr: 92.3% -- replaced with /var/log/ceph/ceph-client.admin.205257.log.gz 2023-11-13T18:43:49.401 INFO:teuthology.orchestra.run.smithi102.stderr: 93.6% -- replaced with /var/log/ceph/ceph-client.admin.175994.log.gz 2023-11-13T18:43:49.402 INFO:teuthology.orchestra.run.smithi102.stderr: 85.3% -- replaced with /var/log/ceph/ceph-client.admin.389151.log.gz 2023-11-13T18:43:49.407 INFO:teuthology.orchestra.run.smithi102.stderr: 81.5% -- replaced with /var/log/ceph/ceph-client.admin.479817.log.gz 2023-11-13T18:43:49.409 INFO:teuthology.orchestra.run.smithi102.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.48004.log.gz 2023-11-13T18:43:49.409 INFO:teuthology.orchestra.run.smithi102.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.46671.log.gz 2023-11-13T18:43:49.410 INFO:teuthology.orchestra.run.smithi102.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.44239.log.gz 2023-11-13T18:43:49.411 INFO:teuthology.orchestra.run.smithi102.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.45045.log.gz 2023-11-13T18:43:49.412 INFO:teuthology.orchestra.run.smithi102.stderr: 86.1% -- replaced with /var/log/ceph/ceph-client.admin.459069.log.gz 2023-11-13T18:43:49.413 INFO:teuthology.orchestra.run.smithi102.stderr: 81.9% -- replaced with /var/log/ceph/ceph-client.admin.335029.log.gz 2023-11-13T18:43:49.426 INFO:teuthology.orchestra.run.smithi102.stderr: 81.2% -- replaced with /var/log/ceph/ceph-client.admin.231387.log.gz 2023-11-13T18:43:49.428 INFO:teuthology.orchestra.run.smithi102.stderr: 93.0% -- replaced with /var/log/ceph/ceph-client.admin.421521.log.gz 2023-11-13T18:43:49.428 INFO:teuthology.orchestra.run.smithi102.stderr: 80.9% -- replaced with /var/log/ceph/ceph-client.admin.347152.log.gz 2023-11-13T18:43:49.430 INFO:teuthology.orchestra.run.smithi102.stderr: 91.6% -- replaced with /var/log/ceph/ceph-client.admin.348546.log.gz 2023-11-13T18:43:49.433 INFO:teuthology.orchestra.run.smithi102.stderr: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.339157.log.gz 2023-11-13T18:43:49.433 INFO:teuthology.orchestra.run.smithi102.stderr: 81.6% -- replaced with /var/log/ceph/ceph-client.admin.339559.log.gz 2023-11-13T18:43:49.456 INFO:teuthology.orchestra.run.smithi102.stderr: 84.2% -- replaced with /var/log/ceph/ceph-client.admin.312668.log.gz 2023-11-13T18:43:49.457 INFO:teuthology.orchestra.run.smithi102.stderr: 80.9% -- replaced with /var/log/ceph/ceph-client.admin.225384.log.gz 2023-11-13T18:43:49.458 INFO:teuthology.orchestra.run.smithi102.stderr: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.367843.log.gz 2023-11-13T18:43:49.570 INFO:teuthology.orchestra.run.smithi102.stderr: 80.8% -- replaced with /var/log/ceph/ceph-client.admin.86919.log.gz 2023-11-13T18:43:49.580 INFO:teuthology.orchestra.run.smithi102.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.47252.log.gz 2023-11-13T18:43:49.581 INFO:teuthology.orchestra.run.smithi102.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.44226.log.gz 2023-11-13T18:43:49.583 INFO:teuthology.orchestra.run.smithi102.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.44993.log.gz 2023-11-13T18:43:49.583 INFO:teuthology.orchestra.run.smithi102.stderr: 77.7% -- replaced with /var/log/ceph/ceph-client.admin.111754.log.gz 2023-11-13T18:43:49.586 INFO:teuthology.orchestra.run.smithi102.stderr: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.483050.log.gz 2023-11-13T18:43:49.589 INFO:teuthology.orchestra.run.smithi102.stderr: 81.5% -- replaced with /var/log/ceph/ceph-client.admin.320755.log.gz 2023-11-13T18:43:49.590 INFO:teuthology.orchestra.run.smithi102.stderr: 81.5% -- replaced with /var/log/ceph/ceph-client.admin.324454.log.gz 2023-11-13T18:43:49.601 INFO:teuthology.orchestra.run.smithi102.stderr: 80.8% -- replaced with /var/log/ceph/ceph-client.admin.429435.log.gz 2023-11-13T18:43:49.602 INFO:teuthology.orchestra.run.smithi102.stderr: 78.5% -- replaced with /var/log/ceph/ceph-client.admin.430239.log.gz 2023-11-13T18:43:49.613 INFO:teuthology.orchestra.run.smithi102.stderr: 85.6% -- replaced with /var/log/ceph/ceph-client.admin.257015.log.gz 2023-11-13T18:43:49.613 INFO:teuthology.orchestra.run.smithi102.stderr: 77.3% -- replaced with /var/log/ceph/ceph-client.admin.252761.log.gz 2023-11-13T18:43:49.614 INFO:teuthology.orchestra.run.smithi102.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.394054.log.gz 2023-11-13T18:43:49.619 INFO:teuthology.orchestra.run.smithi102.stderr: 81.2% -- replaced with /var/log/ceph/ceph-client.admin.233006.log.gz 2023-11-13T18:43:49.627 INFO:teuthology.orchestra.run.smithi102.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.387108.log.gz 2023-11-13T18:43:49.635 INFO:teuthology.orchestra.run.smithi102.stderr: 93.6% -- replaced with /var/log/ceph/ceph-client.admin.173870.log.gz 2023-11-13T18:43:49.648 INFO:teuthology.orchestra.run.smithi102.stderr: 77.7% -- replaced with /var/log/ceph/ceph-client.admin.213622.log.gz 2023-11-13T18:43:49.657 INFO:teuthology.orchestra.run.smithi102.stderr: 81.4% -- replaced with /var/log/ceph/ceph-client.admin.187736.log.gz 2023-11-13T18:43:49.676 INFO:teuthology.orchestra.run.smithi102.stderr: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.223360.log.gz 2023-11-13T18:43:49.681 INFO:teuthology.orchestra.run.smithi102.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.188147.log.gz 2023-11-13T18:43:49.684 INFO:teuthology.orchestra.run.smithi102.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.194371.log.gz 2023-11-13T18:43:49.688 INFO:teuthology.orchestra.run.smithi102.stderr: 81.5% -- replaced with /var/log/ceph/ceph-client.admin.242811.log.gz 2023-11-13T18:43:49.689 INFO:teuthology.orchestra.run.smithi102.stderr: 84.4% -- replaced with /var/log/ceph/ceph-client.admin.256206.log.gz 2023-11-13T18:43:51.669 INFO:teuthology.orchestra.run.smithi102.stderr: 95.6% -- replaced with /var/log/ceph/ceph-client.admin.405922.log.gz 2023-11-13T18:43:52.211 INFO:teuthology.orchestra.run.smithi102.stderr: 93.6% -- replaced with /var/log/ceph/ceph-client.admin.181156.log.gz 2023-11-13T18:43:52.211 INFO:teuthology.orchestra.run.smithi102.stderr: 92.2% -- replaced with /var/log/ceph/ceph-client.admin.426927.log.gz 2023-11-13T18:43:52.212 INFO:teuthology.orchestra.run.smithi102.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.109746.log.gz 2023-11-13T18:43:52.212 INFO:teuthology.orchestra.run.smithi102.stderr: 81.1% -- replaced with /var/log/ceph/ceph-client.admin.326076.log.gz 2023-11-13T18:43:52.213 INFO:teuthology.orchestra.run.smithi102.stderr: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.378292.log.gz 2023-11-13T18:43:52.213 INFO:teuthology.orchestra.run.smithi102.stderr: 94.3% -- replaced with /var/log/ceph/ceph-client.admin.182879.log.gz 2023-11-13T18:43:52.213 INFO:teuthology.orchestra.run.smithi102.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.46803.log.gz 2023-11-13T18:43:52.360 INFO:teuthology.orchestra.run.smithi102.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.443927.log.gz 2023-11-13T18:43:52.360 INFO:teuthology.orchestra.run.smithi102.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.404797.log.gz 2023-11-13T18:43:52.361 INFO:teuthology.orchestra.run.smithi102.stderr: 78.6% -- replaced with /var/log/ceph/ceph-client.admin.441031.log.gz 2023-11-13T18:43:52.361 INFO:teuthology.orchestra.run.smithi102.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.44135.log.gz 2023-11-13T18:43:52.362 INFO:teuthology.orchestra.run.smithi102.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.319139.log.gz 2023-11-13T18:43:52.364 INFO:teuthology.orchestra.run.smithi102.stderr: 81.0% -- replaced with /var/log/ceph/ceph-client.admin.201439.log.gz 2023-11-13T18:43:52.364 INFO:teuthology.orchestra.run.smithi102.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.230175.log.gz 2023-11-13T18:43:52.365 INFO:teuthology.orchestra.run.smithi102.stderr: 81.5% -- replaced with /var/log/ceph/ceph-client.admin.383393.log.gz 2023-11-13T18:43:52.365 INFO:teuthology.orchestra.run.smithi102.stderr: 80.5% -- replaced with /var/log/ceph/ceph-client.admin.343041.log.gz 2023-11-13T18:43:52.365 INFO:teuthology.orchestra.run.smithi102.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.305194.log.gz 2023-11-13T18:43:52.366 INFO:teuthology.orchestra.run.smithi102.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.195575.log.gz 2023-11-13T18:43:52.366 INFO:teuthology.orchestra.run.smithi102.stderr: 86.1% -- replaced with /var/log/ceph/ceph-client.admin.381150.log.gz 2023-11-13T18:43:52.367 INFO:teuthology.orchestra.run.smithi102.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.45774.log.gz 2023-11-13T18:43:52.367 INFO:teuthology.orchestra.run.smithi102.stderr: 90.4% -- replaced with /var/log/ceph/ceph-client.admin.243626.log.gz 2023-11-13T18:43:52.367 INFO:teuthology.orchestra.run.smithi102.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.196781.log.gz 2023-11-13T18:43:52.600 INFO:teuthology.orchestra.run.smithi102.stderr: 93.1% -- replaced with /var/log/ceph/ceph-client.admin.205689.log.gz 2023-11-13T18:43:53.415 INFO:teuthology.orchestra.run.smithi102.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.419862.log.gz 2023-11-13T18:43:53.428 INFO:teuthology.orchestra.run.smithi102.stderr: 80.7% 90.1% -- replaced with /var/log/ceph/ceph-client.admin.114243.log.gz 2023-11-13T18:43:53.429 INFO:teuthology.orchestra.run.smithi102.stderr: 81.4% -- replaced with /var/log/ceph/ceph-client.admin.159652.log.gz 2023-11-13T18:43:53.429 INFO:teuthology.orchestra.run.smithi102.stderr: 79.4% -- replaced with /var/log/ceph/ceph-client.admin.309233.log.gz 2023-11-13T18:43:53.430 INFO:teuthology.orchestra.run.smithi102.stderr: -- replaced with /var/log/ceph/ceph-client.admin.214431.log.gz 2023-11-13T18:43:53.430 INFO:teuthology.orchestra.run.smithi102.stderr: 81.3% -- replaced with /var/log/ceph/ceph-client.admin.168530.log.gz 2023-11-13T18:43:53.431 INFO:teuthology.orchestra.run.smithi102.stderr: 78.5% -- replaced with /var/log/ceph/ceph-client.admin.170455.log.gz 2023-11-13T18:43:53.431 INFO:teuthology.orchestra.run.smithi102.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.423575.log.gz 2023-11-13T18:43:53.433 INFO:teuthology.orchestra.run.smithi102.stderr: 81.1% -- replaced with /var/log/ceph/ceph-client.admin.110945.log.gz 2023-11-13T18:43:53.433 INFO:teuthology.orchestra.run.smithi102.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.102003.log.gz 2023-11-13T18:43:53.434 INFO:teuthology.orchestra.run.smithi102.stderr: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.176845.log.gz 2023-11-13T18:43:53.434 INFO:teuthology.orchestra.run.smithi102.stderr: 93.7% -- replaced with /var/log/ceph/ceph-client.admin.381111.log.gz 2023-11-13T18:43:53.434 INFO:teuthology.orchestra.run.smithi102.stderr: 77.8% -- replaced with /var/log/ceph/ceph-client.admin.108529.log.gz 2023-11-13T18:43:53.435 INFO:teuthology.orchestra.run.smithi102.stderr: 93.3% -- replaced with /var/log/ceph/ceph-client.admin.140680.log.gz 2023-11-13T18:43:53.437 INFO:teuthology.orchestra.run.smithi102.stderr: 93.6% -- replaced with /var/log/ceph/ceph-client.admin.175161.log.gz 2023-11-13T18:43:53.437 INFO:teuthology.orchestra.run.smithi102.stderr: 93.6% -- replaced with /var/log/ceph/ceph-client.admin.172599.log.gz 2023-11-13T18:43:53.438 INFO:teuthology.orchestra.run.smithi102.stderr: 93.0% -- replaced with /var/log/ceph/ceph-client.admin.313883.log.gz 2023-11-13T18:43:53.438 INFO:teuthology.orchestra.run.smithi102.stderr: 93.8% -- replaced with /var/log/ceph/ceph-client.admin.444731.log.gz 2023-11-13T18:43:53.439 INFO:teuthology.orchestra.run.smithi102.stderr: 93.3% -- replaced with /var/log/ceph/ceph-client.admin.169002.log.gz 2023-11-13T18:43:53.439 INFO:teuthology.orchestra.run.smithi102.stderr: 92.9% -- replaced with /var/log/ceph/ceph-client.admin.89132.log.gz 2023-11-13T18:43:53.439 INFO:teuthology.orchestra.run.smithi102.stderr: 94.3% -- replaced with /var/log/ceph/ceph-client.admin.167226.log.gz 2023-11-13T18:43:53.440 INFO:teuthology.orchestra.run.smithi102.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.427792.log.gz 2023-11-13T18:43:53.440 INFO:teuthology.orchestra.run.smithi102.stderr: 94.3% -- replaced with /var/log/ceph/ceph-client.admin.245675.log.gz 2023-11-13T18:43:53.441 INFO:teuthology.orchestra.run.smithi102.stderr: 79.4% -- replaced with /var/log/ceph/ceph-client.admin.400142.log.gz 2023-11-13T18:43:53.441 INFO:teuthology.orchestra.run.smithi102.stderr: 83.4% 95.2% -- replaced with /var/log/ceph/ceph-client.admin.171268.log.gz 2023-11-13T18:43:53.441 INFO:teuthology.orchestra.run.smithi102.stderr: -- replaced with /var/log/ceph/ceph-client.admin.101161.log.gz 2023-11-13T18:43:53.442 INFO:teuthology.orchestra.run.smithi102.stderr: 82.5% -- replaced with /var/log/ceph/ceph-client.admin.115540.log.gz 2023-11-13T18:43:53.442 INFO:teuthology.orchestra.run.smithi102.stderr: 93.0% 89.7% -- replaced with /var/log/ceph/ceph-client.admin.183720.log.gz -- replaced with /var/log/ceph/ceph-client.admin.485065.log.gz 2023-11-13T18:43:53.442 INFO:teuthology.orchestra.run.smithi102.stderr: 2023-11-13T18:43:53.443 INFO:teuthology.orchestra.run.smithi102.stderr: 93.4% -- replaced with /var/log/ceph/ceph-client.admin.219680.log.gz 2023-11-13T18:43:53.443 INFO:teuthology.orchestra.run.smithi102.stderr: 93.5% -- replaced with /var/log/ceph/ceph-client.admin.206153.log.gz 2023-11-13T18:43:53.444 INFO:teuthology.orchestra.run.smithi102.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.325267.log.gz 2023-11-13T18:43:53.452 INFO:teuthology.orchestra.run.smithi102.stderr: 80.7% -- replaced with /var/log/ceph/ceph-client.admin.110141.log.gz 2023-11-13T18:43:53.453 INFO:teuthology.orchestra.run.smithi102.stderr: 93.6% -- replaced with /var/log/ceph/ceph-client.admin.374616.log.gz 2023-11-13T18:43:53.453 INFO:teuthology.orchestra.run.smithi102.stderr: 93.7% -- replaced with /var/log/ceph/ceph-client.admin.342177.log.gz 2023-11-13T18:43:53.454 INFO:teuthology.orchestra.run.smithi102.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.429444.log.gz 2023-11-13T18:43:53.454 INFO:teuthology.orchestra.run.smithi102.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.430714.log.gz 2023-11-13T18:43:53.454 INFO:teuthology.orchestra.run.smithi102.stderr: 94.5% -- replaced with /var/log/ceph/ceph-client.admin.346189.log.gz 2023-11-13T18:43:53.455 INFO:teuthology.orchestra.run.smithi102.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.44435.log.gz 2023-11-13T18:43:53.455 INFO:teuthology.orchestra.run.smithi102.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.109343.log.gz 2023-11-13T18:43:53.455 INFO:teuthology.orchestra.run.smithi102.stderr: 80.5% -- replaced with /var/log/ceph/ceph-client.admin.107321.log.gz 2023-11-13T18:43:53.456 INFO:teuthology.orchestra.run.smithi102.stderr: 81.4% -- replaced with /var/log/ceph/ceph-client.admin.233812.log.gz 2023-11-13T18:43:53.456 INFO:teuthology.orchestra.run.smithi102.stderr: 84.4% -- replaced with /var/log/ceph/ceph-client.admin.245233.log.gz 2023-11-13T18:43:53.456 INFO:teuthology.orchestra.run.smithi102.stderr: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.212419.log.gz 2023-11-13T18:43:53.457 INFO:teuthology.orchestra.run.smithi102.stderr: 81.4% -- replaced with /var/log/ceph/ceph-client.admin.307209.log.gz 2023-11-13T18:43:53.457 INFO:teuthology.orchestra.run.smithi102.stderr: 81.6% -- replaced with /var/log/ceph/ceph-client.admin.369548.log.gz 2023-11-13T18:43:53.458 INFO:teuthology.orchestra.run.smithi102.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.343050.log.gz 2023-11-13T18:43:53.458 INFO:teuthology.orchestra.run.smithi102.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.45584.log.gz 2023-11-13T18:43:53.458 INFO:teuthology.orchestra.run.smithi102.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.43714.log.gz 2023-11-13T18:43:53.459 INFO:teuthology.orchestra.run.smithi102.stderr: 92.8% -- replaced with /var/log/ceph/ceph-client.admin.131960.log.gz 2023-11-13T18:43:53.459 INFO:teuthology.orchestra.run.smithi102.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.43767.log.gz 2023-11-13T18:43:53.459 INFO:teuthology.orchestra.run.smithi102.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.47616.log.gz 2023-11-13T18:43:53.460 INFO:teuthology.orchestra.run.smithi102.stderr: 81.3% -- replaced with /var/log/ceph/ceph-client.admin.91990.log.gz 2023-11-13T18:43:53.460 INFO:teuthology.orchestra.run.smithi102.stderr: 80.9% -- replaced with /var/log/ceph/ceph-client.admin.248176.log.gz 2023-11-13T18:43:53.460 INFO:teuthology.orchestra.run.smithi102.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.230582.log.gz 2023-11-13T18:43:53.461 INFO:teuthology.orchestra.run.smithi102.stderr: 81.3% -- replaced with /var/log/ceph/ceph-client.admin.192261.log.gz 2023-11-13T18:43:53.461 INFO:teuthology.orchestra.run.smithi102.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.186941.log.gz 2023-11-13T18:43:53.461 INFO:teuthology.orchestra.run.smithi102.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.46034.log.gz 2023-11-13T18:43:53.462 INFO:teuthology.orchestra.run.smithi102.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.415191.log.gz 2023-11-13T18:43:53.462 INFO:teuthology.orchestra.run.smithi102.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.46086.log.gz 2023-11-13T18:43:53.462 INFO:teuthology.orchestra.run.smithi102.stderr: 93.8% -- replaced with /var/log/ceph/ceph-client.admin.345704.log.gz 2023-11-13T18:43:53.463 INFO:teuthology.orchestra.run.smithi102.stderr: 85.2% -- replaced with /var/log/ceph/ceph-client.admin.425182.log.gz 2023-11-13T18:43:53.463 INFO:teuthology.orchestra.run.smithi102.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.390368.log.gz 2023-11-13T18:43:53.463 INFO:teuthology.orchestra.run.smithi102.stderr: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.168131.log.gz 2023-11-13T18:43:53.464 INFO:teuthology.orchestra.run.smithi102.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.44441.log.gz 2023-11-13T18:43:53.464 INFO:teuthology.orchestra.run.smithi102.stderr: 79.3% -- replaced with /var/log/ceph/ceph-client.admin.246504.log.gz 2023-11-13T18:43:53.464 INFO:teuthology.orchestra.run.smithi102.stderr: 78.6% -- replaced with /var/log/ceph/ceph-client.admin.228503.log.gz 2023-11-13T18:43:53.465 INFO:teuthology.orchestra.run.smithi102.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.404396.log.gz 2023-11-13T18:43:53.465 INFO:teuthology.orchestra.run.smithi102.stderr: 88.1% 89.8% -- replaced with /var/log/ceph/ceph-client.admin.48302.log.gz 2023-11-13T18:43:53.465 INFO:teuthology.orchestra.run.smithi102.stderr: -- replaced with /var/log/ceph/ceph-client.admin.214844.log.gz 2023-11-13T18:43:53.466 INFO:teuthology.orchestra.run.smithi102.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.admin.226873.log.gz 2023-11-13T18:43:53.466 INFO:teuthology.orchestra.run.smithi102.stderr: 93.7% -- replaced with /var/log/ceph/ceph-client.admin.428195.log.gz 2023-11-13T18:43:53.466 INFO:teuthology.orchestra.run.smithi102.stderr: 80.7% -- replaced with /var/log/ceph/ceph-client.admin.395266.log.gz 89.9% 2023-11-13T18:43:53.467 INFO:teuthology.orchestra.run.smithi102.stderr: -- replaced with /var/log/ceph/ceph-client.admin.207106.log.gz 2023-11-13T18:43:53.467 INFO:teuthology.orchestra.run.smithi102.stderr: 85.2% -- replaced with /var/log/ceph/ceph-client.admin.184519.log.gz 2023-11-13T18:43:53.467 INFO:teuthology.orchestra.run.smithi102.stderr: 81.0% -- replaced with /var/log/ceph/ceph-client.admin.87407.log.gz 2023-11-13T18:43:53.468 INFO:teuthology.orchestra.run.smithi102.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.44083.log.gz 2023-11-13T18:43:53.468 INFO:teuthology.orchestra.run.smithi102.stderr: 79.1% -- replaced with /var/log/ceph/ceph-client.admin.381199.log.gz 2023-11-13T18:43:53.469 INFO:teuthology.orchestra.run.smithi102.stderr: 81.0% -- replaced with /var/log/ceph/ceph-client.admin.346674.log.gz 2023-11-13T18:43:53.469 INFO:teuthology.orchestra.run.smithi102.stderr: 81.9% -- replaced with /var/log/ceph/ceph-client.admin.345202.log.gz 2023-11-13T18:43:53.469 INFO:teuthology.orchestra.run.smithi102.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.admin.457397.log.gz 2023-11-13T18:43:53.470 INFO:teuthology.orchestra.run.smithi102.stderr: 81.6% -- replaced with /var/log/ceph/ceph-client.admin.188947.log.gz 2023-11-13T18:43:53.470 INFO:teuthology.orchestra.run.smithi102.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.185332.log.gz 2023-11-13T18:43:53.470 INFO:teuthology.orchestra.run.smithi102.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.368678.log.gz 2023-11-13T18:43:53.471 INFO:teuthology.orchestra.run.smithi102.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.201850.log.gz 2023-11-13T18:43:53.471 INFO:teuthology.orchestra.run.smithi102.stderr: 84.2% -- replaced with /var/log/ceph/ceph-client.admin.235024.log.gz 2023-11-13T18:43:53.471 INFO:teuthology.orchestra.run.smithi102.stderr: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.482245.log.gz 2023-11-13T18:43:53.472 INFO:teuthology.orchestra.run.smithi102.stderr: 81.0% -- replaced with /var/log/ceph/ceph-client.admin.162542.log.gz 2023-11-13T18:43:53.472 INFO:teuthology.orchestra.run.smithi102.stderr: 93.6% -- replaced with /var/log/ceph/ceph-client.admin.405637.log.gz 2023-11-13T18:43:53.472 INFO:teuthology.orchestra.run.smithi102.stderr: 93.6% -- replaced with /var/log/ceph/ceph-client.admin.191409.log.gz 2023-11-13T18:43:53.472 INFO:teuthology.orchestra.run.smithi102.stderr: 81.4% -- replaced with /var/log/ceph/ceph-client.admin.195164.log.gz 2023-11-13T18:43:53.473 INFO:teuthology.orchestra.run.smithi102.stderr: 93.6% -- replaced with /var/log/ceph/ceph-client.admin.440062.log.gz 2023-11-13T18:43:53.473 INFO:teuthology.orchestra.run.smithi102.stderr: 81.4% 84.9% -- replaced with /var/log/ceph/ceph-client.admin.256613.log.gz 2023-11-13T18:43:53.473 INFO:teuthology.orchestra.run.smithi102.stderr: -- replaced with /var/log/ceph/ceph-client.admin.257421.log.gz 2023-11-13T18:43:53.474 INFO:teuthology.orchestra.run.smithi102.stderr: 80.8% -- replaced with /var/log/ceph/ceph-client.admin.132775.log.gz 2023-11-13T18:43:53.474 INFO:teuthology.orchestra.run.smithi102.stderr: 85.8% -- replaced with /var/log/ceph/ceph-client.admin.372984.log.gz 2023-11-13T18:43:53.474 INFO:teuthology.orchestra.run.smithi102.stderr: 85.2% -- replaced with /var/log/ceph/ceph-client.admin.433351.log.gz 2023-11-13T18:43:53.475 INFO:teuthology.orchestra.run.smithi102.stderr: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.178135.log.gz 2023-11-13T18:43:53.475 INFO:teuthology.orchestra.run.smithi102.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.310982.log.gz 2023-11-13T18:43:53.475 INFO:teuthology.orchestra.run.smithi102.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.160470.log.gz 2023-11-13T18:43:53.476 INFO:teuthology.orchestra.run.smithi102.stderr: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.446893.log.gz 2023-11-13T18:43:53.476 INFO:teuthology.orchestra.run.smithi102.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.194772.log.gz 2023-11-13T18:43:53.476 INFO:teuthology.orchestra.run.smithi102.stderr: 78.7% -- replaced with /var/log/ceph/ceph-client.admin.373393.log.gz 2023-11-13T18:43:53.477 INFO:teuthology.orchestra.run.smithi102.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.318335.log.gz 2023-11-13T18:43:53.477 INFO:teuthology.orchestra.run.smithi102.stderr: 79.4% -- replaced with /var/log/ceph/ceph-client.admin.175985.log.gz 2023-11-13T18:43:53.477 INFO:teuthology.orchestra.run.smithi102.stderr: 81.2% -- replaced with /var/log/ceph/ceph-client.admin.116794.log.gz 2023-11-13T18:43:53.478 INFO:teuthology.orchestra.run.smithi102.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.43521.log.gz 2023-11-13T18:43:53.478 INFO:teuthology.orchestra.run.smithi102.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.373804.log.gz 2023-11-13T18:43:53.478 INFO:teuthology.orchestra.run.smithi102.stderr: 81.5% -- replaced with /var/log/ceph/ceph-client.admin.141565.log.gz 2023-11-13T18:43:53.479 INFO:teuthology.orchestra.run.smithi102.stderr: 90.3% 80.7% -- replaced with /var/log/ceph/ceph-client.admin.481026.log.gz 2023-11-13T18:43:53.479 INFO:teuthology.orchestra.run.smithi102.stderr: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.374207.log.gz 2023-11-13T18:43:53.479 INFO:teuthology.orchestra.run.smithi102.stderr: 80.8% -- replaced with /var/log/ceph/ceph-client.admin.140671.log.gz 2023-11-13T18:43:53.480 INFO:teuthology.orchestra.run.smithi102.stderr: -- replaced with /var/log/ceph/ceph-client.admin.141976.log.gz 2023-11-13T18:43:53.480 INFO:teuthology.orchestra.run.smithi102.stderr: 80.7% -- replaced with /var/log/ceph/ceph-client.admin.348089.log.gz 2023-11-13T18:43:53.480 INFO:teuthology.orchestra.run.smithi102.stderr: 84.7% -- replaced with /var/log/ceph/ceph-client.admin.480221.log.gz 2023-11-13T18:43:53.496 INFO:teuthology.orchestra.run.smithi102.stderr: 93.1% -- replaced with /var/log/ceph/ceph-client.admin.417204.log.gz 2023-11-13T18:43:53.502 INFO:teuthology.orchestra.run.smithi102.stderr: 93.6% -- replaced with /var/log/ceph/ceph-client.admin.179005.log.gz 2023-11-13T18:43:53.667 INFO:teuthology.orchestra.run.smithi102.stderr: 92.4% -- replaced with /var/log/ceph/ceph-client.admin.117618.log.gz 2023-11-13T18:43:53.854 INFO:teuthology.orchestra.run.smithi102.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.415995.log.gz 2023-11-13T18:43:53.854 INFO:teuthology.orchestra.run.smithi102.stderr: 93.0% -- replaced with /var/log/ceph/ceph-client.admin.436890.log.gz 2023-11-13T18:43:53.857 INFO:teuthology.orchestra.run.smithi102.stderr: 92.4% -- replaced with /var/log/ceph/ceph-client.admin.100739.log.gz 2023-11-13T18:43:53.858 INFO:teuthology.orchestra.run.smithi102.stderr: 92.8% -- replaced with /var/log/ceph/ceph-client.admin.215248.log.gz 2023-11-13T18:43:53.974 INFO:teuthology.orchestra.run.smithi102.stderr: 94.3% -- replaced with /var/log/ceph/ceph-client.admin.387516.log.gz 2023-11-13T18:43:54.118 INFO:teuthology.orchestra.run.smithi102.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.2.45540.log.gz 2023-11-13T18:43:54.332 INFO:teuthology.orchestra.run.smithi102.stderr: 80.9% 94.1% -- replaced with /var/log/ceph/ceph-client.admin.119700.log.gz 2023-11-13T18:43:54.332 INFO:teuthology.orchestra.run.smithi102.stderr: -- replaced with /var/log/ceph/ceph-client.admin.197197.log.gz 2023-11-13T18:43:54.333 INFO:teuthology.orchestra.run.smithi102.stderr: 94.3% -- replaced with /var/log/ceph/ceph-client.admin.348098.log.gz 2023-11-13T18:43:54.333 INFO:teuthology.orchestra.run.smithi102.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.315927.log.gz 2023-11-13T18:43:54.333 INFO:teuthology.orchestra.run.smithi102.stderr: 89.7% 95.2% -- replaced with /var/log/ceph/ceph-client.0.48433.log.gz 2023-11-13T18:43:54.334 INFO:teuthology.orchestra.run.smithi102.stderr: -- replaced with /var/log/ceph/ceph-client.admin.478211.log.gz 2023-11-13T18:43:54.334 INFO:teuthology.orchestra.run.smithi102.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.159661.log.gz 2023-11-13T18:43:54.335 INFO:teuthology.orchestra.run.smithi102.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.46458.log.gz 2023-11-13T18:43:54.336 INFO:teuthology.orchestra.run.smithi102.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.366153.log.gz 2023-11-13T18:43:54.379 INFO:teuthology.orchestra.run.smithi102.stderr: 78.0% -- replaced with /var/log/ceph/ceph-client.admin.212813.log.gz 2023-11-13T18:43:55.155 INFO:teuthology.orchestra.run.smithi102.stderr: 93.4% -- replaced with /var/log/ceph/ceph-client.admin.342630.log.gz 2023-11-13T18:43:55.161 INFO:teuthology.orchestra.run.smithi102.stderr: 89.1% -- replaced with /var/log/ceph/ceph.audit.log.gz 2023-11-13T18:43:55.554 INFO:teuthology.orchestra.run.smithi102.stderr: 94.2% -- replaced with /var/log/ceph/ceph-client.admin.380801.log.gz 2023-11-13T18:43:55.703 INFO:teuthology.orchestra.run.smithi102.stderr: 95.2% -- replaced with /var/log/ceph/ceph-client.admin.381423.log.gz 2023-11-13T18:43:56.171 INFO:teuthology.orchestra.run.smithi102.stderr: 93.9% -- replaced with /var/log/ceph/ceph-client.admin.381062.log.gz 2023-11-13T18:43:56.410 INFO:teuthology.orchestra.run.smithi102.stderr: 93.2% -- replaced with /var/log/ceph/ceph-client.admin.135700.log.gz 2023-11-13T18:43:56.448 INFO:teuthology.orchestra.run.smithi102.stderr: 93.7% -- replaced with /var/log/ceph/ceph-client.admin.381159.log.gz 2023-11-13T18:43:56.703 INFO:teuthology.orchestra.run.smithi102.stderr: 94.2% -- replaced with /var/log/ceph/ceph-client.admin.366993.log.gz 2023-11-13T18:43:56.767 INFO:teuthology.orchestra.run.smithi102.stderr: 95.9% -- replaced with /var/log/ceph/ceph-client.admin.199388.log.gz 2023-11-13T18:43:56.854 INFO:teuthology.orchestra.run.smithi102.stderr: 95.0% -- replaced with /var/log/ceph/ceph-client.admin.369557.log.gz 2023-11-13T18:43:57.206 INFO:teuthology.orchestra.run.smithi102.stderr: 95.6% -- replaced with /var/log/ceph/ceph-client.admin.217460.log.gz 2023-11-13T18:44:00.205 INFO:teuthology.orchestra.run.smithi154.stderr: 93.7% -- replaced with /var/log/ceph/ceph-osd.6.log.gz 2023-11-13T18:44:02.628 INFO:teuthology.orchestra.run.smithi102.stderr: 94.6% -- replaced with /var/log/ceph/ceph-client.admin.86928.log.gz 2023-11-13T18:44:03.449 INFO:teuthology.orchestra.run.smithi102.stderr: 93.6% -- replaced with /var/log/ceph/ceph-client.admin.99178.log.gz 2023-11-13T18:44:04.431 INFO:teuthology.orchestra.run.smithi102.stderr: 94.5% -- replaced with /var/log/ceph/ceph-mds.c.log.gz 2023-11-13T18:44:14.130 INFO:teuthology.orchestra.run.smithi102.stderr: 97.4% -- replaced with /var/log/ceph/ceph-client.admin.369081.log.gz 2023-11-13T18:44:14.454 INFO:teuthology.orchestra.run.smithi102.stderr: 94.4% -- replaced with /var/log/ceph/ceph-client.admin.226275.log.gz 2023-11-13T18:44:17.952 INFO:teuthology.orchestra.run.smithi102.stderr: 95.9% -- replaced with /var/log/ceph/ceph-client.admin.237877.log.gz 2023-11-13T18:44:18.894 INFO:teuthology.orchestra.run.smithi102.stderr: 94.6% -- replaced with /var/log/ceph/ceph-client.admin.376548.log.gz 2023-11-13T18:44:18.898 INFO:teuthology.orchestra.run.smithi102.stderr: 96.9% -- replaced with /var/log/ceph/ceph-client.admin.206659.log.gz 2023-11-13T18:44:20.761 INFO:teuthology.orchestra.run.smithi102.stderr: 94.8% -- replaced with /var/log/ceph/ceph-client.admin.101572.log.gz 2023-11-13T18:44:23.916 INFO:teuthology.orchestra.run.smithi102.stderr: 96.8% -- replaced with /var/log/ceph/ceph-client.admin.119709.log.gz 2023-11-13T18:44:24.371 INFO:teuthology.orchestra.run.smithi102.stderr: 97.1% -- replaced with /var/log/ceph/ceph-client.admin.115101.log.gz 2023-11-13T18:44:25.000 INFO:teuthology.orchestra.run.smithi102.stderr: 95.8% -- replaced with /var/log/ceph/ceph-client.admin.203952.log.gz 2023-11-13T18:44:26.488 INFO:teuthology.orchestra.run.smithi102.stderr: 96.7% -- replaced with /var/log/ceph/ceph-client.admin.114651.log.gz 2023-11-13T18:44:26.515 INFO:teuthology.orchestra.run.smithi102.stderr: 97.2% -- replaced with /var/log/ceph/ceph-client.admin.309658.log.gz 2023-11-13T18:44:26.718 INFO:teuthology.orchestra.run.smithi102.stderr: 96.8% -- replaced with /var/log/ceph/ceph-client.admin.225393.log.gz 2023-11-13T18:44:27.452 INFO:teuthology.orchestra.run.smithi102.stderr: 97.0% -- replaced with /var/log/ceph/ceph-client.admin.113793.log.gz 2023-11-13T18:44:28.958 INFO:teuthology.orchestra.run.smithi102.stderr: 97.4% -- replaced with /var/log/ceph/ceph-client.admin.88720.log.gz 2023-11-13T18:44:29.093 INFO:teuthology.orchestra.run.smithi102.stderr: 97.4% -- replaced with /var/log/ceph/ceph-client.admin.225853.log.gz 2023-11-13T18:44:29.099 INFO:teuthology.orchestra.run.smithi102.stderr: 97.6% -- replaced with /var/log/ceph/ceph-client.admin.115953.log.gz 2023-11-13T18:44:29.390 INFO:teuthology.orchestra.run.smithi102.stderr: 97.2% -- replaced with /var/log/ceph/ceph-client.admin.334187.log.gz 2023-11-13T18:44:30.267 INFO:teuthology.orchestra.run.smithi102.stderr: 97.6% -- replaced with /var/log/ceph/ceph-client.admin.340848.log.gz 2023-11-13T18:44:31.590 INFO:teuthology.orchestra.run.smithi102.stderr: 92.8% -- replaced with /var/log/ceph/ceph-client.admin.216517.log.gz 2023-11-13T18:44:32.229 INFO:teuthology.orchestra.run.smithi102.stderr: 97.2% -- replaced with /var/log/ceph/ceph-client.admin.310147.log.gz 2023-11-13T18:44:32.374 INFO:teuthology.orchestra.run.smithi102.stderr: 97.0% -- replaced with /var/log/ceph/ceph-client.admin.98722.log.gz 2023-11-13T18:44:32.574 INFO:teuthology.orchestra.run.smithi102.stderr: 97.2% -- replaced with /var/log/ceph/ceph-client.admin.88306.log.gz 2023-11-13T18:44:32.646 INFO:teuthology.orchestra.run.smithi154.stderr: 93.7% -- replaced with /var/log/ceph/ceph-osd.4.log.gz 2023-11-13T18:44:32.935 INFO:teuthology.orchestra.run.smithi102.stderr: 96.6% -- replaced with /var/log/ceph/ceph-client.admin.98264.log.gz 2023-11-13T18:44:33.920 INFO:teuthology.orchestra.run.smithi102.stderr: 97.2% -- replaced with /var/log/ceph/ceph-client.admin.89997.log.gz 2023-11-13T18:44:33.927 INFO:teuthology.orchestra.run.smithi102.stderr: 97.6% -- replaced with /var/log/ceph/ceph-client.admin.254971.log.gz 2023-11-13T18:44:34.770 INFO:teuthology.orchestra.run.smithi102.stderr: 96.9% -- replaced with /var/log/ceph/ceph-client.admin.93072.log.gz 2023-11-13T18:44:36.261 INFO:teuthology.orchestra.run.smithi102.stderr: 97.4% -- replaced with /var/log/ceph/ceph-client.admin.414741.log.gz 2023-11-13T18:44:37.531 INFO:teuthology.orchestra.run.smithi102.stderr: 97.7% -- replaced with /var/log/ceph/ceph-client.admin.309242.log.gz 2023-11-13T18:44:40.841 INFO:teuthology.orchestra.run.smithi102.stderr: 97.3% -- replaced with /var/log/ceph/ceph-client.admin.385453.log.gz 2023-11-13T18:44:42.538 INFO:teuthology.orchestra.run.smithi102.stderr: 95.3% -- replaced with /var/log/ceph/ceph-client.admin.434698.log.gz 2023-11-13T18:44:43.981 INFO:teuthology.orchestra.run.smithi154.stderr: 92.3% -- replaced with /var/log/ceph/ceph-mon.c.log.gz 2023-11-13T18:44:45.735 INFO:teuthology.orchestra.run.smithi102.stderr: 96.0% -- replaced with /var/log/ceph/ceph-client.admin.203060.log.gz 2023-11-13T18:44:46.627 INFO:teuthology.orchestra.run.smithi154.stderr: 92.4% -- replaced with /var/log/ceph/ceph-mon.b.log.gz 2023-11-13T18:44:47.604 INFO:teuthology.orchestra.run.smithi102.stderr: 95.7% -- replaced with /var/log/ceph/ceph-client.admin.375456.log.gz 2023-11-13T18:44:51.543 INFO:teuthology.orchestra.run.smithi102.stderr: 96.9% -- replaced with /var/log/ceph/ceph-client.admin.222931.log.gz 2023-11-13T18:44:53.658 INFO:teuthology.orchestra.run.smithi102.stderr: 95.4% -- replaced with /var/log/ceph/ceph-client.admin.94736.log.gz 2023-11-13T18:45:09.215 INFO:teuthology.orchestra.run.smithi102.stderr: 93.9% -- replaced with /var/log/ceph/ceph-client.admin.456428.log.gz 2023-11-13T18:45:25.594 INFO:teuthology.orchestra.run.smithi102.stderr: 97.6% -- replaced with /var/log/ceph/ceph-client.admin.377440.log.gz 2023-11-13T18:45:25.749 INFO:teuthology.orchestra.run.smithi102.stderr: 95.1% -- replaced with /var/log/ceph/ceph-client.admin.220550.log.gz 2023-11-13T18:45:28.839 INFO:teuthology.orchestra.run.smithi102.stderr: 97.9% -- replaced with /var/log/ceph/ceph-client.admin.454341.log.gz 2023-11-13T18:45:45.694 INFO:teuthology.orchestra.run.smithi102.stderr: 97.2% -- replaced with /var/log/ceph/ceph-client.admin.104862.log.gz 2023-11-13T18:46:12.079 INFO:teuthology.orchestra.run.smithi102.stderr: 94.0% -- replaced with /var/log/ceph/ceph-client.admin.91999.log.gz 2023-11-13T18:46:13.699 INFO:teuthology.orchestra.run.smithi154.stderr: 93.7% -- replaced with /var/log/ceph/ceph-osd.7.log.gz 2023-11-13T18:46:21.825 INFO:teuthology.orchestra.run.smithi154.stderr: 93.7% -- replaced with /var/log/ceph/ceph-osd.5.log.gz 2023-11-13T18:46:21.828 INFO:teuthology.orchestra.run.smithi154.stderr: 2023-11-13T18:46:21.829 INFO:teuthology.orchestra.run.smithi154.stderr:real 2m36.942s 2023-11-13T18:46:21.830 INFO:teuthology.orchestra.run.smithi154.stderr:user 3m0.699s 2023-11-13T18:46:21.830 INFO:teuthology.orchestra.run.smithi154.stderr:sys 0m19.112s 2023-11-13T18:46:29.904 INFO:teuthology.orchestra.run.smithi102.stderr: 94.4% -- replaced with /var/log/ceph/ceph-client.admin.448161.log.gz 2023-11-13T18:46:29.909 INFO:teuthology.orchestra.run.smithi102.stderr: 94.4% -- replaced with /var/log/ceph/ceph-client.admin.228914.log.gz 2023-11-13T18:46:39.635 INFO:teuthology.orchestra.run.smithi102.stderr: 94.4% -- replaced with /var/log/ceph/ceph-client.admin.162551.log.gz 2023-11-13T18:46:57.214 INFO:teuthology.orchestra.run.smithi102.stderr: 94.5% -- replaced with /var/log/ceph/ceph-client.admin.130687.log.gz 2023-11-13T18:47:01.943 INFO:teuthology.orchestra.run.smithi102.stderr: 96.3% -- replaced with /var/log/ceph/ceph-client.admin.326491.log.gz 2023-11-13T18:48:28.465 INFO:teuthology.orchestra.run.smithi102.stderr: 94.2% -- replaced with /var/log/ceph/ceph-client.admin.163016.log.gz 2023-11-13T18:49:18.727 INFO:teuthology.orchestra.run.smithi102.stderr: 96.3% -- replaced with /var/log/ceph/ceph-client.admin.203498.log.gz 2023-11-13T18:49:29.457 INFO:teuthology.orchestra.run.smithi102.stderr: 93.7% -- replaced with /var/log/ceph/ceph-client.admin.92217.log.gz 2023-11-13T18:49:32.005 INFO:teuthology.orchestra.run.smithi102.stderr: 91.9% -- replaced with /var/log/ceph/ceph-mgr.y.log.gz 2023-11-13T18:49:48.199 INFO:teuthology.orchestra.run.smithi102.stderr: 94.6% -- replaced with /var/log/ceph/ceph-client.admin.139758.log.gz 2023-11-13T18:50:04.481 INFO:teuthology.orchestra.run.smithi102.stderr: 95.3% -- replaced with /var/log/ceph/ceph-client.admin.343453.log.gz 2023-11-13T18:50:25.071 INFO:teuthology.orchestra.run.smithi102.stderr: 93.9% -- replaced with /var/log/ceph/ceph-client.admin.118841.log.gz 2023-11-13T18:52:53.723 INFO:teuthology.orchestra.run.smithi102.stderr: 95.3% -- replaced with /var/log/ceph/ceph-client.admin.87416.log.gz 2023-11-13T18:53:05.128 INFO:teuthology.orchestra.run.smithi102.stderr: 96.2% -- replaced with /var/log/ceph/ceph-client.admin.172111.log.gz 2023-11-13T18:53:14.623 INFO:teuthology.orchestra.run.smithi102.stderr: 94.0% -- replaced with /var/log/ceph/ceph-client.admin.143765.log.gz 2023-11-13T18:54:06.354 INFO:teuthology.orchestra.run.smithi102.stderr: 93.8% -- replaced with /var/log/ceph/ceph-client.admin.89535.log.gz 2023-11-13T18:55:10.899 INFO:teuthology.orchestra.run.smithi102.stderr: 95.2% -- replaced with /var/log/ceph/ceph-client.admin.378301.log.gz 2023-11-13T18:55:41.960 INFO:teuthology.orchestra.run.smithi102.stderr: 94.4% -- replaced with /var/log/ceph/ceph-client.admin.447698.log.gz 2023-11-13T18:56:48.446 INFO:teuthology.orchestra.run.smithi102.stderr: 93.5% -- replaced with /var/log/ceph/ceph-client.admin.476365.log.gz 2023-11-13T18:59:31.214 INFO:teuthology.orchestra.run.smithi102.stderr: 93.3% -- replaced with /var/log/ceph/ceph-client.admin.217915.log.gz 2023-11-13T19:00:59.589 INFO:teuthology.orchestra.run.smithi102.stderr: 97.1% -- replaced with /var/log/ceph/ceph-client.admin.238309.log.gz 2023-11-13T19:02:32.152 INFO:teuthology.orchestra.run.smithi102.stderr: 92.1% -- replaced with /var/log/ceph/ceph-client.admin.90452.log.gz 2023-11-13T19:03:28.379 INFO:teuthology.orchestra.run.smithi102.stderr: 90.5% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2023-11-13T19:04:03.412 INFO:teuthology.orchestra.run.smithi102.stderr: 96.1% -- replaced with /var/log/ceph/ceph-client.admin.349972.log.gz 2023-11-13T19:04:12.219 INFO:teuthology.orchestra.run.smithi102.stderr: 94.1% -- replaced with /var/log/ceph/ceph-client.admin.87866.log.gz 2023-11-13T19:06:34.135 INFO:teuthology.orchestra.run.smithi102.stderr: 92.1% -- replaced with /var/log/ceph/ceph-client.admin.472610.log.gz 2023-11-13T19:06:37.867 INFO:teuthology.orchestra.run.smithi102.stderr: 92.1% -- replaced with /var/log/ceph/ceph-client.admin.471327.log.gz 2023-11-13T19:09:41.941 INFO:teuthology.orchestra.run.smithi102.stderr: 92.2% -- replaced with /var/log/ceph/ceph-client.admin.468914.log.gz 2023-11-13T19:09:44.459 INFO:teuthology.orchestra.run.smithi102.stderr: 92.1% -- replaced with /var/log/ceph/ceph-client.admin.470196.log.gz 2023-11-13T19:09:48.734 INFO:teuthology.orchestra.run.smithi102.stderr: 92.1% -- replaced with /var/log/ceph/ceph-client.admin.467622.log.gz 2023-11-13T19:10:49.738 INFO:teuthology.orchestra.run.smithi102.stderr: 92.1% -- replaced with /var/log/ceph/ceph-client.admin.461964.log.gz 2023-11-13T19:10:59.681 INFO:teuthology.orchestra.run.smithi102.stderr: 92.1% -- replaced with /var/log/ceph/ceph-client.admin.465006.log.gz 2023-11-13T19:11:01.186 INFO:teuthology.orchestra.run.smithi102.stderr: 92.1% -- replaced with /var/log/ceph/ceph-client.admin.474995.log.gz 2023-11-13T19:11:02.803 INFO:teuthology.orchestra.run.smithi102.stderr: 92.1% -- replaced with /var/log/ceph/ceph-client.admin.473817.log.gz 2023-11-13T19:12:34.696 INFO:teuthology.orchestra.run.smithi102.stderr: 92.2% -- replaced with /var/log/ceph/ceph-client.admin.466266.log.gz 2023-11-13T19:13:26.130 INFO:teuthology.orchestra.run.smithi102.stderr: 93.7% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2023-11-13T19:15:21.757 INFO:teuthology.orchestra.run.smithi102.stderr: 95.5% -- replaced with /var/log/ceph/ceph-client.admin.257836.log.gz 2023-11-13T19:18:06.302 INFO:teuthology.orchestra.run.smithi102.stderr: 95.1% -- replaced with /var/log/ceph/ceph-client.admin.169527.log.gz 2023-11-13T19:20:24.391 INFO:teuthology.orchestra.run.smithi102.stderr: 95.8% -- replaced with /var/log/ceph/ceph-client.admin.407879.log.gz 2023-11-13T19:33:58.301 INFO:teuthology.orchestra.run.smithi102.stderr: 94.4% -- replaced with /var/log/ceph/ceph-client.admin.400151.log.gz 2023-11-13T19:34:31.542 INFO:teuthology.orchestra.run.smithi102.stderr: 92.0% -- replaced with /var/log/ceph/ceph-client.admin.248185.log.gz 2023-11-13T19:34:46.503 INFO:teuthology.orchestra.run.smithi102.stderr: 94.4% -- replaced with /var/log/ceph/ceph-client.admin.400892.log.gz 2023-11-13T19:35:36.176 INFO:teuthology.orchestra.run.smithi102.stderr: 93.6% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2023-11-13T19:37:29.504 INFO:teuthology.orchestra.run.smithi102.stderr: 93.8% -- replaced with /var/log/ceph/ceph-osd.3.log.gz 2023-11-13T19:39:27.570 INFO:teuthology.orchestra.run.smithi102.stderr: 93.6% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2023-11-13T19:39:37.324 INFO:teuthology.orchestra.run.smithi102.stderr: 91.6% -- replaced with /var/log/ceph/ceph-mds.a.log.gz 2023-11-13T19:40:22.468 INFO:teuthology.orchestra.run.smithi102.stderr: 93.6% -- replaced with /var/log/ceph/ceph-client.admin.136596.log.gz 2023-11-13T19:57:20.797 INFO:teuthology.orchestra.run.smithi102.stderr: 95.7% -- replaced with /var/log/ceph/ceph-client.admin.120542.log.gz 2023-11-13T20:07:23.892 INFO:teuthology.orchestra.run.smithi102.stderr: 91.7% -- replaced with /var/log/ceph/ceph-client.admin.486726.log.gz 2023-11-13T20:07:23.895 INFO:teuthology.orchestra.run.smithi102.stderr: 2023-11-13T20:07:23.895 INFO:teuthology.orchestra.run.smithi102.stderr:real 83m39.049s 2023-11-13T20:07:23.896 INFO:teuthology.orchestra.run.smithi102.stderr:user 48m2.108s 2023-11-13T20:07:23.896 INFO:teuthology.orchestra.run.smithi102.stderr:sys 7m24.700s 2023-11-13T20:07:23.898 INFO:tasks.ceph:Archiving logs... 2023-11-13T20:07:23.899 DEBUG:teuthology.misc:Transferring archived files from smithi102:/var/log/ceph to /home/teuthworker/archive/mchangir-2023-11-13_10:27:15-fs-wip-mchangir-testing-20231110.052303-testing-default-smithi/7456244/remote/smithi102/log 2023-11-13T20:07:23.901 DEBUG:teuthology.orchestra.run.smithi102:> sudo tar c -f - -C /var/log/ceph -- . 2023-11-13T20:15:03.654 DEBUG:teuthology.misc:Transferring archived files from smithi154:/var/log/ceph to /home/teuthworker/archive/mchangir-2023-11-13_10:27:15-fs-wip-mchangir-testing-20231110.052303-testing-default-smithi/7456244/remote/smithi154/log 2023-11-13T20:15:03.657 DEBUG:teuthology.orchestra.run.smithi154:> sudo tar c -f - -C /var/log/ceph -- . 2023-11-13T20:17:03.203 DEBUG:teuthology.run_tasks:Unwinding manager install 2023-11-13T20:17:03.212 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2023-11-13T20:17:03.213 DEBUG:teuthology.orchestra.run.smithi102:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2023-11-13T20:17:03.221 DEBUG:teuthology.orchestra.run.smithi154:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2023-11-13T20:17:03.300 DEBUG:teuthology.run_tasks:Unwinding manager clock 2023-11-13T20:17:03.309 INFO:teuthology.task.clock:Checking final clock skew... 2023-11-13T20:17:03.309 DEBUG:teuthology.orchestra.run.smithi102:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-11-13T20:17:03.317 DEBUG:teuthology.orchestra.run.smithi154:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-11-13T20:17:03.385 INFO:teuthology.orchestra.run.smithi154.stdout: remote refid st t when poll reach delay offset jitter 2023-11-13T20:17:03.385 INFO:teuthology.orchestra.run.smithi154.stdout:============================================================================== 2023-11-13T20:17:03.385 INFO:teuthology.orchestra.run.smithi154.stdout:*hv01.front.sepi 44.4.53.2 2 u 571 1024 377 0.193 -3.911 4.928 2023-11-13T20:17:03.385 INFO:teuthology.orchestra.run.smithi154.stdout:+hv02.front.sepi 63.231.80.2 3 u 739 1024 377 0.222 -3.599 5.514 2023-11-13T20:17:03.386 INFO:teuthology.orchestra.run.smithi154.stdout:+hv03.front.sepi 74.6.168.72 3 u 622 1024 377 0.225 -1.663 2.861 2023-11-13T20:17:03.386 INFO:teuthology.orchestra.run.smithi154.stdout: hv04.front.sepi .INIT. 16 u - 1024 0 0.000 +0.000 0.000 2023-11-13T20:17:03.427 INFO:teuthology.orchestra.run.smithi102.stdout: remote refid st t when poll reach delay offset jitter 2023-11-13T20:17:03.427 INFO:teuthology.orchestra.run.smithi102.stdout:============================================================================== 2023-11-13T20:17:03.427 INFO:teuthology.orchestra.run.smithi102.stdout:*hv01.front.sepi 44.4.53.2 2 u 742 1024 377 0.209 -0.835 1.565 2023-11-13T20:17:03.427 INFO:teuthology.orchestra.run.smithi102.stdout:+hv02.front.sepi 63.231.80.2 3 u 735 1024 377 0.227 +0.288 1.478 2023-11-13T20:17:03.428 INFO:teuthology.orchestra.run.smithi102.stdout:+hv03.front.sepi 74.6.168.72 3 u 734 1024 377 0.230 +1.394 1.595 2023-11-13T20:17:03.428 INFO:teuthology.orchestra.run.smithi102.stdout: hv04.front.sepi .INIT. 16 u - 1024 0 0.000 +0.000 0.000 2023-11-13T20:17:03.429 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2023-11-13T20:17:03.437 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2023-11-13T20:17:03.439 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2023-11-13T20:17:03.448 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2023-11-13T20:17:03.462 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2023-11-13T20:17:03.470 INFO:teuthology.task.internal:Duration was 32453.225710 seconds 2023-11-13T20:17:03.471 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2023-11-13T20:17:03.494 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2023-11-13T20:17:03.495 DEBUG:teuthology.orchestra.run.smithi102:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2023-11-13T20:17:03.502 DEBUG:teuthology.orchestra.run.smithi154:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2023-11-13T20:17:03.832 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2023-11-13T20:17:03.832 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi102.front.sepia.ceph.com 2023-11-13T20:17:03.833 DEBUG:teuthology.orchestra.run.smithi102:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2023-11-13T20:17:03.898 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi154.front.sepia.ceph.com 2023-11-13T20:17:03.898 DEBUG:teuthology.orchestra.run.smithi154:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2023-11-13T20:17:03.932 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2023-11-13T20:17:03.933 DEBUG:teuthology.orchestra.run.smithi102:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-11-13T20:17:03.941 DEBUG:teuthology.orchestra.run.smithi154:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-11-13T20:17:04.163 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2023-11-13T20:17:04.163 DEBUG:teuthology.orchestra.run.smithi102:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2023-11-13T20:17:04.171 DEBUG:teuthology.orchestra.run.smithi154:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2023-11-13T20:17:05.204 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2023-11-13T20:17:05.214 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2023-11-13T20:17:05.215 DEBUG:teuthology.orchestra.run.smithi102:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2023-11-13T20:17:05.271 DEBUG:teuthology.orchestra.run.smithi154:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2023-11-13T20:17:05.353 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2023-11-13T20:17:05.362 DEBUG:teuthology.orchestra.run.smithi102:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2023-11-13T20:17:05.369 DEBUG:teuthology.orchestra.run.smithi154:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2023-11-13T20:17:05.403 INFO:teuthology.orchestra.run.smithi154.stdout:kernel.core_pattern = core 2023-11-13T20:17:05.412 INFO:teuthology.orchestra.run.smithi102.stdout:kernel.core_pattern = core 2023-11-13T20:17:05.488 DEBUG:teuthology.orchestra.run.smithi102:> test -e /home/ubuntu/cephtest/archive/coredump 2023-11-13T20:17:05.507 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-13T20:17:05.508 DEBUG:teuthology.orchestra.run.smithi154:> test -e /home/ubuntu/cephtest/archive/coredump 2023-11-13T20:17:05.516 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-13T20:17:05.517 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2023-11-13T20:17:05.526 INFO:teuthology.task.internal:Transferring archived files... 2023-11-13T20:17:05.527 DEBUG:teuthology.misc:Transferring archived files from smithi102:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/mchangir-2023-11-13_10:27:15-fs-wip-mchangir-testing-20231110.052303-testing-default-smithi/7456244/remote/smithi102 2023-11-13T20:17:05.527 DEBUG:teuthology.orchestra.run.smithi102:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2023-11-13T20:17:05.615 DEBUG:teuthology.misc:Transferring archived files from smithi154:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/mchangir-2023-11-13_10:27:15-fs-wip-mchangir-testing-20231110.052303-testing-default-smithi/7456244/remote/smithi154 2023-11-13T20:17:05.615 DEBUG:teuthology.orchestra.run.smithi154:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2023-11-13T20:17:05.643 INFO:teuthology.task.internal:Removing archive directory... 2023-11-13T20:17:05.643 DEBUG:teuthology.orchestra.run.smithi102:> rm -rf -- /home/ubuntu/cephtest/archive 2023-11-13T20:17:05.661 DEBUG:teuthology.orchestra.run.smithi154:> rm -rf -- /home/ubuntu/cephtest/archive 2023-11-13T20:17:05.694 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2023-11-13T20:17:05.704 INFO:teuthology.task.internal:Not uploading archives. 2023-11-13T20:17:05.705 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2023-11-13T20:17:05.714 INFO:teuthology.task.internal:Tidying up after the test... 2023-11-13T20:17:05.714 DEBUG:teuthology.orchestra.run.smithi102:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2023-11-13T20:17:05.725 DEBUG:teuthology.orchestra.run.smithi154:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2023-11-13T20:17:05.740 INFO:teuthology.orchestra.run.smithi102.stdout: 655432 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Nov 13 20:17 /home/ubuntu/cephtest 2023-11-13T20:17:05.746 INFO:teuthology.orchestra.run.smithi154.stdout: 658042 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Nov 13 20:17 /home/ubuntu/cephtest 2023-11-13T20:17:05.752 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2023-11-13T20:17:05.761 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2023-11-13T20:17:05.780 INFO:teuthology.nuke:Checking targets against current locks 2023-11-13T20:17:05.806 DEBUG:teuthology.nuke:shortname: smithi102 2023-11-13T20:17:05.807 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-11-13T20:17:05.831 DEBUG:teuthology.nuke:shortname: smithi154 2023-11-13T20:17:05.832 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-11-13T20:17:05.835 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi102.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/mchangir-2023-11-13_10:27:15-fs-wip-mchangir-testing-20231110.052303-testing-default-smithi/7456244', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-11-13 11:06:20.728869', 'locked_by': 'mchangir', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBBcI2TSV0qNd3ch5a4V0vVrn/qrvbcXY5EvKVSqfgxKssxe7YmgPyNbPgkMrTHjeTHRtcG4DzJjr16P5Wl3BdR4='} 2023-11-13T20:17:05.860 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi154.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/mchangir-2023-11-13_10:27:15-fs-wip-mchangir-testing-20231110.052303-testing-default-smithi/7456244', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-11-13 11:06:20.730149', 'locked_by': 'mchangir', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBA/UR6tY53tV/hRttaw/xRNVkHsaF9+RzBacTuDQ8FbEkk+ZJpl2LrtnIQHlRgvBJ9kiTJfKmB/+kxyKYllN5Zs='} 2023-11-13T20:17:05.889 INFO:teuthology.orchestra.console.smithi102:Power off 2023-11-13T20:17:05.891 DEBUG:teuthology.orchestra.console.smithi102:pexpect command: ipmitool -H smithi102.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-11-13T20:17:05.914 DEBUG:teuthology.orchestra.console.smithi102:power off output: Chassis Power Control: Down/Off 2023-11-13T20:17:05.914 DEBUG:teuthology.orchestra.console.smithi102:pexpect command: ipmitool -H smithi102.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-13T20:17:05.928 INFO:teuthology.orchestra.console.smithi154:Power off 2023-11-13T20:17:05.929 DEBUG:teuthology.orchestra.console.smithi154:pexpect command: ipmitool -H smithi154.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-11-13T20:17:05.938 DEBUG:teuthology.orchestra.console.smithi102:check power output: Chassis Power is on 2023-11-13T20:17:05.949 DEBUG:teuthology.orchestra.console.smithi154:power off output: Chassis Power Control: Down/Off 2023-11-13T20:17:05.950 DEBUG:teuthology.orchestra.console.smithi154:pexpect command: ipmitool -H smithi154.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-13T20:17:05.969 DEBUG:teuthology.orchestra.console.smithi154:check power output: Chassis Power is on 2023-11-13T20:17:09.939 DEBUG:teuthology.orchestra.console.smithi102:pexpect command: ipmitool -H smithi102.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-13T20:17:09.971 DEBUG:teuthology.orchestra.console.smithi154:pexpect command: ipmitool -H smithi154.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-13T20:17:10.050 DEBUG:teuthology.orchestra.console.smithi102:check power output: Chassis Power is on 2023-11-13T20:17:10.079 DEBUG:teuthology.orchestra.console.smithi154:check power output: Chassis Power is on 2023-11-13T20:17:14.056 DEBUG:teuthology.orchestra.console.smithi102:pexpect command: ipmitool -H smithi102.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-13T20:17:14.080 DEBUG:teuthology.orchestra.console.smithi154:pexpect command: ipmitool -H smithi154.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-13T20:17:14.168 DEBUG:teuthology.orchestra.console.smithi102:check power output: Chassis Power is off 2023-11-13T20:17:14.190 DEBUG:teuthology.orchestra.console.smithi154:check power output: Chassis Power is on 2023-11-13T20:17:14.270 INFO:teuthology.orchestra.console.smithi102:Power off completed 2023-11-13T20:17:18.195 DEBUG:teuthology.orchestra.console.smithi154:pexpect command: ipmitool -H smithi154.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-13T20:17:18.306 DEBUG:teuthology.orchestra.console.smithi154:check power output: Chassis Power is off 2023-11-13T20:17:18.407 INFO:teuthology.orchestra.console.smithi154:Power off completed 2023-11-13T20:17:18.513 INFO:teuthology.run:Summary data: description: fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/fuse objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/xfstests-dev} duration: 32453.225710392 failure_reason: 'Test failure: test_generic (tasks.cephfs.tests_from_xfstests_dev.TestXFSTestsDev)' flavor: default mon.a-kernel-sha1: 5b73517e0e2fa132ea79290e5fc06ea5349b2288 mon.b-kernel-sha1: 5b73517e0e2fa132ea79290e5fc06ea5349b2288 owner: mchangir sentry_event: https://sentry.ceph.com/organizations/ceph/?query=c848065eac2a4544a254695547c30336 status: fail success: false 2023-11-13T20:17:18.513 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-13T20:17:18.601 INFO:teuthology.run:FAIL